2026/07/07 10:48:11 Test passed > Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/07/26 10:47:20.553 Create an experiment with name E2EExperiment-1783421240553210506 < Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/07/26 10:47:20.831 (278ms) > Enter [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/07/26 10:47:20.831 ################### Setup before each Pipeline Upload test ##################### ################### Global Setup before each test ##################### Test Context: 0x94b122b2400 Looks like test-secret-1 already exists, because creation failed due to secrets "test-secret-1" already exists Looks like test-secret-2 already exists, because creation failed due to secrets "test-secret-2" already exists Looks like test-secret-3 already exists, because creation failed due to secrets "test-secret-3" already exists < Exit [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/07/26 10:47:20.97 (139ms) > Enter [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/07/26 10:47:20.97 Uploading pipeline file essential/component_with_pip_index_urls.yaml Creating temp pipeline file with overridden SDK Version Uploading pipeline with name=e2e-test-1783421240831537690, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml Upload of pipeline file 'essential/component_with_pip_index_urls.yaml' successful Listing pipeline versions for pipeline aa39298e-db42-486e-abd0-323dc89a582c Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml Returning pipeline run time inputs map[] Create run for pipeline with id: 'aa39298e-db42-486e-abd0-323dc89a582c' and name: 'e2e-test-1783421240831537690' Create a pipeline run for pipeline with id=aa39298e-db42-486e-abd0-323dc89a582c and versionId=804f6682-cebc-48da-a5d5-5e8b196c36ec Create a pipeline run body Created Pipeline Run successfully with runId=ca96ae65-7f23-4ece-a515-08cc0cc317c9 Created Pipeline Run with id: ca96ae65-7f23-4ece-a515-08cc0cc317c9 for pipeline with id: aa39298e-db42-486e-abd0-323dc89a582c Waiting for pipeline run with id=ca96ae65-7f23-4ece-a515-08cc0cc317c9 to be in one of '[SUCCEEDED SKIPPED FAILED CANCELED]' Get a pipeline run with id=ca96ae65-7f23-4ece-a515-08cc0cc317c9 Pipeline run with id=ca96ae65-7f23-4ece-a515-08cc0cc317c9 is in PENDING state, waiting... Get a pipeline run with id=ca96ae65-7f23-4ece-a515-08cc0cc317c9 Pipeline run with id=ca96ae65-7f23-4ece-a515-08cc0cc317c9 is in RUNNING state, waiting... Get a pipeline run with id=ca96ae65-7f23-4ece-a515-08cc0cc317c9 Pipeline run with id=ca96ae65-7f23-4ece-a515-08cc0cc317c9 is in RUNNING state, waiting... Get a pipeline run with id=ca96ae65-7f23-4ece-a515-08cc0cc317c9 Pipeline run with id=ca96ae65-7f23-4ece-a515-08cc0cc317c9 is in RUNNING state, waiting... Get a pipeline run with id=ca96ae65-7f23-4ece-a515-08cc0cc317c9 Pipeline run with id=ca96ae65-7f23-4ece-a515-08cc0cc317c9 is in RUNNING state, waiting... Get a pipeline run with id=ca96ae65-7f23-4ece-a515-08cc0cc317c9 Pipeline run with id=ca96ae65-7f23-4ece-a515-08cc0cc317c9 is in RUNNING state, waiting... Get a pipeline run with id=ca96ae65-7f23-4ece-a515-08cc0cc317c9 Pipeline run with id=ca96ae65-7f23-4ece-a515-08cc0cc317c9 is in RUNNING state, waiting... Get a pipeline run with id=ca96ae65-7f23-4ece-a515-08cc0cc317c9 Pipeline run with id=ca96ae65-7f23-4ece-a515-08cc0cc317c9 is in RUNNING state, waiting... Get a pipeline run with id=ca96ae65-7f23-4ece-a515-08cc0cc317c9 Pipeline run with id=ca96ae65-7f23-4ece-a515-08cc0cc317c9 is in RUNNING state, waiting... Get a pipeline run with id=ca96ae65-7f23-4ece-a515-08cc0cc317c9 Pipeline run with id=ca96ae65-7f23-4ece-a515-08cc0cc317c9 is in RUNNING state, waiting... Get a pipeline run with id=ca96ae65-7f23-4ece-a515-08cc0cc317c9 Pipeline run with id=ca96ae65-7f23-4ece-a515-08cc0cc317c9 reached expected state SUCCEEDED Deserializing expected compiled workflow file 'essential/component_with_pip_index_urls.yaml' for the pipeline Unmarshalling Expected Workflow YAML Unmarshalled Expected Workflow YAML Fetching updated pipeline run details for run with id=ca96ae65-7f23-4ece-a515-08cc0cc317c9 Get a pipeline run with id=ca96ae65-7f23-4ece-a515-08cc0cc317c9 Updated pipeline run details Pipeline run succeeded, checking if the number of tasks are what is expected < Exit [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/07/26 10:48:11.483 (50.512s) > Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/07/26 10:48:11.483 ################### Global Cleanup after each test ##################### Deleting 1 run(s) Terminate run ca96ae65-7f23-4ece-a515-08cc0cc317c9 Failed to terminate run ca96ae65-7f23-4ece-a515-08cc0cc317c9 Terminate run ca96ae65-7f23-4ece-a515-08cc0cc317c9 Deleting run ca96ae65-7f23-4ece-a515-08cc0cc317c9 Deleting 0 experiment(s) Deleting 1 pipeline(s) Deleting pipeline with id=aa39298e-db42-486e-abd0-323dc89a582c (cascade=true) Pipeline with id=aa39298e-db42-486e-abd0-323dc89a582c, DELETED < Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/07/26 10:48:11.648 (165ms) > Enter [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/07/26 10:48:11.648 < Exit [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/07/26 10:48:11.648 (0s) > Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/07/26 10:48:11.649 < Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/07/26 10:48:11.649 (0s) 2026/07/07 10:48:56 Test passed > Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/07/26 10:47:20.552 Create an experiment with name E2EExperiment-1783421240552739453 < Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/07/26 10:47:20.824 (272ms) > Enter [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/07/26 10:47:20.824 ################### Setup before each Pipeline Upload test ##################### ################### Global Setup before each test ##################### Test Context: 0xd5cab8b4500 Looks like test-secret-1 already exists, because creation failed due to secrets "test-secret-1" already exists Looks like test-secret-2 already exists, because creation failed due to secrets "test-secret-2" already exists Looks like test-secret-3 already exists, because creation failed due to secrets "test-secret-3" already exists < Exit [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/07/26 10:47:20.967 (143ms) > Enter [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/07/26 10:47:20.967 Uploading pipeline file critical/parallel_for_after_dependency.yaml Creating temp pipeline file with overridden SDK Version Uploading pipeline with name=e2e-test-1783421240824600900, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml Upload of pipeline file 'critical/parallel_for_after_dependency.yaml' successful Listing pipeline versions for pipeline a9e43624-c978-4f87-8c4b-a0b1d96e0693 Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml Returning pipeline run time inputs map[] Create run for pipeline with id: 'a9e43624-c978-4f87-8c4b-a0b1d96e0693' and name: 'e2e-test-1783421240824600900' Create a pipeline run for pipeline with id=a9e43624-c978-4f87-8c4b-a0b1d96e0693 and versionId=7510fc67-05db-4ef8-a77d-0369bb5c9f2d Create a pipeline run body Created Pipeline Run successfully with runId=35801a79-dc1e-4a6b-94bb-4460baf8d993 Created Pipeline Run with id: 35801a79-dc1e-4a6b-94bb-4460baf8d993 for pipeline with id: a9e43624-c978-4f87-8c4b-a0b1d96e0693 Waiting for pipeline run with id=35801a79-dc1e-4a6b-94bb-4460baf8d993 to be in one of '[SUCCEEDED SKIPPED FAILED CANCELED]' Get a pipeline run with id=35801a79-dc1e-4a6b-94bb-4460baf8d993 Pipeline run with id=35801a79-dc1e-4a6b-94bb-4460baf8d993 is in PENDING state, waiting... Get a pipeline run with id=35801a79-dc1e-4a6b-94bb-4460baf8d993 Pipeline run with id=35801a79-dc1e-4a6b-94bb-4460baf8d993 is in RUNNING state, waiting... Get a pipeline run with id=35801a79-dc1e-4a6b-94bb-4460baf8d993 Pipeline run with id=35801a79-dc1e-4a6b-94bb-4460baf8d993 is in RUNNING state, waiting... Get a pipeline run with id=35801a79-dc1e-4a6b-94bb-4460baf8d993 Pipeline run with id=35801a79-dc1e-4a6b-94bb-4460baf8d993 is in RUNNING state, waiting... Get a pipeline run with id=35801a79-dc1e-4a6b-94bb-4460baf8d993 Pipeline run with id=35801a79-dc1e-4a6b-94bb-4460baf8d993 is in RUNNING state, waiting... Get a pipeline run with id=35801a79-dc1e-4a6b-94bb-4460baf8d993 Pipeline run with id=35801a79-dc1e-4a6b-94bb-4460baf8d993 is in RUNNING state, waiting... Get a pipeline run with id=35801a79-dc1e-4a6b-94bb-4460baf8d993 Pipeline run with id=35801a79-dc1e-4a6b-94bb-4460baf8d993 is in RUNNING state, waiting... Get a pipeline run with id=35801a79-dc1e-4a6b-94bb-4460baf8d993 Pipeline run with id=35801a79-dc1e-4a6b-94bb-4460baf8d993 is in RUNNING state, waiting... Get a pipeline run with id=35801a79-dc1e-4a6b-94bb-4460baf8d993 Pipeline run with id=35801a79-dc1e-4a6b-94bb-4460baf8d993 is in RUNNING state, waiting... Get a pipeline run with id=35801a79-dc1e-4a6b-94bb-4460baf8d993 Pipeline run with id=35801a79-dc1e-4a6b-94bb-4460baf8d993 is in RUNNING state, waiting... Get a pipeline run with id=35801a79-dc1e-4a6b-94bb-4460baf8d993 Pipeline run with id=35801a79-dc1e-4a6b-94bb-4460baf8d993 is in RUNNING state, waiting... Get a pipeline run with id=35801a79-dc1e-4a6b-94bb-4460baf8d993 Pipeline run with id=35801a79-dc1e-4a6b-94bb-4460baf8d993 is in RUNNING state, waiting... Get a pipeline run with id=35801a79-dc1e-4a6b-94bb-4460baf8d993 Pipeline run with id=35801a79-dc1e-4a6b-94bb-4460baf8d993 is in RUNNING state, waiting... Get a pipeline run with id=35801a79-dc1e-4a6b-94bb-4460baf8d993 Pipeline run with id=35801a79-dc1e-4a6b-94bb-4460baf8d993 is in RUNNING state, waiting... Get a pipeline run with id=35801a79-dc1e-4a6b-94bb-4460baf8d993 Pipeline run with id=35801a79-dc1e-4a6b-94bb-4460baf8d993 is in RUNNING state, waiting... Get a pipeline run with id=35801a79-dc1e-4a6b-94bb-4460baf8d993 Pipeline run with id=35801a79-dc1e-4a6b-94bb-4460baf8d993 is in RUNNING state, waiting... Get a pipeline run with id=35801a79-dc1e-4a6b-94bb-4460baf8d993 Pipeline run with id=35801a79-dc1e-4a6b-94bb-4460baf8d993 is in RUNNING state, waiting... Get a pipeline run with id=35801a79-dc1e-4a6b-94bb-4460baf8d993 Pipeline run with id=35801a79-dc1e-4a6b-94bb-4460baf8d993 is in RUNNING state, waiting... Get a pipeline run with id=35801a79-dc1e-4a6b-94bb-4460baf8d993 Pipeline run with id=35801a79-dc1e-4a6b-94bb-4460baf8d993 is in RUNNING state, waiting... Get a pipeline run with id=35801a79-dc1e-4a6b-94bb-4460baf8d993 Pipeline run with id=35801a79-dc1e-4a6b-94bb-4460baf8d993 reached expected state SUCCEEDED Deserializing expected compiled workflow file 'critical/parallel_for_after_dependency.yaml' for the pipeline Unmarshalling Expected Workflow YAML Unmarshalled Expected Workflow YAML Fetching updated pipeline run details for run with id=35801a79-dc1e-4a6b-94bb-4460baf8d993 Get a pipeline run with id=35801a79-dc1e-4a6b-94bb-4460baf8d993 Updated pipeline run details Pipeline run succeeded, checking if the number of tasks are what is expected < Exit [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/07/26 10:48:56.486 (1m35.518s) > Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/07/26 10:48:56.486 ################### Global Cleanup after each test ##################### Deleting 1 run(s) Terminate run 35801a79-dc1e-4a6b-94bb-4460baf8d993 Failed to terminate run 35801a79-dc1e-4a6b-94bb-4460baf8d993 Terminate run 35801a79-dc1e-4a6b-94bb-4460baf8d993 Deleting run 35801a79-dc1e-4a6b-94bb-4460baf8d993 Deleting 0 experiment(s) Deleting 1 pipeline(s) Deleting pipeline with id=a9e43624-c978-4f87-8c4b-a0b1d96e0693 (cascade=true) Pipeline with id=a9e43624-c978-4f87-8c4b-a0b1d96e0693, DELETED < Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/07/26 10:48:56.657 (171ms) > Enter [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/07/26 10:48:56.657 < Exit [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/07/26 10:48:56.657 (0s) > Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/07/26 10:48:56.658 < Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/07/26 10:48:56.658 (0s) 2026/07/07 10:48:56 Test passed > Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/07/26 10:47:20.552 Create an experiment with name E2EExperiment-1783421240552907578 < Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/07/26 10:47:20.818 (266ms) > Enter [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/07/26 10:47:20.818 ################### Setup before each Pipeline Upload test ##################### ################### Global Setup before each test ##################### Test Context: 0x134c3e1cc280 test-secret-1 created test-secret-2 created test-secret-3 created < Exit [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/07/26 10:47:20.904 (86ms) > Enter [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/07/26 10:47:20.905 Uploading pipeline file critical/pipeline_with_artifact_upload_download.yaml Creating temp pipeline file with overridden SDK Version Uploading pipeline with name=e2e-test-1783421240818815992, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml Upload of pipeline file 'critical/pipeline_with_artifact_upload_download.yaml' successful Listing pipeline versions for pipeline 84c3d956-a4c3-42f3-83db-cb4f718bd0df Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml Returning pipeline run time inputs map[] Create run for pipeline with id: '84c3d956-a4c3-42f3-83db-cb4f718bd0df' and name: 'e2e-test-1783421240818815992' Create a pipeline run for pipeline with id=84c3d956-a4c3-42f3-83db-cb4f718bd0df and versionId=eb129510-ab68-472a-8022-68bbdb3dc026 Create a pipeline run body Created Pipeline Run successfully with runId=4d3cff5f-959e-4ea6-8dc9-d04525f75947 Created Pipeline Run with id: 4d3cff5f-959e-4ea6-8dc9-d04525f75947 for pipeline with id: 84c3d956-a4c3-42f3-83db-cb4f718bd0df Waiting for pipeline run with id=4d3cff5f-959e-4ea6-8dc9-d04525f75947 to be in one of '[SUCCEEDED SKIPPED FAILED CANCELED]' Get a pipeline run with id=4d3cff5f-959e-4ea6-8dc9-d04525f75947 Pipeline run with id=4d3cff5f-959e-4ea6-8dc9-d04525f75947 is in PENDING state, waiting... Get a pipeline run with id=4d3cff5f-959e-4ea6-8dc9-d04525f75947 Pipeline run with id=4d3cff5f-959e-4ea6-8dc9-d04525f75947 is in RUNNING state, waiting... Get a pipeline run with id=4d3cff5f-959e-4ea6-8dc9-d04525f75947 Pipeline run with id=4d3cff5f-959e-4ea6-8dc9-d04525f75947 is in RUNNING state, waiting... Get a pipeline run with id=4d3cff5f-959e-4ea6-8dc9-d04525f75947 Pipeline run with id=4d3cff5f-959e-4ea6-8dc9-d04525f75947 is in RUNNING state, waiting... Get a pipeline run with id=4d3cff5f-959e-4ea6-8dc9-d04525f75947 Pipeline run with id=4d3cff5f-959e-4ea6-8dc9-d04525f75947 is in RUNNING state, waiting... Get a pipeline run with id=4d3cff5f-959e-4ea6-8dc9-d04525f75947 Pipeline run with id=4d3cff5f-959e-4ea6-8dc9-d04525f75947 is in RUNNING state, waiting... Get a pipeline run with id=4d3cff5f-959e-4ea6-8dc9-d04525f75947 Pipeline run with id=4d3cff5f-959e-4ea6-8dc9-d04525f75947 is in RUNNING state, waiting... Get a pipeline run with id=4d3cff5f-959e-4ea6-8dc9-d04525f75947 Pipeline run with id=4d3cff5f-959e-4ea6-8dc9-d04525f75947 is in RUNNING state, waiting... Get a pipeline run with id=4d3cff5f-959e-4ea6-8dc9-d04525f75947 Pipeline run with id=4d3cff5f-959e-4ea6-8dc9-d04525f75947 is in RUNNING state, waiting... Get a pipeline run with id=4d3cff5f-959e-4ea6-8dc9-d04525f75947 Pipeline run with id=4d3cff5f-959e-4ea6-8dc9-d04525f75947 is in RUNNING state, waiting... Get a pipeline run with id=4d3cff5f-959e-4ea6-8dc9-d04525f75947 Pipeline run with id=4d3cff5f-959e-4ea6-8dc9-d04525f75947 is in RUNNING state, waiting... Get a pipeline run with id=4d3cff5f-959e-4ea6-8dc9-d04525f75947 Pipeline run with id=4d3cff5f-959e-4ea6-8dc9-d04525f75947 is in RUNNING state, waiting... Get a pipeline run with id=4d3cff5f-959e-4ea6-8dc9-d04525f75947 Pipeline run with id=4d3cff5f-959e-4ea6-8dc9-d04525f75947 is in RUNNING state, waiting... Get a pipeline run with id=4d3cff5f-959e-4ea6-8dc9-d04525f75947 Pipeline run with id=4d3cff5f-959e-4ea6-8dc9-d04525f75947 is in RUNNING state, waiting... Get a pipeline run with id=4d3cff5f-959e-4ea6-8dc9-d04525f75947 Pipeline run with id=4d3cff5f-959e-4ea6-8dc9-d04525f75947 is in RUNNING state, waiting... Get a pipeline run with id=4d3cff5f-959e-4ea6-8dc9-d04525f75947 Pipeline run with id=4d3cff5f-959e-4ea6-8dc9-d04525f75947 is in RUNNING state, waiting... Get a pipeline run with id=4d3cff5f-959e-4ea6-8dc9-d04525f75947 Pipeline run with id=4d3cff5f-959e-4ea6-8dc9-d04525f75947 is in RUNNING state, waiting... Get a pipeline run with id=4d3cff5f-959e-4ea6-8dc9-d04525f75947 Pipeline run with id=4d3cff5f-959e-4ea6-8dc9-d04525f75947 is in RUNNING state, waiting... Get a pipeline run with id=4d3cff5f-959e-4ea6-8dc9-d04525f75947 Pipeline run with id=4d3cff5f-959e-4ea6-8dc9-d04525f75947 is in RUNNING state, waiting... Get a pipeline run with id=4d3cff5f-959e-4ea6-8dc9-d04525f75947 Pipeline run with id=4d3cff5f-959e-4ea6-8dc9-d04525f75947 reached expected state SUCCEEDED Deserializing expected compiled workflow file 'critical/pipeline_with_artifact_upload_download.yaml' for the pipeline Unmarshalling Expected Workflow YAML Unmarshalled Expected Workflow YAML Fetching updated pipeline run details for run with id=4d3cff5f-959e-4ea6-8dc9-d04525f75947 Get a pipeline run with id=4d3cff5f-959e-4ea6-8dc9-d04525f75947 Updated pipeline run details Pipeline run succeeded, checking if the number of tasks are what is expected < Exit [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/07/26 10:48:56.47 (1m35.565s) > Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/07/26 10:48:56.47 ################### Global Cleanup after each test ##################### Deleting 1 run(s) Terminate run 4d3cff5f-959e-4ea6-8dc9-d04525f75947 Failed to terminate run 4d3cff5f-959e-4ea6-8dc9-d04525f75947 Terminate run 4d3cff5f-959e-4ea6-8dc9-d04525f75947 Deleting run 4d3cff5f-959e-4ea6-8dc9-d04525f75947 Deleting 0 experiment(s) Deleting 1 pipeline(s) Deleting pipeline with id=84c3d956-a4c3-42f3-83db-cb4f718bd0df (cascade=true) Pipeline with id=84c3d956-a4c3-42f3-83db-cb4f718bd0df, DELETED < Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/07/26 10:48:56.667 (197ms) > Enter [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/07/26 10:48:56.668 < Exit [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/07/26 10:48:56.668 (0s) > Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/07/26 10:48:56.668 < Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/07/26 10:48:56.668 (0s) 2026/07/07 10:49:31 Test passed > Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/07/26 10:47:20.552 Create an experiment with name E2EExperiment-1783421240552609830 < Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/07/26 10:47:20.828 (275ms) > Enter [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/07/26 10:47:20.828 ################### Setup before each Pipeline Upload test ##################### ################### Global Setup before each test ##################### Test Context: 0x38f547b28200 Looks like test-secret-1 already exists, because creation failed due to secrets "test-secret-1" already exists Looks like test-secret-2 already exists, because creation failed due to secrets "test-secret-2" already exists Looks like test-secret-3 already exists, because creation failed due to secrets "test-secret-3" already exists < Exit [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/07/26 10:47:20.992 (165ms) > Enter [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/07/26 10:47:20.993 Uploading pipeline file critical/flip_coin.yaml Creating temp pipeline file with overridden SDK Version Uploading pipeline with name=e2e-test-1783421240828258280, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml Upload of pipeline file 'critical/flip_coin.yaml' successful Listing pipeline versions for pipeline f9084c70-fc2c-4a60-a527-7e27145f471c Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml Returning pipeline run time inputs map[] Create run for pipeline with id: 'f9084c70-fc2c-4a60-a527-7e27145f471c' and name: 'e2e-test-1783421240828258280' Create a pipeline run for pipeline with id=f9084c70-fc2c-4a60-a527-7e27145f471c and versionId=425b7850-ccc7-46aa-ad4e-82a359ba9558 Create a pipeline run body Created Pipeline Run successfully with runId=738d4cdc-0528-47e0-ab88-80b9614afcd3 Created Pipeline Run with id: 738d4cdc-0528-47e0-ab88-80b9614afcd3 for pipeline with id: f9084c70-fc2c-4a60-a527-7e27145f471c Waiting for pipeline run with id=738d4cdc-0528-47e0-ab88-80b9614afcd3 to be in one of '[SUCCEEDED SKIPPED FAILED CANCELED]' Get a pipeline run with id=738d4cdc-0528-47e0-ab88-80b9614afcd3 Pipeline run with id=738d4cdc-0528-47e0-ab88-80b9614afcd3 is in PENDING state, waiting... Get a pipeline run with id=738d4cdc-0528-47e0-ab88-80b9614afcd3 Pipeline run with id=738d4cdc-0528-47e0-ab88-80b9614afcd3 is in RUNNING state, waiting... Get a pipeline run with id=738d4cdc-0528-47e0-ab88-80b9614afcd3 Pipeline run with id=738d4cdc-0528-47e0-ab88-80b9614afcd3 is in RUNNING state, waiting... Get a pipeline run with id=738d4cdc-0528-47e0-ab88-80b9614afcd3 Pipeline run with id=738d4cdc-0528-47e0-ab88-80b9614afcd3 is in RUNNING state, waiting... Get a pipeline run with id=738d4cdc-0528-47e0-ab88-80b9614afcd3 Pipeline run with id=738d4cdc-0528-47e0-ab88-80b9614afcd3 is in RUNNING state, waiting... Get a pipeline run with id=738d4cdc-0528-47e0-ab88-80b9614afcd3 Pipeline run with id=738d4cdc-0528-47e0-ab88-80b9614afcd3 is in RUNNING state, waiting... Get a pipeline run with id=738d4cdc-0528-47e0-ab88-80b9614afcd3 Pipeline run with id=738d4cdc-0528-47e0-ab88-80b9614afcd3 is in RUNNING state, waiting... Get a pipeline run with id=738d4cdc-0528-47e0-ab88-80b9614afcd3 Pipeline run with id=738d4cdc-0528-47e0-ab88-80b9614afcd3 is in RUNNING state, waiting... Get a pipeline run with id=738d4cdc-0528-47e0-ab88-80b9614afcd3 Pipeline run with id=738d4cdc-0528-47e0-ab88-80b9614afcd3 is in RUNNING state, waiting... Get a pipeline run with id=738d4cdc-0528-47e0-ab88-80b9614afcd3 Pipeline run with id=738d4cdc-0528-47e0-ab88-80b9614afcd3 is in RUNNING state, waiting... Get a pipeline run with id=738d4cdc-0528-47e0-ab88-80b9614afcd3 Pipeline run with id=738d4cdc-0528-47e0-ab88-80b9614afcd3 is in RUNNING state, waiting... Get a pipeline run with id=738d4cdc-0528-47e0-ab88-80b9614afcd3 Pipeline run with id=738d4cdc-0528-47e0-ab88-80b9614afcd3 is in RUNNING state, waiting... Get a pipeline run with id=738d4cdc-0528-47e0-ab88-80b9614afcd3 Pipeline run with id=738d4cdc-0528-47e0-ab88-80b9614afcd3 is in RUNNING state, waiting... Get a pipeline run with id=738d4cdc-0528-47e0-ab88-80b9614afcd3 Pipeline run with id=738d4cdc-0528-47e0-ab88-80b9614afcd3 is in RUNNING state, waiting... Get a pipeline run with id=738d4cdc-0528-47e0-ab88-80b9614afcd3 Pipeline run with id=738d4cdc-0528-47e0-ab88-80b9614afcd3 is in RUNNING state, waiting... Get a pipeline run with id=738d4cdc-0528-47e0-ab88-80b9614afcd3 Pipeline run with id=738d4cdc-0528-47e0-ab88-80b9614afcd3 is in RUNNING state, waiting... Get a pipeline run with id=738d4cdc-0528-47e0-ab88-80b9614afcd3 Pipeline run with id=738d4cdc-0528-47e0-ab88-80b9614afcd3 is in RUNNING state, waiting... Get a pipeline run with id=738d4cdc-0528-47e0-ab88-80b9614afcd3 Pipeline run with id=738d4cdc-0528-47e0-ab88-80b9614afcd3 is in RUNNING state, waiting... Get a pipeline run with id=738d4cdc-0528-47e0-ab88-80b9614afcd3 Pipeline run with id=738d4cdc-0528-47e0-ab88-80b9614afcd3 is in RUNNING state, waiting... Get a pipeline run with id=738d4cdc-0528-47e0-ab88-80b9614afcd3 Pipeline run with id=738d4cdc-0528-47e0-ab88-80b9614afcd3 is in RUNNING state, waiting... Get a pipeline run with id=738d4cdc-0528-47e0-ab88-80b9614afcd3 Pipeline run with id=738d4cdc-0528-47e0-ab88-80b9614afcd3 is in RUNNING state, waiting... Get a pipeline run with id=738d4cdc-0528-47e0-ab88-80b9614afcd3 Pipeline run with id=738d4cdc-0528-47e0-ab88-80b9614afcd3 is in RUNNING state, waiting... Get a pipeline run with id=738d4cdc-0528-47e0-ab88-80b9614afcd3 Pipeline run with id=738d4cdc-0528-47e0-ab88-80b9614afcd3 is in RUNNING state, waiting... Get a pipeline run with id=738d4cdc-0528-47e0-ab88-80b9614afcd3 Pipeline run with id=738d4cdc-0528-47e0-ab88-80b9614afcd3 is in RUNNING state, waiting... Get a pipeline run with id=738d4cdc-0528-47e0-ab88-80b9614afcd3 Pipeline run with id=738d4cdc-0528-47e0-ab88-80b9614afcd3 is in RUNNING state, waiting... Get a pipeline run with id=738d4cdc-0528-47e0-ab88-80b9614afcd3 Pipeline run with id=738d4cdc-0528-47e0-ab88-80b9614afcd3 is in RUNNING state, waiting... Get a pipeline run with id=738d4cdc-0528-47e0-ab88-80b9614afcd3 Pipeline run with id=738d4cdc-0528-47e0-ab88-80b9614afcd3 reached expected state SUCCEEDED Deserializing expected compiled workflow file 'critical/flip_coin.yaml' for the pipeline Unmarshalling Expected Workflow YAML Unmarshalled Expected Workflow YAML Fetching updated pipeline run details for run with id=738d4cdc-0528-47e0-ab88-80b9614afcd3 Get a pipeline run with id=738d4cdc-0528-47e0-ab88-80b9614afcd3 Updated pipeline run details Pipeline run succeeded, checking if the number of tasks are what is expected < Exit [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/07/26 10:49:31.654 (2m10.661s) > Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/07/26 10:49:31.654 ################### Global Cleanup after each test ##################### Deleting 1 run(s) Terminate run 738d4cdc-0528-47e0-ab88-80b9614afcd3 Failed to terminate run 738d4cdc-0528-47e0-ab88-80b9614afcd3 Terminate run 738d4cdc-0528-47e0-ab88-80b9614afcd3 Deleting run 738d4cdc-0528-47e0-ab88-80b9614afcd3 Deleting 0 experiment(s) Deleting 1 pipeline(s) Deleting pipeline with id=f9084c70-fc2c-4a60-a527-7e27145f471c (cascade=true) Pipeline with id=f9084c70-fc2c-4a60-a527-7e27145f471c, DELETED < Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/07/26 10:49:31.924 (270ms) > Enter [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/07/26 10:49:31.924 < Exit [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/07/26 10:49:31.924 (0s) > Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/07/26 10:49:31.924 < Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/07/26 10:49:31.924 (0s) 2026/07/07 10:49:56 Test passed > Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/07/26 10:47:20.58 Create an experiment with name E2EExperiment-1783421240580754431 < Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/07/26 10:47:20.819 (239ms) > Enter [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/07/26 10:47:20.819 ################### Setup before each Pipeline Upload test ##################### ################### Global Setup before each test ##################### Test Context: 0x1b136aa0c600 Looks like test-secret-1 already exists, because creation failed due to secrets "test-secret-1" already exists Looks like test-secret-2 already exists, because creation failed due to secrets "test-secret-2" already exists Looks like test-secret-3 already exists, because creation failed due to secrets "test-secret-3" already exists < Exit [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/07/26 10:47:20.974 (154ms) > Enter [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/07/26 10:47:20.974 Uploading pipeline file essential/iris_pipeline_compiled.yaml Creating temp pipeline file with overridden SDK Version Uploading pipeline with name=e2e-test-1783421240819944612, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml Upload of pipeline file 'essential/iris_pipeline_compiled.yaml' successful Listing pipeline versions for pipeline d64032e2-07ba-4d53-9cdf-b5c3626f8728 Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml Returning pipeline run time inputs map[] Create run for pipeline with id: 'd64032e2-07ba-4d53-9cdf-b5c3626f8728' and name: 'e2e-test-1783421240819944612' Create a pipeline run for pipeline with id=d64032e2-07ba-4d53-9cdf-b5c3626f8728 and versionId=fb38a663-381b-44a9-92e2-ca85d5734bf2 Create a pipeline run body Created Pipeline Run successfully with runId=55641ac1-a245-4197-982a-61b2120e1aeb Created Pipeline Run with id: 55641ac1-a245-4197-982a-61b2120e1aeb for pipeline with id: d64032e2-07ba-4d53-9cdf-b5c3626f8728 Waiting for pipeline run with id=55641ac1-a245-4197-982a-61b2120e1aeb to be in one of '[SUCCEEDED SKIPPED FAILED CANCELED]' Get a pipeline run with id=55641ac1-a245-4197-982a-61b2120e1aeb Pipeline run with id=55641ac1-a245-4197-982a-61b2120e1aeb is in PENDING state, waiting... Get a pipeline run with id=55641ac1-a245-4197-982a-61b2120e1aeb Pipeline run with id=55641ac1-a245-4197-982a-61b2120e1aeb is in RUNNING state, waiting... Get a pipeline run with id=55641ac1-a245-4197-982a-61b2120e1aeb Pipeline run with id=55641ac1-a245-4197-982a-61b2120e1aeb is in RUNNING state, waiting... Get a pipeline run with id=55641ac1-a245-4197-982a-61b2120e1aeb Pipeline run with id=55641ac1-a245-4197-982a-61b2120e1aeb is in RUNNING state, waiting... Get a pipeline run with id=55641ac1-a245-4197-982a-61b2120e1aeb Pipeline run with id=55641ac1-a245-4197-982a-61b2120e1aeb is in RUNNING state, waiting... Get a pipeline run with id=55641ac1-a245-4197-982a-61b2120e1aeb Pipeline run with id=55641ac1-a245-4197-982a-61b2120e1aeb is in RUNNING state, waiting... Get a pipeline run with id=55641ac1-a245-4197-982a-61b2120e1aeb Pipeline run with id=55641ac1-a245-4197-982a-61b2120e1aeb is in RUNNING state, waiting... Get a pipeline run with id=55641ac1-a245-4197-982a-61b2120e1aeb Pipeline run with id=55641ac1-a245-4197-982a-61b2120e1aeb is in RUNNING state, waiting... Get a pipeline run with id=55641ac1-a245-4197-982a-61b2120e1aeb Pipeline run with id=55641ac1-a245-4197-982a-61b2120e1aeb is in RUNNING state, waiting... Get a pipeline run with id=55641ac1-a245-4197-982a-61b2120e1aeb Pipeline run with id=55641ac1-a245-4197-982a-61b2120e1aeb is in RUNNING state, waiting... Get a pipeline run with id=55641ac1-a245-4197-982a-61b2120e1aeb Pipeline run with id=55641ac1-a245-4197-982a-61b2120e1aeb is in RUNNING state, waiting... Get a pipeline run with id=55641ac1-a245-4197-982a-61b2120e1aeb Pipeline run with id=55641ac1-a245-4197-982a-61b2120e1aeb is in RUNNING state, waiting... Get a pipeline run with id=55641ac1-a245-4197-982a-61b2120e1aeb Pipeline run with id=55641ac1-a245-4197-982a-61b2120e1aeb is in RUNNING state, waiting... Get a pipeline run with id=55641ac1-a245-4197-982a-61b2120e1aeb Pipeline run with id=55641ac1-a245-4197-982a-61b2120e1aeb is in RUNNING state, waiting... Get a pipeline run with id=55641ac1-a245-4197-982a-61b2120e1aeb Pipeline run with id=55641ac1-a245-4197-982a-61b2120e1aeb is in RUNNING state, waiting... Get a pipeline run with id=55641ac1-a245-4197-982a-61b2120e1aeb Pipeline run with id=55641ac1-a245-4197-982a-61b2120e1aeb is in RUNNING state, waiting... Get a pipeline run with id=55641ac1-a245-4197-982a-61b2120e1aeb Pipeline run with id=55641ac1-a245-4197-982a-61b2120e1aeb is in RUNNING state, waiting... Get a pipeline run with id=55641ac1-a245-4197-982a-61b2120e1aeb Pipeline run with id=55641ac1-a245-4197-982a-61b2120e1aeb is in RUNNING state, waiting... Get a pipeline run with id=55641ac1-a245-4197-982a-61b2120e1aeb Pipeline run with id=55641ac1-a245-4197-982a-61b2120e1aeb is in RUNNING state, waiting... Get a pipeline run with id=55641ac1-a245-4197-982a-61b2120e1aeb Pipeline run with id=55641ac1-a245-4197-982a-61b2120e1aeb is in RUNNING state, waiting... Get a pipeline run with id=55641ac1-a245-4197-982a-61b2120e1aeb Pipeline run with id=55641ac1-a245-4197-982a-61b2120e1aeb is in RUNNING state, waiting... Get a pipeline run with id=55641ac1-a245-4197-982a-61b2120e1aeb Pipeline run with id=55641ac1-a245-4197-982a-61b2120e1aeb is in RUNNING state, waiting... Get a pipeline run with id=55641ac1-a245-4197-982a-61b2120e1aeb Pipeline run with id=55641ac1-a245-4197-982a-61b2120e1aeb is in RUNNING state, waiting... Get a pipeline run with id=55641ac1-a245-4197-982a-61b2120e1aeb Pipeline run with id=55641ac1-a245-4197-982a-61b2120e1aeb is in RUNNING state, waiting... Get a pipeline run with id=55641ac1-a245-4197-982a-61b2120e1aeb Pipeline run with id=55641ac1-a245-4197-982a-61b2120e1aeb is in RUNNING state, waiting... Get a pipeline run with id=55641ac1-a245-4197-982a-61b2120e1aeb Pipeline run with id=55641ac1-a245-4197-982a-61b2120e1aeb is in RUNNING state, waiting... Get a pipeline run with id=55641ac1-a245-4197-982a-61b2120e1aeb Pipeline run with id=55641ac1-a245-4197-982a-61b2120e1aeb is in RUNNING state, waiting... Get a pipeline run with id=55641ac1-a245-4197-982a-61b2120e1aeb Pipeline run with id=55641ac1-a245-4197-982a-61b2120e1aeb is in RUNNING state, waiting... Get a pipeline run with id=55641ac1-a245-4197-982a-61b2120e1aeb Pipeline run with id=55641ac1-a245-4197-982a-61b2120e1aeb is in RUNNING state, waiting... Get a pipeline run with id=55641ac1-a245-4197-982a-61b2120e1aeb Pipeline run with id=55641ac1-a245-4197-982a-61b2120e1aeb is in RUNNING state, waiting... Get a pipeline run with id=55641ac1-a245-4197-982a-61b2120e1aeb Pipeline run with id=55641ac1-a245-4197-982a-61b2120e1aeb is in RUNNING state, waiting... Get a pipeline run with id=55641ac1-a245-4197-982a-61b2120e1aeb Pipeline run with id=55641ac1-a245-4197-982a-61b2120e1aeb reached expected state SUCCEEDED Deserializing expected compiled workflow file 'essential/iris_pipeline_compiled.yaml' for the pipeline Unmarshalling Expected Workflow YAML Unmarshalled Expected Workflow YAML Fetching updated pipeline run details for run with id=55641ac1-a245-4197-982a-61b2120e1aeb Get a pipeline run with id=55641ac1-a245-4197-982a-61b2120e1aeb Updated pipeline run details Pipeline run succeeded, checking if the number of tasks are what is expected < Exit [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/07/26 10:49:56.476 (2m35.502s) > Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/07/26 10:49:56.476 ################### Global Cleanup after each test ##################### Deleting 1 run(s) Terminate run 55641ac1-a245-4197-982a-61b2120e1aeb Failed to terminate run 55641ac1-a245-4197-982a-61b2120e1aeb Terminate run 55641ac1-a245-4197-982a-61b2120e1aeb Deleting run 55641ac1-a245-4197-982a-61b2120e1aeb Deleting 0 experiment(s) Deleting 1 pipeline(s) Deleting pipeline with id=d64032e2-07ba-4d53-9cdf-b5c3626f8728 (cascade=true) Pipeline with id=d64032e2-07ba-4d53-9cdf-b5c3626f8728, DELETED < Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/07/26 10:49:56.69 (214ms) > Enter [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/07/26 10:49:56.69 < Exit [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/07/26 10:49:56.69 (0s) > Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/07/26 10:49:56.691 < Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/07/26 10:49:56.691 (0s)