2026/07/07 17:47:28 Test passed > Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/07/26 17:46:42.681 Create an experiment with name E2EExperiment-1783446402681054153 < Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/07/26 17:46:42.894 (214ms) > Enter [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/07/26 17:46:42.894 ################### Setup before each Pipeline Upload test ##################### ################### Global Setup before each test ##################### Test Context: 0x2f365a686780 Looks like test-secret-1 already exists, because creation failed due to secrets "test-secret-1" already exists Looks like test-secret-2 already exists, because creation failed due to secrets "test-secret-2" already exists Looks like test-secret-3 already exists, because creation failed due to secrets "test-secret-3" already exists < Exit [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/07/26 17:46:42.974 (80ms) > Enter [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/07/26 17:46:42.975 Uploading pipeline file essential/component_with_pip_index_urls.yaml Creating temp pipeline file with overridden SDK Version Uploading pipeline with name=e2e-test-1783446402894904501, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml Upload of pipeline file 'essential/component_with_pip_index_urls.yaml' successful Listing pipeline versions for pipeline 7256b9c7-8137-4683-8130-718b75d3decd Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml Returning pipeline run time inputs map[] Create run for pipeline with id: '7256b9c7-8137-4683-8130-718b75d3decd' and name: 'e2e-test-1783446402894904501' Create a pipeline run for pipeline with id=7256b9c7-8137-4683-8130-718b75d3decd and versionId=5fe014c9-84cf-4f23-b225-5cbc23dc095b Create a pipeline run body Created Pipeline Run successfully with runId=50c7f5a2-2080-4610-b445-765c96690074 Created Pipeline Run with id: 50c7f5a2-2080-4610-b445-765c96690074 for pipeline with id: 7256b9c7-8137-4683-8130-718b75d3decd Waiting for pipeline run with id=50c7f5a2-2080-4610-b445-765c96690074 to be in one of '[SUCCEEDED SKIPPED FAILED CANCELED]' Get a pipeline run with id=50c7f5a2-2080-4610-b445-765c96690074 Pipeline run with id=50c7f5a2-2080-4610-b445-765c96690074 is in PENDING state, waiting... Get a pipeline run with id=50c7f5a2-2080-4610-b445-765c96690074 Pipeline run with id=50c7f5a2-2080-4610-b445-765c96690074 is in RUNNING state, waiting... Get a pipeline run with id=50c7f5a2-2080-4610-b445-765c96690074 Pipeline run with id=50c7f5a2-2080-4610-b445-765c96690074 is in RUNNING state, waiting... Get a pipeline run with id=50c7f5a2-2080-4610-b445-765c96690074 Pipeline run with id=50c7f5a2-2080-4610-b445-765c96690074 is in RUNNING state, waiting... Get a pipeline run with id=50c7f5a2-2080-4610-b445-765c96690074 Pipeline run with id=50c7f5a2-2080-4610-b445-765c96690074 is in RUNNING state, waiting... Get a pipeline run with id=50c7f5a2-2080-4610-b445-765c96690074 Pipeline run with id=50c7f5a2-2080-4610-b445-765c96690074 is in RUNNING state, waiting... Get a pipeline run with id=50c7f5a2-2080-4610-b445-765c96690074 Pipeline run with id=50c7f5a2-2080-4610-b445-765c96690074 is in RUNNING state, waiting... Get a pipeline run with id=50c7f5a2-2080-4610-b445-765c96690074 Pipeline run with id=50c7f5a2-2080-4610-b445-765c96690074 is in RUNNING state, waiting... Get a pipeline run with id=50c7f5a2-2080-4610-b445-765c96690074 Pipeline run with id=50c7f5a2-2080-4610-b445-765c96690074 is in RUNNING state, waiting... Get a pipeline run with id=50c7f5a2-2080-4610-b445-765c96690074 Pipeline run with id=50c7f5a2-2080-4610-b445-765c96690074 reached expected state SUCCEEDED Deserializing expected compiled workflow file 'essential/component_with_pip_index_urls.yaml' for the pipeline Unmarshalling Expected Workflow YAML Unmarshalled Expected Workflow YAML Fetching updated pipeline run details for run with id=50c7f5a2-2080-4610-b445-765c96690074 Get a pipeline run with id=50c7f5a2-2080-4610-b445-765c96690074 Updated pipeline run details Pipeline run succeeded, checking if the number of tasks are what is expected < Exit [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/07/26 17:47:28.564 (45.589s) > Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/07/26 17:47:28.564 ################### Global Cleanup after each test ##################### Deleting 1 run(s) Terminate run 50c7f5a2-2080-4610-b445-765c96690074 Failed to terminate run 50c7f5a2-2080-4610-b445-765c96690074 Terminate run 50c7f5a2-2080-4610-b445-765c96690074 Deleting run 50c7f5a2-2080-4610-b445-765c96690074 Deleting 0 experiment(s) Deleting 1 pipeline(s) Deleting pipeline with id=7256b9c7-8137-4683-8130-718b75d3decd (cascade=true) Pipeline with id=7256b9c7-8137-4683-8130-718b75d3decd, DELETED < Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/07/26 17:47:28.847 (282ms) > Enter [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/07/26 17:47:28.847 < Exit [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/07/26 17:47:28.847 (0s) > Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/07/26 17:47:28.847 < Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/07/26 17:47:28.847 (0s) 2026/07/07 17:48:18 Test passed > Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/07/26 17:46:42.68 Create an experiment with name E2EExperiment-1783446402680848256 < Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/07/26 17:46:42.976 (296ms) > Enter [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/07/26 17:46:42.976 ################### Setup before each Pipeline Upload test ##################### ################### Global Setup before each test ##################### Test Context: 0x2e86004b8300 Looks like test-secret-1 already exists, because creation failed due to secrets "test-secret-1" already exists Looks like test-secret-2 already exists, because creation failed due to secrets "test-secret-2" already exists Looks like test-secret-3 already exists, because creation failed due to secrets "test-secret-3" already exists < Exit [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/07/26 17:46:43.055 (78ms) > Enter [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/07/26 17:46:43.055 Uploading pipeline file critical/parallel_for_after_dependency.yaml Creating temp pipeline file with overridden SDK Version Uploading pipeline with name=e2e-test-1783446402977011301, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml Upload of pipeline file 'critical/parallel_for_after_dependency.yaml' successful Listing pipeline versions for pipeline ba7bce3c-5b19-486c-a709-1f5ef13548f0 Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml Returning pipeline run time inputs map[] Create run for pipeline with id: 'ba7bce3c-5b19-486c-a709-1f5ef13548f0' and name: 'e2e-test-1783446402977011301' Create a pipeline run for pipeline with id=ba7bce3c-5b19-486c-a709-1f5ef13548f0 and versionId=998b1089-a1f2-4516-9ef0-3ea527e2bde6 Create a pipeline run body Created Pipeline Run successfully with runId=15ccbd6d-5102-47e4-ac50-72bca1d6feec Created Pipeline Run with id: 15ccbd6d-5102-47e4-ac50-72bca1d6feec for pipeline with id: ba7bce3c-5b19-486c-a709-1f5ef13548f0 Waiting for pipeline run with id=15ccbd6d-5102-47e4-ac50-72bca1d6feec to be in one of '[SUCCEEDED SKIPPED FAILED CANCELED]' Get a pipeline run with id=15ccbd6d-5102-47e4-ac50-72bca1d6feec Pipeline run with id=15ccbd6d-5102-47e4-ac50-72bca1d6feec is in PENDING state, waiting... Get a pipeline run with id=15ccbd6d-5102-47e4-ac50-72bca1d6feec Pipeline run with id=15ccbd6d-5102-47e4-ac50-72bca1d6feec is in RUNNING state, waiting... Get a pipeline run with id=15ccbd6d-5102-47e4-ac50-72bca1d6feec Pipeline run with id=15ccbd6d-5102-47e4-ac50-72bca1d6feec is in RUNNING state, waiting... Get a pipeline run with id=15ccbd6d-5102-47e4-ac50-72bca1d6feec Pipeline run with id=15ccbd6d-5102-47e4-ac50-72bca1d6feec is in RUNNING state, waiting... Get a pipeline run with id=15ccbd6d-5102-47e4-ac50-72bca1d6feec Pipeline run with id=15ccbd6d-5102-47e4-ac50-72bca1d6feec is in RUNNING state, waiting... Get a pipeline run with id=15ccbd6d-5102-47e4-ac50-72bca1d6feec Pipeline run with id=15ccbd6d-5102-47e4-ac50-72bca1d6feec is in RUNNING state, waiting... Get a pipeline run with id=15ccbd6d-5102-47e4-ac50-72bca1d6feec Pipeline run with id=15ccbd6d-5102-47e4-ac50-72bca1d6feec is in RUNNING state, waiting... Get a pipeline run with id=15ccbd6d-5102-47e4-ac50-72bca1d6feec Pipeline run with id=15ccbd6d-5102-47e4-ac50-72bca1d6feec is in RUNNING state, waiting... Get a pipeline run with id=15ccbd6d-5102-47e4-ac50-72bca1d6feec Pipeline run with id=15ccbd6d-5102-47e4-ac50-72bca1d6feec is in RUNNING state, waiting... Get a pipeline run with id=15ccbd6d-5102-47e4-ac50-72bca1d6feec Pipeline run with id=15ccbd6d-5102-47e4-ac50-72bca1d6feec is in RUNNING state, waiting... Get a pipeline run with id=15ccbd6d-5102-47e4-ac50-72bca1d6feec Pipeline run with id=15ccbd6d-5102-47e4-ac50-72bca1d6feec is in RUNNING state, waiting... Get a pipeline run with id=15ccbd6d-5102-47e4-ac50-72bca1d6feec Pipeline run with id=15ccbd6d-5102-47e4-ac50-72bca1d6feec is in RUNNING state, waiting... Get a pipeline run with id=15ccbd6d-5102-47e4-ac50-72bca1d6feec Pipeline run with id=15ccbd6d-5102-47e4-ac50-72bca1d6feec is in RUNNING state, waiting... Get a pipeline run with id=15ccbd6d-5102-47e4-ac50-72bca1d6feec Pipeline run with id=15ccbd6d-5102-47e4-ac50-72bca1d6feec is in RUNNING state, waiting... Get a pipeline run with id=15ccbd6d-5102-47e4-ac50-72bca1d6feec Pipeline run with id=15ccbd6d-5102-47e4-ac50-72bca1d6feec is in RUNNING state, waiting... Get a pipeline run with id=15ccbd6d-5102-47e4-ac50-72bca1d6feec Pipeline run with id=15ccbd6d-5102-47e4-ac50-72bca1d6feec is in RUNNING state, waiting... Get a pipeline run with id=15ccbd6d-5102-47e4-ac50-72bca1d6feec Pipeline run with id=15ccbd6d-5102-47e4-ac50-72bca1d6feec is in RUNNING state, waiting... Get a pipeline run with id=15ccbd6d-5102-47e4-ac50-72bca1d6feec Pipeline run with id=15ccbd6d-5102-47e4-ac50-72bca1d6feec is in RUNNING state, waiting... Get a pipeline run with id=15ccbd6d-5102-47e4-ac50-72bca1d6feec Pipeline run with id=15ccbd6d-5102-47e4-ac50-72bca1d6feec is in RUNNING state, waiting... Get a pipeline run with id=15ccbd6d-5102-47e4-ac50-72bca1d6feec Pipeline run with id=15ccbd6d-5102-47e4-ac50-72bca1d6feec reached expected state SUCCEEDED Deserializing expected compiled workflow file 'critical/parallel_for_after_dependency.yaml' for the pipeline Unmarshalling Expected Workflow YAML Unmarshalled Expected Workflow YAML Fetching updated pipeline run details for run with id=15ccbd6d-5102-47e4-ac50-72bca1d6feec Get a pipeline run with id=15ccbd6d-5102-47e4-ac50-72bca1d6feec Updated pipeline run details Pipeline run succeeded, checking if the number of tasks are what is expected < Exit [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/07/26 17:48:18.684 (1m35.629s) > Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/07/26 17:48:18.685 ################### Global Cleanup after each test ##################### Deleting 1 run(s) Terminate run 15ccbd6d-5102-47e4-ac50-72bca1d6feec Failed to terminate run 15ccbd6d-5102-47e4-ac50-72bca1d6feec Terminate run 15ccbd6d-5102-47e4-ac50-72bca1d6feec Deleting run 15ccbd6d-5102-47e4-ac50-72bca1d6feec Deleting 0 experiment(s) Deleting 1 pipeline(s) Deleting pipeline with id=ba7bce3c-5b19-486c-a709-1f5ef13548f0 (cascade=true) Pipeline with id=ba7bce3c-5b19-486c-a709-1f5ef13548f0, DELETED < Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/07/26 17:48:18.842 (158ms) > Enter [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/07/26 17:48:18.842 < Exit [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/07/26 17:48:18.843 (0s) > Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/07/26 17:48:18.843 < Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/07/26 17:48:18.843 (0s) 2026/07/07 17:48:24 Test passed > Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/07/26 17:46:42.68 Create an experiment with name E2EExperiment-1783446402680962850 < Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/07/26 17:46:42.976 (295ms) > Enter [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/07/26 17:46:42.976 ################### Setup before each Pipeline Upload test ##################### ################### Global Setup before each test ##################### Test Context: 0x2d4be5f2eb00 Looks like test-secret-1 already exists, because creation failed due to secrets "test-secret-1" already exists Looks like test-secret-2 already exists, because creation failed due to secrets "test-secret-2" already exists Looks like test-secret-3 already exists, because creation failed due to secrets "test-secret-3" already exists < Exit [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/07/26 17:46:43.055 (79ms) > Enter [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/07/26 17:46:43.055 Uploading pipeline file critical/pipeline_with_artifact_upload_download.yaml Creating temp pipeline file with overridden SDK Version Uploading pipeline with name=e2e-test-1783446402976203997, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml Upload of pipeline file 'critical/pipeline_with_artifact_upload_download.yaml' successful Listing pipeline versions for pipeline b685df50-339a-48d1-8e35-991018b4c555 Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml Returning pipeline run time inputs map[] Create run for pipeline with id: 'b685df50-339a-48d1-8e35-991018b4c555' and name: 'e2e-test-1783446402976203997' Create a pipeline run for pipeline with id=b685df50-339a-48d1-8e35-991018b4c555 and versionId=515ebaca-50f6-493b-9bc5-e00c15827cbe Create a pipeline run body Created Pipeline Run successfully with runId=d4bd1625-04d1-422c-b7bf-77ad763a8ae7 Created Pipeline Run with id: d4bd1625-04d1-422c-b7bf-77ad763a8ae7 for pipeline with id: b685df50-339a-48d1-8e35-991018b4c555 Waiting for pipeline run with id=d4bd1625-04d1-422c-b7bf-77ad763a8ae7 to be in one of '[SUCCEEDED SKIPPED FAILED CANCELED]' Get a pipeline run with id=d4bd1625-04d1-422c-b7bf-77ad763a8ae7 Pipeline run with id=d4bd1625-04d1-422c-b7bf-77ad763a8ae7 is in PENDING state, waiting... Get a pipeline run with id=d4bd1625-04d1-422c-b7bf-77ad763a8ae7 Pipeline run with id=d4bd1625-04d1-422c-b7bf-77ad763a8ae7 is in RUNNING state, waiting... Get a pipeline run with id=d4bd1625-04d1-422c-b7bf-77ad763a8ae7 Pipeline run with id=d4bd1625-04d1-422c-b7bf-77ad763a8ae7 is in RUNNING state, waiting... Get a pipeline run with id=d4bd1625-04d1-422c-b7bf-77ad763a8ae7 Pipeline run with id=d4bd1625-04d1-422c-b7bf-77ad763a8ae7 is in RUNNING state, waiting... Get a pipeline run with id=d4bd1625-04d1-422c-b7bf-77ad763a8ae7 Pipeline run with id=d4bd1625-04d1-422c-b7bf-77ad763a8ae7 is in RUNNING state, waiting... Get a pipeline run with id=d4bd1625-04d1-422c-b7bf-77ad763a8ae7 Pipeline run with id=d4bd1625-04d1-422c-b7bf-77ad763a8ae7 is in RUNNING state, waiting... Get a pipeline run with id=d4bd1625-04d1-422c-b7bf-77ad763a8ae7 Pipeline run with id=d4bd1625-04d1-422c-b7bf-77ad763a8ae7 is in RUNNING state, waiting... Get a pipeline run with id=d4bd1625-04d1-422c-b7bf-77ad763a8ae7 Pipeline run with id=d4bd1625-04d1-422c-b7bf-77ad763a8ae7 is in RUNNING state, waiting... Get a pipeline run with id=d4bd1625-04d1-422c-b7bf-77ad763a8ae7 Pipeline run with id=d4bd1625-04d1-422c-b7bf-77ad763a8ae7 is in RUNNING state, waiting... Get a pipeline run with id=d4bd1625-04d1-422c-b7bf-77ad763a8ae7 Pipeline run with id=d4bd1625-04d1-422c-b7bf-77ad763a8ae7 is in RUNNING state, waiting... Get a pipeline run with id=d4bd1625-04d1-422c-b7bf-77ad763a8ae7 Pipeline run with id=d4bd1625-04d1-422c-b7bf-77ad763a8ae7 is in RUNNING state, waiting... Get a pipeline run with id=d4bd1625-04d1-422c-b7bf-77ad763a8ae7 Pipeline run with id=d4bd1625-04d1-422c-b7bf-77ad763a8ae7 is in RUNNING state, waiting... Get a pipeline run with id=d4bd1625-04d1-422c-b7bf-77ad763a8ae7 Pipeline run with id=d4bd1625-04d1-422c-b7bf-77ad763a8ae7 is in RUNNING state, waiting... Get a pipeline run with id=d4bd1625-04d1-422c-b7bf-77ad763a8ae7 Pipeline run with id=d4bd1625-04d1-422c-b7bf-77ad763a8ae7 is in RUNNING state, waiting... Get a pipeline run with id=d4bd1625-04d1-422c-b7bf-77ad763a8ae7 Pipeline run with id=d4bd1625-04d1-422c-b7bf-77ad763a8ae7 is in RUNNING state, waiting... Get a pipeline run with id=d4bd1625-04d1-422c-b7bf-77ad763a8ae7 Pipeline run with id=d4bd1625-04d1-422c-b7bf-77ad763a8ae7 is in RUNNING state, waiting... Get a pipeline run with id=d4bd1625-04d1-422c-b7bf-77ad763a8ae7 Pipeline run with id=d4bd1625-04d1-422c-b7bf-77ad763a8ae7 is in RUNNING state, waiting... Get a pipeline run with id=d4bd1625-04d1-422c-b7bf-77ad763a8ae7 Pipeline run with id=d4bd1625-04d1-422c-b7bf-77ad763a8ae7 is in RUNNING state, waiting... Get a pipeline run with id=d4bd1625-04d1-422c-b7bf-77ad763a8ae7 Pipeline run with id=d4bd1625-04d1-422c-b7bf-77ad763a8ae7 is in RUNNING state, waiting... Get a pipeline run with id=d4bd1625-04d1-422c-b7bf-77ad763a8ae7 Pipeline run with id=d4bd1625-04d1-422c-b7bf-77ad763a8ae7 is in RUNNING state, waiting... Get a pipeline run with id=d4bd1625-04d1-422c-b7bf-77ad763a8ae7 Pipeline run with id=d4bd1625-04d1-422c-b7bf-77ad763a8ae7 reached expected state SUCCEEDED Deserializing expected compiled workflow file 'critical/pipeline_with_artifact_upload_download.yaml' for the pipeline Unmarshalling Expected Workflow YAML Unmarshalled Expected Workflow YAML Fetching updated pipeline run details for run with id=d4bd1625-04d1-422c-b7bf-77ad763a8ae7 Get a pipeline run with id=d4bd1625-04d1-422c-b7bf-77ad763a8ae7 Updated pipeline run details Pipeline run succeeded, checking if the number of tasks are what is expected < Exit [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/07/26 17:48:24.051 (1m40.996s) > Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/07/26 17:48:24.051 ################### Global Cleanup after each test ##################### Deleting 1 run(s) Terminate run d4bd1625-04d1-422c-b7bf-77ad763a8ae7 Failed to terminate run d4bd1625-04d1-422c-b7bf-77ad763a8ae7 Terminate run d4bd1625-04d1-422c-b7bf-77ad763a8ae7 Deleting run d4bd1625-04d1-422c-b7bf-77ad763a8ae7 Deleting 0 experiment(s) Deleting 1 pipeline(s) Deleting pipeline with id=b685df50-339a-48d1-8e35-991018b4c555 (cascade=true) Pipeline with id=b685df50-339a-48d1-8e35-991018b4c555, DELETED < Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/07/26 17:48:24.371 (320ms) > Enter [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/07/26 17:48:24.372 < Exit [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/07/26 17:48:24.372 (0s) > Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/07/26 17:48:24.372 < Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/07/26 17:48:24.372 (0s) 2026/07/07 17:48:54 Test passed > Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/07/26 17:46:42.68 Create an experiment with name E2EExperiment-1783446402680593129 < Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/07/26 17:46:42.894 (214ms) > Enter [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/07/26 17:46:42.895 ################### Setup before each Pipeline Upload test ##################### ################### Global Setup before each test ##################### Test Context: 0x344151b2a400 Looks like test-secret-1 already exists, because creation failed due to secrets "test-secret-1" already exists Looks like test-secret-2 already exists, because creation failed due to secrets "test-secret-2" already exists Looks like test-secret-3 already exists, because creation failed due to secrets "test-secret-3" already exists < Exit [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/07/26 17:46:43.043 (149ms) > Enter [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/07/26 17:46:43.044 Uploading pipeline file critical/flip_coin.yaml Creating temp pipeline file with overridden SDK Version Uploading pipeline with name=e2e-test-1783446402895129257, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml Upload of pipeline file 'critical/flip_coin.yaml' successful Listing pipeline versions for pipeline 4f0f4fed-3f55-471e-8059-9ef0c9c463c2 Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml Returning pipeline run time inputs map[] Create run for pipeline with id: '4f0f4fed-3f55-471e-8059-9ef0c9c463c2' and name: 'e2e-test-1783446402895129257' Create a pipeline run for pipeline with id=4f0f4fed-3f55-471e-8059-9ef0c9c463c2 and versionId=c48de81a-1e84-47d6-a8cf-65162cad070f Create a pipeline run body Created Pipeline Run successfully with runId=33b46a95-8947-4da0-9f62-103ad3f7dedc Created Pipeline Run with id: 33b46a95-8947-4da0-9f62-103ad3f7dedc for pipeline with id: 4f0f4fed-3f55-471e-8059-9ef0c9c463c2 Waiting for pipeline run with id=33b46a95-8947-4da0-9f62-103ad3f7dedc to be in one of '[SUCCEEDED SKIPPED FAILED CANCELED]' Get a pipeline run with id=33b46a95-8947-4da0-9f62-103ad3f7dedc Pipeline run with id=33b46a95-8947-4da0-9f62-103ad3f7dedc is in PENDING state, waiting... Get a pipeline run with id=33b46a95-8947-4da0-9f62-103ad3f7dedc Pipeline run with id=33b46a95-8947-4da0-9f62-103ad3f7dedc is in RUNNING state, waiting... Get a pipeline run with id=33b46a95-8947-4da0-9f62-103ad3f7dedc Pipeline run with id=33b46a95-8947-4da0-9f62-103ad3f7dedc is in RUNNING state, waiting... Get a pipeline run with id=33b46a95-8947-4da0-9f62-103ad3f7dedc Pipeline run with id=33b46a95-8947-4da0-9f62-103ad3f7dedc is in RUNNING state, waiting... Get a pipeline run with id=33b46a95-8947-4da0-9f62-103ad3f7dedc Pipeline run with id=33b46a95-8947-4da0-9f62-103ad3f7dedc is in RUNNING state, waiting... Get a pipeline run with id=33b46a95-8947-4da0-9f62-103ad3f7dedc Pipeline run with id=33b46a95-8947-4da0-9f62-103ad3f7dedc is in RUNNING state, waiting... Get a pipeline run with id=33b46a95-8947-4da0-9f62-103ad3f7dedc Pipeline run with id=33b46a95-8947-4da0-9f62-103ad3f7dedc is in RUNNING state, waiting... Get a pipeline run with id=33b46a95-8947-4da0-9f62-103ad3f7dedc Pipeline run with id=33b46a95-8947-4da0-9f62-103ad3f7dedc is in RUNNING state, waiting... Get a pipeline run with id=33b46a95-8947-4da0-9f62-103ad3f7dedc Pipeline run with id=33b46a95-8947-4da0-9f62-103ad3f7dedc is in RUNNING state, waiting... Get a pipeline run with id=33b46a95-8947-4da0-9f62-103ad3f7dedc Pipeline run with id=33b46a95-8947-4da0-9f62-103ad3f7dedc is in RUNNING state, waiting... Get a pipeline run with id=33b46a95-8947-4da0-9f62-103ad3f7dedc Pipeline run with id=33b46a95-8947-4da0-9f62-103ad3f7dedc is in RUNNING state, waiting... Get a pipeline run with id=33b46a95-8947-4da0-9f62-103ad3f7dedc Pipeline run with id=33b46a95-8947-4da0-9f62-103ad3f7dedc is in RUNNING state, waiting... Get a pipeline run with id=33b46a95-8947-4da0-9f62-103ad3f7dedc Pipeline run with id=33b46a95-8947-4da0-9f62-103ad3f7dedc is in RUNNING state, waiting... Get a pipeline run with id=33b46a95-8947-4da0-9f62-103ad3f7dedc Pipeline run with id=33b46a95-8947-4da0-9f62-103ad3f7dedc is in RUNNING state, waiting... Get a pipeline run with id=33b46a95-8947-4da0-9f62-103ad3f7dedc Pipeline run with id=33b46a95-8947-4da0-9f62-103ad3f7dedc is in RUNNING state, waiting... Get a pipeline run with id=33b46a95-8947-4da0-9f62-103ad3f7dedc Pipeline run with id=33b46a95-8947-4da0-9f62-103ad3f7dedc is in RUNNING state, waiting... Get a pipeline run with id=33b46a95-8947-4da0-9f62-103ad3f7dedc Pipeline run with id=33b46a95-8947-4da0-9f62-103ad3f7dedc is in RUNNING state, waiting... Get a pipeline run with id=33b46a95-8947-4da0-9f62-103ad3f7dedc Pipeline run with id=33b46a95-8947-4da0-9f62-103ad3f7dedc is in RUNNING state, waiting... Get a pipeline run with id=33b46a95-8947-4da0-9f62-103ad3f7dedc Pipeline run with id=33b46a95-8947-4da0-9f62-103ad3f7dedc is in RUNNING state, waiting... Get a pipeline run with id=33b46a95-8947-4da0-9f62-103ad3f7dedc Pipeline run with id=33b46a95-8947-4da0-9f62-103ad3f7dedc is in RUNNING state, waiting... Get a pipeline run with id=33b46a95-8947-4da0-9f62-103ad3f7dedc Pipeline run with id=33b46a95-8947-4da0-9f62-103ad3f7dedc is in RUNNING state, waiting... Get a pipeline run with id=33b46a95-8947-4da0-9f62-103ad3f7dedc Pipeline run with id=33b46a95-8947-4da0-9f62-103ad3f7dedc is in RUNNING state, waiting... Get a pipeline run with id=33b46a95-8947-4da0-9f62-103ad3f7dedc Pipeline run with id=33b46a95-8947-4da0-9f62-103ad3f7dedc is in RUNNING state, waiting... Get a pipeline run with id=33b46a95-8947-4da0-9f62-103ad3f7dedc Pipeline run with id=33b46a95-8947-4da0-9f62-103ad3f7dedc is in RUNNING state, waiting... Get a pipeline run with id=33b46a95-8947-4da0-9f62-103ad3f7dedc Pipeline run with id=33b46a95-8947-4da0-9f62-103ad3f7dedc is in RUNNING state, waiting... Get a pipeline run with id=33b46a95-8947-4da0-9f62-103ad3f7dedc Pipeline run with id=33b46a95-8947-4da0-9f62-103ad3f7dedc is in RUNNING state, waiting... Get a pipeline run with id=33b46a95-8947-4da0-9f62-103ad3f7dedc Pipeline run with id=33b46a95-8947-4da0-9f62-103ad3f7dedc reached expected state SUCCEEDED Deserializing expected compiled workflow file 'critical/flip_coin.yaml' for the pipeline Unmarshalling Expected Workflow YAML Unmarshalled Expected Workflow YAML Fetching updated pipeline run details for run with id=33b46a95-8947-4da0-9f62-103ad3f7dedc Get a pipeline run with id=33b46a95-8947-4da0-9f62-103ad3f7dedc Updated pipeline run details Pipeline run succeeded, checking if the number of tasks are what is expected < Exit [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/07/26 17:48:53.732 (2m10.688s) > Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/07/26 17:48:53.732 ################### Global Cleanup after each test ##################### Deleting 1 run(s) Terminate run 33b46a95-8947-4da0-9f62-103ad3f7dedc Failed to terminate run 33b46a95-8947-4da0-9f62-103ad3f7dedc Terminate run 33b46a95-8947-4da0-9f62-103ad3f7dedc Deleting run 33b46a95-8947-4da0-9f62-103ad3f7dedc Deleting 0 experiment(s) Deleting 1 pipeline(s) Deleting pipeline with id=4f0f4fed-3f55-471e-8059-9ef0c9c463c2 (cascade=true) Pipeline with id=4f0f4fed-3f55-471e-8059-9ef0c9c463c2, DELETED < Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/07/26 17:48:54.063 (331ms) > Enter [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/07/26 17:48:54.063 < Exit [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/07/26 17:48:54.063 (0s) > Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/07/26 17:48:54.063 < Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/07/26 17:48:54.063 (0s) 2026/07/07 17:49:18 Test passed > Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/07/26 17:46:42.686 Create an experiment with name E2EExperiment-1783446402686600599 < Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/07/26 17:46:42.894 (208ms) > Enter [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/07/26 17:46:42.894 ################### Setup before each Pipeline Upload test ##################### ################### Global Setup before each test ##################### Test Context: 0x37b06e570b00 test-secret-1 created test-secret-2 created test-secret-3 created < Exit [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/07/26 17:46:42.937 (43ms) > Enter [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/07/26 17:46:42.937 Uploading pipeline file essential/iris_pipeline_compiled.yaml Creating temp pipeline file with overridden SDK Version Uploading pipeline with name=e2e-test-1783446402894908031, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml Upload of pipeline file 'essential/iris_pipeline_compiled.yaml' successful Listing pipeline versions for pipeline a84bdc5d-dda2-4916-994a-869e112b766d Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml Returning pipeline run time inputs map[] Create run for pipeline with id: 'a84bdc5d-dda2-4916-994a-869e112b766d' and name: 'e2e-test-1783446402894908031' Create a pipeline run for pipeline with id=a84bdc5d-dda2-4916-994a-869e112b766d and versionId=c680e573-3dbd-4c9d-8c03-eded76e6d8d3 Create a pipeline run body Created Pipeline Run successfully with runId=6c466349-1308-4f86-87b4-2c1cdcdce847 Created Pipeline Run with id: 6c466349-1308-4f86-87b4-2c1cdcdce847 for pipeline with id: a84bdc5d-dda2-4916-994a-869e112b766d Waiting for pipeline run with id=6c466349-1308-4f86-87b4-2c1cdcdce847 to be in one of '[SUCCEEDED SKIPPED FAILED CANCELED]' Get a pipeline run with id=6c466349-1308-4f86-87b4-2c1cdcdce847 Pipeline run with id=6c466349-1308-4f86-87b4-2c1cdcdce847 is in PENDING state, waiting... Get a pipeline run with id=6c466349-1308-4f86-87b4-2c1cdcdce847 Pipeline run with id=6c466349-1308-4f86-87b4-2c1cdcdce847 is in RUNNING state, waiting... Get a pipeline run with id=6c466349-1308-4f86-87b4-2c1cdcdce847 Pipeline run with id=6c466349-1308-4f86-87b4-2c1cdcdce847 is in RUNNING state, waiting... Get a pipeline run with id=6c466349-1308-4f86-87b4-2c1cdcdce847 Pipeline run with id=6c466349-1308-4f86-87b4-2c1cdcdce847 is in RUNNING state, waiting... Get a pipeline run with id=6c466349-1308-4f86-87b4-2c1cdcdce847 Pipeline run with id=6c466349-1308-4f86-87b4-2c1cdcdce847 is in RUNNING state, waiting... Get a pipeline run with id=6c466349-1308-4f86-87b4-2c1cdcdce847 Pipeline run with id=6c466349-1308-4f86-87b4-2c1cdcdce847 is in RUNNING state, waiting... Get a pipeline run with id=6c466349-1308-4f86-87b4-2c1cdcdce847 Pipeline run with id=6c466349-1308-4f86-87b4-2c1cdcdce847 is in RUNNING state, waiting... Get a pipeline run with id=6c466349-1308-4f86-87b4-2c1cdcdce847 Pipeline run with id=6c466349-1308-4f86-87b4-2c1cdcdce847 is in RUNNING state, waiting... Get a pipeline run with id=6c466349-1308-4f86-87b4-2c1cdcdce847 Pipeline run with id=6c466349-1308-4f86-87b4-2c1cdcdce847 is in RUNNING state, waiting... Get a pipeline run with id=6c466349-1308-4f86-87b4-2c1cdcdce847 Pipeline run with id=6c466349-1308-4f86-87b4-2c1cdcdce847 is in RUNNING state, waiting... Get a pipeline run with id=6c466349-1308-4f86-87b4-2c1cdcdce847 Pipeline run with id=6c466349-1308-4f86-87b4-2c1cdcdce847 is in RUNNING state, waiting... Get a pipeline run with id=6c466349-1308-4f86-87b4-2c1cdcdce847 Pipeline run with id=6c466349-1308-4f86-87b4-2c1cdcdce847 is in RUNNING state, waiting... Get a pipeline run with id=6c466349-1308-4f86-87b4-2c1cdcdce847 Pipeline run with id=6c466349-1308-4f86-87b4-2c1cdcdce847 is in RUNNING state, waiting... Get a pipeline run with id=6c466349-1308-4f86-87b4-2c1cdcdce847 Pipeline run with id=6c466349-1308-4f86-87b4-2c1cdcdce847 is in RUNNING state, waiting... Get a pipeline run with id=6c466349-1308-4f86-87b4-2c1cdcdce847 Pipeline run with id=6c466349-1308-4f86-87b4-2c1cdcdce847 is in RUNNING state, waiting... Get a pipeline run with id=6c466349-1308-4f86-87b4-2c1cdcdce847 Pipeline run with id=6c466349-1308-4f86-87b4-2c1cdcdce847 is in RUNNING state, waiting... Get a pipeline run with id=6c466349-1308-4f86-87b4-2c1cdcdce847 Pipeline run with id=6c466349-1308-4f86-87b4-2c1cdcdce847 is in RUNNING state, waiting... Get a pipeline run with id=6c466349-1308-4f86-87b4-2c1cdcdce847 Pipeline run with id=6c466349-1308-4f86-87b4-2c1cdcdce847 is in RUNNING state, waiting... Get a pipeline run with id=6c466349-1308-4f86-87b4-2c1cdcdce847 Pipeline run with id=6c466349-1308-4f86-87b4-2c1cdcdce847 is in RUNNING state, waiting... Get a pipeline run with id=6c466349-1308-4f86-87b4-2c1cdcdce847 Pipeline run with id=6c466349-1308-4f86-87b4-2c1cdcdce847 is in RUNNING state, waiting... Get a pipeline run with id=6c466349-1308-4f86-87b4-2c1cdcdce847 Pipeline run with id=6c466349-1308-4f86-87b4-2c1cdcdce847 is in RUNNING state, waiting... Get a pipeline run with id=6c466349-1308-4f86-87b4-2c1cdcdce847 Pipeline run with id=6c466349-1308-4f86-87b4-2c1cdcdce847 is in RUNNING state, waiting... Get a pipeline run with id=6c466349-1308-4f86-87b4-2c1cdcdce847 Pipeline run with id=6c466349-1308-4f86-87b4-2c1cdcdce847 is in RUNNING state, waiting... Get a pipeline run with id=6c466349-1308-4f86-87b4-2c1cdcdce847 Pipeline run with id=6c466349-1308-4f86-87b4-2c1cdcdce847 is in RUNNING state, waiting... Get a pipeline run with id=6c466349-1308-4f86-87b4-2c1cdcdce847 Pipeline run with id=6c466349-1308-4f86-87b4-2c1cdcdce847 is in RUNNING state, waiting... Get a pipeline run with id=6c466349-1308-4f86-87b4-2c1cdcdce847 Pipeline run with id=6c466349-1308-4f86-87b4-2c1cdcdce847 is in RUNNING state, waiting... Get a pipeline run with id=6c466349-1308-4f86-87b4-2c1cdcdce847 Pipeline run with id=6c466349-1308-4f86-87b4-2c1cdcdce847 is in RUNNING state, waiting... Get a pipeline run with id=6c466349-1308-4f86-87b4-2c1cdcdce847 Pipeline run with id=6c466349-1308-4f86-87b4-2c1cdcdce847 is in RUNNING state, waiting... Get a pipeline run with id=6c466349-1308-4f86-87b4-2c1cdcdce847 Pipeline run with id=6c466349-1308-4f86-87b4-2c1cdcdce847 is in RUNNING state, waiting... Get a pipeline run with id=6c466349-1308-4f86-87b4-2c1cdcdce847 Pipeline run with id=6c466349-1308-4f86-87b4-2c1cdcdce847 is in RUNNING state, waiting... Get a pipeline run with id=6c466349-1308-4f86-87b4-2c1cdcdce847 Pipeline run with id=6c466349-1308-4f86-87b4-2c1cdcdce847 is in RUNNING state, waiting... Get a pipeline run with id=6c466349-1308-4f86-87b4-2c1cdcdce847 Pipeline run with id=6c466349-1308-4f86-87b4-2c1cdcdce847 reached expected state SUCCEEDED Deserializing expected compiled workflow file 'essential/iris_pipeline_compiled.yaml' for the pipeline Unmarshalling Expected Workflow YAML Unmarshalled Expected Workflow YAML Fetching updated pipeline run details for run with id=6c466349-1308-4f86-87b4-2c1cdcdce847 Get a pipeline run with id=6c466349-1308-4f86-87b4-2c1cdcdce847 Updated pipeline run details Pipeline run succeeded, checking if the number of tasks are what is expected < Exit [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/07/26 17:49:18.369 (2m35.432s) > Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/07/26 17:49:18.37 ################### Global Cleanup after each test ##################### Deleting 1 run(s) Terminate run 6c466349-1308-4f86-87b4-2c1cdcdce847 Failed to terminate run 6c466349-1308-4f86-87b4-2c1cdcdce847 Terminate run 6c466349-1308-4f86-87b4-2c1cdcdce847 Deleting run 6c466349-1308-4f86-87b4-2c1cdcdce847 Deleting 0 experiment(s) Deleting 1 pipeline(s) Deleting pipeline with id=a84bdc5d-dda2-4916-994a-869e112b766d (cascade=true) Pipeline with id=a84bdc5d-dda2-4916-994a-869e112b766d, DELETED < Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/07/26 17:49:18.544 (174ms) > Enter [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/07/26 17:49:18.544 < Exit [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/07/26 17:49:18.544 (0s) > Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/07/26 17:49:18.545 < Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/07/26 17:49:18.545 (0s)