2026/07/14 09:06:51 Test passed > Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/14/26 09:06:05.893 Create an experiment with name E2EExperiment-1784019965893532284 < Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/14/26 09:06:06.071 (178ms) > Enter [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/14/26 09:06:06.071 ################### Setup before each Pipeline Upload test ##################### ################### Global Setup before each test ##################### Test Context: 0x1d603e5e2100 test-secret-1 created test-secret-2 created test-secret-3 created < Exit [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/14/26 09:06:06.134 (63ms) > Enter [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/14/26 09:06:06.135 Uploading pipeline file essential/component_with_pip_index_urls.yaml Creating temp pipeline file with overridden SDK Version Uploading pipeline with name=e2e-test-1784019966071684348, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml Upload of pipeline file 'essential/component_with_pip_index_urls.yaml' successful Listing pipeline versions for pipeline d4315268-7df1-4a88-b16f-a000b620c483 Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml Returning pipeline run time inputs map[] Create run for pipeline with id: 'd4315268-7df1-4a88-b16f-a000b620c483' and name: 'e2e-test-1784019966071684348' Create a pipeline run for pipeline with id=d4315268-7df1-4a88-b16f-a000b620c483 and versionId=a2425184-8121-4b2f-a6fa-00e885036ce5 Create a pipeline run body Created Pipeline Run successfully with runId=22ccc245-9ed7-430c-952f-8969087ee1ea Created Pipeline Run with id: 22ccc245-9ed7-430c-952f-8969087ee1ea for pipeline with id: d4315268-7df1-4a88-b16f-a000b620c483 Waiting for pipeline run with id=22ccc245-9ed7-430c-952f-8969087ee1ea to be in one of '[SUCCEEDED SKIPPED FAILED CANCELED]' Get a pipeline run with id=22ccc245-9ed7-430c-952f-8969087ee1ea Pipeline run with id=22ccc245-9ed7-430c-952f-8969087ee1ea is in PENDING state, waiting... Get a pipeline run with id=22ccc245-9ed7-430c-952f-8969087ee1ea Pipeline run with id=22ccc245-9ed7-430c-952f-8969087ee1ea is in RUNNING state, waiting... Get a pipeline run with id=22ccc245-9ed7-430c-952f-8969087ee1ea Pipeline run with id=22ccc245-9ed7-430c-952f-8969087ee1ea is in RUNNING state, waiting... Get a pipeline run with id=22ccc245-9ed7-430c-952f-8969087ee1ea Pipeline run with id=22ccc245-9ed7-430c-952f-8969087ee1ea is in RUNNING state, waiting... Get a pipeline run with id=22ccc245-9ed7-430c-952f-8969087ee1ea Pipeline run with id=22ccc245-9ed7-430c-952f-8969087ee1ea is in RUNNING state, waiting... Get a pipeline run with id=22ccc245-9ed7-430c-952f-8969087ee1ea Pipeline run with id=22ccc245-9ed7-430c-952f-8969087ee1ea is in RUNNING state, waiting... Get a pipeline run with id=22ccc245-9ed7-430c-952f-8969087ee1ea Pipeline run with id=22ccc245-9ed7-430c-952f-8969087ee1ea is in RUNNING state, waiting... Get a pipeline run with id=22ccc245-9ed7-430c-952f-8969087ee1ea Pipeline run with id=22ccc245-9ed7-430c-952f-8969087ee1ea is in RUNNING state, waiting... Get a pipeline run with id=22ccc245-9ed7-430c-952f-8969087ee1ea Pipeline run with id=22ccc245-9ed7-430c-952f-8969087ee1ea is in RUNNING state, waiting... Get a pipeline run with id=22ccc245-9ed7-430c-952f-8969087ee1ea Pipeline run with id=22ccc245-9ed7-430c-952f-8969087ee1ea reached expected state SUCCEEDED Deserializing expected compiled workflow file 'essential/component_with_pip_index_urls.yaml' for the pipeline Unmarshalling Expected Workflow YAML Unmarshalled Expected Workflow YAML Fetching updated pipeline run details for run with id=22ccc245-9ed7-430c-952f-8969087ee1ea Get a pipeline run with id=22ccc245-9ed7-430c-952f-8969087ee1ea Updated pipeline run details Pipeline run succeeded, checking if the number of tasks are what is expected < Exit [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/14/26 09:06:51.565 (45.43s) > Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/14/26 09:06:51.565 ################### Global Cleanup after each test ##################### Deleting 1 run(s) Terminate run 22ccc245-9ed7-430c-952f-8969087ee1ea Failed to terminate run 22ccc245-9ed7-430c-952f-8969087ee1ea Terminate run 22ccc245-9ed7-430c-952f-8969087ee1ea Deleting run 22ccc245-9ed7-430c-952f-8969087ee1ea Deleting 0 experiment(s) Deleting 1 pipeline(s) Deleting pipeline with id=d4315268-7df1-4a88-b16f-a000b620c483 (cascade=true) Pipeline with id=d4315268-7df1-4a88-b16f-a000b620c483, DELETED < Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/14/26 09:06:51.747 (182ms) > Enter [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/14/26 09:06:51.747 < Exit [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/14/26 09:06:51.747 (0s) > Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/14/26 09:06:51.747 < Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/14/26 09:06:51.747 (0s) 2026/07/14 09:07:42 Test passed > Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/14/26 09:06:05.893 Create an experiment with name E2EExperiment-1784019965893058787 < Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/14/26 09:06:06.073 (181ms) > Enter [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/14/26 09:06:06.073 ################### Setup before each Pipeline Upload test ##################### ################### Global Setup before each test ##################### Test Context: 0x29e2ea46e280 Looks like test-secret-1 already exists, because creation failed due to secrets "test-secret-1" already exists Looks like test-secret-2 already exists, because creation failed due to secrets "test-secret-2" already exists Looks like test-secret-3 already exists, because creation failed due to secrets "test-secret-3" already exists < Exit [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/14/26 09:06:06.188 (115ms) > Enter [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/14/26 09:06:06.188 Uploading pipeline file critical/pipeline_with_artifact_upload_download.yaml Creating temp pipeline file with overridden SDK Version Uploading pipeline with name=e2e-test-1784019966073810819, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml Upload of pipeline file 'critical/pipeline_with_artifact_upload_download.yaml' successful Listing pipeline versions for pipeline d0aecdd1-7b1d-442f-9eb7-db8ac50f8a4f Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml Returning pipeline run time inputs map[] Create run for pipeline with id: 'd0aecdd1-7b1d-442f-9eb7-db8ac50f8a4f' and name: 'e2e-test-1784019966073810819' Create a pipeline run for pipeline with id=d0aecdd1-7b1d-442f-9eb7-db8ac50f8a4f and versionId=c83f2f08-7ad0-4f4b-b362-b8c67f69092c Create a pipeline run body Created Pipeline Run successfully with runId=ae9140be-bd80-4dfa-a1d0-12f0a8bb6f77 Created Pipeline Run with id: ae9140be-bd80-4dfa-a1d0-12f0a8bb6f77 for pipeline with id: d0aecdd1-7b1d-442f-9eb7-db8ac50f8a4f Waiting for pipeline run with id=ae9140be-bd80-4dfa-a1d0-12f0a8bb6f77 to be in one of '[SUCCEEDED SKIPPED FAILED CANCELED]' Get a pipeline run with id=ae9140be-bd80-4dfa-a1d0-12f0a8bb6f77 Pipeline run with id=ae9140be-bd80-4dfa-a1d0-12f0a8bb6f77 is in PENDING state, waiting... Get a pipeline run with id=ae9140be-bd80-4dfa-a1d0-12f0a8bb6f77 Pipeline run with id=ae9140be-bd80-4dfa-a1d0-12f0a8bb6f77 is in RUNNING state, waiting... Get a pipeline run with id=ae9140be-bd80-4dfa-a1d0-12f0a8bb6f77 Pipeline run with id=ae9140be-bd80-4dfa-a1d0-12f0a8bb6f77 is in RUNNING state, waiting... Get a pipeline run with id=ae9140be-bd80-4dfa-a1d0-12f0a8bb6f77 Pipeline run with id=ae9140be-bd80-4dfa-a1d0-12f0a8bb6f77 is in RUNNING state, waiting... Get a pipeline run with id=ae9140be-bd80-4dfa-a1d0-12f0a8bb6f77 Pipeline run with id=ae9140be-bd80-4dfa-a1d0-12f0a8bb6f77 is in RUNNING state, waiting... Get a pipeline run with id=ae9140be-bd80-4dfa-a1d0-12f0a8bb6f77 Pipeline run with id=ae9140be-bd80-4dfa-a1d0-12f0a8bb6f77 is in RUNNING state, waiting... Get a pipeline run with id=ae9140be-bd80-4dfa-a1d0-12f0a8bb6f77 Pipeline run with id=ae9140be-bd80-4dfa-a1d0-12f0a8bb6f77 is in RUNNING state, waiting... Get a pipeline run with id=ae9140be-bd80-4dfa-a1d0-12f0a8bb6f77 Pipeline run with id=ae9140be-bd80-4dfa-a1d0-12f0a8bb6f77 is in RUNNING state, waiting... Get a pipeline run with id=ae9140be-bd80-4dfa-a1d0-12f0a8bb6f77 Pipeline run with id=ae9140be-bd80-4dfa-a1d0-12f0a8bb6f77 is in RUNNING state, waiting... Get a pipeline run with id=ae9140be-bd80-4dfa-a1d0-12f0a8bb6f77 Pipeline run with id=ae9140be-bd80-4dfa-a1d0-12f0a8bb6f77 is in RUNNING state, waiting... Get a pipeline run with id=ae9140be-bd80-4dfa-a1d0-12f0a8bb6f77 Pipeline run with id=ae9140be-bd80-4dfa-a1d0-12f0a8bb6f77 is in RUNNING state, waiting... Get a pipeline run with id=ae9140be-bd80-4dfa-a1d0-12f0a8bb6f77 Pipeline run with id=ae9140be-bd80-4dfa-a1d0-12f0a8bb6f77 is in RUNNING state, waiting... Get a pipeline run with id=ae9140be-bd80-4dfa-a1d0-12f0a8bb6f77 Pipeline run with id=ae9140be-bd80-4dfa-a1d0-12f0a8bb6f77 is in RUNNING state, waiting... Get a pipeline run with id=ae9140be-bd80-4dfa-a1d0-12f0a8bb6f77 Pipeline run with id=ae9140be-bd80-4dfa-a1d0-12f0a8bb6f77 is in RUNNING state, waiting... Get a pipeline run with id=ae9140be-bd80-4dfa-a1d0-12f0a8bb6f77 Pipeline run with id=ae9140be-bd80-4dfa-a1d0-12f0a8bb6f77 is in RUNNING state, waiting... Get a pipeline run with id=ae9140be-bd80-4dfa-a1d0-12f0a8bb6f77 Pipeline run with id=ae9140be-bd80-4dfa-a1d0-12f0a8bb6f77 is in RUNNING state, waiting... Get a pipeline run with id=ae9140be-bd80-4dfa-a1d0-12f0a8bb6f77 Pipeline run with id=ae9140be-bd80-4dfa-a1d0-12f0a8bb6f77 is in RUNNING state, waiting... Get a pipeline run with id=ae9140be-bd80-4dfa-a1d0-12f0a8bb6f77 Pipeline run with id=ae9140be-bd80-4dfa-a1d0-12f0a8bb6f77 is in RUNNING state, waiting... Get a pipeline run with id=ae9140be-bd80-4dfa-a1d0-12f0a8bb6f77 Pipeline run with id=ae9140be-bd80-4dfa-a1d0-12f0a8bb6f77 is in RUNNING state, waiting... Get a pipeline run with id=ae9140be-bd80-4dfa-a1d0-12f0a8bb6f77 Pipeline run with id=ae9140be-bd80-4dfa-a1d0-12f0a8bb6f77 reached expected state SUCCEEDED Deserializing expected compiled workflow file 'critical/pipeline_with_artifact_upload_download.yaml' for the pipeline Unmarshalling Expected Workflow YAML Unmarshalled Expected Workflow YAML Fetching updated pipeline run details for run with id=ae9140be-bd80-4dfa-a1d0-12f0a8bb6f77 Get a pipeline run with id=ae9140be-bd80-4dfa-a1d0-12f0a8bb6f77 Updated pipeline run details Pipeline run succeeded, checking if the number of tasks are what is expected < Exit [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/14/26 09:07:41.839 (1m35.651s) > Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/14/26 09:07:41.84 ################### Global Cleanup after each test ##################### Deleting 1 run(s) Terminate run ae9140be-bd80-4dfa-a1d0-12f0a8bb6f77 Failed to terminate run ae9140be-bd80-4dfa-a1d0-12f0a8bb6f77 Terminate run ae9140be-bd80-4dfa-a1d0-12f0a8bb6f77 Deleting run ae9140be-bd80-4dfa-a1d0-12f0a8bb6f77 Deleting 0 experiment(s) Deleting 1 pipeline(s) Deleting pipeline with id=d0aecdd1-7b1d-442f-9eb7-db8ac50f8a4f (cascade=true) Pipeline with id=d0aecdd1-7b1d-442f-9eb7-db8ac50f8a4f, DELETED < Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/14/26 09:07:42.09 (251ms) > Enter [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/14/26 09:07:42.091 < Exit [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/14/26 09:07:42.091 (0s) > Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/14/26 09:07:42.091 < Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/14/26 09:07:42.091 (0s) 2026/07/14 09:07:42 Test passed > Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/14/26 09:06:05.892 Create an experiment with name E2EExperiment-1784019965892804153 < Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/14/26 09:06:06.114 (222ms) > Enter [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/14/26 09:06:06.115 ################### Setup before each Pipeline Upload test ##################### ################### Global Setup before each test ##################### Test Context: 0x24c943f80680 Looks like test-secret-1 already exists, because creation failed due to secrets "test-secret-1" already exists Looks like test-secret-2 already exists, because creation failed due to secrets "test-secret-2" already exists Looks like test-secret-3 already exists, because creation failed due to secrets "test-secret-3" already exists < Exit [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/14/26 09:06:06.228 (113ms) > Enter [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/14/26 09:06:06.228 Uploading pipeline file critical/parallel_for_after_dependency.yaml Creating temp pipeline file with overridden SDK Version Uploading pipeline with name=e2e-test-1784019966115160359, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml Upload of pipeline file 'critical/parallel_for_after_dependency.yaml' successful Listing pipeline versions for pipeline 485d12f2-ba5b-411e-807c-2bf190b10ed6 Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml Returning pipeline run time inputs map[] Create run for pipeline with id: '485d12f2-ba5b-411e-807c-2bf190b10ed6' and name: 'e2e-test-1784019966115160359' Create a pipeline run for pipeline with id=485d12f2-ba5b-411e-807c-2bf190b10ed6 and versionId=8d5f5e39-508e-4961-ba3d-9662e557483b Create a pipeline run body Created Pipeline Run successfully with runId=ddeecdfd-c9f7-4005-9822-578a8ff1e523 Created Pipeline Run with id: ddeecdfd-c9f7-4005-9822-578a8ff1e523 for pipeline with id: 485d12f2-ba5b-411e-807c-2bf190b10ed6 Waiting for pipeline run with id=ddeecdfd-c9f7-4005-9822-578a8ff1e523 to be in one of '[SUCCEEDED SKIPPED FAILED CANCELED]' Get a pipeline run with id=ddeecdfd-c9f7-4005-9822-578a8ff1e523 Pipeline run with id=ddeecdfd-c9f7-4005-9822-578a8ff1e523 is in PENDING state, waiting... Get a pipeline run with id=ddeecdfd-c9f7-4005-9822-578a8ff1e523 Pipeline run with id=ddeecdfd-c9f7-4005-9822-578a8ff1e523 is in RUNNING state, waiting... Get a pipeline run with id=ddeecdfd-c9f7-4005-9822-578a8ff1e523 Pipeline run with id=ddeecdfd-c9f7-4005-9822-578a8ff1e523 is in RUNNING state, waiting... Get a pipeline run with id=ddeecdfd-c9f7-4005-9822-578a8ff1e523 Pipeline run with id=ddeecdfd-c9f7-4005-9822-578a8ff1e523 is in RUNNING state, waiting... Get a pipeline run with id=ddeecdfd-c9f7-4005-9822-578a8ff1e523 Pipeline run with id=ddeecdfd-c9f7-4005-9822-578a8ff1e523 is in RUNNING state, waiting... Get a pipeline run with id=ddeecdfd-c9f7-4005-9822-578a8ff1e523 Pipeline run with id=ddeecdfd-c9f7-4005-9822-578a8ff1e523 is in RUNNING state, waiting... Get a pipeline run with id=ddeecdfd-c9f7-4005-9822-578a8ff1e523 Pipeline run with id=ddeecdfd-c9f7-4005-9822-578a8ff1e523 is in RUNNING state, waiting... Get a pipeline run with id=ddeecdfd-c9f7-4005-9822-578a8ff1e523 Pipeline run with id=ddeecdfd-c9f7-4005-9822-578a8ff1e523 is in RUNNING state, waiting... Get a pipeline run with id=ddeecdfd-c9f7-4005-9822-578a8ff1e523 Pipeline run with id=ddeecdfd-c9f7-4005-9822-578a8ff1e523 is in RUNNING state, waiting... Get a pipeline run with id=ddeecdfd-c9f7-4005-9822-578a8ff1e523 Pipeline run with id=ddeecdfd-c9f7-4005-9822-578a8ff1e523 is in RUNNING state, waiting... Get a pipeline run with id=ddeecdfd-c9f7-4005-9822-578a8ff1e523 Pipeline run with id=ddeecdfd-c9f7-4005-9822-578a8ff1e523 is in RUNNING state, waiting... Get a pipeline run with id=ddeecdfd-c9f7-4005-9822-578a8ff1e523 Pipeline run with id=ddeecdfd-c9f7-4005-9822-578a8ff1e523 is in RUNNING state, waiting... Get a pipeline run with id=ddeecdfd-c9f7-4005-9822-578a8ff1e523 Pipeline run with id=ddeecdfd-c9f7-4005-9822-578a8ff1e523 is in RUNNING state, waiting... Get a pipeline run with id=ddeecdfd-c9f7-4005-9822-578a8ff1e523 Pipeline run with id=ddeecdfd-c9f7-4005-9822-578a8ff1e523 is in RUNNING state, waiting... Get a pipeline run with id=ddeecdfd-c9f7-4005-9822-578a8ff1e523 Pipeline run with id=ddeecdfd-c9f7-4005-9822-578a8ff1e523 is in RUNNING state, waiting... Get a pipeline run with id=ddeecdfd-c9f7-4005-9822-578a8ff1e523 Pipeline run with id=ddeecdfd-c9f7-4005-9822-578a8ff1e523 is in RUNNING state, waiting... Get a pipeline run with id=ddeecdfd-c9f7-4005-9822-578a8ff1e523 Pipeline run with id=ddeecdfd-c9f7-4005-9822-578a8ff1e523 is in RUNNING state, waiting... Get a pipeline run with id=ddeecdfd-c9f7-4005-9822-578a8ff1e523 Pipeline run with id=ddeecdfd-c9f7-4005-9822-578a8ff1e523 is in RUNNING state, waiting... Get a pipeline run with id=ddeecdfd-c9f7-4005-9822-578a8ff1e523 Pipeline run with id=ddeecdfd-c9f7-4005-9822-578a8ff1e523 is in RUNNING state, waiting... Get a pipeline run with id=ddeecdfd-c9f7-4005-9822-578a8ff1e523 Pipeline run with id=ddeecdfd-c9f7-4005-9822-578a8ff1e523 reached expected state SUCCEEDED Deserializing expected compiled workflow file 'critical/parallel_for_after_dependency.yaml' for the pipeline Unmarshalling Expected Workflow YAML Unmarshalled Expected Workflow YAML Fetching updated pipeline run details for run with id=ddeecdfd-c9f7-4005-9822-578a8ff1e523 Get a pipeline run with id=ddeecdfd-c9f7-4005-9822-578a8ff1e523 Updated pipeline run details Pipeline run succeeded, checking if the number of tasks are what is expected < Exit [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/14/26 09:07:41.885 (1m35.657s) > Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/14/26 09:07:41.885 ################### Global Cleanup after each test ##################### Deleting 1 run(s) Terminate run ddeecdfd-c9f7-4005-9822-578a8ff1e523 Failed to terminate run ddeecdfd-c9f7-4005-9822-578a8ff1e523 Terminate run ddeecdfd-c9f7-4005-9822-578a8ff1e523 Deleting run ddeecdfd-c9f7-4005-9822-578a8ff1e523 Deleting 0 experiment(s) Deleting 1 pipeline(s) Deleting pipeline with id=485d12f2-ba5b-411e-807c-2bf190b10ed6 (cascade=true) Pipeline with id=485d12f2-ba5b-411e-807c-2bf190b10ed6, DELETED < Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/14/26 09:07:42.242 (357ms) > Enter [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/14/26 09:07:42.242 < Exit [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/14/26 09:07:42.242 (0s) > Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/14/26 09:07:42.242 < Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/14/26 09:07:42.242 (0s) 2026/07/14 09:08:12 Test passed > Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/14/26 09:06:05.892 Create an experiment with name E2EExperiment-1784019965892662945 < Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/14/26 09:06:06.112 (220ms) > Enter [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/14/26 09:06:06.112 ################### Setup before each Pipeline Upload test ##################### ################### Global Setup before each test ##################### Test Context: 0x1bdfda42c100 Looks like test-secret-1 already exists, because creation failed due to secrets "test-secret-1" already exists Looks like test-secret-2 already exists, because creation failed due to secrets "test-secret-2" already exists Looks like test-secret-3 already exists, because creation failed due to secrets "test-secret-3" already exists < Exit [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/14/26 09:06:06.233 (121ms) > Enter [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/14/26 09:06:06.233 Uploading pipeline file critical/flip_coin.yaml Creating temp pipeline file with overridden SDK Version Uploading pipeline with name=e2e-test-1784019966112473756, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml Upload of pipeline file 'critical/flip_coin.yaml' successful Listing pipeline versions for pipeline 79780fba-a8a3-4c9c-a020-39703f3991a1 Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml Returning pipeline run time inputs map[] Create run for pipeline with id: '79780fba-a8a3-4c9c-a020-39703f3991a1' and name: 'e2e-test-1784019966112473756' Create a pipeline run for pipeline with id=79780fba-a8a3-4c9c-a020-39703f3991a1 and versionId=32b339d1-da7f-4f53-9798-63875b629bcf Create a pipeline run body Created Pipeline Run successfully with runId=d144fe79-0b7c-4c6a-b564-af520144cb6b Created Pipeline Run with id: d144fe79-0b7c-4c6a-b564-af520144cb6b for pipeline with id: 79780fba-a8a3-4c9c-a020-39703f3991a1 Waiting for pipeline run with id=d144fe79-0b7c-4c6a-b564-af520144cb6b to be in one of '[SUCCEEDED SKIPPED FAILED CANCELED]' Get a pipeline run with id=d144fe79-0b7c-4c6a-b564-af520144cb6b Pipeline run with id=d144fe79-0b7c-4c6a-b564-af520144cb6b is in PENDING state, waiting... Get a pipeline run with id=d144fe79-0b7c-4c6a-b564-af520144cb6b Pipeline run with id=d144fe79-0b7c-4c6a-b564-af520144cb6b is in RUNNING state, waiting... Get a pipeline run with id=d144fe79-0b7c-4c6a-b564-af520144cb6b Pipeline run with id=d144fe79-0b7c-4c6a-b564-af520144cb6b is in RUNNING state, waiting... Get a pipeline run with id=d144fe79-0b7c-4c6a-b564-af520144cb6b Pipeline run with id=d144fe79-0b7c-4c6a-b564-af520144cb6b is in RUNNING state, waiting... Get a pipeline run with id=d144fe79-0b7c-4c6a-b564-af520144cb6b Pipeline run with id=d144fe79-0b7c-4c6a-b564-af520144cb6b is in RUNNING state, waiting... Get a pipeline run with id=d144fe79-0b7c-4c6a-b564-af520144cb6b Pipeline run with id=d144fe79-0b7c-4c6a-b564-af520144cb6b is in RUNNING state, waiting... Get a pipeline run with id=d144fe79-0b7c-4c6a-b564-af520144cb6b Pipeline run with id=d144fe79-0b7c-4c6a-b564-af520144cb6b is in RUNNING state, waiting... Get a pipeline run with id=d144fe79-0b7c-4c6a-b564-af520144cb6b Pipeline run with id=d144fe79-0b7c-4c6a-b564-af520144cb6b is in RUNNING state, waiting... Get a pipeline run with id=d144fe79-0b7c-4c6a-b564-af520144cb6b Pipeline run with id=d144fe79-0b7c-4c6a-b564-af520144cb6b is in RUNNING state, waiting... Get a pipeline run with id=d144fe79-0b7c-4c6a-b564-af520144cb6b Pipeline run with id=d144fe79-0b7c-4c6a-b564-af520144cb6b is in RUNNING state, waiting... Get a pipeline run with id=d144fe79-0b7c-4c6a-b564-af520144cb6b Pipeline run with id=d144fe79-0b7c-4c6a-b564-af520144cb6b is in RUNNING state, waiting... Get a pipeline run with id=d144fe79-0b7c-4c6a-b564-af520144cb6b Pipeline run with id=d144fe79-0b7c-4c6a-b564-af520144cb6b is in RUNNING state, waiting... Get a pipeline run with id=d144fe79-0b7c-4c6a-b564-af520144cb6b Pipeline run with id=d144fe79-0b7c-4c6a-b564-af520144cb6b is in RUNNING state, waiting... Get a pipeline run with id=d144fe79-0b7c-4c6a-b564-af520144cb6b Pipeline run with id=d144fe79-0b7c-4c6a-b564-af520144cb6b is in RUNNING state, waiting... Get a pipeline run with id=d144fe79-0b7c-4c6a-b564-af520144cb6b Pipeline run with id=d144fe79-0b7c-4c6a-b564-af520144cb6b is in RUNNING state, waiting... Get a pipeline run with id=d144fe79-0b7c-4c6a-b564-af520144cb6b Pipeline run with id=d144fe79-0b7c-4c6a-b564-af520144cb6b is in RUNNING state, waiting... Get a pipeline run with id=d144fe79-0b7c-4c6a-b564-af520144cb6b Pipeline run with id=d144fe79-0b7c-4c6a-b564-af520144cb6b is in RUNNING state, waiting... Get a pipeline run with id=d144fe79-0b7c-4c6a-b564-af520144cb6b Pipeline run with id=d144fe79-0b7c-4c6a-b564-af520144cb6b is in RUNNING state, waiting... Get a pipeline run with id=d144fe79-0b7c-4c6a-b564-af520144cb6b Pipeline run with id=d144fe79-0b7c-4c6a-b564-af520144cb6b is in RUNNING state, waiting... Get a pipeline run with id=d144fe79-0b7c-4c6a-b564-af520144cb6b Pipeline run with id=d144fe79-0b7c-4c6a-b564-af520144cb6b is in RUNNING state, waiting... Get a pipeline run with id=d144fe79-0b7c-4c6a-b564-af520144cb6b Pipeline run with id=d144fe79-0b7c-4c6a-b564-af520144cb6b is in RUNNING state, waiting... Get a pipeline run with id=d144fe79-0b7c-4c6a-b564-af520144cb6b Pipeline run with id=d144fe79-0b7c-4c6a-b564-af520144cb6b is in RUNNING state, waiting... Get a pipeline run with id=d144fe79-0b7c-4c6a-b564-af520144cb6b Pipeline run with id=d144fe79-0b7c-4c6a-b564-af520144cb6b is in RUNNING state, waiting... Get a pipeline run with id=d144fe79-0b7c-4c6a-b564-af520144cb6b Pipeline run with id=d144fe79-0b7c-4c6a-b564-af520144cb6b is in RUNNING state, waiting... Get a pipeline run with id=d144fe79-0b7c-4c6a-b564-af520144cb6b Pipeline run with id=d144fe79-0b7c-4c6a-b564-af520144cb6b is in RUNNING state, waiting... Get a pipeline run with id=d144fe79-0b7c-4c6a-b564-af520144cb6b Pipeline run with id=d144fe79-0b7c-4c6a-b564-af520144cb6b reached expected state SUCCEEDED Deserializing expected compiled workflow file 'critical/flip_coin.yaml' for the pipeline Unmarshalling Expected Workflow YAML Unmarshalled Expected Workflow YAML Fetching updated pipeline run details for run with id=d144fe79-0b7c-4c6a-b564-af520144cb6b Get a pipeline run with id=d144fe79-0b7c-4c6a-b564-af520144cb6b Updated pipeline run details Pipeline run succeeded, checking if the number of tasks are what is expected < Exit [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/14/26 09:08:11.8 (2m5.567s) > Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/14/26 09:08:11.801 ################### Global Cleanup after each test ##################### Deleting 1 run(s) Terminate run d144fe79-0b7c-4c6a-b564-af520144cb6b Failed to terminate run d144fe79-0b7c-4c6a-b564-af520144cb6b Terminate run d144fe79-0b7c-4c6a-b564-af520144cb6b Deleting run d144fe79-0b7c-4c6a-b564-af520144cb6b Deleting 0 experiment(s) Deleting 1 pipeline(s) Deleting pipeline with id=79780fba-a8a3-4c9c-a020-39703f3991a1 (cascade=true) Pipeline with id=79780fba-a8a3-4c9c-a020-39703f3991a1, DELETED < Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/14/26 09:08:12.142 (341ms) > Enter [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/14/26 09:08:12.142 < Exit [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/14/26 09:08:12.142 (0s) > Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/14/26 09:08:12.143 < Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/14/26 09:08:12.143 (0s) 2026/07/14 09:08:41 Test passed > Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/14/26 09:06:05.926 Create an experiment with name E2EExperiment-1784019965926440904 < Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/14/26 09:06:06.071 (145ms) > Enter [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/14/26 09:06:06.071 ################### Setup before each Pipeline Upload test ##################### ################### Global Setup before each test ##################### Test Context: 0x23f63b20d000 Looks like test-secret-1 already exists, because creation failed due to secrets "test-secret-1" already exists Looks like test-secret-2 already exists, because creation failed due to secrets "test-secret-2" already exists Looks like test-secret-3 already exists, because creation failed due to secrets "test-secret-3" already exists < Exit [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/14/26 09:06:06.196 (125ms) > Enter [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/14/26 09:06:06.196 Uploading pipeline file essential/iris_pipeline_compiled.yaml Creating temp pipeline file with overridden SDK Version Uploading pipeline with name=e2e-test-1784019966071531940, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml Upload of pipeline file 'essential/iris_pipeline_compiled.yaml' successful Listing pipeline versions for pipeline f1f4191a-9d1e-4c50-9915-1340130246d9 Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml Returning pipeline run time inputs map[] Create run for pipeline with id: 'f1f4191a-9d1e-4c50-9915-1340130246d9' and name: 'e2e-test-1784019966071531940' Create a pipeline run for pipeline with id=f1f4191a-9d1e-4c50-9915-1340130246d9 and versionId=57074d0c-503c-4681-8a74-18592464e265 Create a pipeline run body Created Pipeline Run successfully with runId=3eaddcf7-0f07-4c8b-8c38-ebf82b39456f Created Pipeline Run with id: 3eaddcf7-0f07-4c8b-8c38-ebf82b39456f for pipeline with id: f1f4191a-9d1e-4c50-9915-1340130246d9 Waiting for pipeline run with id=3eaddcf7-0f07-4c8b-8c38-ebf82b39456f to be in one of '[SUCCEEDED SKIPPED FAILED CANCELED]' Get a pipeline run with id=3eaddcf7-0f07-4c8b-8c38-ebf82b39456f Pipeline run with id=3eaddcf7-0f07-4c8b-8c38-ebf82b39456f is in PENDING state, waiting... Get a pipeline run with id=3eaddcf7-0f07-4c8b-8c38-ebf82b39456f Pipeline run with id=3eaddcf7-0f07-4c8b-8c38-ebf82b39456f is in RUNNING state, waiting... Get a pipeline run with id=3eaddcf7-0f07-4c8b-8c38-ebf82b39456f Pipeline run with id=3eaddcf7-0f07-4c8b-8c38-ebf82b39456f is in RUNNING state, waiting... Get a pipeline run with id=3eaddcf7-0f07-4c8b-8c38-ebf82b39456f Pipeline run with id=3eaddcf7-0f07-4c8b-8c38-ebf82b39456f is in RUNNING state, waiting... Get a pipeline run with id=3eaddcf7-0f07-4c8b-8c38-ebf82b39456f Pipeline run with id=3eaddcf7-0f07-4c8b-8c38-ebf82b39456f is in RUNNING state, waiting... Get a pipeline run with id=3eaddcf7-0f07-4c8b-8c38-ebf82b39456f Pipeline run with id=3eaddcf7-0f07-4c8b-8c38-ebf82b39456f is in RUNNING state, waiting... Get a pipeline run with id=3eaddcf7-0f07-4c8b-8c38-ebf82b39456f Pipeline run with id=3eaddcf7-0f07-4c8b-8c38-ebf82b39456f is in RUNNING state, waiting... Get a pipeline run with id=3eaddcf7-0f07-4c8b-8c38-ebf82b39456f Pipeline run with id=3eaddcf7-0f07-4c8b-8c38-ebf82b39456f is in RUNNING state, waiting... Get a pipeline run with id=3eaddcf7-0f07-4c8b-8c38-ebf82b39456f Pipeline run with id=3eaddcf7-0f07-4c8b-8c38-ebf82b39456f is in RUNNING state, waiting... Get a pipeline run with id=3eaddcf7-0f07-4c8b-8c38-ebf82b39456f Pipeline run with id=3eaddcf7-0f07-4c8b-8c38-ebf82b39456f is in RUNNING state, waiting... Get a pipeline run with id=3eaddcf7-0f07-4c8b-8c38-ebf82b39456f Pipeline run with id=3eaddcf7-0f07-4c8b-8c38-ebf82b39456f is in RUNNING state, waiting... Get a pipeline run with id=3eaddcf7-0f07-4c8b-8c38-ebf82b39456f Pipeline run with id=3eaddcf7-0f07-4c8b-8c38-ebf82b39456f is in RUNNING state, waiting... Get a pipeline run with id=3eaddcf7-0f07-4c8b-8c38-ebf82b39456f Pipeline run with id=3eaddcf7-0f07-4c8b-8c38-ebf82b39456f is in RUNNING state, waiting... Get a pipeline run with id=3eaddcf7-0f07-4c8b-8c38-ebf82b39456f Pipeline run with id=3eaddcf7-0f07-4c8b-8c38-ebf82b39456f is in RUNNING state, waiting... Get a pipeline run with id=3eaddcf7-0f07-4c8b-8c38-ebf82b39456f Pipeline run with id=3eaddcf7-0f07-4c8b-8c38-ebf82b39456f is in RUNNING state, waiting... Get a pipeline run with id=3eaddcf7-0f07-4c8b-8c38-ebf82b39456f Pipeline run with id=3eaddcf7-0f07-4c8b-8c38-ebf82b39456f is in RUNNING state, waiting... Get a pipeline run with id=3eaddcf7-0f07-4c8b-8c38-ebf82b39456f Pipeline run with id=3eaddcf7-0f07-4c8b-8c38-ebf82b39456f is in RUNNING state, waiting... Get a pipeline run with id=3eaddcf7-0f07-4c8b-8c38-ebf82b39456f Pipeline run with id=3eaddcf7-0f07-4c8b-8c38-ebf82b39456f is in RUNNING state, waiting... Get a pipeline run with id=3eaddcf7-0f07-4c8b-8c38-ebf82b39456f Pipeline run with id=3eaddcf7-0f07-4c8b-8c38-ebf82b39456f is in RUNNING state, waiting... Get a pipeline run with id=3eaddcf7-0f07-4c8b-8c38-ebf82b39456f Pipeline run with id=3eaddcf7-0f07-4c8b-8c38-ebf82b39456f is in RUNNING state, waiting... Get a pipeline run with id=3eaddcf7-0f07-4c8b-8c38-ebf82b39456f Pipeline run with id=3eaddcf7-0f07-4c8b-8c38-ebf82b39456f is in RUNNING state, waiting... Get a pipeline run with id=3eaddcf7-0f07-4c8b-8c38-ebf82b39456f Pipeline run with id=3eaddcf7-0f07-4c8b-8c38-ebf82b39456f is in RUNNING state, waiting... Get a pipeline run with id=3eaddcf7-0f07-4c8b-8c38-ebf82b39456f Pipeline run with id=3eaddcf7-0f07-4c8b-8c38-ebf82b39456f is in RUNNING state, waiting... Get a pipeline run with id=3eaddcf7-0f07-4c8b-8c38-ebf82b39456f Pipeline run with id=3eaddcf7-0f07-4c8b-8c38-ebf82b39456f is in RUNNING state, waiting... Get a pipeline run with id=3eaddcf7-0f07-4c8b-8c38-ebf82b39456f Pipeline run with id=3eaddcf7-0f07-4c8b-8c38-ebf82b39456f is in RUNNING state, waiting... Get a pipeline run with id=3eaddcf7-0f07-4c8b-8c38-ebf82b39456f Pipeline run with id=3eaddcf7-0f07-4c8b-8c38-ebf82b39456f is in RUNNING state, waiting... Get a pipeline run with id=3eaddcf7-0f07-4c8b-8c38-ebf82b39456f Pipeline run with id=3eaddcf7-0f07-4c8b-8c38-ebf82b39456f is in RUNNING state, waiting... Get a pipeline run with id=3eaddcf7-0f07-4c8b-8c38-ebf82b39456f Pipeline run with id=3eaddcf7-0f07-4c8b-8c38-ebf82b39456f is in RUNNING state, waiting... Get a pipeline run with id=3eaddcf7-0f07-4c8b-8c38-ebf82b39456f Pipeline run with id=3eaddcf7-0f07-4c8b-8c38-ebf82b39456f is in RUNNING state, waiting... Get a pipeline run with id=3eaddcf7-0f07-4c8b-8c38-ebf82b39456f Pipeline run with id=3eaddcf7-0f07-4c8b-8c38-ebf82b39456f is in RUNNING state, waiting... Get a pipeline run with id=3eaddcf7-0f07-4c8b-8c38-ebf82b39456f Pipeline run with id=3eaddcf7-0f07-4c8b-8c38-ebf82b39456f is in RUNNING state, waiting... Get a pipeline run with id=3eaddcf7-0f07-4c8b-8c38-ebf82b39456f Pipeline run with id=3eaddcf7-0f07-4c8b-8c38-ebf82b39456f reached expected state SUCCEEDED Deserializing expected compiled workflow file 'essential/iris_pipeline_compiled.yaml' for the pipeline Unmarshalling Expected Workflow YAML Unmarshalled Expected Workflow YAML Fetching updated pipeline run details for run with id=3eaddcf7-0f07-4c8b-8c38-ebf82b39456f Get a pipeline run with id=3eaddcf7-0f07-4c8b-8c38-ebf82b39456f Updated pipeline run details Pipeline run succeeded, checking if the number of tasks are what is expected < Exit [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/14/26 09:08:41.672 (2m35.475s) > Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/14/26 09:08:41.672 ################### Global Cleanup after each test ##################### Deleting 1 run(s) Terminate run 3eaddcf7-0f07-4c8b-8c38-ebf82b39456f Failed to terminate run 3eaddcf7-0f07-4c8b-8c38-ebf82b39456f Terminate run 3eaddcf7-0f07-4c8b-8c38-ebf82b39456f Deleting run 3eaddcf7-0f07-4c8b-8c38-ebf82b39456f Deleting 0 experiment(s) Deleting 1 pipeline(s) Deleting pipeline with id=f1f4191a-9d1e-4c50-9915-1340130246d9 (cascade=true) Pipeline with id=f1f4191a-9d1e-4c50-9915-1340130246d9, DELETED < Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/14/26 09:08:41.843 (171ms) > Enter [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/14/26 09:08:41.843 < Exit [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/14/26 09:08:41.843 (0s) > Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/14/26 09:08:41.844 < Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/14/26 09:08:41.844 (0s)