2026/07/13 06:05:04 Test passed > Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/13/26 06:04:17.897 Create an experiment with name E2EExperiment-1783922657897975325 < Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/13/26 06:04:18.347 (450ms) > Enter [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/13/26 06:04:18.347 ################### Setup before each Pipeline Upload test ##################### ################### Global Setup before each test ##################### Test Context: 0x35628fc36d80 Looks like test-secret-1 already exists, because creation failed due to secrets "test-secret-1" already exists Looks like test-secret-2 already exists, because creation failed due to secrets "test-secret-2" already exists Looks like test-secret-3 already exists, because creation failed due to secrets "test-secret-3" already exists < Exit [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/13/26 06:04:18.484 (136ms) > Enter [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/13/26 06:04:18.484 Uploading pipeline file essential/component_with_pip_index_urls.yaml Creating temp pipeline file with overridden SDK Version Uploading pipeline with name=e2e-test-1783922658347973660, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml Upload of pipeline file 'essential/component_with_pip_index_urls.yaml' successful Listing pipeline versions for pipeline 6debccd2-4b4d-41cc-b87a-6a1ec2626bcf Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml Returning pipeline run time inputs map[] Create run for pipeline with id: '6debccd2-4b4d-41cc-b87a-6a1ec2626bcf' and name: 'e2e-test-1783922658347973660' Create a pipeline run for pipeline with id=6debccd2-4b4d-41cc-b87a-6a1ec2626bcf and versionId=fb4030f8-9a6e-4039-920e-d11fc25d016d Create a pipeline run body Created Pipeline Run successfully with runId=38bc1190-22aa-44b0-8701-9ea831cf3bff Created Pipeline Run with id: 38bc1190-22aa-44b0-8701-9ea831cf3bff for pipeline with id: 6debccd2-4b4d-41cc-b87a-6a1ec2626bcf Waiting for pipeline run with id=38bc1190-22aa-44b0-8701-9ea831cf3bff to be in one of '[SUCCEEDED SKIPPED FAILED CANCELED]' Get a pipeline run with id=38bc1190-22aa-44b0-8701-9ea831cf3bff Pipeline run with id=38bc1190-22aa-44b0-8701-9ea831cf3bff is in PENDING state, waiting... Get a pipeline run with id=38bc1190-22aa-44b0-8701-9ea831cf3bff Pipeline run with id=38bc1190-22aa-44b0-8701-9ea831cf3bff is in RUNNING state, waiting... Get a pipeline run with id=38bc1190-22aa-44b0-8701-9ea831cf3bff Pipeline run with id=38bc1190-22aa-44b0-8701-9ea831cf3bff is in RUNNING state, waiting... Get a pipeline run with id=38bc1190-22aa-44b0-8701-9ea831cf3bff Pipeline run with id=38bc1190-22aa-44b0-8701-9ea831cf3bff is in RUNNING state, waiting... Get a pipeline run with id=38bc1190-22aa-44b0-8701-9ea831cf3bff Pipeline run with id=38bc1190-22aa-44b0-8701-9ea831cf3bff is in RUNNING state, waiting... Get a pipeline run with id=38bc1190-22aa-44b0-8701-9ea831cf3bff Pipeline run with id=38bc1190-22aa-44b0-8701-9ea831cf3bff is in RUNNING state, waiting... Get a pipeline run with id=38bc1190-22aa-44b0-8701-9ea831cf3bff Pipeline run with id=38bc1190-22aa-44b0-8701-9ea831cf3bff is in RUNNING state, waiting... Get a pipeline run with id=38bc1190-22aa-44b0-8701-9ea831cf3bff Pipeline run with id=38bc1190-22aa-44b0-8701-9ea831cf3bff is in RUNNING state, waiting... Get a pipeline run with id=38bc1190-22aa-44b0-8701-9ea831cf3bff Pipeline run with id=38bc1190-22aa-44b0-8701-9ea831cf3bff is in RUNNING state, waiting... Get a pipeline run with id=38bc1190-22aa-44b0-8701-9ea831cf3bff Pipeline run with id=38bc1190-22aa-44b0-8701-9ea831cf3bff reached expected state SUCCEEDED Deserializing expected compiled workflow file 'essential/component_with_pip_index_urls.yaml' for the pipeline Unmarshalling Expected Workflow YAML Unmarshalled Expected Workflow YAML Fetching updated pipeline run details for run with id=38bc1190-22aa-44b0-8701-9ea831cf3bff Get a pipeline run with id=38bc1190-22aa-44b0-8701-9ea831cf3bff Updated pipeline run details Pipeline run succeeded, checking if the number of tasks are what is expected < Exit [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/13/26 06:05:03.95 (45.466s) > Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/13/26 06:05:03.95 ################### Global Cleanup after each test ##################### Deleting 1 run(s) Terminate run 38bc1190-22aa-44b0-8701-9ea831cf3bff Failed to terminate run 38bc1190-22aa-44b0-8701-9ea831cf3bff Terminate run 38bc1190-22aa-44b0-8701-9ea831cf3bff Deleting run 38bc1190-22aa-44b0-8701-9ea831cf3bff Deleting 0 experiment(s) Deleting 1 pipeline(s) Deleting pipeline with id=6debccd2-4b4d-41cc-b87a-6a1ec2626bcf (cascade=true) Pipeline with id=6debccd2-4b4d-41cc-b87a-6a1ec2626bcf, DELETED < Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/13/26 06:05:04.165 (215ms) > Enter [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/13/26 06:05:04.165 < Exit [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/13/26 06:05:04.165 (0s) > Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/13/26 06:05:04.165 < Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/13/26 06:05:04.165 (0s) 2026/07/13 06:05:53 Test passed > Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/13/26 06:04:17.885 Create an experiment with name E2EExperiment-1783922657885712036 < Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/13/26 06:04:18.067 (182ms) > Enter [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/13/26 06:04:18.067 ################### Setup before each Pipeline Upload test ##################### ################### Global Setup before each test ##################### Test Context: 0x6dba66e500 Looks like test-secret-1 already exists, because creation failed due to secrets "test-secret-1" already exists Looks like test-secret-2 already exists, because creation failed due to secrets "test-secret-2" already exists Looks like test-secret-3 already exists, because creation failed due to secrets "test-secret-3" already exists < Exit [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/13/26 06:04:18.199 (132ms) > Enter [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/13/26 06:04:18.199 Uploading pipeline file critical/pipeline_with_artifact_upload_download.yaml Creating temp pipeline file with overridden SDK Version Uploading pipeline with name=e2e-test-1783922658067807293, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml Upload of pipeline file 'critical/pipeline_with_artifact_upload_download.yaml' successful Listing pipeline versions for pipeline f1f391e4-ab3c-427d-b9ab-dba0920e9221 Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml Returning pipeline run time inputs map[] Create run for pipeline with id: 'f1f391e4-ab3c-427d-b9ab-dba0920e9221' and name: 'e2e-test-1783922658067807293' Create a pipeline run for pipeline with id=f1f391e4-ab3c-427d-b9ab-dba0920e9221 and versionId=d1e93926-1224-4013-844d-a98722beaf3c Create a pipeline run body Created Pipeline Run successfully with runId=781e4861-eccd-493b-99be-dda6b4f4d17a Created Pipeline Run with id: 781e4861-eccd-493b-99be-dda6b4f4d17a for pipeline with id: f1f391e4-ab3c-427d-b9ab-dba0920e9221 Waiting for pipeline run with id=781e4861-eccd-493b-99be-dda6b4f4d17a to be in one of '[SUCCEEDED SKIPPED FAILED CANCELED]' Get a pipeline run with id=781e4861-eccd-493b-99be-dda6b4f4d17a Pipeline run with id=781e4861-eccd-493b-99be-dda6b4f4d17a is in PENDING state, waiting... Get a pipeline run with id=781e4861-eccd-493b-99be-dda6b4f4d17a Pipeline run with id=781e4861-eccd-493b-99be-dda6b4f4d17a is in RUNNING state, waiting... Get a pipeline run with id=781e4861-eccd-493b-99be-dda6b4f4d17a Pipeline run with id=781e4861-eccd-493b-99be-dda6b4f4d17a is in RUNNING state, waiting... Get a pipeline run with id=781e4861-eccd-493b-99be-dda6b4f4d17a Pipeline run with id=781e4861-eccd-493b-99be-dda6b4f4d17a is in RUNNING state, waiting... Get a pipeline run with id=781e4861-eccd-493b-99be-dda6b4f4d17a Pipeline run with id=781e4861-eccd-493b-99be-dda6b4f4d17a is in RUNNING state, waiting... Get a pipeline run with id=781e4861-eccd-493b-99be-dda6b4f4d17a Pipeline run with id=781e4861-eccd-493b-99be-dda6b4f4d17a is in RUNNING state, waiting... Get a pipeline run with id=781e4861-eccd-493b-99be-dda6b4f4d17a Pipeline run with id=781e4861-eccd-493b-99be-dda6b4f4d17a is in RUNNING state, waiting... Get a pipeline run with id=781e4861-eccd-493b-99be-dda6b4f4d17a Pipeline run with id=781e4861-eccd-493b-99be-dda6b4f4d17a is in RUNNING state, waiting... Get a pipeline run with id=781e4861-eccd-493b-99be-dda6b4f4d17a Pipeline run with id=781e4861-eccd-493b-99be-dda6b4f4d17a is in RUNNING state, waiting... Get a pipeline run with id=781e4861-eccd-493b-99be-dda6b4f4d17a Pipeline run with id=781e4861-eccd-493b-99be-dda6b4f4d17a is in RUNNING state, waiting... Get a pipeline run with id=781e4861-eccd-493b-99be-dda6b4f4d17a Pipeline run with id=781e4861-eccd-493b-99be-dda6b4f4d17a is in RUNNING state, waiting... Get a pipeline run with id=781e4861-eccd-493b-99be-dda6b4f4d17a Pipeline run with id=781e4861-eccd-493b-99be-dda6b4f4d17a is in RUNNING state, waiting... Get a pipeline run with id=781e4861-eccd-493b-99be-dda6b4f4d17a Pipeline run with id=781e4861-eccd-493b-99be-dda6b4f4d17a is in RUNNING state, waiting... Get a pipeline run with id=781e4861-eccd-493b-99be-dda6b4f4d17a Pipeline run with id=781e4861-eccd-493b-99be-dda6b4f4d17a is in RUNNING state, waiting... Get a pipeline run with id=781e4861-eccd-493b-99be-dda6b4f4d17a Pipeline run with id=781e4861-eccd-493b-99be-dda6b4f4d17a is in RUNNING state, waiting... Get a pipeline run with id=781e4861-eccd-493b-99be-dda6b4f4d17a Pipeline run with id=781e4861-eccd-493b-99be-dda6b4f4d17a is in RUNNING state, waiting... Get a pipeline run with id=781e4861-eccd-493b-99be-dda6b4f4d17a Pipeline run with id=781e4861-eccd-493b-99be-dda6b4f4d17a is in RUNNING state, waiting... Get a pipeline run with id=781e4861-eccd-493b-99be-dda6b4f4d17a Pipeline run with id=781e4861-eccd-493b-99be-dda6b4f4d17a is in RUNNING state, waiting... Get a pipeline run with id=781e4861-eccd-493b-99be-dda6b4f4d17a Pipeline run with id=781e4861-eccd-493b-99be-dda6b4f4d17a is in RUNNING state, waiting... Get a pipeline run with id=781e4861-eccd-493b-99be-dda6b4f4d17a Pipeline run with id=781e4861-eccd-493b-99be-dda6b4f4d17a reached expected state SUCCEEDED Deserializing expected compiled workflow file 'critical/pipeline_with_artifact_upload_download.yaml' for the pipeline Unmarshalling Expected Workflow YAML Unmarshalled Expected Workflow YAML Fetching updated pipeline run details for run with id=781e4861-eccd-493b-99be-dda6b4f4d17a Get a pipeline run with id=781e4861-eccd-493b-99be-dda6b4f4d17a Updated pipeline run details Pipeline run succeeded, checking if the number of tasks are what is expected < Exit [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/13/26 06:05:53.716 (1m35.517s) > Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/13/26 06:05:53.716 ################### Global Cleanup after each test ##################### Deleting 1 run(s) Terminate run 781e4861-eccd-493b-99be-dda6b4f4d17a Failed to terminate run 781e4861-eccd-493b-99be-dda6b4f4d17a Terminate run 781e4861-eccd-493b-99be-dda6b4f4d17a Deleting run 781e4861-eccd-493b-99be-dda6b4f4d17a Deleting 0 experiment(s) Deleting 1 pipeline(s) Deleting pipeline with id=f1f391e4-ab3c-427d-b9ab-dba0920e9221 (cascade=true) Pipeline with id=f1f391e4-ab3c-427d-b9ab-dba0920e9221, DELETED < Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/13/26 06:05:53.971 (255ms) > Enter [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/13/26 06:05:53.972 < Exit [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/13/26 06:05:53.972 (0s) > Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/13/26 06:05:53.972 < Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/13/26 06:05:53.972 (0s) 2026/07/13 06:05:59 Test passed > Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/13/26 06:04:17.885 Create an experiment with name E2EExperiment-1783922657885502221 < Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/13/26 06:04:18.061 (176ms) > Enter [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/13/26 06:04:18.061 ################### Setup before each Pipeline Upload test ##################### ################### Global Setup before each test ##################### Test Context: 0x198bfee14380 test-secret-1 created test-secret-2 created test-secret-3 created < Exit [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/13/26 06:04:18.14 (79ms) > Enter [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/13/26 06:04:18.14 Uploading pipeline file critical/parallel_for_after_dependency.yaml Creating temp pipeline file with overridden SDK Version Uploading pipeline with name=e2e-test-1783922658061615803, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml Upload of pipeline file 'critical/parallel_for_after_dependency.yaml' successful Listing pipeline versions for pipeline 9ded6110-0628-474b-a9fa-c242f76fa0a2 Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml Returning pipeline run time inputs map[] Create run for pipeline with id: '9ded6110-0628-474b-a9fa-c242f76fa0a2' and name: 'e2e-test-1783922658061615803' Create a pipeline run for pipeline with id=9ded6110-0628-474b-a9fa-c242f76fa0a2 and versionId=5f2edd94-25ec-43fd-bf2f-90c64ae4acd5 Create a pipeline run body Created Pipeline Run successfully with runId=1d36a8b4-ebe6-481f-8752-d424b5a3f514 Created Pipeline Run with id: 1d36a8b4-ebe6-481f-8752-d424b5a3f514 for pipeline with id: 9ded6110-0628-474b-a9fa-c242f76fa0a2 Waiting for pipeline run with id=1d36a8b4-ebe6-481f-8752-d424b5a3f514 to be in one of '[SUCCEEDED SKIPPED FAILED CANCELED]' Get a pipeline run with id=1d36a8b4-ebe6-481f-8752-d424b5a3f514 Pipeline run with id=1d36a8b4-ebe6-481f-8752-d424b5a3f514 is in PENDING state, waiting... Get a pipeline run with id=1d36a8b4-ebe6-481f-8752-d424b5a3f514 Pipeline run with id=1d36a8b4-ebe6-481f-8752-d424b5a3f514 is in RUNNING state, waiting... Get a pipeline run with id=1d36a8b4-ebe6-481f-8752-d424b5a3f514 Pipeline run with id=1d36a8b4-ebe6-481f-8752-d424b5a3f514 is in RUNNING state, waiting... Get a pipeline run with id=1d36a8b4-ebe6-481f-8752-d424b5a3f514 Pipeline run with id=1d36a8b4-ebe6-481f-8752-d424b5a3f514 is in RUNNING state, waiting... Get a pipeline run with id=1d36a8b4-ebe6-481f-8752-d424b5a3f514 Pipeline run with id=1d36a8b4-ebe6-481f-8752-d424b5a3f514 is in RUNNING state, waiting... Get a pipeline run with id=1d36a8b4-ebe6-481f-8752-d424b5a3f514 Pipeline run with id=1d36a8b4-ebe6-481f-8752-d424b5a3f514 is in RUNNING state, waiting... Get a pipeline run with id=1d36a8b4-ebe6-481f-8752-d424b5a3f514 Pipeline run with id=1d36a8b4-ebe6-481f-8752-d424b5a3f514 is in RUNNING state, waiting... Get a pipeline run with id=1d36a8b4-ebe6-481f-8752-d424b5a3f514 Pipeline run with id=1d36a8b4-ebe6-481f-8752-d424b5a3f514 is in RUNNING state, waiting... Get a pipeline run with id=1d36a8b4-ebe6-481f-8752-d424b5a3f514 Pipeline run with id=1d36a8b4-ebe6-481f-8752-d424b5a3f514 is in RUNNING state, waiting... Get a pipeline run with id=1d36a8b4-ebe6-481f-8752-d424b5a3f514 Pipeline run with id=1d36a8b4-ebe6-481f-8752-d424b5a3f514 is in RUNNING state, waiting... Get a pipeline run with id=1d36a8b4-ebe6-481f-8752-d424b5a3f514 Pipeline run with id=1d36a8b4-ebe6-481f-8752-d424b5a3f514 is in RUNNING state, waiting... Get a pipeline run with id=1d36a8b4-ebe6-481f-8752-d424b5a3f514 Pipeline run with id=1d36a8b4-ebe6-481f-8752-d424b5a3f514 is in RUNNING state, waiting... Get a pipeline run with id=1d36a8b4-ebe6-481f-8752-d424b5a3f514 Pipeline run with id=1d36a8b4-ebe6-481f-8752-d424b5a3f514 is in RUNNING state, waiting... Get a pipeline run with id=1d36a8b4-ebe6-481f-8752-d424b5a3f514 Pipeline run with id=1d36a8b4-ebe6-481f-8752-d424b5a3f514 is in RUNNING state, waiting... Get a pipeline run with id=1d36a8b4-ebe6-481f-8752-d424b5a3f514 Pipeline run with id=1d36a8b4-ebe6-481f-8752-d424b5a3f514 is in RUNNING state, waiting... Get a pipeline run with id=1d36a8b4-ebe6-481f-8752-d424b5a3f514 Pipeline run with id=1d36a8b4-ebe6-481f-8752-d424b5a3f514 is in RUNNING state, waiting... Get a pipeline run with id=1d36a8b4-ebe6-481f-8752-d424b5a3f514 Pipeline run with id=1d36a8b4-ebe6-481f-8752-d424b5a3f514 is in RUNNING state, waiting... Get a pipeline run with id=1d36a8b4-ebe6-481f-8752-d424b5a3f514 Pipeline run with id=1d36a8b4-ebe6-481f-8752-d424b5a3f514 is in RUNNING state, waiting... Get a pipeline run with id=1d36a8b4-ebe6-481f-8752-d424b5a3f514 Pipeline run with id=1d36a8b4-ebe6-481f-8752-d424b5a3f514 is in RUNNING state, waiting... Get a pipeline run with id=1d36a8b4-ebe6-481f-8752-d424b5a3f514 Pipeline run with id=1d36a8b4-ebe6-481f-8752-d424b5a3f514 is in RUNNING state, waiting... Get a pipeline run with id=1d36a8b4-ebe6-481f-8752-d424b5a3f514 Pipeline run with id=1d36a8b4-ebe6-481f-8752-d424b5a3f514 reached expected state SUCCEEDED Deserializing expected compiled workflow file 'critical/parallel_for_after_dependency.yaml' for the pipeline Unmarshalling Expected Workflow YAML Unmarshalled Expected Workflow YAML Fetching updated pipeline run details for run with id=1d36a8b4-ebe6-481f-8752-d424b5a3f514 Get a pipeline run with id=1d36a8b4-ebe6-481f-8752-d424b5a3f514 Updated pipeline run details Pipeline run succeeded, checking if the number of tasks are what is expected < Exit [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/13/26 06:05:58.828 (1m40.688s) > Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/13/26 06:05:58.829 ################### Global Cleanup after each test ##################### Deleting 1 run(s) Terminate run 1d36a8b4-ebe6-481f-8752-d424b5a3f514 Failed to terminate run 1d36a8b4-ebe6-481f-8752-d424b5a3f514 Terminate run 1d36a8b4-ebe6-481f-8752-d424b5a3f514 Deleting run 1d36a8b4-ebe6-481f-8752-d424b5a3f514 Deleting 0 experiment(s) Deleting 1 pipeline(s) Deleting pipeline with id=9ded6110-0628-474b-a9fa-c242f76fa0a2 (cascade=true) Pipeline with id=9ded6110-0628-474b-a9fa-c242f76fa0a2, DELETED < Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/13/26 06:05:59.192 (364ms) > Enter [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/13/26 06:05:59.193 < Exit [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/13/26 06:05:59.193 (0s) > Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/13/26 06:05:59.193 < Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/13/26 06:05:59.193 (0s) 2026/07/13 06:06:24 Test passed > Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/13/26 06:04:17.885 Create an experiment with name E2EExperiment-1783922657885415509 < Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/13/26 06:04:18.066 (181ms) > Enter [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/13/26 06:04:18.066 ################### Setup before each Pipeline Upload test ##################### ################### Global Setup before each test ##################### Test Context: 0x5d3f460200 Looks like test-secret-1 already exists, because creation failed due to secrets "test-secret-1" already exists Looks like test-secret-2 already exists, because creation failed due to secrets "test-secret-2" already exists Looks like test-secret-3 already exists, because creation failed due to secrets "test-secret-3" already exists < Exit [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/13/26 06:04:18.198 (132ms) > Enter [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/13/26 06:04:18.198 Uploading pipeline file critical/flip_coin.yaml Creating temp pipeline file with overridden SDK Version Uploading pipeline with name=e2e-test-1783922658066738527, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml Upload of pipeline file 'critical/flip_coin.yaml' successful Listing pipeline versions for pipeline eaff57df-a3ce-4857-952c-3348340c6e4a Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml Returning pipeline run time inputs map[] Create run for pipeline with id: 'eaff57df-a3ce-4857-952c-3348340c6e4a' and name: 'e2e-test-1783922658066738527' Create a pipeline run for pipeline with id=eaff57df-a3ce-4857-952c-3348340c6e4a and versionId=c19c014a-77cf-4a29-96b4-475402b5b6f7 Create a pipeline run body Created Pipeline Run successfully with runId=7bcf301b-28a4-4584-b87a-6dc10e1894f2 Created Pipeline Run with id: 7bcf301b-28a4-4584-b87a-6dc10e1894f2 for pipeline with id: eaff57df-a3ce-4857-952c-3348340c6e4a Waiting for pipeline run with id=7bcf301b-28a4-4584-b87a-6dc10e1894f2 to be in one of '[SUCCEEDED SKIPPED FAILED CANCELED]' Get a pipeline run with id=7bcf301b-28a4-4584-b87a-6dc10e1894f2 Pipeline run with id=7bcf301b-28a4-4584-b87a-6dc10e1894f2 is in PENDING state, waiting... Get a pipeline run with id=7bcf301b-28a4-4584-b87a-6dc10e1894f2 Pipeline run with id=7bcf301b-28a4-4584-b87a-6dc10e1894f2 is in RUNNING state, waiting... Get a pipeline run with id=7bcf301b-28a4-4584-b87a-6dc10e1894f2 Pipeline run with id=7bcf301b-28a4-4584-b87a-6dc10e1894f2 is in RUNNING state, waiting... Get a pipeline run with id=7bcf301b-28a4-4584-b87a-6dc10e1894f2 Pipeline run with id=7bcf301b-28a4-4584-b87a-6dc10e1894f2 is in RUNNING state, waiting... Get a pipeline run with id=7bcf301b-28a4-4584-b87a-6dc10e1894f2 Pipeline run with id=7bcf301b-28a4-4584-b87a-6dc10e1894f2 is in RUNNING state, waiting... Get a pipeline run with id=7bcf301b-28a4-4584-b87a-6dc10e1894f2 Pipeline run with id=7bcf301b-28a4-4584-b87a-6dc10e1894f2 is in RUNNING state, waiting... Get a pipeline run with id=7bcf301b-28a4-4584-b87a-6dc10e1894f2 Pipeline run with id=7bcf301b-28a4-4584-b87a-6dc10e1894f2 is in RUNNING state, waiting... Get a pipeline run with id=7bcf301b-28a4-4584-b87a-6dc10e1894f2 Pipeline run with id=7bcf301b-28a4-4584-b87a-6dc10e1894f2 is in RUNNING state, waiting... Get a pipeline run with id=7bcf301b-28a4-4584-b87a-6dc10e1894f2 Pipeline run with id=7bcf301b-28a4-4584-b87a-6dc10e1894f2 is in RUNNING state, waiting... Get a pipeline run with id=7bcf301b-28a4-4584-b87a-6dc10e1894f2 Pipeline run with id=7bcf301b-28a4-4584-b87a-6dc10e1894f2 is in RUNNING state, waiting... Get a pipeline run with id=7bcf301b-28a4-4584-b87a-6dc10e1894f2 Pipeline run with id=7bcf301b-28a4-4584-b87a-6dc10e1894f2 is in RUNNING state, waiting... Get a pipeline run with id=7bcf301b-28a4-4584-b87a-6dc10e1894f2 Pipeline run with id=7bcf301b-28a4-4584-b87a-6dc10e1894f2 is in RUNNING state, waiting... Get a pipeline run with id=7bcf301b-28a4-4584-b87a-6dc10e1894f2 Pipeline run with id=7bcf301b-28a4-4584-b87a-6dc10e1894f2 is in RUNNING state, waiting... Get a pipeline run with id=7bcf301b-28a4-4584-b87a-6dc10e1894f2 Pipeline run with id=7bcf301b-28a4-4584-b87a-6dc10e1894f2 is in RUNNING state, waiting... Get a pipeline run with id=7bcf301b-28a4-4584-b87a-6dc10e1894f2 Pipeline run with id=7bcf301b-28a4-4584-b87a-6dc10e1894f2 is in RUNNING state, waiting... Get a pipeline run with id=7bcf301b-28a4-4584-b87a-6dc10e1894f2 Pipeline run with id=7bcf301b-28a4-4584-b87a-6dc10e1894f2 is in RUNNING state, waiting... Get a pipeline run with id=7bcf301b-28a4-4584-b87a-6dc10e1894f2 Pipeline run with id=7bcf301b-28a4-4584-b87a-6dc10e1894f2 is in RUNNING state, waiting... Get a pipeline run with id=7bcf301b-28a4-4584-b87a-6dc10e1894f2 Pipeline run with id=7bcf301b-28a4-4584-b87a-6dc10e1894f2 is in RUNNING state, waiting... Get a pipeline run with id=7bcf301b-28a4-4584-b87a-6dc10e1894f2 Pipeline run with id=7bcf301b-28a4-4584-b87a-6dc10e1894f2 is in RUNNING state, waiting... Get a pipeline run with id=7bcf301b-28a4-4584-b87a-6dc10e1894f2 Pipeline run with id=7bcf301b-28a4-4584-b87a-6dc10e1894f2 is in RUNNING state, waiting... Get a pipeline run with id=7bcf301b-28a4-4584-b87a-6dc10e1894f2 Pipeline run with id=7bcf301b-28a4-4584-b87a-6dc10e1894f2 is in RUNNING state, waiting... Get a pipeline run with id=7bcf301b-28a4-4584-b87a-6dc10e1894f2 Pipeline run with id=7bcf301b-28a4-4584-b87a-6dc10e1894f2 is in RUNNING state, waiting... Get a pipeline run with id=7bcf301b-28a4-4584-b87a-6dc10e1894f2 Pipeline run with id=7bcf301b-28a4-4584-b87a-6dc10e1894f2 is in RUNNING state, waiting... Get a pipeline run with id=7bcf301b-28a4-4584-b87a-6dc10e1894f2 Pipeline run with id=7bcf301b-28a4-4584-b87a-6dc10e1894f2 is in RUNNING state, waiting... Get a pipeline run with id=7bcf301b-28a4-4584-b87a-6dc10e1894f2 Pipeline run with id=7bcf301b-28a4-4584-b87a-6dc10e1894f2 is in RUNNING state, waiting... Get a pipeline run with id=7bcf301b-28a4-4584-b87a-6dc10e1894f2 Pipeline run with id=7bcf301b-28a4-4584-b87a-6dc10e1894f2 reached expected state SUCCEEDED Deserializing expected compiled workflow file 'critical/flip_coin.yaml' for the pipeline Unmarshalling Expected Workflow YAML Unmarshalled Expected Workflow YAML Fetching updated pipeline run details for run with id=7bcf301b-28a4-4584-b87a-6dc10e1894f2 Get a pipeline run with id=7bcf301b-28a4-4584-b87a-6dc10e1894f2 Updated pipeline run details Pipeline run succeeded, checking if the number of tasks are what is expected < Exit [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/13/26 06:06:23.892 (2m5.693s) > Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/13/26 06:06:23.892 ################### Global Cleanup after each test ##################### Deleting 1 run(s) Terminate run 7bcf301b-28a4-4584-b87a-6dc10e1894f2 Failed to terminate run 7bcf301b-28a4-4584-b87a-6dc10e1894f2 Terminate run 7bcf301b-28a4-4584-b87a-6dc10e1894f2 Deleting run 7bcf301b-28a4-4584-b87a-6dc10e1894f2 Deleting 0 experiment(s) Deleting 1 pipeline(s) Deleting pipeline with id=eaff57df-a3ce-4857-952c-3348340c6e4a (cascade=true) Pipeline with id=eaff57df-a3ce-4857-952c-3348340c6e4a, DELETED < Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/13/26 06:06:24.079 (187ms) > Enter [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/13/26 06:06:24.079 < Exit [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/13/26 06:06:24.079 (0s) > Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/13/26 06:06:24.08 < Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/13/26 06:06:24.08 (0s) 2026/07/13 06:06:49 Test passed > Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/13/26 06:04:17.899 Create an experiment with name E2EExperiment-1783922657899060471 < Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/13/26 06:04:18.067 (169ms) > Enter [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/13/26 06:04:18.067 ################### Setup before each Pipeline Upload test ##################### ################### Global Setup before each test ##################### Test Context: 0x13db7d7a6180 Looks like test-secret-1 already exists, because creation failed due to secrets "test-secret-1" already exists Looks like test-secret-2 already exists, because creation failed due to secrets "test-secret-2" already exists Looks like test-secret-3 already exists, because creation failed due to secrets "test-secret-3" already exists < Exit [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/13/26 06:04:18.221 (154ms) > Enter [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/13/26 06:04:18.222 Uploading pipeline file essential/iris_pipeline_compiled.yaml Creating temp pipeline file with overridden SDK Version Uploading pipeline with name=e2e-test-1783922658067873885, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml Upload of pipeline file 'essential/iris_pipeline_compiled.yaml' successful Listing pipeline versions for pipeline 6f36503a-eb11-4b7e-a033-d4ec37529ded Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml Returning pipeline run time inputs map[] Create run for pipeline with id: '6f36503a-eb11-4b7e-a033-d4ec37529ded' and name: 'e2e-test-1783922658067873885' Create a pipeline run for pipeline with id=6f36503a-eb11-4b7e-a033-d4ec37529ded and versionId=d16dc513-417e-4fb1-9f29-265094be61e0 Create a pipeline run body Created Pipeline Run successfully with runId=20bd5729-dbf2-4afa-88b5-3a490c0987cf Created Pipeline Run with id: 20bd5729-dbf2-4afa-88b5-3a490c0987cf for pipeline with id: 6f36503a-eb11-4b7e-a033-d4ec37529ded Waiting for pipeline run with id=20bd5729-dbf2-4afa-88b5-3a490c0987cf to be in one of '[SUCCEEDED SKIPPED FAILED CANCELED]' Get a pipeline run with id=20bd5729-dbf2-4afa-88b5-3a490c0987cf Pipeline run with id=20bd5729-dbf2-4afa-88b5-3a490c0987cf is in PENDING state, waiting... Get a pipeline run with id=20bd5729-dbf2-4afa-88b5-3a490c0987cf Pipeline run with id=20bd5729-dbf2-4afa-88b5-3a490c0987cf is in RUNNING state, waiting... Get a pipeline run with id=20bd5729-dbf2-4afa-88b5-3a490c0987cf Pipeline run with id=20bd5729-dbf2-4afa-88b5-3a490c0987cf is in RUNNING state, waiting... Get a pipeline run with id=20bd5729-dbf2-4afa-88b5-3a490c0987cf Pipeline run with id=20bd5729-dbf2-4afa-88b5-3a490c0987cf is in RUNNING state, waiting... Get a pipeline run with id=20bd5729-dbf2-4afa-88b5-3a490c0987cf Pipeline run with id=20bd5729-dbf2-4afa-88b5-3a490c0987cf is in RUNNING state, waiting... Get a pipeline run with id=20bd5729-dbf2-4afa-88b5-3a490c0987cf Pipeline run with id=20bd5729-dbf2-4afa-88b5-3a490c0987cf is in RUNNING state, waiting... Get a pipeline run with id=20bd5729-dbf2-4afa-88b5-3a490c0987cf Pipeline run with id=20bd5729-dbf2-4afa-88b5-3a490c0987cf is in RUNNING state, waiting... Get a pipeline run with id=20bd5729-dbf2-4afa-88b5-3a490c0987cf Pipeline run with id=20bd5729-dbf2-4afa-88b5-3a490c0987cf is in RUNNING state, waiting... Get a pipeline run with id=20bd5729-dbf2-4afa-88b5-3a490c0987cf Pipeline run with id=20bd5729-dbf2-4afa-88b5-3a490c0987cf is in RUNNING state, waiting... Get a pipeline run with id=20bd5729-dbf2-4afa-88b5-3a490c0987cf Pipeline run with id=20bd5729-dbf2-4afa-88b5-3a490c0987cf is in RUNNING state, waiting... Get a pipeline run with id=20bd5729-dbf2-4afa-88b5-3a490c0987cf Pipeline run with id=20bd5729-dbf2-4afa-88b5-3a490c0987cf is in RUNNING state, waiting... Get a pipeline run with id=20bd5729-dbf2-4afa-88b5-3a490c0987cf Pipeline run with id=20bd5729-dbf2-4afa-88b5-3a490c0987cf is in RUNNING state, waiting... Get a pipeline run with id=20bd5729-dbf2-4afa-88b5-3a490c0987cf Pipeline run with id=20bd5729-dbf2-4afa-88b5-3a490c0987cf is in RUNNING state, waiting... Get a pipeline run with id=20bd5729-dbf2-4afa-88b5-3a490c0987cf Pipeline run with id=20bd5729-dbf2-4afa-88b5-3a490c0987cf is in RUNNING state, waiting... Get a pipeline run with id=20bd5729-dbf2-4afa-88b5-3a490c0987cf Pipeline run with id=20bd5729-dbf2-4afa-88b5-3a490c0987cf is in RUNNING state, waiting... Get a pipeline run with id=20bd5729-dbf2-4afa-88b5-3a490c0987cf Pipeline run with id=20bd5729-dbf2-4afa-88b5-3a490c0987cf is in RUNNING state, waiting... Get a pipeline run with id=20bd5729-dbf2-4afa-88b5-3a490c0987cf Pipeline run with id=20bd5729-dbf2-4afa-88b5-3a490c0987cf is in RUNNING state, waiting... Get a pipeline run with id=20bd5729-dbf2-4afa-88b5-3a490c0987cf Pipeline run with id=20bd5729-dbf2-4afa-88b5-3a490c0987cf is in RUNNING state, waiting... Get a pipeline run with id=20bd5729-dbf2-4afa-88b5-3a490c0987cf Pipeline run with id=20bd5729-dbf2-4afa-88b5-3a490c0987cf is in RUNNING state, waiting... Get a pipeline run with id=20bd5729-dbf2-4afa-88b5-3a490c0987cf Pipeline run with id=20bd5729-dbf2-4afa-88b5-3a490c0987cf is in RUNNING state, waiting... Get a pipeline run with id=20bd5729-dbf2-4afa-88b5-3a490c0987cf Pipeline run with id=20bd5729-dbf2-4afa-88b5-3a490c0987cf is in RUNNING state, waiting... Get a pipeline run with id=20bd5729-dbf2-4afa-88b5-3a490c0987cf Pipeline run with id=20bd5729-dbf2-4afa-88b5-3a490c0987cf is in RUNNING state, waiting... Get a pipeline run with id=20bd5729-dbf2-4afa-88b5-3a490c0987cf Pipeline run with id=20bd5729-dbf2-4afa-88b5-3a490c0987cf is in RUNNING state, waiting... Get a pipeline run with id=20bd5729-dbf2-4afa-88b5-3a490c0987cf Pipeline run with id=20bd5729-dbf2-4afa-88b5-3a490c0987cf is in RUNNING state, waiting... Get a pipeline run with id=20bd5729-dbf2-4afa-88b5-3a490c0987cf Pipeline run with id=20bd5729-dbf2-4afa-88b5-3a490c0987cf is in RUNNING state, waiting... Get a pipeline run with id=20bd5729-dbf2-4afa-88b5-3a490c0987cf Pipeline run with id=20bd5729-dbf2-4afa-88b5-3a490c0987cf is in RUNNING state, waiting... Get a pipeline run with id=20bd5729-dbf2-4afa-88b5-3a490c0987cf Pipeline run with id=20bd5729-dbf2-4afa-88b5-3a490c0987cf is in RUNNING state, waiting... Get a pipeline run with id=20bd5729-dbf2-4afa-88b5-3a490c0987cf Pipeline run with id=20bd5729-dbf2-4afa-88b5-3a490c0987cf is in RUNNING state, waiting... Get a pipeline run with id=20bd5729-dbf2-4afa-88b5-3a490c0987cf Pipeline run with id=20bd5729-dbf2-4afa-88b5-3a490c0987cf is in RUNNING state, waiting... Get a pipeline run with id=20bd5729-dbf2-4afa-88b5-3a490c0987cf Pipeline run with id=20bd5729-dbf2-4afa-88b5-3a490c0987cf is in RUNNING state, waiting... Get a pipeline run with id=20bd5729-dbf2-4afa-88b5-3a490c0987cf Pipeline run with id=20bd5729-dbf2-4afa-88b5-3a490c0987cf reached expected state SUCCEEDED Deserializing expected compiled workflow file 'essential/iris_pipeline_compiled.yaml' for the pipeline Unmarshalling Expected Workflow YAML Unmarshalled Expected Workflow YAML Fetching updated pipeline run details for run with id=20bd5729-dbf2-4afa-88b5-3a490c0987cf Get a pipeline run with id=20bd5729-dbf2-4afa-88b5-3a490c0987cf Updated pipeline run details Pipeline run succeeded, checking if the number of tasks are what is expected < Exit [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/13/26 06:06:49.075 (2m30.854s) > Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/13/26 06:06:49.075 ################### Global Cleanup after each test ##################### Deleting 1 run(s) Terminate run 20bd5729-dbf2-4afa-88b5-3a490c0987cf Failed to terminate run 20bd5729-dbf2-4afa-88b5-3a490c0987cf Terminate run 20bd5729-dbf2-4afa-88b5-3a490c0987cf Deleting run 20bd5729-dbf2-4afa-88b5-3a490c0987cf Deleting 0 experiment(s) Deleting 1 pipeline(s) Deleting pipeline with id=6f36503a-eb11-4b7e-a033-d4ec37529ded (cascade=true) Pipeline with id=6f36503a-eb11-4b7e-a033-d4ec37529ded, DELETED < Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/13/26 06:06:49.248 (172ms) > Enter [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/13/26 06:06:49.248 < Exit [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/13/26 06:06:49.248 (0s) > Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/13/26 06:06:49.248 < Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/13/26 06:06:49.249 (0s)