2026/07/15 07:58:35 Test passed > Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/15/26 07:56:58.959 Create an experiment with name E2EExperiment-1784102218959481132 < Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/15/26 07:56:59.262 (303ms) > Enter [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/15/26 07:56:59.262 ################### Setup before each Pipeline Upload test ##################### ################### Global Setup before each test ##################### Test Context: 0x1206eafec000 test-secret-1 created test-secret-2 created test-secret-3 created < Exit [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/15/26 07:56:59.347 (85ms) > Enter [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/15/26 07:56:59.347 Uploading pipeline file critical/parallel_for_after_dependency.yaml Creating temp pipeline file with overridden SDK Version Uploading pipeline with name=e2e-test-1784102219262601683, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml Upload of pipeline file 'critical/parallel_for_after_dependency.yaml' successful Listing pipeline versions for pipeline e893de7a-b6e5-44d8-ae9c-3abc54af13ff Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml Returning pipeline run time inputs map[] Create run for pipeline with id: 'e893de7a-b6e5-44d8-ae9c-3abc54af13ff' and name: 'e2e-test-1784102219262601683' Create a pipeline run for pipeline with id=e893de7a-b6e5-44d8-ae9c-3abc54af13ff and versionId=63b39e1a-c6e3-4c47-b593-1055f85cf7bc Create a pipeline run body Created Pipeline Run successfully with runId=c6b6d003-0611-429a-ae6a-607d770df67a Created Pipeline Run with id: c6b6d003-0611-429a-ae6a-607d770df67a for pipeline with id: e893de7a-b6e5-44d8-ae9c-3abc54af13ff Waiting for pipeline run with id=c6b6d003-0611-429a-ae6a-607d770df67a to be in one of '[SUCCEEDED SKIPPED FAILED CANCELED]' Get a pipeline run with id=c6b6d003-0611-429a-ae6a-607d770df67a Pipeline run with id=c6b6d003-0611-429a-ae6a-607d770df67a is in PENDING state, waiting... Get a pipeline run with id=c6b6d003-0611-429a-ae6a-607d770df67a Pipeline run with id=c6b6d003-0611-429a-ae6a-607d770df67a is in RUNNING state, waiting... Get a pipeline run with id=c6b6d003-0611-429a-ae6a-607d770df67a Pipeline run with id=c6b6d003-0611-429a-ae6a-607d770df67a is in RUNNING state, waiting... Get a pipeline run with id=c6b6d003-0611-429a-ae6a-607d770df67a Pipeline run with id=c6b6d003-0611-429a-ae6a-607d770df67a is in RUNNING state, waiting... Get a pipeline run with id=c6b6d003-0611-429a-ae6a-607d770df67a Pipeline run with id=c6b6d003-0611-429a-ae6a-607d770df67a is in RUNNING state, waiting... Get a pipeline run with id=c6b6d003-0611-429a-ae6a-607d770df67a Pipeline run with id=c6b6d003-0611-429a-ae6a-607d770df67a is in RUNNING state, waiting... Get a pipeline run with id=c6b6d003-0611-429a-ae6a-607d770df67a Pipeline run with id=c6b6d003-0611-429a-ae6a-607d770df67a is in RUNNING state, waiting... Get a pipeline run with id=c6b6d003-0611-429a-ae6a-607d770df67a Pipeline run with id=c6b6d003-0611-429a-ae6a-607d770df67a is in RUNNING state, waiting... Get a pipeline run with id=c6b6d003-0611-429a-ae6a-607d770df67a Pipeline run with id=c6b6d003-0611-429a-ae6a-607d770df67a is in RUNNING state, waiting... Get a pipeline run with id=c6b6d003-0611-429a-ae6a-607d770df67a Pipeline run with id=c6b6d003-0611-429a-ae6a-607d770df67a is in RUNNING state, waiting... Get a pipeline run with id=c6b6d003-0611-429a-ae6a-607d770df67a Pipeline run with id=c6b6d003-0611-429a-ae6a-607d770df67a is in RUNNING state, waiting... Get a pipeline run with id=c6b6d003-0611-429a-ae6a-607d770df67a Pipeline run with id=c6b6d003-0611-429a-ae6a-607d770df67a is in RUNNING state, waiting... Get a pipeline run with id=c6b6d003-0611-429a-ae6a-607d770df67a Pipeline run with id=c6b6d003-0611-429a-ae6a-607d770df67a is in RUNNING state, waiting... Get a pipeline run with id=c6b6d003-0611-429a-ae6a-607d770df67a Pipeline run with id=c6b6d003-0611-429a-ae6a-607d770df67a is in RUNNING state, waiting... Get a pipeline run with id=c6b6d003-0611-429a-ae6a-607d770df67a Pipeline run with id=c6b6d003-0611-429a-ae6a-607d770df67a is in RUNNING state, waiting... Get a pipeline run with id=c6b6d003-0611-429a-ae6a-607d770df67a Pipeline run with id=c6b6d003-0611-429a-ae6a-607d770df67a is in RUNNING state, waiting... Get a pipeline run with id=c6b6d003-0611-429a-ae6a-607d770df67a Pipeline run with id=c6b6d003-0611-429a-ae6a-607d770df67a is in RUNNING state, waiting... Get a pipeline run with id=c6b6d003-0611-429a-ae6a-607d770df67a Pipeline run with id=c6b6d003-0611-429a-ae6a-607d770df67a is in RUNNING state, waiting... Get a pipeline run with id=c6b6d003-0611-429a-ae6a-607d770df67a Pipeline run with id=c6b6d003-0611-429a-ae6a-607d770df67a is in RUNNING state, waiting... Get a pipeline run with id=c6b6d003-0611-429a-ae6a-607d770df67a Pipeline run with id=c6b6d003-0611-429a-ae6a-607d770df67a reached expected state SUCCEEDED Deserializing expected compiled workflow file 'critical/parallel_for_after_dependency.yaml' for the pipeline Unmarshalling Expected Workflow YAML Unmarshalled Expected Workflow YAML Fetching updated pipeline run details for run with id=c6b6d003-0611-429a-ae6a-607d770df67a Get a pipeline run with id=c6b6d003-0611-429a-ae6a-607d770df67a Updated pipeline run details Pipeline run succeeded, checking if the number of tasks are what is expected < Exit [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/15/26 07:58:34.803 (1m35.456s) > Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/15/26 07:58:34.803 ################### Global Cleanup after each test ##################### Deleting 1 run(s) Terminate run c6b6d003-0611-429a-ae6a-607d770df67a Failed to terminate run c6b6d003-0611-429a-ae6a-607d770df67a Terminate run c6b6d003-0611-429a-ae6a-607d770df67a Deleting run c6b6d003-0611-429a-ae6a-607d770df67a Deleting 0 experiment(s) Deleting 1 pipeline(s) Deleting pipeline with id=e893de7a-b6e5-44d8-ae9c-3abc54af13ff (cascade=true) Pipeline with id=e893de7a-b6e5-44d8-ae9c-3abc54af13ff, DELETED < Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/15/26 07:58:35.167 (364ms) > Enter [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/15/26 07:58:35.167 < Exit [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/15/26 07:58:35.167 (0s) > Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/15/26 07:58:35.168 < Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/15/26 07:58:35.168 (0s) 2026/07/15 07:57:45 Test passed > Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/15/26 07:56:58.96 Create an experiment with name E2EExperiment-1784102218960520575 < Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/15/26 07:56:59.267 (307ms) > Enter [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/15/26 07:56:59.267 ################### Setup before each Pipeline Upload test ##################### ################### Global Setup before each test ##################### Test Context: 0x73ab2100100 Looks like test-secret-1 already exists, because creation failed due to secrets "test-secret-1" already exists Looks like test-secret-2 already exists, because creation failed due to secrets "test-secret-2" already exists Looks like test-secret-3 already exists, because creation failed due to secrets "test-secret-3" already exists < Exit [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/15/26 07:56:59.413 (146ms) > Enter [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/15/26 07:56:59.413 Uploading pipeline file essential/component_with_pip_index_urls.yaml Creating temp pipeline file with overridden SDK Version Uploading pipeline with name=e2e-test-1784102219267572037, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml Upload of pipeline file 'essential/component_with_pip_index_urls.yaml' successful Listing pipeline versions for pipeline 2824a8eb-1f7d-4975-b13d-f78953687138 Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml Returning pipeline run time inputs map[] Create run for pipeline with id: '2824a8eb-1f7d-4975-b13d-f78953687138' and name: 'e2e-test-1784102219267572037' Create a pipeline run for pipeline with id=2824a8eb-1f7d-4975-b13d-f78953687138 and versionId=e3c5cf8b-0c14-4e9e-84a8-f4656279ab22 Create a pipeline run body Created Pipeline Run successfully with runId=a0be4039-300f-48b3-a473-d469a6087a8b Created Pipeline Run with id: a0be4039-300f-48b3-a473-d469a6087a8b for pipeline with id: 2824a8eb-1f7d-4975-b13d-f78953687138 Waiting for pipeline run with id=a0be4039-300f-48b3-a473-d469a6087a8b to be in one of '[SUCCEEDED SKIPPED FAILED CANCELED]' Get a pipeline run with id=a0be4039-300f-48b3-a473-d469a6087a8b Pipeline run with id=a0be4039-300f-48b3-a473-d469a6087a8b is in PENDING state, waiting... Get a pipeline run with id=a0be4039-300f-48b3-a473-d469a6087a8b Pipeline run with id=a0be4039-300f-48b3-a473-d469a6087a8b is in RUNNING state, waiting... Get a pipeline run with id=a0be4039-300f-48b3-a473-d469a6087a8b Pipeline run with id=a0be4039-300f-48b3-a473-d469a6087a8b is in RUNNING state, waiting... Get a pipeline run with id=a0be4039-300f-48b3-a473-d469a6087a8b Pipeline run with id=a0be4039-300f-48b3-a473-d469a6087a8b is in RUNNING state, waiting... Get a pipeline run with id=a0be4039-300f-48b3-a473-d469a6087a8b Pipeline run with id=a0be4039-300f-48b3-a473-d469a6087a8b is in RUNNING state, waiting... Get a pipeline run with id=a0be4039-300f-48b3-a473-d469a6087a8b Pipeline run with id=a0be4039-300f-48b3-a473-d469a6087a8b is in RUNNING state, waiting... Get a pipeline run with id=a0be4039-300f-48b3-a473-d469a6087a8b Pipeline run with id=a0be4039-300f-48b3-a473-d469a6087a8b is in RUNNING state, waiting... Get a pipeline run with id=a0be4039-300f-48b3-a473-d469a6087a8b Pipeline run with id=a0be4039-300f-48b3-a473-d469a6087a8b is in RUNNING state, waiting... Get a pipeline run with id=a0be4039-300f-48b3-a473-d469a6087a8b Pipeline run with id=a0be4039-300f-48b3-a473-d469a6087a8b is in RUNNING state, waiting... Get a pipeline run with id=a0be4039-300f-48b3-a473-d469a6087a8b Pipeline run with id=a0be4039-300f-48b3-a473-d469a6087a8b reached expected state SUCCEEDED Deserializing expected compiled workflow file 'essential/component_with_pip_index_urls.yaml' for the pipeline Unmarshalling Expected Workflow YAML Unmarshalled Expected Workflow YAML Fetching updated pipeline run details for run with id=a0be4039-300f-48b3-a473-d469a6087a8b Get a pipeline run with id=a0be4039-300f-48b3-a473-d469a6087a8b Updated pipeline run details Pipeline run succeeded, checking if the number of tasks are what is expected < Exit [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/15/26 07:57:44.923 (45.51s) > Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/15/26 07:57:44.923 ################### Global Cleanup after each test ##################### Deleting 1 run(s) Terminate run a0be4039-300f-48b3-a473-d469a6087a8b Failed to terminate run a0be4039-300f-48b3-a473-d469a6087a8b Terminate run a0be4039-300f-48b3-a473-d469a6087a8b Deleting run a0be4039-300f-48b3-a473-d469a6087a8b Deleting 0 experiment(s) Deleting 1 pipeline(s) Deleting pipeline with id=2824a8eb-1f7d-4975-b13d-f78953687138 (cascade=true) Pipeline with id=2824a8eb-1f7d-4975-b13d-f78953687138, DELETED < Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/15/26 07:57:45.3 (377ms) > Enter [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/15/26 07:57:45.301 < Exit [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/15/26 07:57:45.301 (0s) > Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/15/26 07:57:45.301 < Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/15/26 07:57:45.301 (0s) 2026/07/15 07:58:34 Test passed > Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/15/26 07:56:58.959 Create an experiment with name E2EExperiment-1784102218959748768 < Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/15/26 07:56:59.263 (303ms) > Enter [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/15/26 07:56:59.263 ################### Setup before each Pipeline Upload test ##################### ################### Global Setup before each test ##################### Test Context: 0x20e3bc0c2280 Looks like test-secret-1 already exists, because creation failed due to secrets "test-secret-1" already exists Looks like test-secret-2 already exists, because creation failed due to secrets "test-secret-2" already exists Looks like test-secret-3 already exists, because creation failed due to secrets "test-secret-3" already exists < Exit [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/15/26 07:56:59.386 (123ms) > Enter [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/15/26 07:56:59.386 Uploading pipeline file critical/pipeline_with_artifact_upload_download.yaml Creating temp pipeline file with overridden SDK Version Uploading pipeline with name=e2e-test-1784102219263374111, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml Upload of pipeline file 'critical/pipeline_with_artifact_upload_download.yaml' successful Listing pipeline versions for pipeline b49cce72-c1f9-4ffd-9581-d4db679da11f Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml Returning pipeline run time inputs map[] Create run for pipeline with id: 'b49cce72-c1f9-4ffd-9581-d4db679da11f' and name: 'e2e-test-1784102219263374111' Create a pipeline run for pipeline with id=b49cce72-c1f9-4ffd-9581-d4db679da11f and versionId=39a229da-9e5e-4253-8b35-a4f72ff478c1 Create a pipeline run body Created Pipeline Run successfully with runId=4bec1956-dcd1-4884-9a84-e13558ff4c53 Created Pipeline Run with id: 4bec1956-dcd1-4884-9a84-e13558ff4c53 for pipeline with id: b49cce72-c1f9-4ffd-9581-d4db679da11f Waiting for pipeline run with id=4bec1956-dcd1-4884-9a84-e13558ff4c53 to be in one of '[SUCCEEDED SKIPPED FAILED CANCELED]' Get a pipeline run with id=4bec1956-dcd1-4884-9a84-e13558ff4c53 Pipeline run with id=4bec1956-dcd1-4884-9a84-e13558ff4c53 is in PENDING state, waiting... Get a pipeline run with id=4bec1956-dcd1-4884-9a84-e13558ff4c53 Pipeline run with id=4bec1956-dcd1-4884-9a84-e13558ff4c53 is in RUNNING state, waiting... Get a pipeline run with id=4bec1956-dcd1-4884-9a84-e13558ff4c53 Pipeline run with id=4bec1956-dcd1-4884-9a84-e13558ff4c53 is in RUNNING state, waiting... Get a pipeline run with id=4bec1956-dcd1-4884-9a84-e13558ff4c53 Pipeline run with id=4bec1956-dcd1-4884-9a84-e13558ff4c53 is in RUNNING state, waiting... Get a pipeline run with id=4bec1956-dcd1-4884-9a84-e13558ff4c53 Pipeline run with id=4bec1956-dcd1-4884-9a84-e13558ff4c53 is in RUNNING state, waiting... Get a pipeline run with id=4bec1956-dcd1-4884-9a84-e13558ff4c53 Pipeline run with id=4bec1956-dcd1-4884-9a84-e13558ff4c53 is in RUNNING state, waiting... Get a pipeline run with id=4bec1956-dcd1-4884-9a84-e13558ff4c53 Pipeline run with id=4bec1956-dcd1-4884-9a84-e13558ff4c53 is in RUNNING state, waiting... Get a pipeline run with id=4bec1956-dcd1-4884-9a84-e13558ff4c53 Pipeline run with id=4bec1956-dcd1-4884-9a84-e13558ff4c53 is in RUNNING state, waiting... Get a pipeline run with id=4bec1956-dcd1-4884-9a84-e13558ff4c53 Pipeline run with id=4bec1956-dcd1-4884-9a84-e13558ff4c53 is in RUNNING state, waiting... Get a pipeline run with id=4bec1956-dcd1-4884-9a84-e13558ff4c53 Pipeline run with id=4bec1956-dcd1-4884-9a84-e13558ff4c53 is in RUNNING state, waiting... Get a pipeline run with id=4bec1956-dcd1-4884-9a84-e13558ff4c53 Pipeline run with id=4bec1956-dcd1-4884-9a84-e13558ff4c53 is in RUNNING state, waiting... Get a pipeline run with id=4bec1956-dcd1-4884-9a84-e13558ff4c53 Pipeline run with id=4bec1956-dcd1-4884-9a84-e13558ff4c53 is in RUNNING state, waiting... Get a pipeline run with id=4bec1956-dcd1-4884-9a84-e13558ff4c53 Pipeline run with id=4bec1956-dcd1-4884-9a84-e13558ff4c53 is in RUNNING state, waiting... Get a pipeline run with id=4bec1956-dcd1-4884-9a84-e13558ff4c53 Pipeline run with id=4bec1956-dcd1-4884-9a84-e13558ff4c53 is in RUNNING state, waiting... Get a pipeline run with id=4bec1956-dcd1-4884-9a84-e13558ff4c53 Pipeline run with id=4bec1956-dcd1-4884-9a84-e13558ff4c53 is in RUNNING state, waiting... Get a pipeline run with id=4bec1956-dcd1-4884-9a84-e13558ff4c53 Pipeline run with id=4bec1956-dcd1-4884-9a84-e13558ff4c53 is in RUNNING state, waiting... Get a pipeline run with id=4bec1956-dcd1-4884-9a84-e13558ff4c53 Pipeline run with id=4bec1956-dcd1-4884-9a84-e13558ff4c53 is in RUNNING state, waiting... Get a pipeline run with id=4bec1956-dcd1-4884-9a84-e13558ff4c53 Pipeline run with id=4bec1956-dcd1-4884-9a84-e13558ff4c53 is in RUNNING state, waiting... Get a pipeline run with id=4bec1956-dcd1-4884-9a84-e13558ff4c53 Pipeline run with id=4bec1956-dcd1-4884-9a84-e13558ff4c53 is in RUNNING state, waiting... Get a pipeline run with id=4bec1956-dcd1-4884-9a84-e13558ff4c53 Pipeline run with id=4bec1956-dcd1-4884-9a84-e13558ff4c53 reached expected state SUCCEEDED Deserializing expected compiled workflow file 'critical/pipeline_with_artifact_upload_download.yaml' for the pipeline Unmarshalling Expected Workflow YAML Unmarshalled Expected Workflow YAML Fetching updated pipeline run details for run with id=4bec1956-dcd1-4884-9a84-e13558ff4c53 Get a pipeline run with id=4bec1956-dcd1-4884-9a84-e13558ff4c53 Updated pipeline run details Pipeline run succeeded, checking if the number of tasks are what is expected < Exit [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/15/26 07:58:34.763 (1m35.378s) > Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/15/26 07:58:34.763 ################### Global Cleanup after each test ##################### Deleting 1 run(s) Terminate run 4bec1956-dcd1-4884-9a84-e13558ff4c53 Failed to terminate run 4bec1956-dcd1-4884-9a84-e13558ff4c53 Terminate run 4bec1956-dcd1-4884-9a84-e13558ff4c53 Deleting run 4bec1956-dcd1-4884-9a84-e13558ff4c53 Deleting 0 experiment(s) Deleting 1 pipeline(s) Deleting pipeline with id=b49cce72-c1f9-4ffd-9581-d4db679da11f (cascade=true) Pipeline with id=b49cce72-c1f9-4ffd-9581-d4db679da11f, DELETED < Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/15/26 07:58:34.989 (226ms) > Enter [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/15/26 07:58:34.99 < Exit [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/15/26 07:58:34.99 (0s) > Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/15/26 07:58:34.99 < Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/15/26 07:58:34.99 (0s) 2026/07/15 07:59:05 Test passed > Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/15/26 07:56:58.959 Create an experiment with name E2EExperiment-1784102218959467471 < Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/15/26 07:56:59.262 (303ms) > Enter [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/15/26 07:56:59.262 ################### Setup before each Pipeline Upload test ##################### ################### Global Setup before each test ##################### Test Context: 0x25c96a0a2100 Looks like test-secret-1 already exists, because creation failed due to secrets "test-secret-1" already exists Looks like test-secret-2 already exists, because creation failed due to secrets "test-secret-2" already exists Looks like test-secret-3 already exists, because creation failed due to secrets "test-secret-3" already exists < Exit [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/15/26 07:56:59.413 (151ms) > Enter [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/15/26 07:56:59.413 Uploading pipeline file critical/flip_coin.yaml Creating temp pipeline file with overridden SDK Version Uploading pipeline with name=e2e-test-1784102219262989712, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml Upload of pipeline file 'critical/flip_coin.yaml' successful Listing pipeline versions for pipeline 9c7ed10b-a219-4c98-93da-0a9592a66c1d Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml Returning pipeline run time inputs map[] Create run for pipeline with id: '9c7ed10b-a219-4c98-93da-0a9592a66c1d' and name: 'e2e-test-1784102219262989712' Create a pipeline run for pipeline with id=9c7ed10b-a219-4c98-93da-0a9592a66c1d and versionId=5a2a3b90-b683-4462-b316-0cb6676698a4 Create a pipeline run body Created Pipeline Run successfully with runId=39837d35-0317-4b66-b587-6b0712db1b1c Created Pipeline Run with id: 39837d35-0317-4b66-b587-6b0712db1b1c for pipeline with id: 9c7ed10b-a219-4c98-93da-0a9592a66c1d Waiting for pipeline run with id=39837d35-0317-4b66-b587-6b0712db1b1c to be in one of '[SUCCEEDED SKIPPED FAILED CANCELED]' Get a pipeline run with id=39837d35-0317-4b66-b587-6b0712db1b1c Pipeline run with id=39837d35-0317-4b66-b587-6b0712db1b1c is in PENDING state, waiting... Get a pipeline run with id=39837d35-0317-4b66-b587-6b0712db1b1c Pipeline run with id=39837d35-0317-4b66-b587-6b0712db1b1c is in RUNNING state, waiting... Get a pipeline run with id=39837d35-0317-4b66-b587-6b0712db1b1c Pipeline run with id=39837d35-0317-4b66-b587-6b0712db1b1c is in RUNNING state, waiting... Get a pipeline run with id=39837d35-0317-4b66-b587-6b0712db1b1c Pipeline run with id=39837d35-0317-4b66-b587-6b0712db1b1c is in RUNNING state, waiting... Get a pipeline run with id=39837d35-0317-4b66-b587-6b0712db1b1c Pipeline run with id=39837d35-0317-4b66-b587-6b0712db1b1c is in RUNNING state, waiting... Get a pipeline run with id=39837d35-0317-4b66-b587-6b0712db1b1c Pipeline run with id=39837d35-0317-4b66-b587-6b0712db1b1c is in RUNNING state, waiting... Get a pipeline run with id=39837d35-0317-4b66-b587-6b0712db1b1c Pipeline run with id=39837d35-0317-4b66-b587-6b0712db1b1c is in RUNNING state, waiting... Get a pipeline run with id=39837d35-0317-4b66-b587-6b0712db1b1c Pipeline run with id=39837d35-0317-4b66-b587-6b0712db1b1c is in RUNNING state, waiting... Get a pipeline run with id=39837d35-0317-4b66-b587-6b0712db1b1c Pipeline run with id=39837d35-0317-4b66-b587-6b0712db1b1c is in RUNNING state, waiting... Get a pipeline run with id=39837d35-0317-4b66-b587-6b0712db1b1c Pipeline run with id=39837d35-0317-4b66-b587-6b0712db1b1c is in RUNNING state, waiting... Get a pipeline run with id=39837d35-0317-4b66-b587-6b0712db1b1c Pipeline run with id=39837d35-0317-4b66-b587-6b0712db1b1c is in RUNNING state, waiting... Get a pipeline run with id=39837d35-0317-4b66-b587-6b0712db1b1c Pipeline run with id=39837d35-0317-4b66-b587-6b0712db1b1c is in RUNNING state, waiting... Get a pipeline run with id=39837d35-0317-4b66-b587-6b0712db1b1c Pipeline run with id=39837d35-0317-4b66-b587-6b0712db1b1c is in RUNNING state, waiting... Get a pipeline run with id=39837d35-0317-4b66-b587-6b0712db1b1c Pipeline run with id=39837d35-0317-4b66-b587-6b0712db1b1c is in RUNNING state, waiting... Get a pipeline run with id=39837d35-0317-4b66-b587-6b0712db1b1c Pipeline run with id=39837d35-0317-4b66-b587-6b0712db1b1c is in RUNNING state, waiting... Get a pipeline run with id=39837d35-0317-4b66-b587-6b0712db1b1c Pipeline run with id=39837d35-0317-4b66-b587-6b0712db1b1c is in RUNNING state, waiting... Get a pipeline run with id=39837d35-0317-4b66-b587-6b0712db1b1c Pipeline run with id=39837d35-0317-4b66-b587-6b0712db1b1c is in RUNNING state, waiting... Get a pipeline run with id=39837d35-0317-4b66-b587-6b0712db1b1c Pipeline run with id=39837d35-0317-4b66-b587-6b0712db1b1c is in RUNNING state, waiting... Get a pipeline run with id=39837d35-0317-4b66-b587-6b0712db1b1c Pipeline run with id=39837d35-0317-4b66-b587-6b0712db1b1c is in RUNNING state, waiting... Get a pipeline run with id=39837d35-0317-4b66-b587-6b0712db1b1c Pipeline run with id=39837d35-0317-4b66-b587-6b0712db1b1c is in RUNNING state, waiting... Get a pipeline run with id=39837d35-0317-4b66-b587-6b0712db1b1c Pipeline run with id=39837d35-0317-4b66-b587-6b0712db1b1c is in RUNNING state, waiting... Get a pipeline run with id=39837d35-0317-4b66-b587-6b0712db1b1c Pipeline run with id=39837d35-0317-4b66-b587-6b0712db1b1c is in RUNNING state, waiting... Get a pipeline run with id=39837d35-0317-4b66-b587-6b0712db1b1c Pipeline run with id=39837d35-0317-4b66-b587-6b0712db1b1c is in RUNNING state, waiting... Get a pipeline run with id=39837d35-0317-4b66-b587-6b0712db1b1c Pipeline run with id=39837d35-0317-4b66-b587-6b0712db1b1c is in RUNNING state, waiting... Get a pipeline run with id=39837d35-0317-4b66-b587-6b0712db1b1c Pipeline run with id=39837d35-0317-4b66-b587-6b0712db1b1c is in RUNNING state, waiting... Get a pipeline run with id=39837d35-0317-4b66-b587-6b0712db1b1c Pipeline run with id=39837d35-0317-4b66-b587-6b0712db1b1c reached expected state SUCCEEDED Deserializing expected compiled workflow file 'critical/flip_coin.yaml' for the pipeline Unmarshalling Expected Workflow YAML Unmarshalled Expected Workflow YAML Fetching updated pipeline run details for run with id=39837d35-0317-4b66-b587-6b0712db1b1c Get a pipeline run with id=39837d35-0317-4b66-b587-6b0712db1b1c Updated pipeline run details Pipeline run succeeded, checking if the number of tasks are what is expected < Exit [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/15/26 07:59:04.979 (2m5.566s) > Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/15/26 07:59:04.98 ################### Global Cleanup after each test ##################### Deleting 1 run(s) Terminate run 39837d35-0317-4b66-b587-6b0712db1b1c Failed to terminate run 39837d35-0317-4b66-b587-6b0712db1b1c Terminate run 39837d35-0317-4b66-b587-6b0712db1b1c Deleting run 39837d35-0317-4b66-b587-6b0712db1b1c Deleting 0 experiment(s) Deleting 1 pipeline(s) Deleting pipeline with id=9c7ed10b-a219-4c98-93da-0a9592a66c1d (cascade=true) Pipeline with id=9c7ed10b-a219-4c98-93da-0a9592a66c1d, DELETED < Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/15/26 07:59:05.149 (170ms) > Enter [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/15/26 07:59:05.15 < Exit [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/15/26 07:59:05.15 (0s) > Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/15/26 07:59:05.15 < Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/15/26 07:59:05.15 (0s) 2026/07/15 07:59:30 Test passed > Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/15/26 07:56:58.96 Create an experiment with name E2EExperiment-1784102218960037174 < Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/15/26 07:56:59.263 (304ms) > Enter [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/15/26 07:56:59.263 ################### Setup before each Pipeline Upload test ##################### ################### Global Setup before each test ##################### Test Context: 0x379751532880 Looks like test-secret-1 already exists, because creation failed due to secrets "test-secret-1" already exists Looks like test-secret-2 already exists, because creation failed due to secrets "test-secret-2" already exists Looks like test-secret-3 already exists, because creation failed due to secrets "test-secret-3" already exists < Exit [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/15/26 07:56:59.396 (132ms) > Enter [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/15/26 07:56:59.396 Uploading pipeline file essential/iris_pipeline_compiled.yaml Creating temp pipeline file with overridden SDK Version Uploading pipeline with name=e2e-test-1784102219263694428, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml Upload of pipeline file 'essential/iris_pipeline_compiled.yaml' successful Listing pipeline versions for pipeline 4f8754ea-eab1-4b1e-8846-78e0faee17ca Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml Returning pipeline run time inputs map[] Create run for pipeline with id: '4f8754ea-eab1-4b1e-8846-78e0faee17ca' and name: 'e2e-test-1784102219263694428' Create a pipeline run for pipeline with id=4f8754ea-eab1-4b1e-8846-78e0faee17ca and versionId=c56db26f-8a58-4ca0-8cd7-0e44da4f5eea Create a pipeline run body Created Pipeline Run successfully with runId=8be2d735-b712-4528-81f4-8154c4080c7b Created Pipeline Run with id: 8be2d735-b712-4528-81f4-8154c4080c7b for pipeline with id: 4f8754ea-eab1-4b1e-8846-78e0faee17ca Waiting for pipeline run with id=8be2d735-b712-4528-81f4-8154c4080c7b to be in one of '[SUCCEEDED SKIPPED FAILED CANCELED]' Get a pipeline run with id=8be2d735-b712-4528-81f4-8154c4080c7b Pipeline run with id=8be2d735-b712-4528-81f4-8154c4080c7b is in PENDING state, waiting... Get a pipeline run with id=8be2d735-b712-4528-81f4-8154c4080c7b Pipeline run with id=8be2d735-b712-4528-81f4-8154c4080c7b is in RUNNING state, waiting... Get a pipeline run with id=8be2d735-b712-4528-81f4-8154c4080c7b Pipeline run with id=8be2d735-b712-4528-81f4-8154c4080c7b is in RUNNING state, waiting... Get a pipeline run with id=8be2d735-b712-4528-81f4-8154c4080c7b Pipeline run with id=8be2d735-b712-4528-81f4-8154c4080c7b is in RUNNING state, waiting... Get a pipeline run with id=8be2d735-b712-4528-81f4-8154c4080c7b Pipeline run with id=8be2d735-b712-4528-81f4-8154c4080c7b is in RUNNING state, waiting... Get a pipeline run with id=8be2d735-b712-4528-81f4-8154c4080c7b Pipeline run with id=8be2d735-b712-4528-81f4-8154c4080c7b is in RUNNING state, waiting... Get a pipeline run with id=8be2d735-b712-4528-81f4-8154c4080c7b Pipeline run with id=8be2d735-b712-4528-81f4-8154c4080c7b is in RUNNING state, waiting... Get a pipeline run with id=8be2d735-b712-4528-81f4-8154c4080c7b Pipeline run with id=8be2d735-b712-4528-81f4-8154c4080c7b is in RUNNING state, waiting... Get a pipeline run with id=8be2d735-b712-4528-81f4-8154c4080c7b Pipeline run with id=8be2d735-b712-4528-81f4-8154c4080c7b is in RUNNING state, waiting... Get a pipeline run with id=8be2d735-b712-4528-81f4-8154c4080c7b Pipeline run with id=8be2d735-b712-4528-81f4-8154c4080c7b is in RUNNING state, waiting... Get a pipeline run with id=8be2d735-b712-4528-81f4-8154c4080c7b Pipeline run with id=8be2d735-b712-4528-81f4-8154c4080c7b is in RUNNING state, waiting... Get a pipeline run with id=8be2d735-b712-4528-81f4-8154c4080c7b Pipeline run with id=8be2d735-b712-4528-81f4-8154c4080c7b is in RUNNING state, waiting... Get a pipeline run with id=8be2d735-b712-4528-81f4-8154c4080c7b Pipeline run with id=8be2d735-b712-4528-81f4-8154c4080c7b is in RUNNING state, waiting... Get a pipeline run with id=8be2d735-b712-4528-81f4-8154c4080c7b Pipeline run with id=8be2d735-b712-4528-81f4-8154c4080c7b is in RUNNING state, waiting... Get a pipeline run with id=8be2d735-b712-4528-81f4-8154c4080c7b Pipeline run with id=8be2d735-b712-4528-81f4-8154c4080c7b is in RUNNING state, waiting... Get a pipeline run with id=8be2d735-b712-4528-81f4-8154c4080c7b Pipeline run with id=8be2d735-b712-4528-81f4-8154c4080c7b is in RUNNING state, waiting... Get a pipeline run with id=8be2d735-b712-4528-81f4-8154c4080c7b Pipeline run with id=8be2d735-b712-4528-81f4-8154c4080c7b is in RUNNING state, waiting... Get a pipeline run with id=8be2d735-b712-4528-81f4-8154c4080c7b Pipeline run with id=8be2d735-b712-4528-81f4-8154c4080c7b is in RUNNING state, waiting... Get a pipeline run with id=8be2d735-b712-4528-81f4-8154c4080c7b Pipeline run with id=8be2d735-b712-4528-81f4-8154c4080c7b is in RUNNING state, waiting... Get a pipeline run with id=8be2d735-b712-4528-81f4-8154c4080c7b Pipeline run with id=8be2d735-b712-4528-81f4-8154c4080c7b is in RUNNING state, waiting... Get a pipeline run with id=8be2d735-b712-4528-81f4-8154c4080c7b Pipeline run with id=8be2d735-b712-4528-81f4-8154c4080c7b is in RUNNING state, waiting... Get a pipeline run with id=8be2d735-b712-4528-81f4-8154c4080c7b Pipeline run with id=8be2d735-b712-4528-81f4-8154c4080c7b is in RUNNING state, waiting... Get a pipeline run with id=8be2d735-b712-4528-81f4-8154c4080c7b Pipeline run with id=8be2d735-b712-4528-81f4-8154c4080c7b is in RUNNING state, waiting... Get a pipeline run with id=8be2d735-b712-4528-81f4-8154c4080c7b Pipeline run with id=8be2d735-b712-4528-81f4-8154c4080c7b is in RUNNING state, waiting... Get a pipeline run with id=8be2d735-b712-4528-81f4-8154c4080c7b Pipeline run with id=8be2d735-b712-4528-81f4-8154c4080c7b is in RUNNING state, waiting... Get a pipeline run with id=8be2d735-b712-4528-81f4-8154c4080c7b Pipeline run with id=8be2d735-b712-4528-81f4-8154c4080c7b is in RUNNING state, waiting... Get a pipeline run with id=8be2d735-b712-4528-81f4-8154c4080c7b Pipeline run with id=8be2d735-b712-4528-81f4-8154c4080c7b is in RUNNING state, waiting... Get a pipeline run with id=8be2d735-b712-4528-81f4-8154c4080c7b Pipeline run with id=8be2d735-b712-4528-81f4-8154c4080c7b is in RUNNING state, waiting... Get a pipeline run with id=8be2d735-b712-4528-81f4-8154c4080c7b Pipeline run with id=8be2d735-b712-4528-81f4-8154c4080c7b is in RUNNING state, waiting... Get a pipeline run with id=8be2d735-b712-4528-81f4-8154c4080c7b Pipeline run with id=8be2d735-b712-4528-81f4-8154c4080c7b is in RUNNING state, waiting... Get a pipeline run with id=8be2d735-b712-4528-81f4-8154c4080c7b Pipeline run with id=8be2d735-b712-4528-81f4-8154c4080c7b reached expected state SUCCEEDED Deserializing expected compiled workflow file 'essential/iris_pipeline_compiled.yaml' for the pipeline Unmarshalling Expected Workflow YAML Unmarshalled Expected Workflow YAML Fetching updated pipeline run details for run with id=8be2d735-b712-4528-81f4-8154c4080c7b Get a pipeline run with id=8be2d735-b712-4528-81f4-8154c4080c7b Updated pipeline run details Pipeline run succeeded, checking if the number of tasks are what is expected < Exit [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/15/26 07:59:29.881 (2m30.485s) > Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/15/26 07:59:29.881 ################### Global Cleanup after each test ##################### Deleting 1 run(s) Terminate run 8be2d735-b712-4528-81f4-8154c4080c7b Failed to terminate run 8be2d735-b712-4528-81f4-8154c4080c7b Terminate run 8be2d735-b712-4528-81f4-8154c4080c7b Deleting run 8be2d735-b712-4528-81f4-8154c4080c7b Deleting 0 experiment(s) Deleting 1 pipeline(s) Deleting pipeline with id=4f8754ea-eab1-4b1e-8846-78e0faee17ca (cascade=true) Pipeline with id=4f8754ea-eab1-4b1e-8846-78e0faee17ca, DELETED < Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/15/26 07:59:30.053 (173ms) > Enter [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/15/26 07:59:30.054 < Exit [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/15/26 07:59:30.054 (0s) > Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/15/26 07:59:30.054 < Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/15/26 07:59:30.054 (0s)