2026/07/09 17:14:11 Test passed > Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/09/26 17:11:30.618 Create an experiment with name E2EExperiment-1783617090618354744 < Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/09/26 17:11:30.901 (283ms) > Enter [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/09/26 17:11:30.901 ################### Setup before each Pipeline Upload test ##################### ################### Global Setup before each test ##################### Test Context: 0x21abdec94780 Looks like test-secret-1 already exists, because creation failed due to secrets "test-secret-1" already exists Looks like test-secret-2 already exists, because creation failed due to secrets "test-secret-2" already exists Looks like test-secret-3 already exists, because creation failed due to secrets "test-secret-3" already exists < Exit [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/09/26 17:11:31.023 (122ms) > Enter [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/09/26 17:11:31.023 Uploading pipeline file essential/iris_pipeline_compiled.yaml Creating temp pipeline file with overridden SDK Version Uploading pipeline with name=e2e-test-1783617090901185682, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml Upload of pipeline file 'essential/iris_pipeline_compiled.yaml' successful Listing pipeline versions for pipeline 088c6e7e-4cb9-4208-aa9a-a041168b19a7 Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml Returning pipeline run time inputs map[] Create run for pipeline with id: '088c6e7e-4cb9-4208-aa9a-a041168b19a7' and name: 'e2e-test-1783617090901185682' Create a pipeline run for pipeline with id=088c6e7e-4cb9-4208-aa9a-a041168b19a7 and versionId=d39140a2-0aa7-4a8d-a797-21bb98b1711b Create a pipeline run body Created Pipeline Run successfully with runId=248cbe8f-b84e-4c47-bbfd-cddd65349223 Created Pipeline Run with id: 248cbe8f-b84e-4c47-bbfd-cddd65349223 for pipeline with id: 088c6e7e-4cb9-4208-aa9a-a041168b19a7 Waiting for pipeline run with id=248cbe8f-b84e-4c47-bbfd-cddd65349223 to be in one of '[SUCCEEDED SKIPPED FAILED CANCELED]' Get a pipeline run with id=248cbe8f-b84e-4c47-bbfd-cddd65349223 Pipeline run with id=248cbe8f-b84e-4c47-bbfd-cddd65349223 is in PENDING state, waiting... Get a pipeline run with id=248cbe8f-b84e-4c47-bbfd-cddd65349223 Pipeline run with id=248cbe8f-b84e-4c47-bbfd-cddd65349223 is in RUNNING state, waiting... Get a pipeline run with id=248cbe8f-b84e-4c47-bbfd-cddd65349223 Pipeline run with id=248cbe8f-b84e-4c47-bbfd-cddd65349223 is in RUNNING state, waiting... Get a pipeline run with id=248cbe8f-b84e-4c47-bbfd-cddd65349223 Pipeline run with id=248cbe8f-b84e-4c47-bbfd-cddd65349223 is in RUNNING state, waiting... Get a pipeline run with id=248cbe8f-b84e-4c47-bbfd-cddd65349223 Pipeline run with id=248cbe8f-b84e-4c47-bbfd-cddd65349223 is in RUNNING state, waiting... Get a pipeline run with id=248cbe8f-b84e-4c47-bbfd-cddd65349223 Pipeline run with id=248cbe8f-b84e-4c47-bbfd-cddd65349223 is in RUNNING state, waiting... Get a pipeline run with id=248cbe8f-b84e-4c47-bbfd-cddd65349223 Pipeline run with id=248cbe8f-b84e-4c47-bbfd-cddd65349223 is in RUNNING state, waiting... Get a pipeline run with id=248cbe8f-b84e-4c47-bbfd-cddd65349223 Pipeline run with id=248cbe8f-b84e-4c47-bbfd-cddd65349223 is in RUNNING state, waiting... Get a pipeline run with id=248cbe8f-b84e-4c47-bbfd-cddd65349223 Pipeline run with id=248cbe8f-b84e-4c47-bbfd-cddd65349223 is in RUNNING state, waiting... Get a pipeline run with id=248cbe8f-b84e-4c47-bbfd-cddd65349223 Pipeline run with id=248cbe8f-b84e-4c47-bbfd-cddd65349223 is in RUNNING state, waiting... Get a pipeline run with id=248cbe8f-b84e-4c47-bbfd-cddd65349223 Pipeline run with id=248cbe8f-b84e-4c47-bbfd-cddd65349223 is in RUNNING state, waiting... Get a pipeline run with id=248cbe8f-b84e-4c47-bbfd-cddd65349223 Pipeline run with id=248cbe8f-b84e-4c47-bbfd-cddd65349223 is in RUNNING state, waiting... Get a pipeline run with id=248cbe8f-b84e-4c47-bbfd-cddd65349223 Pipeline run with id=248cbe8f-b84e-4c47-bbfd-cddd65349223 is in RUNNING state, waiting... Get a pipeline run with id=248cbe8f-b84e-4c47-bbfd-cddd65349223 Pipeline run with id=248cbe8f-b84e-4c47-bbfd-cddd65349223 is in RUNNING state, waiting... Get a pipeline run with id=248cbe8f-b84e-4c47-bbfd-cddd65349223 Pipeline run with id=248cbe8f-b84e-4c47-bbfd-cddd65349223 is in RUNNING state, waiting... Get a pipeline run with id=248cbe8f-b84e-4c47-bbfd-cddd65349223 Pipeline run with id=248cbe8f-b84e-4c47-bbfd-cddd65349223 is in RUNNING state, waiting... Get a pipeline run with id=248cbe8f-b84e-4c47-bbfd-cddd65349223 Pipeline run with id=248cbe8f-b84e-4c47-bbfd-cddd65349223 is in RUNNING state, waiting... Get a pipeline run with id=248cbe8f-b84e-4c47-bbfd-cddd65349223 Pipeline run with id=248cbe8f-b84e-4c47-bbfd-cddd65349223 is in RUNNING state, waiting... Get a pipeline run with id=248cbe8f-b84e-4c47-bbfd-cddd65349223 Pipeline run with id=248cbe8f-b84e-4c47-bbfd-cddd65349223 is in RUNNING state, waiting... Get a pipeline run with id=248cbe8f-b84e-4c47-bbfd-cddd65349223 Pipeline run with id=248cbe8f-b84e-4c47-bbfd-cddd65349223 is in RUNNING state, waiting... Get a pipeline run with id=248cbe8f-b84e-4c47-bbfd-cddd65349223 Pipeline run with id=248cbe8f-b84e-4c47-bbfd-cddd65349223 is in RUNNING state, waiting... Get a pipeline run with id=248cbe8f-b84e-4c47-bbfd-cddd65349223 Pipeline run with id=248cbe8f-b84e-4c47-bbfd-cddd65349223 is in RUNNING state, waiting... Get a pipeline run with id=248cbe8f-b84e-4c47-bbfd-cddd65349223 Pipeline run with id=248cbe8f-b84e-4c47-bbfd-cddd65349223 is in RUNNING state, waiting... Get a pipeline run with id=248cbe8f-b84e-4c47-bbfd-cddd65349223 Pipeline run with id=248cbe8f-b84e-4c47-bbfd-cddd65349223 is in RUNNING state, waiting... Get a pipeline run with id=248cbe8f-b84e-4c47-bbfd-cddd65349223 Pipeline run with id=248cbe8f-b84e-4c47-bbfd-cddd65349223 is in RUNNING state, waiting... Get a pipeline run with id=248cbe8f-b84e-4c47-bbfd-cddd65349223 Pipeline run with id=248cbe8f-b84e-4c47-bbfd-cddd65349223 is in RUNNING state, waiting... Get a pipeline run with id=248cbe8f-b84e-4c47-bbfd-cddd65349223 Pipeline run with id=248cbe8f-b84e-4c47-bbfd-cddd65349223 is in RUNNING state, waiting... Get a pipeline run with id=248cbe8f-b84e-4c47-bbfd-cddd65349223 Pipeline run with id=248cbe8f-b84e-4c47-bbfd-cddd65349223 is in RUNNING state, waiting... Get a pipeline run with id=248cbe8f-b84e-4c47-bbfd-cddd65349223 Pipeline run with id=248cbe8f-b84e-4c47-bbfd-cddd65349223 is in RUNNING state, waiting... Get a pipeline run with id=248cbe8f-b84e-4c47-bbfd-cddd65349223 Pipeline run with id=248cbe8f-b84e-4c47-bbfd-cddd65349223 is in RUNNING state, waiting... Get a pipeline run with id=248cbe8f-b84e-4c47-bbfd-cddd65349223 Pipeline run with id=248cbe8f-b84e-4c47-bbfd-cddd65349223 is in RUNNING state, waiting... Get a pipeline run with id=248cbe8f-b84e-4c47-bbfd-cddd65349223 Pipeline run with id=248cbe8f-b84e-4c47-bbfd-cddd65349223 is in RUNNING state, waiting... Get a pipeline run with id=248cbe8f-b84e-4c47-bbfd-cddd65349223 Pipeline run with id=248cbe8f-b84e-4c47-bbfd-cddd65349223 reached expected state SUCCEEDED Deserializing expected compiled workflow file 'essential/iris_pipeline_compiled.yaml' for the pipeline Unmarshalling Expected Workflow YAML Unmarshalled Expected Workflow YAML Fetching updated pipeline run details for run with id=248cbe8f-b84e-4c47-bbfd-cddd65349223 Get a pipeline run with id=248cbe8f-b84e-4c47-bbfd-cddd65349223 Updated pipeline run details Pipeline run succeeded, checking if the number of tasks are what is expected < Exit [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/09/26 17:14:11.669 (2m40.646s) > Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/09/26 17:14:11.669 ################### Global Cleanup after each test ##################### Deleting 1 run(s) Terminate run 248cbe8f-b84e-4c47-bbfd-cddd65349223 Failed to terminate run 248cbe8f-b84e-4c47-bbfd-cddd65349223 Terminate run 248cbe8f-b84e-4c47-bbfd-cddd65349223 Deleting run 248cbe8f-b84e-4c47-bbfd-cddd65349223 Deleting 0 experiment(s) Deleting 1 pipeline(s) Deleting pipeline with id=088c6e7e-4cb9-4208-aa9a-a041168b19a7 (cascade=true) Pipeline with id=088c6e7e-4cb9-4208-aa9a-a041168b19a7, DELETED < Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/09/26 17:14:11.872 (203ms) > Enter [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/09/26 17:14:11.872 < Exit [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/09/26 17:14:11.872 (0s) > Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/09/26 17:14:11.873 < Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/09/26 17:14:11.873 (0s) 2026/07/09 17:12:17 Test passed > Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/09/26 17:11:30.618 Create an experiment with name E2EExperiment-1783617090618269952 < Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/09/26 17:11:30.899 (282ms) > Enter [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/09/26 17:11:30.9 ################### Setup before each Pipeline Upload test ##################### ################### Global Setup before each test ##################### Test Context: 0x3202679f4400 Looks like test-secret-1 already exists, because creation failed due to secrets "test-secret-1" already exists Looks like test-secret-2 already exists, because creation failed due to secrets "test-secret-2" already exists Looks like test-secret-3 already exists, because creation failed due to secrets "test-secret-3" already exists < Exit [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/09/26 17:11:31.669 (770ms) > Enter [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/09/26 17:11:31.67 Uploading pipeline file essential/component_with_pip_index_urls.yaml Creating temp pipeline file with overridden SDK Version Uploading pipeline with name=e2e-test-1783617090900111936, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml Upload of pipeline file 'essential/component_with_pip_index_urls.yaml' successful Listing pipeline versions for pipeline 39e5a0ac-35a4-497a-91e2-deef60928429 Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml Returning pipeline run time inputs map[] Create run for pipeline with id: '39e5a0ac-35a4-497a-91e2-deef60928429' and name: 'e2e-test-1783617090900111936' Create a pipeline run for pipeline with id=39e5a0ac-35a4-497a-91e2-deef60928429 and versionId=4daade0d-ce2c-465d-8340-14675907369b Create a pipeline run body Created Pipeline Run successfully with runId=841d0fc8-32c3-428d-a52b-f750a0b6e48b Created Pipeline Run with id: 841d0fc8-32c3-428d-a52b-f750a0b6e48b for pipeline with id: 39e5a0ac-35a4-497a-91e2-deef60928429 Waiting for pipeline run with id=841d0fc8-32c3-428d-a52b-f750a0b6e48b to be in one of '[SUCCEEDED SKIPPED FAILED CANCELED]' Get a pipeline run with id=841d0fc8-32c3-428d-a52b-f750a0b6e48b Pipeline run with id=841d0fc8-32c3-428d-a52b-f750a0b6e48b is in PENDING state, waiting... Get a pipeline run with id=841d0fc8-32c3-428d-a52b-f750a0b6e48b Pipeline run with id=841d0fc8-32c3-428d-a52b-f750a0b6e48b is in RUNNING state, waiting... Get a pipeline run with id=841d0fc8-32c3-428d-a52b-f750a0b6e48b Pipeline run with id=841d0fc8-32c3-428d-a52b-f750a0b6e48b is in RUNNING state, waiting... Get a pipeline run with id=841d0fc8-32c3-428d-a52b-f750a0b6e48b Pipeline run with id=841d0fc8-32c3-428d-a52b-f750a0b6e48b is in RUNNING state, waiting... Get a pipeline run with id=841d0fc8-32c3-428d-a52b-f750a0b6e48b Pipeline run with id=841d0fc8-32c3-428d-a52b-f750a0b6e48b is in RUNNING state, waiting... Get a pipeline run with id=841d0fc8-32c3-428d-a52b-f750a0b6e48b Pipeline run with id=841d0fc8-32c3-428d-a52b-f750a0b6e48b is in RUNNING state, waiting... Get a pipeline run with id=841d0fc8-32c3-428d-a52b-f750a0b6e48b Pipeline run with id=841d0fc8-32c3-428d-a52b-f750a0b6e48b is in RUNNING state, waiting... Get a pipeline run with id=841d0fc8-32c3-428d-a52b-f750a0b6e48b Pipeline run with id=841d0fc8-32c3-428d-a52b-f750a0b6e48b is in RUNNING state, waiting... Get a pipeline run with id=841d0fc8-32c3-428d-a52b-f750a0b6e48b Pipeline run with id=841d0fc8-32c3-428d-a52b-f750a0b6e48b is in RUNNING state, waiting... Get a pipeline run with id=841d0fc8-32c3-428d-a52b-f750a0b6e48b Pipeline run with id=841d0fc8-32c3-428d-a52b-f750a0b6e48b reached expected state SUCCEEDED Deserializing expected compiled workflow file 'essential/component_with_pip_index_urls.yaml' for the pipeline Unmarshalling Expected Workflow YAML Unmarshalled Expected Workflow YAML Fetching updated pipeline run details for run with id=841d0fc8-32c3-428d-a52b-f750a0b6e48b Get a pipeline run with id=841d0fc8-32c3-428d-a52b-f750a0b6e48b Updated pipeline run details Pipeline run succeeded, checking if the number of tasks are what is expected < Exit [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/09/26 17:12:17.047 (45.377s) > Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/09/26 17:12:17.047 ################### Global Cleanup after each test ##################### Deleting 1 run(s) Terminate run 841d0fc8-32c3-428d-a52b-f750a0b6e48b Failed to terminate run 841d0fc8-32c3-428d-a52b-f750a0b6e48b Terminate run 841d0fc8-32c3-428d-a52b-f750a0b6e48b Deleting run 841d0fc8-32c3-428d-a52b-f750a0b6e48b Deleting 0 experiment(s) Deleting 1 pipeline(s) Deleting pipeline with id=39e5a0ac-35a4-497a-91e2-deef60928429 (cascade=true) Pipeline with id=39e5a0ac-35a4-497a-91e2-deef60928429, DELETED < Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/09/26 17:12:17.219 (172ms) > Enter [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/09/26 17:12:17.22 < Exit [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/09/26 17:12:17.22 (0s) > Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/09/26 17:12:17.22 < Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/09/26 17:12:17.22 (0s) 2026/07/09 17:13:06 Test passed > Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/09/26 17:11:30.618 Create an experiment with name E2EExperiment-1783617090618244691 < Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/09/26 17:11:30.896 (278ms) > Enter [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/09/26 17:11:30.896 ################### Setup before each Pipeline Upload test ##################### ################### Global Setup before each test ##################### Test Context: 0x30600f7c8900 Looks like test-secret-1 already exists, because creation failed due to secrets "test-secret-1" already exists Looks like test-secret-2 already exists, because creation failed due to secrets "test-secret-2" already exists Looks like test-secret-3 already exists, because creation failed due to secrets "test-secret-3" already exists < Exit [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/09/26 17:11:30.979 (83ms) > Enter [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/09/26 17:11:30.979 Uploading pipeline file critical/parallel_for_after_dependency.yaml Creating temp pipeline file with overridden SDK Version Uploading pipeline with name=e2e-test-1783617090896379683, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml Upload of pipeline file 'critical/parallel_for_after_dependency.yaml' successful Listing pipeline versions for pipeline a255e4b6-d508-4c76-b4d7-0b29b0ec8034 Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml Returning pipeline run time inputs map[] Create run for pipeline with id: 'a255e4b6-d508-4c76-b4d7-0b29b0ec8034' and name: 'e2e-test-1783617090896379683' Create a pipeline run for pipeline with id=a255e4b6-d508-4c76-b4d7-0b29b0ec8034 and versionId=9d29d962-d27f-450d-94c6-fff88c53fc40 Create a pipeline run body Created Pipeline Run successfully with runId=c90a358e-4a10-45b8-88f4-c838e8f60720 Created Pipeline Run with id: c90a358e-4a10-45b8-88f4-c838e8f60720 for pipeline with id: a255e4b6-d508-4c76-b4d7-0b29b0ec8034 Waiting for pipeline run with id=c90a358e-4a10-45b8-88f4-c838e8f60720 to be in one of '[SUCCEEDED SKIPPED FAILED CANCELED]' Get a pipeline run with id=c90a358e-4a10-45b8-88f4-c838e8f60720 Pipeline run with id=c90a358e-4a10-45b8-88f4-c838e8f60720 is in PENDING state, waiting... Get a pipeline run with id=c90a358e-4a10-45b8-88f4-c838e8f60720 Pipeline run with id=c90a358e-4a10-45b8-88f4-c838e8f60720 is in RUNNING state, waiting... Get a pipeline run with id=c90a358e-4a10-45b8-88f4-c838e8f60720 Pipeline run with id=c90a358e-4a10-45b8-88f4-c838e8f60720 is in RUNNING state, waiting... Get a pipeline run with id=c90a358e-4a10-45b8-88f4-c838e8f60720 Pipeline run with id=c90a358e-4a10-45b8-88f4-c838e8f60720 is in RUNNING state, waiting... Get a pipeline run with id=c90a358e-4a10-45b8-88f4-c838e8f60720 Pipeline run with id=c90a358e-4a10-45b8-88f4-c838e8f60720 is in RUNNING state, waiting... Get a pipeline run with id=c90a358e-4a10-45b8-88f4-c838e8f60720 Pipeline run with id=c90a358e-4a10-45b8-88f4-c838e8f60720 is in RUNNING state, waiting... Get a pipeline run with id=c90a358e-4a10-45b8-88f4-c838e8f60720 Pipeline run with id=c90a358e-4a10-45b8-88f4-c838e8f60720 is in RUNNING state, waiting... Get a pipeline run with id=c90a358e-4a10-45b8-88f4-c838e8f60720 Pipeline run with id=c90a358e-4a10-45b8-88f4-c838e8f60720 is in RUNNING state, waiting... Get a pipeline run with id=c90a358e-4a10-45b8-88f4-c838e8f60720 Pipeline run with id=c90a358e-4a10-45b8-88f4-c838e8f60720 is in RUNNING state, waiting... Get a pipeline run with id=c90a358e-4a10-45b8-88f4-c838e8f60720 Pipeline run with id=c90a358e-4a10-45b8-88f4-c838e8f60720 is in RUNNING state, waiting... Get a pipeline run with id=c90a358e-4a10-45b8-88f4-c838e8f60720 Pipeline run with id=c90a358e-4a10-45b8-88f4-c838e8f60720 is in RUNNING state, waiting... Get a pipeline run with id=c90a358e-4a10-45b8-88f4-c838e8f60720 Pipeline run with id=c90a358e-4a10-45b8-88f4-c838e8f60720 is in RUNNING state, waiting... Get a pipeline run with id=c90a358e-4a10-45b8-88f4-c838e8f60720 Pipeline run with id=c90a358e-4a10-45b8-88f4-c838e8f60720 is in RUNNING state, waiting... Get a pipeline run with id=c90a358e-4a10-45b8-88f4-c838e8f60720 Pipeline run with id=c90a358e-4a10-45b8-88f4-c838e8f60720 is in RUNNING state, waiting... Get a pipeline run with id=c90a358e-4a10-45b8-88f4-c838e8f60720 Pipeline run with id=c90a358e-4a10-45b8-88f4-c838e8f60720 is in RUNNING state, waiting... Get a pipeline run with id=c90a358e-4a10-45b8-88f4-c838e8f60720 Pipeline run with id=c90a358e-4a10-45b8-88f4-c838e8f60720 is in RUNNING state, waiting... Get a pipeline run with id=c90a358e-4a10-45b8-88f4-c838e8f60720 Pipeline run with id=c90a358e-4a10-45b8-88f4-c838e8f60720 is in RUNNING state, waiting... Get a pipeline run with id=c90a358e-4a10-45b8-88f4-c838e8f60720 Pipeline run with id=c90a358e-4a10-45b8-88f4-c838e8f60720 is in RUNNING state, waiting... Get a pipeline run with id=c90a358e-4a10-45b8-88f4-c838e8f60720 Pipeline run with id=c90a358e-4a10-45b8-88f4-c838e8f60720 is in RUNNING state, waiting... Get a pipeline run with id=c90a358e-4a10-45b8-88f4-c838e8f60720 Pipeline run with id=c90a358e-4a10-45b8-88f4-c838e8f60720 reached expected state SUCCEEDED Deserializing expected compiled workflow file 'critical/parallel_for_after_dependency.yaml' for the pipeline Unmarshalling Expected Workflow YAML Unmarshalled Expected Workflow YAML Fetching updated pipeline run details for run with id=c90a358e-4a10-45b8-88f4-c838e8f60720 Get a pipeline run with id=c90a358e-4a10-45b8-88f4-c838e8f60720 Updated pipeline run details Pipeline run succeeded, checking if the number of tasks are what is expected < Exit [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/09/26 17:13:06.612 (1m35.632s) > Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/09/26 17:13:06.612 ################### Global Cleanup after each test ##################### Deleting 1 run(s) Terminate run c90a358e-4a10-45b8-88f4-c838e8f60720 Failed to terminate run c90a358e-4a10-45b8-88f4-c838e8f60720 Terminate run c90a358e-4a10-45b8-88f4-c838e8f60720 Deleting run c90a358e-4a10-45b8-88f4-c838e8f60720 Deleting 0 experiment(s) Deleting 1 pipeline(s) Deleting pipeline with id=a255e4b6-d508-4c76-b4d7-0b29b0ec8034 (cascade=true) Pipeline with id=a255e4b6-d508-4c76-b4d7-0b29b0ec8034, DELETED < Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/09/26 17:13:06.777 (166ms) > Enter [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/09/26 17:13:06.778 < Exit [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/09/26 17:13:06.778 (0s) > Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/09/26 17:13:06.778 < Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/09/26 17:13:06.778 (0s) 2026/07/09 17:13:11 Test passed > Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/09/26 17:11:30.618 Create an experiment with name E2EExperiment-1783617090618442667 < Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/09/26 17:11:30.896 (278ms) > Enter [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/09/26 17:11:30.896 ################### Setup before each Pipeline Upload test ##################### ################### Global Setup before each test ##################### Test Context: 0x158cc97e8e80 Looks like test-secret-1 already exists, because creation failed due to secrets "test-secret-1" already exists Looks like test-secret-2 already exists, because creation failed due to secrets "test-secret-2" already exists Looks like test-secret-3 already exists, because creation failed due to secrets "test-secret-3" already exists < Exit [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/09/26 17:11:30.975 (79ms) > Enter [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/09/26 17:11:30.975 Uploading pipeline file critical/pipeline_with_artifact_upload_download.yaml Creating temp pipeline file with overridden SDK Version Uploading pipeline with name=e2e-test-1783617090896536526, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml Upload of pipeline file 'critical/pipeline_with_artifact_upload_download.yaml' successful Listing pipeline versions for pipeline 6abca988-8f7e-41ec-a975-2525c62d3f9d Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml Returning pipeline run time inputs map[] Create run for pipeline with id: '6abca988-8f7e-41ec-a975-2525c62d3f9d' and name: 'e2e-test-1783617090896536526' Create a pipeline run for pipeline with id=6abca988-8f7e-41ec-a975-2525c62d3f9d and versionId=a7cc18a9-50d2-4644-9546-467f61c19419 Create a pipeline run body Created Pipeline Run successfully with runId=d9d29fca-c98b-4cf3-a376-db111504d938 Created Pipeline Run with id: d9d29fca-c98b-4cf3-a376-db111504d938 for pipeline with id: 6abca988-8f7e-41ec-a975-2525c62d3f9d Waiting for pipeline run with id=d9d29fca-c98b-4cf3-a376-db111504d938 to be in one of '[SUCCEEDED SKIPPED FAILED CANCELED]' Get a pipeline run with id=d9d29fca-c98b-4cf3-a376-db111504d938 Pipeline run with id=d9d29fca-c98b-4cf3-a376-db111504d938 is in PENDING state, waiting... Get a pipeline run with id=d9d29fca-c98b-4cf3-a376-db111504d938 Pipeline run with id=d9d29fca-c98b-4cf3-a376-db111504d938 is in RUNNING state, waiting... Get a pipeline run with id=d9d29fca-c98b-4cf3-a376-db111504d938 Pipeline run with id=d9d29fca-c98b-4cf3-a376-db111504d938 is in RUNNING state, waiting... Get a pipeline run with id=d9d29fca-c98b-4cf3-a376-db111504d938 Pipeline run with id=d9d29fca-c98b-4cf3-a376-db111504d938 is in RUNNING state, waiting... Get a pipeline run with id=d9d29fca-c98b-4cf3-a376-db111504d938 Pipeline run with id=d9d29fca-c98b-4cf3-a376-db111504d938 is in RUNNING state, waiting... Get a pipeline run with id=d9d29fca-c98b-4cf3-a376-db111504d938 Pipeline run with id=d9d29fca-c98b-4cf3-a376-db111504d938 is in RUNNING state, waiting... Get a pipeline run with id=d9d29fca-c98b-4cf3-a376-db111504d938 Pipeline run with id=d9d29fca-c98b-4cf3-a376-db111504d938 is in RUNNING state, waiting... Get a pipeline run with id=d9d29fca-c98b-4cf3-a376-db111504d938 Pipeline run with id=d9d29fca-c98b-4cf3-a376-db111504d938 is in RUNNING state, waiting... Get a pipeline run with id=d9d29fca-c98b-4cf3-a376-db111504d938 Pipeline run with id=d9d29fca-c98b-4cf3-a376-db111504d938 is in RUNNING state, waiting... Get a pipeline run with id=d9d29fca-c98b-4cf3-a376-db111504d938 Pipeline run with id=d9d29fca-c98b-4cf3-a376-db111504d938 is in RUNNING state, waiting... Get a pipeline run with id=d9d29fca-c98b-4cf3-a376-db111504d938 Pipeline run with id=d9d29fca-c98b-4cf3-a376-db111504d938 is in RUNNING state, waiting... Get a pipeline run with id=d9d29fca-c98b-4cf3-a376-db111504d938 Pipeline run with id=d9d29fca-c98b-4cf3-a376-db111504d938 is in RUNNING state, waiting... Get a pipeline run with id=d9d29fca-c98b-4cf3-a376-db111504d938 Pipeline run with id=d9d29fca-c98b-4cf3-a376-db111504d938 is in RUNNING state, waiting... Get a pipeline run with id=d9d29fca-c98b-4cf3-a376-db111504d938 Pipeline run with id=d9d29fca-c98b-4cf3-a376-db111504d938 is in RUNNING state, waiting... Get a pipeline run with id=d9d29fca-c98b-4cf3-a376-db111504d938 Pipeline run with id=d9d29fca-c98b-4cf3-a376-db111504d938 is in RUNNING state, waiting... Get a pipeline run with id=d9d29fca-c98b-4cf3-a376-db111504d938 Pipeline run with id=d9d29fca-c98b-4cf3-a376-db111504d938 is in RUNNING state, waiting... Get a pipeline run with id=d9d29fca-c98b-4cf3-a376-db111504d938 Pipeline run with id=d9d29fca-c98b-4cf3-a376-db111504d938 is in RUNNING state, waiting... Get a pipeline run with id=d9d29fca-c98b-4cf3-a376-db111504d938 Pipeline run with id=d9d29fca-c98b-4cf3-a376-db111504d938 is in RUNNING state, waiting... Get a pipeline run with id=d9d29fca-c98b-4cf3-a376-db111504d938 Pipeline run with id=d9d29fca-c98b-4cf3-a376-db111504d938 is in RUNNING state, waiting... Get a pipeline run with id=d9d29fca-c98b-4cf3-a376-db111504d938 Pipeline run with id=d9d29fca-c98b-4cf3-a376-db111504d938 is in RUNNING state, waiting... Get a pipeline run with id=d9d29fca-c98b-4cf3-a376-db111504d938 Pipeline run with id=d9d29fca-c98b-4cf3-a376-db111504d938 reached expected state SUCCEEDED Deserializing expected compiled workflow file 'critical/pipeline_with_artifact_upload_download.yaml' for the pipeline Unmarshalling Expected Workflow YAML Unmarshalled Expected Workflow YAML Fetching updated pipeline run details for run with id=d9d29fca-c98b-4cf3-a376-db111504d938 Get a pipeline run with id=d9d29fca-c98b-4cf3-a376-db111504d938 Updated pipeline run details Pipeline run succeeded, checking if the number of tasks are what is expected < Exit [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/09/26 17:13:11.585 (1m40.61s) > Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/09/26 17:13:11.585 ################### Global Cleanup after each test ##################### Deleting 1 run(s) Terminate run d9d29fca-c98b-4cf3-a376-db111504d938 Failed to terminate run d9d29fca-c98b-4cf3-a376-db111504d938 Terminate run d9d29fca-c98b-4cf3-a376-db111504d938 Deleting run d9d29fca-c98b-4cf3-a376-db111504d938 Deleting 0 experiment(s) Deleting 1 pipeline(s) Deleting pipeline with id=6abca988-8f7e-41ec-a975-2525c62d3f9d (cascade=true) Pipeline with id=6abca988-8f7e-41ec-a975-2525c62d3f9d, DELETED < Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/09/26 17:13:11.731 (146ms) > Enter [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/09/26 17:13:11.731 < Exit [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/09/26 17:13:11.731 (0s) > Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/09/26 17:13:11.731 < Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/09/26 17:13:11.731 (0s) 2026/07/09 17:13:41 Test passed > Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/09/26 17:11:30.618 Create an experiment with name E2EExperiment-1783617090618164840 < Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/09/26 17:11:30.896 (278ms) > Enter [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/09/26 17:11:30.896 ################### Setup before each Pipeline Upload test ##################### ################### Global Setup before each test ##################### Test Context: 0x29f26a7f8480 test-secret-1 created test-secret-2 created test-secret-3 created < Exit [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/09/26 17:11:30.934 (38ms) > Enter [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/09/26 17:11:30.934 Uploading pipeline file critical/flip_coin.yaml Creating temp pipeline file with overridden SDK Version Uploading pipeline with name=e2e-test-1783617090896459035, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml Upload of pipeline file 'critical/flip_coin.yaml' successful Listing pipeline versions for pipeline f7065d0b-7a05-4fc8-9e96-0b0571808fbd Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml Returning pipeline run time inputs map[] Create run for pipeline with id: 'f7065d0b-7a05-4fc8-9e96-0b0571808fbd' and name: 'e2e-test-1783617090896459035' Create a pipeline run for pipeline with id=f7065d0b-7a05-4fc8-9e96-0b0571808fbd and versionId=d381b5c0-3a30-4df3-879b-8d3405dcf1ef Create a pipeline run body Created Pipeline Run successfully with runId=50e4d23e-fc80-4078-94a4-fccc7354402c Created Pipeline Run with id: 50e4d23e-fc80-4078-94a4-fccc7354402c for pipeline with id: f7065d0b-7a05-4fc8-9e96-0b0571808fbd Waiting for pipeline run with id=50e4d23e-fc80-4078-94a4-fccc7354402c to be in one of '[SUCCEEDED SKIPPED FAILED CANCELED]' Get a pipeline run with id=50e4d23e-fc80-4078-94a4-fccc7354402c Pipeline run with id=50e4d23e-fc80-4078-94a4-fccc7354402c is in PENDING state, waiting... Get a pipeline run with id=50e4d23e-fc80-4078-94a4-fccc7354402c Pipeline run with id=50e4d23e-fc80-4078-94a4-fccc7354402c is in RUNNING state, waiting... Get a pipeline run with id=50e4d23e-fc80-4078-94a4-fccc7354402c Pipeline run with id=50e4d23e-fc80-4078-94a4-fccc7354402c is in RUNNING state, waiting... Get a pipeline run with id=50e4d23e-fc80-4078-94a4-fccc7354402c Pipeline run with id=50e4d23e-fc80-4078-94a4-fccc7354402c is in RUNNING state, waiting... Get a pipeline run with id=50e4d23e-fc80-4078-94a4-fccc7354402c Pipeline run with id=50e4d23e-fc80-4078-94a4-fccc7354402c is in RUNNING state, waiting... Get a pipeline run with id=50e4d23e-fc80-4078-94a4-fccc7354402c Pipeline run with id=50e4d23e-fc80-4078-94a4-fccc7354402c is in RUNNING state, waiting... Get a pipeline run with id=50e4d23e-fc80-4078-94a4-fccc7354402c Pipeline run with id=50e4d23e-fc80-4078-94a4-fccc7354402c is in RUNNING state, waiting... Get a pipeline run with id=50e4d23e-fc80-4078-94a4-fccc7354402c Pipeline run with id=50e4d23e-fc80-4078-94a4-fccc7354402c is in RUNNING state, waiting... Get a pipeline run with id=50e4d23e-fc80-4078-94a4-fccc7354402c Pipeline run with id=50e4d23e-fc80-4078-94a4-fccc7354402c is in RUNNING state, waiting... Get a pipeline run with id=50e4d23e-fc80-4078-94a4-fccc7354402c Pipeline run with id=50e4d23e-fc80-4078-94a4-fccc7354402c is in RUNNING state, waiting... Get a pipeline run with id=50e4d23e-fc80-4078-94a4-fccc7354402c Pipeline run with id=50e4d23e-fc80-4078-94a4-fccc7354402c is in RUNNING state, waiting... Get a pipeline run with id=50e4d23e-fc80-4078-94a4-fccc7354402c Pipeline run with id=50e4d23e-fc80-4078-94a4-fccc7354402c is in RUNNING state, waiting... Get a pipeline run with id=50e4d23e-fc80-4078-94a4-fccc7354402c Pipeline run with id=50e4d23e-fc80-4078-94a4-fccc7354402c is in RUNNING state, waiting... Get a pipeline run with id=50e4d23e-fc80-4078-94a4-fccc7354402c Pipeline run with id=50e4d23e-fc80-4078-94a4-fccc7354402c is in RUNNING state, waiting... Get a pipeline run with id=50e4d23e-fc80-4078-94a4-fccc7354402c Pipeline run with id=50e4d23e-fc80-4078-94a4-fccc7354402c is in RUNNING state, waiting... Get a pipeline run with id=50e4d23e-fc80-4078-94a4-fccc7354402c Pipeline run with id=50e4d23e-fc80-4078-94a4-fccc7354402c is in RUNNING state, waiting... Get a pipeline run with id=50e4d23e-fc80-4078-94a4-fccc7354402c Pipeline run with id=50e4d23e-fc80-4078-94a4-fccc7354402c is in RUNNING state, waiting... Get a pipeline run with id=50e4d23e-fc80-4078-94a4-fccc7354402c Pipeline run with id=50e4d23e-fc80-4078-94a4-fccc7354402c is in RUNNING state, waiting... Get a pipeline run with id=50e4d23e-fc80-4078-94a4-fccc7354402c Pipeline run with id=50e4d23e-fc80-4078-94a4-fccc7354402c is in RUNNING state, waiting... Get a pipeline run with id=50e4d23e-fc80-4078-94a4-fccc7354402c Pipeline run with id=50e4d23e-fc80-4078-94a4-fccc7354402c is in RUNNING state, waiting... Get a pipeline run with id=50e4d23e-fc80-4078-94a4-fccc7354402c Pipeline run with id=50e4d23e-fc80-4078-94a4-fccc7354402c is in RUNNING state, waiting... Get a pipeline run with id=50e4d23e-fc80-4078-94a4-fccc7354402c Pipeline run with id=50e4d23e-fc80-4078-94a4-fccc7354402c is in RUNNING state, waiting... Get a pipeline run with id=50e4d23e-fc80-4078-94a4-fccc7354402c Pipeline run with id=50e4d23e-fc80-4078-94a4-fccc7354402c is in RUNNING state, waiting... Get a pipeline run with id=50e4d23e-fc80-4078-94a4-fccc7354402c Pipeline run with id=50e4d23e-fc80-4078-94a4-fccc7354402c is in RUNNING state, waiting... Get a pipeline run with id=50e4d23e-fc80-4078-94a4-fccc7354402c Pipeline run with id=50e4d23e-fc80-4078-94a4-fccc7354402c is in RUNNING state, waiting... Get a pipeline run with id=50e4d23e-fc80-4078-94a4-fccc7354402c Pipeline run with id=50e4d23e-fc80-4078-94a4-fccc7354402c is in RUNNING state, waiting... Get a pipeline run with id=50e4d23e-fc80-4078-94a4-fccc7354402c Pipeline run with id=50e4d23e-fc80-4078-94a4-fccc7354402c reached expected state SUCCEEDED Deserializing expected compiled workflow file 'critical/flip_coin.yaml' for the pipeline Unmarshalling Expected Workflow YAML Unmarshalled Expected Workflow YAML Fetching updated pipeline run details for run with id=50e4d23e-fc80-4078-94a4-fccc7354402c Get a pipeline run with id=50e4d23e-fc80-4078-94a4-fccc7354402c Updated pipeline run details Pipeline run succeeded, checking if the number of tasks are what is expected < Exit [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/09/26 17:13:41.628 (2m10.694s) > Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/09/26 17:13:41.628 ################### Global Cleanup after each test ##################### Deleting 1 run(s) Terminate run 50e4d23e-fc80-4078-94a4-fccc7354402c Failed to terminate run 50e4d23e-fc80-4078-94a4-fccc7354402c Terminate run 50e4d23e-fc80-4078-94a4-fccc7354402c Deleting run 50e4d23e-fc80-4078-94a4-fccc7354402c Deleting 0 experiment(s) Deleting 1 pipeline(s) Deleting pipeline with id=f7065d0b-7a05-4fc8-9e96-0b0571808fbd (cascade=true) Pipeline with id=f7065d0b-7a05-4fc8-9e96-0b0571808fbd, DELETED < Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/09/26 17:13:41.813 (185ms) > Enter [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/09/26 17:13:41.813 < Exit [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/09/26 17:13:41.814 (0s) > Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/09/26 17:13:41.814 < Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/09/26 17:13:41.814 (0s)