2026/07/02 20:17:23 Test passed > Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/02/26 20:16:36.218 Create an experiment with name E2EExperiment-1783023396218411849 < Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/02/26 20:16:36.488 (270ms) > Enter [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/02/26 20:16:36.488 ################### Setup before each Pipeline Upload test ##################### ################### Global Setup before each test ##################### Test Context: 0x3efbf5e1e300 Looks like test-secret-1 already exists, because creation failed due to secrets "test-secret-1" already exists Looks like test-secret-2 already exists, because creation failed due to secrets "test-secret-2" already exists Looks like test-secret-3 already exists, because creation failed due to secrets "test-secret-3" already exists < Exit [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/02/26 20:16:36.698 (210ms) > Enter [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/02/26 20:16:36.698 Uploading pipeline file essential/component_with_pip_index_urls.yaml Creating temp pipeline file with overridden SDK Version Uploading pipeline with name=e2e-test-1783023396488499435, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml Upload of pipeline file 'essential/component_with_pip_index_urls.yaml' successful Listing pipeline versions for pipeline 4a9da332-78b6-4b39-99d2-910ee64a32dd Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml Returning pipeline run time inputs map[] Create run for pipeline with id: '4a9da332-78b6-4b39-99d2-910ee64a32dd' and name: 'e2e-test-1783023396488499435' Create a pipeline run for pipeline with id=4a9da332-78b6-4b39-99d2-910ee64a32dd and versionId=d104345e-2a39-4a17-86b5-424763e86132 Create a pipeline run body Created Pipeline Run successfully with runId=1a0bda8a-2fe4-4e01-944c-de30cc57202b Created Pipeline Run with id: 1a0bda8a-2fe4-4e01-944c-de30cc57202b for pipeline with id: 4a9da332-78b6-4b39-99d2-910ee64a32dd Waiting for pipeline run with id=1a0bda8a-2fe4-4e01-944c-de30cc57202b to be in one of '[SUCCEEDED SKIPPED FAILED CANCELED]' Get a pipeline run with id=1a0bda8a-2fe4-4e01-944c-de30cc57202b Pipeline run with id=1a0bda8a-2fe4-4e01-944c-de30cc57202b is in PENDING state, waiting... Get a pipeline run with id=1a0bda8a-2fe4-4e01-944c-de30cc57202b Pipeline run with id=1a0bda8a-2fe4-4e01-944c-de30cc57202b is in RUNNING state, waiting... Get a pipeline run with id=1a0bda8a-2fe4-4e01-944c-de30cc57202b Pipeline run with id=1a0bda8a-2fe4-4e01-944c-de30cc57202b is in RUNNING state, waiting... Get a pipeline run with id=1a0bda8a-2fe4-4e01-944c-de30cc57202b Pipeline run with id=1a0bda8a-2fe4-4e01-944c-de30cc57202b is in RUNNING state, waiting... Get a pipeline run with id=1a0bda8a-2fe4-4e01-944c-de30cc57202b Pipeline run with id=1a0bda8a-2fe4-4e01-944c-de30cc57202b is in RUNNING state, waiting... Get a pipeline run with id=1a0bda8a-2fe4-4e01-944c-de30cc57202b Pipeline run with id=1a0bda8a-2fe4-4e01-944c-de30cc57202b is in RUNNING state, waiting... Get a pipeline run with id=1a0bda8a-2fe4-4e01-944c-de30cc57202b Pipeline run with id=1a0bda8a-2fe4-4e01-944c-de30cc57202b is in RUNNING state, waiting... Get a pipeline run with id=1a0bda8a-2fe4-4e01-944c-de30cc57202b Pipeline run with id=1a0bda8a-2fe4-4e01-944c-de30cc57202b is in RUNNING state, waiting... Get a pipeline run with id=1a0bda8a-2fe4-4e01-944c-de30cc57202b Pipeline run with id=1a0bda8a-2fe4-4e01-944c-de30cc57202b is in RUNNING state, waiting... Get a pipeline run with id=1a0bda8a-2fe4-4e01-944c-de30cc57202b Pipeline run with id=1a0bda8a-2fe4-4e01-944c-de30cc57202b reached expected state SUCCEEDED Deserializing expected compiled workflow file 'essential/component_with_pip_index_urls.yaml' for the pipeline Unmarshalling Expected Workflow YAML Unmarshalled Expected Workflow YAML Fetching updated pipeline run details for run with id=1a0bda8a-2fe4-4e01-944c-de30cc57202b Get a pipeline run with id=1a0bda8a-2fe4-4e01-944c-de30cc57202b Updated pipeline run details Pipeline run succeeded, checking if the number of tasks are what is expected < Exit [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/02/26 20:17:23.114 (46.416s) > Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/02/26 20:17:23.114 ################### Global Cleanup after each test ##################### Deleting 1 run(s) Terminate run 1a0bda8a-2fe4-4e01-944c-de30cc57202b Failed to terminate run 1a0bda8a-2fe4-4e01-944c-de30cc57202b Terminate run 1a0bda8a-2fe4-4e01-944c-de30cc57202b Deleting run 1a0bda8a-2fe4-4e01-944c-de30cc57202b Deleting 0 experiment(s) Deleting 1 pipeline(s) Deleting pipeline with id=4a9da332-78b6-4b39-99d2-910ee64a32dd (cascade=true) Pipeline with id=4a9da332-78b6-4b39-99d2-910ee64a32dd, DELETED < Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/02/26 20:17:23.371 (257ms) > Enter [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/02/26 20:17:23.371 < Exit [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/02/26 20:17:23.371 (0s) > Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/02/26 20:17:23.371 < Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/02/26 20:17:23.371 (0s) 2026/07/02 20:18:12 Test passed > Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/02/26 20:16:36.218 Create an experiment with name E2EExperiment-1783023396218051821 < Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/02/26 20:16:36.477 (259ms) > Enter [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/02/26 20:16:36.477 ################### Setup before each Pipeline Upload test ##################### ################### Global Setup before each test ##################### Test Context: 0x347367069080 Looks like test-secret-1 already exists, because creation failed due to secrets "test-secret-1" already exists Looks like test-secret-2 already exists, because creation failed due to secrets "test-secret-2" already exists Looks like test-secret-3 already exists, because creation failed due to secrets "test-secret-3" already exists < Exit [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/02/26 20:16:36.851 (374ms) > Enter [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/02/26 20:16:36.851 Uploading pipeline file critical/parallel_for_after_dependency.yaml Creating temp pipeline file with overridden SDK Version Uploading pipeline with name=e2e-test-1783023396477733784, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml Upload of pipeline file 'critical/parallel_for_after_dependency.yaml' successful Listing pipeline versions for pipeline 7642b66f-c4f6-4157-bdb1-9451799558b0 Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml Returning pipeline run time inputs map[] Create run for pipeline with id: '7642b66f-c4f6-4157-bdb1-9451799558b0' and name: 'e2e-test-1783023396477733784' Create a pipeline run for pipeline with id=7642b66f-c4f6-4157-bdb1-9451799558b0 and versionId=730afe61-7990-4341-84aa-11aa3374c203 Create a pipeline run body Created Pipeline Run successfully with runId=e3e1854e-ac6f-4bf9-96d1-cfc35445f4a1 Created Pipeline Run with id: e3e1854e-ac6f-4bf9-96d1-cfc35445f4a1 for pipeline with id: 7642b66f-c4f6-4157-bdb1-9451799558b0 Waiting for pipeline run with id=e3e1854e-ac6f-4bf9-96d1-cfc35445f4a1 to be in one of '[SUCCEEDED SKIPPED FAILED CANCELED]' Get a pipeline run with id=e3e1854e-ac6f-4bf9-96d1-cfc35445f4a1 Pipeline run with id=e3e1854e-ac6f-4bf9-96d1-cfc35445f4a1 is in PENDING state, waiting... Get a pipeline run with id=e3e1854e-ac6f-4bf9-96d1-cfc35445f4a1 Pipeline run with id=e3e1854e-ac6f-4bf9-96d1-cfc35445f4a1 is in RUNNING state, waiting... Get a pipeline run with id=e3e1854e-ac6f-4bf9-96d1-cfc35445f4a1 Pipeline run with id=e3e1854e-ac6f-4bf9-96d1-cfc35445f4a1 is in RUNNING state, waiting... Get a pipeline run with id=e3e1854e-ac6f-4bf9-96d1-cfc35445f4a1 Pipeline run with id=e3e1854e-ac6f-4bf9-96d1-cfc35445f4a1 is in RUNNING state, waiting... Get a pipeline run with id=e3e1854e-ac6f-4bf9-96d1-cfc35445f4a1 Pipeline run with id=e3e1854e-ac6f-4bf9-96d1-cfc35445f4a1 is in RUNNING state, waiting... Get a pipeline run with id=e3e1854e-ac6f-4bf9-96d1-cfc35445f4a1 Pipeline run with id=e3e1854e-ac6f-4bf9-96d1-cfc35445f4a1 is in RUNNING state, waiting... Get a pipeline run with id=e3e1854e-ac6f-4bf9-96d1-cfc35445f4a1 Pipeline run with id=e3e1854e-ac6f-4bf9-96d1-cfc35445f4a1 is in RUNNING state, waiting... Get a pipeline run with id=e3e1854e-ac6f-4bf9-96d1-cfc35445f4a1 Pipeline run with id=e3e1854e-ac6f-4bf9-96d1-cfc35445f4a1 is in RUNNING state, waiting... Get a pipeline run with id=e3e1854e-ac6f-4bf9-96d1-cfc35445f4a1 Pipeline run with id=e3e1854e-ac6f-4bf9-96d1-cfc35445f4a1 is in RUNNING state, waiting... Get a pipeline run with id=e3e1854e-ac6f-4bf9-96d1-cfc35445f4a1 Pipeline run with id=e3e1854e-ac6f-4bf9-96d1-cfc35445f4a1 is in RUNNING state, waiting... Get a pipeline run with id=e3e1854e-ac6f-4bf9-96d1-cfc35445f4a1 Pipeline run with id=e3e1854e-ac6f-4bf9-96d1-cfc35445f4a1 is in RUNNING state, waiting... Get a pipeline run with id=e3e1854e-ac6f-4bf9-96d1-cfc35445f4a1 Pipeline run with id=e3e1854e-ac6f-4bf9-96d1-cfc35445f4a1 is in RUNNING state, waiting... Get a pipeline run with id=e3e1854e-ac6f-4bf9-96d1-cfc35445f4a1 Pipeline run with id=e3e1854e-ac6f-4bf9-96d1-cfc35445f4a1 is in RUNNING state, waiting... Get a pipeline run with id=e3e1854e-ac6f-4bf9-96d1-cfc35445f4a1 Pipeline run with id=e3e1854e-ac6f-4bf9-96d1-cfc35445f4a1 is in RUNNING state, waiting... Get a pipeline run with id=e3e1854e-ac6f-4bf9-96d1-cfc35445f4a1 Pipeline run with id=e3e1854e-ac6f-4bf9-96d1-cfc35445f4a1 is in RUNNING state, waiting... Get a pipeline run with id=e3e1854e-ac6f-4bf9-96d1-cfc35445f4a1 Pipeline run with id=e3e1854e-ac6f-4bf9-96d1-cfc35445f4a1 is in RUNNING state, waiting... Get a pipeline run with id=e3e1854e-ac6f-4bf9-96d1-cfc35445f4a1 Pipeline run with id=e3e1854e-ac6f-4bf9-96d1-cfc35445f4a1 is in RUNNING state, waiting... Get a pipeline run with id=e3e1854e-ac6f-4bf9-96d1-cfc35445f4a1 Pipeline run with id=e3e1854e-ac6f-4bf9-96d1-cfc35445f4a1 is in RUNNING state, waiting... Get a pipeline run with id=e3e1854e-ac6f-4bf9-96d1-cfc35445f4a1 Pipeline run with id=e3e1854e-ac6f-4bf9-96d1-cfc35445f4a1 is in RUNNING state, waiting... Get a pipeline run with id=e3e1854e-ac6f-4bf9-96d1-cfc35445f4a1 Pipeline run with id=e3e1854e-ac6f-4bf9-96d1-cfc35445f4a1 reached expected state SUCCEEDED Deserializing expected compiled workflow file 'critical/parallel_for_after_dependency.yaml' for the pipeline Unmarshalling Expected Workflow YAML Unmarshalled Expected Workflow YAML Fetching updated pipeline run details for run with id=e3e1854e-ac6f-4bf9-96d1-cfc35445f4a1 Get a pipeline run with id=e3e1854e-ac6f-4bf9-96d1-cfc35445f4a1 Updated pipeline run details Pipeline run succeeded, checking if the number of tasks are what is expected < Exit [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/02/26 20:18:12.351 (1m35.5s) > Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/02/26 20:18:12.351 ################### Global Cleanup after each test ##################### Deleting 1 run(s) Terminate run e3e1854e-ac6f-4bf9-96d1-cfc35445f4a1 Failed to terminate run e3e1854e-ac6f-4bf9-96d1-cfc35445f4a1 Terminate run e3e1854e-ac6f-4bf9-96d1-cfc35445f4a1 Deleting run e3e1854e-ac6f-4bf9-96d1-cfc35445f4a1 Deleting 0 experiment(s) Deleting 1 pipeline(s) Deleting pipeline with id=7642b66f-c4f6-4157-bdb1-9451799558b0 (cascade=true) Pipeline with id=7642b66f-c4f6-4157-bdb1-9451799558b0, DELETED < Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/02/26 20:18:12.614 (263ms) > Enter [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/02/26 20:18:12.615 < Exit [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/02/26 20:18:12.615 (0s) > Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/02/26 20:18:12.615 < Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/02/26 20:18:12.615 (0s) 2026/07/02 20:18:17 Test passed > Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/02/26 20:16:36.218 Create an experiment with name E2EExperiment-1783023396218262256 < Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/02/26 20:16:36.487 (269ms) > Enter [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/02/26 20:16:36.487 ################### Setup before each Pipeline Upload test ##################### ################### Global Setup before each test ##################### Test Context: 0x42eaf700780 Looks like test-secret-1 already exists, because creation failed due to secrets "test-secret-1" already exists Looks like test-secret-2 already exists, because creation failed due to secrets "test-secret-2" already exists Looks like test-secret-3 already exists, because creation failed due to secrets "test-secret-3" already exists < Exit [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/02/26 20:16:36.806 (319ms) > Enter [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/02/26 20:16:36.806 Uploading pipeline file critical/pipeline_with_artifact_upload_download.yaml Creating temp pipeline file with overridden SDK Version Uploading pipeline with name=e2e-test-1783023396487328530, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml Upload of pipeline file 'critical/pipeline_with_artifact_upload_download.yaml' successful Listing pipeline versions for pipeline fa40a092-9224-4266-92e3-1d8e669a7993 Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml Returning pipeline run time inputs map[] Create run for pipeline with id: 'fa40a092-9224-4266-92e3-1d8e669a7993' and name: 'e2e-test-1783023396487328530' Create a pipeline run for pipeline with id=fa40a092-9224-4266-92e3-1d8e669a7993 and versionId=554d96fa-e330-4fb8-b823-c0a5edf4b9a0 Create a pipeline run body Created Pipeline Run successfully with runId=6af52a58-393d-4083-b024-2073bed3a5f5 Created Pipeline Run with id: 6af52a58-393d-4083-b024-2073bed3a5f5 for pipeline with id: fa40a092-9224-4266-92e3-1d8e669a7993 Waiting for pipeline run with id=6af52a58-393d-4083-b024-2073bed3a5f5 to be in one of '[SUCCEEDED SKIPPED FAILED CANCELED]' Get a pipeline run with id=6af52a58-393d-4083-b024-2073bed3a5f5 Pipeline run with id=6af52a58-393d-4083-b024-2073bed3a5f5 is in PENDING state, waiting... Get a pipeline run with id=6af52a58-393d-4083-b024-2073bed3a5f5 Pipeline run with id=6af52a58-393d-4083-b024-2073bed3a5f5 is in RUNNING state, waiting... Get a pipeline run with id=6af52a58-393d-4083-b024-2073bed3a5f5 Pipeline run with id=6af52a58-393d-4083-b024-2073bed3a5f5 is in RUNNING state, waiting... Get a pipeline run with id=6af52a58-393d-4083-b024-2073bed3a5f5 Pipeline run with id=6af52a58-393d-4083-b024-2073bed3a5f5 is in RUNNING state, waiting... Get a pipeline run with id=6af52a58-393d-4083-b024-2073bed3a5f5 Pipeline run with id=6af52a58-393d-4083-b024-2073bed3a5f5 is in RUNNING state, waiting... Get a pipeline run with id=6af52a58-393d-4083-b024-2073bed3a5f5 Pipeline run with id=6af52a58-393d-4083-b024-2073bed3a5f5 is in RUNNING state, waiting... Get a pipeline run with id=6af52a58-393d-4083-b024-2073bed3a5f5 Pipeline run with id=6af52a58-393d-4083-b024-2073bed3a5f5 is in RUNNING state, waiting... Get a pipeline run with id=6af52a58-393d-4083-b024-2073bed3a5f5 Pipeline run with id=6af52a58-393d-4083-b024-2073bed3a5f5 is in RUNNING state, waiting... Get a pipeline run with id=6af52a58-393d-4083-b024-2073bed3a5f5 Pipeline run with id=6af52a58-393d-4083-b024-2073bed3a5f5 is in RUNNING state, waiting... Get a pipeline run with id=6af52a58-393d-4083-b024-2073bed3a5f5 Pipeline run with id=6af52a58-393d-4083-b024-2073bed3a5f5 is in RUNNING state, waiting... Get a pipeline run with id=6af52a58-393d-4083-b024-2073bed3a5f5 Pipeline run with id=6af52a58-393d-4083-b024-2073bed3a5f5 is in RUNNING state, waiting... Get a pipeline run with id=6af52a58-393d-4083-b024-2073bed3a5f5 Pipeline run with id=6af52a58-393d-4083-b024-2073bed3a5f5 is in RUNNING state, waiting... Get a pipeline run with id=6af52a58-393d-4083-b024-2073bed3a5f5 Pipeline run with id=6af52a58-393d-4083-b024-2073bed3a5f5 is in RUNNING state, waiting... Get a pipeline run with id=6af52a58-393d-4083-b024-2073bed3a5f5 Pipeline run with id=6af52a58-393d-4083-b024-2073bed3a5f5 is in RUNNING state, waiting... Get a pipeline run with id=6af52a58-393d-4083-b024-2073bed3a5f5 Pipeline run with id=6af52a58-393d-4083-b024-2073bed3a5f5 is in RUNNING state, waiting... Get a pipeline run with id=6af52a58-393d-4083-b024-2073bed3a5f5 Pipeline run with id=6af52a58-393d-4083-b024-2073bed3a5f5 is in RUNNING state, waiting... Get a pipeline run with id=6af52a58-393d-4083-b024-2073bed3a5f5 Pipeline run with id=6af52a58-393d-4083-b024-2073bed3a5f5 is in RUNNING state, waiting... Get a pipeline run with id=6af52a58-393d-4083-b024-2073bed3a5f5 Pipeline run with id=6af52a58-393d-4083-b024-2073bed3a5f5 is in RUNNING state, waiting... Get a pipeline run with id=6af52a58-393d-4083-b024-2073bed3a5f5 Pipeline run with id=6af52a58-393d-4083-b024-2073bed3a5f5 is in RUNNING state, waiting... Get a pipeline run with id=6af52a58-393d-4083-b024-2073bed3a5f5 Pipeline run with id=6af52a58-393d-4083-b024-2073bed3a5f5 is in RUNNING state, waiting... Get a pipeline run with id=6af52a58-393d-4083-b024-2073bed3a5f5 Pipeline run with id=6af52a58-393d-4083-b024-2073bed3a5f5 reached expected state SUCCEEDED Deserializing expected compiled workflow file 'critical/pipeline_with_artifact_upload_download.yaml' for the pipeline Unmarshalling Expected Workflow YAML Unmarshalled Expected Workflow YAML Fetching updated pipeline run details for run with id=6af52a58-393d-4083-b024-2073bed3a5f5 Get a pipeline run with id=6af52a58-393d-4083-b024-2073bed3a5f5 Updated pipeline run details Pipeline run succeeded, checking if the number of tasks are what is expected < Exit [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/02/26 20:18:17.406 (1m40.6s) > Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/02/26 20:18:17.406 ################### Global Cleanup after each test ##################### Deleting 1 run(s) Terminate run 6af52a58-393d-4083-b024-2073bed3a5f5 Failed to terminate run 6af52a58-393d-4083-b024-2073bed3a5f5 Terminate run 6af52a58-393d-4083-b024-2073bed3a5f5 Deleting run 6af52a58-393d-4083-b024-2073bed3a5f5 Deleting 0 experiment(s) Deleting 1 pipeline(s) Deleting pipeline with id=fa40a092-9224-4266-92e3-1d8e669a7993 (cascade=true) Pipeline with id=fa40a092-9224-4266-92e3-1d8e669a7993, DELETED < Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/02/26 20:18:17.659 (252ms) > Enter [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/02/26 20:18:17.659 < Exit [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/02/26 20:18:17.659 (0s) > Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/02/26 20:18:17.659 < Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/02/26 20:18:17.659 (0s) 2026/07/02 20:18:47 Test passed > Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/02/26 20:16:36.218 Create an experiment with name E2EExperiment-1783023396218017971 < Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/02/26 20:16:36.478 (260ms) > Enter [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/02/26 20:16:36.478 ################### Setup before each Pipeline Upload test ##################### ################### Global Setup before each test ##################### Test Context: 0x1691fee86b00 test-secret-1 created test-secret-2 created test-secret-3 created < Exit [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/02/26 20:16:36.526 (47ms) > Enter [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/02/26 20:16:36.526 Uploading pipeline file critical/flip_coin.yaml Creating temp pipeline file with overridden SDK Version Uploading pipeline with name=e2e-test-1783023396478782046, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml Upload of pipeline file 'critical/flip_coin.yaml' successful Listing pipeline versions for pipeline a4545a97-c57b-4c0f-b762-069dd42b5dd6 Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml Returning pipeline run time inputs map[] Create run for pipeline with id: 'a4545a97-c57b-4c0f-b762-069dd42b5dd6' and name: 'e2e-test-1783023396478782046' Create a pipeline run for pipeline with id=a4545a97-c57b-4c0f-b762-069dd42b5dd6 and versionId=788d4a22-2ac8-4d5c-b217-d8349ecd0e36 Create a pipeline run body Created Pipeline Run successfully with runId=9493875f-4346-42f6-94cf-30b54064c17f Created Pipeline Run with id: 9493875f-4346-42f6-94cf-30b54064c17f for pipeline with id: a4545a97-c57b-4c0f-b762-069dd42b5dd6 Waiting for pipeline run with id=9493875f-4346-42f6-94cf-30b54064c17f to be in one of '[SUCCEEDED SKIPPED FAILED CANCELED]' Get a pipeline run with id=9493875f-4346-42f6-94cf-30b54064c17f Pipeline run with id=9493875f-4346-42f6-94cf-30b54064c17f is in PENDING state, waiting... Get a pipeline run with id=9493875f-4346-42f6-94cf-30b54064c17f Pipeline run with id=9493875f-4346-42f6-94cf-30b54064c17f is in RUNNING state, waiting... Get a pipeline run with id=9493875f-4346-42f6-94cf-30b54064c17f Pipeline run with id=9493875f-4346-42f6-94cf-30b54064c17f is in RUNNING state, waiting... Get a pipeline run with id=9493875f-4346-42f6-94cf-30b54064c17f Pipeline run with id=9493875f-4346-42f6-94cf-30b54064c17f is in RUNNING state, waiting... Get a pipeline run with id=9493875f-4346-42f6-94cf-30b54064c17f Pipeline run with id=9493875f-4346-42f6-94cf-30b54064c17f is in RUNNING state, waiting... Get a pipeline run with id=9493875f-4346-42f6-94cf-30b54064c17f Pipeline run with id=9493875f-4346-42f6-94cf-30b54064c17f is in RUNNING state, waiting... Get a pipeline run with id=9493875f-4346-42f6-94cf-30b54064c17f Pipeline run with id=9493875f-4346-42f6-94cf-30b54064c17f is in RUNNING state, waiting... Get a pipeline run with id=9493875f-4346-42f6-94cf-30b54064c17f Pipeline run with id=9493875f-4346-42f6-94cf-30b54064c17f is in RUNNING state, waiting... Get a pipeline run with id=9493875f-4346-42f6-94cf-30b54064c17f Pipeline run with id=9493875f-4346-42f6-94cf-30b54064c17f is in RUNNING state, waiting... Get a pipeline run with id=9493875f-4346-42f6-94cf-30b54064c17f Pipeline run with id=9493875f-4346-42f6-94cf-30b54064c17f is in RUNNING state, waiting... Get a pipeline run with id=9493875f-4346-42f6-94cf-30b54064c17f Pipeline run with id=9493875f-4346-42f6-94cf-30b54064c17f is in RUNNING state, waiting... Get a pipeline run with id=9493875f-4346-42f6-94cf-30b54064c17f Pipeline run with id=9493875f-4346-42f6-94cf-30b54064c17f is in RUNNING state, waiting... Get a pipeline run with id=9493875f-4346-42f6-94cf-30b54064c17f Pipeline run with id=9493875f-4346-42f6-94cf-30b54064c17f is in RUNNING state, waiting... Get a pipeline run with id=9493875f-4346-42f6-94cf-30b54064c17f Pipeline run with id=9493875f-4346-42f6-94cf-30b54064c17f is in RUNNING state, waiting... Get a pipeline run with id=9493875f-4346-42f6-94cf-30b54064c17f Pipeline run with id=9493875f-4346-42f6-94cf-30b54064c17f is in RUNNING state, waiting... Get a pipeline run with id=9493875f-4346-42f6-94cf-30b54064c17f Pipeline run with id=9493875f-4346-42f6-94cf-30b54064c17f is in RUNNING state, waiting... Get a pipeline run with id=9493875f-4346-42f6-94cf-30b54064c17f Pipeline run with id=9493875f-4346-42f6-94cf-30b54064c17f is in RUNNING state, waiting... Get a pipeline run with id=9493875f-4346-42f6-94cf-30b54064c17f Pipeline run with id=9493875f-4346-42f6-94cf-30b54064c17f is in RUNNING state, waiting... Get a pipeline run with id=9493875f-4346-42f6-94cf-30b54064c17f Pipeline run with id=9493875f-4346-42f6-94cf-30b54064c17f is in RUNNING state, waiting... Get a pipeline run with id=9493875f-4346-42f6-94cf-30b54064c17f Pipeline run with id=9493875f-4346-42f6-94cf-30b54064c17f is in RUNNING state, waiting... Get a pipeline run with id=9493875f-4346-42f6-94cf-30b54064c17f Pipeline run with id=9493875f-4346-42f6-94cf-30b54064c17f is in RUNNING state, waiting... Get a pipeline run with id=9493875f-4346-42f6-94cf-30b54064c17f Pipeline run with id=9493875f-4346-42f6-94cf-30b54064c17f is in RUNNING state, waiting... Get a pipeline run with id=9493875f-4346-42f6-94cf-30b54064c17f Pipeline run with id=9493875f-4346-42f6-94cf-30b54064c17f is in RUNNING state, waiting... Get a pipeline run with id=9493875f-4346-42f6-94cf-30b54064c17f Pipeline run with id=9493875f-4346-42f6-94cf-30b54064c17f is in RUNNING state, waiting... Get a pipeline run with id=9493875f-4346-42f6-94cf-30b54064c17f Pipeline run with id=9493875f-4346-42f6-94cf-30b54064c17f is in RUNNING state, waiting... Get a pipeline run with id=9493875f-4346-42f6-94cf-30b54064c17f Pipeline run with id=9493875f-4346-42f6-94cf-30b54064c17f is in RUNNING state, waiting... Get a pipeline run with id=9493875f-4346-42f6-94cf-30b54064c17f Pipeline run with id=9493875f-4346-42f6-94cf-30b54064c17f reached expected state SUCCEEDED Deserializing expected compiled workflow file 'critical/flip_coin.yaml' for the pipeline Unmarshalling Expected Workflow YAML Unmarshalled Expected Workflow YAML Fetching updated pipeline run details for run with id=9493875f-4346-42f6-94cf-30b54064c17f Get a pipeline run with id=9493875f-4346-42f6-94cf-30b54064c17f Updated pipeline run details Pipeline run succeeded, checking if the number of tasks are what is expected < Exit [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/02/26 20:18:47.212 (2m10.686s) > Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/02/26 20:18:47.212 ################### Global Cleanup after each test ##################### Deleting 1 run(s) Terminate run 9493875f-4346-42f6-94cf-30b54064c17f Failed to terminate run 9493875f-4346-42f6-94cf-30b54064c17f Terminate run 9493875f-4346-42f6-94cf-30b54064c17f Deleting run 9493875f-4346-42f6-94cf-30b54064c17f Deleting 0 experiment(s) Deleting 1 pipeline(s) Deleting pipeline with id=a4545a97-c57b-4c0f-b762-069dd42b5dd6 (cascade=true) Pipeline with id=a4545a97-c57b-4c0f-b762-069dd42b5dd6, DELETED < Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/02/26 20:18:47.475 (263ms) > Enter [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/02/26 20:18:47.475 < Exit [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/02/26 20:18:47.475 (0s) > Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/02/26 20:18:47.475 < Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/02/26 20:18:47.475 (0s) 2026/07/02 20:19:12 Test passed > Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/02/26 20:16:36.218 Create an experiment with name E2EExperiment-1783023396218672874 < Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/02/26 20:16:36.485 (267ms) > Enter [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/02/26 20:16:36.486 ################### Setup before each Pipeline Upload test ##################### ################### Global Setup before each test ##################### Test Context: 0x1f97131d2200 Looks like test-secret-1 already exists, because creation failed due to secrets "test-secret-1" already exists Looks like test-secret-2 already exists, because creation failed due to secrets "test-secret-2" already exists Looks like test-secret-3 already exists, because creation failed due to secrets "test-secret-3" already exists < Exit [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/02/26 20:16:36.582 (97ms) > Enter [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/02/26 20:16:36.582 Uploading pipeline file essential/iris_pipeline_compiled.yaml Creating temp pipeline file with overridden SDK Version Uploading pipeline with name=e2e-test-1783023396486130234, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml Upload of pipeline file 'essential/iris_pipeline_compiled.yaml' successful Listing pipeline versions for pipeline 38cb6025-8456-438f-827c-62ec56dcd7dd Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml Returning pipeline run time inputs map[] Create run for pipeline with id: '38cb6025-8456-438f-827c-62ec56dcd7dd' and name: 'e2e-test-1783023396486130234' Create a pipeline run for pipeline with id=38cb6025-8456-438f-827c-62ec56dcd7dd and versionId=535bc8c7-980b-427c-8867-d312c9e0dace Create a pipeline run body Created Pipeline Run successfully with runId=82173af7-9671-4a83-b897-e6a52f97438c Created Pipeline Run with id: 82173af7-9671-4a83-b897-e6a52f97438c for pipeline with id: 38cb6025-8456-438f-827c-62ec56dcd7dd Waiting for pipeline run with id=82173af7-9671-4a83-b897-e6a52f97438c to be in one of '[SUCCEEDED SKIPPED FAILED CANCELED]' Get a pipeline run with id=82173af7-9671-4a83-b897-e6a52f97438c Pipeline run with id=82173af7-9671-4a83-b897-e6a52f97438c is in PENDING state, waiting... Get a pipeline run with id=82173af7-9671-4a83-b897-e6a52f97438c Pipeline run with id=82173af7-9671-4a83-b897-e6a52f97438c is in RUNNING state, waiting... Get a pipeline run with id=82173af7-9671-4a83-b897-e6a52f97438c Pipeline run with id=82173af7-9671-4a83-b897-e6a52f97438c is in RUNNING state, waiting... Get a pipeline run with id=82173af7-9671-4a83-b897-e6a52f97438c Pipeline run with id=82173af7-9671-4a83-b897-e6a52f97438c is in RUNNING state, waiting... Get a pipeline run with id=82173af7-9671-4a83-b897-e6a52f97438c Pipeline run with id=82173af7-9671-4a83-b897-e6a52f97438c is in RUNNING state, waiting... Get a pipeline run with id=82173af7-9671-4a83-b897-e6a52f97438c Pipeline run with id=82173af7-9671-4a83-b897-e6a52f97438c is in RUNNING state, waiting... Get a pipeline run with id=82173af7-9671-4a83-b897-e6a52f97438c Pipeline run with id=82173af7-9671-4a83-b897-e6a52f97438c is in RUNNING state, waiting... Get a pipeline run with id=82173af7-9671-4a83-b897-e6a52f97438c Pipeline run with id=82173af7-9671-4a83-b897-e6a52f97438c is in RUNNING state, waiting... Get a pipeline run with id=82173af7-9671-4a83-b897-e6a52f97438c Pipeline run with id=82173af7-9671-4a83-b897-e6a52f97438c is in RUNNING state, waiting... Get a pipeline run with id=82173af7-9671-4a83-b897-e6a52f97438c Pipeline run with id=82173af7-9671-4a83-b897-e6a52f97438c is in RUNNING state, waiting... Get a pipeline run with id=82173af7-9671-4a83-b897-e6a52f97438c Pipeline run with id=82173af7-9671-4a83-b897-e6a52f97438c is in RUNNING state, waiting... Get a pipeline run with id=82173af7-9671-4a83-b897-e6a52f97438c Pipeline run with id=82173af7-9671-4a83-b897-e6a52f97438c is in RUNNING state, waiting... Get a pipeline run with id=82173af7-9671-4a83-b897-e6a52f97438c Pipeline run with id=82173af7-9671-4a83-b897-e6a52f97438c is in RUNNING state, waiting... Get a pipeline run with id=82173af7-9671-4a83-b897-e6a52f97438c Pipeline run with id=82173af7-9671-4a83-b897-e6a52f97438c is in RUNNING state, waiting... Get a pipeline run with id=82173af7-9671-4a83-b897-e6a52f97438c Pipeline run with id=82173af7-9671-4a83-b897-e6a52f97438c is in RUNNING state, waiting... Get a pipeline run with id=82173af7-9671-4a83-b897-e6a52f97438c Pipeline run with id=82173af7-9671-4a83-b897-e6a52f97438c is in RUNNING state, waiting... Get a pipeline run with id=82173af7-9671-4a83-b897-e6a52f97438c Pipeline run with id=82173af7-9671-4a83-b897-e6a52f97438c is in RUNNING state, waiting... Get a pipeline run with id=82173af7-9671-4a83-b897-e6a52f97438c Pipeline run with id=82173af7-9671-4a83-b897-e6a52f97438c is in RUNNING state, waiting... Get a pipeline run with id=82173af7-9671-4a83-b897-e6a52f97438c Pipeline run with id=82173af7-9671-4a83-b897-e6a52f97438c is in RUNNING state, waiting... Get a pipeline run with id=82173af7-9671-4a83-b897-e6a52f97438c Pipeline run with id=82173af7-9671-4a83-b897-e6a52f97438c is in RUNNING state, waiting... Get a pipeline run with id=82173af7-9671-4a83-b897-e6a52f97438c Pipeline run with id=82173af7-9671-4a83-b897-e6a52f97438c is in RUNNING state, waiting... Get a pipeline run with id=82173af7-9671-4a83-b897-e6a52f97438c Pipeline run with id=82173af7-9671-4a83-b897-e6a52f97438c is in RUNNING state, waiting... Get a pipeline run with id=82173af7-9671-4a83-b897-e6a52f97438c Pipeline run with id=82173af7-9671-4a83-b897-e6a52f97438c is in RUNNING state, waiting... Get a pipeline run with id=82173af7-9671-4a83-b897-e6a52f97438c Pipeline run with id=82173af7-9671-4a83-b897-e6a52f97438c is in RUNNING state, waiting... Get a pipeline run with id=82173af7-9671-4a83-b897-e6a52f97438c Pipeline run with id=82173af7-9671-4a83-b897-e6a52f97438c is in RUNNING state, waiting... Get a pipeline run with id=82173af7-9671-4a83-b897-e6a52f97438c Pipeline run with id=82173af7-9671-4a83-b897-e6a52f97438c is in RUNNING state, waiting... Get a pipeline run with id=82173af7-9671-4a83-b897-e6a52f97438c Pipeline run with id=82173af7-9671-4a83-b897-e6a52f97438c is in RUNNING state, waiting... Get a pipeline run with id=82173af7-9671-4a83-b897-e6a52f97438c Pipeline run with id=82173af7-9671-4a83-b897-e6a52f97438c is in RUNNING state, waiting... Get a pipeline run with id=82173af7-9671-4a83-b897-e6a52f97438c Pipeline run with id=82173af7-9671-4a83-b897-e6a52f97438c is in RUNNING state, waiting... Get a pipeline run with id=82173af7-9671-4a83-b897-e6a52f97438c Pipeline run with id=82173af7-9671-4a83-b897-e6a52f97438c is in RUNNING state, waiting... Get a pipeline run with id=82173af7-9671-4a83-b897-e6a52f97438c Pipeline run with id=82173af7-9671-4a83-b897-e6a52f97438c is in RUNNING state, waiting... Get a pipeline run with id=82173af7-9671-4a83-b897-e6a52f97438c Pipeline run with id=82173af7-9671-4a83-b897-e6a52f97438c reached expected state SUCCEEDED Deserializing expected compiled workflow file 'essential/iris_pipeline_compiled.yaml' for the pipeline Unmarshalling Expected Workflow YAML Unmarshalled Expected Workflow YAML Fetching updated pipeline run details for run with id=82173af7-9671-4a83-b897-e6a52f97438c Get a pipeline run with id=82173af7-9671-4a83-b897-e6a52f97438c Updated pipeline run details Pipeline run succeeded, checking if the number of tasks are what is expected < Exit [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/02/26 20:19:12.179 (2m35.597s) > Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/02/26 20:19:12.179 ################### Global Cleanup after each test ##################### Deleting 1 run(s) Terminate run 82173af7-9671-4a83-b897-e6a52f97438c Failed to terminate run 82173af7-9671-4a83-b897-e6a52f97438c Terminate run 82173af7-9671-4a83-b897-e6a52f97438c Deleting run 82173af7-9671-4a83-b897-e6a52f97438c Deleting 0 experiment(s) Deleting 1 pipeline(s) Deleting pipeline with id=38cb6025-8456-438f-827c-62ec56dcd7dd (cascade=true) Pipeline with id=38cb6025-8456-438f-827c-62ec56dcd7dd, DELETED < Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/02/26 20:19:12.456 (277ms) > Enter [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/02/26 20:19:12.456 < Exit [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/02/26 20:19:12.456 (0s) > Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/02/26 20:19:12.456 < Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/02/26 20:19:12.456 (0s)