2026/07/05 18:31:04 Test passed > Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/05/26 18:30:18.654 Create an experiment with name E2EExperiment-1783276218654775649 < Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/05/26 18:30:18.885 (231ms) > Enter [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/05/26 18:30:18.886 ################### Setup before each Pipeline Upload test ##################### ################### Global Setup before each test ##################### Test Context: 0x1529a47e6d00 Looks like test-secret-1 already exists, because creation failed due to secrets "test-secret-1" already exists Looks like test-secret-2 already exists, because creation failed due to secrets "test-secret-2" already exists Looks like test-secret-3 already exists, because creation failed due to secrets "test-secret-3" already exists < Exit [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/05/26 18:30:18.97 (84ms) > Enter [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/05/26 18:30:18.97 Uploading pipeline file essential/component_with_pip_index_urls.yaml Creating temp pipeline file with overridden SDK Version Uploading pipeline with name=e2e-test-1783276218886224596, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml Upload of pipeline file 'essential/component_with_pip_index_urls.yaml' successful Listing pipeline versions for pipeline 16d17627-64ce-4a26-b12f-dc68176b1ad8 Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml Returning pipeline run time inputs map[] Create run for pipeline with id: '16d17627-64ce-4a26-b12f-dc68176b1ad8' and name: 'e2e-test-1783276218886224596' Create a pipeline run for pipeline with id=16d17627-64ce-4a26-b12f-dc68176b1ad8 and versionId=12489941-e753-4b5f-b02e-bcbf27fcbdd4 Create a pipeline run body Created Pipeline Run successfully with runId=876a70c6-e21e-4072-b780-d700460d1141 Created Pipeline Run with id: 876a70c6-e21e-4072-b780-d700460d1141 for pipeline with id: 16d17627-64ce-4a26-b12f-dc68176b1ad8 Waiting for pipeline run with id=876a70c6-e21e-4072-b780-d700460d1141 to be in one of '[SUCCEEDED SKIPPED FAILED CANCELED]' Get a pipeline run with id=876a70c6-e21e-4072-b780-d700460d1141 Pipeline run with id=876a70c6-e21e-4072-b780-d700460d1141 is in PENDING state, waiting... Get a pipeline run with id=876a70c6-e21e-4072-b780-d700460d1141 Pipeline run with id=876a70c6-e21e-4072-b780-d700460d1141 is in RUNNING state, waiting... Get a pipeline run with id=876a70c6-e21e-4072-b780-d700460d1141 Pipeline run with id=876a70c6-e21e-4072-b780-d700460d1141 is in RUNNING state, waiting... Get a pipeline run with id=876a70c6-e21e-4072-b780-d700460d1141 Pipeline run with id=876a70c6-e21e-4072-b780-d700460d1141 is in RUNNING state, waiting... Get a pipeline run with id=876a70c6-e21e-4072-b780-d700460d1141 Pipeline run with id=876a70c6-e21e-4072-b780-d700460d1141 is in RUNNING state, waiting... Get a pipeline run with id=876a70c6-e21e-4072-b780-d700460d1141 Pipeline run with id=876a70c6-e21e-4072-b780-d700460d1141 is in RUNNING state, waiting... Get a pipeline run with id=876a70c6-e21e-4072-b780-d700460d1141 Pipeline run with id=876a70c6-e21e-4072-b780-d700460d1141 is in RUNNING state, waiting... Get a pipeline run with id=876a70c6-e21e-4072-b780-d700460d1141 Pipeline run with id=876a70c6-e21e-4072-b780-d700460d1141 is in RUNNING state, waiting... Get a pipeline run with id=876a70c6-e21e-4072-b780-d700460d1141 Pipeline run with id=876a70c6-e21e-4072-b780-d700460d1141 is in RUNNING state, waiting... Get a pipeline run with id=876a70c6-e21e-4072-b780-d700460d1141 Pipeline run with id=876a70c6-e21e-4072-b780-d700460d1141 reached expected state SUCCEEDED Deserializing expected compiled workflow file 'essential/component_with_pip_index_urls.yaml' for the pipeline Unmarshalling Expected Workflow YAML Unmarshalled Expected Workflow YAML Fetching updated pipeline run details for run with id=876a70c6-e21e-4072-b780-d700460d1141 Get a pipeline run with id=876a70c6-e21e-4072-b780-d700460d1141 Updated pipeline run details Pipeline run succeeded, checking if the number of tasks are what is expected < Exit [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/05/26 18:31:04.482 (45.512s) > Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/05/26 18:31:04.482 ################### Global Cleanup after each test ##################### Deleting 1 run(s) Terminate run 876a70c6-e21e-4072-b780-d700460d1141 Failed to terminate run 876a70c6-e21e-4072-b780-d700460d1141 Terminate run 876a70c6-e21e-4072-b780-d700460d1141 Deleting run 876a70c6-e21e-4072-b780-d700460d1141 Deleting 0 experiment(s) Deleting 1 pipeline(s) Deleting pipeline with id=16d17627-64ce-4a26-b12f-dc68176b1ad8 (cascade=true) Pipeline with id=16d17627-64ce-4a26-b12f-dc68176b1ad8, DELETED < Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/05/26 18:31:04.709 (227ms) > Enter [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/05/26 18:31:04.709 < Exit [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/05/26 18:31:04.709 (0s) > Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/05/26 18:31:04.709 < Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/05/26 18:31:04.709 (0s) 2026/07/05 18:31:54 Test passed > Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/05/26 18:30:18.654 Create an experiment with name E2EExperiment-1783276218654416404 < Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/05/26 18:30:18.885 (231ms) > Enter [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/05/26 18:30:18.885 ################### Setup before each Pipeline Upload test ##################### ################### Global Setup before each test ##################### Test Context: 0x4dd1e82380 Looks like test-secret-1 already exists, because creation failed due to secrets "test-secret-1" already exists Looks like test-secret-2 already exists, because creation failed due to secrets "test-secret-2" already exists Looks like test-secret-3 already exists, because creation failed due to secrets "test-secret-3" already exists < Exit [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/05/26 18:30:18.971 (86ms) > Enter [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/05/26 18:30:18.971 Uploading pipeline file critical/parallel_for_after_dependency.yaml Creating temp pipeline file with overridden SDK Version Uploading pipeline with name=e2e-test-1783276218885771301, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml Upload of pipeline file 'critical/parallel_for_after_dependency.yaml' successful Listing pipeline versions for pipeline c93b117c-2f08-4b7c-8b7a-abb95141f1ce Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml Returning pipeline run time inputs map[] Create run for pipeline with id: 'c93b117c-2f08-4b7c-8b7a-abb95141f1ce' and name: 'e2e-test-1783276218885771301' Create a pipeline run for pipeline with id=c93b117c-2f08-4b7c-8b7a-abb95141f1ce and versionId=f6f65a39-b1e0-4915-888c-541f212d4662 Create a pipeline run body Created Pipeline Run successfully with runId=6844cc25-f5fa-47e0-b3aa-02373d7f3286 Created Pipeline Run with id: 6844cc25-f5fa-47e0-b3aa-02373d7f3286 for pipeline with id: c93b117c-2f08-4b7c-8b7a-abb95141f1ce Waiting for pipeline run with id=6844cc25-f5fa-47e0-b3aa-02373d7f3286 to be in one of '[SUCCEEDED SKIPPED FAILED CANCELED]' Get a pipeline run with id=6844cc25-f5fa-47e0-b3aa-02373d7f3286 Pipeline run with id=6844cc25-f5fa-47e0-b3aa-02373d7f3286 is in PENDING state, waiting... Get a pipeline run with id=6844cc25-f5fa-47e0-b3aa-02373d7f3286 Pipeline run with id=6844cc25-f5fa-47e0-b3aa-02373d7f3286 is in RUNNING state, waiting... Get a pipeline run with id=6844cc25-f5fa-47e0-b3aa-02373d7f3286 Pipeline run with id=6844cc25-f5fa-47e0-b3aa-02373d7f3286 is in RUNNING state, waiting... Get a pipeline run with id=6844cc25-f5fa-47e0-b3aa-02373d7f3286 Pipeline run with id=6844cc25-f5fa-47e0-b3aa-02373d7f3286 is in RUNNING state, waiting... Get a pipeline run with id=6844cc25-f5fa-47e0-b3aa-02373d7f3286 Pipeline run with id=6844cc25-f5fa-47e0-b3aa-02373d7f3286 is in RUNNING state, waiting... Get a pipeline run with id=6844cc25-f5fa-47e0-b3aa-02373d7f3286 Pipeline run with id=6844cc25-f5fa-47e0-b3aa-02373d7f3286 is in RUNNING state, waiting... Get a pipeline run with id=6844cc25-f5fa-47e0-b3aa-02373d7f3286 Pipeline run with id=6844cc25-f5fa-47e0-b3aa-02373d7f3286 is in RUNNING state, waiting... Get a pipeline run with id=6844cc25-f5fa-47e0-b3aa-02373d7f3286 Pipeline run with id=6844cc25-f5fa-47e0-b3aa-02373d7f3286 is in RUNNING state, waiting... Get a pipeline run with id=6844cc25-f5fa-47e0-b3aa-02373d7f3286 Pipeline run with id=6844cc25-f5fa-47e0-b3aa-02373d7f3286 is in RUNNING state, waiting... Get a pipeline run with id=6844cc25-f5fa-47e0-b3aa-02373d7f3286 Pipeline run with id=6844cc25-f5fa-47e0-b3aa-02373d7f3286 is in RUNNING state, waiting... Get a pipeline run with id=6844cc25-f5fa-47e0-b3aa-02373d7f3286 Pipeline run with id=6844cc25-f5fa-47e0-b3aa-02373d7f3286 is in RUNNING state, waiting... Get a pipeline run with id=6844cc25-f5fa-47e0-b3aa-02373d7f3286 Pipeline run with id=6844cc25-f5fa-47e0-b3aa-02373d7f3286 is in RUNNING state, waiting... Get a pipeline run with id=6844cc25-f5fa-47e0-b3aa-02373d7f3286 Pipeline run with id=6844cc25-f5fa-47e0-b3aa-02373d7f3286 is in RUNNING state, waiting... Get a pipeline run with id=6844cc25-f5fa-47e0-b3aa-02373d7f3286 Pipeline run with id=6844cc25-f5fa-47e0-b3aa-02373d7f3286 is in RUNNING state, waiting... Get a pipeline run with id=6844cc25-f5fa-47e0-b3aa-02373d7f3286 Pipeline run with id=6844cc25-f5fa-47e0-b3aa-02373d7f3286 is in RUNNING state, waiting... Get a pipeline run with id=6844cc25-f5fa-47e0-b3aa-02373d7f3286 Pipeline run with id=6844cc25-f5fa-47e0-b3aa-02373d7f3286 is in RUNNING state, waiting... Get a pipeline run with id=6844cc25-f5fa-47e0-b3aa-02373d7f3286 Pipeline run with id=6844cc25-f5fa-47e0-b3aa-02373d7f3286 is in RUNNING state, waiting... Get a pipeline run with id=6844cc25-f5fa-47e0-b3aa-02373d7f3286 Pipeline run with id=6844cc25-f5fa-47e0-b3aa-02373d7f3286 is in RUNNING state, waiting... Get a pipeline run with id=6844cc25-f5fa-47e0-b3aa-02373d7f3286 Pipeline run with id=6844cc25-f5fa-47e0-b3aa-02373d7f3286 is in RUNNING state, waiting... Get a pipeline run with id=6844cc25-f5fa-47e0-b3aa-02373d7f3286 Pipeline run with id=6844cc25-f5fa-47e0-b3aa-02373d7f3286 reached expected state SUCCEEDED Deserializing expected compiled workflow file 'critical/parallel_for_after_dependency.yaml' for the pipeline Unmarshalling Expected Workflow YAML Unmarshalled Expected Workflow YAML Fetching updated pipeline run details for run with id=6844cc25-f5fa-47e0-b3aa-02373d7f3286 Get a pipeline run with id=6844cc25-f5fa-47e0-b3aa-02373d7f3286 Updated pipeline run details Pipeline run succeeded, checking if the number of tasks are what is expected < Exit [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/05/26 18:31:54.664 (1m35.693s) > Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/05/26 18:31:54.665 ################### Global Cleanup after each test ##################### Deleting 1 run(s) Terminate run 6844cc25-f5fa-47e0-b3aa-02373d7f3286 Failed to terminate run 6844cc25-f5fa-47e0-b3aa-02373d7f3286 Terminate run 6844cc25-f5fa-47e0-b3aa-02373d7f3286 Deleting run 6844cc25-f5fa-47e0-b3aa-02373d7f3286 Deleting 0 experiment(s) Deleting 1 pipeline(s) Deleting pipeline with id=c93b117c-2f08-4b7c-8b7a-abb95141f1ce (cascade=true) Pipeline with id=c93b117c-2f08-4b7c-8b7a-abb95141f1ce, DELETED < Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/05/26 18:31:54.966 (302ms) > Enter [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/05/26 18:31:54.967 < Exit [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/05/26 18:31:54.967 (0s) > Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/05/26 18:31:54.967 < Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/05/26 18:31:54.967 (0s) 2026/07/05 18:31:59 Test passed > Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/05/26 18:30:18.654 Create an experiment with name E2EExperiment-1783276218654540836 < Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/05/26 18:30:18.882 (228ms) > Enter [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/05/26 18:30:18.882 ################### Setup before each Pipeline Upload test ##################### ################### Global Setup before each test ##################### Test Context: 0x2cddc11ae180 Looks like test-secret-1 already exists, because creation failed due to secrets "test-secret-1" already exists Looks like test-secret-2 already exists, because creation failed due to secrets "test-secret-2" already exists Looks like test-secret-3 already exists, because creation failed due to secrets "test-secret-3" already exists < Exit [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/05/26 18:30:18.972 (90ms) > Enter [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/05/26 18:30:18.972 Uploading pipeline file critical/pipeline_with_artifact_upload_download.yaml Creating temp pipeline file with overridden SDK Version Uploading pipeline with name=e2e-test-1783276218882772693, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml Upload of pipeline file 'critical/pipeline_with_artifact_upload_download.yaml' successful Listing pipeline versions for pipeline f538173b-1623-495c-8021-3f3594c891e1 Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml Returning pipeline run time inputs map[] Create run for pipeline with id: 'f538173b-1623-495c-8021-3f3594c891e1' and name: 'e2e-test-1783276218882772693' Create a pipeline run for pipeline with id=f538173b-1623-495c-8021-3f3594c891e1 and versionId=95185267-cfda-4f7a-8535-cb180af8a257 Create a pipeline run body Created Pipeline Run successfully with runId=c8811e82-7417-4e82-a27f-3ff9384a7200 Created Pipeline Run with id: c8811e82-7417-4e82-a27f-3ff9384a7200 for pipeline with id: f538173b-1623-495c-8021-3f3594c891e1 Waiting for pipeline run with id=c8811e82-7417-4e82-a27f-3ff9384a7200 to be in one of '[SUCCEEDED SKIPPED FAILED CANCELED]' Get a pipeline run with id=c8811e82-7417-4e82-a27f-3ff9384a7200 Pipeline run with id=c8811e82-7417-4e82-a27f-3ff9384a7200 is in PENDING state, waiting... Get a pipeline run with id=c8811e82-7417-4e82-a27f-3ff9384a7200 Pipeline run with id=c8811e82-7417-4e82-a27f-3ff9384a7200 is in RUNNING state, waiting... Get a pipeline run with id=c8811e82-7417-4e82-a27f-3ff9384a7200 Pipeline run with id=c8811e82-7417-4e82-a27f-3ff9384a7200 is in RUNNING state, waiting... Get a pipeline run with id=c8811e82-7417-4e82-a27f-3ff9384a7200 Pipeline run with id=c8811e82-7417-4e82-a27f-3ff9384a7200 is in RUNNING state, waiting... Get a pipeline run with id=c8811e82-7417-4e82-a27f-3ff9384a7200 Pipeline run with id=c8811e82-7417-4e82-a27f-3ff9384a7200 is in RUNNING state, waiting... Get a pipeline run with id=c8811e82-7417-4e82-a27f-3ff9384a7200 Pipeline run with id=c8811e82-7417-4e82-a27f-3ff9384a7200 is in RUNNING state, waiting... Get a pipeline run with id=c8811e82-7417-4e82-a27f-3ff9384a7200 Pipeline run with id=c8811e82-7417-4e82-a27f-3ff9384a7200 is in RUNNING state, waiting... Get a pipeline run with id=c8811e82-7417-4e82-a27f-3ff9384a7200 Pipeline run with id=c8811e82-7417-4e82-a27f-3ff9384a7200 is in RUNNING state, waiting... Get a pipeline run with id=c8811e82-7417-4e82-a27f-3ff9384a7200 Pipeline run with id=c8811e82-7417-4e82-a27f-3ff9384a7200 is in RUNNING state, waiting... Get a pipeline run with id=c8811e82-7417-4e82-a27f-3ff9384a7200 Pipeline run with id=c8811e82-7417-4e82-a27f-3ff9384a7200 is in RUNNING state, waiting... Get a pipeline run with id=c8811e82-7417-4e82-a27f-3ff9384a7200 Pipeline run with id=c8811e82-7417-4e82-a27f-3ff9384a7200 is in RUNNING state, waiting... Get a pipeline run with id=c8811e82-7417-4e82-a27f-3ff9384a7200 Pipeline run with id=c8811e82-7417-4e82-a27f-3ff9384a7200 is in RUNNING state, waiting... Get a pipeline run with id=c8811e82-7417-4e82-a27f-3ff9384a7200 Pipeline run with id=c8811e82-7417-4e82-a27f-3ff9384a7200 is in RUNNING state, waiting... Get a pipeline run with id=c8811e82-7417-4e82-a27f-3ff9384a7200 Pipeline run with id=c8811e82-7417-4e82-a27f-3ff9384a7200 is in RUNNING state, waiting... Get a pipeline run with id=c8811e82-7417-4e82-a27f-3ff9384a7200 Pipeline run with id=c8811e82-7417-4e82-a27f-3ff9384a7200 is in RUNNING state, waiting... Get a pipeline run with id=c8811e82-7417-4e82-a27f-3ff9384a7200 Pipeline run with id=c8811e82-7417-4e82-a27f-3ff9384a7200 is in RUNNING state, waiting... Get a pipeline run with id=c8811e82-7417-4e82-a27f-3ff9384a7200 Pipeline run with id=c8811e82-7417-4e82-a27f-3ff9384a7200 is in RUNNING state, waiting... Get a pipeline run with id=c8811e82-7417-4e82-a27f-3ff9384a7200 Pipeline run with id=c8811e82-7417-4e82-a27f-3ff9384a7200 is in RUNNING state, waiting... Get a pipeline run with id=c8811e82-7417-4e82-a27f-3ff9384a7200 Pipeline run with id=c8811e82-7417-4e82-a27f-3ff9384a7200 is in RUNNING state, waiting... Get a pipeline run with id=c8811e82-7417-4e82-a27f-3ff9384a7200 Pipeline run with id=c8811e82-7417-4e82-a27f-3ff9384a7200 is in RUNNING state, waiting... Get a pipeline run with id=c8811e82-7417-4e82-a27f-3ff9384a7200 Pipeline run with id=c8811e82-7417-4e82-a27f-3ff9384a7200 reached expected state SUCCEEDED Deserializing expected compiled workflow file 'critical/pipeline_with_artifact_upload_download.yaml' for the pipeline Unmarshalling Expected Workflow YAML Unmarshalled Expected Workflow YAML Fetching updated pipeline run details for run with id=c8811e82-7417-4e82-a27f-3ff9384a7200 Get a pipeline run with id=c8811e82-7417-4e82-a27f-3ff9384a7200 Updated pipeline run details Pipeline run succeeded, checking if the number of tasks are what is expected < Exit [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/05/26 18:31:59.592 (1m40.62s) > Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/05/26 18:31:59.592 ################### Global Cleanup after each test ##################### Deleting 1 run(s) Terminate run c8811e82-7417-4e82-a27f-3ff9384a7200 Failed to terminate run c8811e82-7417-4e82-a27f-3ff9384a7200 Terminate run c8811e82-7417-4e82-a27f-3ff9384a7200 Deleting run c8811e82-7417-4e82-a27f-3ff9384a7200 Deleting 0 experiment(s) Deleting 1 pipeline(s) Deleting pipeline with id=f538173b-1623-495c-8021-3f3594c891e1 (cascade=true) Pipeline with id=f538173b-1623-495c-8021-3f3594c891e1, DELETED < Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/05/26 18:31:59.755 (163ms) > Enter [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/05/26 18:31:59.755 < Exit [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/05/26 18:31:59.755 (0s) > Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/05/26 18:31:59.755 < Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/05/26 18:31:59.755 (0s) 2026/07/05 18:32:25 Test passed > Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/05/26 18:30:18.654 Create an experiment with name E2EExperiment-1783276218654411774 < Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/05/26 18:30:18.883 (229ms) > Enter [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/05/26 18:30:18.883 ################### Setup before each Pipeline Upload test ##################### ################### Global Setup before each test ##################### Test Context: 0x1656d1b20b00 Looks like test-secret-1 already exists, because creation failed due to secrets "test-secret-1" already exists Looks like test-secret-2 already exists, because creation failed due to secrets "test-secret-2" already exists Looks like test-secret-3 already exists, because creation failed due to secrets "test-secret-3" already exists < Exit [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/05/26 18:30:18.968 (85ms) > Enter [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/05/26 18:30:18.968 Uploading pipeline file critical/flip_coin.yaml Creating temp pipeline file with overridden SDK Version Uploading pipeline with name=e2e-test-1783276218883665254, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml Upload of pipeline file 'critical/flip_coin.yaml' successful Listing pipeline versions for pipeline 8e8971fe-4373-4f29-a791-0508b10840f6 Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml Returning pipeline run time inputs map[] Create run for pipeline with id: '8e8971fe-4373-4f29-a791-0508b10840f6' and name: 'e2e-test-1783276218883665254' Create a pipeline run for pipeline with id=8e8971fe-4373-4f29-a791-0508b10840f6 and versionId=31f262b7-0d11-43d3-8615-8f4d0002b877 Create a pipeline run body Created Pipeline Run successfully with runId=b51233dd-e1cc-4308-bebf-13af51b0339d Created Pipeline Run with id: b51233dd-e1cc-4308-bebf-13af51b0339d for pipeline with id: 8e8971fe-4373-4f29-a791-0508b10840f6 Waiting for pipeline run with id=b51233dd-e1cc-4308-bebf-13af51b0339d to be in one of '[SUCCEEDED SKIPPED FAILED CANCELED]' Get a pipeline run with id=b51233dd-e1cc-4308-bebf-13af51b0339d Pipeline run with id=b51233dd-e1cc-4308-bebf-13af51b0339d is in PENDING state, waiting... Get a pipeline run with id=b51233dd-e1cc-4308-bebf-13af51b0339d Pipeline run with id=b51233dd-e1cc-4308-bebf-13af51b0339d is in RUNNING state, waiting... Get a pipeline run with id=b51233dd-e1cc-4308-bebf-13af51b0339d Pipeline run with id=b51233dd-e1cc-4308-bebf-13af51b0339d is in RUNNING state, waiting... Get a pipeline run with id=b51233dd-e1cc-4308-bebf-13af51b0339d Pipeline run with id=b51233dd-e1cc-4308-bebf-13af51b0339d is in RUNNING state, waiting... Get a pipeline run with id=b51233dd-e1cc-4308-bebf-13af51b0339d Pipeline run with id=b51233dd-e1cc-4308-bebf-13af51b0339d is in RUNNING state, waiting... Get a pipeline run with id=b51233dd-e1cc-4308-bebf-13af51b0339d Pipeline run with id=b51233dd-e1cc-4308-bebf-13af51b0339d is in RUNNING state, waiting... Get a pipeline run with id=b51233dd-e1cc-4308-bebf-13af51b0339d Pipeline run with id=b51233dd-e1cc-4308-bebf-13af51b0339d is in RUNNING state, waiting... Get a pipeline run with id=b51233dd-e1cc-4308-bebf-13af51b0339d Pipeline run with id=b51233dd-e1cc-4308-bebf-13af51b0339d is in RUNNING state, waiting... Get a pipeline run with id=b51233dd-e1cc-4308-bebf-13af51b0339d Pipeline run with id=b51233dd-e1cc-4308-bebf-13af51b0339d is in RUNNING state, waiting... Get a pipeline run with id=b51233dd-e1cc-4308-bebf-13af51b0339d Pipeline run with id=b51233dd-e1cc-4308-bebf-13af51b0339d is in RUNNING state, waiting... Get a pipeline run with id=b51233dd-e1cc-4308-bebf-13af51b0339d Pipeline run with id=b51233dd-e1cc-4308-bebf-13af51b0339d is in RUNNING state, waiting... Get a pipeline run with id=b51233dd-e1cc-4308-bebf-13af51b0339d Pipeline run with id=b51233dd-e1cc-4308-bebf-13af51b0339d is in RUNNING state, waiting... Get a pipeline run with id=b51233dd-e1cc-4308-bebf-13af51b0339d Pipeline run with id=b51233dd-e1cc-4308-bebf-13af51b0339d is in RUNNING state, waiting... Get a pipeline run with id=b51233dd-e1cc-4308-bebf-13af51b0339d Pipeline run with id=b51233dd-e1cc-4308-bebf-13af51b0339d is in RUNNING state, waiting... Get a pipeline run with id=b51233dd-e1cc-4308-bebf-13af51b0339d Pipeline run with id=b51233dd-e1cc-4308-bebf-13af51b0339d is in RUNNING state, waiting... Get a pipeline run with id=b51233dd-e1cc-4308-bebf-13af51b0339d Pipeline run with id=b51233dd-e1cc-4308-bebf-13af51b0339d is in RUNNING state, waiting... Get a pipeline run with id=b51233dd-e1cc-4308-bebf-13af51b0339d Pipeline run with id=b51233dd-e1cc-4308-bebf-13af51b0339d is in RUNNING state, waiting... Get a pipeline run with id=b51233dd-e1cc-4308-bebf-13af51b0339d Pipeline run with id=b51233dd-e1cc-4308-bebf-13af51b0339d is in RUNNING state, waiting... Get a pipeline run with id=b51233dd-e1cc-4308-bebf-13af51b0339d Pipeline run with id=b51233dd-e1cc-4308-bebf-13af51b0339d is in RUNNING state, waiting... Get a pipeline run with id=b51233dd-e1cc-4308-bebf-13af51b0339d Pipeline run with id=b51233dd-e1cc-4308-bebf-13af51b0339d is in RUNNING state, waiting... Get a pipeline run with id=b51233dd-e1cc-4308-bebf-13af51b0339d Pipeline run with id=b51233dd-e1cc-4308-bebf-13af51b0339d is in RUNNING state, waiting... Get a pipeline run with id=b51233dd-e1cc-4308-bebf-13af51b0339d Pipeline run with id=b51233dd-e1cc-4308-bebf-13af51b0339d is in RUNNING state, waiting... Get a pipeline run with id=b51233dd-e1cc-4308-bebf-13af51b0339d Pipeline run with id=b51233dd-e1cc-4308-bebf-13af51b0339d is in RUNNING state, waiting... Get a pipeline run with id=b51233dd-e1cc-4308-bebf-13af51b0339d Pipeline run with id=b51233dd-e1cc-4308-bebf-13af51b0339d is in RUNNING state, waiting... Get a pipeline run with id=b51233dd-e1cc-4308-bebf-13af51b0339d Pipeline run with id=b51233dd-e1cc-4308-bebf-13af51b0339d is in RUNNING state, waiting... Get a pipeline run with id=b51233dd-e1cc-4308-bebf-13af51b0339d Pipeline run with id=b51233dd-e1cc-4308-bebf-13af51b0339d reached expected state SUCCEEDED Deserializing expected compiled workflow file 'critical/flip_coin.yaml' for the pipeline Unmarshalling Expected Workflow YAML Unmarshalled Expected Workflow YAML Fetching updated pipeline run details for run with id=b51233dd-e1cc-4308-bebf-13af51b0339d Get a pipeline run with id=b51233dd-e1cc-4308-bebf-13af51b0339d Updated pipeline run details Pipeline run succeeded, checking if the number of tasks are what is expected < Exit [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/05/26 18:32:24.715 (2m5.747s) > Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/05/26 18:32:24.715 ################### Global Cleanup after each test ##################### Deleting 1 run(s) Terminate run b51233dd-e1cc-4308-bebf-13af51b0339d Failed to terminate run b51233dd-e1cc-4308-bebf-13af51b0339d Terminate run b51233dd-e1cc-4308-bebf-13af51b0339d Deleting run b51233dd-e1cc-4308-bebf-13af51b0339d Deleting 0 experiment(s) Deleting 1 pipeline(s) Deleting pipeline with id=8e8971fe-4373-4f29-a791-0508b10840f6 (cascade=true) Pipeline with id=8e8971fe-4373-4f29-a791-0508b10840f6, DELETED < Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/05/26 18:32:25.013 (298ms) > Enter [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/05/26 18:32:25.014 < Exit [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/05/26 18:32:25.014 (0s) > Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/05/26 18:32:25.014 < Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/05/26 18:32:25.014 (0s) 2026/07/05 18:32:49 Test passed > Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/05/26 18:30:18.657 Create an experiment with name E2EExperiment-1783276218657013467 < Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/05/26 18:30:18.881 (225ms) > Enter [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/05/26 18:30:18.881 ################### Setup before each Pipeline Upload test ##################### ################### Global Setup before each test ##################### Test Context: 0x19b3cae8a380 test-secret-1 created test-secret-2 created test-secret-3 created < Exit [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/05/26 18:30:18.929 (47ms) > Enter [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/05/26 18:30:18.929 Uploading pipeline file essential/iris_pipeline_compiled.yaml Creating temp pipeline file with overridden SDK Version Uploading pipeline with name=e2e-test-1783276218882015014, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml Upload of pipeline file 'essential/iris_pipeline_compiled.yaml' successful Listing pipeline versions for pipeline 62c0857e-8bea-4dcf-9407-ef9c775d650d Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml Returning pipeline run time inputs map[] Create run for pipeline with id: '62c0857e-8bea-4dcf-9407-ef9c775d650d' and name: 'e2e-test-1783276218882015014' Create a pipeline run for pipeline with id=62c0857e-8bea-4dcf-9407-ef9c775d650d and versionId=e8172a62-2579-490e-904e-64bef9e1feed Create a pipeline run body Created Pipeline Run successfully with runId=9495695a-a045-44f8-9dd1-c903bc0afbdb Created Pipeline Run with id: 9495695a-a045-44f8-9dd1-c903bc0afbdb for pipeline with id: 62c0857e-8bea-4dcf-9407-ef9c775d650d Waiting for pipeline run with id=9495695a-a045-44f8-9dd1-c903bc0afbdb to be in one of '[SUCCEEDED SKIPPED FAILED CANCELED]' Get a pipeline run with id=9495695a-a045-44f8-9dd1-c903bc0afbdb Pipeline run with id=9495695a-a045-44f8-9dd1-c903bc0afbdb is in PENDING state, waiting... Get a pipeline run with id=9495695a-a045-44f8-9dd1-c903bc0afbdb Pipeline run with id=9495695a-a045-44f8-9dd1-c903bc0afbdb is in RUNNING state, waiting... Get a pipeline run with id=9495695a-a045-44f8-9dd1-c903bc0afbdb Pipeline run with id=9495695a-a045-44f8-9dd1-c903bc0afbdb is in RUNNING state, waiting... Get a pipeline run with id=9495695a-a045-44f8-9dd1-c903bc0afbdb Pipeline run with id=9495695a-a045-44f8-9dd1-c903bc0afbdb is in RUNNING state, waiting... Get a pipeline run with id=9495695a-a045-44f8-9dd1-c903bc0afbdb Pipeline run with id=9495695a-a045-44f8-9dd1-c903bc0afbdb is in RUNNING state, waiting... Get a pipeline run with id=9495695a-a045-44f8-9dd1-c903bc0afbdb Pipeline run with id=9495695a-a045-44f8-9dd1-c903bc0afbdb is in RUNNING state, waiting... Get a pipeline run with id=9495695a-a045-44f8-9dd1-c903bc0afbdb Pipeline run with id=9495695a-a045-44f8-9dd1-c903bc0afbdb is in RUNNING state, waiting... Get a pipeline run with id=9495695a-a045-44f8-9dd1-c903bc0afbdb Pipeline run with id=9495695a-a045-44f8-9dd1-c903bc0afbdb is in RUNNING state, waiting... Get a pipeline run with id=9495695a-a045-44f8-9dd1-c903bc0afbdb Pipeline run with id=9495695a-a045-44f8-9dd1-c903bc0afbdb is in RUNNING state, waiting... Get a pipeline run with id=9495695a-a045-44f8-9dd1-c903bc0afbdb Pipeline run with id=9495695a-a045-44f8-9dd1-c903bc0afbdb is in RUNNING state, waiting... Get a pipeline run with id=9495695a-a045-44f8-9dd1-c903bc0afbdb Pipeline run with id=9495695a-a045-44f8-9dd1-c903bc0afbdb is in RUNNING state, waiting... Get a pipeline run with id=9495695a-a045-44f8-9dd1-c903bc0afbdb Pipeline run with id=9495695a-a045-44f8-9dd1-c903bc0afbdb is in RUNNING state, waiting... Get a pipeline run with id=9495695a-a045-44f8-9dd1-c903bc0afbdb Pipeline run with id=9495695a-a045-44f8-9dd1-c903bc0afbdb is in RUNNING state, waiting... Get a pipeline run with id=9495695a-a045-44f8-9dd1-c903bc0afbdb Pipeline run with id=9495695a-a045-44f8-9dd1-c903bc0afbdb is in RUNNING state, waiting... Get a pipeline run with id=9495695a-a045-44f8-9dd1-c903bc0afbdb Pipeline run with id=9495695a-a045-44f8-9dd1-c903bc0afbdb is in RUNNING state, waiting... Get a pipeline run with id=9495695a-a045-44f8-9dd1-c903bc0afbdb Pipeline run with id=9495695a-a045-44f8-9dd1-c903bc0afbdb is in RUNNING state, waiting... Get a pipeline run with id=9495695a-a045-44f8-9dd1-c903bc0afbdb Pipeline run with id=9495695a-a045-44f8-9dd1-c903bc0afbdb is in RUNNING state, waiting... Get a pipeline run with id=9495695a-a045-44f8-9dd1-c903bc0afbdb Pipeline run with id=9495695a-a045-44f8-9dd1-c903bc0afbdb is in RUNNING state, waiting... Get a pipeline run with id=9495695a-a045-44f8-9dd1-c903bc0afbdb Pipeline run with id=9495695a-a045-44f8-9dd1-c903bc0afbdb is in RUNNING state, waiting... Get a pipeline run with id=9495695a-a045-44f8-9dd1-c903bc0afbdb Pipeline run with id=9495695a-a045-44f8-9dd1-c903bc0afbdb is in RUNNING state, waiting... Get a pipeline run with id=9495695a-a045-44f8-9dd1-c903bc0afbdb Pipeline run with id=9495695a-a045-44f8-9dd1-c903bc0afbdb is in RUNNING state, waiting... Get a pipeline run with id=9495695a-a045-44f8-9dd1-c903bc0afbdb Pipeline run with id=9495695a-a045-44f8-9dd1-c903bc0afbdb is in RUNNING state, waiting... Get a pipeline run with id=9495695a-a045-44f8-9dd1-c903bc0afbdb Pipeline run with id=9495695a-a045-44f8-9dd1-c903bc0afbdb is in RUNNING state, waiting... Get a pipeline run with id=9495695a-a045-44f8-9dd1-c903bc0afbdb Pipeline run with id=9495695a-a045-44f8-9dd1-c903bc0afbdb is in RUNNING state, waiting... Get a pipeline run with id=9495695a-a045-44f8-9dd1-c903bc0afbdb Pipeline run with id=9495695a-a045-44f8-9dd1-c903bc0afbdb is in RUNNING state, waiting... Get a pipeline run with id=9495695a-a045-44f8-9dd1-c903bc0afbdb Pipeline run with id=9495695a-a045-44f8-9dd1-c903bc0afbdb is in RUNNING state, waiting... Get a pipeline run with id=9495695a-a045-44f8-9dd1-c903bc0afbdb Pipeline run with id=9495695a-a045-44f8-9dd1-c903bc0afbdb is in RUNNING state, waiting... Get a pipeline run with id=9495695a-a045-44f8-9dd1-c903bc0afbdb Pipeline run with id=9495695a-a045-44f8-9dd1-c903bc0afbdb is in RUNNING state, waiting... Get a pipeline run with id=9495695a-a045-44f8-9dd1-c903bc0afbdb Pipeline run with id=9495695a-a045-44f8-9dd1-c903bc0afbdb is in RUNNING state, waiting... Get a pipeline run with id=9495695a-a045-44f8-9dd1-c903bc0afbdb Pipeline run with id=9495695a-a045-44f8-9dd1-c903bc0afbdb is in RUNNING state, waiting... Get a pipeline run with id=9495695a-a045-44f8-9dd1-c903bc0afbdb Pipeline run with id=9495695a-a045-44f8-9dd1-c903bc0afbdb reached expected state SUCCEEDED Deserializing expected compiled workflow file 'essential/iris_pipeline_compiled.yaml' for the pipeline Unmarshalling Expected Workflow YAML Unmarshalled Expected Workflow YAML Fetching updated pipeline run details for run with id=9495695a-a045-44f8-9dd1-c903bc0afbdb Get a pipeline run with id=9495695a-a045-44f8-9dd1-c903bc0afbdb Updated pipeline run details Pipeline run succeeded, checking if the number of tasks are what is expected < Exit [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/05/26 18:32:49.445 (2m30.516s) > Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/05/26 18:32:49.446 ################### Global Cleanup after each test ##################### Deleting 1 run(s) Terminate run 9495695a-a045-44f8-9dd1-c903bc0afbdb Failed to terminate run 9495695a-a045-44f8-9dd1-c903bc0afbdb Terminate run 9495695a-a045-44f8-9dd1-c903bc0afbdb Deleting run 9495695a-a045-44f8-9dd1-c903bc0afbdb Deleting 0 experiment(s) Deleting 1 pipeline(s) Deleting pipeline with id=62c0857e-8bea-4dcf-9407-ef9c775d650d (cascade=true) Pipeline with id=62c0857e-8bea-4dcf-9407-ef9c775d650d, DELETED < Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/05/26 18:32:49.632 (186ms) > Enter [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/05/26 18:32:49.633 < Exit [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/05/26 18:32:49.633 (0s) > Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/05/26 18:32:49.633 < Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/05/26 18:32:49.633 (0s)