2026/07/16 06:21:28 Test passed > Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/16/26 06:19:47.222 Create an experiment with name E2EExperiment-1784182787222973011 < Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/16/26 06:19:47.41 (188ms) > Enter [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/16/26 06:19:47.41 ################### Setup before each Pipeline Upload test ##################### ################### Global Setup before each test ##################### Test Context: 0x2d587582cb80 Looks like test-secret-1 already exists, because creation failed due to secrets "test-secret-1" already exists Looks like test-secret-2 already exists, because creation failed due to secrets "test-secret-2" already exists Looks like test-secret-3 already exists, because creation failed due to secrets "test-secret-3" already exists < Exit [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/16/26 06:19:47.555 (145ms) > Enter [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/16/26 06:19:47.555 Uploading pipeline file critical/pipeline_with_artifact_upload_download.yaml Creating temp pipeline file with overridden SDK Version Uploading pipeline with name=e2e-test-1784182787410829812, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml Upload of pipeline file 'critical/pipeline_with_artifact_upload_download.yaml' successful Listing pipeline versions for pipeline 3ecf87a0-6b91-4a94-980e-3d0074e729c3 Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml Returning pipeline run time inputs map[] Create run for pipeline with id: '3ecf87a0-6b91-4a94-980e-3d0074e729c3' and name: 'e2e-test-1784182787410829812' Create a pipeline run for pipeline with id=3ecf87a0-6b91-4a94-980e-3d0074e729c3 and versionId=908dfe92-437b-4f99-a8d2-83b9f9b77775 Create a pipeline run body Created Pipeline Run successfully with runId=4400d7dc-80f8-41c6-a848-6384e168723f Created Pipeline Run with id: 4400d7dc-80f8-41c6-a848-6384e168723f for pipeline with id: 3ecf87a0-6b91-4a94-980e-3d0074e729c3 Waiting for pipeline run with id=4400d7dc-80f8-41c6-a848-6384e168723f to be in one of '[SUCCEEDED SKIPPED FAILED CANCELED]' Get a pipeline run with id=4400d7dc-80f8-41c6-a848-6384e168723f Pipeline run with id=4400d7dc-80f8-41c6-a848-6384e168723f is in PENDING state, waiting... Get a pipeline run with id=4400d7dc-80f8-41c6-a848-6384e168723f Pipeline run with id=4400d7dc-80f8-41c6-a848-6384e168723f is in RUNNING state, waiting... Get a pipeline run with id=4400d7dc-80f8-41c6-a848-6384e168723f Pipeline run with id=4400d7dc-80f8-41c6-a848-6384e168723f is in RUNNING state, waiting... Get a pipeline run with id=4400d7dc-80f8-41c6-a848-6384e168723f Pipeline run with id=4400d7dc-80f8-41c6-a848-6384e168723f is in RUNNING state, waiting... Get a pipeline run with id=4400d7dc-80f8-41c6-a848-6384e168723f Pipeline run with id=4400d7dc-80f8-41c6-a848-6384e168723f is in RUNNING state, waiting... Get a pipeline run with id=4400d7dc-80f8-41c6-a848-6384e168723f Pipeline run with id=4400d7dc-80f8-41c6-a848-6384e168723f is in RUNNING state, waiting... Get a pipeline run with id=4400d7dc-80f8-41c6-a848-6384e168723f Pipeline run with id=4400d7dc-80f8-41c6-a848-6384e168723f is in RUNNING state, waiting... Get a pipeline run with id=4400d7dc-80f8-41c6-a848-6384e168723f Pipeline run with id=4400d7dc-80f8-41c6-a848-6384e168723f is in RUNNING state, waiting... Get a pipeline run with id=4400d7dc-80f8-41c6-a848-6384e168723f Pipeline run with id=4400d7dc-80f8-41c6-a848-6384e168723f is in RUNNING state, waiting... Get a pipeline run with id=4400d7dc-80f8-41c6-a848-6384e168723f Pipeline run with id=4400d7dc-80f8-41c6-a848-6384e168723f is in RUNNING state, waiting... Get a pipeline run with id=4400d7dc-80f8-41c6-a848-6384e168723f Pipeline run with id=4400d7dc-80f8-41c6-a848-6384e168723f is in RUNNING state, waiting... Get a pipeline run with id=4400d7dc-80f8-41c6-a848-6384e168723f Pipeline run with id=4400d7dc-80f8-41c6-a848-6384e168723f is in RUNNING state, waiting... Get a pipeline run with id=4400d7dc-80f8-41c6-a848-6384e168723f Pipeline run with id=4400d7dc-80f8-41c6-a848-6384e168723f is in RUNNING state, waiting... Get a pipeline run with id=4400d7dc-80f8-41c6-a848-6384e168723f Pipeline run with id=4400d7dc-80f8-41c6-a848-6384e168723f is in RUNNING state, waiting... Get a pipeline run with id=4400d7dc-80f8-41c6-a848-6384e168723f Pipeline run with id=4400d7dc-80f8-41c6-a848-6384e168723f is in RUNNING state, waiting... Get a pipeline run with id=4400d7dc-80f8-41c6-a848-6384e168723f Pipeline run with id=4400d7dc-80f8-41c6-a848-6384e168723f is in RUNNING state, waiting... Get a pipeline run with id=4400d7dc-80f8-41c6-a848-6384e168723f Pipeline run with id=4400d7dc-80f8-41c6-a848-6384e168723f is in RUNNING state, waiting... Get a pipeline run with id=4400d7dc-80f8-41c6-a848-6384e168723f Pipeline run with id=4400d7dc-80f8-41c6-a848-6384e168723f is in RUNNING state, waiting... Get a pipeline run with id=4400d7dc-80f8-41c6-a848-6384e168723f Pipeline run with id=4400d7dc-80f8-41c6-a848-6384e168723f is in RUNNING state, waiting... Get a pipeline run with id=4400d7dc-80f8-41c6-a848-6384e168723f Pipeline run with id=4400d7dc-80f8-41c6-a848-6384e168723f is in RUNNING state, waiting... Get a pipeline run with id=4400d7dc-80f8-41c6-a848-6384e168723f Pipeline run with id=4400d7dc-80f8-41c6-a848-6384e168723f reached expected state SUCCEEDED Deserializing expected compiled workflow file 'critical/pipeline_with_artifact_upload_download.yaml' for the pipeline Unmarshalling Expected Workflow YAML Unmarshalled Expected Workflow YAML Fetching updated pipeline run details for run with id=4400d7dc-80f8-41c6-a848-6384e168723f Get a pipeline run with id=4400d7dc-80f8-41c6-a848-6384e168723f Updated pipeline run details Pipeline run succeeded, checking if the number of tasks are what is expected < Exit [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/16/26 06:21:27.891 (1m40.336s) > Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/16/26 06:21:27.892 ################### Global Cleanup after each test ##################### Deleting 1 run(s) Terminate run 4400d7dc-80f8-41c6-a848-6384e168723f Failed to terminate run 4400d7dc-80f8-41c6-a848-6384e168723f Terminate run 4400d7dc-80f8-41c6-a848-6384e168723f Deleting run 4400d7dc-80f8-41c6-a848-6384e168723f Deleting 0 experiment(s) Deleting 1 pipeline(s) Deleting pipeline with id=3ecf87a0-6b91-4a94-980e-3d0074e729c3 (cascade=true) Pipeline with id=3ecf87a0-6b91-4a94-980e-3d0074e729c3, DELETED < Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/16/26 06:21:28.045 (154ms) > Enter [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/16/26 06:21:28.046 < Exit [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/16/26 06:21:28.046 (0s) > Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/16/26 06:21:28.046 < Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/16/26 06:21:28.046 (0s) 2026/07/16 06:20:38 Test passed > Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/16/26 06:19:47.222 Create an experiment with name E2EExperiment-1784182787223001871 < Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/16/26 06:19:47.409 (187ms) > Enter [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/16/26 06:19:47.409 ################### Setup before each Pipeline Upload test ##################### ################### Global Setup before each test ##################### Test Context: 0x1bda1a0d2380 test-secret-1 created test-secret-2 created test-secret-3 created < Exit [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/16/26 06:19:47.486 (76ms) > Enter [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/16/26 06:19:47.486 Uploading pipeline file essential/component_with_pip_index_urls.yaml Creating temp pipeline file with overridden SDK Version Uploading pipeline with name=e2e-test-1784182787409893645, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml Upload of pipeline file 'essential/component_with_pip_index_urls.yaml' successful Listing pipeline versions for pipeline d984cbaa-d278-40aa-bcd9-4ae132f8dafc Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml Returning pipeline run time inputs map[] Create run for pipeline with id: 'd984cbaa-d278-40aa-bcd9-4ae132f8dafc' and name: 'e2e-test-1784182787409893645' Create a pipeline run for pipeline with id=d984cbaa-d278-40aa-bcd9-4ae132f8dafc and versionId=8b2e01c3-9d69-41b8-a51e-1765767007f4 Create a pipeline run body Created Pipeline Run successfully with runId=56e9e55a-c299-41bb-9750-6544a064caa7 Created Pipeline Run with id: 56e9e55a-c299-41bb-9750-6544a064caa7 for pipeline with id: d984cbaa-d278-40aa-bcd9-4ae132f8dafc Waiting for pipeline run with id=56e9e55a-c299-41bb-9750-6544a064caa7 to be in one of '[SUCCEEDED SKIPPED FAILED CANCELED]' Get a pipeline run with id=56e9e55a-c299-41bb-9750-6544a064caa7 Pipeline run with id=56e9e55a-c299-41bb-9750-6544a064caa7 is in PENDING state, waiting... Get a pipeline run with id=56e9e55a-c299-41bb-9750-6544a064caa7 Pipeline run with id=56e9e55a-c299-41bb-9750-6544a064caa7 is in RUNNING state, waiting... Get a pipeline run with id=56e9e55a-c299-41bb-9750-6544a064caa7 Pipeline run with id=56e9e55a-c299-41bb-9750-6544a064caa7 is in RUNNING state, waiting... Get a pipeline run with id=56e9e55a-c299-41bb-9750-6544a064caa7 Pipeline run with id=56e9e55a-c299-41bb-9750-6544a064caa7 is in RUNNING state, waiting... Get a pipeline run with id=56e9e55a-c299-41bb-9750-6544a064caa7 Pipeline run with id=56e9e55a-c299-41bb-9750-6544a064caa7 is in RUNNING state, waiting... Get a pipeline run with id=56e9e55a-c299-41bb-9750-6544a064caa7 Pipeline run with id=56e9e55a-c299-41bb-9750-6544a064caa7 is in RUNNING state, waiting... Get a pipeline run with id=56e9e55a-c299-41bb-9750-6544a064caa7 Pipeline run with id=56e9e55a-c299-41bb-9750-6544a064caa7 is in RUNNING state, waiting... Get a pipeline run with id=56e9e55a-c299-41bb-9750-6544a064caa7 Pipeline run with id=56e9e55a-c299-41bb-9750-6544a064caa7 is in RUNNING state, waiting... Get a pipeline run with id=56e9e55a-c299-41bb-9750-6544a064caa7 Pipeline run with id=56e9e55a-c299-41bb-9750-6544a064caa7 is in RUNNING state, waiting... Get a pipeline run with id=56e9e55a-c299-41bb-9750-6544a064caa7 Pipeline run with id=56e9e55a-c299-41bb-9750-6544a064caa7 is in RUNNING state, waiting... Get a pipeline run with id=56e9e55a-c299-41bb-9750-6544a064caa7 Pipeline run with id=56e9e55a-c299-41bb-9750-6544a064caa7 reached expected state SUCCEEDED Deserializing expected compiled workflow file 'essential/component_with_pip_index_urls.yaml' for the pipeline Unmarshalling Expected Workflow YAML Unmarshalled Expected Workflow YAML Fetching updated pipeline run details for run with id=56e9e55a-c299-41bb-9750-6544a064caa7 Get a pipeline run with id=56e9e55a-c299-41bb-9750-6544a064caa7 Updated pipeline run details Pipeline run succeeded, checking if the number of tasks are what is expected < Exit [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/16/26 06:20:37.88 (50.395s) > Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/16/26 06:20:37.881 ################### Global Cleanup after each test ##################### Deleting 1 run(s) Terminate run 56e9e55a-c299-41bb-9750-6544a064caa7 Failed to terminate run 56e9e55a-c299-41bb-9750-6544a064caa7 Terminate run 56e9e55a-c299-41bb-9750-6544a064caa7 Deleting run 56e9e55a-c299-41bb-9750-6544a064caa7 Deleting 0 experiment(s) Deleting 1 pipeline(s) Deleting pipeline with id=d984cbaa-d278-40aa-bcd9-4ae132f8dafc (cascade=true) Pipeline with id=d984cbaa-d278-40aa-bcd9-4ae132f8dafc, DELETED < Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/16/26 06:20:38.037 (157ms) > Enter [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/16/26 06:20:38.038 < Exit [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/16/26 06:20:38.038 (0s) > Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/16/26 06:20:38.038 < Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/16/26 06:20:38.038 (0s) 2026/07/16 06:21:23 Test passed > Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/16/26 06:19:47.222 Create an experiment with name E2EExperiment-1784182787222822296 < Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/16/26 06:19:47.409 (186ms) > Enter [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/16/26 06:19:47.409 ################### Setup before each Pipeline Upload test ##################### ################### Global Setup before each test ##################### Test Context: 0x301535002000 Looks like test-secret-1 already exists, because creation failed due to secrets "test-secret-1" already exists Looks like test-secret-2 already exists, because creation failed due to secrets "test-secret-2" already exists Looks like test-secret-3 already exists, because creation failed due to secrets "test-secret-3" already exists < Exit [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/16/26 06:19:47.553 (144ms) > Enter [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/16/26 06:19:47.553 Uploading pipeline file critical/parallel_for_after_dependency.yaml Creating temp pipeline file with overridden SDK Version Uploading pipeline with name=e2e-test-1784182787409335470, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml Upload of pipeline file 'critical/parallel_for_after_dependency.yaml' successful Listing pipeline versions for pipeline 15b1bccb-7393-4b1a-8d8b-02c39464c082 Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml Returning pipeline run time inputs map[] Create run for pipeline with id: '15b1bccb-7393-4b1a-8d8b-02c39464c082' and name: 'e2e-test-1784182787409335470' Create a pipeline run for pipeline with id=15b1bccb-7393-4b1a-8d8b-02c39464c082 and versionId=b3a6959d-f1ad-4bb8-93ae-e898d97be157 Create a pipeline run body Created Pipeline Run successfully with runId=c2a135a9-9c18-4730-a461-b3dce84ef4c1 Created Pipeline Run with id: c2a135a9-9c18-4730-a461-b3dce84ef4c1 for pipeline with id: 15b1bccb-7393-4b1a-8d8b-02c39464c082 Waiting for pipeline run with id=c2a135a9-9c18-4730-a461-b3dce84ef4c1 to be in one of '[SUCCEEDED SKIPPED FAILED CANCELED]' Get a pipeline run with id=c2a135a9-9c18-4730-a461-b3dce84ef4c1 Pipeline run with id=c2a135a9-9c18-4730-a461-b3dce84ef4c1 is in PENDING state, waiting... Get a pipeline run with id=c2a135a9-9c18-4730-a461-b3dce84ef4c1 Pipeline run with id=c2a135a9-9c18-4730-a461-b3dce84ef4c1 is in RUNNING state, waiting... Get a pipeline run with id=c2a135a9-9c18-4730-a461-b3dce84ef4c1 Pipeline run with id=c2a135a9-9c18-4730-a461-b3dce84ef4c1 is in RUNNING state, waiting... Get a pipeline run with id=c2a135a9-9c18-4730-a461-b3dce84ef4c1 Pipeline run with id=c2a135a9-9c18-4730-a461-b3dce84ef4c1 is in RUNNING state, waiting... Get a pipeline run with id=c2a135a9-9c18-4730-a461-b3dce84ef4c1 Pipeline run with id=c2a135a9-9c18-4730-a461-b3dce84ef4c1 is in RUNNING state, waiting... Get a pipeline run with id=c2a135a9-9c18-4730-a461-b3dce84ef4c1 Pipeline run with id=c2a135a9-9c18-4730-a461-b3dce84ef4c1 is in RUNNING state, waiting... Get a pipeline run with id=c2a135a9-9c18-4730-a461-b3dce84ef4c1 Pipeline run with id=c2a135a9-9c18-4730-a461-b3dce84ef4c1 is in RUNNING state, waiting... Get a pipeline run with id=c2a135a9-9c18-4730-a461-b3dce84ef4c1 Pipeline run with id=c2a135a9-9c18-4730-a461-b3dce84ef4c1 is in RUNNING state, waiting... Get a pipeline run with id=c2a135a9-9c18-4730-a461-b3dce84ef4c1 Pipeline run with id=c2a135a9-9c18-4730-a461-b3dce84ef4c1 is in RUNNING state, waiting... Get a pipeline run with id=c2a135a9-9c18-4730-a461-b3dce84ef4c1 Pipeline run with id=c2a135a9-9c18-4730-a461-b3dce84ef4c1 is in RUNNING state, waiting... Get a pipeline run with id=c2a135a9-9c18-4730-a461-b3dce84ef4c1 Pipeline run with id=c2a135a9-9c18-4730-a461-b3dce84ef4c1 is in RUNNING state, waiting... Get a pipeline run with id=c2a135a9-9c18-4730-a461-b3dce84ef4c1 Pipeline run with id=c2a135a9-9c18-4730-a461-b3dce84ef4c1 is in RUNNING state, waiting... Get a pipeline run with id=c2a135a9-9c18-4730-a461-b3dce84ef4c1 Pipeline run with id=c2a135a9-9c18-4730-a461-b3dce84ef4c1 is in RUNNING state, waiting... Get a pipeline run with id=c2a135a9-9c18-4730-a461-b3dce84ef4c1 Pipeline run with id=c2a135a9-9c18-4730-a461-b3dce84ef4c1 is in RUNNING state, waiting... Get a pipeline run with id=c2a135a9-9c18-4730-a461-b3dce84ef4c1 Pipeline run with id=c2a135a9-9c18-4730-a461-b3dce84ef4c1 is in RUNNING state, waiting... Get a pipeline run with id=c2a135a9-9c18-4730-a461-b3dce84ef4c1 Pipeline run with id=c2a135a9-9c18-4730-a461-b3dce84ef4c1 is in RUNNING state, waiting... Get a pipeline run with id=c2a135a9-9c18-4730-a461-b3dce84ef4c1 Pipeline run with id=c2a135a9-9c18-4730-a461-b3dce84ef4c1 is in RUNNING state, waiting... Get a pipeline run with id=c2a135a9-9c18-4730-a461-b3dce84ef4c1 Pipeline run with id=c2a135a9-9c18-4730-a461-b3dce84ef4c1 is in RUNNING state, waiting... Get a pipeline run with id=c2a135a9-9c18-4730-a461-b3dce84ef4c1 Pipeline run with id=c2a135a9-9c18-4730-a461-b3dce84ef4c1 is in RUNNING state, waiting... Get a pipeline run with id=c2a135a9-9c18-4730-a461-b3dce84ef4c1 Pipeline run with id=c2a135a9-9c18-4730-a461-b3dce84ef4c1 reached expected state SUCCEEDED Deserializing expected compiled workflow file 'critical/parallel_for_after_dependency.yaml' for the pipeline Unmarshalling Expected Workflow YAML Unmarshalled Expected Workflow YAML Fetching updated pipeline run details for run with id=c2a135a9-9c18-4730-a461-b3dce84ef4c1 Get a pipeline run with id=c2a135a9-9c18-4730-a461-b3dce84ef4c1 Updated pipeline run details Pipeline run succeeded, checking if the number of tasks are what is expected < Exit [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/16/26 06:21:22.913 (1m35.36s) > Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/16/26 06:21:22.913 ################### Global Cleanup after each test ##################### Deleting 1 run(s) Terminate run c2a135a9-9c18-4730-a461-b3dce84ef4c1 Failed to terminate run c2a135a9-9c18-4730-a461-b3dce84ef4c1 Terminate run c2a135a9-9c18-4730-a461-b3dce84ef4c1 Deleting run c2a135a9-9c18-4730-a461-b3dce84ef4c1 Deleting 0 experiment(s) Deleting 1 pipeline(s) Deleting pipeline with id=15b1bccb-7393-4b1a-8d8b-02c39464c082 (cascade=true) Pipeline with id=15b1bccb-7393-4b1a-8d8b-02c39464c082, DELETED < Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/16/26 06:21:23.076 (163ms) > Enter [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/16/26 06:21:23.076 < Exit [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/16/26 06:21:23.076 (0s) > Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/16/26 06:21:23.076 < Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/16/26 06:21:23.076 (0s) 2026/07/16 06:21:53 Test passed > Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/16/26 06:19:47.223 Create an experiment with name E2EExperiment-1784182787223113734 < Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/16/26 06:19:47.441 (218ms) > Enter [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/16/26 06:19:47.441 ################### Setup before each Pipeline Upload test ##################### ################### Global Setup before each test ##################### Test Context: 0x1e4717538680 Looks like test-secret-1 already exists, because creation failed due to secrets "test-secret-1" already exists Looks like test-secret-2 already exists, because creation failed due to secrets "test-secret-2" already exists Looks like test-secret-3 already exists, because creation failed due to secrets "test-secret-3" already exists < Exit [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/16/26 06:19:47.563 (122ms) > Enter [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/16/26 06:19:47.563 Uploading pipeline file critical/flip_coin.yaml Creating temp pipeline file with overridden SDK Version Uploading pipeline with name=e2e-test-1784182787441648477, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml Upload of pipeline file 'critical/flip_coin.yaml' successful Listing pipeline versions for pipeline 2d6b0861-dc4f-444f-a7d0-e1b638e4e376 Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml Returning pipeline run time inputs map[] Create run for pipeline with id: '2d6b0861-dc4f-444f-a7d0-e1b638e4e376' and name: 'e2e-test-1784182787441648477' Create a pipeline run for pipeline with id=2d6b0861-dc4f-444f-a7d0-e1b638e4e376 and versionId=e271968e-53d2-42cf-ae58-653d3483b1e5 Create a pipeline run body Created Pipeline Run successfully with runId=1f713186-76d6-4e12-8204-f78ecb3d72cf Created Pipeline Run with id: 1f713186-76d6-4e12-8204-f78ecb3d72cf for pipeline with id: 2d6b0861-dc4f-444f-a7d0-e1b638e4e376 Waiting for pipeline run with id=1f713186-76d6-4e12-8204-f78ecb3d72cf to be in one of '[SUCCEEDED SKIPPED FAILED CANCELED]' Get a pipeline run with id=1f713186-76d6-4e12-8204-f78ecb3d72cf Pipeline run with id=1f713186-76d6-4e12-8204-f78ecb3d72cf is in PENDING state, waiting... Get a pipeline run with id=1f713186-76d6-4e12-8204-f78ecb3d72cf Pipeline run with id=1f713186-76d6-4e12-8204-f78ecb3d72cf is in RUNNING state, waiting... Get a pipeline run with id=1f713186-76d6-4e12-8204-f78ecb3d72cf Pipeline run with id=1f713186-76d6-4e12-8204-f78ecb3d72cf is in RUNNING state, waiting... Get a pipeline run with id=1f713186-76d6-4e12-8204-f78ecb3d72cf Pipeline run with id=1f713186-76d6-4e12-8204-f78ecb3d72cf is in RUNNING state, waiting... Get a pipeline run with id=1f713186-76d6-4e12-8204-f78ecb3d72cf Pipeline run with id=1f713186-76d6-4e12-8204-f78ecb3d72cf is in RUNNING state, waiting... Get a pipeline run with id=1f713186-76d6-4e12-8204-f78ecb3d72cf Pipeline run with id=1f713186-76d6-4e12-8204-f78ecb3d72cf is in RUNNING state, waiting... Get a pipeline run with id=1f713186-76d6-4e12-8204-f78ecb3d72cf Pipeline run with id=1f713186-76d6-4e12-8204-f78ecb3d72cf is in RUNNING state, waiting... Get a pipeline run with id=1f713186-76d6-4e12-8204-f78ecb3d72cf Pipeline run with id=1f713186-76d6-4e12-8204-f78ecb3d72cf is in RUNNING state, waiting... Get a pipeline run with id=1f713186-76d6-4e12-8204-f78ecb3d72cf Pipeline run with id=1f713186-76d6-4e12-8204-f78ecb3d72cf is in RUNNING state, waiting... Get a pipeline run with id=1f713186-76d6-4e12-8204-f78ecb3d72cf Pipeline run with id=1f713186-76d6-4e12-8204-f78ecb3d72cf is in RUNNING state, waiting... Get a pipeline run with id=1f713186-76d6-4e12-8204-f78ecb3d72cf Pipeline run with id=1f713186-76d6-4e12-8204-f78ecb3d72cf is in RUNNING state, waiting... Get a pipeline run with id=1f713186-76d6-4e12-8204-f78ecb3d72cf Pipeline run with id=1f713186-76d6-4e12-8204-f78ecb3d72cf is in RUNNING state, waiting... Get a pipeline run with id=1f713186-76d6-4e12-8204-f78ecb3d72cf Pipeline run with id=1f713186-76d6-4e12-8204-f78ecb3d72cf is in RUNNING state, waiting... Get a pipeline run with id=1f713186-76d6-4e12-8204-f78ecb3d72cf Pipeline run with id=1f713186-76d6-4e12-8204-f78ecb3d72cf is in RUNNING state, waiting... Get a pipeline run with id=1f713186-76d6-4e12-8204-f78ecb3d72cf Pipeline run with id=1f713186-76d6-4e12-8204-f78ecb3d72cf is in RUNNING state, waiting... Get a pipeline run with id=1f713186-76d6-4e12-8204-f78ecb3d72cf Pipeline run with id=1f713186-76d6-4e12-8204-f78ecb3d72cf is in RUNNING state, waiting... Get a pipeline run with id=1f713186-76d6-4e12-8204-f78ecb3d72cf Pipeline run with id=1f713186-76d6-4e12-8204-f78ecb3d72cf is in RUNNING state, waiting... Get a pipeline run with id=1f713186-76d6-4e12-8204-f78ecb3d72cf Pipeline run with id=1f713186-76d6-4e12-8204-f78ecb3d72cf is in RUNNING state, waiting... Get a pipeline run with id=1f713186-76d6-4e12-8204-f78ecb3d72cf Pipeline run with id=1f713186-76d6-4e12-8204-f78ecb3d72cf is in RUNNING state, waiting... Get a pipeline run with id=1f713186-76d6-4e12-8204-f78ecb3d72cf Pipeline run with id=1f713186-76d6-4e12-8204-f78ecb3d72cf is in RUNNING state, waiting... Get a pipeline run with id=1f713186-76d6-4e12-8204-f78ecb3d72cf Pipeline run with id=1f713186-76d6-4e12-8204-f78ecb3d72cf is in RUNNING state, waiting... Get a pipeline run with id=1f713186-76d6-4e12-8204-f78ecb3d72cf Pipeline run with id=1f713186-76d6-4e12-8204-f78ecb3d72cf is in RUNNING state, waiting... Get a pipeline run with id=1f713186-76d6-4e12-8204-f78ecb3d72cf Pipeline run with id=1f713186-76d6-4e12-8204-f78ecb3d72cf is in RUNNING state, waiting... Get a pipeline run with id=1f713186-76d6-4e12-8204-f78ecb3d72cf Pipeline run with id=1f713186-76d6-4e12-8204-f78ecb3d72cf is in RUNNING state, waiting... Get a pipeline run with id=1f713186-76d6-4e12-8204-f78ecb3d72cf Pipeline run with id=1f713186-76d6-4e12-8204-f78ecb3d72cf is in RUNNING state, waiting... Get a pipeline run with id=1f713186-76d6-4e12-8204-f78ecb3d72cf Pipeline run with id=1f713186-76d6-4e12-8204-f78ecb3d72cf reached expected state SUCCEEDED Deserializing expected compiled workflow file 'critical/flip_coin.yaml' for the pipeline Unmarshalling Expected Workflow YAML Unmarshalled Expected Workflow YAML Fetching updated pipeline run details for run with id=1f713186-76d6-4e12-8204-f78ecb3d72cf Get a pipeline run with id=1f713186-76d6-4e12-8204-f78ecb3d72cf Updated pipeline run details Pipeline run succeeded, checking if the number of tasks are what is expected < Exit [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/16/26 06:21:53.197 (2m5.634s) > Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/16/26 06:21:53.197 ################### Global Cleanup after each test ##################### Deleting 1 run(s) Terminate run 1f713186-76d6-4e12-8204-f78ecb3d72cf Failed to terminate run 1f713186-76d6-4e12-8204-f78ecb3d72cf Terminate run 1f713186-76d6-4e12-8204-f78ecb3d72cf Deleting run 1f713186-76d6-4e12-8204-f78ecb3d72cf Deleting 0 experiment(s) Deleting 1 pipeline(s) Deleting pipeline with id=2d6b0861-dc4f-444f-a7d0-e1b638e4e376 (cascade=true) Pipeline with id=2d6b0861-dc4f-444f-a7d0-e1b638e4e376, DELETED < Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/16/26 06:21:53.433 (236ms) > Enter [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/16/26 06:21:53.434 < Exit [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/16/26 06:21:53.434 (0s) > Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/16/26 06:21:53.434 < Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/16/26 06:21:53.434 (0s) 2026/07/16 06:22:23 Test passed > Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/16/26 06:19:47.222 Create an experiment with name E2EExperiment-1784182787222964940 < Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/16/26 06:19:47.409 (187ms) > Enter [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/16/26 06:19:47.41 ################### Setup before each Pipeline Upload test ##################### ################### Global Setup before each test ##################### Test Context: 0xc19cad50e80 Looks like test-secret-1 already exists, because creation failed due to secrets "test-secret-1" already exists Looks like test-secret-2 already exists, because creation failed due to secrets "test-secret-2" already exists Looks like test-secret-3 already exists, because creation failed due to secrets "test-secret-3" already exists < Exit [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/16/26 06:19:47.572 (162ms) > Enter [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/16/26 06:19:47.572 Uploading pipeline file essential/iris_pipeline_compiled.yaml Creating temp pipeline file with overridden SDK Version Uploading pipeline with name=e2e-test-1784182787410107762, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml Upload of pipeline file 'essential/iris_pipeline_compiled.yaml' successful Listing pipeline versions for pipeline a8d76f78-b9d5-4f0e-bac7-4db48aa95f18 Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml Returning pipeline run time inputs map[] Create run for pipeline with id: 'a8d76f78-b9d5-4f0e-bac7-4db48aa95f18' and name: 'e2e-test-1784182787410107762' Create a pipeline run for pipeline with id=a8d76f78-b9d5-4f0e-bac7-4db48aa95f18 and versionId=241c7e09-0b3f-47b1-9621-a747c57a26f6 Create a pipeline run body Created Pipeline Run successfully with runId=25c96763-e6cd-4689-9e31-e13824630c66 Created Pipeline Run with id: 25c96763-e6cd-4689-9e31-e13824630c66 for pipeline with id: a8d76f78-b9d5-4f0e-bac7-4db48aa95f18 Waiting for pipeline run with id=25c96763-e6cd-4689-9e31-e13824630c66 to be in one of '[SUCCEEDED SKIPPED FAILED CANCELED]' Get a pipeline run with id=25c96763-e6cd-4689-9e31-e13824630c66 Pipeline run with id=25c96763-e6cd-4689-9e31-e13824630c66 is in PENDING state, waiting... Get a pipeline run with id=25c96763-e6cd-4689-9e31-e13824630c66 Pipeline run with id=25c96763-e6cd-4689-9e31-e13824630c66 is in RUNNING state, waiting... Get a pipeline run with id=25c96763-e6cd-4689-9e31-e13824630c66 Pipeline run with id=25c96763-e6cd-4689-9e31-e13824630c66 is in RUNNING state, waiting... Get a pipeline run with id=25c96763-e6cd-4689-9e31-e13824630c66 Pipeline run with id=25c96763-e6cd-4689-9e31-e13824630c66 is in RUNNING state, waiting... Get a pipeline run with id=25c96763-e6cd-4689-9e31-e13824630c66 Pipeline run with id=25c96763-e6cd-4689-9e31-e13824630c66 is in RUNNING state, waiting... Get a pipeline run with id=25c96763-e6cd-4689-9e31-e13824630c66 Pipeline run with id=25c96763-e6cd-4689-9e31-e13824630c66 is in RUNNING state, waiting... Get a pipeline run with id=25c96763-e6cd-4689-9e31-e13824630c66 Pipeline run with id=25c96763-e6cd-4689-9e31-e13824630c66 is in RUNNING state, waiting... Get a pipeline run with id=25c96763-e6cd-4689-9e31-e13824630c66 Pipeline run with id=25c96763-e6cd-4689-9e31-e13824630c66 is in RUNNING state, waiting... Get a pipeline run with id=25c96763-e6cd-4689-9e31-e13824630c66 Pipeline run with id=25c96763-e6cd-4689-9e31-e13824630c66 is in RUNNING state, waiting... Get a pipeline run with id=25c96763-e6cd-4689-9e31-e13824630c66 Pipeline run with id=25c96763-e6cd-4689-9e31-e13824630c66 is in RUNNING state, waiting... Get a pipeline run with id=25c96763-e6cd-4689-9e31-e13824630c66 Pipeline run with id=25c96763-e6cd-4689-9e31-e13824630c66 is in RUNNING state, waiting... Get a pipeline run with id=25c96763-e6cd-4689-9e31-e13824630c66 Pipeline run with id=25c96763-e6cd-4689-9e31-e13824630c66 is in RUNNING state, waiting... Get a pipeline run with id=25c96763-e6cd-4689-9e31-e13824630c66 Pipeline run with id=25c96763-e6cd-4689-9e31-e13824630c66 is in RUNNING state, waiting... Get a pipeline run with id=25c96763-e6cd-4689-9e31-e13824630c66 Pipeline run with id=25c96763-e6cd-4689-9e31-e13824630c66 is in RUNNING state, waiting... Get a pipeline run with id=25c96763-e6cd-4689-9e31-e13824630c66 Pipeline run with id=25c96763-e6cd-4689-9e31-e13824630c66 is in RUNNING state, waiting... Get a pipeline run with id=25c96763-e6cd-4689-9e31-e13824630c66 Pipeline run with id=25c96763-e6cd-4689-9e31-e13824630c66 is in RUNNING state, waiting... Get a pipeline run with id=25c96763-e6cd-4689-9e31-e13824630c66 Pipeline run with id=25c96763-e6cd-4689-9e31-e13824630c66 is in RUNNING state, waiting... Get a pipeline run with id=25c96763-e6cd-4689-9e31-e13824630c66 Pipeline run with id=25c96763-e6cd-4689-9e31-e13824630c66 is in RUNNING state, waiting... Get a pipeline run with id=25c96763-e6cd-4689-9e31-e13824630c66 Pipeline run with id=25c96763-e6cd-4689-9e31-e13824630c66 is in RUNNING state, waiting... Get a pipeline run with id=25c96763-e6cd-4689-9e31-e13824630c66 Pipeline run with id=25c96763-e6cd-4689-9e31-e13824630c66 is in RUNNING state, waiting... Get a pipeline run with id=25c96763-e6cd-4689-9e31-e13824630c66 Pipeline run with id=25c96763-e6cd-4689-9e31-e13824630c66 is in RUNNING state, waiting... Get a pipeline run with id=25c96763-e6cd-4689-9e31-e13824630c66 Pipeline run with id=25c96763-e6cd-4689-9e31-e13824630c66 is in RUNNING state, waiting... Get a pipeline run with id=25c96763-e6cd-4689-9e31-e13824630c66 Pipeline run with id=25c96763-e6cd-4689-9e31-e13824630c66 is in RUNNING state, waiting... Get a pipeline run with id=25c96763-e6cd-4689-9e31-e13824630c66 Pipeline run with id=25c96763-e6cd-4689-9e31-e13824630c66 is in RUNNING state, waiting... Get a pipeline run with id=25c96763-e6cd-4689-9e31-e13824630c66 Pipeline run with id=25c96763-e6cd-4689-9e31-e13824630c66 is in RUNNING state, waiting... Get a pipeline run with id=25c96763-e6cd-4689-9e31-e13824630c66 Pipeline run with id=25c96763-e6cd-4689-9e31-e13824630c66 is in RUNNING state, waiting... Get a pipeline run with id=25c96763-e6cd-4689-9e31-e13824630c66 Pipeline run with id=25c96763-e6cd-4689-9e31-e13824630c66 is in RUNNING state, waiting... Get a pipeline run with id=25c96763-e6cd-4689-9e31-e13824630c66 Pipeline run with id=25c96763-e6cd-4689-9e31-e13824630c66 is in RUNNING state, waiting... Get a pipeline run with id=25c96763-e6cd-4689-9e31-e13824630c66 Pipeline run with id=25c96763-e6cd-4689-9e31-e13824630c66 is in RUNNING state, waiting... Get a pipeline run with id=25c96763-e6cd-4689-9e31-e13824630c66 Pipeline run with id=25c96763-e6cd-4689-9e31-e13824630c66 is in RUNNING state, waiting... Get a pipeline run with id=25c96763-e6cd-4689-9e31-e13824630c66 Pipeline run with id=25c96763-e6cd-4689-9e31-e13824630c66 is in RUNNING state, waiting... Get a pipeline run with id=25c96763-e6cd-4689-9e31-e13824630c66 Pipeline run with id=25c96763-e6cd-4689-9e31-e13824630c66 reached expected state SUCCEEDED Deserializing expected compiled workflow file 'essential/iris_pipeline_compiled.yaml' for the pipeline Unmarshalling Expected Workflow YAML Unmarshalled Expected Workflow YAML Fetching updated pipeline run details for run with id=25c96763-e6cd-4689-9e31-e13824630c66 Get a pipeline run with id=25c96763-e6cd-4689-9e31-e13824630c66 Updated pipeline run details Pipeline run succeeded, checking if the number of tasks are what is expected < Exit [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/16/26 06:22:23.115 (2m35.543s) > Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/16/26 06:22:23.115 ################### Global Cleanup after each test ##################### Deleting 1 run(s) Terminate run 25c96763-e6cd-4689-9e31-e13824630c66 Failed to terminate run 25c96763-e6cd-4689-9e31-e13824630c66 Terminate run 25c96763-e6cd-4689-9e31-e13824630c66 Deleting run 25c96763-e6cd-4689-9e31-e13824630c66 Deleting 0 experiment(s) Deleting 1 pipeline(s) Deleting pipeline with id=a8d76f78-b9d5-4f0e-bac7-4db48aa95f18 (cascade=true) Pipeline with id=a8d76f78-b9d5-4f0e-bac7-4db48aa95f18, DELETED < Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/16/26 06:22:23.277 (162ms) > Enter [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/16/26 06:22:23.277 < Exit [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/16/26 06:22:23.277 (0s) > Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/16/26 06:22:23.277 < Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/16/26 06:22:23.278 (0s)