2026/07/03 14:58:52 Test passed > Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/03/26 14:58:06.24 Create an experiment with name E2EExperiment-1783090686240223376 < Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/03/26 14:58:06.513 (274ms) > Enter [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/03/26 14:58:06.514 ################### Setup before each Pipeline Upload test ##################### ################### Global Setup before each test ##################### Test Context: 0xca54ea0a280 Looks like test-secret-1 already exists, because creation failed due to secrets "test-secret-1" already exists Looks like test-secret-2 already exists, because creation failed due to secrets "test-secret-2" already exists Looks like test-secret-3 already exists, because creation failed due to secrets "test-secret-3" already exists < Exit [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/03/26 14:58:06.661 (147ms) > Enter [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/03/26 14:58:06.661 Uploading pipeline file essential/component_with_pip_index_urls.yaml Creating temp pipeline file with overridden SDK Version Uploading pipeline with name=e2e-test-1783090686514034216, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml Upload of pipeline file 'essential/component_with_pip_index_urls.yaml' successful Listing pipeline versions for pipeline 308f8639-cfef-421e-8bd6-e699f0d85858 Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml Returning pipeline run time inputs map[] Create run for pipeline with id: '308f8639-cfef-421e-8bd6-e699f0d85858' and name: 'e2e-test-1783090686514034216' Create a pipeline run for pipeline with id=308f8639-cfef-421e-8bd6-e699f0d85858 and versionId=8cb1f0d4-5fea-4ac9-80ca-a3a27d6c7d56 Create a pipeline run body Created Pipeline Run successfully with runId=c674f7b4-2776-442d-8c9e-fd9c74ba3831 Created Pipeline Run with id: c674f7b4-2776-442d-8c9e-fd9c74ba3831 for pipeline with id: 308f8639-cfef-421e-8bd6-e699f0d85858 Waiting for pipeline run with id=c674f7b4-2776-442d-8c9e-fd9c74ba3831 to be in one of '[SUCCEEDED SKIPPED FAILED CANCELED]' Get a pipeline run with id=c674f7b4-2776-442d-8c9e-fd9c74ba3831 Pipeline run with id=c674f7b4-2776-442d-8c9e-fd9c74ba3831 is in PENDING state, waiting... Get a pipeline run with id=c674f7b4-2776-442d-8c9e-fd9c74ba3831 Pipeline run with id=c674f7b4-2776-442d-8c9e-fd9c74ba3831 is in RUNNING state, waiting... Get a pipeline run with id=c674f7b4-2776-442d-8c9e-fd9c74ba3831 Pipeline run with id=c674f7b4-2776-442d-8c9e-fd9c74ba3831 is in RUNNING state, waiting... Get a pipeline run with id=c674f7b4-2776-442d-8c9e-fd9c74ba3831 Pipeline run with id=c674f7b4-2776-442d-8c9e-fd9c74ba3831 is in RUNNING state, waiting... Get a pipeline run with id=c674f7b4-2776-442d-8c9e-fd9c74ba3831 Pipeline run with id=c674f7b4-2776-442d-8c9e-fd9c74ba3831 is in RUNNING state, waiting... Get a pipeline run with id=c674f7b4-2776-442d-8c9e-fd9c74ba3831 Pipeline run with id=c674f7b4-2776-442d-8c9e-fd9c74ba3831 is in RUNNING state, waiting... Get a pipeline run with id=c674f7b4-2776-442d-8c9e-fd9c74ba3831 Pipeline run with id=c674f7b4-2776-442d-8c9e-fd9c74ba3831 is in RUNNING state, waiting... Get a pipeline run with id=c674f7b4-2776-442d-8c9e-fd9c74ba3831 Pipeline run with id=c674f7b4-2776-442d-8c9e-fd9c74ba3831 is in RUNNING state, waiting... Get a pipeline run with id=c674f7b4-2776-442d-8c9e-fd9c74ba3831 Pipeline run with id=c674f7b4-2776-442d-8c9e-fd9c74ba3831 is in RUNNING state, waiting... Get a pipeline run with id=c674f7b4-2776-442d-8c9e-fd9c74ba3831 Pipeline run with id=c674f7b4-2776-442d-8c9e-fd9c74ba3831 reached expected state SUCCEEDED Deserializing expected compiled workflow file 'essential/component_with_pip_index_urls.yaml' for the pipeline Unmarshalling Expected Workflow YAML Unmarshalled Expected Workflow YAML Fetching updated pipeline run details for run with id=c674f7b4-2776-442d-8c9e-fd9c74ba3831 Get a pipeline run with id=c674f7b4-2776-442d-8c9e-fd9c74ba3831 Updated pipeline run details Pipeline run succeeded, checking if the number of tasks are what is expected < Exit [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/03/26 14:58:52.334 (45.673s) > Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/03/26 14:58:52.334 ################### Global Cleanup after each test ##################### Deleting 1 run(s) Terminate run c674f7b4-2776-442d-8c9e-fd9c74ba3831 Failed to terminate run c674f7b4-2776-442d-8c9e-fd9c74ba3831 Terminate run c674f7b4-2776-442d-8c9e-fd9c74ba3831 Deleting run c674f7b4-2776-442d-8c9e-fd9c74ba3831 Deleting 0 experiment(s) Deleting 1 pipeline(s) Deleting pipeline with id=308f8639-cfef-421e-8bd6-e699f0d85858 (cascade=true) Pipeline with id=308f8639-cfef-421e-8bd6-e699f0d85858, DELETED < Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/03/26 14:58:52.638 (304ms) > Enter [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/03/26 14:58:52.638 < Exit [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/03/26 14:58:52.638 (0s) > Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/03/26 14:58:52.638 < Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/03/26 14:58:52.638 (0s) 2026/07/03 14:59:42 Test passed > Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/03/26 14:58:06.24 Create an experiment with name E2EExperiment-1783090686240201294 < Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/03/26 14:58:06.515 (275ms) > Enter [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/03/26 14:58:06.515 ################### Setup before each Pipeline Upload test ##################### ################### Global Setup before each test ##################### Test Context: 0x1078a0faa380 Looks like test-secret-1 already exists, because creation failed due to secrets "test-secret-1" already exists Looks like test-secret-2 already exists, because creation failed due to secrets "test-secret-2" already exists Looks like test-secret-3 already exists, because creation failed due to secrets "test-secret-3" already exists < Exit [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/03/26 14:58:06.646 (131ms) > Enter [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/03/26 14:58:06.646 Uploading pipeline file critical/pipeline_with_artifact_upload_download.yaml Creating temp pipeline file with overridden SDK Version Uploading pipeline with name=e2e-test-1783090686515632360, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml Upload of pipeline file 'critical/pipeline_with_artifact_upload_download.yaml' successful Listing pipeline versions for pipeline a89e066d-eb52-4c42-a75c-950bfcfd8742 Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml Returning pipeline run time inputs map[] Create run for pipeline with id: 'a89e066d-eb52-4c42-a75c-950bfcfd8742' and name: 'e2e-test-1783090686515632360' Create a pipeline run for pipeline with id=a89e066d-eb52-4c42-a75c-950bfcfd8742 and versionId=2d07af29-1435-47c6-afaf-d9396627f005 Create a pipeline run body Created Pipeline Run successfully with runId=5ef71f8a-fe84-49ac-aed8-4057016a5b73 Created Pipeline Run with id: 5ef71f8a-fe84-49ac-aed8-4057016a5b73 for pipeline with id: a89e066d-eb52-4c42-a75c-950bfcfd8742 Waiting for pipeline run with id=5ef71f8a-fe84-49ac-aed8-4057016a5b73 to be in one of '[SUCCEEDED SKIPPED FAILED CANCELED]' Get a pipeline run with id=5ef71f8a-fe84-49ac-aed8-4057016a5b73 Pipeline run with id=5ef71f8a-fe84-49ac-aed8-4057016a5b73 is in PENDING state, waiting... Get a pipeline run with id=5ef71f8a-fe84-49ac-aed8-4057016a5b73 Pipeline run with id=5ef71f8a-fe84-49ac-aed8-4057016a5b73 is in RUNNING state, waiting... Get a pipeline run with id=5ef71f8a-fe84-49ac-aed8-4057016a5b73 Pipeline run with id=5ef71f8a-fe84-49ac-aed8-4057016a5b73 is in RUNNING state, waiting... Get a pipeline run with id=5ef71f8a-fe84-49ac-aed8-4057016a5b73 Pipeline run with id=5ef71f8a-fe84-49ac-aed8-4057016a5b73 is in RUNNING state, waiting... Get a pipeline run with id=5ef71f8a-fe84-49ac-aed8-4057016a5b73 Pipeline run with id=5ef71f8a-fe84-49ac-aed8-4057016a5b73 is in RUNNING state, waiting... Get a pipeline run with id=5ef71f8a-fe84-49ac-aed8-4057016a5b73 Pipeline run with id=5ef71f8a-fe84-49ac-aed8-4057016a5b73 is in RUNNING state, waiting... Get a pipeline run with id=5ef71f8a-fe84-49ac-aed8-4057016a5b73 Pipeline run with id=5ef71f8a-fe84-49ac-aed8-4057016a5b73 is in RUNNING state, waiting... Get a pipeline run with id=5ef71f8a-fe84-49ac-aed8-4057016a5b73 Pipeline run with id=5ef71f8a-fe84-49ac-aed8-4057016a5b73 is in RUNNING state, waiting... Get a pipeline run with id=5ef71f8a-fe84-49ac-aed8-4057016a5b73 Pipeline run with id=5ef71f8a-fe84-49ac-aed8-4057016a5b73 is in RUNNING state, waiting... Get a pipeline run with id=5ef71f8a-fe84-49ac-aed8-4057016a5b73 Pipeline run with id=5ef71f8a-fe84-49ac-aed8-4057016a5b73 is in RUNNING state, waiting... Get a pipeline run with id=5ef71f8a-fe84-49ac-aed8-4057016a5b73 Pipeline run with id=5ef71f8a-fe84-49ac-aed8-4057016a5b73 is in RUNNING state, waiting... Get a pipeline run with id=5ef71f8a-fe84-49ac-aed8-4057016a5b73 Pipeline run with id=5ef71f8a-fe84-49ac-aed8-4057016a5b73 is in RUNNING state, waiting... Get a pipeline run with id=5ef71f8a-fe84-49ac-aed8-4057016a5b73 Pipeline run with id=5ef71f8a-fe84-49ac-aed8-4057016a5b73 is in RUNNING state, waiting... Get a pipeline run with id=5ef71f8a-fe84-49ac-aed8-4057016a5b73 Pipeline run with id=5ef71f8a-fe84-49ac-aed8-4057016a5b73 is in RUNNING state, waiting... Get a pipeline run with id=5ef71f8a-fe84-49ac-aed8-4057016a5b73 Pipeline run with id=5ef71f8a-fe84-49ac-aed8-4057016a5b73 is in RUNNING state, waiting... Get a pipeline run with id=5ef71f8a-fe84-49ac-aed8-4057016a5b73 Pipeline run with id=5ef71f8a-fe84-49ac-aed8-4057016a5b73 is in RUNNING state, waiting... Get a pipeline run with id=5ef71f8a-fe84-49ac-aed8-4057016a5b73 Pipeline run with id=5ef71f8a-fe84-49ac-aed8-4057016a5b73 is in RUNNING state, waiting... Get a pipeline run with id=5ef71f8a-fe84-49ac-aed8-4057016a5b73 Pipeline run with id=5ef71f8a-fe84-49ac-aed8-4057016a5b73 is in RUNNING state, waiting... Get a pipeline run with id=5ef71f8a-fe84-49ac-aed8-4057016a5b73 Pipeline run with id=5ef71f8a-fe84-49ac-aed8-4057016a5b73 is in RUNNING state, waiting... Get a pipeline run with id=5ef71f8a-fe84-49ac-aed8-4057016a5b73 Pipeline run with id=5ef71f8a-fe84-49ac-aed8-4057016a5b73 reached expected state SUCCEEDED Deserializing expected compiled workflow file 'critical/pipeline_with_artifact_upload_download.yaml' for the pipeline Unmarshalling Expected Workflow YAML Unmarshalled Expected Workflow YAML Fetching updated pipeline run details for run with id=5ef71f8a-fe84-49ac-aed8-4057016a5b73 Get a pipeline run with id=5ef71f8a-fe84-49ac-aed8-4057016a5b73 Updated pipeline run details Pipeline run succeeded, checking if the number of tasks are what is expected < Exit [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/03/26 14:59:42.173 (1m35.527s) > Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/03/26 14:59:42.173 ################### Global Cleanup after each test ##################### Deleting 1 run(s) Terminate run 5ef71f8a-fe84-49ac-aed8-4057016a5b73 Failed to terminate run 5ef71f8a-fe84-49ac-aed8-4057016a5b73 Terminate run 5ef71f8a-fe84-49ac-aed8-4057016a5b73 Deleting run 5ef71f8a-fe84-49ac-aed8-4057016a5b73 Deleting 0 experiment(s) Deleting 1 pipeline(s) Deleting pipeline with id=a89e066d-eb52-4c42-a75c-950bfcfd8742 (cascade=true) Pipeline with id=a89e066d-eb52-4c42-a75c-950bfcfd8742, DELETED < Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/03/26 14:59:42.384 (211ms) > Enter [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/03/26 14:59:42.385 < Exit [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/03/26 14:59:42.385 (0s) > Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/03/26 14:59:42.385 < Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/03/26 14:59:42.385 (0s) 2026/07/03 14:59:42 Test passed > Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/03/26 14:58:06.239 Create an experiment with name E2EExperiment-1783090686239773239 < Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/03/26 14:58:06.517 (277ms) > Enter [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/03/26 14:58:06.517 ################### Setup before each Pipeline Upload test ##################### ################### Global Setup before each test ##################### Test Context: 0x2a15352dc280 Looks like test-secret-1 already exists, because creation failed due to secrets "test-secret-1" already exists Looks like test-secret-2 already exists, because creation failed due to secrets "test-secret-2" already exists Looks like test-secret-3 already exists, because creation failed due to secrets "test-secret-3" already exists < Exit [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/03/26 14:58:06.652 (135ms) > Enter [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/03/26 14:58:06.652 Uploading pipeline file critical/parallel_for_after_dependency.yaml Creating temp pipeline file with overridden SDK Version Uploading pipeline with name=e2e-test-1783090686517260357, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml Upload of pipeline file 'critical/parallel_for_after_dependency.yaml' successful Listing pipeline versions for pipeline 8ab994a5-e0ad-4b3c-9481-c64b83db44d5 Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml Returning pipeline run time inputs map[] Create run for pipeline with id: '8ab994a5-e0ad-4b3c-9481-c64b83db44d5' and name: 'e2e-test-1783090686517260357' Create a pipeline run for pipeline with id=8ab994a5-e0ad-4b3c-9481-c64b83db44d5 and versionId=8977f14c-eb17-405d-a8a7-7048b2ab6c4e Create a pipeline run body Created Pipeline Run successfully with runId=2c6407bf-525d-4cdb-a37a-b5a633d39259 Created Pipeline Run with id: 2c6407bf-525d-4cdb-a37a-b5a633d39259 for pipeline with id: 8ab994a5-e0ad-4b3c-9481-c64b83db44d5 Waiting for pipeline run with id=2c6407bf-525d-4cdb-a37a-b5a633d39259 to be in one of '[SUCCEEDED SKIPPED FAILED CANCELED]' Get a pipeline run with id=2c6407bf-525d-4cdb-a37a-b5a633d39259 Pipeline run with id=2c6407bf-525d-4cdb-a37a-b5a633d39259 is in PENDING state, waiting... Get a pipeline run with id=2c6407bf-525d-4cdb-a37a-b5a633d39259 Pipeline run with id=2c6407bf-525d-4cdb-a37a-b5a633d39259 is in RUNNING state, waiting... Get a pipeline run with id=2c6407bf-525d-4cdb-a37a-b5a633d39259 Pipeline run with id=2c6407bf-525d-4cdb-a37a-b5a633d39259 is in RUNNING state, waiting... Get a pipeline run with id=2c6407bf-525d-4cdb-a37a-b5a633d39259 Pipeline run with id=2c6407bf-525d-4cdb-a37a-b5a633d39259 is in RUNNING state, waiting... Get a pipeline run with id=2c6407bf-525d-4cdb-a37a-b5a633d39259 Pipeline run with id=2c6407bf-525d-4cdb-a37a-b5a633d39259 is in RUNNING state, waiting... Get a pipeline run with id=2c6407bf-525d-4cdb-a37a-b5a633d39259 Pipeline run with id=2c6407bf-525d-4cdb-a37a-b5a633d39259 is in RUNNING state, waiting... Get a pipeline run with id=2c6407bf-525d-4cdb-a37a-b5a633d39259 Pipeline run with id=2c6407bf-525d-4cdb-a37a-b5a633d39259 is in RUNNING state, waiting... Get a pipeline run with id=2c6407bf-525d-4cdb-a37a-b5a633d39259 Pipeline run with id=2c6407bf-525d-4cdb-a37a-b5a633d39259 is in RUNNING state, waiting... Get a pipeline run with id=2c6407bf-525d-4cdb-a37a-b5a633d39259 Pipeline run with id=2c6407bf-525d-4cdb-a37a-b5a633d39259 is in RUNNING state, waiting... Get a pipeline run with id=2c6407bf-525d-4cdb-a37a-b5a633d39259 Pipeline run with id=2c6407bf-525d-4cdb-a37a-b5a633d39259 is in RUNNING state, waiting... Get a pipeline run with id=2c6407bf-525d-4cdb-a37a-b5a633d39259 Pipeline run with id=2c6407bf-525d-4cdb-a37a-b5a633d39259 is in RUNNING state, waiting... Get a pipeline run with id=2c6407bf-525d-4cdb-a37a-b5a633d39259 Pipeline run with id=2c6407bf-525d-4cdb-a37a-b5a633d39259 is in RUNNING state, waiting... Get a pipeline run with id=2c6407bf-525d-4cdb-a37a-b5a633d39259 Pipeline run with id=2c6407bf-525d-4cdb-a37a-b5a633d39259 is in RUNNING state, waiting... Get a pipeline run with id=2c6407bf-525d-4cdb-a37a-b5a633d39259 Pipeline run with id=2c6407bf-525d-4cdb-a37a-b5a633d39259 is in RUNNING state, waiting... Get a pipeline run with id=2c6407bf-525d-4cdb-a37a-b5a633d39259 Pipeline run with id=2c6407bf-525d-4cdb-a37a-b5a633d39259 is in RUNNING state, waiting... Get a pipeline run with id=2c6407bf-525d-4cdb-a37a-b5a633d39259 Pipeline run with id=2c6407bf-525d-4cdb-a37a-b5a633d39259 is in RUNNING state, waiting... Get a pipeline run with id=2c6407bf-525d-4cdb-a37a-b5a633d39259 Pipeline run with id=2c6407bf-525d-4cdb-a37a-b5a633d39259 is in RUNNING state, waiting... Get a pipeline run with id=2c6407bf-525d-4cdb-a37a-b5a633d39259 Pipeline run with id=2c6407bf-525d-4cdb-a37a-b5a633d39259 is in RUNNING state, waiting... Get a pipeline run with id=2c6407bf-525d-4cdb-a37a-b5a633d39259 Pipeline run with id=2c6407bf-525d-4cdb-a37a-b5a633d39259 is in RUNNING state, waiting... Get a pipeline run with id=2c6407bf-525d-4cdb-a37a-b5a633d39259 Pipeline run with id=2c6407bf-525d-4cdb-a37a-b5a633d39259 reached expected state SUCCEEDED Deserializing expected compiled workflow file 'critical/parallel_for_after_dependency.yaml' for the pipeline Unmarshalling Expected Workflow YAML Unmarshalled Expected Workflow YAML Fetching updated pipeline run details for run with id=2c6407bf-525d-4cdb-a37a-b5a633d39259 Get a pipeline run with id=2c6407bf-525d-4cdb-a37a-b5a633d39259 Updated pipeline run details Pipeline run succeeded, checking if the number of tasks are what is expected < Exit [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/03/26 14:59:42.351 (1m35.699s) > Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/03/26 14:59:42.351 ################### Global Cleanup after each test ##################### Deleting 1 run(s) Terminate run 2c6407bf-525d-4cdb-a37a-b5a633d39259 Failed to terminate run 2c6407bf-525d-4cdb-a37a-b5a633d39259 Terminate run 2c6407bf-525d-4cdb-a37a-b5a633d39259 Deleting run 2c6407bf-525d-4cdb-a37a-b5a633d39259 Deleting 0 experiment(s) Deleting 1 pipeline(s) Deleting pipeline with id=8ab994a5-e0ad-4b3c-9481-c64b83db44d5 (cascade=true) Pipeline with id=8ab994a5-e0ad-4b3c-9481-c64b83db44d5, DELETED < Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/03/26 14:59:42.714 (363ms) > Enter [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/03/26 14:59:42.715 < Exit [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/03/26 14:59:42.715 (0s) > Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/03/26 14:59:42.715 < Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/03/26 14:59:42.715 (0s) 2026/07/03 15:00:17 Test passed > Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/03/26 14:58:06.239 Create an experiment with name E2EExperiment-1783090686239831793 < Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/03/26 14:58:06.519 (279ms) > Enter [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/03/26 14:58:06.519 ################### Setup before each Pipeline Upload test ##################### ################### Global Setup before each test ##################### Test Context: 0x14abfc220280 Looks like test-secret-1 already exists, because creation failed due to secrets "test-secret-1" already exists Looks like test-secret-2 already exists, because creation failed due to secrets "test-secret-2" already exists Looks like test-secret-3 already exists, because creation failed due to secrets "test-secret-3" already exists < Exit [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/03/26 14:58:06.642 (123ms) > Enter [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/03/26 14:58:06.642 Uploading pipeline file critical/flip_coin.yaml Creating temp pipeline file with overridden SDK Version Uploading pipeline with name=e2e-test-1783090686519521420, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml Upload of pipeline file 'critical/flip_coin.yaml' successful Listing pipeline versions for pipeline 1b6355d2-79a0-4002-81ea-56fa5df67eca Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml Returning pipeline run time inputs map[] Create run for pipeline with id: '1b6355d2-79a0-4002-81ea-56fa5df67eca' and name: 'e2e-test-1783090686519521420' Create a pipeline run for pipeline with id=1b6355d2-79a0-4002-81ea-56fa5df67eca and versionId=e2bda5a0-a62f-4cde-944e-04464589973a Create a pipeline run body Created Pipeline Run successfully with runId=48ea0114-3dc3-441b-a075-3f4483905fb5 Created Pipeline Run with id: 48ea0114-3dc3-441b-a075-3f4483905fb5 for pipeline with id: 1b6355d2-79a0-4002-81ea-56fa5df67eca Waiting for pipeline run with id=48ea0114-3dc3-441b-a075-3f4483905fb5 to be in one of '[SUCCEEDED SKIPPED FAILED CANCELED]' Get a pipeline run with id=48ea0114-3dc3-441b-a075-3f4483905fb5 Pipeline run with id=48ea0114-3dc3-441b-a075-3f4483905fb5 is in PENDING state, waiting... Get a pipeline run with id=48ea0114-3dc3-441b-a075-3f4483905fb5 Pipeline run with id=48ea0114-3dc3-441b-a075-3f4483905fb5 is in RUNNING state, waiting... Get a pipeline run with id=48ea0114-3dc3-441b-a075-3f4483905fb5 Pipeline run with id=48ea0114-3dc3-441b-a075-3f4483905fb5 is in RUNNING state, waiting... Get a pipeline run with id=48ea0114-3dc3-441b-a075-3f4483905fb5 Pipeline run with id=48ea0114-3dc3-441b-a075-3f4483905fb5 is in RUNNING state, waiting... Get a pipeline run with id=48ea0114-3dc3-441b-a075-3f4483905fb5 Pipeline run with id=48ea0114-3dc3-441b-a075-3f4483905fb5 is in RUNNING state, waiting... Get a pipeline run with id=48ea0114-3dc3-441b-a075-3f4483905fb5 Pipeline run with id=48ea0114-3dc3-441b-a075-3f4483905fb5 is in RUNNING state, waiting... Get a pipeline run with id=48ea0114-3dc3-441b-a075-3f4483905fb5 Pipeline run with id=48ea0114-3dc3-441b-a075-3f4483905fb5 is in RUNNING state, waiting... Get a pipeline run with id=48ea0114-3dc3-441b-a075-3f4483905fb5 Pipeline run with id=48ea0114-3dc3-441b-a075-3f4483905fb5 is in RUNNING state, waiting... Get a pipeline run with id=48ea0114-3dc3-441b-a075-3f4483905fb5 Pipeline run with id=48ea0114-3dc3-441b-a075-3f4483905fb5 is in RUNNING state, waiting... Get a pipeline run with id=48ea0114-3dc3-441b-a075-3f4483905fb5 Pipeline run with id=48ea0114-3dc3-441b-a075-3f4483905fb5 is in RUNNING state, waiting... Get a pipeline run with id=48ea0114-3dc3-441b-a075-3f4483905fb5 Pipeline run with id=48ea0114-3dc3-441b-a075-3f4483905fb5 is in RUNNING state, waiting... Get a pipeline run with id=48ea0114-3dc3-441b-a075-3f4483905fb5 Pipeline run with id=48ea0114-3dc3-441b-a075-3f4483905fb5 is in RUNNING state, waiting... Get a pipeline run with id=48ea0114-3dc3-441b-a075-3f4483905fb5 Pipeline run with id=48ea0114-3dc3-441b-a075-3f4483905fb5 is in RUNNING state, waiting... Get a pipeline run with id=48ea0114-3dc3-441b-a075-3f4483905fb5 Pipeline run with id=48ea0114-3dc3-441b-a075-3f4483905fb5 is in RUNNING state, waiting... Get a pipeline run with id=48ea0114-3dc3-441b-a075-3f4483905fb5 Pipeline run with id=48ea0114-3dc3-441b-a075-3f4483905fb5 is in RUNNING state, waiting... Get a pipeline run with id=48ea0114-3dc3-441b-a075-3f4483905fb5 Pipeline run with id=48ea0114-3dc3-441b-a075-3f4483905fb5 is in RUNNING state, waiting... Get a pipeline run with id=48ea0114-3dc3-441b-a075-3f4483905fb5 Pipeline run with id=48ea0114-3dc3-441b-a075-3f4483905fb5 is in RUNNING state, waiting... Get a pipeline run with id=48ea0114-3dc3-441b-a075-3f4483905fb5 Pipeline run with id=48ea0114-3dc3-441b-a075-3f4483905fb5 is in RUNNING state, waiting... Get a pipeline run with id=48ea0114-3dc3-441b-a075-3f4483905fb5 Pipeline run with id=48ea0114-3dc3-441b-a075-3f4483905fb5 is in RUNNING state, waiting... Get a pipeline run with id=48ea0114-3dc3-441b-a075-3f4483905fb5 Pipeline run with id=48ea0114-3dc3-441b-a075-3f4483905fb5 is in RUNNING state, waiting... Get a pipeline run with id=48ea0114-3dc3-441b-a075-3f4483905fb5 Pipeline run with id=48ea0114-3dc3-441b-a075-3f4483905fb5 is in RUNNING state, waiting... Get a pipeline run with id=48ea0114-3dc3-441b-a075-3f4483905fb5 Pipeline run with id=48ea0114-3dc3-441b-a075-3f4483905fb5 is in RUNNING state, waiting... Get a pipeline run with id=48ea0114-3dc3-441b-a075-3f4483905fb5 Pipeline run with id=48ea0114-3dc3-441b-a075-3f4483905fb5 is in RUNNING state, waiting... Get a pipeline run with id=48ea0114-3dc3-441b-a075-3f4483905fb5 Pipeline run with id=48ea0114-3dc3-441b-a075-3f4483905fb5 is in RUNNING state, waiting... Get a pipeline run with id=48ea0114-3dc3-441b-a075-3f4483905fb5 Pipeline run with id=48ea0114-3dc3-441b-a075-3f4483905fb5 is in RUNNING state, waiting... Get a pipeline run with id=48ea0114-3dc3-441b-a075-3f4483905fb5 Pipeline run with id=48ea0114-3dc3-441b-a075-3f4483905fb5 is in RUNNING state, waiting... Get a pipeline run with id=48ea0114-3dc3-441b-a075-3f4483905fb5 Pipeline run with id=48ea0114-3dc3-441b-a075-3f4483905fb5 reached expected state SUCCEEDED Deserializing expected compiled workflow file 'critical/flip_coin.yaml' for the pipeline Unmarshalling Expected Workflow YAML Unmarshalled Expected Workflow YAML Fetching updated pipeline run details for run with id=48ea0114-3dc3-441b-a075-3f4483905fb5 Get a pipeline run with id=48ea0114-3dc3-441b-a075-3f4483905fb5 Updated pipeline run details Pipeline run succeeded, checking if the number of tasks are what is expected < Exit [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/03/26 15:00:17.364 (2m10.722s) > Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/03/26 15:00:17.364 ################### Global Cleanup after each test ##################### Deleting 1 run(s) Terminate run 48ea0114-3dc3-441b-a075-3f4483905fb5 Failed to terminate run 48ea0114-3dc3-441b-a075-3f4483905fb5 Terminate run 48ea0114-3dc3-441b-a075-3f4483905fb5 Deleting run 48ea0114-3dc3-441b-a075-3f4483905fb5 Deleting 0 experiment(s) Deleting 1 pipeline(s) Deleting pipeline with id=1b6355d2-79a0-4002-81ea-56fa5df67eca (cascade=true) Pipeline with id=1b6355d2-79a0-4002-81ea-56fa5df67eca, DELETED < Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/03/26 15:00:17.744 (380ms) > Enter [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/03/26 15:00:17.745 < Exit [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/03/26 15:00:17.745 (0s) > Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/03/26 15:00:17.745 < Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/03/26 15:00:17.745 (0s) 2026/07/03 15:00:42 Test passed > Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/03/26 14:58:06.24 Create an experiment with name E2EExperiment-1783090686240321982 < Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/03/26 14:58:06.453 (213ms) > Enter [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/03/26 14:58:06.453 ################### Setup before each Pipeline Upload test ##################### ################### Global Setup before each test ##################### Test Context: 0x1f70ea3f2000 test-secret-1 created test-secret-2 created test-secret-3 created < Exit [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/03/26 14:58:06.523 (70ms) > Enter [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/03/26 14:58:06.524 Uploading pipeline file essential/iris_pipeline_compiled.yaml Creating temp pipeline file with overridden SDK Version Uploading pipeline with name=e2e-test-1783090686453988730, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml Upload of pipeline file 'essential/iris_pipeline_compiled.yaml' successful Listing pipeline versions for pipeline 15da9f98-15bb-4185-9e8d-7fbc2edae466 Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml Returning pipeline run time inputs map[] Create run for pipeline with id: '15da9f98-15bb-4185-9e8d-7fbc2edae466' and name: 'e2e-test-1783090686453988730' Create a pipeline run for pipeline with id=15da9f98-15bb-4185-9e8d-7fbc2edae466 and versionId=1f30ca20-e8b2-4d8c-96ea-92b97e35cac0 Create a pipeline run body Created Pipeline Run successfully with runId=4bc373cd-7452-40cc-b49a-5f4a4c16e378 Created Pipeline Run with id: 4bc373cd-7452-40cc-b49a-5f4a4c16e378 for pipeline with id: 15da9f98-15bb-4185-9e8d-7fbc2edae466 Waiting for pipeline run with id=4bc373cd-7452-40cc-b49a-5f4a4c16e378 to be in one of '[SUCCEEDED SKIPPED FAILED CANCELED]' Get a pipeline run with id=4bc373cd-7452-40cc-b49a-5f4a4c16e378 Pipeline run with id=4bc373cd-7452-40cc-b49a-5f4a4c16e378 is in PENDING state, waiting... Get a pipeline run with id=4bc373cd-7452-40cc-b49a-5f4a4c16e378 Pipeline run with id=4bc373cd-7452-40cc-b49a-5f4a4c16e378 is in RUNNING state, waiting... Get a pipeline run with id=4bc373cd-7452-40cc-b49a-5f4a4c16e378 Pipeline run with id=4bc373cd-7452-40cc-b49a-5f4a4c16e378 is in RUNNING state, waiting... Get a pipeline run with id=4bc373cd-7452-40cc-b49a-5f4a4c16e378 Pipeline run with id=4bc373cd-7452-40cc-b49a-5f4a4c16e378 is in RUNNING state, waiting... Get a pipeline run with id=4bc373cd-7452-40cc-b49a-5f4a4c16e378 Pipeline run with id=4bc373cd-7452-40cc-b49a-5f4a4c16e378 is in RUNNING state, waiting... Get a pipeline run with id=4bc373cd-7452-40cc-b49a-5f4a4c16e378 Pipeline run with id=4bc373cd-7452-40cc-b49a-5f4a4c16e378 is in RUNNING state, waiting... Get a pipeline run with id=4bc373cd-7452-40cc-b49a-5f4a4c16e378 Pipeline run with id=4bc373cd-7452-40cc-b49a-5f4a4c16e378 is in RUNNING state, waiting... Get a pipeline run with id=4bc373cd-7452-40cc-b49a-5f4a4c16e378 Pipeline run with id=4bc373cd-7452-40cc-b49a-5f4a4c16e378 is in RUNNING state, waiting... Get a pipeline run with id=4bc373cd-7452-40cc-b49a-5f4a4c16e378 Pipeline run with id=4bc373cd-7452-40cc-b49a-5f4a4c16e378 is in RUNNING state, waiting... Get a pipeline run with id=4bc373cd-7452-40cc-b49a-5f4a4c16e378 Pipeline run with id=4bc373cd-7452-40cc-b49a-5f4a4c16e378 is in RUNNING state, waiting... Get a pipeline run with id=4bc373cd-7452-40cc-b49a-5f4a4c16e378 Pipeline run with id=4bc373cd-7452-40cc-b49a-5f4a4c16e378 is in RUNNING state, waiting... Get a pipeline run with id=4bc373cd-7452-40cc-b49a-5f4a4c16e378 Pipeline run with id=4bc373cd-7452-40cc-b49a-5f4a4c16e378 is in RUNNING state, waiting... Get a pipeline run with id=4bc373cd-7452-40cc-b49a-5f4a4c16e378 Pipeline run with id=4bc373cd-7452-40cc-b49a-5f4a4c16e378 is in RUNNING state, waiting... Get a pipeline run with id=4bc373cd-7452-40cc-b49a-5f4a4c16e378 Pipeline run with id=4bc373cd-7452-40cc-b49a-5f4a4c16e378 is in RUNNING state, waiting... Get a pipeline run with id=4bc373cd-7452-40cc-b49a-5f4a4c16e378 Pipeline run with id=4bc373cd-7452-40cc-b49a-5f4a4c16e378 is in RUNNING state, waiting... Get a pipeline run with id=4bc373cd-7452-40cc-b49a-5f4a4c16e378 Pipeline run with id=4bc373cd-7452-40cc-b49a-5f4a4c16e378 is in RUNNING state, waiting... Get a pipeline run with id=4bc373cd-7452-40cc-b49a-5f4a4c16e378 Pipeline run with id=4bc373cd-7452-40cc-b49a-5f4a4c16e378 is in RUNNING state, waiting... Get a pipeline run with id=4bc373cd-7452-40cc-b49a-5f4a4c16e378 Pipeline run with id=4bc373cd-7452-40cc-b49a-5f4a4c16e378 is in RUNNING state, waiting... Get a pipeline run with id=4bc373cd-7452-40cc-b49a-5f4a4c16e378 Pipeline run with id=4bc373cd-7452-40cc-b49a-5f4a4c16e378 is in RUNNING state, waiting... Get a pipeline run with id=4bc373cd-7452-40cc-b49a-5f4a4c16e378 Pipeline run with id=4bc373cd-7452-40cc-b49a-5f4a4c16e378 is in RUNNING state, waiting... Get a pipeline run with id=4bc373cd-7452-40cc-b49a-5f4a4c16e378 Pipeline run with id=4bc373cd-7452-40cc-b49a-5f4a4c16e378 is in RUNNING state, waiting... Get a pipeline run with id=4bc373cd-7452-40cc-b49a-5f4a4c16e378 Pipeline run with id=4bc373cd-7452-40cc-b49a-5f4a4c16e378 is in RUNNING state, waiting... Get a pipeline run with id=4bc373cd-7452-40cc-b49a-5f4a4c16e378 Pipeline run with id=4bc373cd-7452-40cc-b49a-5f4a4c16e378 is in RUNNING state, waiting... Get a pipeline run with id=4bc373cd-7452-40cc-b49a-5f4a4c16e378 Pipeline run with id=4bc373cd-7452-40cc-b49a-5f4a4c16e378 is in RUNNING state, waiting... Get a pipeline run with id=4bc373cd-7452-40cc-b49a-5f4a4c16e378 Pipeline run with id=4bc373cd-7452-40cc-b49a-5f4a4c16e378 is in RUNNING state, waiting... Get a pipeline run with id=4bc373cd-7452-40cc-b49a-5f4a4c16e378 Pipeline run with id=4bc373cd-7452-40cc-b49a-5f4a4c16e378 is in RUNNING state, waiting... Get a pipeline run with id=4bc373cd-7452-40cc-b49a-5f4a4c16e378 Pipeline run with id=4bc373cd-7452-40cc-b49a-5f4a4c16e378 is in RUNNING state, waiting... Get a pipeline run with id=4bc373cd-7452-40cc-b49a-5f4a4c16e378 Pipeline run with id=4bc373cd-7452-40cc-b49a-5f4a4c16e378 is in RUNNING state, waiting... Get a pipeline run with id=4bc373cd-7452-40cc-b49a-5f4a4c16e378 Pipeline run with id=4bc373cd-7452-40cc-b49a-5f4a4c16e378 is in RUNNING state, waiting... Get a pipeline run with id=4bc373cd-7452-40cc-b49a-5f4a4c16e378 Pipeline run with id=4bc373cd-7452-40cc-b49a-5f4a4c16e378 is in RUNNING state, waiting... Get a pipeline run with id=4bc373cd-7452-40cc-b49a-5f4a4c16e378 Pipeline run with id=4bc373cd-7452-40cc-b49a-5f4a4c16e378 is in RUNNING state, waiting... Get a pipeline run with id=4bc373cd-7452-40cc-b49a-5f4a4c16e378 Pipeline run with id=4bc373cd-7452-40cc-b49a-5f4a4c16e378 reached expected state SUCCEEDED Deserializing expected compiled workflow file 'essential/iris_pipeline_compiled.yaml' for the pipeline Unmarshalling Expected Workflow YAML Unmarshalled Expected Workflow YAML Fetching updated pipeline run details for run with id=4bc373cd-7452-40cc-b49a-5f4a4c16e378 Get a pipeline run with id=4bc373cd-7452-40cc-b49a-5f4a4c16e378 Updated pipeline run details Pipeline run succeeded, checking if the number of tasks are what is expected < Exit [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/03/26 15:00:42.081 (2m35.557s) > Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/03/26 15:00:42.081 ################### Global Cleanup after each test ##################### Deleting 1 run(s) Terminate run 4bc373cd-7452-40cc-b49a-5f4a4c16e378 Failed to terminate run 4bc373cd-7452-40cc-b49a-5f4a4c16e378 Terminate run 4bc373cd-7452-40cc-b49a-5f4a4c16e378 Deleting run 4bc373cd-7452-40cc-b49a-5f4a4c16e378 Deleting 0 experiment(s) Deleting 1 pipeline(s) Deleting pipeline with id=15da9f98-15bb-4185-9e8d-7fbc2edae466 (cascade=true) Pipeline with id=15da9f98-15bb-4185-9e8d-7fbc2edae466, DELETED < Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/03/26 15:00:42.408 (327ms) > Enter [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/03/26 15:00:42.408 < Exit [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/03/26 15:00:42.408 (0s) > Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/03/26 15:00:42.409 < Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/03/26 15:00:42.409 (0s)