2026/07/03 09:16:29 Test passed > Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/03/26 09:15:43.082 Create an experiment with name E2EExperiment-1783070143082862701 < Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/03/26 09:15:43.238 (156ms) > Enter [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/03/26 09:15:43.239 ################### Setup before each Pipeline Upload test ##################### ################### Global Setup before each test ##################### Test Context: 0x1731eb2d6900 Looks like test-secret-1 already exists, because creation failed due to secrets "test-secret-1" already exists Looks like test-secret-2 already exists, because creation failed due to secrets "test-secret-2" already exists Looks like test-secret-3 already exists, because creation failed due to secrets "test-secret-3" already exists < Exit [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/03/26 09:15:43.326 (87ms) > Enter [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/03/26 09:15:43.326 Uploading pipeline file essential/component_with_pip_index_urls.yaml Creating temp pipeline file with overridden SDK Version Uploading pipeline with name=e2e-test-1783070143239158583, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml Upload of pipeline file 'essential/component_with_pip_index_urls.yaml' successful Listing pipeline versions for pipeline 4191c34c-f248-48f7-b5a6-fca12e82aa8b Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml Returning pipeline run time inputs map[] Create run for pipeline with id: '4191c34c-f248-48f7-b5a6-fca12e82aa8b' and name: 'e2e-test-1783070143239158583' Create a pipeline run for pipeline with id=4191c34c-f248-48f7-b5a6-fca12e82aa8b and versionId=c64e6540-31d3-4bf4-a897-c3d501c2fd01 Create a pipeline run body Created Pipeline Run successfully with runId=7cb7c936-de54-4de0-a3d9-4899c8ec530a Created Pipeline Run with id: 7cb7c936-de54-4de0-a3d9-4899c8ec530a for pipeline with id: 4191c34c-f248-48f7-b5a6-fca12e82aa8b Waiting for pipeline run with id=7cb7c936-de54-4de0-a3d9-4899c8ec530a to be in one of '[SUCCEEDED SKIPPED FAILED CANCELED]' Get a pipeline run with id=7cb7c936-de54-4de0-a3d9-4899c8ec530a Pipeline run with id=7cb7c936-de54-4de0-a3d9-4899c8ec530a is in PENDING state, waiting... Get a pipeline run with id=7cb7c936-de54-4de0-a3d9-4899c8ec530a Pipeline run with id=7cb7c936-de54-4de0-a3d9-4899c8ec530a is in RUNNING state, waiting... Get a pipeline run with id=7cb7c936-de54-4de0-a3d9-4899c8ec530a Pipeline run with id=7cb7c936-de54-4de0-a3d9-4899c8ec530a is in RUNNING state, waiting... Get a pipeline run with id=7cb7c936-de54-4de0-a3d9-4899c8ec530a Pipeline run with id=7cb7c936-de54-4de0-a3d9-4899c8ec530a is in RUNNING state, waiting... Get a pipeline run with id=7cb7c936-de54-4de0-a3d9-4899c8ec530a Pipeline run with id=7cb7c936-de54-4de0-a3d9-4899c8ec530a is in RUNNING state, waiting... Get a pipeline run with id=7cb7c936-de54-4de0-a3d9-4899c8ec530a Pipeline run with id=7cb7c936-de54-4de0-a3d9-4899c8ec530a is in RUNNING state, waiting... Get a pipeline run with id=7cb7c936-de54-4de0-a3d9-4899c8ec530a Pipeline run with id=7cb7c936-de54-4de0-a3d9-4899c8ec530a is in RUNNING state, waiting... Get a pipeline run with id=7cb7c936-de54-4de0-a3d9-4899c8ec530a Pipeline run with id=7cb7c936-de54-4de0-a3d9-4899c8ec530a is in RUNNING state, waiting... Get a pipeline run with id=7cb7c936-de54-4de0-a3d9-4899c8ec530a Pipeline run with id=7cb7c936-de54-4de0-a3d9-4899c8ec530a is in RUNNING state, waiting... Get a pipeline run with id=7cb7c936-de54-4de0-a3d9-4899c8ec530a Pipeline run with id=7cb7c936-de54-4de0-a3d9-4899c8ec530a reached expected state SUCCEEDED Deserializing expected compiled workflow file 'essential/component_with_pip_index_urls.yaml' for the pipeline Unmarshalling Expected Workflow YAML Unmarshalled Expected Workflow YAML Fetching updated pipeline run details for run with id=7cb7c936-de54-4de0-a3d9-4899c8ec530a Get a pipeline run with id=7cb7c936-de54-4de0-a3d9-4899c8ec530a Updated pipeline run details Pipeline run succeeded, checking if the number of tasks are what is expected < Exit [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/03/26 09:16:29.058 (45.731s) > Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/03/26 09:16:29.058 ################### Global Cleanup after each test ##################### Deleting 1 run(s) Terminate run 7cb7c936-de54-4de0-a3d9-4899c8ec530a Failed to terminate run 7cb7c936-de54-4de0-a3d9-4899c8ec530a Terminate run 7cb7c936-de54-4de0-a3d9-4899c8ec530a Deleting run 7cb7c936-de54-4de0-a3d9-4899c8ec530a Deleting 0 experiment(s) Deleting 1 pipeline(s) Deleting pipeline with id=4191c34c-f248-48f7-b5a6-fca12e82aa8b (cascade=true) Pipeline with id=4191c34c-f248-48f7-b5a6-fca12e82aa8b, DELETED < Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/03/26 09:16:29.431 (373ms) > Enter [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/03/26 09:16:29.431 < Exit [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/03/26 09:16:29.432 (0s) > Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/03/26 09:16:29.432 < Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/03/26 09:16:29.432 (0s) 2026/07/03 09:17:19 Test passed > Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/03/26 09:15:43.068 Create an experiment with name E2EExperiment-1783070143068308118 < Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/03/26 09:15:43.234 (166ms) > Enter [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/03/26 09:15:43.234 ################### Setup before each Pipeline Upload test ##################### ################### Global Setup before each test ##################### Test Context: 0x28b05cc64b00 test-secret-1 created test-secret-2 created test-secret-3 created < Exit [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/03/26 09:15:43.285 (51ms) > Enter [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/03/26 09:15:43.285 Uploading pipeline file critical/parallel_for_after_dependency.yaml Creating temp pipeline file with overridden SDK Version Uploading pipeline with name=e2e-test-1783070143234310745, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml Upload of pipeline file 'critical/parallel_for_after_dependency.yaml' successful Listing pipeline versions for pipeline 3fd01401-8e47-4199-be16-b5b3d62201ad Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml Returning pipeline run time inputs map[] Create run for pipeline with id: '3fd01401-8e47-4199-be16-b5b3d62201ad' and name: 'e2e-test-1783070143234310745' Create a pipeline run for pipeline with id=3fd01401-8e47-4199-be16-b5b3d62201ad and versionId=854c7156-4db5-41b1-a086-c51f0b2f61f8 Create a pipeline run body Created Pipeline Run successfully with runId=35874a4f-3d23-4d0d-a248-3f0544ab66bf Created Pipeline Run with id: 35874a4f-3d23-4d0d-a248-3f0544ab66bf for pipeline with id: 3fd01401-8e47-4199-be16-b5b3d62201ad Waiting for pipeline run with id=35874a4f-3d23-4d0d-a248-3f0544ab66bf to be in one of '[SUCCEEDED SKIPPED FAILED CANCELED]' Get a pipeline run with id=35874a4f-3d23-4d0d-a248-3f0544ab66bf Pipeline run with id=35874a4f-3d23-4d0d-a248-3f0544ab66bf is in PENDING state, waiting... Get a pipeline run with id=35874a4f-3d23-4d0d-a248-3f0544ab66bf Pipeline run with id=35874a4f-3d23-4d0d-a248-3f0544ab66bf is in RUNNING state, waiting... Get a pipeline run with id=35874a4f-3d23-4d0d-a248-3f0544ab66bf Pipeline run with id=35874a4f-3d23-4d0d-a248-3f0544ab66bf is in RUNNING state, waiting... Get a pipeline run with id=35874a4f-3d23-4d0d-a248-3f0544ab66bf Pipeline run with id=35874a4f-3d23-4d0d-a248-3f0544ab66bf is in RUNNING state, waiting... Get a pipeline run with id=35874a4f-3d23-4d0d-a248-3f0544ab66bf Pipeline run with id=35874a4f-3d23-4d0d-a248-3f0544ab66bf is in RUNNING state, waiting... Get a pipeline run with id=35874a4f-3d23-4d0d-a248-3f0544ab66bf Pipeline run with id=35874a4f-3d23-4d0d-a248-3f0544ab66bf is in RUNNING state, waiting... Get a pipeline run with id=35874a4f-3d23-4d0d-a248-3f0544ab66bf Pipeline run with id=35874a4f-3d23-4d0d-a248-3f0544ab66bf is in RUNNING state, waiting... Get a pipeline run with id=35874a4f-3d23-4d0d-a248-3f0544ab66bf Pipeline run with id=35874a4f-3d23-4d0d-a248-3f0544ab66bf is in RUNNING state, waiting... Get a pipeline run with id=35874a4f-3d23-4d0d-a248-3f0544ab66bf Pipeline run with id=35874a4f-3d23-4d0d-a248-3f0544ab66bf is in RUNNING state, waiting... Get a pipeline run with id=35874a4f-3d23-4d0d-a248-3f0544ab66bf Pipeline run with id=35874a4f-3d23-4d0d-a248-3f0544ab66bf is in RUNNING state, waiting... Get a pipeline run with id=35874a4f-3d23-4d0d-a248-3f0544ab66bf Pipeline run with id=35874a4f-3d23-4d0d-a248-3f0544ab66bf is in RUNNING state, waiting... Get a pipeline run with id=35874a4f-3d23-4d0d-a248-3f0544ab66bf Pipeline run with id=35874a4f-3d23-4d0d-a248-3f0544ab66bf is in RUNNING state, waiting... Get a pipeline run with id=35874a4f-3d23-4d0d-a248-3f0544ab66bf Pipeline run with id=35874a4f-3d23-4d0d-a248-3f0544ab66bf is in RUNNING state, waiting... Get a pipeline run with id=35874a4f-3d23-4d0d-a248-3f0544ab66bf Pipeline run with id=35874a4f-3d23-4d0d-a248-3f0544ab66bf is in RUNNING state, waiting... Get a pipeline run with id=35874a4f-3d23-4d0d-a248-3f0544ab66bf Pipeline run with id=35874a4f-3d23-4d0d-a248-3f0544ab66bf is in RUNNING state, waiting... Get a pipeline run with id=35874a4f-3d23-4d0d-a248-3f0544ab66bf Pipeline run with id=35874a4f-3d23-4d0d-a248-3f0544ab66bf is in RUNNING state, waiting... Get a pipeline run with id=35874a4f-3d23-4d0d-a248-3f0544ab66bf Pipeline run with id=35874a4f-3d23-4d0d-a248-3f0544ab66bf is in RUNNING state, waiting... Get a pipeline run with id=35874a4f-3d23-4d0d-a248-3f0544ab66bf Pipeline run with id=35874a4f-3d23-4d0d-a248-3f0544ab66bf is in RUNNING state, waiting... Get a pipeline run with id=35874a4f-3d23-4d0d-a248-3f0544ab66bf Pipeline run with id=35874a4f-3d23-4d0d-a248-3f0544ab66bf is in RUNNING state, waiting... Get a pipeline run with id=35874a4f-3d23-4d0d-a248-3f0544ab66bf Pipeline run with id=35874a4f-3d23-4d0d-a248-3f0544ab66bf reached expected state SUCCEEDED Deserializing expected compiled workflow file 'critical/parallel_for_after_dependency.yaml' for the pipeline Unmarshalling Expected Workflow YAML Unmarshalled Expected Workflow YAML Fetching updated pipeline run details for run with id=35874a4f-3d23-4d0d-a248-3f0544ab66bf Get a pipeline run with id=35874a4f-3d23-4d0d-a248-3f0544ab66bf Updated pipeline run details Pipeline run succeeded, checking if the number of tasks are what is expected < Exit [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/03/26 09:17:19.041 (1m35.756s) > Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/03/26 09:17:19.042 ################### Global Cleanup after each test ##################### Deleting 1 run(s) Terminate run 35874a4f-3d23-4d0d-a248-3f0544ab66bf Failed to terminate run 35874a4f-3d23-4d0d-a248-3f0544ab66bf Terminate run 35874a4f-3d23-4d0d-a248-3f0544ab66bf Deleting run 35874a4f-3d23-4d0d-a248-3f0544ab66bf Deleting 0 experiment(s) Deleting 1 pipeline(s) Deleting pipeline with id=3fd01401-8e47-4199-be16-b5b3d62201ad (cascade=true) Pipeline with id=3fd01401-8e47-4199-be16-b5b3d62201ad, DELETED < Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/03/26 09:17:19.301 (259ms) > Enter [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/03/26 09:17:19.301 < Exit [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/03/26 09:17:19.301 (0s) > Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/03/26 09:17:19.301 < Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/03/26 09:17:19.301 (0s) 2026/07/03 09:17:24 Test passed > Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/03/26 09:15:43.068 Create an experiment with name E2EExperiment-1783070143068636976 < Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/03/26 09:15:43.234 (166ms) > Enter [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/03/26 09:15:43.234 ################### Setup before each Pipeline Upload test ##################### ################### Global Setup before each test ##################### Test Context: 0xb467a680700 Looks like test-secret-1 already exists, because creation failed due to secrets "test-secret-1" already exists Looks like test-secret-2 already exists, because creation failed due to secrets "test-secret-2" already exists Looks like test-secret-3 already exists, because creation failed due to secrets "test-secret-3" already exists < Exit [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/03/26 09:15:43.327 (92ms) > Enter [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/03/26 09:15:43.327 Uploading pipeline file critical/pipeline_with_artifact_upload_download.yaml Creating temp pipeline file with overridden SDK Version Uploading pipeline with name=e2e-test-1783070143235008112, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml Upload of pipeline file 'critical/pipeline_with_artifact_upload_download.yaml' successful Listing pipeline versions for pipeline 571e404a-7344-4b3a-b84a-bfdb22868720 Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml Returning pipeline run time inputs map[] Create run for pipeline with id: '571e404a-7344-4b3a-b84a-bfdb22868720' and name: 'e2e-test-1783070143235008112' Create a pipeline run for pipeline with id=571e404a-7344-4b3a-b84a-bfdb22868720 and versionId=fdbaeefb-6904-4305-8721-11433f0d10a7 Create a pipeline run body Created Pipeline Run successfully with runId=aa042ea0-6804-4567-bc87-3585de54bbb3 Created Pipeline Run with id: aa042ea0-6804-4567-bc87-3585de54bbb3 for pipeline with id: 571e404a-7344-4b3a-b84a-bfdb22868720 Waiting for pipeline run with id=aa042ea0-6804-4567-bc87-3585de54bbb3 to be in one of '[SUCCEEDED SKIPPED FAILED CANCELED]' Get a pipeline run with id=aa042ea0-6804-4567-bc87-3585de54bbb3 Pipeline run with id=aa042ea0-6804-4567-bc87-3585de54bbb3 is in PENDING state, waiting... Get a pipeline run with id=aa042ea0-6804-4567-bc87-3585de54bbb3 Pipeline run with id=aa042ea0-6804-4567-bc87-3585de54bbb3 is in RUNNING state, waiting... Get a pipeline run with id=aa042ea0-6804-4567-bc87-3585de54bbb3 Pipeline run with id=aa042ea0-6804-4567-bc87-3585de54bbb3 is in RUNNING state, waiting... Get a pipeline run with id=aa042ea0-6804-4567-bc87-3585de54bbb3 Pipeline run with id=aa042ea0-6804-4567-bc87-3585de54bbb3 is in RUNNING state, waiting... Get a pipeline run with id=aa042ea0-6804-4567-bc87-3585de54bbb3 Pipeline run with id=aa042ea0-6804-4567-bc87-3585de54bbb3 is in RUNNING state, waiting... Get a pipeline run with id=aa042ea0-6804-4567-bc87-3585de54bbb3 Pipeline run with id=aa042ea0-6804-4567-bc87-3585de54bbb3 is in RUNNING state, waiting... Get a pipeline run with id=aa042ea0-6804-4567-bc87-3585de54bbb3 Pipeline run with id=aa042ea0-6804-4567-bc87-3585de54bbb3 is in RUNNING state, waiting... Get a pipeline run with id=aa042ea0-6804-4567-bc87-3585de54bbb3 Pipeline run with id=aa042ea0-6804-4567-bc87-3585de54bbb3 is in RUNNING state, waiting... Get a pipeline run with id=aa042ea0-6804-4567-bc87-3585de54bbb3 Pipeline run with id=aa042ea0-6804-4567-bc87-3585de54bbb3 is in RUNNING state, waiting... Get a pipeline run with id=aa042ea0-6804-4567-bc87-3585de54bbb3 Pipeline run with id=aa042ea0-6804-4567-bc87-3585de54bbb3 is in RUNNING state, waiting... Get a pipeline run with id=aa042ea0-6804-4567-bc87-3585de54bbb3 Pipeline run with id=aa042ea0-6804-4567-bc87-3585de54bbb3 is in RUNNING state, waiting... Get a pipeline run with id=aa042ea0-6804-4567-bc87-3585de54bbb3 Pipeline run with id=aa042ea0-6804-4567-bc87-3585de54bbb3 is in RUNNING state, waiting... Get a pipeline run with id=aa042ea0-6804-4567-bc87-3585de54bbb3 Pipeline run with id=aa042ea0-6804-4567-bc87-3585de54bbb3 is in RUNNING state, waiting... Get a pipeline run with id=aa042ea0-6804-4567-bc87-3585de54bbb3 Pipeline run with id=aa042ea0-6804-4567-bc87-3585de54bbb3 is in RUNNING state, waiting... Get a pipeline run with id=aa042ea0-6804-4567-bc87-3585de54bbb3 Pipeline run with id=aa042ea0-6804-4567-bc87-3585de54bbb3 is in RUNNING state, waiting... Get a pipeline run with id=aa042ea0-6804-4567-bc87-3585de54bbb3 Pipeline run with id=aa042ea0-6804-4567-bc87-3585de54bbb3 is in RUNNING state, waiting... Get a pipeline run with id=aa042ea0-6804-4567-bc87-3585de54bbb3 Pipeline run with id=aa042ea0-6804-4567-bc87-3585de54bbb3 is in RUNNING state, waiting... Get a pipeline run with id=aa042ea0-6804-4567-bc87-3585de54bbb3 Pipeline run with id=aa042ea0-6804-4567-bc87-3585de54bbb3 is in RUNNING state, waiting... Get a pipeline run with id=aa042ea0-6804-4567-bc87-3585de54bbb3 Pipeline run with id=aa042ea0-6804-4567-bc87-3585de54bbb3 is in RUNNING state, waiting... Get a pipeline run with id=aa042ea0-6804-4567-bc87-3585de54bbb3 Pipeline run with id=aa042ea0-6804-4567-bc87-3585de54bbb3 is in RUNNING state, waiting... Get a pipeline run with id=aa042ea0-6804-4567-bc87-3585de54bbb3 Pipeline run with id=aa042ea0-6804-4567-bc87-3585de54bbb3 reached expected state SUCCEEDED Deserializing expected compiled workflow file 'critical/pipeline_with_artifact_upload_download.yaml' for the pipeline Unmarshalling Expected Workflow YAML Unmarshalled Expected Workflow YAML Fetching updated pipeline run details for run with id=aa042ea0-6804-4567-bc87-3585de54bbb3 Get a pipeline run with id=aa042ea0-6804-4567-bc87-3585de54bbb3 Updated pipeline run details Pipeline run succeeded, checking if the number of tasks are what is expected < Exit [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/03/26 09:17:24.047 (1m40.72s) > Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/03/26 09:17:24.047 ################### Global Cleanup after each test ##################### Deleting 1 run(s) Terminate run aa042ea0-6804-4567-bc87-3585de54bbb3 Failed to terminate run aa042ea0-6804-4567-bc87-3585de54bbb3 Terminate run aa042ea0-6804-4567-bc87-3585de54bbb3 Deleting run aa042ea0-6804-4567-bc87-3585de54bbb3 Deleting 0 experiment(s) Deleting 1 pipeline(s) Deleting pipeline with id=571e404a-7344-4b3a-b84a-bfdb22868720 (cascade=true) Pipeline with id=571e404a-7344-4b3a-b84a-bfdb22868720, DELETED < Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/03/26 09:17:24.249 (202ms) > Enter [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/03/26 09:17:24.249 < Exit [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/03/26 09:17:24.249 (0s) > Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/03/26 09:17:24.249 < Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/03/26 09:17:24.249 (0s) 2026/07/03 09:17:55 Test passed > Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/03/26 09:15:43.068 Create an experiment with name E2EExperiment-1783070143068293068 < Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/03/26 09:15:43.238 (170ms) > Enter [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/03/26 09:15:43.238 ################### Setup before each Pipeline Upload test ##################### ################### Global Setup before each test ##################### Test Context: 0x2706a358900 Looks like test-secret-1 already exists, because creation failed due to secrets "test-secret-1" already exists Looks like test-secret-2 already exists, because creation failed due to secrets "test-secret-2" already exists Looks like test-secret-3 already exists, because creation failed due to secrets "test-secret-3" already exists < Exit [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/03/26 09:15:43.332 (94ms) > Enter [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/03/26 09:15:43.332 Uploading pipeline file critical/flip_coin.yaml Creating temp pipeline file with overridden SDK Version Uploading pipeline with name=e2e-test-1783070143238377424, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml Upload of pipeline file 'critical/flip_coin.yaml' successful Listing pipeline versions for pipeline 1585453b-9fa9-4a0e-99af-0fcf58c67ccc Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml Returning pipeline run time inputs map[] Create run for pipeline with id: '1585453b-9fa9-4a0e-99af-0fcf58c67ccc' and name: 'e2e-test-1783070143238377424' Create a pipeline run for pipeline with id=1585453b-9fa9-4a0e-99af-0fcf58c67ccc and versionId=3539798e-977f-4ee3-9722-1ae369145b07 Create a pipeline run body Created Pipeline Run successfully with runId=dbc069b7-3302-48e2-95d8-867a5c79f916 Created Pipeline Run with id: dbc069b7-3302-48e2-95d8-867a5c79f916 for pipeline with id: 1585453b-9fa9-4a0e-99af-0fcf58c67ccc Waiting for pipeline run with id=dbc069b7-3302-48e2-95d8-867a5c79f916 to be in one of '[SUCCEEDED SKIPPED FAILED CANCELED]' Get a pipeline run with id=dbc069b7-3302-48e2-95d8-867a5c79f916 Pipeline run with id=dbc069b7-3302-48e2-95d8-867a5c79f916 is in PENDING state, waiting... Get a pipeline run with id=dbc069b7-3302-48e2-95d8-867a5c79f916 Pipeline run with id=dbc069b7-3302-48e2-95d8-867a5c79f916 is in RUNNING state, waiting... Get a pipeline run with id=dbc069b7-3302-48e2-95d8-867a5c79f916 Pipeline run with id=dbc069b7-3302-48e2-95d8-867a5c79f916 is in RUNNING state, waiting... Get a pipeline run with id=dbc069b7-3302-48e2-95d8-867a5c79f916 Pipeline run with id=dbc069b7-3302-48e2-95d8-867a5c79f916 is in RUNNING state, waiting... Get a pipeline run with id=dbc069b7-3302-48e2-95d8-867a5c79f916 Pipeline run with id=dbc069b7-3302-48e2-95d8-867a5c79f916 is in RUNNING state, waiting... Get a pipeline run with id=dbc069b7-3302-48e2-95d8-867a5c79f916 Pipeline run with id=dbc069b7-3302-48e2-95d8-867a5c79f916 is in RUNNING state, waiting... Get a pipeline run with id=dbc069b7-3302-48e2-95d8-867a5c79f916 Pipeline run with id=dbc069b7-3302-48e2-95d8-867a5c79f916 is in RUNNING state, waiting... Get a pipeline run with id=dbc069b7-3302-48e2-95d8-867a5c79f916 Pipeline run with id=dbc069b7-3302-48e2-95d8-867a5c79f916 is in RUNNING state, waiting... Get a pipeline run with id=dbc069b7-3302-48e2-95d8-867a5c79f916 Pipeline run with id=dbc069b7-3302-48e2-95d8-867a5c79f916 is in RUNNING state, waiting... Get a pipeline run with id=dbc069b7-3302-48e2-95d8-867a5c79f916 Pipeline run with id=dbc069b7-3302-48e2-95d8-867a5c79f916 is in RUNNING state, waiting... Get a pipeline run with id=dbc069b7-3302-48e2-95d8-867a5c79f916 Pipeline run with id=dbc069b7-3302-48e2-95d8-867a5c79f916 is in RUNNING state, waiting... Get a pipeline run with id=dbc069b7-3302-48e2-95d8-867a5c79f916 Pipeline run with id=dbc069b7-3302-48e2-95d8-867a5c79f916 is in RUNNING state, waiting... Get a pipeline run with id=dbc069b7-3302-48e2-95d8-867a5c79f916 Pipeline run with id=dbc069b7-3302-48e2-95d8-867a5c79f916 is in RUNNING state, waiting... Get a pipeline run with id=dbc069b7-3302-48e2-95d8-867a5c79f916 Pipeline run with id=dbc069b7-3302-48e2-95d8-867a5c79f916 is in RUNNING state, waiting... Get a pipeline run with id=dbc069b7-3302-48e2-95d8-867a5c79f916 Pipeline run with id=dbc069b7-3302-48e2-95d8-867a5c79f916 is in RUNNING state, waiting... Get a pipeline run with id=dbc069b7-3302-48e2-95d8-867a5c79f916 Pipeline run with id=dbc069b7-3302-48e2-95d8-867a5c79f916 is in RUNNING state, waiting... Get a pipeline run with id=dbc069b7-3302-48e2-95d8-867a5c79f916 Pipeline run with id=dbc069b7-3302-48e2-95d8-867a5c79f916 is in RUNNING state, waiting... Get a pipeline run with id=dbc069b7-3302-48e2-95d8-867a5c79f916 Pipeline run with id=dbc069b7-3302-48e2-95d8-867a5c79f916 is in RUNNING state, waiting... Get a pipeline run with id=dbc069b7-3302-48e2-95d8-867a5c79f916 Pipeline run with id=dbc069b7-3302-48e2-95d8-867a5c79f916 is in RUNNING state, waiting... Get a pipeline run with id=dbc069b7-3302-48e2-95d8-867a5c79f916 Pipeline run with id=dbc069b7-3302-48e2-95d8-867a5c79f916 is in RUNNING state, waiting... Get a pipeline run with id=dbc069b7-3302-48e2-95d8-867a5c79f916 Pipeline run with id=dbc069b7-3302-48e2-95d8-867a5c79f916 is in RUNNING state, waiting... Get a pipeline run with id=dbc069b7-3302-48e2-95d8-867a5c79f916 Pipeline run with id=dbc069b7-3302-48e2-95d8-867a5c79f916 is in RUNNING state, waiting... Get a pipeline run with id=dbc069b7-3302-48e2-95d8-867a5c79f916 Pipeline run with id=dbc069b7-3302-48e2-95d8-867a5c79f916 is in RUNNING state, waiting... Get a pipeline run with id=dbc069b7-3302-48e2-95d8-867a5c79f916 Pipeline run with id=dbc069b7-3302-48e2-95d8-867a5c79f916 is in RUNNING state, waiting... Get a pipeline run with id=dbc069b7-3302-48e2-95d8-867a5c79f916 Pipeline run with id=dbc069b7-3302-48e2-95d8-867a5c79f916 is in RUNNING state, waiting... Get a pipeline run with id=dbc069b7-3302-48e2-95d8-867a5c79f916 Pipeline run with id=dbc069b7-3302-48e2-95d8-867a5c79f916 is in RUNNING state, waiting... Get a pipeline run with id=dbc069b7-3302-48e2-95d8-867a5c79f916 Pipeline run with id=dbc069b7-3302-48e2-95d8-867a5c79f916 reached expected state SUCCEEDED Deserializing expected compiled workflow file 'critical/flip_coin.yaml' for the pipeline Unmarshalling Expected Workflow YAML Unmarshalled Expected Workflow YAML Fetching updated pipeline run details for run with id=dbc069b7-3302-48e2-95d8-867a5c79f916 Get a pipeline run with id=dbc069b7-3302-48e2-95d8-867a5c79f916 Updated pipeline run details Pipeline run succeeded, checking if the number of tasks are what is expected < Exit [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/03/26 09:17:54.074 (2m10.742s) > Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/03/26 09:17:54.074 ################### Global Cleanup after each test ##################### Deleting 1 run(s) Terminate run dbc069b7-3302-48e2-95d8-867a5c79f916 Failed to terminate run dbc069b7-3302-48e2-95d8-867a5c79f916 Terminate run dbc069b7-3302-48e2-95d8-867a5c79f916 Deleting run dbc069b7-3302-48e2-95d8-867a5c79f916 Deleting 0 experiment(s) Deleting 1 pipeline(s) Deleting pipeline with id=1585453b-9fa9-4a0e-99af-0fcf58c67ccc (cascade=true) Pipeline with id=1585453b-9fa9-4a0e-99af-0fcf58c67ccc, DELETED < Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/03/26 09:17:55.564 (1.491s) > Enter [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/03/26 09:17:55.565 < Exit [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/03/26 09:17:55.565 (0s) > Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/03/26 09:17:55.565 < Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/03/26 09:17:55.565 (0s) 2026/07/03 09:18:19 Test passed > Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/03/26 09:15:43.083 Create an experiment with name E2EExperiment-1783070143083149318 < Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/03/26 09:15:43.243 (161ms) > Enter [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/03/26 09:15:43.244 ################### Setup before each Pipeline Upload test ##################### ################### Global Setup before each test ##################### Test Context: 0xd39e05e2e00 Looks like test-secret-1 already exists, because creation failed due to secrets "test-secret-1" already exists Looks like test-secret-2 already exists, because creation failed due to secrets "test-secret-2" already exists Looks like test-secret-3 already exists, because creation failed due to secrets "test-secret-3" already exists < Exit [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/03/26 09:15:43.331 (87ms) > Enter [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/03/26 09:15:43.331 Uploading pipeline file essential/iris_pipeline_compiled.yaml Creating temp pipeline file with overridden SDK Version Uploading pipeline with name=e2e-test-1783070143244057301, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml Upload of pipeline file 'essential/iris_pipeline_compiled.yaml' successful Listing pipeline versions for pipeline 2eb0db01-e262-462e-8aa1-96118b364eac Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml Returning pipeline run time inputs map[] Create run for pipeline with id: '2eb0db01-e262-462e-8aa1-96118b364eac' and name: 'e2e-test-1783070143244057301' Create a pipeline run for pipeline with id=2eb0db01-e262-462e-8aa1-96118b364eac and versionId=c9941211-694d-4644-9081-6620ce925ade Create a pipeline run body Created Pipeline Run successfully with runId=902dcd8e-80a9-43b6-97c4-04a161a1c97b Created Pipeline Run with id: 902dcd8e-80a9-43b6-97c4-04a161a1c97b for pipeline with id: 2eb0db01-e262-462e-8aa1-96118b364eac Waiting for pipeline run with id=902dcd8e-80a9-43b6-97c4-04a161a1c97b to be in one of '[SUCCEEDED SKIPPED FAILED CANCELED]' Get a pipeline run with id=902dcd8e-80a9-43b6-97c4-04a161a1c97b Pipeline run with id=902dcd8e-80a9-43b6-97c4-04a161a1c97b is in PENDING state, waiting... Get a pipeline run with id=902dcd8e-80a9-43b6-97c4-04a161a1c97b Pipeline run with id=902dcd8e-80a9-43b6-97c4-04a161a1c97b is in RUNNING state, waiting... Get a pipeline run with id=902dcd8e-80a9-43b6-97c4-04a161a1c97b Pipeline run with id=902dcd8e-80a9-43b6-97c4-04a161a1c97b is in RUNNING state, waiting... Get a pipeline run with id=902dcd8e-80a9-43b6-97c4-04a161a1c97b Pipeline run with id=902dcd8e-80a9-43b6-97c4-04a161a1c97b is in RUNNING state, waiting... Get a pipeline run with id=902dcd8e-80a9-43b6-97c4-04a161a1c97b Pipeline run with id=902dcd8e-80a9-43b6-97c4-04a161a1c97b is in RUNNING state, waiting... Get a pipeline run with id=902dcd8e-80a9-43b6-97c4-04a161a1c97b Pipeline run with id=902dcd8e-80a9-43b6-97c4-04a161a1c97b is in RUNNING state, waiting... Get a pipeline run with id=902dcd8e-80a9-43b6-97c4-04a161a1c97b Pipeline run with id=902dcd8e-80a9-43b6-97c4-04a161a1c97b is in RUNNING state, waiting... Get a pipeline run with id=902dcd8e-80a9-43b6-97c4-04a161a1c97b Pipeline run with id=902dcd8e-80a9-43b6-97c4-04a161a1c97b is in RUNNING state, waiting... Get a pipeline run with id=902dcd8e-80a9-43b6-97c4-04a161a1c97b Pipeline run with id=902dcd8e-80a9-43b6-97c4-04a161a1c97b is in RUNNING state, waiting... Get a pipeline run with id=902dcd8e-80a9-43b6-97c4-04a161a1c97b Pipeline run with id=902dcd8e-80a9-43b6-97c4-04a161a1c97b is in RUNNING state, waiting... Get a pipeline run with id=902dcd8e-80a9-43b6-97c4-04a161a1c97b Pipeline run with id=902dcd8e-80a9-43b6-97c4-04a161a1c97b is in RUNNING state, waiting... Get a pipeline run with id=902dcd8e-80a9-43b6-97c4-04a161a1c97b Pipeline run with id=902dcd8e-80a9-43b6-97c4-04a161a1c97b is in RUNNING state, waiting... Get a pipeline run with id=902dcd8e-80a9-43b6-97c4-04a161a1c97b Pipeline run with id=902dcd8e-80a9-43b6-97c4-04a161a1c97b is in RUNNING state, waiting... Get a pipeline run with id=902dcd8e-80a9-43b6-97c4-04a161a1c97b Pipeline run with id=902dcd8e-80a9-43b6-97c4-04a161a1c97b is in RUNNING state, waiting... Get a pipeline run with id=902dcd8e-80a9-43b6-97c4-04a161a1c97b Pipeline run with id=902dcd8e-80a9-43b6-97c4-04a161a1c97b is in RUNNING state, waiting... Get a pipeline run with id=902dcd8e-80a9-43b6-97c4-04a161a1c97b Pipeline run with id=902dcd8e-80a9-43b6-97c4-04a161a1c97b is in RUNNING state, waiting... Get a pipeline run with id=902dcd8e-80a9-43b6-97c4-04a161a1c97b Pipeline run with id=902dcd8e-80a9-43b6-97c4-04a161a1c97b is in RUNNING state, waiting... Get a pipeline run with id=902dcd8e-80a9-43b6-97c4-04a161a1c97b Pipeline run with id=902dcd8e-80a9-43b6-97c4-04a161a1c97b is in RUNNING state, waiting... Get a pipeline run with id=902dcd8e-80a9-43b6-97c4-04a161a1c97b Pipeline run with id=902dcd8e-80a9-43b6-97c4-04a161a1c97b is in RUNNING state, waiting... Get a pipeline run with id=902dcd8e-80a9-43b6-97c4-04a161a1c97b Pipeline run with id=902dcd8e-80a9-43b6-97c4-04a161a1c97b is in RUNNING state, waiting... Get a pipeline run with id=902dcd8e-80a9-43b6-97c4-04a161a1c97b Pipeline run with id=902dcd8e-80a9-43b6-97c4-04a161a1c97b is in RUNNING state, waiting... Get a pipeline run with id=902dcd8e-80a9-43b6-97c4-04a161a1c97b Pipeline run with id=902dcd8e-80a9-43b6-97c4-04a161a1c97b is in RUNNING state, waiting... Get a pipeline run with id=902dcd8e-80a9-43b6-97c4-04a161a1c97b Pipeline run with id=902dcd8e-80a9-43b6-97c4-04a161a1c97b is in RUNNING state, waiting... Get a pipeline run with id=902dcd8e-80a9-43b6-97c4-04a161a1c97b Pipeline run with id=902dcd8e-80a9-43b6-97c4-04a161a1c97b is in RUNNING state, waiting... Get a pipeline run with id=902dcd8e-80a9-43b6-97c4-04a161a1c97b Pipeline run with id=902dcd8e-80a9-43b6-97c4-04a161a1c97b is in RUNNING state, waiting... Get a pipeline run with id=902dcd8e-80a9-43b6-97c4-04a161a1c97b Pipeline run with id=902dcd8e-80a9-43b6-97c4-04a161a1c97b is in RUNNING state, waiting... Get a pipeline run with id=902dcd8e-80a9-43b6-97c4-04a161a1c97b Pipeline run with id=902dcd8e-80a9-43b6-97c4-04a161a1c97b is in RUNNING state, waiting... Get a pipeline run with id=902dcd8e-80a9-43b6-97c4-04a161a1c97b Pipeline run with id=902dcd8e-80a9-43b6-97c4-04a161a1c97b is in RUNNING state, waiting... Get a pipeline run with id=902dcd8e-80a9-43b6-97c4-04a161a1c97b Pipeline run with id=902dcd8e-80a9-43b6-97c4-04a161a1c97b is in RUNNING state, waiting... Get a pipeline run with id=902dcd8e-80a9-43b6-97c4-04a161a1c97b Pipeline run with id=902dcd8e-80a9-43b6-97c4-04a161a1c97b is in RUNNING state, waiting... Get a pipeline run with id=902dcd8e-80a9-43b6-97c4-04a161a1c97b Pipeline run with id=902dcd8e-80a9-43b6-97c4-04a161a1c97b is in RUNNING state, waiting... Get a pipeline run with id=902dcd8e-80a9-43b6-97c4-04a161a1c97b Pipeline run with id=902dcd8e-80a9-43b6-97c4-04a161a1c97b reached expected state SUCCEEDED Deserializing expected compiled workflow file 'essential/iris_pipeline_compiled.yaml' for the pipeline Unmarshalling Expected Workflow YAML Unmarshalled Expected Workflow YAML Fetching updated pipeline run details for run with id=902dcd8e-80a9-43b6-97c4-04a161a1c97b Get a pipeline run with id=902dcd8e-80a9-43b6-97c4-04a161a1c97b Updated pipeline run details Pipeline run succeeded, checking if the number of tasks are what is expected < Exit [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/03/26 09:18:19.026 (2m35.695s) > Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/03/26 09:18:19.026 ################### Global Cleanup after each test ##################### Deleting 1 run(s) Terminate run 902dcd8e-80a9-43b6-97c4-04a161a1c97b Failed to terminate run 902dcd8e-80a9-43b6-97c4-04a161a1c97b Terminate run 902dcd8e-80a9-43b6-97c4-04a161a1c97b Deleting run 902dcd8e-80a9-43b6-97c4-04a161a1c97b Deleting 0 experiment(s) Deleting 1 pipeline(s) Deleting pipeline with id=2eb0db01-e262-462e-8aa1-96118b364eac (cascade=true) Pipeline with id=2eb0db01-e262-462e-8aa1-96118b364eac, DELETED < Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/03/26 09:18:19.217 (191ms) > Enter [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/03/26 09:18:19.217 < Exit [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/03/26 09:18:19.217 (0s) > Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/03/26 09:18:19.218 < Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/03/26 09:18:19.218 (0s)