2026/09/07 21:24:36 Test passed > Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 09/07/26 21:22:00.657 Create an experiment with name E2EExperiment-1788816120657056509 < Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 09/07/26 21:22:00.939 (283ms) > Enter [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 09/07/26 21:22:00.939 ################### Setup before each Pipeline Upload test ##################### ################### Global Setup before each test ##################### Test Context: 0x332b8e306380 test-secret-1 created test-secret-2 created test-secret-3 created < Exit [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 09/07/26 21:22:01.035 (96ms) > Enter [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 09/07/26 21:22:01.035 Uploading pipeline file critical/flip_coin.yaml Creating temp pipeline file with overridden SDK Version Uploading pipeline with name=e2e-test-1788816120939908879, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml Upload of pipeline file 'critical/flip_coin.yaml' successful Listing pipeline versions for pipeline a93d0767-8014-43e9-b47a-a599c6981967 Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml Returning pipeline run time inputs map[] Create run for pipeline with id: 'a93d0767-8014-43e9-b47a-a599c6981967' and name: 'e2e-test-1788816120939908879' Create a pipeline run for pipeline with id=a93d0767-8014-43e9-b47a-a599c6981967 and versionId=cf657a17-c017-415f-8ff9-7fc099c70c43 Create a pipeline run body Created Pipeline Run successfully with runId=fde45cdf-ef88-47f7-841f-fddb510e77bd Created Pipeline Run with id: fde45cdf-ef88-47f7-841f-fddb510e77bd for pipeline with id: a93d0767-8014-43e9-b47a-a599c6981967 Waiting for pipeline run with id=fde45cdf-ef88-47f7-841f-fddb510e77bd to be in one of '[SUCCEEDED SKIPPED FAILED CANCELED]' Get a pipeline run with id=fde45cdf-ef88-47f7-841f-fddb510e77bd Pipeline run with id=fde45cdf-ef88-47f7-841f-fddb510e77bd is in PENDING state, waiting... Get a pipeline run with id=fde45cdf-ef88-47f7-841f-fddb510e77bd Pipeline run with id=fde45cdf-ef88-47f7-841f-fddb510e77bd is in RUNNING state, waiting... Get a pipeline run with id=fde45cdf-ef88-47f7-841f-fddb510e77bd Pipeline run with id=fde45cdf-ef88-47f7-841f-fddb510e77bd is in RUNNING state, waiting... Get a pipeline run with id=fde45cdf-ef88-47f7-841f-fddb510e77bd Pipeline run with id=fde45cdf-ef88-47f7-841f-fddb510e77bd is in RUNNING state, waiting... Get a pipeline run with id=fde45cdf-ef88-47f7-841f-fddb510e77bd Pipeline run with id=fde45cdf-ef88-47f7-841f-fddb510e77bd is in RUNNING state, waiting... Get a pipeline run with id=fde45cdf-ef88-47f7-841f-fddb510e77bd Pipeline run with id=fde45cdf-ef88-47f7-841f-fddb510e77bd is in RUNNING state, waiting... Get a pipeline run with id=fde45cdf-ef88-47f7-841f-fddb510e77bd Pipeline run with id=fde45cdf-ef88-47f7-841f-fddb510e77bd is in RUNNING state, waiting... Get a pipeline run with id=fde45cdf-ef88-47f7-841f-fddb510e77bd Pipeline run with id=fde45cdf-ef88-47f7-841f-fddb510e77bd is in RUNNING state, waiting... Get a pipeline run with id=fde45cdf-ef88-47f7-841f-fddb510e77bd Pipeline run with id=fde45cdf-ef88-47f7-841f-fddb510e77bd is in RUNNING state, waiting... Get a pipeline run with id=fde45cdf-ef88-47f7-841f-fddb510e77bd Pipeline run with id=fde45cdf-ef88-47f7-841f-fddb510e77bd is in RUNNING state, waiting... Get a pipeline run with id=fde45cdf-ef88-47f7-841f-fddb510e77bd Pipeline run with id=fde45cdf-ef88-47f7-841f-fddb510e77bd is in RUNNING state, waiting... Get a pipeline run with id=fde45cdf-ef88-47f7-841f-fddb510e77bd Pipeline run with id=fde45cdf-ef88-47f7-841f-fddb510e77bd is in RUNNING state, waiting... Get a pipeline run with id=fde45cdf-ef88-47f7-841f-fddb510e77bd Pipeline run with id=fde45cdf-ef88-47f7-841f-fddb510e77bd is in RUNNING state, waiting... Get a pipeline run with id=fde45cdf-ef88-47f7-841f-fddb510e77bd Pipeline run with id=fde45cdf-ef88-47f7-841f-fddb510e77bd is in RUNNING state, waiting... Get a pipeline run with id=fde45cdf-ef88-47f7-841f-fddb510e77bd Pipeline run with id=fde45cdf-ef88-47f7-841f-fddb510e77bd is in RUNNING state, waiting... Get a pipeline run with id=fde45cdf-ef88-47f7-841f-fddb510e77bd Pipeline run with id=fde45cdf-ef88-47f7-841f-fddb510e77bd is in RUNNING state, waiting... Get a pipeline run with id=fde45cdf-ef88-47f7-841f-fddb510e77bd Pipeline run with id=fde45cdf-ef88-47f7-841f-fddb510e77bd is in RUNNING state, waiting... Get a pipeline run with id=fde45cdf-ef88-47f7-841f-fddb510e77bd Pipeline run with id=fde45cdf-ef88-47f7-841f-fddb510e77bd is in RUNNING state, waiting... Get a pipeline run with id=fde45cdf-ef88-47f7-841f-fddb510e77bd Pipeline run with id=fde45cdf-ef88-47f7-841f-fddb510e77bd is in RUNNING state, waiting... Get a pipeline run with id=fde45cdf-ef88-47f7-841f-fddb510e77bd Pipeline run with id=fde45cdf-ef88-47f7-841f-fddb510e77bd is in RUNNING state, waiting... Get a pipeline run with id=fde45cdf-ef88-47f7-841f-fddb510e77bd Pipeline run with id=fde45cdf-ef88-47f7-841f-fddb510e77bd is in RUNNING state, waiting... Get a pipeline run with id=fde45cdf-ef88-47f7-841f-fddb510e77bd Pipeline run with id=fde45cdf-ef88-47f7-841f-fddb510e77bd is in RUNNING state, waiting... Get a pipeline run with id=fde45cdf-ef88-47f7-841f-fddb510e77bd Pipeline run with id=fde45cdf-ef88-47f7-841f-fddb510e77bd is in RUNNING state, waiting... Get a pipeline run with id=fde45cdf-ef88-47f7-841f-fddb510e77bd Pipeline run with id=fde45cdf-ef88-47f7-841f-fddb510e77bd is in RUNNING state, waiting... Get a pipeline run with id=fde45cdf-ef88-47f7-841f-fddb510e77bd Pipeline run with id=fde45cdf-ef88-47f7-841f-fddb510e77bd is in RUNNING state, waiting... Get a pipeline run with id=fde45cdf-ef88-47f7-841f-fddb510e77bd Pipeline run with id=fde45cdf-ef88-47f7-841f-fddb510e77bd is in RUNNING state, waiting... Get a pipeline run with id=fde45cdf-ef88-47f7-841f-fddb510e77bd Pipeline run with id=fde45cdf-ef88-47f7-841f-fddb510e77bd is in RUNNING state, waiting... Get a pipeline run with id=fde45cdf-ef88-47f7-841f-fddb510e77bd Pipeline run with id=fde45cdf-ef88-47f7-841f-fddb510e77bd is in RUNNING state, waiting... Get a pipeline run with id=fde45cdf-ef88-47f7-841f-fddb510e77bd Pipeline run with id=fde45cdf-ef88-47f7-841f-fddb510e77bd is in RUNNING state, waiting... Get a pipeline run with id=fde45cdf-ef88-47f7-841f-fddb510e77bd Pipeline run with id=fde45cdf-ef88-47f7-841f-fddb510e77bd is in RUNNING state, waiting... Get a pipeline run with id=fde45cdf-ef88-47f7-841f-fddb510e77bd Pipeline run with id=fde45cdf-ef88-47f7-841f-fddb510e77bd is in RUNNING state, waiting... Get a pipeline run with id=fde45cdf-ef88-47f7-841f-fddb510e77bd Pipeline run with id=fde45cdf-ef88-47f7-841f-fddb510e77bd reached expected state SUCCEEDED Deserializing expected compiled workflow file 'critical/flip_coin.yaml' for the pipeline Unmarshalling Expected Workflow YAML Unmarshalled Expected Workflow YAML Fetching updated pipeline run details for run with id=fde45cdf-ef88-47f7-841f-fddb510e77bd Get a pipeline run with id=fde45cdf-ef88-47f7-841f-fddb510e77bd Updated pipeline run details Pipeline run succeeded, checking if the number of tasks are what is expected < Exit [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 09/07/26 21:24:36.545 (2m35.51s) > Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 09/07/26 21:24:36.545 ################### Global Cleanup after each test ##################### Deleting 1 run(s) Terminate run fde45cdf-ef88-47f7-841f-fddb510e77bd Failed to terminate run fde45cdf-ef88-47f7-841f-fddb510e77bd Terminate run fde45cdf-ef88-47f7-841f-fddb510e77bd Deleting run fde45cdf-ef88-47f7-841f-fddb510e77bd Deleting 0 experiment(s) Deleting 1 pipeline(s) Deleting pipeline with id=a93d0767-8014-43e9-b47a-a599c6981967 (cascade=true) Pipeline with id=a93d0767-8014-43e9-b47a-a599c6981967, DELETED < Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 09/07/26 21:24:36.758 (213ms) > Enter [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 09/07/26 21:24:36.758 < Exit [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 09/07/26 21:24:36.758 (0s) > Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 09/07/26 21:24:36.759 < Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 09/07/26 21:24:36.759 (0s) 2026/09/07 21:23:11 Test passed > Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 09/07/26 21:22:00.657 Create an experiment with name E2EExperiment-1788816120657696463 < Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 09/07/26 21:22:00.939 (282ms) > Enter [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 09/07/26 21:22:00.939 ################### Setup before each Pipeline Upload test ##################### ################### Global Setup before each test ##################### Test Context: 0x22247fe16a80 Looks like test-secret-1 already exists, because creation failed due to secrets "test-secret-1" already exists Looks like test-secret-2 already exists, because creation failed due to secrets "test-secret-2" already exists Looks like test-secret-3 already exists, because creation failed due to secrets "test-secret-3" already exists < Exit [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 09/07/26 21:22:01.091 (152ms) > Enter [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 09/07/26 21:22:01.092 Uploading pipeline file essential/component_with_pip_index_urls.yaml Creating temp pipeline file with overridden SDK Version Uploading pipeline with name=e2e-test-1788816120939958500, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml Upload of pipeline file 'essential/component_with_pip_index_urls.yaml' successful Listing pipeline versions for pipeline c1b2ae6b-4e19-49ea-8be9-7814d81914a7 Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml Returning pipeline run time inputs map[] Create run for pipeline with id: 'c1b2ae6b-4e19-49ea-8be9-7814d81914a7' and name: 'e2e-test-1788816120939958500' Create a pipeline run for pipeline with id=c1b2ae6b-4e19-49ea-8be9-7814d81914a7 and versionId=85e3b106-c0fd-4c56-9bdf-132d3dd22bfa Create a pipeline run body Created Pipeline Run successfully with runId=e8f823bd-0df8-457e-a2c6-b9c2daa3bc3e Created Pipeline Run with id: e8f823bd-0df8-457e-a2c6-b9c2daa3bc3e for pipeline with id: c1b2ae6b-4e19-49ea-8be9-7814d81914a7 Waiting for pipeline run with id=e8f823bd-0df8-457e-a2c6-b9c2daa3bc3e to be in one of '[SUCCEEDED SKIPPED FAILED CANCELED]' Get a pipeline run with id=e8f823bd-0df8-457e-a2c6-b9c2daa3bc3e Pipeline run with id=e8f823bd-0df8-457e-a2c6-b9c2daa3bc3e is in PENDING state, waiting... Get a pipeline run with id=e8f823bd-0df8-457e-a2c6-b9c2daa3bc3e Pipeline run with id=e8f823bd-0df8-457e-a2c6-b9c2daa3bc3e is in RUNNING state, waiting... Get a pipeline run with id=e8f823bd-0df8-457e-a2c6-b9c2daa3bc3e Pipeline run with id=e8f823bd-0df8-457e-a2c6-b9c2daa3bc3e is in RUNNING state, waiting... Get a pipeline run with id=e8f823bd-0df8-457e-a2c6-b9c2daa3bc3e Pipeline run with id=e8f823bd-0df8-457e-a2c6-b9c2daa3bc3e is in RUNNING state, waiting... Get a pipeline run with id=e8f823bd-0df8-457e-a2c6-b9c2daa3bc3e Pipeline run with id=e8f823bd-0df8-457e-a2c6-b9c2daa3bc3e is in RUNNING state, waiting... Get a pipeline run with id=e8f823bd-0df8-457e-a2c6-b9c2daa3bc3e Pipeline run with id=e8f823bd-0df8-457e-a2c6-b9c2daa3bc3e is in RUNNING state, waiting... Get a pipeline run with id=e8f823bd-0df8-457e-a2c6-b9c2daa3bc3e Pipeline run with id=e8f823bd-0df8-457e-a2c6-b9c2daa3bc3e is in RUNNING state, waiting... Get a pipeline run with id=e8f823bd-0df8-457e-a2c6-b9c2daa3bc3e Pipeline run with id=e8f823bd-0df8-457e-a2c6-b9c2daa3bc3e is in RUNNING state, waiting... Get a pipeline run with id=e8f823bd-0df8-457e-a2c6-b9c2daa3bc3e Pipeline run with id=e8f823bd-0df8-457e-a2c6-b9c2daa3bc3e is in RUNNING state, waiting... Get a pipeline run with id=e8f823bd-0df8-457e-a2c6-b9c2daa3bc3e Pipeline run with id=e8f823bd-0df8-457e-a2c6-b9c2daa3bc3e is in RUNNING state, waiting... Get a pipeline run with id=e8f823bd-0df8-457e-a2c6-b9c2daa3bc3e Pipeline run with id=e8f823bd-0df8-457e-a2c6-b9c2daa3bc3e is in RUNNING state, waiting... Get a pipeline run with id=e8f823bd-0df8-457e-a2c6-b9c2daa3bc3e Pipeline run with id=e8f823bd-0df8-457e-a2c6-b9c2daa3bc3e is in RUNNING state, waiting... Get a pipeline run with id=e8f823bd-0df8-457e-a2c6-b9c2daa3bc3e Pipeline run with id=e8f823bd-0df8-457e-a2c6-b9c2daa3bc3e is in RUNNING state, waiting... Get a pipeline run with id=e8f823bd-0df8-457e-a2c6-b9c2daa3bc3e Pipeline run with id=e8f823bd-0df8-457e-a2c6-b9c2daa3bc3e is in RUNNING state, waiting... Get a pipeline run with id=e8f823bd-0df8-457e-a2c6-b9c2daa3bc3e Pipeline run with id=e8f823bd-0df8-457e-a2c6-b9c2daa3bc3e reached expected state SUCCEEDED Deserializing expected compiled workflow file 'essential/component_with_pip_index_urls.yaml' for the pipeline Unmarshalling Expected Workflow YAML Unmarshalled Expected Workflow YAML Fetching updated pipeline run details for run with id=e8f823bd-0df8-457e-a2c6-b9c2daa3bc3e Get a pipeline run with id=e8f823bd-0df8-457e-a2c6-b9c2daa3bc3e Updated pipeline run details Pipeline run succeeded, checking if the number of tasks are what is expected < Exit [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 09/07/26 21:23:11.515 (1m10.424s) > Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 09/07/26 21:23:11.516 ################### Global Cleanup after each test ##################### Deleting 1 run(s) Terminate run e8f823bd-0df8-457e-a2c6-b9c2daa3bc3e Failed to terminate run e8f823bd-0df8-457e-a2c6-b9c2daa3bc3e Terminate run e8f823bd-0df8-457e-a2c6-b9c2daa3bc3e Deleting run e8f823bd-0df8-457e-a2c6-b9c2daa3bc3e Deleting 0 experiment(s) Deleting 1 pipeline(s) Deleting pipeline with id=c1b2ae6b-4e19-49ea-8be9-7814d81914a7 (cascade=true) Pipeline with id=c1b2ae6b-4e19-49ea-8be9-7814d81914a7, DELETED < Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 09/07/26 21:23:11.633 (117ms) > Enter [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 09/07/26 21:23:11.633 < Exit [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 09/07/26 21:23:11.633 (0s) > Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 09/07/26 21:23:11.633 < Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 09/07/26 21:23:11.633 (0s) 2026/09/07 21:23:51 Test passed > Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 09/07/26 21:22:00.657 Create an experiment with name E2EExperiment-1788816120657612222 < Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 09/07/26 21:22:00.939 (282ms) > Enter [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 09/07/26 21:22:00.939 ################### Setup before each Pipeline Upload test ##################### ################### Global Setup before each test ##################### Test Context: 0x2566243c6f00 Looks like test-secret-1 already exists, because creation failed due to secrets "test-secret-1" already exists Looks like test-secret-2 already exists, because creation failed due to secrets "test-secret-2" already exists Looks like test-secret-3 already exists, because creation failed due to secrets "test-secret-3" already exists < Exit [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 09/07/26 21:22:01.085 (146ms) > Enter [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 09/07/26 21:22:01.085 Uploading pipeline file critical/pipeline_with_artifact_upload_download.yaml Creating temp pipeline file with overridden SDK Version Uploading pipeline with name=e2e-test-1788816120939958510, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml Upload of pipeline file 'critical/pipeline_with_artifact_upload_download.yaml' successful Listing pipeline versions for pipeline 98ff0b4c-9bea-4cb3-90a6-9b600561fb40 Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml Returning pipeline run time inputs map[] Create run for pipeline with id: '98ff0b4c-9bea-4cb3-90a6-9b600561fb40' and name: 'e2e-test-1788816120939958510' Create a pipeline run for pipeline with id=98ff0b4c-9bea-4cb3-90a6-9b600561fb40 and versionId=244ad06c-b4e9-4ff4-8c6b-bea1660c67a8 Create a pipeline run body Created Pipeline Run successfully with runId=ed0d3f9d-4fde-4bd5-aee7-e786838b4332 Created Pipeline Run with id: ed0d3f9d-4fde-4bd5-aee7-e786838b4332 for pipeline with id: 98ff0b4c-9bea-4cb3-90a6-9b600561fb40 Waiting for pipeline run with id=ed0d3f9d-4fde-4bd5-aee7-e786838b4332 to be in one of '[SUCCEEDED SKIPPED FAILED CANCELED]' Get a pipeline run with id=ed0d3f9d-4fde-4bd5-aee7-e786838b4332 Pipeline run with id=ed0d3f9d-4fde-4bd5-aee7-e786838b4332 is in PENDING state, waiting... Get a pipeline run with id=ed0d3f9d-4fde-4bd5-aee7-e786838b4332 Pipeline run with id=ed0d3f9d-4fde-4bd5-aee7-e786838b4332 is in RUNNING state, waiting... Get a pipeline run with id=ed0d3f9d-4fde-4bd5-aee7-e786838b4332 Pipeline run with id=ed0d3f9d-4fde-4bd5-aee7-e786838b4332 is in RUNNING state, waiting... Get a pipeline run with id=ed0d3f9d-4fde-4bd5-aee7-e786838b4332 Pipeline run with id=ed0d3f9d-4fde-4bd5-aee7-e786838b4332 is in RUNNING state, waiting... Get a pipeline run with id=ed0d3f9d-4fde-4bd5-aee7-e786838b4332 Pipeline run with id=ed0d3f9d-4fde-4bd5-aee7-e786838b4332 is in RUNNING state, waiting... Get a pipeline run with id=ed0d3f9d-4fde-4bd5-aee7-e786838b4332 Pipeline run with id=ed0d3f9d-4fde-4bd5-aee7-e786838b4332 is in RUNNING state, waiting... Get a pipeline run with id=ed0d3f9d-4fde-4bd5-aee7-e786838b4332 Pipeline run with id=ed0d3f9d-4fde-4bd5-aee7-e786838b4332 is in RUNNING state, waiting... Get a pipeline run with id=ed0d3f9d-4fde-4bd5-aee7-e786838b4332 Pipeline run with id=ed0d3f9d-4fde-4bd5-aee7-e786838b4332 is in RUNNING state, waiting... Get a pipeline run with id=ed0d3f9d-4fde-4bd5-aee7-e786838b4332 Pipeline run with id=ed0d3f9d-4fde-4bd5-aee7-e786838b4332 is in RUNNING state, waiting... Get a pipeline run with id=ed0d3f9d-4fde-4bd5-aee7-e786838b4332 Pipeline run with id=ed0d3f9d-4fde-4bd5-aee7-e786838b4332 is in RUNNING state, waiting... Get a pipeline run with id=ed0d3f9d-4fde-4bd5-aee7-e786838b4332 Pipeline run with id=ed0d3f9d-4fde-4bd5-aee7-e786838b4332 is in RUNNING state, waiting... Get a pipeline run with id=ed0d3f9d-4fde-4bd5-aee7-e786838b4332 Pipeline run with id=ed0d3f9d-4fde-4bd5-aee7-e786838b4332 is in RUNNING state, waiting... Get a pipeline run with id=ed0d3f9d-4fde-4bd5-aee7-e786838b4332 Pipeline run with id=ed0d3f9d-4fde-4bd5-aee7-e786838b4332 is in RUNNING state, waiting... Get a pipeline run with id=ed0d3f9d-4fde-4bd5-aee7-e786838b4332 Pipeline run with id=ed0d3f9d-4fde-4bd5-aee7-e786838b4332 is in RUNNING state, waiting... Get a pipeline run with id=ed0d3f9d-4fde-4bd5-aee7-e786838b4332 Pipeline run with id=ed0d3f9d-4fde-4bd5-aee7-e786838b4332 is in RUNNING state, waiting... Get a pipeline run with id=ed0d3f9d-4fde-4bd5-aee7-e786838b4332 Pipeline run with id=ed0d3f9d-4fde-4bd5-aee7-e786838b4332 is in RUNNING state, waiting... Get a pipeline run with id=ed0d3f9d-4fde-4bd5-aee7-e786838b4332 Pipeline run with id=ed0d3f9d-4fde-4bd5-aee7-e786838b4332 is in RUNNING state, waiting... Get a pipeline run with id=ed0d3f9d-4fde-4bd5-aee7-e786838b4332 Pipeline run with id=ed0d3f9d-4fde-4bd5-aee7-e786838b4332 is in RUNNING state, waiting... Get a pipeline run with id=ed0d3f9d-4fde-4bd5-aee7-e786838b4332 Pipeline run with id=ed0d3f9d-4fde-4bd5-aee7-e786838b4332 is in RUNNING state, waiting... Get a pipeline run with id=ed0d3f9d-4fde-4bd5-aee7-e786838b4332 Pipeline run with id=ed0d3f9d-4fde-4bd5-aee7-e786838b4332 is in RUNNING state, waiting... Get a pipeline run with id=ed0d3f9d-4fde-4bd5-aee7-e786838b4332 Pipeline run with id=ed0d3f9d-4fde-4bd5-aee7-e786838b4332 is in RUNNING state, waiting... Get a pipeline run with id=ed0d3f9d-4fde-4bd5-aee7-e786838b4332 Pipeline run with id=ed0d3f9d-4fde-4bd5-aee7-e786838b4332 is in RUNNING state, waiting... Get a pipeline run with id=ed0d3f9d-4fde-4bd5-aee7-e786838b4332 Pipeline run with id=ed0d3f9d-4fde-4bd5-aee7-e786838b4332 reached expected state SUCCEEDED Deserializing expected compiled workflow file 'critical/pipeline_with_artifact_upload_download.yaml' for the pipeline Unmarshalling Expected Workflow YAML Unmarshalled Expected Workflow YAML Fetching updated pipeline run details for run with id=ed0d3f9d-4fde-4bd5-aee7-e786838b4332 Get a pipeline run with id=ed0d3f9d-4fde-4bd5-aee7-e786838b4332 Updated pipeline run details Pipeline run succeeded, checking if the number of tasks are what is expected < Exit [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 09/07/26 21:23:51.569 (1m50.484s) > Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 09/07/26 21:23:51.569 ################### Global Cleanup after each test ##################### Deleting 1 run(s) Terminate run ed0d3f9d-4fde-4bd5-aee7-e786838b4332 Failed to terminate run ed0d3f9d-4fde-4bd5-aee7-e786838b4332 Terminate run ed0d3f9d-4fde-4bd5-aee7-e786838b4332 Deleting run ed0d3f9d-4fde-4bd5-aee7-e786838b4332 Deleting 0 experiment(s) Deleting 1 pipeline(s) Deleting pipeline with id=98ff0b4c-9bea-4cb3-90a6-9b600561fb40 (cascade=true) Pipeline with id=98ff0b4c-9bea-4cb3-90a6-9b600561fb40, DELETED < Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 09/07/26 21:23:51.707 (138ms) > Enter [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 09/07/26 21:23:51.708 < Exit [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 09/07/26 21:23:51.708 (0s) > Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 09/07/26 21:23:51.708 < Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 09/07/26 21:23:51.708 (0s) 2026/09/07 21:23:56 Test passed > Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 09/07/26 21:22:00.657 Create an experiment with name E2EExperiment-1788816120657382806 < Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 09/07/26 21:22:00.939 (282ms) > Enter [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 09/07/26 21:22:00.939 ################### Setup before each Pipeline Upload test ##################### ################### Global Setup before each test ##################### Test Context: 0x344d0ddc4b00 Looks like test-secret-1 already exists, because creation failed due to secrets "test-secret-1" already exists Looks like test-secret-2 already exists, because creation failed due to secrets "test-secret-2" already exists Looks like test-secret-3 already exists, because creation failed due to secrets "test-secret-3" already exists < Exit [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 09/07/26 21:22:01.075 (136ms) > Enter [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 09/07/26 21:22:01.076 Uploading pipeline file critical/parallel_for_after_dependency.yaml Creating temp pipeline file with overridden SDK Version Uploading pipeline with name=e2e-test-1788816120939908879, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml [FAILED] Failure recorded during attempt 1: Failed to upload pipeline critical/parallel_for_after_dependency.yaml Expected <*util.UserError | 0x344d0e9a57d0>: Failed to upload pipeline. Params: '&{<nil> <nil> 0x344d0ddc4b18 <nil> <nil> 0x344d0e6ad020 30000000000 context.Background.WithDeadline(2026-09-07 21:22:36.076657732 +0000 UTC m=+35.825260550 [34.964309419s]) <nil>}': (code: 0) { internalError: <*errors.withStack | 0x344d0e8ff6b0>{ error: <*errors.withMessage | 0x344d0e8d3b80>{ cause: <*errors.errorString | 0x344d0e572190>{s: " (code: 0)"}, msg: "Failed to upload pipeline. Params: '&{<nil> <nil> 0x344d0ddc4b18 <nil> <nil> 0x344d0e6ad020 30000000000 context.Background.WithDeadline(2026-09-07 21:22:36.076657732 +0000 UTC m=+35.825260550 [34.964309419s]) <nil>}'", }, stack: [0x1a067f8, 0x2a30bb8, 0x2a308e6, 0x2b8428e, 0x2b99305, 0x2b97eca, 0x2b3dfd3, 0x2b57919, 0x49a2a1], }, externalMessage: "Failed to upload pipeline. Raw error from the service: (code: 0)", externalStatusCode: 13, } to be nil In [It] at: /dspa/backend/test/end2end/pipeline_e2e_test.go:290 @ 09/07/26 21:22:01.112 < Exit [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 09/07/26 21:22:01.112 (37ms) > Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 09/07/26 21:22:01.112 ################### Global Cleanup after each test ##################### Deleting 0 run(s) Deleting 0 experiment(s) Deleting 0 pipeline(s) < Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 09/07/26 21:22:01.112 (0s) Attempt #1 Failed. Retrying ↺ @ 09/07/26 21:22:01.112 > Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 09/07/26 21:22:01.112 Create an experiment with name E2EExperiment-1788816121112982756 < Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 09/07/26 21:22:01.146 (33ms) > Enter [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 09/07/26 21:22:01.146 ################### Setup before each Pipeline Upload test ##################### ################### Global Setup before each test ##################### Test Context: 0x344d0ddc5e80 Looks like test-secret-1 already exists, because creation failed due to secrets "test-secret-1" already exists Looks like test-secret-2 already exists, because creation failed due to secrets "test-secret-2" already exists Looks like test-secret-3 already exists, because creation failed due to secrets "test-secret-3" already exists < Exit [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 09/07/26 21:22:01.354 (208ms) > Enter [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 09/07/26 21:22:01.354 Uploading pipeline file critical/parallel_for_after_dependency.yaml Creating temp pipeline file with overridden SDK Version Uploading pipeline with name=e2e-test-1788816121146498210, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml Upload of pipeline file 'critical/parallel_for_after_dependency.yaml' successful Listing pipeline versions for pipeline d5c27082-2cb1-4e66-8414-50409cd9c842 Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml Returning pipeline run time inputs map[] Create run for pipeline with id: 'd5c27082-2cb1-4e66-8414-50409cd9c842' and name: 'e2e-test-1788816121146498210' Create a pipeline run for pipeline with id=d5c27082-2cb1-4e66-8414-50409cd9c842 and versionId=26e0fe5a-0242-4d31-8549-5bce2cdd71c6 Create a pipeline run body Created Pipeline Run successfully with runId=9a315cb0-bedf-4bf7-b675-d149a9c253b6 Created Pipeline Run with id: 9a315cb0-bedf-4bf7-b675-d149a9c253b6 for pipeline with id: d5c27082-2cb1-4e66-8414-50409cd9c842 Waiting for pipeline run with id=9a315cb0-bedf-4bf7-b675-d149a9c253b6 to be in one of '[SUCCEEDED SKIPPED FAILED CANCELED]' Get a pipeline run with id=9a315cb0-bedf-4bf7-b675-d149a9c253b6 Pipeline run with id=9a315cb0-bedf-4bf7-b675-d149a9c253b6 is in PENDING state, waiting... Get a pipeline run with id=9a315cb0-bedf-4bf7-b675-d149a9c253b6 Pipeline run with id=9a315cb0-bedf-4bf7-b675-d149a9c253b6 is in RUNNING state, waiting... Get a pipeline run with id=9a315cb0-bedf-4bf7-b675-d149a9c253b6 Pipeline run with id=9a315cb0-bedf-4bf7-b675-d149a9c253b6 is in RUNNING state, waiting... Get a pipeline run with id=9a315cb0-bedf-4bf7-b675-d149a9c253b6 Pipeline run with id=9a315cb0-bedf-4bf7-b675-d149a9c253b6 is in RUNNING state, waiting... Get a pipeline run with id=9a315cb0-bedf-4bf7-b675-d149a9c253b6 Pipeline run with id=9a315cb0-bedf-4bf7-b675-d149a9c253b6 is in RUNNING state, waiting... Get a pipeline run with id=9a315cb0-bedf-4bf7-b675-d149a9c253b6 Pipeline run with id=9a315cb0-bedf-4bf7-b675-d149a9c253b6 is in RUNNING state, waiting... Get a pipeline run with id=9a315cb0-bedf-4bf7-b675-d149a9c253b6 Pipeline run with id=9a315cb0-bedf-4bf7-b675-d149a9c253b6 is in RUNNING state, waiting... Get a pipeline run with id=9a315cb0-bedf-4bf7-b675-d149a9c253b6 Pipeline run with id=9a315cb0-bedf-4bf7-b675-d149a9c253b6 is in RUNNING state, waiting... Get a pipeline run with id=9a315cb0-bedf-4bf7-b675-d149a9c253b6 Pipeline run with id=9a315cb0-bedf-4bf7-b675-d149a9c253b6 is in RUNNING state, waiting... Get a pipeline run with id=9a315cb0-bedf-4bf7-b675-d149a9c253b6 Pipeline run with id=9a315cb0-bedf-4bf7-b675-d149a9c253b6 is in RUNNING state, waiting... Get a pipeline run with id=9a315cb0-bedf-4bf7-b675-d149a9c253b6 Pipeline run with id=9a315cb0-bedf-4bf7-b675-d149a9c253b6 is in RUNNING state, waiting... Get a pipeline run with id=9a315cb0-bedf-4bf7-b675-d149a9c253b6 Pipeline run with id=9a315cb0-bedf-4bf7-b675-d149a9c253b6 is in RUNNING state, waiting... Get a pipeline run with id=9a315cb0-bedf-4bf7-b675-d149a9c253b6 Pipeline run with id=9a315cb0-bedf-4bf7-b675-d149a9c253b6 is in RUNNING state, waiting... Get a pipeline run with id=9a315cb0-bedf-4bf7-b675-d149a9c253b6 Pipeline run with id=9a315cb0-bedf-4bf7-b675-d149a9c253b6 is in RUNNING state, waiting... Get a pipeline run with id=9a315cb0-bedf-4bf7-b675-d149a9c253b6 Pipeline run with id=9a315cb0-bedf-4bf7-b675-d149a9c253b6 is in RUNNING state, waiting... Get a pipeline run with id=9a315cb0-bedf-4bf7-b675-d149a9c253b6 Pipeline run with id=9a315cb0-bedf-4bf7-b675-d149a9c253b6 is in RUNNING state, waiting... Get a pipeline run with id=9a315cb0-bedf-4bf7-b675-d149a9c253b6 Pipeline run with id=9a315cb0-bedf-4bf7-b675-d149a9c253b6 is in RUNNING state, waiting... Get a pipeline run with id=9a315cb0-bedf-4bf7-b675-d149a9c253b6 Pipeline run with id=9a315cb0-bedf-4bf7-b675-d149a9c253b6 is in RUNNING state, waiting... Get a pipeline run with id=9a315cb0-bedf-4bf7-b675-d149a9c253b6 Pipeline run with id=9a315cb0-bedf-4bf7-b675-d149a9c253b6 is in RUNNING state, waiting... Get a pipeline run with id=9a315cb0-bedf-4bf7-b675-d149a9c253b6 Pipeline run with id=9a315cb0-bedf-4bf7-b675-d149a9c253b6 is in RUNNING state, waiting... Get a pipeline run with id=9a315cb0-bedf-4bf7-b675-d149a9c253b6 Pipeline run with id=9a315cb0-bedf-4bf7-b675-d149a9c253b6 is in RUNNING state, waiting... Get a pipeline run with id=9a315cb0-bedf-4bf7-b675-d149a9c253b6 Pipeline run with id=9a315cb0-bedf-4bf7-b675-d149a9c253b6 is in RUNNING state, waiting... Get a pipeline run with id=9a315cb0-bedf-4bf7-b675-d149a9c253b6 Pipeline run with id=9a315cb0-bedf-4bf7-b675-d149a9c253b6 is in RUNNING state, waiting... Get a pipeline run with id=9a315cb0-bedf-4bf7-b675-d149a9c253b6 Pipeline run with id=9a315cb0-bedf-4bf7-b675-d149a9c253b6 reached expected state SUCCEEDED Deserializing expected compiled workflow file 'critical/parallel_for_after_dependency.yaml' for the pipeline Unmarshalling Expected Workflow YAML Unmarshalled Expected Workflow YAML Fetching updated pipeline run details for run with id=9a315cb0-bedf-4bf7-b675-d149a9c253b6 Get a pipeline run with id=9a315cb0-bedf-4bf7-b675-d149a9c253b6 Updated pipeline run details Pipeline run succeeded, checking if the number of tasks are what is expected < Exit [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 09/07/26 21:23:56.623 (1m55.269s) > Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 09/07/26 21:23:56.623 ################### Global Cleanup after each test ##################### Deleting 1 run(s) Terminate run 9a315cb0-bedf-4bf7-b675-d149a9c253b6 Failed to terminate run 9a315cb0-bedf-4bf7-b675-d149a9c253b6 Terminate run 9a315cb0-bedf-4bf7-b675-d149a9c253b6 Deleting run 9a315cb0-bedf-4bf7-b675-d149a9c253b6 Deleting 0 experiment(s) Deleting 1 pipeline(s) Deleting pipeline with id=d5c27082-2cb1-4e66-8414-50409cd9c842 (cascade=true) Pipeline with id=d5c27082-2cb1-4e66-8414-50409cd9c842, DELETED < Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 09/07/26 21:23:56.742 (120ms) > Enter [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 09/07/26 21:23:56.743 < Exit [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 09/07/26 21:23:56.743 (0s) > Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 09/07/26 21:23:56.743 < Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 09/07/26 21:23:56.743 (0s) 2026/09/07 21:24:56 Test passed > Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 09/07/26 21:22:00.668 Create an experiment with name E2EExperiment-1788816120668657923 < Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 09/07/26 21:22:00.939 (271ms) > Enter [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 09/07/26 21:22:00.939 ################### Setup before each Pipeline Upload test ##################### ################### Global Setup before each test ##################### Test Context: 0x3c4a236fe700 Looks like test-secret-1 already exists, because creation failed due to secrets "test-secret-1" already exists Looks like test-secret-2 already exists, because creation failed due to secrets "test-secret-2" already exists Looks like test-secret-3 already exists, because creation failed due to secrets "test-secret-3" already exists < Exit [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 09/07/26 21:22:01.089 (150ms) > Enter [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 09/07/26 21:22:01.089 Uploading pipeline file essential/iris_pipeline_compiled.yaml Creating temp pipeline file with overridden SDK Version Uploading pipeline with name=e2e-test-1788816120940016041, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml Upload of pipeline file 'essential/iris_pipeline_compiled.yaml' successful Listing pipeline versions for pipeline 9c187d98-c809-485c-8e40-6be314b6e586 Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml Returning pipeline run time inputs map[] Create run for pipeline with id: '9c187d98-c809-485c-8e40-6be314b6e586' and name: 'e2e-test-1788816120940016041' Create a pipeline run for pipeline with id=9c187d98-c809-485c-8e40-6be314b6e586 and versionId=5f425770-bdb5-4406-b348-d75e4aa09520 Create a pipeline run body Created Pipeline Run successfully with runId=9c635b13-5b4b-4de5-82c3-e54db719ddcc Created Pipeline Run with id: 9c635b13-5b4b-4de5-82c3-e54db719ddcc for pipeline with id: 9c187d98-c809-485c-8e40-6be314b6e586 Waiting for pipeline run with id=9c635b13-5b4b-4de5-82c3-e54db719ddcc to be in one of '[SUCCEEDED SKIPPED FAILED CANCELED]' Get a pipeline run with id=9c635b13-5b4b-4de5-82c3-e54db719ddcc Pipeline run with id=9c635b13-5b4b-4de5-82c3-e54db719ddcc is in PENDING state, waiting... Get a pipeline run with id=9c635b13-5b4b-4de5-82c3-e54db719ddcc Pipeline run with id=9c635b13-5b4b-4de5-82c3-e54db719ddcc is in RUNNING state, waiting... Get a pipeline run with id=9c635b13-5b4b-4de5-82c3-e54db719ddcc Pipeline run with id=9c635b13-5b4b-4de5-82c3-e54db719ddcc is in RUNNING state, waiting... Get a pipeline run with id=9c635b13-5b4b-4de5-82c3-e54db719ddcc Pipeline run with id=9c635b13-5b4b-4de5-82c3-e54db719ddcc is in RUNNING state, waiting... Get a pipeline run with id=9c635b13-5b4b-4de5-82c3-e54db719ddcc Pipeline run with id=9c635b13-5b4b-4de5-82c3-e54db719ddcc is in RUNNING state, waiting... Get a pipeline run with id=9c635b13-5b4b-4de5-82c3-e54db719ddcc Pipeline run with id=9c635b13-5b4b-4de5-82c3-e54db719ddcc is in RUNNING state, waiting... Get a pipeline run with id=9c635b13-5b4b-4de5-82c3-e54db719ddcc Pipeline run with id=9c635b13-5b4b-4de5-82c3-e54db719ddcc is in RUNNING state, waiting... Get a pipeline run with id=9c635b13-5b4b-4de5-82c3-e54db719ddcc Pipeline run with id=9c635b13-5b4b-4de5-82c3-e54db719ddcc is in RUNNING state, waiting... Get a pipeline run with id=9c635b13-5b4b-4de5-82c3-e54db719ddcc Pipeline run with id=9c635b13-5b4b-4de5-82c3-e54db719ddcc is in RUNNING state, waiting... Get a pipeline run with id=9c635b13-5b4b-4de5-82c3-e54db719ddcc Pipeline run with id=9c635b13-5b4b-4de5-82c3-e54db719ddcc is in RUNNING state, waiting... Get a pipeline run with id=9c635b13-5b4b-4de5-82c3-e54db719ddcc Pipeline run with id=9c635b13-5b4b-4de5-82c3-e54db719ddcc is in RUNNING state, waiting... Get a pipeline run with id=9c635b13-5b4b-4de5-82c3-e54db719ddcc Pipeline run with id=9c635b13-5b4b-4de5-82c3-e54db719ddcc is in RUNNING state, waiting... Get a pipeline run with id=9c635b13-5b4b-4de5-82c3-e54db719ddcc Pipeline run with id=9c635b13-5b4b-4de5-82c3-e54db719ddcc is in RUNNING state, waiting... Get a pipeline run with id=9c635b13-5b4b-4de5-82c3-e54db719ddcc Pipeline run with id=9c635b13-5b4b-4de5-82c3-e54db719ddcc is in RUNNING state, waiting... Get a pipeline run with id=9c635b13-5b4b-4de5-82c3-e54db719ddcc Pipeline run with id=9c635b13-5b4b-4de5-82c3-e54db719ddcc is in RUNNING state, waiting... Get a pipeline run with id=9c635b13-5b4b-4de5-82c3-e54db719ddcc Pipeline run with id=9c635b13-5b4b-4de5-82c3-e54db719ddcc is in RUNNING state, waiting... Get a pipeline run with id=9c635b13-5b4b-4de5-82c3-e54db719ddcc Pipeline run with id=9c635b13-5b4b-4de5-82c3-e54db719ddcc is in RUNNING state, waiting... Get a pipeline run with id=9c635b13-5b4b-4de5-82c3-e54db719ddcc Pipeline run with id=9c635b13-5b4b-4de5-82c3-e54db719ddcc is in RUNNING state, waiting... Get a pipeline run with id=9c635b13-5b4b-4de5-82c3-e54db719ddcc Pipeline run with id=9c635b13-5b4b-4de5-82c3-e54db719ddcc is in RUNNING state, waiting... Get a pipeline run with id=9c635b13-5b4b-4de5-82c3-e54db719ddcc Pipeline run with id=9c635b13-5b4b-4de5-82c3-e54db719ddcc is in RUNNING state, waiting... Get a pipeline run with id=9c635b13-5b4b-4de5-82c3-e54db719ddcc Pipeline run with id=9c635b13-5b4b-4de5-82c3-e54db719ddcc is in RUNNING state, waiting... Get a pipeline run with id=9c635b13-5b4b-4de5-82c3-e54db719ddcc Pipeline run with id=9c635b13-5b4b-4de5-82c3-e54db719ddcc is in RUNNING state, waiting... Get a pipeline run with id=9c635b13-5b4b-4de5-82c3-e54db719ddcc Pipeline run with id=9c635b13-5b4b-4de5-82c3-e54db719ddcc is in RUNNING state, waiting... Get a pipeline run with id=9c635b13-5b4b-4de5-82c3-e54db719ddcc Pipeline run with id=9c635b13-5b4b-4de5-82c3-e54db719ddcc is in RUNNING state, waiting... Get a pipeline run with id=9c635b13-5b4b-4de5-82c3-e54db719ddcc Pipeline run with id=9c635b13-5b4b-4de5-82c3-e54db719ddcc is in RUNNING state, waiting... Get a pipeline run with id=9c635b13-5b4b-4de5-82c3-e54db719ddcc Pipeline run with id=9c635b13-5b4b-4de5-82c3-e54db719ddcc is in RUNNING state, waiting... Get a pipeline run with id=9c635b13-5b4b-4de5-82c3-e54db719ddcc Pipeline run with id=9c635b13-5b4b-4de5-82c3-e54db719ddcc is in RUNNING state, waiting... Get a pipeline run with id=9c635b13-5b4b-4de5-82c3-e54db719ddcc Pipeline run with id=9c635b13-5b4b-4de5-82c3-e54db719ddcc is in RUNNING state, waiting... Get a pipeline run with id=9c635b13-5b4b-4de5-82c3-e54db719ddcc Pipeline run with id=9c635b13-5b4b-4de5-82c3-e54db719ddcc is in RUNNING state, waiting... Get a pipeline run with id=9c635b13-5b4b-4de5-82c3-e54db719ddcc Pipeline run with id=9c635b13-5b4b-4de5-82c3-e54db719ddcc is in RUNNING state, waiting... Get a pipeline run with id=9c635b13-5b4b-4de5-82c3-e54db719ddcc Pipeline run with id=9c635b13-5b4b-4de5-82c3-e54db719ddcc is in RUNNING state, waiting... Get a pipeline run with id=9c635b13-5b4b-4de5-82c3-e54db719ddcc Pipeline run with id=9c635b13-5b4b-4de5-82c3-e54db719ddcc is in RUNNING state, waiting... Get a pipeline run with id=9c635b13-5b4b-4de5-82c3-e54db719ddcc Pipeline run with id=9c635b13-5b4b-4de5-82c3-e54db719ddcc is in RUNNING state, waiting... Get a pipeline run with id=9c635b13-5b4b-4de5-82c3-e54db719ddcc Pipeline run with id=9c635b13-5b4b-4de5-82c3-e54db719ddcc is in RUNNING state, waiting... Get a pipeline run with id=9c635b13-5b4b-4de5-82c3-e54db719ddcc Pipeline run with id=9c635b13-5b4b-4de5-82c3-e54db719ddcc is in RUNNING state, waiting... Get a pipeline run with id=9c635b13-5b4b-4de5-82c3-e54db719ddcc Pipeline run with id=9c635b13-5b4b-4de5-82c3-e54db719ddcc reached expected state SUCCEEDED Deserializing expected compiled workflow file 'essential/iris_pipeline_compiled.yaml' for the pipeline Unmarshalling Expected Workflow YAML Unmarshalled Expected Workflow YAML Fetching updated pipeline run details for run with id=9c635b13-5b4b-4de5-82c3-e54db719ddcc Get a pipeline run with id=9c635b13-5b4b-4de5-82c3-e54db719ddcc Updated pipeline run details Pipeline run succeeded, checking if the number of tasks are what is expected < Exit [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 09/07/26 21:24:56.561 (2m55.471s) > Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 09/07/26 21:24:56.561 ################### Global Cleanup after each test ##################### Deleting 1 run(s) Terminate run 9c635b13-5b4b-4de5-82c3-e54db719ddcc Failed to terminate run 9c635b13-5b4b-4de5-82c3-e54db719ddcc Terminate run 9c635b13-5b4b-4de5-82c3-e54db719ddcc Deleting run 9c635b13-5b4b-4de5-82c3-e54db719ddcc Deleting 0 experiment(s) Deleting 1 pipeline(s) Deleting pipeline with id=9c187d98-c809-485c-8e40-6be314b6e586 (cascade=true) Pipeline with id=9c187d98-c809-485c-8e40-6be314b6e586, DELETED < Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 09/07/26 21:24:56.686 (125ms) > Enter [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 09/07/26 21:24:56.687 < Exit [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 09/07/26 21:24:56.687 (0s) > Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 09/07/26 21:24:56.687 < Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 09/07/26 21:24:56.687 (0s)