2026/07/07 05:33:29 Test passed > Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/07/26 05:31:53.62 Create an experiment with name E2EExperiment-1783402313620658566 < Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/07/26 05:31:53.779 (159ms) > Enter [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/07/26 05:31:53.779 ################### Setup before each Pipeline Upload test ##################### ################### Global Setup before each test ##################### Test Context: 0x290b6b6c6c80 test-secret-1 created test-secret-2 created test-secret-3 created < Exit [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/07/26 05:31:53.818 (39ms) > Enter [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/07/26 05:31:53.818 Uploading pipeline file critical/pipeline_with_artifact_upload_download.yaml Creating temp pipeline file with overridden SDK Version Uploading pipeline with name=e2e-test-1783402313779963935, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml Upload of pipeline file 'critical/pipeline_with_artifact_upload_download.yaml' successful Listing pipeline versions for pipeline fb7d6ded-ef75-4051-92fb-7d0bfbc32244 Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml Returning pipeline run time inputs map[] Create run for pipeline with id: 'fb7d6ded-ef75-4051-92fb-7d0bfbc32244' and name: 'e2e-test-1783402313779963935' Create a pipeline run for pipeline with id=fb7d6ded-ef75-4051-92fb-7d0bfbc32244 and versionId=b83dfe5f-528b-4537-936c-1c96e9f9a511 Create a pipeline run body Created Pipeline Run successfully with runId=340cf317-2d78-46b3-8ee2-d48c2a34c998 Created Pipeline Run with id: 340cf317-2d78-46b3-8ee2-d48c2a34c998 for pipeline with id: fb7d6ded-ef75-4051-92fb-7d0bfbc32244 Waiting for pipeline run with id=340cf317-2d78-46b3-8ee2-d48c2a34c998 to be in one of '[SUCCEEDED SKIPPED FAILED CANCELED]' Get a pipeline run with id=340cf317-2d78-46b3-8ee2-d48c2a34c998 Pipeline run with id=340cf317-2d78-46b3-8ee2-d48c2a34c998 is in PENDING state, waiting... Get a pipeline run with id=340cf317-2d78-46b3-8ee2-d48c2a34c998 Pipeline run with id=340cf317-2d78-46b3-8ee2-d48c2a34c998 is in RUNNING state, waiting... Get a pipeline run with id=340cf317-2d78-46b3-8ee2-d48c2a34c998 Pipeline run with id=340cf317-2d78-46b3-8ee2-d48c2a34c998 is in RUNNING state, waiting... Get a pipeline run with id=340cf317-2d78-46b3-8ee2-d48c2a34c998 Pipeline run with id=340cf317-2d78-46b3-8ee2-d48c2a34c998 is in RUNNING state, waiting... Get a pipeline run with id=340cf317-2d78-46b3-8ee2-d48c2a34c998 Pipeline run with id=340cf317-2d78-46b3-8ee2-d48c2a34c998 is in RUNNING state, waiting... Get a pipeline run with id=340cf317-2d78-46b3-8ee2-d48c2a34c998 Pipeline run with id=340cf317-2d78-46b3-8ee2-d48c2a34c998 is in RUNNING state, waiting... Get a pipeline run with id=340cf317-2d78-46b3-8ee2-d48c2a34c998 Pipeline run with id=340cf317-2d78-46b3-8ee2-d48c2a34c998 is in RUNNING state, waiting... Get a pipeline run with id=340cf317-2d78-46b3-8ee2-d48c2a34c998 Pipeline run with id=340cf317-2d78-46b3-8ee2-d48c2a34c998 is in RUNNING state, waiting... Get a pipeline run with id=340cf317-2d78-46b3-8ee2-d48c2a34c998 Pipeline run with id=340cf317-2d78-46b3-8ee2-d48c2a34c998 is in RUNNING state, waiting... Get a pipeline run with id=340cf317-2d78-46b3-8ee2-d48c2a34c998 Pipeline run with id=340cf317-2d78-46b3-8ee2-d48c2a34c998 is in RUNNING state, waiting... Get a pipeline run with id=340cf317-2d78-46b3-8ee2-d48c2a34c998 Pipeline run with id=340cf317-2d78-46b3-8ee2-d48c2a34c998 is in RUNNING state, waiting... Get a pipeline run with id=340cf317-2d78-46b3-8ee2-d48c2a34c998 Pipeline run with id=340cf317-2d78-46b3-8ee2-d48c2a34c998 is in RUNNING state, waiting... Get a pipeline run with id=340cf317-2d78-46b3-8ee2-d48c2a34c998 Pipeline run with id=340cf317-2d78-46b3-8ee2-d48c2a34c998 is in RUNNING state, waiting... Get a pipeline run with id=340cf317-2d78-46b3-8ee2-d48c2a34c998 Pipeline run with id=340cf317-2d78-46b3-8ee2-d48c2a34c998 is in RUNNING state, waiting... Get a pipeline run with id=340cf317-2d78-46b3-8ee2-d48c2a34c998 Pipeline run with id=340cf317-2d78-46b3-8ee2-d48c2a34c998 is in RUNNING state, waiting... Get a pipeline run with id=340cf317-2d78-46b3-8ee2-d48c2a34c998 Pipeline run with id=340cf317-2d78-46b3-8ee2-d48c2a34c998 is in RUNNING state, waiting... Get a pipeline run with id=340cf317-2d78-46b3-8ee2-d48c2a34c998 Pipeline run with id=340cf317-2d78-46b3-8ee2-d48c2a34c998 is in RUNNING state, waiting... Get a pipeline run with id=340cf317-2d78-46b3-8ee2-d48c2a34c998 Pipeline run with id=340cf317-2d78-46b3-8ee2-d48c2a34c998 is in RUNNING state, waiting... Get a pipeline run with id=340cf317-2d78-46b3-8ee2-d48c2a34c998 Pipeline run with id=340cf317-2d78-46b3-8ee2-d48c2a34c998 is in RUNNING state, waiting... Get a pipeline run with id=340cf317-2d78-46b3-8ee2-d48c2a34c998 Pipeline run with id=340cf317-2d78-46b3-8ee2-d48c2a34c998 reached expected state SUCCEEDED Deserializing expected compiled workflow file 'critical/pipeline_with_artifact_upload_download.yaml' for the pipeline Unmarshalling Expected Workflow YAML Unmarshalled Expected Workflow YAML Fetching updated pipeline run details for run with id=340cf317-2d78-46b3-8ee2-d48c2a34c998 Get a pipeline run with id=340cf317-2d78-46b3-8ee2-d48c2a34c998 Updated pipeline run details Pipeline run succeeded, checking if the number of tasks are what is expected < Exit [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/07/26 05:33:29.123 (1m35.305s) > Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/07/26 05:33:29.123 ################### Global Cleanup after each test ##################### Deleting 1 run(s) Terminate run 340cf317-2d78-46b3-8ee2-d48c2a34c998 Failed to terminate run 340cf317-2d78-46b3-8ee2-d48c2a34c998 Terminate run 340cf317-2d78-46b3-8ee2-d48c2a34c998 Deleting run 340cf317-2d78-46b3-8ee2-d48c2a34c998 Deleting 0 experiment(s) Deleting 1 pipeline(s) Deleting pipeline with id=fb7d6ded-ef75-4051-92fb-7d0bfbc32244 (cascade=true) Pipeline with id=fb7d6ded-ef75-4051-92fb-7d0bfbc32244, DELETED < Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/07/26 05:33:29.274 (151ms) > Enter [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/07/26 05:33:29.275 < Exit [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/07/26 05:33:29.275 (0s) > Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/07/26 05:33:29.275 < Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/07/26 05:33:29.275 (0s) 2026/07/07 05:32:39 Test passed > Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/07/26 05:31:53.62 Create an experiment with name E2EExperiment-1783402313620964472 < Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/07/26 05:31:53.779 (159ms) > Enter [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/07/26 05:31:53.779 ################### Setup before each Pipeline Upload test ##################### ################### Global Setup before each test ##################### Test Context: 0x2df57cd86d00 Looks like test-secret-1 already exists, because creation failed due to secrets "test-secret-1" already exists Looks like test-secret-2 already exists, because creation failed due to secrets "test-secret-2" already exists Looks like test-secret-3 already exists, because creation failed due to secrets "test-secret-3" already exists < Exit [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/07/26 05:31:53.865 (86ms) > Enter [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/07/26 05:31:53.866 Uploading pipeline file essential/component_with_pip_index_urls.yaml Creating temp pipeline file with overridden SDK Version Uploading pipeline with name=e2e-test-1783402313779951155, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml Upload of pipeline file 'essential/component_with_pip_index_urls.yaml' successful Listing pipeline versions for pipeline 9215e336-9636-4337-8ecf-f5e3e32864b4 Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml Returning pipeline run time inputs map[] Create run for pipeline with id: '9215e336-9636-4337-8ecf-f5e3e32864b4' and name: 'e2e-test-1783402313779951155' Create a pipeline run for pipeline with id=9215e336-9636-4337-8ecf-f5e3e32864b4 and versionId=a9533ef6-6849-4f24-8581-315226b926ea Create a pipeline run body Created Pipeline Run successfully with runId=7f3efb98-00a1-46b5-8894-bbcab1ee6cdc Created Pipeline Run with id: 7f3efb98-00a1-46b5-8894-bbcab1ee6cdc for pipeline with id: 9215e336-9636-4337-8ecf-f5e3e32864b4 Waiting for pipeline run with id=7f3efb98-00a1-46b5-8894-bbcab1ee6cdc to be in one of '[SUCCEEDED SKIPPED FAILED CANCELED]' Get a pipeline run with id=7f3efb98-00a1-46b5-8894-bbcab1ee6cdc Pipeline run with id=7f3efb98-00a1-46b5-8894-bbcab1ee6cdc is in PENDING state, waiting... Get a pipeline run with id=7f3efb98-00a1-46b5-8894-bbcab1ee6cdc Pipeline run with id=7f3efb98-00a1-46b5-8894-bbcab1ee6cdc is in RUNNING state, waiting... Get a pipeline run with id=7f3efb98-00a1-46b5-8894-bbcab1ee6cdc Pipeline run with id=7f3efb98-00a1-46b5-8894-bbcab1ee6cdc is in RUNNING state, waiting... Get a pipeline run with id=7f3efb98-00a1-46b5-8894-bbcab1ee6cdc Pipeline run with id=7f3efb98-00a1-46b5-8894-bbcab1ee6cdc is in RUNNING state, waiting... Get a pipeline run with id=7f3efb98-00a1-46b5-8894-bbcab1ee6cdc Pipeline run with id=7f3efb98-00a1-46b5-8894-bbcab1ee6cdc is in RUNNING state, waiting... Get a pipeline run with id=7f3efb98-00a1-46b5-8894-bbcab1ee6cdc Pipeline run with id=7f3efb98-00a1-46b5-8894-bbcab1ee6cdc is in RUNNING state, waiting... Get a pipeline run with id=7f3efb98-00a1-46b5-8894-bbcab1ee6cdc Pipeline run with id=7f3efb98-00a1-46b5-8894-bbcab1ee6cdc is in RUNNING state, waiting... Get a pipeline run with id=7f3efb98-00a1-46b5-8894-bbcab1ee6cdc Pipeline run with id=7f3efb98-00a1-46b5-8894-bbcab1ee6cdc is in RUNNING state, waiting... Get a pipeline run with id=7f3efb98-00a1-46b5-8894-bbcab1ee6cdc Pipeline run with id=7f3efb98-00a1-46b5-8894-bbcab1ee6cdc is in RUNNING state, waiting... Get a pipeline run with id=7f3efb98-00a1-46b5-8894-bbcab1ee6cdc Pipeline run with id=7f3efb98-00a1-46b5-8894-bbcab1ee6cdc reached expected state SUCCEEDED Deserializing expected compiled workflow file 'essential/component_with_pip_index_urls.yaml' for the pipeline Unmarshalling Expected Workflow YAML Unmarshalled Expected Workflow YAML Fetching updated pipeline run details for run with id=7f3efb98-00a1-46b5-8894-bbcab1ee6cdc Get a pipeline run with id=7f3efb98-00a1-46b5-8894-bbcab1ee6cdc Updated pipeline run details Pipeline run succeeded, checking if the number of tasks are what is expected < Exit [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/07/26 05:32:39.123 (45.257s) > Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/07/26 05:32:39.123 ################### Global Cleanup after each test ##################### Deleting 1 run(s) Terminate run 7f3efb98-00a1-46b5-8894-bbcab1ee6cdc Failed to terminate run 7f3efb98-00a1-46b5-8894-bbcab1ee6cdc Terminate run 7f3efb98-00a1-46b5-8894-bbcab1ee6cdc Deleting run 7f3efb98-00a1-46b5-8894-bbcab1ee6cdc Deleting 0 experiment(s) Deleting 1 pipeline(s) Deleting pipeline with id=9215e336-9636-4337-8ecf-f5e3e32864b4 (cascade=true) Pipeline with id=9215e336-9636-4337-8ecf-f5e3e32864b4, DELETED < Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/07/26 05:32:39.266 (143ms) > Enter [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/07/26 05:32:39.266 < Exit [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/07/26 05:32:39.266 (0s) > Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/07/26 05:32:39.267 < Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/07/26 05:32:39.267 (0s) 2026/07/07 05:33:29 Test passed > Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/07/26 05:31:53.62 Create an experiment with name E2EExperiment-1783402313620486722 < Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/07/26 05:31:54.158 (538ms) > Enter [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/07/26 05:31:54.158 ################### Setup before each Pipeline Upload test ##################### ################### Global Setup before each test ##################### Test Context: 0x33c0b32e0780 Looks like test-secret-1 already exists, because creation failed due to secrets "test-secret-1" already exists Looks like test-secret-2 already exists, because creation failed due to secrets "test-secret-2" already exists Looks like test-secret-3 already exists, because creation failed due to secrets "test-secret-3" already exists < Exit [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/07/26 05:31:54.292 (133ms) > Enter [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/07/26 05:31:54.292 Uploading pipeline file critical/parallel_for_after_dependency.yaml Creating temp pipeline file with overridden SDK Version Uploading pipeline with name=e2e-test-1783402314158881663, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml Upload of pipeline file 'critical/parallel_for_after_dependency.yaml' successful Listing pipeline versions for pipeline dacbaff2-0599-4b13-b4ac-f1a9b8d94985 Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml Returning pipeline run time inputs map[] Create run for pipeline with id: 'dacbaff2-0599-4b13-b4ac-f1a9b8d94985' and name: 'e2e-test-1783402314158881663' Create a pipeline run for pipeline with id=dacbaff2-0599-4b13-b4ac-f1a9b8d94985 and versionId=f4c985cf-39e8-49f0-bf8a-f3bf0d8371ec Create a pipeline run body Created Pipeline Run successfully with runId=c7e39ff6-1014-43b6-8c29-a54000dd3285 Created Pipeline Run with id: c7e39ff6-1014-43b6-8c29-a54000dd3285 for pipeline with id: dacbaff2-0599-4b13-b4ac-f1a9b8d94985 Waiting for pipeline run with id=c7e39ff6-1014-43b6-8c29-a54000dd3285 to be in one of '[SUCCEEDED SKIPPED FAILED CANCELED]' Get a pipeline run with id=c7e39ff6-1014-43b6-8c29-a54000dd3285 Pipeline run with id=c7e39ff6-1014-43b6-8c29-a54000dd3285 is in PENDING state, waiting... Get a pipeline run with id=c7e39ff6-1014-43b6-8c29-a54000dd3285 Pipeline run with id=c7e39ff6-1014-43b6-8c29-a54000dd3285 is in RUNNING state, waiting... Get a pipeline run with id=c7e39ff6-1014-43b6-8c29-a54000dd3285 Pipeline run with id=c7e39ff6-1014-43b6-8c29-a54000dd3285 is in RUNNING state, waiting... Get a pipeline run with id=c7e39ff6-1014-43b6-8c29-a54000dd3285 Pipeline run with id=c7e39ff6-1014-43b6-8c29-a54000dd3285 is in RUNNING state, waiting... Get a pipeline run with id=c7e39ff6-1014-43b6-8c29-a54000dd3285 Pipeline run with id=c7e39ff6-1014-43b6-8c29-a54000dd3285 is in RUNNING state, waiting... Get a pipeline run with id=c7e39ff6-1014-43b6-8c29-a54000dd3285 Pipeline run with id=c7e39ff6-1014-43b6-8c29-a54000dd3285 is in RUNNING state, waiting... Get a pipeline run with id=c7e39ff6-1014-43b6-8c29-a54000dd3285 Pipeline run with id=c7e39ff6-1014-43b6-8c29-a54000dd3285 is in RUNNING state, waiting... Get a pipeline run with id=c7e39ff6-1014-43b6-8c29-a54000dd3285 Pipeline run with id=c7e39ff6-1014-43b6-8c29-a54000dd3285 is in RUNNING state, waiting... Get a pipeline run with id=c7e39ff6-1014-43b6-8c29-a54000dd3285 Pipeline run with id=c7e39ff6-1014-43b6-8c29-a54000dd3285 is in RUNNING state, waiting... Get a pipeline run with id=c7e39ff6-1014-43b6-8c29-a54000dd3285 Pipeline run with id=c7e39ff6-1014-43b6-8c29-a54000dd3285 is in RUNNING state, waiting... Get a pipeline run with id=c7e39ff6-1014-43b6-8c29-a54000dd3285 Pipeline run with id=c7e39ff6-1014-43b6-8c29-a54000dd3285 is in RUNNING state, waiting... Get a pipeline run with id=c7e39ff6-1014-43b6-8c29-a54000dd3285 Pipeline run with id=c7e39ff6-1014-43b6-8c29-a54000dd3285 is in RUNNING state, waiting... Get a pipeline run with id=c7e39ff6-1014-43b6-8c29-a54000dd3285 Pipeline run with id=c7e39ff6-1014-43b6-8c29-a54000dd3285 is in RUNNING state, waiting... Get a pipeline run with id=c7e39ff6-1014-43b6-8c29-a54000dd3285 Pipeline run with id=c7e39ff6-1014-43b6-8c29-a54000dd3285 is in RUNNING state, waiting... Get a pipeline run with id=c7e39ff6-1014-43b6-8c29-a54000dd3285 Pipeline run with id=c7e39ff6-1014-43b6-8c29-a54000dd3285 is in RUNNING state, waiting... Get a pipeline run with id=c7e39ff6-1014-43b6-8c29-a54000dd3285 Pipeline run with id=c7e39ff6-1014-43b6-8c29-a54000dd3285 is in RUNNING state, waiting... Get a pipeline run with id=c7e39ff6-1014-43b6-8c29-a54000dd3285 Pipeline run with id=c7e39ff6-1014-43b6-8c29-a54000dd3285 is in RUNNING state, waiting... Get a pipeline run with id=c7e39ff6-1014-43b6-8c29-a54000dd3285 Pipeline run with id=c7e39ff6-1014-43b6-8c29-a54000dd3285 is in RUNNING state, waiting... Get a pipeline run with id=c7e39ff6-1014-43b6-8c29-a54000dd3285 Pipeline run with id=c7e39ff6-1014-43b6-8c29-a54000dd3285 is in RUNNING state, waiting... Get a pipeline run with id=c7e39ff6-1014-43b6-8c29-a54000dd3285 Pipeline run with id=c7e39ff6-1014-43b6-8c29-a54000dd3285 reached expected state SUCCEEDED Deserializing expected compiled workflow file 'critical/parallel_for_after_dependency.yaml' for the pipeline Unmarshalling Expected Workflow YAML Unmarshalled Expected Workflow YAML Fetching updated pipeline run details for run with id=c7e39ff6-1014-43b6-8c29-a54000dd3285 Get a pipeline run with id=c7e39ff6-1014-43b6-8c29-a54000dd3285 Updated pipeline run details Pipeline run succeeded, checking if the number of tasks are what is expected < Exit [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/07/26 05:33:29.626 (1m35.335s) > Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/07/26 05:33:29.627 ################### Global Cleanup after each test ##################### Deleting 1 run(s) Terminate run c7e39ff6-1014-43b6-8c29-a54000dd3285 Failed to terminate run c7e39ff6-1014-43b6-8c29-a54000dd3285 Terminate run c7e39ff6-1014-43b6-8c29-a54000dd3285 Deleting run c7e39ff6-1014-43b6-8c29-a54000dd3285 Deleting 0 experiment(s) Deleting 1 pipeline(s) Deleting pipeline with id=dacbaff2-0599-4b13-b4ac-f1a9b8d94985 (cascade=true) Pipeline with id=dacbaff2-0599-4b13-b4ac-f1a9b8d94985, DELETED < Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/07/26 05:33:29.791 (165ms) > Enter [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/07/26 05:33:29.792 < Exit [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/07/26 05:33:29.792 (0s) > Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/07/26 05:33:29.792 < Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/07/26 05:33:29.792 (0s) 2026/07/07 05:33:59 Test passed > Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/07/26 05:31:53.62 Create an experiment with name E2EExperiment-1783402313620528913 < Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/07/26 05:31:53.779 (159ms) > Enter [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/07/26 05:31:53.779 ################### Setup before each Pipeline Upload test ##################### ################### Global Setup before each test ##################### Test Context: 0x38f2c58acb00 Looks like test-secret-1 already exists, because creation failed due to secrets "test-secret-1" already exists Looks like test-secret-2 already exists, because creation failed due to secrets "test-secret-2" already exists Looks like test-secret-3 already exists, because creation failed due to secrets "test-secret-3" already exists < Exit [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/07/26 05:31:53.859 (80ms) > Enter [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/07/26 05:31:53.859 Uploading pipeline file critical/flip_coin.yaml Creating temp pipeline file with overridden SDK Version Uploading pipeline with name=e2e-test-1783402313779550097, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml Upload of pipeline file 'critical/flip_coin.yaml' successful Listing pipeline versions for pipeline 6b4bb5a7-0653-46e0-9458-41e09cdedad6 Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml Returning pipeline run time inputs map[] Create run for pipeline with id: '6b4bb5a7-0653-46e0-9458-41e09cdedad6' and name: 'e2e-test-1783402313779550097' Create a pipeline run for pipeline with id=6b4bb5a7-0653-46e0-9458-41e09cdedad6 and versionId=eda183ab-6f2e-478f-9979-481da436d6c4 Create a pipeline run body Created Pipeline Run successfully with runId=ce9e8b4d-05d6-4e2a-9e56-70d6139dcca7 Created Pipeline Run with id: ce9e8b4d-05d6-4e2a-9e56-70d6139dcca7 for pipeline with id: 6b4bb5a7-0653-46e0-9458-41e09cdedad6 Waiting for pipeline run with id=ce9e8b4d-05d6-4e2a-9e56-70d6139dcca7 to be in one of '[SUCCEEDED SKIPPED FAILED CANCELED]' Get a pipeline run with id=ce9e8b4d-05d6-4e2a-9e56-70d6139dcca7 Pipeline run with id=ce9e8b4d-05d6-4e2a-9e56-70d6139dcca7 is in PENDING state, waiting... Get a pipeline run with id=ce9e8b4d-05d6-4e2a-9e56-70d6139dcca7 Pipeline run with id=ce9e8b4d-05d6-4e2a-9e56-70d6139dcca7 is in RUNNING state, waiting... Get a pipeline run with id=ce9e8b4d-05d6-4e2a-9e56-70d6139dcca7 Pipeline run with id=ce9e8b4d-05d6-4e2a-9e56-70d6139dcca7 is in RUNNING state, waiting... Get a pipeline run with id=ce9e8b4d-05d6-4e2a-9e56-70d6139dcca7 Pipeline run with id=ce9e8b4d-05d6-4e2a-9e56-70d6139dcca7 is in RUNNING state, waiting... Get a pipeline run with id=ce9e8b4d-05d6-4e2a-9e56-70d6139dcca7 Pipeline run with id=ce9e8b4d-05d6-4e2a-9e56-70d6139dcca7 is in RUNNING state, waiting... Get a pipeline run with id=ce9e8b4d-05d6-4e2a-9e56-70d6139dcca7 Pipeline run with id=ce9e8b4d-05d6-4e2a-9e56-70d6139dcca7 is in RUNNING state, waiting... Get a pipeline run with id=ce9e8b4d-05d6-4e2a-9e56-70d6139dcca7 Pipeline run with id=ce9e8b4d-05d6-4e2a-9e56-70d6139dcca7 is in RUNNING state, waiting... Get a pipeline run with id=ce9e8b4d-05d6-4e2a-9e56-70d6139dcca7 Pipeline run with id=ce9e8b4d-05d6-4e2a-9e56-70d6139dcca7 is in RUNNING state, waiting... Get a pipeline run with id=ce9e8b4d-05d6-4e2a-9e56-70d6139dcca7 Pipeline run with id=ce9e8b4d-05d6-4e2a-9e56-70d6139dcca7 is in RUNNING state, waiting... Get a pipeline run with id=ce9e8b4d-05d6-4e2a-9e56-70d6139dcca7 Pipeline run with id=ce9e8b4d-05d6-4e2a-9e56-70d6139dcca7 is in RUNNING state, waiting... Get a pipeline run with id=ce9e8b4d-05d6-4e2a-9e56-70d6139dcca7 Pipeline run with id=ce9e8b4d-05d6-4e2a-9e56-70d6139dcca7 is in RUNNING state, waiting... Get a pipeline run with id=ce9e8b4d-05d6-4e2a-9e56-70d6139dcca7 Pipeline run with id=ce9e8b4d-05d6-4e2a-9e56-70d6139dcca7 is in RUNNING state, waiting... Get a pipeline run with id=ce9e8b4d-05d6-4e2a-9e56-70d6139dcca7 Pipeline run with id=ce9e8b4d-05d6-4e2a-9e56-70d6139dcca7 is in RUNNING state, waiting... Get a pipeline run with id=ce9e8b4d-05d6-4e2a-9e56-70d6139dcca7 Pipeline run with id=ce9e8b4d-05d6-4e2a-9e56-70d6139dcca7 is in RUNNING state, waiting... Get a pipeline run with id=ce9e8b4d-05d6-4e2a-9e56-70d6139dcca7 Pipeline run with id=ce9e8b4d-05d6-4e2a-9e56-70d6139dcca7 is in RUNNING state, waiting... Get a pipeline run with id=ce9e8b4d-05d6-4e2a-9e56-70d6139dcca7 Pipeline run with id=ce9e8b4d-05d6-4e2a-9e56-70d6139dcca7 is in RUNNING state, waiting... Get a pipeline run with id=ce9e8b4d-05d6-4e2a-9e56-70d6139dcca7 Pipeline run with id=ce9e8b4d-05d6-4e2a-9e56-70d6139dcca7 is in RUNNING state, waiting... Get a pipeline run with id=ce9e8b4d-05d6-4e2a-9e56-70d6139dcca7 Pipeline run with id=ce9e8b4d-05d6-4e2a-9e56-70d6139dcca7 is in RUNNING state, waiting... Get a pipeline run with id=ce9e8b4d-05d6-4e2a-9e56-70d6139dcca7 Pipeline run with id=ce9e8b4d-05d6-4e2a-9e56-70d6139dcca7 is in RUNNING state, waiting... Get a pipeline run with id=ce9e8b4d-05d6-4e2a-9e56-70d6139dcca7 Pipeline run with id=ce9e8b4d-05d6-4e2a-9e56-70d6139dcca7 is in RUNNING state, waiting... Get a pipeline run with id=ce9e8b4d-05d6-4e2a-9e56-70d6139dcca7 Pipeline run with id=ce9e8b4d-05d6-4e2a-9e56-70d6139dcca7 is in RUNNING state, waiting... Get a pipeline run with id=ce9e8b4d-05d6-4e2a-9e56-70d6139dcca7 Pipeline run with id=ce9e8b4d-05d6-4e2a-9e56-70d6139dcca7 is in RUNNING state, waiting... Get a pipeline run with id=ce9e8b4d-05d6-4e2a-9e56-70d6139dcca7 Pipeline run with id=ce9e8b4d-05d6-4e2a-9e56-70d6139dcca7 is in RUNNING state, waiting... Get a pipeline run with id=ce9e8b4d-05d6-4e2a-9e56-70d6139dcca7 Pipeline run with id=ce9e8b4d-05d6-4e2a-9e56-70d6139dcca7 is in RUNNING state, waiting... Get a pipeline run with id=ce9e8b4d-05d6-4e2a-9e56-70d6139dcca7 Pipeline run with id=ce9e8b4d-05d6-4e2a-9e56-70d6139dcca7 is in RUNNING state, waiting... Get a pipeline run with id=ce9e8b4d-05d6-4e2a-9e56-70d6139dcca7 Pipeline run with id=ce9e8b4d-05d6-4e2a-9e56-70d6139dcca7 reached expected state SUCCEEDED Deserializing expected compiled workflow file 'critical/flip_coin.yaml' for the pipeline Unmarshalling Expected Workflow YAML Unmarshalled Expected Workflow YAML Fetching updated pipeline run details for run with id=ce9e8b4d-05d6-4e2a-9e56-70d6139dcca7 Get a pipeline run with id=ce9e8b4d-05d6-4e2a-9e56-70d6139dcca7 Updated pipeline run details Pipeline run succeeded, checking if the number of tasks are what is expected < Exit [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/07/26 05:33:59.603 (2m5.744s) > Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/07/26 05:33:59.603 ################### Global Cleanup after each test ##################### Deleting 1 run(s) Terminate run ce9e8b4d-05d6-4e2a-9e56-70d6139dcca7 Failed to terminate run ce9e8b4d-05d6-4e2a-9e56-70d6139dcca7 Terminate run ce9e8b4d-05d6-4e2a-9e56-70d6139dcca7 Deleting run ce9e8b4d-05d6-4e2a-9e56-70d6139dcca7 Deleting 0 experiment(s) Deleting 1 pipeline(s) Deleting pipeline with id=6b4bb5a7-0653-46e0-9458-41e09cdedad6 (cascade=true) Pipeline with id=6b4bb5a7-0653-46e0-9458-41e09cdedad6, DELETED < Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/07/26 05:33:59.758 (155ms) > Enter [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/07/26 05:33:59.758 < Exit [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/07/26 05:33:59.758 (0s) > Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/07/26 05:33:59.758 < Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/07/26 05:33:59.758 (0s) 2026/07/07 05:34:24 Test passed > Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/07/26 05:31:53.641 Create an experiment with name E2EExperiment-1783402313641567562 < Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/07/26 05:31:53.949 (308ms) > Enter [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/07/26 05:31:53.95 ################### Setup before each Pipeline Upload test ##################### ################### Global Setup before each test ##################### Test Context: 0x36d5a4dd7100 Looks like test-secret-1 already exists, because creation failed due to secrets "test-secret-1" already exists Looks like test-secret-2 already exists, because creation failed due to secrets "test-secret-2" already exists Looks like test-secret-3 already exists, because creation failed due to secrets "test-secret-3" already exists < Exit [BeforeEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/07/26 05:31:54.035 (85ms) > Enter [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/07/26 05:31:54.035 Uploading pipeline file essential/iris_pipeline_compiled.yaml Creating temp pipeline file with overridden SDK Version Uploading pipeline with name=e2e-test-1783402313950261228, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml Upload of pipeline file 'essential/iris_pipeline_compiled.yaml' successful Listing pipeline versions for pipeline 23c63d76-1066-4048-a7ef-88a9f07af0a1 Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml Returning pipeline run time inputs map[] Create run for pipeline with id: '23c63d76-1066-4048-a7ef-88a9f07af0a1' and name: 'e2e-test-1783402313950261228' Create a pipeline run for pipeline with id=23c63d76-1066-4048-a7ef-88a9f07af0a1 and versionId=1b547651-6b11-4310-86fe-34b77a69f947 Create a pipeline run body Created Pipeline Run successfully with runId=5a6fa3c0-f8a0-4365-845e-32dcf488079d Created Pipeline Run with id: 5a6fa3c0-f8a0-4365-845e-32dcf488079d for pipeline with id: 23c63d76-1066-4048-a7ef-88a9f07af0a1 Waiting for pipeline run with id=5a6fa3c0-f8a0-4365-845e-32dcf488079d to be in one of '[SUCCEEDED SKIPPED FAILED CANCELED]' Get a pipeline run with id=5a6fa3c0-f8a0-4365-845e-32dcf488079d Pipeline run with id=5a6fa3c0-f8a0-4365-845e-32dcf488079d is in PENDING state, waiting... Get a pipeline run with id=5a6fa3c0-f8a0-4365-845e-32dcf488079d Pipeline run with id=5a6fa3c0-f8a0-4365-845e-32dcf488079d is in RUNNING state, waiting... Get a pipeline run with id=5a6fa3c0-f8a0-4365-845e-32dcf488079d Pipeline run with id=5a6fa3c0-f8a0-4365-845e-32dcf488079d is in RUNNING state, waiting... Get a pipeline run with id=5a6fa3c0-f8a0-4365-845e-32dcf488079d Pipeline run with id=5a6fa3c0-f8a0-4365-845e-32dcf488079d is in RUNNING state, waiting... Get a pipeline run with id=5a6fa3c0-f8a0-4365-845e-32dcf488079d Pipeline run with id=5a6fa3c0-f8a0-4365-845e-32dcf488079d is in RUNNING state, waiting... Get a pipeline run with id=5a6fa3c0-f8a0-4365-845e-32dcf488079d Pipeline run with id=5a6fa3c0-f8a0-4365-845e-32dcf488079d is in RUNNING state, waiting... Get a pipeline run with id=5a6fa3c0-f8a0-4365-845e-32dcf488079d Pipeline run with id=5a6fa3c0-f8a0-4365-845e-32dcf488079d is in RUNNING state, waiting... Get a pipeline run with id=5a6fa3c0-f8a0-4365-845e-32dcf488079d Pipeline run with id=5a6fa3c0-f8a0-4365-845e-32dcf488079d is in RUNNING state, waiting... Get a pipeline run with id=5a6fa3c0-f8a0-4365-845e-32dcf488079d Pipeline run with id=5a6fa3c0-f8a0-4365-845e-32dcf488079d is in RUNNING state, waiting... Get a pipeline run with id=5a6fa3c0-f8a0-4365-845e-32dcf488079d Pipeline run with id=5a6fa3c0-f8a0-4365-845e-32dcf488079d is in RUNNING state, waiting... Get a pipeline run with id=5a6fa3c0-f8a0-4365-845e-32dcf488079d Pipeline run with id=5a6fa3c0-f8a0-4365-845e-32dcf488079d is in RUNNING state, waiting... Get a pipeline run with id=5a6fa3c0-f8a0-4365-845e-32dcf488079d Pipeline run with id=5a6fa3c0-f8a0-4365-845e-32dcf488079d is in RUNNING state, waiting... Get a pipeline run with id=5a6fa3c0-f8a0-4365-845e-32dcf488079d Pipeline run with id=5a6fa3c0-f8a0-4365-845e-32dcf488079d is in RUNNING state, waiting... Get a pipeline run with id=5a6fa3c0-f8a0-4365-845e-32dcf488079d Pipeline run with id=5a6fa3c0-f8a0-4365-845e-32dcf488079d is in RUNNING state, waiting... Get a pipeline run with id=5a6fa3c0-f8a0-4365-845e-32dcf488079d Pipeline run with id=5a6fa3c0-f8a0-4365-845e-32dcf488079d is in RUNNING state, waiting... Get a pipeline run with id=5a6fa3c0-f8a0-4365-845e-32dcf488079d Pipeline run with id=5a6fa3c0-f8a0-4365-845e-32dcf488079d is in RUNNING state, waiting... Get a pipeline run with id=5a6fa3c0-f8a0-4365-845e-32dcf488079d Pipeline run with id=5a6fa3c0-f8a0-4365-845e-32dcf488079d is in RUNNING state, waiting... Get a pipeline run with id=5a6fa3c0-f8a0-4365-845e-32dcf488079d Pipeline run with id=5a6fa3c0-f8a0-4365-845e-32dcf488079d is in RUNNING state, waiting... Get a pipeline run with id=5a6fa3c0-f8a0-4365-845e-32dcf488079d Pipeline run with id=5a6fa3c0-f8a0-4365-845e-32dcf488079d is in RUNNING state, waiting... Get a pipeline run with id=5a6fa3c0-f8a0-4365-845e-32dcf488079d Pipeline run with id=5a6fa3c0-f8a0-4365-845e-32dcf488079d is in RUNNING state, waiting... Get a pipeline run with id=5a6fa3c0-f8a0-4365-845e-32dcf488079d Pipeline run with id=5a6fa3c0-f8a0-4365-845e-32dcf488079d is in RUNNING state, waiting... Get a pipeline run with id=5a6fa3c0-f8a0-4365-845e-32dcf488079d Pipeline run with id=5a6fa3c0-f8a0-4365-845e-32dcf488079d is in RUNNING state, waiting... Get a pipeline run with id=5a6fa3c0-f8a0-4365-845e-32dcf488079d Pipeline run with id=5a6fa3c0-f8a0-4365-845e-32dcf488079d is in RUNNING state, waiting... Get a pipeline run with id=5a6fa3c0-f8a0-4365-845e-32dcf488079d Pipeline run with id=5a6fa3c0-f8a0-4365-845e-32dcf488079d is in RUNNING state, waiting... Get a pipeline run with id=5a6fa3c0-f8a0-4365-845e-32dcf488079d Pipeline run with id=5a6fa3c0-f8a0-4365-845e-32dcf488079d is in RUNNING state, waiting... Get a pipeline run with id=5a6fa3c0-f8a0-4365-845e-32dcf488079d Pipeline run with id=5a6fa3c0-f8a0-4365-845e-32dcf488079d is in RUNNING state, waiting... Get a pipeline run with id=5a6fa3c0-f8a0-4365-845e-32dcf488079d Pipeline run with id=5a6fa3c0-f8a0-4365-845e-32dcf488079d is in RUNNING state, waiting... Get a pipeline run with id=5a6fa3c0-f8a0-4365-845e-32dcf488079d Pipeline run with id=5a6fa3c0-f8a0-4365-845e-32dcf488079d is in RUNNING state, waiting... Get a pipeline run with id=5a6fa3c0-f8a0-4365-845e-32dcf488079d Pipeline run with id=5a6fa3c0-f8a0-4365-845e-32dcf488079d is in RUNNING state, waiting... Get a pipeline run with id=5a6fa3c0-f8a0-4365-845e-32dcf488079d Pipeline run with id=5a6fa3c0-f8a0-4365-845e-32dcf488079d is in RUNNING state, waiting... Get a pipeline run with id=5a6fa3c0-f8a0-4365-845e-32dcf488079d Pipeline run with id=5a6fa3c0-f8a0-4365-845e-32dcf488079d reached expected state SUCCEEDED Deserializing expected compiled workflow file 'essential/iris_pipeline_compiled.yaml' for the pipeline Unmarshalling Expected Workflow YAML Unmarshalled Expected Workflow YAML Fetching updated pipeline run details for run with id=5a6fa3c0-f8a0-4365-845e-32dcf488079d Get a pipeline run with id=5a6fa3c0-f8a0-4365-845e-32dcf488079d Updated pipeline run details Pipeline run succeeded, checking if the number of tasks are what is expected < Exit [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/07/26 05:34:24.365 (2m30.33s) > Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/07/26 05:34:24.365 ################### Global Cleanup after each test ##################### Deleting 1 run(s) Terminate run 5a6fa3c0-f8a0-4365-845e-32dcf488079d Failed to terminate run 5a6fa3c0-f8a0-4365-845e-32dcf488079d Terminate run 5a6fa3c0-f8a0-4365-845e-32dcf488079d Deleting run 5a6fa3c0-f8a0-4365-845e-32dcf488079d Deleting 0 experiment(s) Deleting 1 pipeline(s) Deleting pipeline with id=23c63d76-1066-4048-a7ef-88a9f07af0a1 (cascade=true) Pipeline with id=23c63d76-1066-4048-a7ef-88a9f07af0a1, DELETED < Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/07/26 05:34:24.567 (202ms) > Enter [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/07/26 05:34:24.568 < Exit [ReportAfterEach] Upload and Verify Pipeline Run > - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/07/26 05:34:24.568 (0s) > Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/07/26 05:34:24.568 < Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/07/26 05:34:24.568 (0s)