<?xml version="1.0" encoding="UTF-8"?>
  <testsuites tests="5" disabled="0" errors="0" failures="0" time="156.330649731">
      <testsuite name="AIPipelinesE2ETests" package="/dspa/backend/test/end2end" tests="5" disabled="0" skipped="0" errors="0" failures="0" time="156.330649731" timestamp="2026-07-19T13:24:14">
          <properties>
              <property name="SuiteSucceeded" value="true"></property>
              <property name="SuiteHasProgrammaticFocus" value="false"></property>
              <property name="SpecialSuiteFailureReason" value=""></property>
              <property name="SuiteLabels" value="[]"></property>
              <property name="SuiteSemVerConstraints" value="[]"></property>
              <property name="RandomSeed" value="1784467292"></property>
              <property name="RandomizeAllSpecs" value="false"></property>
              <property name="LabelFilter" value="Smoke"></property>
              <property name="SemVerFilter" value=""></property>
              <property name="FocusStrings" value=""></property>
              <property name="SkipStrings" value=""></property>
              <property name="FocusFiles" value=""></property>
              <property name="SkipFiles" value=""></property>
              <property name="FailOnPending" value="false"></property>
              <property name="FailOnEmpty" value="false"></property>
              <property name="FailFast" value="false"></property>
              <property name="FlakeAttempts" value="0"></property>
              <property name="DryRun" value="false"></property>
              <property name="ParallelTotal" value="10"></property>
              <property name="OutputInterceptorMode" value=""></property>
          </properties>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload essential/component_with_pip_index_urls.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="45.937214269">
              <system-out>2026/07/19 13:25:00 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/19/26 13:24:14.221&#xA;Create an experiment with name E2EExperiment-1784467454221682627&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/19/26 13:24:14.351 (129ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/19/26 13:24:14.351&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x2823e4b1af00&#xA;test-secret-1 created&#xA;test-secret-2 created&#xA;test-secret-3 created&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/19/26 13:24:14.417 (66ms)&#xA;&gt; Enter [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/19/26 13:24:14.417&#xA;Uploading pipeline file essential/component_with_pip_index_urls.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1784467454351406560, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml&#xA;Upload of pipeline file &#39;essential/component_with_pip_index_urls.yaml&#39; successful&#xA;Listing pipeline versions for pipeline fd73f7c8-2c12-46d8-9950-7b4ae2724a02&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;fd73f7c8-2c12-46d8-9950-7b4ae2724a02&#39; and name: &#39;e2e-test-1784467454351406560&#39;&#xA;Create a pipeline run for pipeline with id=fd73f7c8-2c12-46d8-9950-7b4ae2724a02 and versionId=d268b1f3-5d86-4df9-acd1-a3b0a0047f1c&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=6f94d9b4-b416-471b-a31e-8a19f55282b8&#xA;Created Pipeline Run with id: 6f94d9b4-b416-471b-a31e-8a19f55282b8 for pipeline with id: fd73f7c8-2c12-46d8-9950-7b4ae2724a02&#xA;Waiting for pipeline run with id=6f94d9b4-b416-471b-a31e-8a19f55282b8 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=6f94d9b4-b416-471b-a31e-8a19f55282b8&#xA;Pipeline run with id=6f94d9b4-b416-471b-a31e-8a19f55282b8 is in PENDING state, waiting...&#xA;Get a pipeline run with id=6f94d9b4-b416-471b-a31e-8a19f55282b8&#xA;Pipeline run with id=6f94d9b4-b416-471b-a31e-8a19f55282b8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6f94d9b4-b416-471b-a31e-8a19f55282b8&#xA;Pipeline run with id=6f94d9b4-b416-471b-a31e-8a19f55282b8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6f94d9b4-b416-471b-a31e-8a19f55282b8&#xA;Pipeline run with id=6f94d9b4-b416-471b-a31e-8a19f55282b8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6f94d9b4-b416-471b-a31e-8a19f55282b8&#xA;Pipeline run with id=6f94d9b4-b416-471b-a31e-8a19f55282b8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6f94d9b4-b416-471b-a31e-8a19f55282b8&#xA;Pipeline run with id=6f94d9b4-b416-471b-a31e-8a19f55282b8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6f94d9b4-b416-471b-a31e-8a19f55282b8&#xA;Pipeline run with id=6f94d9b4-b416-471b-a31e-8a19f55282b8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6f94d9b4-b416-471b-a31e-8a19f55282b8&#xA;Pipeline run with id=6f94d9b4-b416-471b-a31e-8a19f55282b8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6f94d9b4-b416-471b-a31e-8a19f55282b8&#xA;Pipeline run with id=6f94d9b4-b416-471b-a31e-8a19f55282b8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6f94d9b4-b416-471b-a31e-8a19f55282b8&#xA;Pipeline run with id=6f94d9b4-b416-471b-a31e-8a19f55282b8 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;essential/component_with_pip_index_urls.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=6f94d9b4-b416-471b-a31e-8a19f55282b8&#xA;Get a pipeline run with id=6f94d9b4-b416-471b-a31e-8a19f55282b8&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/19/26 13:24:59.982 (45.565s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/19/26 13:24:59.982&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 6f94d9b4-b416-471b-a31e-8a19f55282b8&#xA;Failed to terminate run 6f94d9b4-b416-471b-a31e-8a19f55282b8&#xA;Terminate run 6f94d9b4-b416-471b-a31e-8a19f55282b8&#xA;Deleting run 6f94d9b4-b416-471b-a31e-8a19f55282b8&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=fd73f7c8-2c12-46d8-9950-7b4ae2724a02 (cascade=true)&#xA;Pipeline with id=fd73f7c8-2c12-46d8-9950-7b4ae2724a02, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/19/26 13:25:00.158 (176ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/19/26 13:25:00.159&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/19/26 13:25:00.159 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/19/26 13:25:00.159&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/19/26 13:25:00.159 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/pipeline_with_artifact_upload_download.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="95.894434439">
              <system-out>2026/07/19 13:25:50 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/19/26 13:24:14.221&#xA;Create an experiment with name E2EExperiment-1784467454221600492&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/19/26 13:24:14.354 (132ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/19/26 13:24:14.354&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x3239d9c90400&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/19/26 13:24:14.468 (114ms)&#xA;&gt; Enter [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/19/26 13:24:14.468&#xA;Uploading pipeline file critical/pipeline_with_artifact_upload_download.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1784467454354385622, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml&#xA;Upload of pipeline file &#39;critical/pipeline_with_artifact_upload_download.yaml&#39; successful&#xA;Listing pipeline versions for pipeline f92bc686-e19d-4e3a-b60b-ae24ca77f975&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;f92bc686-e19d-4e3a-b60b-ae24ca77f975&#39; and name: &#39;e2e-test-1784467454354385622&#39;&#xA;Create a pipeline run for pipeline with id=f92bc686-e19d-4e3a-b60b-ae24ca77f975 and versionId=56ecae07-4198-4cd0-9bf8-a27f334c8731&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=aba0dd67-77d6-4296-92a6-dda4f9fcab34&#xA;Created Pipeline Run with id: aba0dd67-77d6-4296-92a6-dda4f9fcab34 for pipeline with id: f92bc686-e19d-4e3a-b60b-ae24ca77f975&#xA;Waiting for pipeline run with id=aba0dd67-77d6-4296-92a6-dda4f9fcab34 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=aba0dd67-77d6-4296-92a6-dda4f9fcab34&#xA;Pipeline run with id=aba0dd67-77d6-4296-92a6-dda4f9fcab34 is in PENDING state, waiting...&#xA;Get a pipeline run with id=aba0dd67-77d6-4296-92a6-dda4f9fcab34&#xA;Pipeline run with id=aba0dd67-77d6-4296-92a6-dda4f9fcab34 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=aba0dd67-77d6-4296-92a6-dda4f9fcab34&#xA;Pipeline run with id=aba0dd67-77d6-4296-92a6-dda4f9fcab34 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=aba0dd67-77d6-4296-92a6-dda4f9fcab34&#xA;Pipeline run with id=aba0dd67-77d6-4296-92a6-dda4f9fcab34 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=aba0dd67-77d6-4296-92a6-dda4f9fcab34&#xA;Pipeline run with id=aba0dd67-77d6-4296-92a6-dda4f9fcab34 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=aba0dd67-77d6-4296-92a6-dda4f9fcab34&#xA;Pipeline run with id=aba0dd67-77d6-4296-92a6-dda4f9fcab34 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=aba0dd67-77d6-4296-92a6-dda4f9fcab34&#xA;Pipeline run with id=aba0dd67-77d6-4296-92a6-dda4f9fcab34 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=aba0dd67-77d6-4296-92a6-dda4f9fcab34&#xA;Pipeline run with id=aba0dd67-77d6-4296-92a6-dda4f9fcab34 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=aba0dd67-77d6-4296-92a6-dda4f9fcab34&#xA;Pipeline run with id=aba0dd67-77d6-4296-92a6-dda4f9fcab34 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=aba0dd67-77d6-4296-92a6-dda4f9fcab34&#xA;Pipeline run with id=aba0dd67-77d6-4296-92a6-dda4f9fcab34 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=aba0dd67-77d6-4296-92a6-dda4f9fcab34&#xA;Pipeline run with id=aba0dd67-77d6-4296-92a6-dda4f9fcab34 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=aba0dd67-77d6-4296-92a6-dda4f9fcab34&#xA;Pipeline run with id=aba0dd67-77d6-4296-92a6-dda4f9fcab34 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=aba0dd67-77d6-4296-92a6-dda4f9fcab34&#xA;Pipeline run with id=aba0dd67-77d6-4296-92a6-dda4f9fcab34 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=aba0dd67-77d6-4296-92a6-dda4f9fcab34&#xA;Pipeline run with id=aba0dd67-77d6-4296-92a6-dda4f9fcab34 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=aba0dd67-77d6-4296-92a6-dda4f9fcab34&#xA;Pipeline run with id=aba0dd67-77d6-4296-92a6-dda4f9fcab34 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=aba0dd67-77d6-4296-92a6-dda4f9fcab34&#xA;Pipeline run with id=aba0dd67-77d6-4296-92a6-dda4f9fcab34 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=aba0dd67-77d6-4296-92a6-dda4f9fcab34&#xA;Pipeline run with id=aba0dd67-77d6-4296-92a6-dda4f9fcab34 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=aba0dd67-77d6-4296-92a6-dda4f9fcab34&#xA;Pipeline run with id=aba0dd67-77d6-4296-92a6-dda4f9fcab34 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=aba0dd67-77d6-4296-92a6-dda4f9fcab34&#xA;Pipeline run with id=aba0dd67-77d6-4296-92a6-dda4f9fcab34 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=aba0dd67-77d6-4296-92a6-dda4f9fcab34&#xA;Pipeline run with id=aba0dd67-77d6-4296-92a6-dda4f9fcab34 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/pipeline_with_artifact_upload_download.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=aba0dd67-77d6-4296-92a6-dda4f9fcab34&#xA;Get a pipeline run with id=aba0dd67-77d6-4296-92a6-dda4f9fcab34&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/19/26 13:25:49.97 (1m35.502s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/19/26 13:25:49.97&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run aba0dd67-77d6-4296-92a6-dda4f9fcab34&#xA;Failed to terminate run aba0dd67-77d6-4296-92a6-dda4f9fcab34&#xA;Terminate run aba0dd67-77d6-4296-92a6-dda4f9fcab34&#xA;Deleting run aba0dd67-77d6-4296-92a6-dda4f9fcab34&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=f92bc686-e19d-4e3a-b60b-ae24ca77f975 (cascade=true)&#xA;Pipeline with id=f92bc686-e19d-4e3a-b60b-ae24ca77f975, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/19/26 13:25:50.115 (145ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/19/26 13:25:50.116&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/19/26 13:25:50.116 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/19/26 13:25:50.116&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/19/26 13:25:50.116 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/parallel_for_after_dependency.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="96.193631188">
              <system-out>2026/07/19 13:25:50 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/19/26 13:24:14.221&#xA;Create an experiment with name E2EExperiment-1784467454221348924&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/19/26 13:24:14.354 (133ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/19/26 13:24:14.354&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x2f88f3f50500&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/19/26 13:24:14.505 (151ms)&#xA;&gt; Enter [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/19/26 13:24:14.505&#xA;Uploading pipeline file critical/parallel_for_after_dependency.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1784467454354449507, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml&#xA;Upload of pipeline file &#39;critical/parallel_for_after_dependency.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 8f04cdc1-3005-4192-93c8-97b22c3f28e9&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;8f04cdc1-3005-4192-93c8-97b22c3f28e9&#39; and name: &#39;e2e-test-1784467454354449507&#39;&#xA;Create a pipeline run for pipeline with id=8f04cdc1-3005-4192-93c8-97b22c3f28e9 and versionId=b55661d0-9542-4b32-9969-100c5b4177d0&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=e5425294-3c92-4969-a961-50b109fcb040&#xA;Created Pipeline Run with id: e5425294-3c92-4969-a961-50b109fcb040 for pipeline with id: 8f04cdc1-3005-4192-93c8-97b22c3f28e9&#xA;Waiting for pipeline run with id=e5425294-3c92-4969-a961-50b109fcb040 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=e5425294-3c92-4969-a961-50b109fcb040&#xA;Pipeline run with id=e5425294-3c92-4969-a961-50b109fcb040 is in PENDING state, waiting...&#xA;Get a pipeline run with id=e5425294-3c92-4969-a961-50b109fcb040&#xA;Pipeline run with id=e5425294-3c92-4969-a961-50b109fcb040 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e5425294-3c92-4969-a961-50b109fcb040&#xA;Pipeline run with id=e5425294-3c92-4969-a961-50b109fcb040 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e5425294-3c92-4969-a961-50b109fcb040&#xA;Pipeline run with id=e5425294-3c92-4969-a961-50b109fcb040 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e5425294-3c92-4969-a961-50b109fcb040&#xA;Pipeline run with id=e5425294-3c92-4969-a961-50b109fcb040 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e5425294-3c92-4969-a961-50b109fcb040&#xA;Pipeline run with id=e5425294-3c92-4969-a961-50b109fcb040 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e5425294-3c92-4969-a961-50b109fcb040&#xA;Pipeline run with id=e5425294-3c92-4969-a961-50b109fcb040 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e5425294-3c92-4969-a961-50b109fcb040&#xA;Pipeline run with id=e5425294-3c92-4969-a961-50b109fcb040 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e5425294-3c92-4969-a961-50b109fcb040&#xA;Pipeline run with id=e5425294-3c92-4969-a961-50b109fcb040 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e5425294-3c92-4969-a961-50b109fcb040&#xA;Pipeline run with id=e5425294-3c92-4969-a961-50b109fcb040 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e5425294-3c92-4969-a961-50b109fcb040&#xA;Pipeline run with id=e5425294-3c92-4969-a961-50b109fcb040 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e5425294-3c92-4969-a961-50b109fcb040&#xA;Pipeline run with id=e5425294-3c92-4969-a961-50b109fcb040 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e5425294-3c92-4969-a961-50b109fcb040&#xA;Pipeline run with id=e5425294-3c92-4969-a961-50b109fcb040 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e5425294-3c92-4969-a961-50b109fcb040&#xA;Pipeline run with id=e5425294-3c92-4969-a961-50b109fcb040 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e5425294-3c92-4969-a961-50b109fcb040&#xA;Pipeline run with id=e5425294-3c92-4969-a961-50b109fcb040 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e5425294-3c92-4969-a961-50b109fcb040&#xA;Pipeline run with id=e5425294-3c92-4969-a961-50b109fcb040 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e5425294-3c92-4969-a961-50b109fcb040&#xA;Pipeline run with id=e5425294-3c92-4969-a961-50b109fcb040 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e5425294-3c92-4969-a961-50b109fcb040&#xA;Pipeline run with id=e5425294-3c92-4969-a961-50b109fcb040 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e5425294-3c92-4969-a961-50b109fcb040&#xA;Pipeline run with id=e5425294-3c92-4969-a961-50b109fcb040 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e5425294-3c92-4969-a961-50b109fcb040&#xA;Pipeline run with id=e5425294-3c92-4969-a961-50b109fcb040 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/parallel_for_after_dependency.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=e5425294-3c92-4969-a961-50b109fcb040&#xA;Get a pipeline run with id=e5425294-3c92-4969-a961-50b109fcb040&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/19/26 13:25:49.992 (1m35.488s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/19/26 13:25:49.993&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run e5425294-3c92-4969-a961-50b109fcb040&#xA;Failed to terminate run e5425294-3c92-4969-a961-50b109fcb040&#xA;Terminate run e5425294-3c92-4969-a961-50b109fcb040&#xA;Deleting run e5425294-3c92-4969-a961-50b109fcb040&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=8f04cdc1-3005-4192-93c8-97b22c3f28e9 (cascade=true)&#xA;Pipeline with id=8f04cdc1-3005-4192-93c8-97b22c3f28e9, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/19/26 13:25:50.414 (422ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/19/26 13:25:50.415&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/19/26 13:25:50.415 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/19/26 13:25:50.415&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/19/26 13:25:50.415 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/flip_coin.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="126.11638022">
              <system-out>2026/07/19 13:26:20 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/19/26 13:24:14.221&#xA;Create an experiment with name E2EExperiment-1784467454221299130&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/19/26 13:24:14.357 (136ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/19/26 13:24:14.357&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x2d0120a36d00&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/19/26 13:24:14.455 (98ms)&#xA;&gt; Enter [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/19/26 13:24:14.455&#xA;Uploading pipeline file critical/flip_coin.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1784467454357765064, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml&#xA;Upload of pipeline file &#39;critical/flip_coin.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 435bd01a-7e77-4d2c-9fd0-73b2d6009061&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;435bd01a-7e77-4d2c-9fd0-73b2d6009061&#39; and name: &#39;e2e-test-1784467454357765064&#39;&#xA;Create a pipeline run for pipeline with id=435bd01a-7e77-4d2c-9fd0-73b2d6009061 and versionId=f78509be-1f1e-4793-9a15-a2651d0d884c&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=1ab8c086-24cb-47f0-aa09-1cf67d6ce609&#xA;Created Pipeline Run with id: 1ab8c086-24cb-47f0-aa09-1cf67d6ce609 for pipeline with id: 435bd01a-7e77-4d2c-9fd0-73b2d6009061&#xA;Waiting for pipeline run with id=1ab8c086-24cb-47f0-aa09-1cf67d6ce609 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=1ab8c086-24cb-47f0-aa09-1cf67d6ce609&#xA;Pipeline run with id=1ab8c086-24cb-47f0-aa09-1cf67d6ce609 is in PENDING state, waiting...&#xA;Get a pipeline run with id=1ab8c086-24cb-47f0-aa09-1cf67d6ce609&#xA;Pipeline run with id=1ab8c086-24cb-47f0-aa09-1cf67d6ce609 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ab8c086-24cb-47f0-aa09-1cf67d6ce609&#xA;Pipeline run with id=1ab8c086-24cb-47f0-aa09-1cf67d6ce609 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ab8c086-24cb-47f0-aa09-1cf67d6ce609&#xA;Pipeline run with id=1ab8c086-24cb-47f0-aa09-1cf67d6ce609 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ab8c086-24cb-47f0-aa09-1cf67d6ce609&#xA;Pipeline run with id=1ab8c086-24cb-47f0-aa09-1cf67d6ce609 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ab8c086-24cb-47f0-aa09-1cf67d6ce609&#xA;Pipeline run with id=1ab8c086-24cb-47f0-aa09-1cf67d6ce609 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ab8c086-24cb-47f0-aa09-1cf67d6ce609&#xA;Pipeline run with id=1ab8c086-24cb-47f0-aa09-1cf67d6ce609 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ab8c086-24cb-47f0-aa09-1cf67d6ce609&#xA;Pipeline run with id=1ab8c086-24cb-47f0-aa09-1cf67d6ce609 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ab8c086-24cb-47f0-aa09-1cf67d6ce609&#xA;Pipeline run with id=1ab8c086-24cb-47f0-aa09-1cf67d6ce609 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ab8c086-24cb-47f0-aa09-1cf67d6ce609&#xA;Pipeline run with id=1ab8c086-24cb-47f0-aa09-1cf67d6ce609 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ab8c086-24cb-47f0-aa09-1cf67d6ce609&#xA;Pipeline run with id=1ab8c086-24cb-47f0-aa09-1cf67d6ce609 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ab8c086-24cb-47f0-aa09-1cf67d6ce609&#xA;Pipeline run with id=1ab8c086-24cb-47f0-aa09-1cf67d6ce609 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ab8c086-24cb-47f0-aa09-1cf67d6ce609&#xA;Pipeline run with id=1ab8c086-24cb-47f0-aa09-1cf67d6ce609 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ab8c086-24cb-47f0-aa09-1cf67d6ce609&#xA;Pipeline run with id=1ab8c086-24cb-47f0-aa09-1cf67d6ce609 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ab8c086-24cb-47f0-aa09-1cf67d6ce609&#xA;Pipeline run with id=1ab8c086-24cb-47f0-aa09-1cf67d6ce609 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ab8c086-24cb-47f0-aa09-1cf67d6ce609&#xA;Pipeline run with id=1ab8c086-24cb-47f0-aa09-1cf67d6ce609 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ab8c086-24cb-47f0-aa09-1cf67d6ce609&#xA;Pipeline run with id=1ab8c086-24cb-47f0-aa09-1cf67d6ce609 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ab8c086-24cb-47f0-aa09-1cf67d6ce609&#xA;Pipeline run with id=1ab8c086-24cb-47f0-aa09-1cf67d6ce609 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ab8c086-24cb-47f0-aa09-1cf67d6ce609&#xA;Pipeline run with id=1ab8c086-24cb-47f0-aa09-1cf67d6ce609 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ab8c086-24cb-47f0-aa09-1cf67d6ce609&#xA;Pipeline run with id=1ab8c086-24cb-47f0-aa09-1cf67d6ce609 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ab8c086-24cb-47f0-aa09-1cf67d6ce609&#xA;Pipeline run with id=1ab8c086-24cb-47f0-aa09-1cf67d6ce609 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ab8c086-24cb-47f0-aa09-1cf67d6ce609&#xA;Pipeline run with id=1ab8c086-24cb-47f0-aa09-1cf67d6ce609 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ab8c086-24cb-47f0-aa09-1cf67d6ce609&#xA;Pipeline run with id=1ab8c086-24cb-47f0-aa09-1cf67d6ce609 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ab8c086-24cb-47f0-aa09-1cf67d6ce609&#xA;Pipeline run with id=1ab8c086-24cb-47f0-aa09-1cf67d6ce609 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ab8c086-24cb-47f0-aa09-1cf67d6ce609&#xA;Pipeline run with id=1ab8c086-24cb-47f0-aa09-1cf67d6ce609 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ab8c086-24cb-47f0-aa09-1cf67d6ce609&#xA;Pipeline run with id=1ab8c086-24cb-47f0-aa09-1cf67d6ce609 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/flip_coin.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=1ab8c086-24cb-47f0-aa09-1cf67d6ce609&#xA;Get a pipeline run with id=1ab8c086-24cb-47f0-aa09-1cf67d6ce609&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/19/26 13:26:20.124 (2m5.669s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/19/26 13:26:20.124&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 1ab8c086-24cb-47f0-aa09-1cf67d6ce609&#xA;Failed to terminate run 1ab8c086-24cb-47f0-aa09-1cf67d6ce609&#xA;Terminate run 1ab8c086-24cb-47f0-aa09-1cf67d6ce609&#xA;Deleting run 1ab8c086-24cb-47f0-aa09-1cf67d6ce609&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=435bd01a-7e77-4d2c-9fd0-73b2d6009061 (cascade=true)&#xA;Pipeline with id=435bd01a-7e77-4d2c-9fd0-73b2d6009061, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/19/26 13:26:20.337 (213ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/19/26 13:26:20.338&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/19/26 13:26:20.338 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/19/26 13:26:20.338&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/19/26 13:26:20.338 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload essential/iris_pipeline_compiled.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="156.111203097">
              <system-out>2026/07/19 13:26:50 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/19/26 13:24:14.221&#xA;Create an experiment with name E2EExperiment-1784467454221786315&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/19/26 13:24:14.355 (133ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/19/26 13:24:14.355&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x9df6f8d0680&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/19/26 13:24:14.48 (125ms)&#xA;&gt; Enter [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/19/26 13:24:14.48&#xA;Uploading pipeline file essential/iris_pipeline_compiled.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1784467454355459899, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml&#xA;Upload of pipeline file &#39;essential/iris_pipeline_compiled.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 0cdeebd9-a0c8-410c-ac90-0e57516a512e&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;0cdeebd9-a0c8-410c-ac90-0e57516a512e&#39; and name: &#39;e2e-test-1784467454355459899&#39;&#xA;Create a pipeline run for pipeline with id=0cdeebd9-a0c8-410c-ac90-0e57516a512e and versionId=7d1102fa-915b-410d-96ef-2807cd6c3655&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=209b3e93-da40-4ad5-be9b-667ee5ac0f28&#xA;Created Pipeline Run with id: 209b3e93-da40-4ad5-be9b-667ee5ac0f28 for pipeline with id: 0cdeebd9-a0c8-410c-ac90-0e57516a512e&#xA;Waiting for pipeline run with id=209b3e93-da40-4ad5-be9b-667ee5ac0f28 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=209b3e93-da40-4ad5-be9b-667ee5ac0f28&#xA;Pipeline run with id=209b3e93-da40-4ad5-be9b-667ee5ac0f28 is in PENDING state, waiting...&#xA;Get a pipeline run with id=209b3e93-da40-4ad5-be9b-667ee5ac0f28&#xA;Pipeline run with id=209b3e93-da40-4ad5-be9b-667ee5ac0f28 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=209b3e93-da40-4ad5-be9b-667ee5ac0f28&#xA;Pipeline run with id=209b3e93-da40-4ad5-be9b-667ee5ac0f28 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=209b3e93-da40-4ad5-be9b-667ee5ac0f28&#xA;Pipeline run with id=209b3e93-da40-4ad5-be9b-667ee5ac0f28 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=209b3e93-da40-4ad5-be9b-667ee5ac0f28&#xA;Pipeline run with id=209b3e93-da40-4ad5-be9b-667ee5ac0f28 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=209b3e93-da40-4ad5-be9b-667ee5ac0f28&#xA;Pipeline run with id=209b3e93-da40-4ad5-be9b-667ee5ac0f28 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=209b3e93-da40-4ad5-be9b-667ee5ac0f28&#xA;Pipeline run with id=209b3e93-da40-4ad5-be9b-667ee5ac0f28 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=209b3e93-da40-4ad5-be9b-667ee5ac0f28&#xA;Pipeline run with id=209b3e93-da40-4ad5-be9b-667ee5ac0f28 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=209b3e93-da40-4ad5-be9b-667ee5ac0f28&#xA;Pipeline run with id=209b3e93-da40-4ad5-be9b-667ee5ac0f28 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=209b3e93-da40-4ad5-be9b-667ee5ac0f28&#xA;Pipeline run with id=209b3e93-da40-4ad5-be9b-667ee5ac0f28 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=209b3e93-da40-4ad5-be9b-667ee5ac0f28&#xA;Pipeline run with id=209b3e93-da40-4ad5-be9b-667ee5ac0f28 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=209b3e93-da40-4ad5-be9b-667ee5ac0f28&#xA;Pipeline run with id=209b3e93-da40-4ad5-be9b-667ee5ac0f28 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=209b3e93-da40-4ad5-be9b-667ee5ac0f28&#xA;Pipeline run with id=209b3e93-da40-4ad5-be9b-667ee5ac0f28 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=209b3e93-da40-4ad5-be9b-667ee5ac0f28&#xA;Pipeline run with id=209b3e93-da40-4ad5-be9b-667ee5ac0f28 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=209b3e93-da40-4ad5-be9b-667ee5ac0f28&#xA;Pipeline run with id=209b3e93-da40-4ad5-be9b-667ee5ac0f28 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=209b3e93-da40-4ad5-be9b-667ee5ac0f28&#xA;Pipeline run with id=209b3e93-da40-4ad5-be9b-667ee5ac0f28 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=209b3e93-da40-4ad5-be9b-667ee5ac0f28&#xA;Pipeline run with id=209b3e93-da40-4ad5-be9b-667ee5ac0f28 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=209b3e93-da40-4ad5-be9b-667ee5ac0f28&#xA;Pipeline run with id=209b3e93-da40-4ad5-be9b-667ee5ac0f28 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=209b3e93-da40-4ad5-be9b-667ee5ac0f28&#xA;Pipeline run with id=209b3e93-da40-4ad5-be9b-667ee5ac0f28 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=209b3e93-da40-4ad5-be9b-667ee5ac0f28&#xA;Pipeline run with id=209b3e93-da40-4ad5-be9b-667ee5ac0f28 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=209b3e93-da40-4ad5-be9b-667ee5ac0f28&#xA;Pipeline run with id=209b3e93-da40-4ad5-be9b-667ee5ac0f28 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=209b3e93-da40-4ad5-be9b-667ee5ac0f28&#xA;Pipeline run with id=209b3e93-da40-4ad5-be9b-667ee5ac0f28 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=209b3e93-da40-4ad5-be9b-667ee5ac0f28&#xA;Pipeline run with id=209b3e93-da40-4ad5-be9b-667ee5ac0f28 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=209b3e93-da40-4ad5-be9b-667ee5ac0f28&#xA;Pipeline run with id=209b3e93-da40-4ad5-be9b-667ee5ac0f28 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=209b3e93-da40-4ad5-be9b-667ee5ac0f28&#xA;Pipeline run with id=209b3e93-da40-4ad5-be9b-667ee5ac0f28 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=209b3e93-da40-4ad5-be9b-667ee5ac0f28&#xA;Pipeline run with id=209b3e93-da40-4ad5-be9b-667ee5ac0f28 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=209b3e93-da40-4ad5-be9b-667ee5ac0f28&#xA;Pipeline run with id=209b3e93-da40-4ad5-be9b-667ee5ac0f28 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=209b3e93-da40-4ad5-be9b-667ee5ac0f28&#xA;Pipeline run with id=209b3e93-da40-4ad5-be9b-667ee5ac0f28 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=209b3e93-da40-4ad5-be9b-667ee5ac0f28&#xA;Pipeline run with id=209b3e93-da40-4ad5-be9b-667ee5ac0f28 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=209b3e93-da40-4ad5-be9b-667ee5ac0f28&#xA;Pipeline run with id=209b3e93-da40-4ad5-be9b-667ee5ac0f28 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=209b3e93-da40-4ad5-be9b-667ee5ac0f28&#xA;Pipeline run with id=209b3e93-da40-4ad5-be9b-667ee5ac0f28 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=209b3e93-da40-4ad5-be9b-667ee5ac0f28&#xA;Pipeline run with id=209b3e93-da40-4ad5-be9b-667ee5ac0f28 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;essential/iris_pipeline_compiled.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=209b3e93-da40-4ad5-be9b-667ee5ac0f28&#xA;Get a pipeline run with id=209b3e93-da40-4ad5-be9b-667ee5ac0f28&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/19/26 13:26:50.181 (2m35.701s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/19/26 13:26:50.181&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 209b3e93-da40-4ad5-be9b-667ee5ac0f28&#xA;Failed to terminate run 209b3e93-da40-4ad5-be9b-667ee5ac0f28&#xA;Terminate run 209b3e93-da40-4ad5-be9b-667ee5ac0f28&#xA;Deleting run 209b3e93-da40-4ad5-be9b-667ee5ac0f28&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=0cdeebd9-a0c8-410c-ac90-0e57516a512e (cascade=true)&#xA;Pipeline with id=0cdeebd9-a0c8-410c-ac90-0e57516a512e, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/19/26 13:26:50.332 (151ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/19/26 13:26:50.333&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/19/26 13:26:50.333 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/19/26 13:26:50.333&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/19/26 13:26:50.333 (0s)&#xA;</system-err>
          </testcase>
      </testsuite>
  </testsuites>