<?xml version="1.0" encoding="UTF-8"?>
  <testsuites tests="5" disabled="0" errors="0" failures="0" time="166.520111558">
      <testsuite name="AIPipelinesE2ETests" package="/dspa/backend/test/end2end" tests="5" disabled="0" skipped="0" errors="0" failures="0" time="166.520111558" timestamp="2026-07-01T19:19:39">
          <properties>
              <property name="SuiteSucceeded" value="true"></property>
              <property name="SuiteHasProgrammaticFocus" value="false"></property>
              <property name="SpecialSuiteFailureReason" value=""></property>
              <property name="SuiteLabels" value="[]"></property>
              <property name="SuiteSemVerConstraints" value="[]"></property>
              <property name="RandomSeed" value="1782933405"></property>
              <property name="RandomizeAllSpecs" value="false"></property>
              <property name="LabelFilter" value="Smoke"></property>
              <property name="SemVerFilter" value=""></property>
              <property name="FocusStrings" value=""></property>
              <property name="SkipStrings" value=""></property>
              <property name="FocusFiles" value=""></property>
              <property name="SkipFiles" value=""></property>
              <property name="FailOnPending" value="false"></property>
              <property name="FailOnEmpty" value="false"></property>
              <property name="FailFast" value="false"></property>
              <property name="FlakeAttempts" value="0"></property>
              <property name="DryRun" value="false"></property>
              <property name="ParallelTotal" value="10"></property>
              <property name="OutputInterceptorMode" value=""></property>
          </properties>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/flip_coin.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="141.348050148">
              <system-out>2026/07/01 19:22:01 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/01/26 19:19:39.8&#xA;Create an experiment with name E2EExperiment-1782933579800907382&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/01/26 19:19:40.101 (301ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/01/26 19:19:40.102&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x3b5379984b00&#xA;test-secret-1 created&#xA;test-secret-2 created&#xA;test-secret-3 created&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/01/26 19:19:40.145 (43ms)&#xA;&gt; Enter [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/01/26 19:19:40.145&#xA;Uploading pipeline file critical/flip_coin.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1782933580102167962, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml&#xA;Upload of pipeline file &#39;critical/flip_coin.yaml&#39; successful&#xA;Listing pipeline versions for pipeline fec54e72-17ca-4a87-89c8-dea49c7f07e6&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;fec54e72-17ca-4a87-89c8-dea49c7f07e6&#39; and name: &#39;e2e-test-1782933580102167962&#39;&#xA;Create a pipeline run for pipeline with id=fec54e72-17ca-4a87-89c8-dea49c7f07e6 and versionId=764e0b89-c2a8-44a9-a327-699f2c1ea308&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=c933cbee-7974-4c12-990e-af94554316e6&#xA;Created Pipeline Run with id: c933cbee-7974-4c12-990e-af94554316e6 for pipeline with id: fec54e72-17ca-4a87-89c8-dea49c7f07e6&#xA;Waiting for pipeline run with id=c933cbee-7974-4c12-990e-af94554316e6 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=c933cbee-7974-4c12-990e-af94554316e6&#xA;Pipeline run with id=c933cbee-7974-4c12-990e-af94554316e6 is in PENDING state, waiting...&#xA;Get a pipeline run with id=c933cbee-7974-4c12-990e-af94554316e6&#xA;Pipeline run with id=c933cbee-7974-4c12-990e-af94554316e6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c933cbee-7974-4c12-990e-af94554316e6&#xA;Pipeline run with id=c933cbee-7974-4c12-990e-af94554316e6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c933cbee-7974-4c12-990e-af94554316e6&#xA;Pipeline run with id=c933cbee-7974-4c12-990e-af94554316e6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c933cbee-7974-4c12-990e-af94554316e6&#xA;Pipeline run with id=c933cbee-7974-4c12-990e-af94554316e6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c933cbee-7974-4c12-990e-af94554316e6&#xA;Pipeline run with id=c933cbee-7974-4c12-990e-af94554316e6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c933cbee-7974-4c12-990e-af94554316e6&#xA;Pipeline run with id=c933cbee-7974-4c12-990e-af94554316e6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c933cbee-7974-4c12-990e-af94554316e6&#xA;Pipeline run with id=c933cbee-7974-4c12-990e-af94554316e6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c933cbee-7974-4c12-990e-af94554316e6&#xA;Pipeline run with id=c933cbee-7974-4c12-990e-af94554316e6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c933cbee-7974-4c12-990e-af94554316e6&#xA;Pipeline run with id=c933cbee-7974-4c12-990e-af94554316e6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c933cbee-7974-4c12-990e-af94554316e6&#xA;Pipeline run with id=c933cbee-7974-4c12-990e-af94554316e6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c933cbee-7974-4c12-990e-af94554316e6&#xA;Pipeline run with id=c933cbee-7974-4c12-990e-af94554316e6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c933cbee-7974-4c12-990e-af94554316e6&#xA;Pipeline run with id=c933cbee-7974-4c12-990e-af94554316e6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c933cbee-7974-4c12-990e-af94554316e6&#xA;Pipeline run with id=c933cbee-7974-4c12-990e-af94554316e6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c933cbee-7974-4c12-990e-af94554316e6&#xA;Pipeline run with id=c933cbee-7974-4c12-990e-af94554316e6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c933cbee-7974-4c12-990e-af94554316e6&#xA;Pipeline run with id=c933cbee-7974-4c12-990e-af94554316e6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c933cbee-7974-4c12-990e-af94554316e6&#xA;Pipeline run with id=c933cbee-7974-4c12-990e-af94554316e6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c933cbee-7974-4c12-990e-af94554316e6&#xA;Pipeline run with id=c933cbee-7974-4c12-990e-af94554316e6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c933cbee-7974-4c12-990e-af94554316e6&#xA;Pipeline run with id=c933cbee-7974-4c12-990e-af94554316e6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c933cbee-7974-4c12-990e-af94554316e6&#xA;Pipeline run with id=c933cbee-7974-4c12-990e-af94554316e6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c933cbee-7974-4c12-990e-af94554316e6&#xA;Pipeline run with id=c933cbee-7974-4c12-990e-af94554316e6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c933cbee-7974-4c12-990e-af94554316e6&#xA;Pipeline run with id=c933cbee-7974-4c12-990e-af94554316e6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c933cbee-7974-4c12-990e-af94554316e6&#xA;Pipeline run with id=c933cbee-7974-4c12-990e-af94554316e6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c933cbee-7974-4c12-990e-af94554316e6&#xA;Pipeline run with id=c933cbee-7974-4c12-990e-af94554316e6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c933cbee-7974-4c12-990e-af94554316e6&#xA;Pipeline run with id=c933cbee-7974-4c12-990e-af94554316e6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c933cbee-7974-4c12-990e-af94554316e6&#xA;Pipeline run with id=c933cbee-7974-4c12-990e-af94554316e6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c933cbee-7974-4c12-990e-af94554316e6&#xA;Pipeline run with id=c933cbee-7974-4c12-990e-af94554316e6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c933cbee-7974-4c12-990e-af94554316e6&#xA;Pipeline run with id=c933cbee-7974-4c12-990e-af94554316e6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c933cbee-7974-4c12-990e-af94554316e6&#xA;Pipeline run with id=c933cbee-7974-4c12-990e-af94554316e6 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/flip_coin.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=c933cbee-7974-4c12-990e-af94554316e6&#xA;Get a pipeline run with id=c933cbee-7974-4c12-990e-af94554316e6&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/01/26 19:22:00.896 (2m20.751s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/01/26 19:22:00.896&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run c933cbee-7974-4c12-990e-af94554316e6&#xA;Failed to terminate run c933cbee-7974-4c12-990e-af94554316e6&#xA;Terminate run c933cbee-7974-4c12-990e-af94554316e6&#xA;Deleting run c933cbee-7974-4c12-990e-af94554316e6&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=fec54e72-17ca-4a87-89c8-dea49c7f07e6 (cascade=true)&#xA;Pipeline with id=fec54e72-17ca-4a87-89c8-dea49c7f07e6, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/01/26 19:22:01.148 (252ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/01/26 19:22:01.148&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/01/26 19:22:01.148 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/01/26 19:22:01.149&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/01/26 19:22:01.149 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload essential/component_with_pip_index_urls.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="46.079860456">
              <system-out>2026/07/01 19:20:25 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/01/26 19:19:39.801&#xA;Create an experiment with name E2EExperiment-1782933579801208000&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/01/26 19:19:40.133 (333ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/01/26 19:19:40.133&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x11605e366b00&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/01/26 19:19:40.233 (100ms)&#xA;&gt; Enter [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/01/26 19:19:40.233&#xA;Uploading pipeline file essential/component_with_pip_index_urls.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1782933580133987033, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml&#xA;Upload of pipeline file &#39;essential/component_with_pip_index_urls.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 8d250bd3-df93-4515-bebe-b9488bb7733b&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;8d250bd3-df93-4515-bebe-b9488bb7733b&#39; and name: &#39;e2e-test-1782933580133987033&#39;&#xA;Create a pipeline run for pipeline with id=8d250bd3-df93-4515-bebe-b9488bb7733b and versionId=6df3a0db-b3c6-4142-8a3f-40cefd9cb126&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=88bc21be-f0c8-459e-9386-dc7c0e368b08&#xA;Created Pipeline Run with id: 88bc21be-f0c8-459e-9386-dc7c0e368b08 for pipeline with id: 8d250bd3-df93-4515-bebe-b9488bb7733b&#xA;Waiting for pipeline run with id=88bc21be-f0c8-459e-9386-dc7c0e368b08 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=88bc21be-f0c8-459e-9386-dc7c0e368b08&#xA;Pipeline run with id=88bc21be-f0c8-459e-9386-dc7c0e368b08 is in PENDING state, waiting...&#xA;Get a pipeline run with id=88bc21be-f0c8-459e-9386-dc7c0e368b08&#xA;Pipeline run with id=88bc21be-f0c8-459e-9386-dc7c0e368b08 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=88bc21be-f0c8-459e-9386-dc7c0e368b08&#xA;Pipeline run with id=88bc21be-f0c8-459e-9386-dc7c0e368b08 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=88bc21be-f0c8-459e-9386-dc7c0e368b08&#xA;Pipeline run with id=88bc21be-f0c8-459e-9386-dc7c0e368b08 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=88bc21be-f0c8-459e-9386-dc7c0e368b08&#xA;Pipeline run with id=88bc21be-f0c8-459e-9386-dc7c0e368b08 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=88bc21be-f0c8-459e-9386-dc7c0e368b08&#xA;Pipeline run with id=88bc21be-f0c8-459e-9386-dc7c0e368b08 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=88bc21be-f0c8-459e-9386-dc7c0e368b08&#xA;Pipeline run with id=88bc21be-f0c8-459e-9386-dc7c0e368b08 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=88bc21be-f0c8-459e-9386-dc7c0e368b08&#xA;Pipeline run with id=88bc21be-f0c8-459e-9386-dc7c0e368b08 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=88bc21be-f0c8-459e-9386-dc7c0e368b08&#xA;Pipeline run with id=88bc21be-f0c8-459e-9386-dc7c0e368b08 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=88bc21be-f0c8-459e-9386-dc7c0e368b08&#xA;Pipeline run with id=88bc21be-f0c8-459e-9386-dc7c0e368b08 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;essential/component_with_pip_index_urls.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=88bc21be-f0c8-459e-9386-dc7c0e368b08&#xA;Get a pipeline run with id=88bc21be-f0c8-459e-9386-dc7c0e368b08&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/01/26 19:20:25.697 (45.463s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/01/26 19:20:25.697&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 88bc21be-f0c8-459e-9386-dc7c0e368b08&#xA;Failed to terminate run 88bc21be-f0c8-459e-9386-dc7c0e368b08&#xA;Terminate run 88bc21be-f0c8-459e-9386-dc7c0e368b08&#xA;Deleting run 88bc21be-f0c8-459e-9386-dc7c0e368b08&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=8d250bd3-df93-4515-bebe-b9488bb7733b (cascade=true)&#xA;Pipeline with id=8d250bd3-df93-4515-bebe-b9488bb7733b, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/01/26 19:20:25.88 (184ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/01/26 19:20:25.881&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/01/26 19:20:25.881 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/01/26 19:20:25.881&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/01/26 19:20:25.881 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/pipeline_with_artifact_upload_download.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="101.070880287">
              <system-out>2026/07/01 19:21:20 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/01/26 19:19:39.801&#xA;Create an experiment with name E2EExperiment-1782933579801180809&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/01/26 19:19:40.132 (331ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/01/26 19:19:40.132&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x12063770ef00&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/01/26 19:19:40.235 (102ms)&#xA;&gt; Enter [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/01/26 19:19:40.235&#xA;Uploading pipeline file critical/pipeline_with_artifact_upload_download.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1782933580132844364, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml&#xA;Upload of pipeline file &#39;critical/pipeline_with_artifact_upload_download.yaml&#39; successful&#xA;Listing pipeline versions for pipeline f1998f14-3bc6-4fc8-b05c-c8b4924fd9b1&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;f1998f14-3bc6-4fc8-b05c-c8b4924fd9b1&#39; and name: &#39;e2e-test-1782933580132844364&#39;&#xA;Create a pipeline run for pipeline with id=f1998f14-3bc6-4fc8-b05c-c8b4924fd9b1 and versionId=18299072-37be-4bc7-933b-84aba46bb888&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=f7131270-a39f-45a7-bccf-e862b53f99a1&#xA;Created Pipeline Run with id: f7131270-a39f-45a7-bccf-e862b53f99a1 for pipeline with id: f1998f14-3bc6-4fc8-b05c-c8b4924fd9b1&#xA;Waiting for pipeline run with id=f7131270-a39f-45a7-bccf-e862b53f99a1 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=f7131270-a39f-45a7-bccf-e862b53f99a1&#xA;Pipeline run with id=f7131270-a39f-45a7-bccf-e862b53f99a1 is in PENDING state, waiting...&#xA;Get a pipeline run with id=f7131270-a39f-45a7-bccf-e862b53f99a1&#xA;Pipeline run with id=f7131270-a39f-45a7-bccf-e862b53f99a1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f7131270-a39f-45a7-bccf-e862b53f99a1&#xA;Pipeline run with id=f7131270-a39f-45a7-bccf-e862b53f99a1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f7131270-a39f-45a7-bccf-e862b53f99a1&#xA;Pipeline run with id=f7131270-a39f-45a7-bccf-e862b53f99a1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f7131270-a39f-45a7-bccf-e862b53f99a1&#xA;Pipeline run with id=f7131270-a39f-45a7-bccf-e862b53f99a1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f7131270-a39f-45a7-bccf-e862b53f99a1&#xA;Pipeline run with id=f7131270-a39f-45a7-bccf-e862b53f99a1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f7131270-a39f-45a7-bccf-e862b53f99a1&#xA;Pipeline run with id=f7131270-a39f-45a7-bccf-e862b53f99a1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f7131270-a39f-45a7-bccf-e862b53f99a1&#xA;Pipeline run with id=f7131270-a39f-45a7-bccf-e862b53f99a1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f7131270-a39f-45a7-bccf-e862b53f99a1&#xA;Pipeline run with id=f7131270-a39f-45a7-bccf-e862b53f99a1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f7131270-a39f-45a7-bccf-e862b53f99a1&#xA;Pipeline run with id=f7131270-a39f-45a7-bccf-e862b53f99a1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f7131270-a39f-45a7-bccf-e862b53f99a1&#xA;Pipeline run with id=f7131270-a39f-45a7-bccf-e862b53f99a1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f7131270-a39f-45a7-bccf-e862b53f99a1&#xA;Pipeline run with id=f7131270-a39f-45a7-bccf-e862b53f99a1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f7131270-a39f-45a7-bccf-e862b53f99a1&#xA;Pipeline run with id=f7131270-a39f-45a7-bccf-e862b53f99a1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f7131270-a39f-45a7-bccf-e862b53f99a1&#xA;Pipeline run with id=f7131270-a39f-45a7-bccf-e862b53f99a1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f7131270-a39f-45a7-bccf-e862b53f99a1&#xA;Pipeline run with id=f7131270-a39f-45a7-bccf-e862b53f99a1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f7131270-a39f-45a7-bccf-e862b53f99a1&#xA;Pipeline run with id=f7131270-a39f-45a7-bccf-e862b53f99a1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f7131270-a39f-45a7-bccf-e862b53f99a1&#xA;Pipeline run with id=f7131270-a39f-45a7-bccf-e862b53f99a1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f7131270-a39f-45a7-bccf-e862b53f99a1&#xA;Pipeline run with id=f7131270-a39f-45a7-bccf-e862b53f99a1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f7131270-a39f-45a7-bccf-e862b53f99a1&#xA;Pipeline run with id=f7131270-a39f-45a7-bccf-e862b53f99a1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f7131270-a39f-45a7-bccf-e862b53f99a1&#xA;Pipeline run with id=f7131270-a39f-45a7-bccf-e862b53f99a1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f7131270-a39f-45a7-bccf-e862b53f99a1&#xA;Pipeline run with id=f7131270-a39f-45a7-bccf-e862b53f99a1 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/pipeline_with_artifact_upload_download.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=f7131270-a39f-45a7-bccf-e862b53f99a1&#xA;Get a pipeline run with id=f7131270-a39f-45a7-bccf-e862b53f99a1&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/01/26 19:21:20.701 (1m40.466s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/01/26 19:21:20.701&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run f7131270-a39f-45a7-bccf-e862b53f99a1&#xA;Failed to terminate run f7131270-a39f-45a7-bccf-e862b53f99a1&#xA;Terminate run f7131270-a39f-45a7-bccf-e862b53f99a1&#xA;Deleting run f7131270-a39f-45a7-bccf-e862b53f99a1&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=f1998f14-3bc6-4fc8-b05c-c8b4924fd9b1 (cascade=true)&#xA;Pipeline with id=f1998f14-3bc6-4fc8-b05c-c8b4924fd9b1, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/01/26 19:21:20.871 (170ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/01/26 19:21:20.872&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/01/26 19:21:20.872 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/01/26 19:21:20.872&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/01/26 19:21:20.872 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/parallel_for_after_dependency.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="121.234284693">
              <system-out>2026/07/01 19:21:41 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/01/26 19:19:39.8&#xA;Create an experiment with name E2EExperiment-1782933579800716897&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/01/26 19:19:40.132 (332ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/01/26 19:19:40.133&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x257444f8e300&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/01/26 19:19:40.236 (103ms)&#xA;&gt; Enter [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/01/26 19:19:40.236&#xA;Uploading pipeline file critical/parallel_for_after_dependency.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1782933580133064099, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml&#xA;Upload of pipeline file &#39;critical/parallel_for_after_dependency.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 22b278e5-ea52-49f4-b51c-3e3d30fdfdce&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;22b278e5-ea52-49f4-b51c-3e3d30fdfdce&#39; and name: &#39;e2e-test-1782933580133064099&#39;&#xA;Create a pipeline run for pipeline with id=22b278e5-ea52-49f4-b51c-3e3d30fdfdce and versionId=b2b881ea-01bd-4411-b777-d76215353746&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=cd3e386f-316c-4a18-8e5b-78a40c62f3aa&#xA;Created Pipeline Run with id: cd3e386f-316c-4a18-8e5b-78a40c62f3aa for pipeline with id: 22b278e5-ea52-49f4-b51c-3e3d30fdfdce&#xA;Waiting for pipeline run with id=cd3e386f-316c-4a18-8e5b-78a40c62f3aa to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=cd3e386f-316c-4a18-8e5b-78a40c62f3aa&#xA;Pipeline run with id=cd3e386f-316c-4a18-8e5b-78a40c62f3aa is in PENDING state, waiting...&#xA;Get a pipeline run with id=cd3e386f-316c-4a18-8e5b-78a40c62f3aa&#xA;Pipeline run with id=cd3e386f-316c-4a18-8e5b-78a40c62f3aa is in RUNNING state, waiting...&#xA;Get a pipeline run with id=cd3e386f-316c-4a18-8e5b-78a40c62f3aa&#xA;Pipeline run with id=cd3e386f-316c-4a18-8e5b-78a40c62f3aa is in RUNNING state, waiting...&#xA;Get a pipeline run with id=cd3e386f-316c-4a18-8e5b-78a40c62f3aa&#xA;Pipeline run with id=cd3e386f-316c-4a18-8e5b-78a40c62f3aa is in RUNNING state, waiting...&#xA;Get a pipeline run with id=cd3e386f-316c-4a18-8e5b-78a40c62f3aa&#xA;Pipeline run with id=cd3e386f-316c-4a18-8e5b-78a40c62f3aa is in RUNNING state, waiting...&#xA;Get a pipeline run with id=cd3e386f-316c-4a18-8e5b-78a40c62f3aa&#xA;Pipeline run with id=cd3e386f-316c-4a18-8e5b-78a40c62f3aa is in RUNNING state, waiting...&#xA;Get a pipeline run with id=cd3e386f-316c-4a18-8e5b-78a40c62f3aa&#xA;Pipeline run with id=cd3e386f-316c-4a18-8e5b-78a40c62f3aa is in RUNNING state, waiting...&#xA;Get a pipeline run with id=cd3e386f-316c-4a18-8e5b-78a40c62f3aa&#xA;Pipeline run with id=cd3e386f-316c-4a18-8e5b-78a40c62f3aa is in RUNNING state, waiting...&#xA;Get a pipeline run with id=cd3e386f-316c-4a18-8e5b-78a40c62f3aa&#xA;Pipeline run with id=cd3e386f-316c-4a18-8e5b-78a40c62f3aa is in RUNNING state, waiting...&#xA;Get a pipeline run with id=cd3e386f-316c-4a18-8e5b-78a40c62f3aa&#xA;Pipeline run with id=cd3e386f-316c-4a18-8e5b-78a40c62f3aa is in RUNNING state, waiting...&#xA;Get a pipeline run with id=cd3e386f-316c-4a18-8e5b-78a40c62f3aa&#xA;Pipeline run with id=cd3e386f-316c-4a18-8e5b-78a40c62f3aa is in RUNNING state, waiting...&#xA;Get a pipeline run with id=cd3e386f-316c-4a18-8e5b-78a40c62f3aa&#xA;Pipeline run with id=cd3e386f-316c-4a18-8e5b-78a40c62f3aa is in RUNNING state, waiting...&#xA;Get a pipeline run with id=cd3e386f-316c-4a18-8e5b-78a40c62f3aa&#xA;Pipeline run with id=cd3e386f-316c-4a18-8e5b-78a40c62f3aa is in RUNNING state, waiting...&#xA;Get a pipeline run with id=cd3e386f-316c-4a18-8e5b-78a40c62f3aa&#xA;Pipeline run with id=cd3e386f-316c-4a18-8e5b-78a40c62f3aa is in RUNNING state, waiting...&#xA;Get a pipeline run with id=cd3e386f-316c-4a18-8e5b-78a40c62f3aa&#xA;Pipeline run with id=cd3e386f-316c-4a18-8e5b-78a40c62f3aa is in RUNNING state, waiting...&#xA;Get a pipeline run with id=cd3e386f-316c-4a18-8e5b-78a40c62f3aa&#xA;Pipeline run with id=cd3e386f-316c-4a18-8e5b-78a40c62f3aa is in RUNNING state, waiting...&#xA;Get a pipeline run with id=cd3e386f-316c-4a18-8e5b-78a40c62f3aa&#xA;Pipeline run with id=cd3e386f-316c-4a18-8e5b-78a40c62f3aa is in RUNNING state, waiting...&#xA;Get a pipeline run with id=cd3e386f-316c-4a18-8e5b-78a40c62f3aa&#xA;Pipeline run with id=cd3e386f-316c-4a18-8e5b-78a40c62f3aa is in RUNNING state, waiting...&#xA;Get a pipeline run with id=cd3e386f-316c-4a18-8e5b-78a40c62f3aa&#xA;Pipeline run with id=cd3e386f-316c-4a18-8e5b-78a40c62f3aa is in RUNNING state, waiting...&#xA;Get a pipeline run with id=cd3e386f-316c-4a18-8e5b-78a40c62f3aa&#xA;Pipeline run with id=cd3e386f-316c-4a18-8e5b-78a40c62f3aa is in RUNNING state, waiting...&#xA;Get a pipeline run with id=cd3e386f-316c-4a18-8e5b-78a40c62f3aa&#xA;Pipeline run with id=cd3e386f-316c-4a18-8e5b-78a40c62f3aa is in RUNNING state, waiting...&#xA;Get a pipeline run with id=cd3e386f-316c-4a18-8e5b-78a40c62f3aa&#xA;Pipeline run with id=cd3e386f-316c-4a18-8e5b-78a40c62f3aa is in RUNNING state, waiting...&#xA;Get a pipeline run with id=cd3e386f-316c-4a18-8e5b-78a40c62f3aa&#xA;Pipeline run with id=cd3e386f-316c-4a18-8e5b-78a40c62f3aa is in RUNNING state, waiting...&#xA;Get a pipeline run with id=cd3e386f-316c-4a18-8e5b-78a40c62f3aa&#xA;Pipeline run with id=cd3e386f-316c-4a18-8e5b-78a40c62f3aa is in RUNNING state, waiting...&#xA;Get a pipeline run with id=cd3e386f-316c-4a18-8e5b-78a40c62f3aa&#xA;Pipeline run with id=cd3e386f-316c-4a18-8e5b-78a40c62f3aa reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/parallel_for_after_dependency.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=cd3e386f-316c-4a18-8e5b-78a40c62f3aa&#xA;Get a pipeline run with id=cd3e386f-316c-4a18-8e5b-78a40c62f3aa&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/01/26 19:21:40.772 (2m0.536s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/01/26 19:21:40.772&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run cd3e386f-316c-4a18-8e5b-78a40c62f3aa&#xA;Failed to terminate run cd3e386f-316c-4a18-8e5b-78a40c62f3aa&#xA;Terminate run cd3e386f-316c-4a18-8e5b-78a40c62f3aa&#xA;Deleting run cd3e386f-316c-4a18-8e5b-78a40c62f3aa&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=22b278e5-ea52-49f4-b51c-3e3d30fdfdce (cascade=true)&#xA;Pipeline with id=22b278e5-ea52-49f4-b51c-3e3d30fdfdce, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/01/26 19:21:41.034 (262ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/01/26 19:21:41.035&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/01/26 19:21:41.035 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/01/26 19:21:41.035&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/01/26 19:21:41.035 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload essential/iris_pipeline_compiled.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="166.324502565">
              <system-out>2026/07/01 19:22:26 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/01/26 19:19:39.801&#xA;Create an experiment with name E2EExperiment-1782933579801338113&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/01/26 19:19:40.133 (332ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/01/26 19:19:40.133&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x221b0aaa2880&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/01/26 19:19:40.437 (304ms)&#xA;&gt; Enter [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/01/26 19:19:40.437&#xA;Uploading pipeline file essential/iris_pipeline_compiled.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1782933580133603663, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml&#xA;Upload of pipeline file &#39;essential/iris_pipeline_compiled.yaml&#39; successful&#xA;Listing pipeline versions for pipeline f4d17ac1-c640-400b-85c5-d2d70578ccad&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;f4d17ac1-c640-400b-85c5-d2d70578ccad&#39; and name: &#39;e2e-test-1782933580133603663&#39;&#xA;Create a pipeline run for pipeline with id=f4d17ac1-c640-400b-85c5-d2d70578ccad and versionId=0233f33e-4ff8-4ffa-863a-2792e715ca80&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=10de72d7-2bdf-4985-9b19-fe8e18f7d73d&#xA;Created Pipeline Run with id: 10de72d7-2bdf-4985-9b19-fe8e18f7d73d for pipeline with id: f4d17ac1-c640-400b-85c5-d2d70578ccad&#xA;Waiting for pipeline run with id=10de72d7-2bdf-4985-9b19-fe8e18f7d73d to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=10de72d7-2bdf-4985-9b19-fe8e18f7d73d&#xA;Pipeline run with id=10de72d7-2bdf-4985-9b19-fe8e18f7d73d is in PENDING state, waiting...&#xA;Get a pipeline run with id=10de72d7-2bdf-4985-9b19-fe8e18f7d73d&#xA;Pipeline run with id=10de72d7-2bdf-4985-9b19-fe8e18f7d73d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=10de72d7-2bdf-4985-9b19-fe8e18f7d73d&#xA;Pipeline run with id=10de72d7-2bdf-4985-9b19-fe8e18f7d73d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=10de72d7-2bdf-4985-9b19-fe8e18f7d73d&#xA;Pipeline run with id=10de72d7-2bdf-4985-9b19-fe8e18f7d73d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=10de72d7-2bdf-4985-9b19-fe8e18f7d73d&#xA;Pipeline run with id=10de72d7-2bdf-4985-9b19-fe8e18f7d73d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=10de72d7-2bdf-4985-9b19-fe8e18f7d73d&#xA;Pipeline run with id=10de72d7-2bdf-4985-9b19-fe8e18f7d73d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=10de72d7-2bdf-4985-9b19-fe8e18f7d73d&#xA;Pipeline run with id=10de72d7-2bdf-4985-9b19-fe8e18f7d73d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=10de72d7-2bdf-4985-9b19-fe8e18f7d73d&#xA;Pipeline run with id=10de72d7-2bdf-4985-9b19-fe8e18f7d73d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=10de72d7-2bdf-4985-9b19-fe8e18f7d73d&#xA;Pipeline run with id=10de72d7-2bdf-4985-9b19-fe8e18f7d73d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=10de72d7-2bdf-4985-9b19-fe8e18f7d73d&#xA;Pipeline run with id=10de72d7-2bdf-4985-9b19-fe8e18f7d73d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=10de72d7-2bdf-4985-9b19-fe8e18f7d73d&#xA;Pipeline run with id=10de72d7-2bdf-4985-9b19-fe8e18f7d73d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=10de72d7-2bdf-4985-9b19-fe8e18f7d73d&#xA;Pipeline run with id=10de72d7-2bdf-4985-9b19-fe8e18f7d73d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=10de72d7-2bdf-4985-9b19-fe8e18f7d73d&#xA;Pipeline run with id=10de72d7-2bdf-4985-9b19-fe8e18f7d73d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=10de72d7-2bdf-4985-9b19-fe8e18f7d73d&#xA;Pipeline run with id=10de72d7-2bdf-4985-9b19-fe8e18f7d73d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=10de72d7-2bdf-4985-9b19-fe8e18f7d73d&#xA;Pipeline run with id=10de72d7-2bdf-4985-9b19-fe8e18f7d73d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=10de72d7-2bdf-4985-9b19-fe8e18f7d73d&#xA;Pipeline run with id=10de72d7-2bdf-4985-9b19-fe8e18f7d73d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=10de72d7-2bdf-4985-9b19-fe8e18f7d73d&#xA;Pipeline run with id=10de72d7-2bdf-4985-9b19-fe8e18f7d73d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=10de72d7-2bdf-4985-9b19-fe8e18f7d73d&#xA;Pipeline run with id=10de72d7-2bdf-4985-9b19-fe8e18f7d73d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=10de72d7-2bdf-4985-9b19-fe8e18f7d73d&#xA;Pipeline run with id=10de72d7-2bdf-4985-9b19-fe8e18f7d73d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=10de72d7-2bdf-4985-9b19-fe8e18f7d73d&#xA;Pipeline run with id=10de72d7-2bdf-4985-9b19-fe8e18f7d73d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=10de72d7-2bdf-4985-9b19-fe8e18f7d73d&#xA;Pipeline run with id=10de72d7-2bdf-4985-9b19-fe8e18f7d73d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=10de72d7-2bdf-4985-9b19-fe8e18f7d73d&#xA;Pipeline run with id=10de72d7-2bdf-4985-9b19-fe8e18f7d73d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=10de72d7-2bdf-4985-9b19-fe8e18f7d73d&#xA;Pipeline run with id=10de72d7-2bdf-4985-9b19-fe8e18f7d73d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=10de72d7-2bdf-4985-9b19-fe8e18f7d73d&#xA;Pipeline run with id=10de72d7-2bdf-4985-9b19-fe8e18f7d73d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=10de72d7-2bdf-4985-9b19-fe8e18f7d73d&#xA;Pipeline run with id=10de72d7-2bdf-4985-9b19-fe8e18f7d73d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=10de72d7-2bdf-4985-9b19-fe8e18f7d73d&#xA;Pipeline run with id=10de72d7-2bdf-4985-9b19-fe8e18f7d73d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=10de72d7-2bdf-4985-9b19-fe8e18f7d73d&#xA;Pipeline run with id=10de72d7-2bdf-4985-9b19-fe8e18f7d73d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=10de72d7-2bdf-4985-9b19-fe8e18f7d73d&#xA;Pipeline run with id=10de72d7-2bdf-4985-9b19-fe8e18f7d73d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=10de72d7-2bdf-4985-9b19-fe8e18f7d73d&#xA;Pipeline run with id=10de72d7-2bdf-4985-9b19-fe8e18f7d73d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=10de72d7-2bdf-4985-9b19-fe8e18f7d73d&#xA;Pipeline run with id=10de72d7-2bdf-4985-9b19-fe8e18f7d73d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=10de72d7-2bdf-4985-9b19-fe8e18f7d73d&#xA;Pipeline run with id=10de72d7-2bdf-4985-9b19-fe8e18f7d73d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=10de72d7-2bdf-4985-9b19-fe8e18f7d73d&#xA;Pipeline run with id=10de72d7-2bdf-4985-9b19-fe8e18f7d73d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=10de72d7-2bdf-4985-9b19-fe8e18f7d73d&#xA;Pipeline run with id=10de72d7-2bdf-4985-9b19-fe8e18f7d73d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=10de72d7-2bdf-4985-9b19-fe8e18f7d73d&#xA;Pipeline run with id=10de72d7-2bdf-4985-9b19-fe8e18f7d73d reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;essential/iris_pipeline_compiled.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=10de72d7-2bdf-4985-9b19-fe8e18f7d73d&#xA;Get a pipeline run with id=10de72d7-2bdf-4985-9b19-fe8e18f7d73d&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/01/26 19:22:25.907 (2m45.47s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/01/26 19:22:25.907&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 10de72d7-2bdf-4985-9b19-fe8e18f7d73d&#xA;Failed to terminate run 10de72d7-2bdf-4985-9b19-fe8e18f7d73d&#xA;Terminate run 10de72d7-2bdf-4985-9b19-fe8e18f7d73d&#xA;Deleting run 10de72d7-2bdf-4985-9b19-fe8e18f7d73d&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=f4d17ac1-c640-400b-85c5-d2d70578ccad (cascade=true)&#xA;Pipeline with id=f4d17ac1-c640-400b-85c5-d2d70578ccad, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/01/26 19:22:26.125 (218ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/01/26 19:22:26.126&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/01/26 19:22:26.126 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/01/26 19:22:26.126&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/01/26 19:22:26.126 (0s)&#xA;</system-err>
          </testcase>
      </testsuite>
  </testsuites>