<?xml version="1.0" encoding="UTF-8"?>
  <testsuites tests="5" disabled="0" errors="0" failures="0" time="161.476676173">
      <testsuite name="AIPipelinesE2ETests" package="/dspa/backend/test/end2end" tests="5" disabled="0" skipped="0" errors="0" failures="0" time="161.476676173" timestamp="2026-07-16T13:20:08">
          <properties>
              <property name="SuiteSucceeded" value="true"></property>
              <property name="SuiteHasProgrammaticFocus" value="false"></property>
              <property name="SpecialSuiteFailureReason" value=""></property>
              <property name="SuiteLabels" value="[]"></property>
              <property name="SuiteSemVerConstraints" value="[]"></property>
              <property name="RandomSeed" value="1784207834"></property>
              <property name="RandomizeAllSpecs" value="false"></property>
              <property name="LabelFilter" value="Smoke"></property>
              <property name="SemVerFilter" value=""></property>
              <property name="FocusStrings" value=""></property>
              <property name="SkipStrings" value=""></property>
              <property name="FocusFiles" value=""></property>
              <property name="SkipFiles" value=""></property>
              <property name="FailOnPending" value="false"></property>
              <property name="FailOnEmpty" value="false"></property>
              <property name="FailFast" value="false"></property>
              <property name="FlakeAttempts" value="0"></property>
              <property name="DryRun" value="false"></property>
              <property name="ParallelTotal" value="10"></property>
              <property name="OutputInterceptorMode" value=""></property>
          </properties>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/pipeline_with_artifact_upload_download.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="101.226314769">
              <system-out>2026/07/16 13:21:49 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/16/26 13:20:08.408&#xA;Create an experiment with name E2EExperiment-1784208008408994024&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/16/26 13:20:08.54 (131ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/16/26 13:20:08.54&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x309796d4e380&#xA;test-secret-1 created&#xA;test-secret-2 created&#xA;test-secret-3 created&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/16/26 13:20:08.622 (83ms)&#xA;&gt; Enter [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/16/26 13:20:08.623&#xA;Uploading pipeline file critical/pipeline_with_artifact_upload_download.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1784208008540339968, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml&#xA;Upload of pipeline file &#39;critical/pipeline_with_artifact_upload_download.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 261c4045-f90a-402c-b468-f2da384bd55a&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;261c4045-f90a-402c-b468-f2da384bd55a&#39; and name: &#39;e2e-test-1784208008540339968&#39;&#xA;Create a pipeline run for pipeline with id=261c4045-f90a-402c-b468-f2da384bd55a and versionId=84ecdc8a-5a18-4cde-86ac-39d70cc5323e&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=47469886-9b79-48d9-8241-4055457bc149&#xA;Created Pipeline Run with id: 47469886-9b79-48d9-8241-4055457bc149 for pipeline with id: 261c4045-f90a-402c-b468-f2da384bd55a&#xA;Waiting for pipeline run with id=47469886-9b79-48d9-8241-4055457bc149 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=47469886-9b79-48d9-8241-4055457bc149&#xA;Pipeline run with id=47469886-9b79-48d9-8241-4055457bc149 is in PENDING state, waiting...&#xA;Get a pipeline run with id=47469886-9b79-48d9-8241-4055457bc149&#xA;Pipeline run with id=47469886-9b79-48d9-8241-4055457bc149 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=47469886-9b79-48d9-8241-4055457bc149&#xA;Pipeline run with id=47469886-9b79-48d9-8241-4055457bc149 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=47469886-9b79-48d9-8241-4055457bc149&#xA;Pipeline run with id=47469886-9b79-48d9-8241-4055457bc149 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=47469886-9b79-48d9-8241-4055457bc149&#xA;Pipeline run with id=47469886-9b79-48d9-8241-4055457bc149 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=47469886-9b79-48d9-8241-4055457bc149&#xA;Pipeline run with id=47469886-9b79-48d9-8241-4055457bc149 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=47469886-9b79-48d9-8241-4055457bc149&#xA;Pipeline run with id=47469886-9b79-48d9-8241-4055457bc149 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=47469886-9b79-48d9-8241-4055457bc149&#xA;Pipeline run with id=47469886-9b79-48d9-8241-4055457bc149 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=47469886-9b79-48d9-8241-4055457bc149&#xA;Pipeline run with id=47469886-9b79-48d9-8241-4055457bc149 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=47469886-9b79-48d9-8241-4055457bc149&#xA;Pipeline run with id=47469886-9b79-48d9-8241-4055457bc149 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=47469886-9b79-48d9-8241-4055457bc149&#xA;Pipeline run with id=47469886-9b79-48d9-8241-4055457bc149 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=47469886-9b79-48d9-8241-4055457bc149&#xA;Pipeline run with id=47469886-9b79-48d9-8241-4055457bc149 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=47469886-9b79-48d9-8241-4055457bc149&#xA;Pipeline run with id=47469886-9b79-48d9-8241-4055457bc149 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=47469886-9b79-48d9-8241-4055457bc149&#xA;Pipeline run with id=47469886-9b79-48d9-8241-4055457bc149 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=47469886-9b79-48d9-8241-4055457bc149&#xA;Pipeline run with id=47469886-9b79-48d9-8241-4055457bc149 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=47469886-9b79-48d9-8241-4055457bc149&#xA;Pipeline run with id=47469886-9b79-48d9-8241-4055457bc149 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=47469886-9b79-48d9-8241-4055457bc149&#xA;Pipeline run with id=47469886-9b79-48d9-8241-4055457bc149 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=47469886-9b79-48d9-8241-4055457bc149&#xA;Pipeline run with id=47469886-9b79-48d9-8241-4055457bc149 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=47469886-9b79-48d9-8241-4055457bc149&#xA;Pipeline run with id=47469886-9b79-48d9-8241-4055457bc149 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=47469886-9b79-48d9-8241-4055457bc149&#xA;Pipeline run with id=47469886-9b79-48d9-8241-4055457bc149 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=47469886-9b79-48d9-8241-4055457bc149&#xA;Pipeline run with id=47469886-9b79-48d9-8241-4055457bc149 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/pipeline_with_artifact_upload_download.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=47469886-9b79-48d9-8241-4055457bc149&#xA;Get a pipeline run with id=47469886-9b79-48d9-8241-4055457bc149&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/16/26 13:21:49.356 (1m40.733s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/16/26 13:21:49.356&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 47469886-9b79-48d9-8241-4055457bc149&#xA;Failed to terminate run 47469886-9b79-48d9-8241-4055457bc149&#xA;Terminate run 47469886-9b79-48d9-8241-4055457bc149&#xA;Deleting run 47469886-9b79-48d9-8241-4055457bc149&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=261c4045-f90a-402c-b468-f2da384bd55a (cascade=true)&#xA;Pipeline with id=261c4045-f90a-402c-b468-f2da384bd55a, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/16/26 13:21:49.635 (278ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/16/26 13:21:49.635&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/16/26 13:21:49.635 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/16/26 13:21:49.635&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/16/26 13:21:49.635 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload essential/component_with_pip_index_urls.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="51.068479228">
              <system-out>2026/07/16 13:20:59 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/16/26 13:20:08.452&#xA;Create an experiment with name E2EExperiment-1784208008452977913&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/16/26 13:20:08.633 (181ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/16/26 13:20:08.633&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x7cf57a08180&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/16/26 13:20:08.746 (113ms)&#xA;&gt; Enter [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/16/26 13:20:08.746&#xA;Uploading pipeline file essential/component_with_pip_index_urls.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1784208008633872512, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml&#xA;Upload of pipeline file &#39;essential/component_with_pip_index_urls.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 56f4045d-758d-4c34-b5d6-b21c485e7cdb&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;56f4045d-758d-4c34-b5d6-b21c485e7cdb&#39; and name: &#39;e2e-test-1784208008633872512&#39;&#xA;Create a pipeline run for pipeline with id=56f4045d-758d-4c34-b5d6-b21c485e7cdb and versionId=ce4fb374-be68-4097-a24d-462b74a4a076&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=1af7c64a-ff44-4ab9-a7bc-383b66aae5a2&#xA;Created Pipeline Run with id: 1af7c64a-ff44-4ab9-a7bc-383b66aae5a2 for pipeline with id: 56f4045d-758d-4c34-b5d6-b21c485e7cdb&#xA;Waiting for pipeline run with id=1af7c64a-ff44-4ab9-a7bc-383b66aae5a2 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=1af7c64a-ff44-4ab9-a7bc-383b66aae5a2&#xA;Pipeline run with id=1af7c64a-ff44-4ab9-a7bc-383b66aae5a2 is in PENDING state, waiting...&#xA;Get a pipeline run with id=1af7c64a-ff44-4ab9-a7bc-383b66aae5a2&#xA;Pipeline run with id=1af7c64a-ff44-4ab9-a7bc-383b66aae5a2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1af7c64a-ff44-4ab9-a7bc-383b66aae5a2&#xA;Pipeline run with id=1af7c64a-ff44-4ab9-a7bc-383b66aae5a2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1af7c64a-ff44-4ab9-a7bc-383b66aae5a2&#xA;Pipeline run with id=1af7c64a-ff44-4ab9-a7bc-383b66aae5a2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1af7c64a-ff44-4ab9-a7bc-383b66aae5a2&#xA;Pipeline run with id=1af7c64a-ff44-4ab9-a7bc-383b66aae5a2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1af7c64a-ff44-4ab9-a7bc-383b66aae5a2&#xA;Pipeline run with id=1af7c64a-ff44-4ab9-a7bc-383b66aae5a2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1af7c64a-ff44-4ab9-a7bc-383b66aae5a2&#xA;Pipeline run with id=1af7c64a-ff44-4ab9-a7bc-383b66aae5a2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1af7c64a-ff44-4ab9-a7bc-383b66aae5a2&#xA;Pipeline run with id=1af7c64a-ff44-4ab9-a7bc-383b66aae5a2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1af7c64a-ff44-4ab9-a7bc-383b66aae5a2&#xA;Pipeline run with id=1af7c64a-ff44-4ab9-a7bc-383b66aae5a2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1af7c64a-ff44-4ab9-a7bc-383b66aae5a2&#xA;Pipeline run with id=1af7c64a-ff44-4ab9-a7bc-383b66aae5a2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1af7c64a-ff44-4ab9-a7bc-383b66aae5a2&#xA;Pipeline run with id=1af7c64a-ff44-4ab9-a7bc-383b66aae5a2 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;essential/component_with_pip_index_urls.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=1af7c64a-ff44-4ab9-a7bc-383b66aae5a2&#xA;Get a pipeline run with id=1af7c64a-ff44-4ab9-a7bc-383b66aae5a2&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/16/26 13:20:59.363 (50.617s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/16/26 13:20:59.364&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 1af7c64a-ff44-4ab9-a7bc-383b66aae5a2&#xA;Failed to terminate run 1af7c64a-ff44-4ab9-a7bc-383b66aae5a2&#xA;Terminate run 1af7c64a-ff44-4ab9-a7bc-383b66aae5a2&#xA;Deleting run 1af7c64a-ff44-4ab9-a7bc-383b66aae5a2&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=56f4045d-758d-4c34-b5d6-b21c485e7cdb (cascade=true)&#xA;Pipeline with id=56f4045d-758d-4c34-b5d6-b21c485e7cdb, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/16/26 13:20:59.521 (157ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/16/26 13:20:59.521&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/16/26 13:20:59.521 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/16/26 13:20:59.522&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/16/26 13:20:59.522 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/parallel_for_after_dependency.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="96.332949087">
              <system-out>2026/07/16 13:21:44 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/16/26 13:20:08.408&#xA;Create an experiment with name E2EExperiment-1784208008408708158&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/16/26 13:20:08.623 (215ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/16/26 13:20:08.623&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x160fe63c900&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/16/26 13:20:08.758 (135ms)&#xA;&gt; Enter [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/16/26 13:20:08.759&#xA;Uploading pipeline file critical/parallel_for_after_dependency.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1784208008624005614, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml&#xA;Upload of pipeline file &#39;critical/parallel_for_after_dependency.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 1f7a18fc-54e5-4c58-a3b3-1e4ff06d462b&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;1f7a18fc-54e5-4c58-a3b3-1e4ff06d462b&#39; and name: &#39;e2e-test-1784208008624005614&#39;&#xA;Create a pipeline run for pipeline with id=1f7a18fc-54e5-4c58-a3b3-1e4ff06d462b and versionId=8ef35e76-b957-48fe-a8b0-ced1d752e470&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=8d1394b9-f8a9-444f-b789-891f0218f8e8&#xA;Created Pipeline Run with id: 8d1394b9-f8a9-444f-b789-891f0218f8e8 for pipeline with id: 1f7a18fc-54e5-4c58-a3b3-1e4ff06d462b&#xA;Waiting for pipeline run with id=8d1394b9-f8a9-444f-b789-891f0218f8e8 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=8d1394b9-f8a9-444f-b789-891f0218f8e8&#xA;Pipeline run with id=8d1394b9-f8a9-444f-b789-891f0218f8e8 is in PENDING state, waiting...&#xA;Get a pipeline run with id=8d1394b9-f8a9-444f-b789-891f0218f8e8&#xA;Pipeline run with id=8d1394b9-f8a9-444f-b789-891f0218f8e8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8d1394b9-f8a9-444f-b789-891f0218f8e8&#xA;Pipeline run with id=8d1394b9-f8a9-444f-b789-891f0218f8e8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8d1394b9-f8a9-444f-b789-891f0218f8e8&#xA;Pipeline run with id=8d1394b9-f8a9-444f-b789-891f0218f8e8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8d1394b9-f8a9-444f-b789-891f0218f8e8&#xA;Pipeline run with id=8d1394b9-f8a9-444f-b789-891f0218f8e8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8d1394b9-f8a9-444f-b789-891f0218f8e8&#xA;Pipeline run with id=8d1394b9-f8a9-444f-b789-891f0218f8e8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8d1394b9-f8a9-444f-b789-891f0218f8e8&#xA;Pipeline run with id=8d1394b9-f8a9-444f-b789-891f0218f8e8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8d1394b9-f8a9-444f-b789-891f0218f8e8&#xA;Pipeline run with id=8d1394b9-f8a9-444f-b789-891f0218f8e8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8d1394b9-f8a9-444f-b789-891f0218f8e8&#xA;Pipeline run with id=8d1394b9-f8a9-444f-b789-891f0218f8e8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8d1394b9-f8a9-444f-b789-891f0218f8e8&#xA;Pipeline run with id=8d1394b9-f8a9-444f-b789-891f0218f8e8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8d1394b9-f8a9-444f-b789-891f0218f8e8&#xA;Pipeline run with id=8d1394b9-f8a9-444f-b789-891f0218f8e8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8d1394b9-f8a9-444f-b789-891f0218f8e8&#xA;Pipeline run with id=8d1394b9-f8a9-444f-b789-891f0218f8e8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8d1394b9-f8a9-444f-b789-891f0218f8e8&#xA;Pipeline run with id=8d1394b9-f8a9-444f-b789-891f0218f8e8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8d1394b9-f8a9-444f-b789-891f0218f8e8&#xA;Pipeline run with id=8d1394b9-f8a9-444f-b789-891f0218f8e8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8d1394b9-f8a9-444f-b789-891f0218f8e8&#xA;Pipeline run with id=8d1394b9-f8a9-444f-b789-891f0218f8e8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8d1394b9-f8a9-444f-b789-891f0218f8e8&#xA;Pipeline run with id=8d1394b9-f8a9-444f-b789-891f0218f8e8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8d1394b9-f8a9-444f-b789-891f0218f8e8&#xA;Pipeline run with id=8d1394b9-f8a9-444f-b789-891f0218f8e8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8d1394b9-f8a9-444f-b789-891f0218f8e8&#xA;Pipeline run with id=8d1394b9-f8a9-444f-b789-891f0218f8e8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8d1394b9-f8a9-444f-b789-891f0218f8e8&#xA;Pipeline run with id=8d1394b9-f8a9-444f-b789-891f0218f8e8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8d1394b9-f8a9-444f-b789-891f0218f8e8&#xA;Pipeline run with id=8d1394b9-f8a9-444f-b789-891f0218f8e8 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/parallel_for_after_dependency.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=8d1394b9-f8a9-444f-b789-891f0218f8e8&#xA;Get a pipeline run with id=8d1394b9-f8a9-444f-b789-891f0218f8e8&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/16/26 13:21:44.437 (1m35.678s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/16/26 13:21:44.437&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 8d1394b9-f8a9-444f-b789-891f0218f8e8&#xA;Failed to terminate run 8d1394b9-f8a9-444f-b789-891f0218f8e8&#xA;Terminate run 8d1394b9-f8a9-444f-b789-891f0218f8e8&#xA;Deleting run 8d1394b9-f8a9-444f-b789-891f0218f8e8&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=1f7a18fc-54e5-4c58-a3b3-1e4ff06d462b (cascade=true)&#xA;Pipeline with id=1f7a18fc-54e5-4c58-a3b3-1e4ff06d462b, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/16/26 13:21:44.741 (304ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/16/26 13:21:44.741&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/16/26 13:21:44.741 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/16/26 13:21:44.742&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/16/26 13:21:44.742 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/flip_coin.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="131.192770772">
              <system-out>2026/07/16 13:22:19 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/16/26 13:20:08.408&#xA;Create an experiment with name E2EExperiment-1784208008408462663&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/16/26 13:20:08.54 (133ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/16/26 13:20:08.541&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x311db3ec2900&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/16/26 13:20:08.685 (144ms)&#xA;&gt; Enter [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/16/26 13:20:08.685&#xA;Uploading pipeline file critical/flip_coin.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1784208008541159475, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml&#xA;Upload of pipeline file &#39;critical/flip_coin.yaml&#39; successful&#xA;Listing pipeline versions for pipeline e494fdea-eeb1-4f2f-8aea-d511cc1f4874&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;e494fdea-eeb1-4f2f-8aea-d511cc1f4874&#39; and name: &#39;e2e-test-1784208008541159475&#39;&#xA;Create a pipeline run for pipeline with id=e494fdea-eeb1-4f2f-8aea-d511cc1f4874 and versionId=724ced69-eb93-43b1-ae0f-6f44104e0db4&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=3efd290c-7799-4c8c-b69d-7b19ad5405fd&#xA;Created Pipeline Run with id: 3efd290c-7799-4c8c-b69d-7b19ad5405fd for pipeline with id: e494fdea-eeb1-4f2f-8aea-d511cc1f4874&#xA;Waiting for pipeline run with id=3efd290c-7799-4c8c-b69d-7b19ad5405fd to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=3efd290c-7799-4c8c-b69d-7b19ad5405fd&#xA;Pipeline run with id=3efd290c-7799-4c8c-b69d-7b19ad5405fd is in PENDING state, waiting...&#xA;Get a pipeline run with id=3efd290c-7799-4c8c-b69d-7b19ad5405fd&#xA;Pipeline run with id=3efd290c-7799-4c8c-b69d-7b19ad5405fd is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3efd290c-7799-4c8c-b69d-7b19ad5405fd&#xA;Pipeline run with id=3efd290c-7799-4c8c-b69d-7b19ad5405fd is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3efd290c-7799-4c8c-b69d-7b19ad5405fd&#xA;Pipeline run with id=3efd290c-7799-4c8c-b69d-7b19ad5405fd is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3efd290c-7799-4c8c-b69d-7b19ad5405fd&#xA;Pipeline run with id=3efd290c-7799-4c8c-b69d-7b19ad5405fd is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3efd290c-7799-4c8c-b69d-7b19ad5405fd&#xA;Pipeline run with id=3efd290c-7799-4c8c-b69d-7b19ad5405fd is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3efd290c-7799-4c8c-b69d-7b19ad5405fd&#xA;Pipeline run with id=3efd290c-7799-4c8c-b69d-7b19ad5405fd is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3efd290c-7799-4c8c-b69d-7b19ad5405fd&#xA;Pipeline run with id=3efd290c-7799-4c8c-b69d-7b19ad5405fd is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3efd290c-7799-4c8c-b69d-7b19ad5405fd&#xA;Pipeline run with id=3efd290c-7799-4c8c-b69d-7b19ad5405fd is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3efd290c-7799-4c8c-b69d-7b19ad5405fd&#xA;Pipeline run with id=3efd290c-7799-4c8c-b69d-7b19ad5405fd is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3efd290c-7799-4c8c-b69d-7b19ad5405fd&#xA;Pipeline run with id=3efd290c-7799-4c8c-b69d-7b19ad5405fd is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3efd290c-7799-4c8c-b69d-7b19ad5405fd&#xA;Pipeline run with id=3efd290c-7799-4c8c-b69d-7b19ad5405fd is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3efd290c-7799-4c8c-b69d-7b19ad5405fd&#xA;Pipeline run with id=3efd290c-7799-4c8c-b69d-7b19ad5405fd is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3efd290c-7799-4c8c-b69d-7b19ad5405fd&#xA;Pipeline run with id=3efd290c-7799-4c8c-b69d-7b19ad5405fd is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3efd290c-7799-4c8c-b69d-7b19ad5405fd&#xA;Pipeline run with id=3efd290c-7799-4c8c-b69d-7b19ad5405fd is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3efd290c-7799-4c8c-b69d-7b19ad5405fd&#xA;Pipeline run with id=3efd290c-7799-4c8c-b69d-7b19ad5405fd is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3efd290c-7799-4c8c-b69d-7b19ad5405fd&#xA;Pipeline run with id=3efd290c-7799-4c8c-b69d-7b19ad5405fd is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3efd290c-7799-4c8c-b69d-7b19ad5405fd&#xA;Pipeline run with id=3efd290c-7799-4c8c-b69d-7b19ad5405fd is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3efd290c-7799-4c8c-b69d-7b19ad5405fd&#xA;Pipeline run with id=3efd290c-7799-4c8c-b69d-7b19ad5405fd is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3efd290c-7799-4c8c-b69d-7b19ad5405fd&#xA;Pipeline run with id=3efd290c-7799-4c8c-b69d-7b19ad5405fd is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3efd290c-7799-4c8c-b69d-7b19ad5405fd&#xA;Pipeline run with id=3efd290c-7799-4c8c-b69d-7b19ad5405fd is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3efd290c-7799-4c8c-b69d-7b19ad5405fd&#xA;Pipeline run with id=3efd290c-7799-4c8c-b69d-7b19ad5405fd is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3efd290c-7799-4c8c-b69d-7b19ad5405fd&#xA;Pipeline run with id=3efd290c-7799-4c8c-b69d-7b19ad5405fd is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3efd290c-7799-4c8c-b69d-7b19ad5405fd&#xA;Pipeline run with id=3efd290c-7799-4c8c-b69d-7b19ad5405fd is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3efd290c-7799-4c8c-b69d-7b19ad5405fd&#xA;Pipeline run with id=3efd290c-7799-4c8c-b69d-7b19ad5405fd is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3efd290c-7799-4c8c-b69d-7b19ad5405fd&#xA;Pipeline run with id=3efd290c-7799-4c8c-b69d-7b19ad5405fd is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3efd290c-7799-4c8c-b69d-7b19ad5405fd&#xA;Pipeline run with id=3efd290c-7799-4c8c-b69d-7b19ad5405fd reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/flip_coin.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=3efd290c-7799-4c8c-b69d-7b19ad5405fd&#xA;Get a pipeline run with id=3efd290c-7799-4c8c-b69d-7b19ad5405fd&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/16/26 13:22:19.444 (2m10.758s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/16/26 13:22:19.444&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 3efd290c-7799-4c8c-b69d-7b19ad5405fd&#xA;Failed to terminate run 3efd290c-7799-4c8c-b69d-7b19ad5405fd&#xA;Terminate run 3efd290c-7799-4c8c-b69d-7b19ad5405fd&#xA;Deleting run 3efd290c-7799-4c8c-b69d-7b19ad5405fd&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=e494fdea-eeb1-4f2f-8aea-d511cc1f4874 (cascade=true)&#xA;Pipeline with id=e494fdea-eeb1-4f2f-8aea-d511cc1f4874, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/16/26 13:22:19.601 (157ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/16/26 13:22:19.601&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/16/26 13:22:19.601 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/16/26 13:22:19.601&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/16/26 13:22:19.601 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload essential/iris_pipeline_compiled.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="161.163147474">
              <system-out>2026/07/16 13:22:49 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/16/26 13:20:08.53&#xA;Create an experiment with name E2EExperiment-1784208008530747095&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/16/26 13:20:08.594 (64ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/16/26 13:20:08.595&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x343da908a080&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/16/26 13:20:08.716 (122ms)&#xA;&gt; Enter [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/16/26 13:20:08.717&#xA;Uploading pipeline file essential/iris_pipeline_compiled.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1784208008595200226, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml&#xA;Upload of pipeline file &#39;essential/iris_pipeline_compiled.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 0b904c2b-078a-4955-a107-96a228a4663a&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;0b904c2b-078a-4955-a107-96a228a4663a&#39; and name: &#39;e2e-test-1784208008595200226&#39;&#xA;Create a pipeline run for pipeline with id=0b904c2b-078a-4955-a107-96a228a4663a and versionId=aa2ee2f9-6ba8-435c-abbe-eb57ad947c8a&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=35a1ef19-e2e3-418e-9687-1e0d585d679b&#xA;Created Pipeline Run with id: 35a1ef19-e2e3-418e-9687-1e0d585d679b for pipeline with id: 0b904c2b-078a-4955-a107-96a228a4663a&#xA;Waiting for pipeline run with id=35a1ef19-e2e3-418e-9687-1e0d585d679b to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=35a1ef19-e2e3-418e-9687-1e0d585d679b&#xA;Pipeline run with id=35a1ef19-e2e3-418e-9687-1e0d585d679b is in PENDING state, waiting...&#xA;Get a pipeline run with id=35a1ef19-e2e3-418e-9687-1e0d585d679b&#xA;Pipeline run with id=35a1ef19-e2e3-418e-9687-1e0d585d679b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=35a1ef19-e2e3-418e-9687-1e0d585d679b&#xA;Pipeline run with id=35a1ef19-e2e3-418e-9687-1e0d585d679b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=35a1ef19-e2e3-418e-9687-1e0d585d679b&#xA;Pipeline run with id=35a1ef19-e2e3-418e-9687-1e0d585d679b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=35a1ef19-e2e3-418e-9687-1e0d585d679b&#xA;Pipeline run with id=35a1ef19-e2e3-418e-9687-1e0d585d679b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=35a1ef19-e2e3-418e-9687-1e0d585d679b&#xA;Pipeline run with id=35a1ef19-e2e3-418e-9687-1e0d585d679b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=35a1ef19-e2e3-418e-9687-1e0d585d679b&#xA;Pipeline run with id=35a1ef19-e2e3-418e-9687-1e0d585d679b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=35a1ef19-e2e3-418e-9687-1e0d585d679b&#xA;Pipeline run with id=35a1ef19-e2e3-418e-9687-1e0d585d679b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=35a1ef19-e2e3-418e-9687-1e0d585d679b&#xA;Pipeline run with id=35a1ef19-e2e3-418e-9687-1e0d585d679b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=35a1ef19-e2e3-418e-9687-1e0d585d679b&#xA;Pipeline run with id=35a1ef19-e2e3-418e-9687-1e0d585d679b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=35a1ef19-e2e3-418e-9687-1e0d585d679b&#xA;Pipeline run with id=35a1ef19-e2e3-418e-9687-1e0d585d679b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=35a1ef19-e2e3-418e-9687-1e0d585d679b&#xA;Pipeline run with id=35a1ef19-e2e3-418e-9687-1e0d585d679b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=35a1ef19-e2e3-418e-9687-1e0d585d679b&#xA;Pipeline run with id=35a1ef19-e2e3-418e-9687-1e0d585d679b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=35a1ef19-e2e3-418e-9687-1e0d585d679b&#xA;Pipeline run with id=35a1ef19-e2e3-418e-9687-1e0d585d679b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=35a1ef19-e2e3-418e-9687-1e0d585d679b&#xA;Pipeline run with id=35a1ef19-e2e3-418e-9687-1e0d585d679b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=35a1ef19-e2e3-418e-9687-1e0d585d679b&#xA;Pipeline run with id=35a1ef19-e2e3-418e-9687-1e0d585d679b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=35a1ef19-e2e3-418e-9687-1e0d585d679b&#xA;Pipeline run with id=35a1ef19-e2e3-418e-9687-1e0d585d679b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=35a1ef19-e2e3-418e-9687-1e0d585d679b&#xA;Pipeline run with id=35a1ef19-e2e3-418e-9687-1e0d585d679b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=35a1ef19-e2e3-418e-9687-1e0d585d679b&#xA;Pipeline run with id=35a1ef19-e2e3-418e-9687-1e0d585d679b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=35a1ef19-e2e3-418e-9687-1e0d585d679b&#xA;Pipeline run with id=35a1ef19-e2e3-418e-9687-1e0d585d679b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=35a1ef19-e2e3-418e-9687-1e0d585d679b&#xA;Pipeline run with id=35a1ef19-e2e3-418e-9687-1e0d585d679b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=35a1ef19-e2e3-418e-9687-1e0d585d679b&#xA;Pipeline run with id=35a1ef19-e2e3-418e-9687-1e0d585d679b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=35a1ef19-e2e3-418e-9687-1e0d585d679b&#xA;Pipeline run with id=35a1ef19-e2e3-418e-9687-1e0d585d679b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=35a1ef19-e2e3-418e-9687-1e0d585d679b&#xA;Pipeline run with id=35a1ef19-e2e3-418e-9687-1e0d585d679b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=35a1ef19-e2e3-418e-9687-1e0d585d679b&#xA;Pipeline run with id=35a1ef19-e2e3-418e-9687-1e0d585d679b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=35a1ef19-e2e3-418e-9687-1e0d585d679b&#xA;Pipeline run with id=35a1ef19-e2e3-418e-9687-1e0d585d679b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=35a1ef19-e2e3-418e-9687-1e0d585d679b&#xA;Pipeline run with id=35a1ef19-e2e3-418e-9687-1e0d585d679b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=35a1ef19-e2e3-418e-9687-1e0d585d679b&#xA;Pipeline run with id=35a1ef19-e2e3-418e-9687-1e0d585d679b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=35a1ef19-e2e3-418e-9687-1e0d585d679b&#xA;Pipeline run with id=35a1ef19-e2e3-418e-9687-1e0d585d679b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=35a1ef19-e2e3-418e-9687-1e0d585d679b&#xA;Pipeline run with id=35a1ef19-e2e3-418e-9687-1e0d585d679b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=35a1ef19-e2e3-418e-9687-1e0d585d679b&#xA;Pipeline run with id=35a1ef19-e2e3-418e-9687-1e0d585d679b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=35a1ef19-e2e3-418e-9687-1e0d585d679b&#xA;Pipeline run with id=35a1ef19-e2e3-418e-9687-1e0d585d679b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=35a1ef19-e2e3-418e-9687-1e0d585d679b&#xA;Pipeline run with id=35a1ef19-e2e3-418e-9687-1e0d585d679b reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;essential/iris_pipeline_compiled.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=35a1ef19-e2e3-418e-9687-1e0d585d679b&#xA;Get a pipeline run with id=35a1ef19-e2e3-418e-9687-1e0d585d679b&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/16/26 13:22:49.44 (2m40.723s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/16/26 13:22:49.44&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 35a1ef19-e2e3-418e-9687-1e0d585d679b&#xA;Failed to terminate run 35a1ef19-e2e3-418e-9687-1e0d585d679b&#xA;Terminate run 35a1ef19-e2e3-418e-9687-1e0d585d679b&#xA;Deleting run 35a1ef19-e2e3-418e-9687-1e0d585d679b&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=0b904c2b-078a-4955-a107-96a228a4663a (cascade=true)&#xA;Pipeline with id=0b904c2b-078a-4955-a107-96a228a4663a, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/16/26 13:22:49.693 (253ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/16/26 13:22:49.694&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/16/26 13:22:49.694 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/16/26 13:22:49.694&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/16/26 13:22:49.694 (0s)&#xA;</system-err>
          </testcase>
      </testsuite>
  </testsuites>