<?xml version="1.0" encoding="UTF-8"?>
  <testsuites tests="5" disabled="0" errors="0" failures="0" time="156.154028506">
      <testsuite name="AIPipelinesE2ETests" package="/dspa/backend/test/end2end" tests="5" disabled="0" skipped="0" errors="0" failures="0" time="156.154028506" timestamp="2026-07-06T07:30:53">
          <properties>
              <property name="SuiteSucceeded" value="true"></property>
              <property name="SuiteHasProgrammaticFocus" value="false"></property>
              <property name="SpecialSuiteFailureReason" value=""></property>
              <property name="SuiteLabels" value="[]"></property>
              <property name="SuiteSemVerConstraints" value="[]"></property>
              <property name="RandomSeed" value="1783322895"></property>
              <property name="RandomizeAllSpecs" value="false"></property>
              <property name="LabelFilter" value="Smoke"></property>
              <property name="SemVerFilter" value=""></property>
              <property name="FocusStrings" value=""></property>
              <property name="SkipStrings" value=""></property>
              <property name="FocusFiles" value=""></property>
              <property name="SkipFiles" value=""></property>
              <property name="FailOnPending" value="false"></property>
              <property name="FailOnEmpty" value="false"></property>
              <property name="FailFast" value="false"></property>
              <property name="FlakeAttempts" value="0"></property>
              <property name="DryRun" value="false"></property>
              <property name="ParallelTotal" value="10"></property>
              <property name="OutputInterceptorMode" value=""></property>
          </properties>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload essential/component_with_pip_index_urls.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="46.173136847">
              <system-out>2026/07/06 07:31:39 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/06/26 07:30:53.724&#xA;Create an experiment with name E2EExperiment-1783323053724350135&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/06/26 07:30:53.933 (210ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/06/26 07:30:53.934&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x114112654c80&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/06/26 07:30:54.011 (77ms)&#xA;&gt; Enter [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/06/26 07:30:54.011&#xA;Uploading pipeline file essential/component_with_pip_index_urls.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1783323053934319657, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml&#xA;Upload of pipeline file &#39;essential/component_with_pip_index_urls.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 5a1c7dfb-f53d-41b8-8c88-2880035aa133&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;5a1c7dfb-f53d-41b8-8c88-2880035aa133&#39; and name: &#39;e2e-test-1783323053934319657&#39;&#xA;Create a pipeline run for pipeline with id=5a1c7dfb-f53d-41b8-8c88-2880035aa133 and versionId=479fda21-ecb1-431c-a714-ea66d6462cde&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=a78cd15d-a72b-4017-8514-c6f780d14864&#xA;Created Pipeline Run with id: a78cd15d-a72b-4017-8514-c6f780d14864 for pipeline with id: 5a1c7dfb-f53d-41b8-8c88-2880035aa133&#xA;Waiting for pipeline run with id=a78cd15d-a72b-4017-8514-c6f780d14864 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=a78cd15d-a72b-4017-8514-c6f780d14864&#xA;Pipeline run with id=a78cd15d-a72b-4017-8514-c6f780d14864 is in PENDING state, waiting...&#xA;Get a pipeline run with id=a78cd15d-a72b-4017-8514-c6f780d14864&#xA;Pipeline run with id=a78cd15d-a72b-4017-8514-c6f780d14864 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=a78cd15d-a72b-4017-8514-c6f780d14864&#xA;Pipeline run with id=a78cd15d-a72b-4017-8514-c6f780d14864 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=a78cd15d-a72b-4017-8514-c6f780d14864&#xA;Pipeline run with id=a78cd15d-a72b-4017-8514-c6f780d14864 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=a78cd15d-a72b-4017-8514-c6f780d14864&#xA;Pipeline run with id=a78cd15d-a72b-4017-8514-c6f780d14864 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=a78cd15d-a72b-4017-8514-c6f780d14864&#xA;Pipeline run with id=a78cd15d-a72b-4017-8514-c6f780d14864 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=a78cd15d-a72b-4017-8514-c6f780d14864&#xA;Pipeline run with id=a78cd15d-a72b-4017-8514-c6f780d14864 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=a78cd15d-a72b-4017-8514-c6f780d14864&#xA;Pipeline run with id=a78cd15d-a72b-4017-8514-c6f780d14864 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=a78cd15d-a72b-4017-8514-c6f780d14864&#xA;Pipeline run with id=a78cd15d-a72b-4017-8514-c6f780d14864 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=a78cd15d-a72b-4017-8514-c6f780d14864&#xA;Pipeline run with id=a78cd15d-a72b-4017-8514-c6f780d14864 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;essential/component_with_pip_index_urls.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=a78cd15d-a72b-4017-8514-c6f780d14864&#xA;Get a pipeline run with id=a78cd15d-a72b-4017-8514-c6f780d14864&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/06/26 07:31:39.636 (45.625s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/06/26 07:31:39.636&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run a78cd15d-a72b-4017-8514-c6f780d14864&#xA;Failed to terminate run a78cd15d-a72b-4017-8514-c6f780d14864&#xA;Terminate run a78cd15d-a72b-4017-8514-c6f780d14864&#xA;Deleting run a78cd15d-a72b-4017-8514-c6f780d14864&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=5a1c7dfb-f53d-41b8-8c88-2880035aa133 (cascade=true)&#xA;Pipeline with id=5a1c7dfb-f53d-41b8-8c88-2880035aa133, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/06/26 07:31:39.897 (261ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/06/26 07:31:39.897&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/06/26 07:31:39.898 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/06/26 07:31:39.898&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/06/26 07:31:39.898 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/pipeline_with_artifact_upload_download.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="96.168946732">
              <system-out>2026/07/06 07:32:29 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/06/26 07:30:53.724&#xA;Create an experiment with name E2EExperiment-1783323053724282743&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/06/26 07:30:53.933 (210ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/06/26 07:30:53.934&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x30725d2cc00&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/06/26 07:30:54.015 (81ms)&#xA;&gt; Enter [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/06/26 07:30:54.015&#xA;Uploading pipeline file critical/pipeline_with_artifact_upload_download.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1783323053934235355, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml&#xA;Upload of pipeline file &#39;critical/pipeline_with_artifact_upload_download.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 5ba3a6ea-9c02-4593-ba3d-7c6058620034&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;5ba3a6ea-9c02-4593-ba3d-7c6058620034&#39; and name: &#39;e2e-test-1783323053934235355&#39;&#xA;Create a pipeline run for pipeline with id=5ba3a6ea-9c02-4593-ba3d-7c6058620034 and versionId=8ee35c5d-adfd-46f6-978f-e4ed496ed655&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=28261a6c-5996-4712-ad56-4b123537b8ce&#xA;Created Pipeline Run with id: 28261a6c-5996-4712-ad56-4b123537b8ce for pipeline with id: 5ba3a6ea-9c02-4593-ba3d-7c6058620034&#xA;Waiting for pipeline run with id=28261a6c-5996-4712-ad56-4b123537b8ce to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=28261a6c-5996-4712-ad56-4b123537b8ce&#xA;Pipeline run with id=28261a6c-5996-4712-ad56-4b123537b8ce is in PENDING state, waiting...&#xA;Get a pipeline run with id=28261a6c-5996-4712-ad56-4b123537b8ce&#xA;Pipeline run with id=28261a6c-5996-4712-ad56-4b123537b8ce is in RUNNING state, waiting...&#xA;Get a pipeline run with id=28261a6c-5996-4712-ad56-4b123537b8ce&#xA;Pipeline run with id=28261a6c-5996-4712-ad56-4b123537b8ce is in RUNNING state, waiting...&#xA;Get a pipeline run with id=28261a6c-5996-4712-ad56-4b123537b8ce&#xA;Pipeline run with id=28261a6c-5996-4712-ad56-4b123537b8ce is in RUNNING state, waiting...&#xA;Get a pipeline run with id=28261a6c-5996-4712-ad56-4b123537b8ce&#xA;Pipeline run with id=28261a6c-5996-4712-ad56-4b123537b8ce is in RUNNING state, waiting...&#xA;Get a pipeline run with id=28261a6c-5996-4712-ad56-4b123537b8ce&#xA;Pipeline run with id=28261a6c-5996-4712-ad56-4b123537b8ce is in RUNNING state, waiting...&#xA;Get a pipeline run with id=28261a6c-5996-4712-ad56-4b123537b8ce&#xA;Pipeline run with id=28261a6c-5996-4712-ad56-4b123537b8ce is in RUNNING state, waiting...&#xA;Get a pipeline run with id=28261a6c-5996-4712-ad56-4b123537b8ce&#xA;Pipeline run with id=28261a6c-5996-4712-ad56-4b123537b8ce is in RUNNING state, waiting...&#xA;Get a pipeline run with id=28261a6c-5996-4712-ad56-4b123537b8ce&#xA;Pipeline run with id=28261a6c-5996-4712-ad56-4b123537b8ce is in RUNNING state, waiting...&#xA;Get a pipeline run with id=28261a6c-5996-4712-ad56-4b123537b8ce&#xA;Pipeline run with id=28261a6c-5996-4712-ad56-4b123537b8ce is in RUNNING state, waiting...&#xA;Get a pipeline run with id=28261a6c-5996-4712-ad56-4b123537b8ce&#xA;Pipeline run with id=28261a6c-5996-4712-ad56-4b123537b8ce is in RUNNING state, waiting...&#xA;Get a pipeline run with id=28261a6c-5996-4712-ad56-4b123537b8ce&#xA;Pipeline run with id=28261a6c-5996-4712-ad56-4b123537b8ce is in RUNNING state, waiting...&#xA;Get a pipeline run with id=28261a6c-5996-4712-ad56-4b123537b8ce&#xA;Pipeline run with id=28261a6c-5996-4712-ad56-4b123537b8ce is in RUNNING state, waiting...&#xA;Get a pipeline run with id=28261a6c-5996-4712-ad56-4b123537b8ce&#xA;Pipeline run with id=28261a6c-5996-4712-ad56-4b123537b8ce is in RUNNING state, waiting...&#xA;Get a pipeline run with id=28261a6c-5996-4712-ad56-4b123537b8ce&#xA;Pipeline run with id=28261a6c-5996-4712-ad56-4b123537b8ce is in RUNNING state, waiting...&#xA;Get a pipeline run with id=28261a6c-5996-4712-ad56-4b123537b8ce&#xA;Pipeline run with id=28261a6c-5996-4712-ad56-4b123537b8ce is in RUNNING state, waiting...&#xA;Get a pipeline run with id=28261a6c-5996-4712-ad56-4b123537b8ce&#xA;Pipeline run with id=28261a6c-5996-4712-ad56-4b123537b8ce is in RUNNING state, waiting...&#xA;Get a pipeline run with id=28261a6c-5996-4712-ad56-4b123537b8ce&#xA;Pipeline run with id=28261a6c-5996-4712-ad56-4b123537b8ce is in RUNNING state, waiting...&#xA;Get a pipeline run with id=28261a6c-5996-4712-ad56-4b123537b8ce&#xA;Pipeline run with id=28261a6c-5996-4712-ad56-4b123537b8ce is in RUNNING state, waiting...&#xA;Get a pipeline run with id=28261a6c-5996-4712-ad56-4b123537b8ce&#xA;Pipeline run with id=28261a6c-5996-4712-ad56-4b123537b8ce reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/pipeline_with_artifact_upload_download.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=28261a6c-5996-4712-ad56-4b123537b8ce&#xA;Get a pipeline run with id=28261a6c-5996-4712-ad56-4b123537b8ce&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/06/26 07:32:29.603 (1m35.587s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/06/26 07:32:29.603&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 28261a6c-5996-4712-ad56-4b123537b8ce&#xA;Failed to terminate run 28261a6c-5996-4712-ad56-4b123537b8ce&#xA;Terminate run 28261a6c-5996-4712-ad56-4b123537b8ce&#xA;Deleting run 28261a6c-5996-4712-ad56-4b123537b8ce&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=5ba3a6ea-9c02-4593-ba3d-7c6058620034 (cascade=true)&#xA;Pipeline with id=5ba3a6ea-9c02-4593-ba3d-7c6058620034, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/06/26 07:32:29.893 (290ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/06/26 07:32:29.893&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/06/26 07:32:29.893 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/06/26 07:32:29.893&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/06/26 07:32:29.893 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/parallel_for_after_dependency.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="121.398595161">
              <system-out>2026/07/06 07:32:55 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/06/26 07:30:53.724&#xA;Create an experiment with name E2EExperiment-1783323053724140260&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/06/26 07:30:53.938 (215ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/06/26 07:30:53.938&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x1d5c208f8f80&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/06/26 07:30:54.033 (94ms)&#xA;&gt; Enter [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/06/26 07:30:54.033&#xA;Uploading pipeline file critical/parallel_for_after_dependency.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1783323053938906990, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml&#xA;Upload of pipeline file &#39;critical/parallel_for_after_dependency.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 51995bf5-ba8c-46d6-82e9-493568c9f2ea&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;51995bf5-ba8c-46d6-82e9-493568c9f2ea&#39; and name: &#39;e2e-test-1783323053938906990&#39;&#xA;Create a pipeline run for pipeline with id=51995bf5-ba8c-46d6-82e9-493568c9f2ea and versionId=dfbc5c7e-b948-49a0-ac0d-c1eefd410129&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=764b65c5-da30-4e9a-8437-2cd10e4cbe33&#xA;Created Pipeline Run with id: 764b65c5-da30-4e9a-8437-2cd10e4cbe33 for pipeline with id: 51995bf5-ba8c-46d6-82e9-493568c9f2ea&#xA;Waiting for pipeline run with id=764b65c5-da30-4e9a-8437-2cd10e4cbe33 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=764b65c5-da30-4e9a-8437-2cd10e4cbe33&#xA;Pipeline run with id=764b65c5-da30-4e9a-8437-2cd10e4cbe33 is in PENDING state, waiting...&#xA;Get a pipeline run with id=764b65c5-da30-4e9a-8437-2cd10e4cbe33&#xA;Pipeline run with id=764b65c5-da30-4e9a-8437-2cd10e4cbe33 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=764b65c5-da30-4e9a-8437-2cd10e4cbe33&#xA;Pipeline run with id=764b65c5-da30-4e9a-8437-2cd10e4cbe33 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=764b65c5-da30-4e9a-8437-2cd10e4cbe33&#xA;Pipeline run with id=764b65c5-da30-4e9a-8437-2cd10e4cbe33 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=764b65c5-da30-4e9a-8437-2cd10e4cbe33&#xA;Pipeline run with id=764b65c5-da30-4e9a-8437-2cd10e4cbe33 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=764b65c5-da30-4e9a-8437-2cd10e4cbe33&#xA;Pipeline run with id=764b65c5-da30-4e9a-8437-2cd10e4cbe33 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=764b65c5-da30-4e9a-8437-2cd10e4cbe33&#xA;Pipeline run with id=764b65c5-da30-4e9a-8437-2cd10e4cbe33 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=764b65c5-da30-4e9a-8437-2cd10e4cbe33&#xA;Pipeline run with id=764b65c5-da30-4e9a-8437-2cd10e4cbe33 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=764b65c5-da30-4e9a-8437-2cd10e4cbe33&#xA;Pipeline run with id=764b65c5-da30-4e9a-8437-2cd10e4cbe33 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=764b65c5-da30-4e9a-8437-2cd10e4cbe33&#xA;Pipeline run with id=764b65c5-da30-4e9a-8437-2cd10e4cbe33 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=764b65c5-da30-4e9a-8437-2cd10e4cbe33&#xA;Pipeline run with id=764b65c5-da30-4e9a-8437-2cd10e4cbe33 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=764b65c5-da30-4e9a-8437-2cd10e4cbe33&#xA;Pipeline run with id=764b65c5-da30-4e9a-8437-2cd10e4cbe33 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=764b65c5-da30-4e9a-8437-2cd10e4cbe33&#xA;Pipeline run with id=764b65c5-da30-4e9a-8437-2cd10e4cbe33 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=764b65c5-da30-4e9a-8437-2cd10e4cbe33&#xA;Pipeline run with id=764b65c5-da30-4e9a-8437-2cd10e4cbe33 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=764b65c5-da30-4e9a-8437-2cd10e4cbe33&#xA;Pipeline run with id=764b65c5-da30-4e9a-8437-2cd10e4cbe33 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=764b65c5-da30-4e9a-8437-2cd10e4cbe33&#xA;Pipeline run with id=764b65c5-da30-4e9a-8437-2cd10e4cbe33 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=764b65c5-da30-4e9a-8437-2cd10e4cbe33&#xA;Pipeline run with id=764b65c5-da30-4e9a-8437-2cd10e4cbe33 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=764b65c5-da30-4e9a-8437-2cd10e4cbe33&#xA;Pipeline run with id=764b65c5-da30-4e9a-8437-2cd10e4cbe33 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=764b65c5-da30-4e9a-8437-2cd10e4cbe33&#xA;Pipeline run with id=764b65c5-da30-4e9a-8437-2cd10e4cbe33 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=764b65c5-da30-4e9a-8437-2cd10e4cbe33&#xA;Pipeline run with id=764b65c5-da30-4e9a-8437-2cd10e4cbe33 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=764b65c5-da30-4e9a-8437-2cd10e4cbe33&#xA;Pipeline run with id=764b65c5-da30-4e9a-8437-2cd10e4cbe33 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=764b65c5-da30-4e9a-8437-2cd10e4cbe33&#xA;Pipeline run with id=764b65c5-da30-4e9a-8437-2cd10e4cbe33 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=764b65c5-da30-4e9a-8437-2cd10e4cbe33&#xA;Pipeline run with id=764b65c5-da30-4e9a-8437-2cd10e4cbe33 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=764b65c5-da30-4e9a-8437-2cd10e4cbe33&#xA;Pipeline run with id=764b65c5-da30-4e9a-8437-2cd10e4cbe33 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=764b65c5-da30-4e9a-8437-2cd10e4cbe33&#xA;Pipeline run with id=764b65c5-da30-4e9a-8437-2cd10e4cbe33 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/parallel_for_after_dependency.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=764b65c5-da30-4e9a-8437-2cd10e4cbe33&#xA;Get a pipeline run with id=764b65c5-da30-4e9a-8437-2cd10e4cbe33&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/06/26 07:32:54.788 (2m0.756s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/06/26 07:32:54.789&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 764b65c5-da30-4e9a-8437-2cd10e4cbe33&#xA;Failed to terminate run 764b65c5-da30-4e9a-8437-2cd10e4cbe33&#xA;Terminate run 764b65c5-da30-4e9a-8437-2cd10e4cbe33&#xA;Deleting run 764b65c5-da30-4e9a-8437-2cd10e4cbe33&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=51995bf5-ba8c-46d6-82e9-493568c9f2ea (cascade=true)&#xA;Pipeline with id=51995bf5-ba8c-46d6-82e9-493568c9f2ea, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/06/26 07:32:55.122 (333ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/06/26 07:32:55.122&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/06/26 07:32:55.122 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/06/26 07:32:55.122&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/06/26 07:32:55.122 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/flip_coin.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="126.165060024">
              <system-out>2026/07/06 07:32:59 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/06/26 07:30:53.724&#xA;Create an experiment with name E2EExperiment-1783323053724130600&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/06/26 07:30:53.933 (210ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/06/26 07:30:53.934&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x3be8dd4bce00&#xA;test-secret-1 created&#xA;test-secret-2 created&#xA;test-secret-3 created&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/06/26 07:30:53.974 (41ms)&#xA;&gt; Enter [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/06/26 07:30:53.974&#xA;Uploading pipeline file critical/flip_coin.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1783323053934169214, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml&#xA;Upload of pipeline file &#39;critical/flip_coin.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 2a0b4fcd-3e1c-4bf1-97dd-859a7486b084&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;2a0b4fcd-3e1c-4bf1-97dd-859a7486b084&#39; and name: &#39;e2e-test-1783323053934169214&#39;&#xA;Create a pipeline run for pipeline with id=2a0b4fcd-3e1c-4bf1-97dd-859a7486b084 and versionId=532b2633-3212-4381-8871-2528dbba6973&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=0348b19e-ee9b-4e4d-83f0-616739e41a6e&#xA;Created Pipeline Run with id: 0348b19e-ee9b-4e4d-83f0-616739e41a6e for pipeline with id: 2a0b4fcd-3e1c-4bf1-97dd-859a7486b084&#xA;Waiting for pipeline run with id=0348b19e-ee9b-4e4d-83f0-616739e41a6e to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=0348b19e-ee9b-4e4d-83f0-616739e41a6e&#xA;Pipeline run with id=0348b19e-ee9b-4e4d-83f0-616739e41a6e is in PENDING state, waiting...&#xA;Get a pipeline run with id=0348b19e-ee9b-4e4d-83f0-616739e41a6e&#xA;Pipeline run with id=0348b19e-ee9b-4e4d-83f0-616739e41a6e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0348b19e-ee9b-4e4d-83f0-616739e41a6e&#xA;Pipeline run with id=0348b19e-ee9b-4e4d-83f0-616739e41a6e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0348b19e-ee9b-4e4d-83f0-616739e41a6e&#xA;Pipeline run with id=0348b19e-ee9b-4e4d-83f0-616739e41a6e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0348b19e-ee9b-4e4d-83f0-616739e41a6e&#xA;Pipeline run with id=0348b19e-ee9b-4e4d-83f0-616739e41a6e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0348b19e-ee9b-4e4d-83f0-616739e41a6e&#xA;Pipeline run with id=0348b19e-ee9b-4e4d-83f0-616739e41a6e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0348b19e-ee9b-4e4d-83f0-616739e41a6e&#xA;Pipeline run with id=0348b19e-ee9b-4e4d-83f0-616739e41a6e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0348b19e-ee9b-4e4d-83f0-616739e41a6e&#xA;Pipeline run with id=0348b19e-ee9b-4e4d-83f0-616739e41a6e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0348b19e-ee9b-4e4d-83f0-616739e41a6e&#xA;Pipeline run with id=0348b19e-ee9b-4e4d-83f0-616739e41a6e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0348b19e-ee9b-4e4d-83f0-616739e41a6e&#xA;Pipeline run with id=0348b19e-ee9b-4e4d-83f0-616739e41a6e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0348b19e-ee9b-4e4d-83f0-616739e41a6e&#xA;Pipeline run with id=0348b19e-ee9b-4e4d-83f0-616739e41a6e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0348b19e-ee9b-4e4d-83f0-616739e41a6e&#xA;Pipeline run with id=0348b19e-ee9b-4e4d-83f0-616739e41a6e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0348b19e-ee9b-4e4d-83f0-616739e41a6e&#xA;Pipeline run with id=0348b19e-ee9b-4e4d-83f0-616739e41a6e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0348b19e-ee9b-4e4d-83f0-616739e41a6e&#xA;Pipeline run with id=0348b19e-ee9b-4e4d-83f0-616739e41a6e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0348b19e-ee9b-4e4d-83f0-616739e41a6e&#xA;Pipeline run with id=0348b19e-ee9b-4e4d-83f0-616739e41a6e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0348b19e-ee9b-4e4d-83f0-616739e41a6e&#xA;Pipeline run with id=0348b19e-ee9b-4e4d-83f0-616739e41a6e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0348b19e-ee9b-4e4d-83f0-616739e41a6e&#xA;Pipeline run with id=0348b19e-ee9b-4e4d-83f0-616739e41a6e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0348b19e-ee9b-4e4d-83f0-616739e41a6e&#xA;Pipeline run with id=0348b19e-ee9b-4e4d-83f0-616739e41a6e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0348b19e-ee9b-4e4d-83f0-616739e41a6e&#xA;Pipeline run with id=0348b19e-ee9b-4e4d-83f0-616739e41a6e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0348b19e-ee9b-4e4d-83f0-616739e41a6e&#xA;Pipeline run with id=0348b19e-ee9b-4e4d-83f0-616739e41a6e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0348b19e-ee9b-4e4d-83f0-616739e41a6e&#xA;Pipeline run with id=0348b19e-ee9b-4e4d-83f0-616739e41a6e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0348b19e-ee9b-4e4d-83f0-616739e41a6e&#xA;Pipeline run with id=0348b19e-ee9b-4e4d-83f0-616739e41a6e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0348b19e-ee9b-4e4d-83f0-616739e41a6e&#xA;Pipeline run with id=0348b19e-ee9b-4e4d-83f0-616739e41a6e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0348b19e-ee9b-4e4d-83f0-616739e41a6e&#xA;Pipeline run with id=0348b19e-ee9b-4e4d-83f0-616739e41a6e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0348b19e-ee9b-4e4d-83f0-616739e41a6e&#xA;Pipeline run with id=0348b19e-ee9b-4e4d-83f0-616739e41a6e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0348b19e-ee9b-4e4d-83f0-616739e41a6e&#xA;Pipeline run with id=0348b19e-ee9b-4e4d-83f0-616739e41a6e reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/flip_coin.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=0348b19e-ee9b-4e4d-83f0-616739e41a6e&#xA;Get a pipeline run with id=0348b19e-ee9b-4e4d-83f0-616739e41a6e&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/06/26 07:32:59.652 (2m5.678s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/06/26 07:32:59.653&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 0348b19e-ee9b-4e4d-83f0-616739e41a6e&#xA;Failed to terminate run 0348b19e-ee9b-4e4d-83f0-616739e41a6e&#xA;Terminate run 0348b19e-ee9b-4e4d-83f0-616739e41a6e&#xA;Deleting run 0348b19e-ee9b-4e4d-83f0-616739e41a6e&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=2a0b4fcd-3e1c-4bf1-97dd-859a7486b084 (cascade=true)&#xA;Pipeline with id=2a0b4fcd-3e1c-4bf1-97dd-859a7486b084, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/06/26 07:32:59.889 (236ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/06/26 07:32:59.889&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/06/26 07:32:59.889 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/06/26 07:32:59.889&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/06/26 07:32:59.889 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload essential/iris_pipeline_compiled.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="156.046088279">
              <system-out>2026/07/06 07:33:29 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/06/26 07:30:53.724&#xA;Create an experiment with name E2EExperiment-1783323053724318854&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/06/26 07:30:53.933 (210ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/06/26 07:30:53.934&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x2ce14c5e6380&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/06/26 07:30:54.006 (72ms)&#xA;&gt; Enter [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/06/26 07:30:54.006&#xA;Uploading pipeline file essential/iris_pipeline_compiled.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1783323053934247956, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml&#xA;Upload of pipeline file &#39;essential/iris_pipeline_compiled.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 0cb017db-2e17-4bf8-9b3d-50e3d3f8db90&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;0cb017db-2e17-4bf8-9b3d-50e3d3f8db90&#39; and name: &#39;e2e-test-1783323053934247956&#39;&#xA;Create a pipeline run for pipeline with id=0cb017db-2e17-4bf8-9b3d-50e3d3f8db90 and versionId=3b8c0b98-5b29-4cda-bce4-37821c2a7b69&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=b4e5dc8e-6705-46dc-9640-ba5cb0f42655&#xA;Created Pipeline Run with id: b4e5dc8e-6705-46dc-9640-ba5cb0f42655 for pipeline with id: 0cb017db-2e17-4bf8-9b3d-50e3d3f8db90&#xA;Waiting for pipeline run with id=b4e5dc8e-6705-46dc-9640-ba5cb0f42655 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=b4e5dc8e-6705-46dc-9640-ba5cb0f42655&#xA;Pipeline run with id=b4e5dc8e-6705-46dc-9640-ba5cb0f42655 is in PENDING state, waiting...&#xA;Get a pipeline run with id=b4e5dc8e-6705-46dc-9640-ba5cb0f42655&#xA;Pipeline run with id=b4e5dc8e-6705-46dc-9640-ba5cb0f42655 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b4e5dc8e-6705-46dc-9640-ba5cb0f42655&#xA;Pipeline run with id=b4e5dc8e-6705-46dc-9640-ba5cb0f42655 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b4e5dc8e-6705-46dc-9640-ba5cb0f42655&#xA;Pipeline run with id=b4e5dc8e-6705-46dc-9640-ba5cb0f42655 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b4e5dc8e-6705-46dc-9640-ba5cb0f42655&#xA;Pipeline run with id=b4e5dc8e-6705-46dc-9640-ba5cb0f42655 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b4e5dc8e-6705-46dc-9640-ba5cb0f42655&#xA;Pipeline run with id=b4e5dc8e-6705-46dc-9640-ba5cb0f42655 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b4e5dc8e-6705-46dc-9640-ba5cb0f42655&#xA;Pipeline run with id=b4e5dc8e-6705-46dc-9640-ba5cb0f42655 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b4e5dc8e-6705-46dc-9640-ba5cb0f42655&#xA;Pipeline run with id=b4e5dc8e-6705-46dc-9640-ba5cb0f42655 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b4e5dc8e-6705-46dc-9640-ba5cb0f42655&#xA;Pipeline run with id=b4e5dc8e-6705-46dc-9640-ba5cb0f42655 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b4e5dc8e-6705-46dc-9640-ba5cb0f42655&#xA;Pipeline run with id=b4e5dc8e-6705-46dc-9640-ba5cb0f42655 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b4e5dc8e-6705-46dc-9640-ba5cb0f42655&#xA;Pipeline run with id=b4e5dc8e-6705-46dc-9640-ba5cb0f42655 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b4e5dc8e-6705-46dc-9640-ba5cb0f42655&#xA;Pipeline run with id=b4e5dc8e-6705-46dc-9640-ba5cb0f42655 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b4e5dc8e-6705-46dc-9640-ba5cb0f42655&#xA;Pipeline run with id=b4e5dc8e-6705-46dc-9640-ba5cb0f42655 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b4e5dc8e-6705-46dc-9640-ba5cb0f42655&#xA;Pipeline run with id=b4e5dc8e-6705-46dc-9640-ba5cb0f42655 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b4e5dc8e-6705-46dc-9640-ba5cb0f42655&#xA;Pipeline run with id=b4e5dc8e-6705-46dc-9640-ba5cb0f42655 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b4e5dc8e-6705-46dc-9640-ba5cb0f42655&#xA;Pipeline run with id=b4e5dc8e-6705-46dc-9640-ba5cb0f42655 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b4e5dc8e-6705-46dc-9640-ba5cb0f42655&#xA;Pipeline run with id=b4e5dc8e-6705-46dc-9640-ba5cb0f42655 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b4e5dc8e-6705-46dc-9640-ba5cb0f42655&#xA;Pipeline run with id=b4e5dc8e-6705-46dc-9640-ba5cb0f42655 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b4e5dc8e-6705-46dc-9640-ba5cb0f42655&#xA;Pipeline run with id=b4e5dc8e-6705-46dc-9640-ba5cb0f42655 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b4e5dc8e-6705-46dc-9640-ba5cb0f42655&#xA;Pipeline run with id=b4e5dc8e-6705-46dc-9640-ba5cb0f42655 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b4e5dc8e-6705-46dc-9640-ba5cb0f42655&#xA;Pipeline run with id=b4e5dc8e-6705-46dc-9640-ba5cb0f42655 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b4e5dc8e-6705-46dc-9640-ba5cb0f42655&#xA;Pipeline run with id=b4e5dc8e-6705-46dc-9640-ba5cb0f42655 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b4e5dc8e-6705-46dc-9640-ba5cb0f42655&#xA;Pipeline run with id=b4e5dc8e-6705-46dc-9640-ba5cb0f42655 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b4e5dc8e-6705-46dc-9640-ba5cb0f42655&#xA;Pipeline run with id=b4e5dc8e-6705-46dc-9640-ba5cb0f42655 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b4e5dc8e-6705-46dc-9640-ba5cb0f42655&#xA;Pipeline run with id=b4e5dc8e-6705-46dc-9640-ba5cb0f42655 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b4e5dc8e-6705-46dc-9640-ba5cb0f42655&#xA;Pipeline run with id=b4e5dc8e-6705-46dc-9640-ba5cb0f42655 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b4e5dc8e-6705-46dc-9640-ba5cb0f42655&#xA;Pipeline run with id=b4e5dc8e-6705-46dc-9640-ba5cb0f42655 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b4e5dc8e-6705-46dc-9640-ba5cb0f42655&#xA;Pipeline run with id=b4e5dc8e-6705-46dc-9640-ba5cb0f42655 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b4e5dc8e-6705-46dc-9640-ba5cb0f42655&#xA;Pipeline run with id=b4e5dc8e-6705-46dc-9640-ba5cb0f42655 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b4e5dc8e-6705-46dc-9640-ba5cb0f42655&#xA;Pipeline run with id=b4e5dc8e-6705-46dc-9640-ba5cb0f42655 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b4e5dc8e-6705-46dc-9640-ba5cb0f42655&#xA;Pipeline run with id=b4e5dc8e-6705-46dc-9640-ba5cb0f42655 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b4e5dc8e-6705-46dc-9640-ba5cb0f42655&#xA;Pipeline run with id=b4e5dc8e-6705-46dc-9640-ba5cb0f42655 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;essential/iris_pipeline_compiled.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=b4e5dc8e-6705-46dc-9640-ba5cb0f42655&#xA;Get a pipeline run with id=b4e5dc8e-6705-46dc-9640-ba5cb0f42655&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/06/26 07:33:29.6 (2m35.593s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/06/26 07:33:29.6&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run b4e5dc8e-6705-46dc-9640-ba5cb0f42655&#xA;Failed to terminate run b4e5dc8e-6705-46dc-9640-ba5cb0f42655&#xA;Terminate run b4e5dc8e-6705-46dc-9640-ba5cb0f42655&#xA;Deleting run b4e5dc8e-6705-46dc-9640-ba5cb0f42655&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=0cb017db-2e17-4bf8-9b3d-50e3d3f8db90 (cascade=true)&#xA;Pipeline with id=0cb017db-2e17-4bf8-9b3d-50e3d3f8db90, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/06/26 07:33:29.77 (170ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/06/26 07:33:29.77&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/06/26 07:33:29.77 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/06/26 07:33:29.77&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/06/26 07:33:29.771 (0s)&#xA;</system-err>
          </testcase>
      </testsuite>
  </testsuites>