<?xml version="1.0" encoding="UTF-8"?>
  <testsuites tests="5" disabled="0" errors="0" failures="0" time="156.812208908">
      <testsuite name="AIPipelinesE2ETests" package="/dspa/backend/test/end2end" tests="5" disabled="0" skipped="0" errors="0" failures="0" time="156.812208908" timestamp="2026-07-02T06:31:28">
          <properties>
              <property name="SuiteSucceeded" value="true"></property>
              <property name="SuiteHasProgrammaticFocus" value="false"></property>
              <property name="SpecialSuiteFailureReason" value=""></property>
              <property name="SuiteLabels" value="[]"></property>
              <property name="SuiteSemVerConstraints" value="[]"></property>
              <property name="RandomSeed" value="1782973724"></property>
              <property name="RandomizeAllSpecs" value="false"></property>
              <property name="LabelFilter" value="Smoke"></property>
              <property name="SemVerFilter" value=""></property>
              <property name="FocusStrings" value=""></property>
              <property name="SkipStrings" value=""></property>
              <property name="FocusFiles" value=""></property>
              <property name="SkipFiles" value=""></property>
              <property name="FailOnPending" value="false"></property>
              <property name="FailOnEmpty" value="false"></property>
              <property name="FailFast" value="false"></property>
              <property name="FlakeAttempts" value="0"></property>
              <property name="DryRun" value="false"></property>
              <property name="ParallelTotal" value="10"></property>
              <property name="OutputInterceptorMode" value=""></property>
          </properties>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload essential/component_with_pip_index_urls.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="46.866877177">
              <system-out>2026/07/02 06:32:15 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/02/26 06:31:29.042&#xA;Create an experiment with name E2EExperiment-1782973889042882892&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/02/26 06:31:29.356 (313ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/02/26 06:31:29.356&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x37119c43c380&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/02/26 06:31:29.59 (234ms)&#xA;&gt; Enter [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/02/26 06:31:29.59&#xA;Uploading pipeline file essential/component_with_pip_index_urls.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1782973889356224676, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml&#xA;Upload of pipeline file &#39;essential/component_with_pip_index_urls.yaml&#39; successful&#xA;Listing pipeline versions for pipeline ef75eaba-6551-43a7-8a12-eeef3dd3c610&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;ef75eaba-6551-43a7-8a12-eeef3dd3c610&#39; and name: &#39;e2e-test-1782973889356224676&#39;&#xA;Create a pipeline run for pipeline with id=ef75eaba-6551-43a7-8a12-eeef3dd3c610 and versionId=b0b35e5f-ca2e-432d-81f0-035c7f64f596&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=4daaaf8b-4953-436d-a006-224bf4789e2b&#xA;Created Pipeline Run with id: 4daaaf8b-4953-436d-a006-224bf4789e2b for pipeline with id: ef75eaba-6551-43a7-8a12-eeef3dd3c610&#xA;Waiting for pipeline run with id=4daaaf8b-4953-436d-a006-224bf4789e2b to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=4daaaf8b-4953-436d-a006-224bf4789e2b&#xA;Pipeline run with id=4daaaf8b-4953-436d-a006-224bf4789e2b is in PENDING state, waiting...&#xA;Get a pipeline run with id=4daaaf8b-4953-436d-a006-224bf4789e2b&#xA;Pipeline run with id=4daaaf8b-4953-436d-a006-224bf4789e2b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4daaaf8b-4953-436d-a006-224bf4789e2b&#xA;Pipeline run with id=4daaaf8b-4953-436d-a006-224bf4789e2b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4daaaf8b-4953-436d-a006-224bf4789e2b&#xA;Pipeline run with id=4daaaf8b-4953-436d-a006-224bf4789e2b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4daaaf8b-4953-436d-a006-224bf4789e2b&#xA;Pipeline run with id=4daaaf8b-4953-436d-a006-224bf4789e2b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4daaaf8b-4953-436d-a006-224bf4789e2b&#xA;Pipeline run with id=4daaaf8b-4953-436d-a006-224bf4789e2b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4daaaf8b-4953-436d-a006-224bf4789e2b&#xA;Pipeline run with id=4daaaf8b-4953-436d-a006-224bf4789e2b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4daaaf8b-4953-436d-a006-224bf4789e2b&#xA;Pipeline run with id=4daaaf8b-4953-436d-a006-224bf4789e2b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4daaaf8b-4953-436d-a006-224bf4789e2b&#xA;Pipeline run with id=4daaaf8b-4953-436d-a006-224bf4789e2b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4daaaf8b-4953-436d-a006-224bf4789e2b&#xA;Pipeline run with id=4daaaf8b-4953-436d-a006-224bf4789e2b reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;essential/component_with_pip_index_urls.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=4daaaf8b-4953-436d-a006-224bf4789e2b&#xA;Get a pipeline run with id=4daaaf8b-4953-436d-a006-224bf4789e2b&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/02/26 06:32:15.416 (45.826s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/02/26 06:32:15.416&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 4daaaf8b-4953-436d-a006-224bf4789e2b&#xA;Failed to terminate run 4daaaf8b-4953-436d-a006-224bf4789e2b&#xA;Terminate run 4daaaf8b-4953-436d-a006-224bf4789e2b&#xA;Deleting run 4daaaf8b-4953-436d-a006-224bf4789e2b&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=ef75eaba-6551-43a7-8a12-eeef3dd3c610 (cascade=true)&#xA;Pipeline with id=ef75eaba-6551-43a7-8a12-eeef3dd3c610, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/02/26 06:32:15.909 (493ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/02/26 06:32:15.91&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/02/26 06:32:15.91 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/02/26 06:32:15.91&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/02/26 06:32:15.91 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/parallel_for_after_dependency.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="96.799542176">
              <system-out>2026/07/02 06:33:05 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/02/26 06:31:29.042&#xA;Create an experiment with name E2EExperiment-1782973889042668108&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/02/26 06:31:29.262 (220ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/02/26 06:31:29.262&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x2cd401ea2680&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/02/26 06:31:29.506 (244ms)&#xA;&gt; Enter [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/02/26 06:31:29.506&#xA;Uploading pipeline file critical/parallel_for_after_dependency.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1782973889262902709, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml&#xA;Upload of pipeline file &#39;critical/parallel_for_after_dependency.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 65106175-8532-4ed2-afaf-a785dbc4cd80&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;65106175-8532-4ed2-afaf-a785dbc4cd80&#39; and name: &#39;e2e-test-1782973889262902709&#39;&#xA;Create a pipeline run for pipeline with id=65106175-8532-4ed2-afaf-a785dbc4cd80 and versionId=b1e4464f-d7a5-4093-8c03-b21cb9e52cb7&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=fead1a68-5e31-4ccb-a018-9f45ef1ef900&#xA;Created Pipeline Run with id: fead1a68-5e31-4ccb-a018-9f45ef1ef900 for pipeline with id: 65106175-8532-4ed2-afaf-a785dbc4cd80&#xA;Waiting for pipeline run with id=fead1a68-5e31-4ccb-a018-9f45ef1ef900 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=fead1a68-5e31-4ccb-a018-9f45ef1ef900&#xA;Pipeline run with id=fead1a68-5e31-4ccb-a018-9f45ef1ef900 is in PENDING state, waiting...&#xA;Get a pipeline run with id=fead1a68-5e31-4ccb-a018-9f45ef1ef900&#xA;Pipeline run with id=fead1a68-5e31-4ccb-a018-9f45ef1ef900 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fead1a68-5e31-4ccb-a018-9f45ef1ef900&#xA;Pipeline run with id=fead1a68-5e31-4ccb-a018-9f45ef1ef900 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fead1a68-5e31-4ccb-a018-9f45ef1ef900&#xA;Pipeline run with id=fead1a68-5e31-4ccb-a018-9f45ef1ef900 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fead1a68-5e31-4ccb-a018-9f45ef1ef900&#xA;Pipeline run with id=fead1a68-5e31-4ccb-a018-9f45ef1ef900 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fead1a68-5e31-4ccb-a018-9f45ef1ef900&#xA;Pipeline run with id=fead1a68-5e31-4ccb-a018-9f45ef1ef900 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fead1a68-5e31-4ccb-a018-9f45ef1ef900&#xA;Pipeline run with id=fead1a68-5e31-4ccb-a018-9f45ef1ef900 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fead1a68-5e31-4ccb-a018-9f45ef1ef900&#xA;Pipeline run with id=fead1a68-5e31-4ccb-a018-9f45ef1ef900 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fead1a68-5e31-4ccb-a018-9f45ef1ef900&#xA;Pipeline run with id=fead1a68-5e31-4ccb-a018-9f45ef1ef900 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fead1a68-5e31-4ccb-a018-9f45ef1ef900&#xA;Pipeline run with id=fead1a68-5e31-4ccb-a018-9f45ef1ef900 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fead1a68-5e31-4ccb-a018-9f45ef1ef900&#xA;Pipeline run with id=fead1a68-5e31-4ccb-a018-9f45ef1ef900 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fead1a68-5e31-4ccb-a018-9f45ef1ef900&#xA;Pipeline run with id=fead1a68-5e31-4ccb-a018-9f45ef1ef900 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fead1a68-5e31-4ccb-a018-9f45ef1ef900&#xA;Pipeline run with id=fead1a68-5e31-4ccb-a018-9f45ef1ef900 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fead1a68-5e31-4ccb-a018-9f45ef1ef900&#xA;Pipeline run with id=fead1a68-5e31-4ccb-a018-9f45ef1ef900 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fead1a68-5e31-4ccb-a018-9f45ef1ef900&#xA;Pipeline run with id=fead1a68-5e31-4ccb-a018-9f45ef1ef900 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fead1a68-5e31-4ccb-a018-9f45ef1ef900&#xA;Pipeline run with id=fead1a68-5e31-4ccb-a018-9f45ef1ef900 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fead1a68-5e31-4ccb-a018-9f45ef1ef900&#xA;Pipeline run with id=fead1a68-5e31-4ccb-a018-9f45ef1ef900 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fead1a68-5e31-4ccb-a018-9f45ef1ef900&#xA;Pipeline run with id=fead1a68-5e31-4ccb-a018-9f45ef1ef900 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fead1a68-5e31-4ccb-a018-9f45ef1ef900&#xA;Pipeline run with id=fead1a68-5e31-4ccb-a018-9f45ef1ef900 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fead1a68-5e31-4ccb-a018-9f45ef1ef900&#xA;Pipeline run with id=fead1a68-5e31-4ccb-a018-9f45ef1ef900 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/parallel_for_after_dependency.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=fead1a68-5e31-4ccb-a018-9f45ef1ef900&#xA;Get a pipeline run with id=fead1a68-5e31-4ccb-a018-9f45ef1ef900&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/02/26 06:33:05.377 (1m35.87s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/02/26 06:33:05.377&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run fead1a68-5e31-4ccb-a018-9f45ef1ef900&#xA;Failed to terminate run fead1a68-5e31-4ccb-a018-9f45ef1ef900&#xA;Terminate run fead1a68-5e31-4ccb-a018-9f45ef1ef900&#xA;Deleting run fead1a68-5e31-4ccb-a018-9f45ef1ef900&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=65106175-8532-4ed2-afaf-a785dbc4cd80 (cascade=true)&#xA;Pipeline with id=65106175-8532-4ed2-afaf-a785dbc4cd80, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/02/26 06:33:05.842 (465ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/02/26 06:33:05.842&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/02/26 06:33:05.842 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/02/26 06:33:05.842&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/02/26 06:33:05.842 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/pipeline_with_artifact_upload_download.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="101.587515585">
              <system-out>2026/07/02 06:33:10 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/02/26 06:31:29.042&#xA;Create an experiment with name E2EExperiment-1782973889042549006&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/02/26 06:31:29.257 (215ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/02/26 06:31:29.257&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x5ce9726100&#xA;test-secret-1 created&#xA;test-secret-2 created&#xA;test-secret-3 created&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/02/26 06:31:29.384 (127ms)&#xA;&gt; Enter [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/02/26 06:31:29.384&#xA;Uploading pipeline file critical/pipeline_with_artifact_upload_download.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1782973889257661293, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml&#xA;Upload of pipeline file &#39;critical/pipeline_with_artifact_upload_download.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 2cc2f206-645b-4605-ba1b-079140dfe316&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;2cc2f206-645b-4605-ba1b-079140dfe316&#39; and name: &#39;e2e-test-1782973889257661293&#39;&#xA;Create a pipeline run for pipeline with id=2cc2f206-645b-4605-ba1b-079140dfe316 and versionId=7a5868fb-7534-461b-a627-676c74760881&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=0e275988-c93d-4ce1-93c8-5524772faeb8&#xA;Created Pipeline Run with id: 0e275988-c93d-4ce1-93c8-5524772faeb8 for pipeline with id: 2cc2f206-645b-4605-ba1b-079140dfe316&#xA;Waiting for pipeline run with id=0e275988-c93d-4ce1-93c8-5524772faeb8 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=0e275988-c93d-4ce1-93c8-5524772faeb8&#xA;Pipeline run with id=0e275988-c93d-4ce1-93c8-5524772faeb8 is in PENDING state, waiting...&#xA;Get a pipeline run with id=0e275988-c93d-4ce1-93c8-5524772faeb8&#xA;Pipeline run with id=0e275988-c93d-4ce1-93c8-5524772faeb8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0e275988-c93d-4ce1-93c8-5524772faeb8&#xA;Pipeline run with id=0e275988-c93d-4ce1-93c8-5524772faeb8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0e275988-c93d-4ce1-93c8-5524772faeb8&#xA;Pipeline run with id=0e275988-c93d-4ce1-93c8-5524772faeb8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0e275988-c93d-4ce1-93c8-5524772faeb8&#xA;Pipeline run with id=0e275988-c93d-4ce1-93c8-5524772faeb8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0e275988-c93d-4ce1-93c8-5524772faeb8&#xA;Pipeline run with id=0e275988-c93d-4ce1-93c8-5524772faeb8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0e275988-c93d-4ce1-93c8-5524772faeb8&#xA;Pipeline run with id=0e275988-c93d-4ce1-93c8-5524772faeb8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0e275988-c93d-4ce1-93c8-5524772faeb8&#xA;Pipeline run with id=0e275988-c93d-4ce1-93c8-5524772faeb8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0e275988-c93d-4ce1-93c8-5524772faeb8&#xA;Pipeline run with id=0e275988-c93d-4ce1-93c8-5524772faeb8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0e275988-c93d-4ce1-93c8-5524772faeb8&#xA;Pipeline run with id=0e275988-c93d-4ce1-93c8-5524772faeb8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0e275988-c93d-4ce1-93c8-5524772faeb8&#xA;Pipeline run with id=0e275988-c93d-4ce1-93c8-5524772faeb8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0e275988-c93d-4ce1-93c8-5524772faeb8&#xA;Pipeline run with id=0e275988-c93d-4ce1-93c8-5524772faeb8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0e275988-c93d-4ce1-93c8-5524772faeb8&#xA;Pipeline run with id=0e275988-c93d-4ce1-93c8-5524772faeb8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0e275988-c93d-4ce1-93c8-5524772faeb8&#xA;Pipeline run with id=0e275988-c93d-4ce1-93c8-5524772faeb8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0e275988-c93d-4ce1-93c8-5524772faeb8&#xA;Pipeline run with id=0e275988-c93d-4ce1-93c8-5524772faeb8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0e275988-c93d-4ce1-93c8-5524772faeb8&#xA;Pipeline run with id=0e275988-c93d-4ce1-93c8-5524772faeb8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0e275988-c93d-4ce1-93c8-5524772faeb8&#xA;Pipeline run with id=0e275988-c93d-4ce1-93c8-5524772faeb8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0e275988-c93d-4ce1-93c8-5524772faeb8&#xA;Pipeline run with id=0e275988-c93d-4ce1-93c8-5524772faeb8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0e275988-c93d-4ce1-93c8-5524772faeb8&#xA;Pipeline run with id=0e275988-c93d-4ce1-93c8-5524772faeb8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0e275988-c93d-4ce1-93c8-5524772faeb8&#xA;Pipeline run with id=0e275988-c93d-4ce1-93c8-5524772faeb8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0e275988-c93d-4ce1-93c8-5524772faeb8&#xA;Pipeline run with id=0e275988-c93d-4ce1-93c8-5524772faeb8 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/pipeline_with_artifact_upload_download.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=0e275988-c93d-4ce1-93c8-5524772faeb8&#xA;Get a pipeline run with id=0e275988-c93d-4ce1-93c8-5524772faeb8&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/02/26 06:33:10.133 (1m40.749s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/02/26 06:33:10.133&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 0e275988-c93d-4ce1-93c8-5524772faeb8&#xA;Failed to terminate run 0e275988-c93d-4ce1-93c8-5524772faeb8&#xA;Terminate run 0e275988-c93d-4ce1-93c8-5524772faeb8&#xA;Deleting run 0e275988-c93d-4ce1-93c8-5524772faeb8&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=2cc2f206-645b-4605-ba1b-079140dfe316 (cascade=true)&#xA;Pipeline with id=2cc2f206-645b-4605-ba1b-079140dfe316, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/02/26 06:33:10.629 (496ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/02/26 06:33:10.63&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/02/26 06:33:10.63 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/02/26 06:33:10.63&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/02/26 06:33:10.63 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/flip_coin.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="132.099232093">
              <system-out>2026/07/02 06:33:41 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/02/26 06:31:29.042&#xA;Create an experiment with name E2EExperiment-1782973889042702899&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/02/26 06:31:29.258 (215ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/02/26 06:31:29.258&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x1ccb73ae2400&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/02/26 06:31:29.511 (253ms)&#xA;&gt; Enter [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/02/26 06:31:29.511&#xA;Uploading pipeline file critical/flip_coin.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1782973889258432349, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml&#xA;Upload of pipeline file &#39;critical/flip_coin.yaml&#39; successful&#xA;Listing pipeline versions for pipeline c3b6580d-12e5-4261-85fc-3f0c768353a0&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;c3b6580d-12e5-4261-85fc-3f0c768353a0&#39; and name: &#39;e2e-test-1782973889258432349&#39;&#xA;Create a pipeline run for pipeline with id=c3b6580d-12e5-4261-85fc-3f0c768353a0 and versionId=38036bf5-b997-4250-9adc-3ce1b0634037&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=3b266dd4-9c6e-40ca-ab83-5d8db2aca408&#xA;Created Pipeline Run with id: 3b266dd4-9c6e-40ca-ab83-5d8db2aca408 for pipeline with id: c3b6580d-12e5-4261-85fc-3f0c768353a0&#xA;Waiting for pipeline run with id=3b266dd4-9c6e-40ca-ab83-5d8db2aca408 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=3b266dd4-9c6e-40ca-ab83-5d8db2aca408&#xA;Pipeline run with id=3b266dd4-9c6e-40ca-ab83-5d8db2aca408 is in PENDING state, waiting...&#xA;Get a pipeline run with id=3b266dd4-9c6e-40ca-ab83-5d8db2aca408&#xA;Pipeline run with id=3b266dd4-9c6e-40ca-ab83-5d8db2aca408 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3b266dd4-9c6e-40ca-ab83-5d8db2aca408&#xA;Pipeline run with id=3b266dd4-9c6e-40ca-ab83-5d8db2aca408 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3b266dd4-9c6e-40ca-ab83-5d8db2aca408&#xA;Pipeline run with id=3b266dd4-9c6e-40ca-ab83-5d8db2aca408 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3b266dd4-9c6e-40ca-ab83-5d8db2aca408&#xA;Pipeline run with id=3b266dd4-9c6e-40ca-ab83-5d8db2aca408 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3b266dd4-9c6e-40ca-ab83-5d8db2aca408&#xA;Pipeline run with id=3b266dd4-9c6e-40ca-ab83-5d8db2aca408 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3b266dd4-9c6e-40ca-ab83-5d8db2aca408&#xA;Pipeline run with id=3b266dd4-9c6e-40ca-ab83-5d8db2aca408 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3b266dd4-9c6e-40ca-ab83-5d8db2aca408&#xA;Pipeline run with id=3b266dd4-9c6e-40ca-ab83-5d8db2aca408 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3b266dd4-9c6e-40ca-ab83-5d8db2aca408&#xA;Pipeline run with id=3b266dd4-9c6e-40ca-ab83-5d8db2aca408 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3b266dd4-9c6e-40ca-ab83-5d8db2aca408&#xA;Pipeline run with id=3b266dd4-9c6e-40ca-ab83-5d8db2aca408 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3b266dd4-9c6e-40ca-ab83-5d8db2aca408&#xA;Pipeline run with id=3b266dd4-9c6e-40ca-ab83-5d8db2aca408 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3b266dd4-9c6e-40ca-ab83-5d8db2aca408&#xA;Pipeline run with id=3b266dd4-9c6e-40ca-ab83-5d8db2aca408 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3b266dd4-9c6e-40ca-ab83-5d8db2aca408&#xA;Pipeline run with id=3b266dd4-9c6e-40ca-ab83-5d8db2aca408 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3b266dd4-9c6e-40ca-ab83-5d8db2aca408&#xA;Pipeline run with id=3b266dd4-9c6e-40ca-ab83-5d8db2aca408 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3b266dd4-9c6e-40ca-ab83-5d8db2aca408&#xA;Pipeline run with id=3b266dd4-9c6e-40ca-ab83-5d8db2aca408 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3b266dd4-9c6e-40ca-ab83-5d8db2aca408&#xA;Pipeline run with id=3b266dd4-9c6e-40ca-ab83-5d8db2aca408 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3b266dd4-9c6e-40ca-ab83-5d8db2aca408&#xA;Pipeline run with id=3b266dd4-9c6e-40ca-ab83-5d8db2aca408 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3b266dd4-9c6e-40ca-ab83-5d8db2aca408&#xA;Pipeline run with id=3b266dd4-9c6e-40ca-ab83-5d8db2aca408 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3b266dd4-9c6e-40ca-ab83-5d8db2aca408&#xA;Pipeline run with id=3b266dd4-9c6e-40ca-ab83-5d8db2aca408 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3b266dd4-9c6e-40ca-ab83-5d8db2aca408&#xA;Pipeline run with id=3b266dd4-9c6e-40ca-ab83-5d8db2aca408 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3b266dd4-9c6e-40ca-ab83-5d8db2aca408&#xA;Pipeline run with id=3b266dd4-9c6e-40ca-ab83-5d8db2aca408 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3b266dd4-9c6e-40ca-ab83-5d8db2aca408&#xA;Pipeline run with id=3b266dd4-9c6e-40ca-ab83-5d8db2aca408 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3b266dd4-9c6e-40ca-ab83-5d8db2aca408&#xA;Pipeline run with id=3b266dd4-9c6e-40ca-ab83-5d8db2aca408 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3b266dd4-9c6e-40ca-ab83-5d8db2aca408&#xA;Pipeline run with id=3b266dd4-9c6e-40ca-ab83-5d8db2aca408 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3b266dd4-9c6e-40ca-ab83-5d8db2aca408&#xA;Pipeline run with id=3b266dd4-9c6e-40ca-ab83-5d8db2aca408 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3b266dd4-9c6e-40ca-ab83-5d8db2aca408&#xA;Pipeline run with id=3b266dd4-9c6e-40ca-ab83-5d8db2aca408 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3b266dd4-9c6e-40ca-ab83-5d8db2aca408&#xA;Pipeline run with id=3b266dd4-9c6e-40ca-ab83-5d8db2aca408 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/flip_coin.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=3b266dd4-9c6e-40ca-ab83-5d8db2aca408&#xA;Get a pipeline run with id=3b266dd4-9c6e-40ca-ab83-5d8db2aca408&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/02/26 06:33:40.463 (2m10.952s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/02/26 06:33:40.463&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 3b266dd4-9c6e-40ca-ab83-5d8db2aca408&#xA;Failed to terminate run 3b266dd4-9c6e-40ca-ab83-5d8db2aca408&#xA;Terminate run 3b266dd4-9c6e-40ca-ab83-5d8db2aca408&#xA;Deleting run 3b266dd4-9c6e-40ca-ab83-5d8db2aca408&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=c3b6580d-12e5-4261-85fc-3f0c768353a0 (cascade=true)&#xA;Pipeline with id=c3b6580d-12e5-4261-85fc-3f0c768353a0, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/02/26 06:33:41.141 (679ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/02/26 06:33:41.142&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/02/26 06:33:41.142 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/02/26 06:33:41.142&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/02/26 06:33:41.142 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload essential/iris_pipeline_compiled.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="156.551015008">
              <system-out>2026/07/02 06:34:05 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/02/26 06:31:29.042&#xA;Create an experiment with name E2EExperiment-1782973889042784960&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/02/26 06:31:29.344 (302ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/02/26 06:31:29.345&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x48b9bdc4680&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/02/26 06:31:29.597 (252ms)&#xA;&gt; Enter [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/02/26 06:31:29.597&#xA;Uploading pipeline file essential/iris_pipeline_compiled.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1782973889345029290, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml&#xA;Upload of pipeline file &#39;essential/iris_pipeline_compiled.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 8b4a886b-96ef-43ee-8072-a6473fa63342&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;8b4a886b-96ef-43ee-8072-a6473fa63342&#39; and name: &#39;e2e-test-1782973889345029290&#39;&#xA;Create a pipeline run for pipeline with id=8b4a886b-96ef-43ee-8072-a6473fa63342 and versionId=a8d26f27-fb5f-46f2-a9c2-727b7867de5d&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=6caf14f2-7024-4cc7-bf4d-80e348d41eef&#xA;Created Pipeline Run with id: 6caf14f2-7024-4cc7-bf4d-80e348d41eef for pipeline with id: 8b4a886b-96ef-43ee-8072-a6473fa63342&#xA;Waiting for pipeline run with id=6caf14f2-7024-4cc7-bf4d-80e348d41eef to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=6caf14f2-7024-4cc7-bf4d-80e348d41eef&#xA;Pipeline run with id=6caf14f2-7024-4cc7-bf4d-80e348d41eef is in PENDING state, waiting...&#xA;Get a pipeline run with id=6caf14f2-7024-4cc7-bf4d-80e348d41eef&#xA;Pipeline run with id=6caf14f2-7024-4cc7-bf4d-80e348d41eef is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6caf14f2-7024-4cc7-bf4d-80e348d41eef&#xA;Pipeline run with id=6caf14f2-7024-4cc7-bf4d-80e348d41eef is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6caf14f2-7024-4cc7-bf4d-80e348d41eef&#xA;Pipeline run with id=6caf14f2-7024-4cc7-bf4d-80e348d41eef is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6caf14f2-7024-4cc7-bf4d-80e348d41eef&#xA;Pipeline run with id=6caf14f2-7024-4cc7-bf4d-80e348d41eef is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6caf14f2-7024-4cc7-bf4d-80e348d41eef&#xA;Pipeline run with id=6caf14f2-7024-4cc7-bf4d-80e348d41eef is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6caf14f2-7024-4cc7-bf4d-80e348d41eef&#xA;Pipeline run with id=6caf14f2-7024-4cc7-bf4d-80e348d41eef is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6caf14f2-7024-4cc7-bf4d-80e348d41eef&#xA;Pipeline run with id=6caf14f2-7024-4cc7-bf4d-80e348d41eef is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6caf14f2-7024-4cc7-bf4d-80e348d41eef&#xA;Pipeline run with id=6caf14f2-7024-4cc7-bf4d-80e348d41eef is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6caf14f2-7024-4cc7-bf4d-80e348d41eef&#xA;Pipeline run with id=6caf14f2-7024-4cc7-bf4d-80e348d41eef is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6caf14f2-7024-4cc7-bf4d-80e348d41eef&#xA;Pipeline run with id=6caf14f2-7024-4cc7-bf4d-80e348d41eef is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6caf14f2-7024-4cc7-bf4d-80e348d41eef&#xA;Pipeline run with id=6caf14f2-7024-4cc7-bf4d-80e348d41eef is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6caf14f2-7024-4cc7-bf4d-80e348d41eef&#xA;Pipeline run with id=6caf14f2-7024-4cc7-bf4d-80e348d41eef is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6caf14f2-7024-4cc7-bf4d-80e348d41eef&#xA;Pipeline run with id=6caf14f2-7024-4cc7-bf4d-80e348d41eef is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6caf14f2-7024-4cc7-bf4d-80e348d41eef&#xA;Pipeline run with id=6caf14f2-7024-4cc7-bf4d-80e348d41eef is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6caf14f2-7024-4cc7-bf4d-80e348d41eef&#xA;Pipeline run with id=6caf14f2-7024-4cc7-bf4d-80e348d41eef is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6caf14f2-7024-4cc7-bf4d-80e348d41eef&#xA;Pipeline run with id=6caf14f2-7024-4cc7-bf4d-80e348d41eef is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6caf14f2-7024-4cc7-bf4d-80e348d41eef&#xA;Pipeline run with id=6caf14f2-7024-4cc7-bf4d-80e348d41eef is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6caf14f2-7024-4cc7-bf4d-80e348d41eef&#xA;Pipeline run with id=6caf14f2-7024-4cc7-bf4d-80e348d41eef is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6caf14f2-7024-4cc7-bf4d-80e348d41eef&#xA;Pipeline run with id=6caf14f2-7024-4cc7-bf4d-80e348d41eef is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6caf14f2-7024-4cc7-bf4d-80e348d41eef&#xA;Pipeline run with id=6caf14f2-7024-4cc7-bf4d-80e348d41eef is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6caf14f2-7024-4cc7-bf4d-80e348d41eef&#xA;Pipeline run with id=6caf14f2-7024-4cc7-bf4d-80e348d41eef is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6caf14f2-7024-4cc7-bf4d-80e348d41eef&#xA;Pipeline run with id=6caf14f2-7024-4cc7-bf4d-80e348d41eef is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6caf14f2-7024-4cc7-bf4d-80e348d41eef&#xA;Pipeline run with id=6caf14f2-7024-4cc7-bf4d-80e348d41eef is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6caf14f2-7024-4cc7-bf4d-80e348d41eef&#xA;Pipeline run with id=6caf14f2-7024-4cc7-bf4d-80e348d41eef is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6caf14f2-7024-4cc7-bf4d-80e348d41eef&#xA;Pipeline run with id=6caf14f2-7024-4cc7-bf4d-80e348d41eef is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6caf14f2-7024-4cc7-bf4d-80e348d41eef&#xA;Pipeline run with id=6caf14f2-7024-4cc7-bf4d-80e348d41eef is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6caf14f2-7024-4cc7-bf4d-80e348d41eef&#xA;Pipeline run with id=6caf14f2-7024-4cc7-bf4d-80e348d41eef is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6caf14f2-7024-4cc7-bf4d-80e348d41eef&#xA;Pipeline run with id=6caf14f2-7024-4cc7-bf4d-80e348d41eef is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6caf14f2-7024-4cc7-bf4d-80e348d41eef&#xA;Pipeline run with id=6caf14f2-7024-4cc7-bf4d-80e348d41eef is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6caf14f2-7024-4cc7-bf4d-80e348d41eef&#xA;Pipeline run with id=6caf14f2-7024-4cc7-bf4d-80e348d41eef is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6caf14f2-7024-4cc7-bf4d-80e348d41eef&#xA;Pipeline run with id=6caf14f2-7024-4cc7-bf4d-80e348d41eef reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;essential/iris_pipeline_compiled.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=6caf14f2-7024-4cc7-bf4d-80e348d41eef&#xA;Get a pipeline run with id=6caf14f2-7024-4cc7-bf4d-80e348d41eef&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/02/26 06:34:05.309 (2m35.712s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/02/26 06:34:05.309&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 6caf14f2-7024-4cc7-bf4d-80e348d41eef&#xA;Failed to terminate run 6caf14f2-7024-4cc7-bf4d-80e348d41eef&#xA;Terminate run 6caf14f2-7024-4cc7-bf4d-80e348d41eef&#xA;Deleting run 6caf14f2-7024-4cc7-bf4d-80e348d41eef&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=8b4a886b-96ef-43ee-8072-a6473fa63342 (cascade=true)&#xA;Pipeline with id=8b4a886b-96ef-43ee-8072-a6473fa63342, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/02/26 06:34:05.593 (284ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/02/26 06:34:05.594&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/02/26 06:34:05.594 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/02/26 06:34:05.594&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/02/26 06:34:05.594 (0s)&#xA;</system-err>
          </testcase>
      </testsuite>
  </testsuites>