<?xml version="1.0" encoding="UTF-8"?>
  <testsuites tests="5" disabled="0" errors="0" failures="0" time="157.436314713">
      <testsuite name="AIPipelinesE2ETests" package="/dspa/backend/test/end2end" tests="5" disabled="0" skipped="0" errors="0" failures="0" time="157.436314713" timestamp="2026-11-01T14:13:14">
          <properties>
              <property name="SuiteSucceeded" value="true"></property>
              <property name="SuiteHasProgrammaticFocus" value="false"></property>
              <property name="SpecialSuiteFailureReason" value=""></property>
              <property name="SuiteLabels" value="[]"></property>
              <property name="SuiteSemVerConstraints" value="[]"></property>
              <property name="RandomSeed" value="1793542235"></property>
              <property name="RandomizeAllSpecs" value="false"></property>
              <property name="LabelFilter" value="Smoke"></property>
              <property name="SemVerFilter" value=""></property>
              <property name="FocusStrings" value=""></property>
              <property name="SkipStrings" value=""></property>
              <property name="FocusFiles" value=""></property>
              <property name="SkipFiles" value=""></property>
              <property name="FailOnPending" value="false"></property>
              <property name="FailOnEmpty" value="false"></property>
              <property name="FailFast" value="false"></property>
              <property name="FlakeAttempts" value="0"></property>
              <property name="DryRun" value="false"></property>
              <property name="ParallelTotal" value="10"></property>
              <property name="OutputInterceptorMode" value=""></property>
          </properties>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload essential/component_with_pip_index_urls.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="46.881849638">
              <system-out>2026/11/01 14:14:02 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 11/01/26 14:13:15.173&#xA;Create an experiment with name E2EExperiment-1793542395174003953&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 11/01/26 14:13:15.458 (284ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 11/01/26 14:13:15.458&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x14a60a92f380&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 11/01/26 14:13:15.841 (383ms)&#xA;&gt; Enter [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 11/01/26 14:13:15.841&#xA;Uploading pipeline file essential/component_with_pip_index_urls.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1793542395458520891, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml&#xA;Upload of pipeline file &#39;essential/component_with_pip_index_urls.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 2abef8f9-0527-46bd-a374-5e1d5195b5e1&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;2abef8f9-0527-46bd-a374-5e1d5195b5e1&#39; and name: &#39;e2e-test-1793542395458520891&#39;&#xA;Create a pipeline run for pipeline with id=2abef8f9-0527-46bd-a374-5e1d5195b5e1 and versionId=c8544f95-4803-4535-bbfc-fac91c7183b4&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=6e5fdf40-6513-42cb-84ac-9af1b8844c9e&#xA;Created Pipeline Run with id: 6e5fdf40-6513-42cb-84ac-9af1b8844c9e for pipeline with id: 2abef8f9-0527-46bd-a374-5e1d5195b5e1&#xA;Waiting for pipeline run with id=6e5fdf40-6513-42cb-84ac-9af1b8844c9e to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=6e5fdf40-6513-42cb-84ac-9af1b8844c9e&#xA;Pipeline run with id=6e5fdf40-6513-42cb-84ac-9af1b8844c9e is in PENDING state, waiting...&#xA;Get a pipeline run with id=6e5fdf40-6513-42cb-84ac-9af1b8844c9e&#xA;Pipeline run with id=6e5fdf40-6513-42cb-84ac-9af1b8844c9e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6e5fdf40-6513-42cb-84ac-9af1b8844c9e&#xA;Pipeline run with id=6e5fdf40-6513-42cb-84ac-9af1b8844c9e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6e5fdf40-6513-42cb-84ac-9af1b8844c9e&#xA;Pipeline run with id=6e5fdf40-6513-42cb-84ac-9af1b8844c9e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6e5fdf40-6513-42cb-84ac-9af1b8844c9e&#xA;Pipeline run with id=6e5fdf40-6513-42cb-84ac-9af1b8844c9e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6e5fdf40-6513-42cb-84ac-9af1b8844c9e&#xA;Pipeline run with id=6e5fdf40-6513-42cb-84ac-9af1b8844c9e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6e5fdf40-6513-42cb-84ac-9af1b8844c9e&#xA;Pipeline run with id=6e5fdf40-6513-42cb-84ac-9af1b8844c9e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6e5fdf40-6513-42cb-84ac-9af1b8844c9e&#xA;Pipeline run with id=6e5fdf40-6513-42cb-84ac-9af1b8844c9e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6e5fdf40-6513-42cb-84ac-9af1b8844c9e&#xA;Pipeline run with id=6e5fdf40-6513-42cb-84ac-9af1b8844c9e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6e5fdf40-6513-42cb-84ac-9af1b8844c9e&#xA;Pipeline run with id=6e5fdf40-6513-42cb-84ac-9af1b8844c9e reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;essential/component_with_pip_index_urls.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=6e5fdf40-6513-42cb-84ac-9af1b8844c9e&#xA;Get a pipeline run with id=6e5fdf40-6513-42cb-84ac-9af1b8844c9e&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 11/01/26 14:14:01.59 (45.749s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 11/01/26 14:14:01.59&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 6e5fdf40-6513-42cb-84ac-9af1b8844c9e&#xA;Failed to terminate run 6e5fdf40-6513-42cb-84ac-9af1b8844c9e&#xA;Terminate run 6e5fdf40-6513-42cb-84ac-9af1b8844c9e&#xA;Deleting run 6e5fdf40-6513-42cb-84ac-9af1b8844c9e&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=2abef8f9-0527-46bd-a374-5e1d5195b5e1 (cascade=true)&#xA;Pipeline with id=2abef8f9-0527-46bd-a374-5e1d5195b5e1, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 11/01/26 14:14:02.055 (465ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 11/01/26 14:14:02.056&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 11/01/26 14:14:02.056 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 11/01/26 14:14:02.056&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 11/01/26 14:14:02.056 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/parallel_for_after_dependency.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="97.085717936">
              <system-out>2026/11/01 14:14:52 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 11/01/26 14:13:15.137&#xA;Create an experiment with name E2EExperiment-1793542395137420685&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 11/01/26 14:13:15.442 (305ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 11/01/26 14:13:15.442&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0xb8c28184800&#xA;test-secret-1 created&#xA;test-secret-2 created&#xA;test-secret-3 created&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 11/01/26 14:13:15.681 (239ms)&#xA;&gt; Enter [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 11/01/26 14:13:15.681&#xA;Uploading pipeline file critical/parallel_for_after_dependency.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1793542395442643950, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml&#xA;Upload of pipeline file &#39;critical/parallel_for_after_dependency.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 70f2256a-3585-4282-a0ed-2d9906f88ecc&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;70f2256a-3585-4282-a0ed-2d9906f88ecc&#39; and name: &#39;e2e-test-1793542395442643950&#39;&#xA;Create a pipeline run for pipeline with id=70f2256a-3585-4282-a0ed-2d9906f88ecc and versionId=35622264-d223-47fe-b84d-85b00fe8f9dc&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=a0e719e0-b5ea-4375-a603-f6391cb6013e&#xA;Created Pipeline Run with id: a0e719e0-b5ea-4375-a603-f6391cb6013e for pipeline with id: 70f2256a-3585-4282-a0ed-2d9906f88ecc&#xA;Waiting for pipeline run with id=a0e719e0-b5ea-4375-a603-f6391cb6013e to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=a0e719e0-b5ea-4375-a603-f6391cb6013e&#xA;Pipeline run with id=a0e719e0-b5ea-4375-a603-f6391cb6013e is in PENDING state, waiting...&#xA;Get a pipeline run with id=a0e719e0-b5ea-4375-a603-f6391cb6013e&#xA;Pipeline run with id=a0e719e0-b5ea-4375-a603-f6391cb6013e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=a0e719e0-b5ea-4375-a603-f6391cb6013e&#xA;Pipeline run with id=a0e719e0-b5ea-4375-a603-f6391cb6013e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=a0e719e0-b5ea-4375-a603-f6391cb6013e&#xA;Pipeline run with id=a0e719e0-b5ea-4375-a603-f6391cb6013e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=a0e719e0-b5ea-4375-a603-f6391cb6013e&#xA;Pipeline run with id=a0e719e0-b5ea-4375-a603-f6391cb6013e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=a0e719e0-b5ea-4375-a603-f6391cb6013e&#xA;Pipeline run with id=a0e719e0-b5ea-4375-a603-f6391cb6013e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=a0e719e0-b5ea-4375-a603-f6391cb6013e&#xA;Pipeline run with id=a0e719e0-b5ea-4375-a603-f6391cb6013e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=a0e719e0-b5ea-4375-a603-f6391cb6013e&#xA;Pipeline run with id=a0e719e0-b5ea-4375-a603-f6391cb6013e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=a0e719e0-b5ea-4375-a603-f6391cb6013e&#xA;Pipeline run with id=a0e719e0-b5ea-4375-a603-f6391cb6013e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=a0e719e0-b5ea-4375-a603-f6391cb6013e&#xA;Pipeline run with id=a0e719e0-b5ea-4375-a603-f6391cb6013e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=a0e719e0-b5ea-4375-a603-f6391cb6013e&#xA;Pipeline run with id=a0e719e0-b5ea-4375-a603-f6391cb6013e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=a0e719e0-b5ea-4375-a603-f6391cb6013e&#xA;Pipeline run with id=a0e719e0-b5ea-4375-a603-f6391cb6013e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=a0e719e0-b5ea-4375-a603-f6391cb6013e&#xA;Pipeline run with id=a0e719e0-b5ea-4375-a603-f6391cb6013e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=a0e719e0-b5ea-4375-a603-f6391cb6013e&#xA;Pipeline run with id=a0e719e0-b5ea-4375-a603-f6391cb6013e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=a0e719e0-b5ea-4375-a603-f6391cb6013e&#xA;Pipeline run with id=a0e719e0-b5ea-4375-a603-f6391cb6013e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=a0e719e0-b5ea-4375-a603-f6391cb6013e&#xA;Pipeline run with id=a0e719e0-b5ea-4375-a603-f6391cb6013e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=a0e719e0-b5ea-4375-a603-f6391cb6013e&#xA;Pipeline run with id=a0e719e0-b5ea-4375-a603-f6391cb6013e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=a0e719e0-b5ea-4375-a603-f6391cb6013e&#xA;Pipeline run with id=a0e719e0-b5ea-4375-a603-f6391cb6013e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=a0e719e0-b5ea-4375-a603-f6391cb6013e&#xA;Pipeline run with id=a0e719e0-b5ea-4375-a603-f6391cb6013e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=a0e719e0-b5ea-4375-a603-f6391cb6013e&#xA;Pipeline run with id=a0e719e0-b5ea-4375-a603-f6391cb6013e reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/parallel_for_after_dependency.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=a0e719e0-b5ea-4375-a603-f6391cb6013e&#xA;Get a pipeline run with id=a0e719e0-b5ea-4375-a603-f6391cb6013e&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 11/01/26 14:14:51.715 (1m36.034s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 11/01/26 14:14:51.715&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run a0e719e0-b5ea-4375-a603-f6391cb6013e&#xA;Failed to terminate run a0e719e0-b5ea-4375-a603-f6391cb6013e&#xA;Terminate run a0e719e0-b5ea-4375-a603-f6391cb6013e&#xA;Deleting run a0e719e0-b5ea-4375-a603-f6391cb6013e&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=70f2256a-3585-4282-a0ed-2d9906f88ecc (cascade=true)&#xA;Pipeline with id=70f2256a-3585-4282-a0ed-2d9906f88ecc, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 11/01/26 14:14:52.223 (507ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 11/01/26 14:14:52.223&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 11/01/26 14:14:52.223 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 11/01/26 14:14:52.223&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 11/01/26 14:14:52.223 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/pipeline_with_artifact_upload_download.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="102.016755398">
              <system-out>2026/11/01 14:14:57 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 11/01/26 14:13:15.172&#xA;Create an experiment with name E2EExperiment-1793542395172764851&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 11/01/26 14:13:15.446 (274ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 11/01/26 14:13:15.446&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x1394a9926180&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 11/01/26 14:13:15.866 (420ms)&#xA;&gt; Enter [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 11/01/26 14:13:15.866&#xA;Uploading pipeline file critical/pipeline_with_artifact_upload_download.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1793542395446604462, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml&#xA;Upload of pipeline file &#39;critical/pipeline_with_artifact_upload_download.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 9b6e24ab-3e91-49a5-bc83-ed920ba931a0&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;9b6e24ab-3e91-49a5-bc83-ed920ba931a0&#39; and name: &#39;e2e-test-1793542395446604462&#39;&#xA;Create a pipeline run for pipeline with id=9b6e24ab-3e91-49a5-bc83-ed920ba931a0 and versionId=6be5e1e8-8d6f-4f8f-9667-0a36eacfcbf7&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=0a272bf6-6ec4-4d7c-8e66-74be4cb262da&#xA;Created Pipeline Run with id: 0a272bf6-6ec4-4d7c-8e66-74be4cb262da for pipeline with id: 9b6e24ab-3e91-49a5-bc83-ed920ba931a0&#xA;Waiting for pipeline run with id=0a272bf6-6ec4-4d7c-8e66-74be4cb262da to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=0a272bf6-6ec4-4d7c-8e66-74be4cb262da&#xA;Pipeline run with id=0a272bf6-6ec4-4d7c-8e66-74be4cb262da is in PENDING state, waiting...&#xA;Get a pipeline run with id=0a272bf6-6ec4-4d7c-8e66-74be4cb262da&#xA;Pipeline run with id=0a272bf6-6ec4-4d7c-8e66-74be4cb262da is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0a272bf6-6ec4-4d7c-8e66-74be4cb262da&#xA;Pipeline run with id=0a272bf6-6ec4-4d7c-8e66-74be4cb262da is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0a272bf6-6ec4-4d7c-8e66-74be4cb262da&#xA;Pipeline run with id=0a272bf6-6ec4-4d7c-8e66-74be4cb262da is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0a272bf6-6ec4-4d7c-8e66-74be4cb262da&#xA;Pipeline run with id=0a272bf6-6ec4-4d7c-8e66-74be4cb262da is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0a272bf6-6ec4-4d7c-8e66-74be4cb262da&#xA;Pipeline run with id=0a272bf6-6ec4-4d7c-8e66-74be4cb262da is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0a272bf6-6ec4-4d7c-8e66-74be4cb262da&#xA;Pipeline run with id=0a272bf6-6ec4-4d7c-8e66-74be4cb262da is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0a272bf6-6ec4-4d7c-8e66-74be4cb262da&#xA;Pipeline run with id=0a272bf6-6ec4-4d7c-8e66-74be4cb262da is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0a272bf6-6ec4-4d7c-8e66-74be4cb262da&#xA;Pipeline run with id=0a272bf6-6ec4-4d7c-8e66-74be4cb262da is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0a272bf6-6ec4-4d7c-8e66-74be4cb262da&#xA;Pipeline run with id=0a272bf6-6ec4-4d7c-8e66-74be4cb262da is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0a272bf6-6ec4-4d7c-8e66-74be4cb262da&#xA;Pipeline run with id=0a272bf6-6ec4-4d7c-8e66-74be4cb262da is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0a272bf6-6ec4-4d7c-8e66-74be4cb262da&#xA;Pipeline run with id=0a272bf6-6ec4-4d7c-8e66-74be4cb262da is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0a272bf6-6ec4-4d7c-8e66-74be4cb262da&#xA;Pipeline run with id=0a272bf6-6ec4-4d7c-8e66-74be4cb262da is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0a272bf6-6ec4-4d7c-8e66-74be4cb262da&#xA;Pipeline run with id=0a272bf6-6ec4-4d7c-8e66-74be4cb262da is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0a272bf6-6ec4-4d7c-8e66-74be4cb262da&#xA;Pipeline run with id=0a272bf6-6ec4-4d7c-8e66-74be4cb262da is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0a272bf6-6ec4-4d7c-8e66-74be4cb262da&#xA;Pipeline run with id=0a272bf6-6ec4-4d7c-8e66-74be4cb262da is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0a272bf6-6ec4-4d7c-8e66-74be4cb262da&#xA;Pipeline run with id=0a272bf6-6ec4-4d7c-8e66-74be4cb262da is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0a272bf6-6ec4-4d7c-8e66-74be4cb262da&#xA;Pipeline run with id=0a272bf6-6ec4-4d7c-8e66-74be4cb262da is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0a272bf6-6ec4-4d7c-8e66-74be4cb262da&#xA;Pipeline run with id=0a272bf6-6ec4-4d7c-8e66-74be4cb262da is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0a272bf6-6ec4-4d7c-8e66-74be4cb262da&#xA;Pipeline run with id=0a272bf6-6ec4-4d7c-8e66-74be4cb262da is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0a272bf6-6ec4-4d7c-8e66-74be4cb262da&#xA;Pipeline run with id=0a272bf6-6ec4-4d7c-8e66-74be4cb262da reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/pipeline_with_artifact_upload_download.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=0a272bf6-6ec4-4d7c-8e66-74be4cb262da&#xA;Get a pipeline run with id=0a272bf6-6ec4-4d7c-8e66-74be4cb262da&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 11/01/26 14:14:56.708 (1m40.842s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 11/01/26 14:14:56.709&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 0a272bf6-6ec4-4d7c-8e66-74be4cb262da&#xA;Failed to terminate run 0a272bf6-6ec4-4d7c-8e66-74be4cb262da&#xA;Terminate run 0a272bf6-6ec4-4d7c-8e66-74be4cb262da&#xA;Deleting run 0a272bf6-6ec4-4d7c-8e66-74be4cb262da&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=9b6e24ab-3e91-49a5-bc83-ed920ba931a0 (cascade=true)&#xA;Pipeline with id=9b6e24ab-3e91-49a5-bc83-ed920ba931a0, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 11/01/26 14:14:57.189 (480ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 11/01/26 14:14:57.189&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 11/01/26 14:14:57.189 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 11/01/26 14:14:57.19&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 11/01/26 14:14:57.19 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/flip_coin.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="132.587838028">
              <system-out>2026/11/01 14:15:27 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 11/01/26 14:13:15.136&#xA;Create an experiment with name E2EExperiment-1793542395136888012&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 11/01/26 14:13:15.453 (317ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 11/01/26 14:13:15.453&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x6870765c780&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 11/01/26 14:13:15.917 (463ms)&#xA;&gt; Enter [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 11/01/26 14:13:15.917&#xA;Uploading pipeline file critical/flip_coin.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1793542395453856700, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml&#xA;Upload of pipeline file &#39;critical/flip_coin.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 86aca9d9-b036-4ad8-802c-644b1bea67b7&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;86aca9d9-b036-4ad8-802c-644b1bea67b7&#39; and name: &#39;e2e-test-1793542395453856700&#39;&#xA;Create a pipeline run for pipeline with id=86aca9d9-b036-4ad8-802c-644b1bea67b7 and versionId=6737e6fa-7276-4130-b8f5-300f384de649&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=cc04833e-3ef9-4359-9190-6d5c101d9753&#xA;Created Pipeline Run with id: cc04833e-3ef9-4359-9190-6d5c101d9753 for pipeline with id: 86aca9d9-b036-4ad8-802c-644b1bea67b7&#xA;Waiting for pipeline run with id=cc04833e-3ef9-4359-9190-6d5c101d9753 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=cc04833e-3ef9-4359-9190-6d5c101d9753&#xA;Pipeline run with id=cc04833e-3ef9-4359-9190-6d5c101d9753 is in PENDING state, waiting...&#xA;Get a pipeline run with id=cc04833e-3ef9-4359-9190-6d5c101d9753&#xA;Pipeline run with id=cc04833e-3ef9-4359-9190-6d5c101d9753 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=cc04833e-3ef9-4359-9190-6d5c101d9753&#xA;Pipeline run with id=cc04833e-3ef9-4359-9190-6d5c101d9753 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=cc04833e-3ef9-4359-9190-6d5c101d9753&#xA;Pipeline run with id=cc04833e-3ef9-4359-9190-6d5c101d9753 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=cc04833e-3ef9-4359-9190-6d5c101d9753&#xA;Pipeline run with id=cc04833e-3ef9-4359-9190-6d5c101d9753 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=cc04833e-3ef9-4359-9190-6d5c101d9753&#xA;Pipeline run with id=cc04833e-3ef9-4359-9190-6d5c101d9753 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=cc04833e-3ef9-4359-9190-6d5c101d9753&#xA;Pipeline run with id=cc04833e-3ef9-4359-9190-6d5c101d9753 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=cc04833e-3ef9-4359-9190-6d5c101d9753&#xA;Pipeline run with id=cc04833e-3ef9-4359-9190-6d5c101d9753 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=cc04833e-3ef9-4359-9190-6d5c101d9753&#xA;Pipeline run with id=cc04833e-3ef9-4359-9190-6d5c101d9753 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=cc04833e-3ef9-4359-9190-6d5c101d9753&#xA;Pipeline run with id=cc04833e-3ef9-4359-9190-6d5c101d9753 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=cc04833e-3ef9-4359-9190-6d5c101d9753&#xA;Pipeline run with id=cc04833e-3ef9-4359-9190-6d5c101d9753 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=cc04833e-3ef9-4359-9190-6d5c101d9753&#xA;Pipeline run with id=cc04833e-3ef9-4359-9190-6d5c101d9753 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=cc04833e-3ef9-4359-9190-6d5c101d9753&#xA;Pipeline run with id=cc04833e-3ef9-4359-9190-6d5c101d9753 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=cc04833e-3ef9-4359-9190-6d5c101d9753&#xA;Pipeline run with id=cc04833e-3ef9-4359-9190-6d5c101d9753 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=cc04833e-3ef9-4359-9190-6d5c101d9753&#xA;Pipeline run with id=cc04833e-3ef9-4359-9190-6d5c101d9753 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=cc04833e-3ef9-4359-9190-6d5c101d9753&#xA;Pipeline run with id=cc04833e-3ef9-4359-9190-6d5c101d9753 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=cc04833e-3ef9-4359-9190-6d5c101d9753&#xA;Pipeline run with id=cc04833e-3ef9-4359-9190-6d5c101d9753 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=cc04833e-3ef9-4359-9190-6d5c101d9753&#xA;Pipeline run with id=cc04833e-3ef9-4359-9190-6d5c101d9753 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=cc04833e-3ef9-4359-9190-6d5c101d9753&#xA;Pipeline run with id=cc04833e-3ef9-4359-9190-6d5c101d9753 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=cc04833e-3ef9-4359-9190-6d5c101d9753&#xA;Pipeline run with id=cc04833e-3ef9-4359-9190-6d5c101d9753 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=cc04833e-3ef9-4359-9190-6d5c101d9753&#xA;Pipeline run with id=cc04833e-3ef9-4359-9190-6d5c101d9753 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=cc04833e-3ef9-4359-9190-6d5c101d9753&#xA;Pipeline run with id=cc04833e-3ef9-4359-9190-6d5c101d9753 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=cc04833e-3ef9-4359-9190-6d5c101d9753&#xA;Pipeline run with id=cc04833e-3ef9-4359-9190-6d5c101d9753 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=cc04833e-3ef9-4359-9190-6d5c101d9753&#xA;Pipeline run with id=cc04833e-3ef9-4359-9190-6d5c101d9753 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=cc04833e-3ef9-4359-9190-6d5c101d9753&#xA;Pipeline run with id=cc04833e-3ef9-4359-9190-6d5c101d9753 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=cc04833e-3ef9-4359-9190-6d5c101d9753&#xA;Pipeline run with id=cc04833e-3ef9-4359-9190-6d5c101d9753 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=cc04833e-3ef9-4359-9190-6d5c101d9753&#xA;Pipeline run with id=cc04833e-3ef9-4359-9190-6d5c101d9753 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/flip_coin.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=cc04833e-3ef9-4359-9190-6d5c101d9753&#xA;Get a pipeline run with id=cc04833e-3ef9-4359-9190-6d5c101d9753&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 11/01/26 14:15:27.059 (2m11.142s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 11/01/26 14:15:27.059&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run cc04833e-3ef9-4359-9190-6d5c101d9753&#xA;Failed to terminate run cc04833e-3ef9-4359-9190-6d5c101d9753&#xA;Terminate run cc04833e-3ef9-4359-9190-6d5c101d9753&#xA;Deleting run cc04833e-3ef9-4359-9190-6d5c101d9753&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=86aca9d9-b036-4ad8-802c-644b1bea67b7 (cascade=true)&#xA;Pipeline with id=86aca9d9-b036-4ad8-802c-644b1bea67b7, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 11/01/26 14:15:27.724 (665ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 11/01/26 14:15:27.725&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 11/01/26 14:15:27.725 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 11/01/26 14:15:27.725&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 11/01/26 14:15:27.725 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload essential/iris_pipeline_compiled.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="157.122999399">
              <system-out>2026/11/01 14:15:52 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 11/01/26 14:13:15.175&#xA;Create an experiment with name E2EExperiment-1793542395175621495&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 11/01/26 14:13:15.452 (277ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 11/01/26 14:13:15.452&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0xdfe17d0480&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 11/01/26 14:13:15.87 (418ms)&#xA;&gt; Enter [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 11/01/26 14:13:15.87&#xA;Uploading pipeline file essential/iris_pipeline_compiled.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1793542395452874475, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml&#xA;Upload of pipeline file &#39;essential/iris_pipeline_compiled.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 7696626d-21ff-4731-85dc-a271e377d92e&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;7696626d-21ff-4731-85dc-a271e377d92e&#39; and name: &#39;e2e-test-1793542395452874475&#39;&#xA;Create a pipeline run for pipeline with id=7696626d-21ff-4731-85dc-a271e377d92e and versionId=6a18b951-da38-47ca-be83-623e493f588b&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=23437567-b46c-4377-aa48-873c8eb886c2&#xA;Created Pipeline Run with id: 23437567-b46c-4377-aa48-873c8eb886c2 for pipeline with id: 7696626d-21ff-4731-85dc-a271e377d92e&#xA;Waiting for pipeline run with id=23437567-b46c-4377-aa48-873c8eb886c2 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=23437567-b46c-4377-aa48-873c8eb886c2&#xA;Pipeline run with id=23437567-b46c-4377-aa48-873c8eb886c2 is in PENDING state, waiting...&#xA;Get a pipeline run with id=23437567-b46c-4377-aa48-873c8eb886c2&#xA;Pipeline run with id=23437567-b46c-4377-aa48-873c8eb886c2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=23437567-b46c-4377-aa48-873c8eb886c2&#xA;Pipeline run with id=23437567-b46c-4377-aa48-873c8eb886c2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=23437567-b46c-4377-aa48-873c8eb886c2&#xA;Pipeline run with id=23437567-b46c-4377-aa48-873c8eb886c2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=23437567-b46c-4377-aa48-873c8eb886c2&#xA;Pipeline run with id=23437567-b46c-4377-aa48-873c8eb886c2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=23437567-b46c-4377-aa48-873c8eb886c2&#xA;Pipeline run with id=23437567-b46c-4377-aa48-873c8eb886c2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=23437567-b46c-4377-aa48-873c8eb886c2&#xA;Pipeline run with id=23437567-b46c-4377-aa48-873c8eb886c2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=23437567-b46c-4377-aa48-873c8eb886c2&#xA;Pipeline run with id=23437567-b46c-4377-aa48-873c8eb886c2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=23437567-b46c-4377-aa48-873c8eb886c2&#xA;Pipeline run with id=23437567-b46c-4377-aa48-873c8eb886c2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=23437567-b46c-4377-aa48-873c8eb886c2&#xA;Pipeline run with id=23437567-b46c-4377-aa48-873c8eb886c2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=23437567-b46c-4377-aa48-873c8eb886c2&#xA;Pipeline run with id=23437567-b46c-4377-aa48-873c8eb886c2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=23437567-b46c-4377-aa48-873c8eb886c2&#xA;Pipeline run with id=23437567-b46c-4377-aa48-873c8eb886c2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=23437567-b46c-4377-aa48-873c8eb886c2&#xA;Pipeline run with id=23437567-b46c-4377-aa48-873c8eb886c2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=23437567-b46c-4377-aa48-873c8eb886c2&#xA;Pipeline run with id=23437567-b46c-4377-aa48-873c8eb886c2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=23437567-b46c-4377-aa48-873c8eb886c2&#xA;Pipeline run with id=23437567-b46c-4377-aa48-873c8eb886c2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=23437567-b46c-4377-aa48-873c8eb886c2&#xA;Pipeline run with id=23437567-b46c-4377-aa48-873c8eb886c2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=23437567-b46c-4377-aa48-873c8eb886c2&#xA;Pipeline run with id=23437567-b46c-4377-aa48-873c8eb886c2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=23437567-b46c-4377-aa48-873c8eb886c2&#xA;Pipeline run with id=23437567-b46c-4377-aa48-873c8eb886c2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=23437567-b46c-4377-aa48-873c8eb886c2&#xA;Pipeline run with id=23437567-b46c-4377-aa48-873c8eb886c2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=23437567-b46c-4377-aa48-873c8eb886c2&#xA;Pipeline run with id=23437567-b46c-4377-aa48-873c8eb886c2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=23437567-b46c-4377-aa48-873c8eb886c2&#xA;Pipeline run with id=23437567-b46c-4377-aa48-873c8eb886c2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=23437567-b46c-4377-aa48-873c8eb886c2&#xA;Pipeline run with id=23437567-b46c-4377-aa48-873c8eb886c2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=23437567-b46c-4377-aa48-873c8eb886c2&#xA;Pipeline run with id=23437567-b46c-4377-aa48-873c8eb886c2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=23437567-b46c-4377-aa48-873c8eb886c2&#xA;Pipeline run with id=23437567-b46c-4377-aa48-873c8eb886c2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=23437567-b46c-4377-aa48-873c8eb886c2&#xA;Pipeline run with id=23437567-b46c-4377-aa48-873c8eb886c2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=23437567-b46c-4377-aa48-873c8eb886c2&#xA;Pipeline run with id=23437567-b46c-4377-aa48-873c8eb886c2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=23437567-b46c-4377-aa48-873c8eb886c2&#xA;Pipeline run with id=23437567-b46c-4377-aa48-873c8eb886c2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=23437567-b46c-4377-aa48-873c8eb886c2&#xA;Pipeline run with id=23437567-b46c-4377-aa48-873c8eb886c2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=23437567-b46c-4377-aa48-873c8eb886c2&#xA;Pipeline run with id=23437567-b46c-4377-aa48-873c8eb886c2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=23437567-b46c-4377-aa48-873c8eb886c2&#xA;Pipeline run with id=23437567-b46c-4377-aa48-873c8eb886c2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=23437567-b46c-4377-aa48-873c8eb886c2&#xA;Pipeline run with id=23437567-b46c-4377-aa48-873c8eb886c2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=23437567-b46c-4377-aa48-873c8eb886c2&#xA;Pipeline run with id=23437567-b46c-4377-aa48-873c8eb886c2 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;essential/iris_pipeline_compiled.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=23437567-b46c-4377-aa48-873c8eb886c2&#xA;Get a pipeline run with id=23437567-b46c-4377-aa48-873c8eb886c2&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 11/01/26 14:15:51.749 (2m35.879s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 11/01/26 14:15:51.749&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 23437567-b46c-4377-aa48-873c8eb886c2&#xA;Failed to terminate run 23437567-b46c-4377-aa48-873c8eb886c2&#xA;Terminate run 23437567-b46c-4377-aa48-873c8eb886c2&#xA;Deleting run 23437567-b46c-4377-aa48-873c8eb886c2&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=7696626d-21ff-4731-85dc-a271e377d92e (cascade=true)&#xA;Pipeline with id=7696626d-21ff-4731-85dc-a271e377d92e, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 11/01/26 14:15:52.298 (549ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 11/01/26 14:15:52.298&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 11/01/26 14:15:52.298 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 11/01/26 14:15:52.299&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 11/01/26 14:15:52.299 (0s)&#xA;</system-err>
          </testcase>
      </testsuite>
  </testsuites>