<?xml version="1.0" encoding="UTF-8"?>
  <testsuites tests="5" disabled="0" errors="0" failures="0" time="156.51145795">
      <testsuite name="AIPipelinesE2ETests" package="/dspa/backend/test/end2end" tests="5" disabled="0" skipped="0" errors="0" failures="0" time="156.51145795" timestamp="2026-07-07T16:42:58">
          <properties>
              <property name="SuiteSucceeded" value="true"></property>
              <property name="SuiteHasProgrammaticFocus" value="false"></property>
              <property name="SpecialSuiteFailureReason" value=""></property>
              <property name="SuiteLabels" value="[]"></property>
              <property name="SuiteSemVerConstraints" value="[]"></property>
              <property name="RandomSeed" value="1783442405"></property>
              <property name="RandomizeAllSpecs" value="false"></property>
              <property name="LabelFilter" value="Smoke"></property>
              <property name="SemVerFilter" value=""></property>
              <property name="FocusStrings" value=""></property>
              <property name="SkipStrings" value=""></property>
              <property name="FocusFiles" value=""></property>
              <property name="SkipFiles" value=""></property>
              <property name="FailOnPending" value="false"></property>
              <property name="FailOnEmpty" value="false"></property>
              <property name="FailFast" value="false"></property>
              <property name="FlakeAttempts" value="0"></property>
              <property name="DryRun" value="false"></property>
              <property name="ParallelTotal" value="10"></property>
              <property name="OutputInterceptorMode" value=""></property>
          </properties>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload essential/component_with_pip_index_urls.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="46.117241813">
              <system-out>2026/07/07 16:43:44 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/07/26 16:42:58.75&#xA;Create an experiment with name E2EExperiment-1783442578750775953&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/07/26 16:42:59.229 (479ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/07/26 16:42:59.229&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0xd4eefa2e200&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/07/26 16:42:59.347 (118ms)&#xA;&gt; Enter [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/07/26 16:42:59.347&#xA;Uploading pipeline file essential/component_with_pip_index_urls.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1783442579229827317, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml&#xA;Upload of pipeline file &#39;essential/component_with_pip_index_urls.yaml&#39; successful&#xA;Listing pipeline versions for pipeline afac297d-0d9a-4348-9f66-64e468c80f73&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;afac297d-0d9a-4348-9f66-64e468c80f73&#39; and name: &#39;e2e-test-1783442579229827317&#39;&#xA;Create a pipeline run for pipeline with id=afac297d-0d9a-4348-9f66-64e468c80f73 and versionId=7f7ef009-3dff-40d8-b3ab-6b16e75bf97a&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=b22f0edc-4a07-47f6-97cf-d5adac0b17ff&#xA;Created Pipeline Run with id: b22f0edc-4a07-47f6-97cf-d5adac0b17ff for pipeline with id: afac297d-0d9a-4348-9f66-64e468c80f73&#xA;Waiting for pipeline run with id=b22f0edc-4a07-47f6-97cf-d5adac0b17ff to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=b22f0edc-4a07-47f6-97cf-d5adac0b17ff&#xA;Pipeline run with id=b22f0edc-4a07-47f6-97cf-d5adac0b17ff is in PENDING state, waiting...&#xA;Get a pipeline run with id=b22f0edc-4a07-47f6-97cf-d5adac0b17ff&#xA;Pipeline run with id=b22f0edc-4a07-47f6-97cf-d5adac0b17ff is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b22f0edc-4a07-47f6-97cf-d5adac0b17ff&#xA;Pipeline run with id=b22f0edc-4a07-47f6-97cf-d5adac0b17ff is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b22f0edc-4a07-47f6-97cf-d5adac0b17ff&#xA;Pipeline run with id=b22f0edc-4a07-47f6-97cf-d5adac0b17ff is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b22f0edc-4a07-47f6-97cf-d5adac0b17ff&#xA;Pipeline run with id=b22f0edc-4a07-47f6-97cf-d5adac0b17ff is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b22f0edc-4a07-47f6-97cf-d5adac0b17ff&#xA;Pipeline run with id=b22f0edc-4a07-47f6-97cf-d5adac0b17ff is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b22f0edc-4a07-47f6-97cf-d5adac0b17ff&#xA;Pipeline run with id=b22f0edc-4a07-47f6-97cf-d5adac0b17ff is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b22f0edc-4a07-47f6-97cf-d5adac0b17ff&#xA;Pipeline run with id=b22f0edc-4a07-47f6-97cf-d5adac0b17ff is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b22f0edc-4a07-47f6-97cf-d5adac0b17ff&#xA;Pipeline run with id=b22f0edc-4a07-47f6-97cf-d5adac0b17ff is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b22f0edc-4a07-47f6-97cf-d5adac0b17ff&#xA;Pipeline run with id=b22f0edc-4a07-47f6-97cf-d5adac0b17ff reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;essential/component_with_pip_index_urls.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=b22f0edc-4a07-47f6-97cf-d5adac0b17ff&#xA;Get a pipeline run with id=b22f0edc-4a07-47f6-97cf-d5adac0b17ff&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/07/26 16:43:44.656 (45.309s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/07/26 16:43:44.656&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run b22f0edc-4a07-47f6-97cf-d5adac0b17ff&#xA;Failed to terminate run b22f0edc-4a07-47f6-97cf-d5adac0b17ff&#xA;Terminate run b22f0edc-4a07-47f6-97cf-d5adac0b17ff&#xA;Deleting run b22f0edc-4a07-47f6-97cf-d5adac0b17ff&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=afac297d-0d9a-4348-9f66-64e468c80f73 (cascade=true)&#xA;Pipeline with id=afac297d-0d9a-4348-9f66-64e468c80f73, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/07/26 16:43:44.867 (211ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/07/26 16:43:44.868&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/07/26 16:43:44.868 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/07/26 16:43:44.868&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/07/26 16:43:44.868 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/pipeline_with_artifact_upload_download.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="96.164586826">
              <system-out>2026/07/07 16:44:34 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/07/26 16:42:58.75&#xA;Create an experiment with name E2EExperiment-1783442578750835034&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/07/26 16:42:59.205 (455ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/07/26 16:42:59.205&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x18edfba2c500&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/07/26 16:42:59.336 (131ms)&#xA;&gt; Enter [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/07/26 16:42:59.337&#xA;Uploading pipeline file critical/pipeline_with_artifact_upload_download.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1783442579205689602, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml&#xA;Upload of pipeline file &#39;critical/pipeline_with_artifact_upload_download.yaml&#39; successful&#xA;Listing pipeline versions for pipeline fa3d6ee0-3cdc-4292-ae23-0af2e298825f&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;fa3d6ee0-3cdc-4292-ae23-0af2e298825f&#39; and name: &#39;e2e-test-1783442579205689602&#39;&#xA;Create a pipeline run for pipeline with id=fa3d6ee0-3cdc-4292-ae23-0af2e298825f and versionId=e7bee715-dec0-4c2e-ba32-a76d12ba76f8&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=97847e90-e5e8-47d3-bc85-4e09be14cac2&#xA;Created Pipeline Run with id: 97847e90-e5e8-47d3-bc85-4e09be14cac2 for pipeline with id: fa3d6ee0-3cdc-4292-ae23-0af2e298825f&#xA;Waiting for pipeline run with id=97847e90-e5e8-47d3-bc85-4e09be14cac2 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=97847e90-e5e8-47d3-bc85-4e09be14cac2&#xA;Pipeline run with id=97847e90-e5e8-47d3-bc85-4e09be14cac2 is in PENDING state, waiting...&#xA;Get a pipeline run with id=97847e90-e5e8-47d3-bc85-4e09be14cac2&#xA;Pipeline run with id=97847e90-e5e8-47d3-bc85-4e09be14cac2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=97847e90-e5e8-47d3-bc85-4e09be14cac2&#xA;Pipeline run with id=97847e90-e5e8-47d3-bc85-4e09be14cac2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=97847e90-e5e8-47d3-bc85-4e09be14cac2&#xA;Pipeline run with id=97847e90-e5e8-47d3-bc85-4e09be14cac2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=97847e90-e5e8-47d3-bc85-4e09be14cac2&#xA;Pipeline run with id=97847e90-e5e8-47d3-bc85-4e09be14cac2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=97847e90-e5e8-47d3-bc85-4e09be14cac2&#xA;Pipeline run with id=97847e90-e5e8-47d3-bc85-4e09be14cac2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=97847e90-e5e8-47d3-bc85-4e09be14cac2&#xA;Pipeline run with id=97847e90-e5e8-47d3-bc85-4e09be14cac2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=97847e90-e5e8-47d3-bc85-4e09be14cac2&#xA;Pipeline run with id=97847e90-e5e8-47d3-bc85-4e09be14cac2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=97847e90-e5e8-47d3-bc85-4e09be14cac2&#xA;Pipeline run with id=97847e90-e5e8-47d3-bc85-4e09be14cac2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=97847e90-e5e8-47d3-bc85-4e09be14cac2&#xA;Pipeline run with id=97847e90-e5e8-47d3-bc85-4e09be14cac2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=97847e90-e5e8-47d3-bc85-4e09be14cac2&#xA;Pipeline run with id=97847e90-e5e8-47d3-bc85-4e09be14cac2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=97847e90-e5e8-47d3-bc85-4e09be14cac2&#xA;Pipeline run with id=97847e90-e5e8-47d3-bc85-4e09be14cac2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=97847e90-e5e8-47d3-bc85-4e09be14cac2&#xA;Pipeline run with id=97847e90-e5e8-47d3-bc85-4e09be14cac2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=97847e90-e5e8-47d3-bc85-4e09be14cac2&#xA;Pipeline run with id=97847e90-e5e8-47d3-bc85-4e09be14cac2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=97847e90-e5e8-47d3-bc85-4e09be14cac2&#xA;Pipeline run with id=97847e90-e5e8-47d3-bc85-4e09be14cac2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=97847e90-e5e8-47d3-bc85-4e09be14cac2&#xA;Pipeline run with id=97847e90-e5e8-47d3-bc85-4e09be14cac2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=97847e90-e5e8-47d3-bc85-4e09be14cac2&#xA;Pipeline run with id=97847e90-e5e8-47d3-bc85-4e09be14cac2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=97847e90-e5e8-47d3-bc85-4e09be14cac2&#xA;Pipeline run with id=97847e90-e5e8-47d3-bc85-4e09be14cac2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=97847e90-e5e8-47d3-bc85-4e09be14cac2&#xA;Pipeline run with id=97847e90-e5e8-47d3-bc85-4e09be14cac2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=97847e90-e5e8-47d3-bc85-4e09be14cac2&#xA;Pipeline run with id=97847e90-e5e8-47d3-bc85-4e09be14cac2 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/pipeline_with_artifact_upload_download.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=97847e90-e5e8-47d3-bc85-4e09be14cac2&#xA;Get a pipeline run with id=97847e90-e5e8-47d3-bc85-4e09be14cac2&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/07/26 16:44:34.703 (1m35.367s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/07/26 16:44:34.704&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 97847e90-e5e8-47d3-bc85-4e09be14cac2&#xA;Failed to terminate run 97847e90-e5e8-47d3-bc85-4e09be14cac2&#xA;Terminate run 97847e90-e5e8-47d3-bc85-4e09be14cac2&#xA;Deleting run 97847e90-e5e8-47d3-bc85-4e09be14cac2&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=fa3d6ee0-3cdc-4292-ae23-0af2e298825f (cascade=true)&#xA;Pipeline with id=fa3d6ee0-3cdc-4292-ae23-0af2e298825f, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/07/26 16:44:34.915 (211ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/07/26 16:44:34.915&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/07/26 16:44:34.915 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/07/26 16:44:34.915&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/07/26 16:44:34.915 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/parallel_for_after_dependency.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="101.60335581">
              <system-out>2026/07/07 16:44:40 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/07/26 16:42:58.75&#xA;Create an experiment with name E2EExperiment-1783442578750457975&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/07/26 16:42:59.012 (262ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/07/26 16:42:59.012&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x1748d67a0100&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/07/26 16:42:59.129 (117ms)&#xA;&gt; Enter [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/07/26 16:42:59.129&#xA;Uploading pipeline file critical/parallel_for_after_dependency.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1783442579012240334, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml&#xA;Upload of pipeline file &#39;critical/parallel_for_after_dependency.yaml&#39; successful&#xA;Listing pipeline versions for pipeline b195d7ea-17bf-48a3-9341-44110d9a55d7&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;b195d7ea-17bf-48a3-9341-44110d9a55d7&#39; and name: &#39;e2e-test-1783442579012240334&#39;&#xA;Create a pipeline run for pipeline with id=b195d7ea-17bf-48a3-9341-44110d9a55d7 and versionId=034228e3-c343-4c27-a82c-76d7ffe9d4b9&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=d37cecb2-c58e-4076-8b9c-91abfa214716&#xA;Created Pipeline Run with id: d37cecb2-c58e-4076-8b9c-91abfa214716 for pipeline with id: b195d7ea-17bf-48a3-9341-44110d9a55d7&#xA;Waiting for pipeline run with id=d37cecb2-c58e-4076-8b9c-91abfa214716 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=d37cecb2-c58e-4076-8b9c-91abfa214716&#xA;Pipeline run with id=d37cecb2-c58e-4076-8b9c-91abfa214716 is in PENDING state, waiting...&#xA;Get a pipeline run with id=d37cecb2-c58e-4076-8b9c-91abfa214716&#xA;Pipeline run with id=d37cecb2-c58e-4076-8b9c-91abfa214716 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d37cecb2-c58e-4076-8b9c-91abfa214716&#xA;Pipeline run with id=d37cecb2-c58e-4076-8b9c-91abfa214716 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d37cecb2-c58e-4076-8b9c-91abfa214716&#xA;Pipeline run with id=d37cecb2-c58e-4076-8b9c-91abfa214716 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d37cecb2-c58e-4076-8b9c-91abfa214716&#xA;Pipeline run with id=d37cecb2-c58e-4076-8b9c-91abfa214716 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d37cecb2-c58e-4076-8b9c-91abfa214716&#xA;Pipeline run with id=d37cecb2-c58e-4076-8b9c-91abfa214716 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d37cecb2-c58e-4076-8b9c-91abfa214716&#xA;Pipeline run with id=d37cecb2-c58e-4076-8b9c-91abfa214716 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d37cecb2-c58e-4076-8b9c-91abfa214716&#xA;Pipeline run with id=d37cecb2-c58e-4076-8b9c-91abfa214716 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d37cecb2-c58e-4076-8b9c-91abfa214716&#xA;Pipeline run with id=d37cecb2-c58e-4076-8b9c-91abfa214716 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d37cecb2-c58e-4076-8b9c-91abfa214716&#xA;Pipeline run with id=d37cecb2-c58e-4076-8b9c-91abfa214716 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d37cecb2-c58e-4076-8b9c-91abfa214716&#xA;Pipeline run with id=d37cecb2-c58e-4076-8b9c-91abfa214716 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d37cecb2-c58e-4076-8b9c-91abfa214716&#xA;Pipeline run with id=d37cecb2-c58e-4076-8b9c-91abfa214716 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d37cecb2-c58e-4076-8b9c-91abfa214716&#xA;Pipeline run with id=d37cecb2-c58e-4076-8b9c-91abfa214716 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d37cecb2-c58e-4076-8b9c-91abfa214716&#xA;Pipeline run with id=d37cecb2-c58e-4076-8b9c-91abfa214716 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d37cecb2-c58e-4076-8b9c-91abfa214716&#xA;Pipeline run with id=d37cecb2-c58e-4076-8b9c-91abfa214716 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d37cecb2-c58e-4076-8b9c-91abfa214716&#xA;Pipeline run with id=d37cecb2-c58e-4076-8b9c-91abfa214716 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d37cecb2-c58e-4076-8b9c-91abfa214716&#xA;Pipeline run with id=d37cecb2-c58e-4076-8b9c-91abfa214716 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d37cecb2-c58e-4076-8b9c-91abfa214716&#xA;Pipeline run with id=d37cecb2-c58e-4076-8b9c-91abfa214716 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d37cecb2-c58e-4076-8b9c-91abfa214716&#xA;Pipeline run with id=d37cecb2-c58e-4076-8b9c-91abfa214716 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d37cecb2-c58e-4076-8b9c-91abfa214716&#xA;Pipeline run with id=d37cecb2-c58e-4076-8b9c-91abfa214716 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d37cecb2-c58e-4076-8b9c-91abfa214716&#xA;Pipeline run with id=d37cecb2-c58e-4076-8b9c-91abfa214716 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/parallel_for_after_dependency.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=d37cecb2-c58e-4076-8b9c-91abfa214716&#xA;Get a pipeline run with id=d37cecb2-c58e-4076-8b9c-91abfa214716&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/07/26 16:44:40.006 (1m40.877s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/07/26 16:44:40.006&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run d37cecb2-c58e-4076-8b9c-91abfa214716&#xA;Failed to terminate run d37cecb2-c58e-4076-8b9c-91abfa214716&#xA;Terminate run d37cecb2-c58e-4076-8b9c-91abfa214716&#xA;Deleting run d37cecb2-c58e-4076-8b9c-91abfa214716&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=b195d7ea-17bf-48a3-9341-44110d9a55d7 (cascade=true)&#xA;Pipeline with id=b195d7ea-17bf-48a3-9341-44110d9a55d7, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/07/26 16:44:40.353 (347ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/07/26 16:44:40.353&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/07/26 16:44:40.353 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/07/26 16:44:40.353&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/07/26 16:44:40.353 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/flip_coin.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="131.570050761">
              <system-out>2026/07/07 16:45:10 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/07/26 16:42:58.75&#xA;Create an experiment with name E2EExperiment-1783442578750496526&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/07/26 16:42:59.2 (450ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/07/26 16:42:59.2&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x41c2dc20680&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/07/26 16:42:59.346 (146ms)&#xA;&gt; Enter [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/07/26 16:42:59.346&#xA;Uploading pipeline file critical/flip_coin.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1783442579200242624, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml&#xA;Upload of pipeline file &#39;critical/flip_coin.yaml&#39; successful&#xA;Listing pipeline versions for pipeline c25c935a-3180-49fc-aa87-2de090f000af&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;c25c935a-3180-49fc-aa87-2de090f000af&#39; and name: &#39;e2e-test-1783442579200242624&#39;&#xA;Create a pipeline run for pipeline with id=c25c935a-3180-49fc-aa87-2de090f000af and versionId=6fa1cdc6-c9c7-4d59-b077-44f073f54830&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=30fff0d9-5ce9-48e1-8795-a3e292a6d9ef&#xA;Created Pipeline Run with id: 30fff0d9-5ce9-48e1-8795-a3e292a6d9ef for pipeline with id: c25c935a-3180-49fc-aa87-2de090f000af&#xA;Waiting for pipeline run with id=30fff0d9-5ce9-48e1-8795-a3e292a6d9ef to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=30fff0d9-5ce9-48e1-8795-a3e292a6d9ef&#xA;Pipeline run with id=30fff0d9-5ce9-48e1-8795-a3e292a6d9ef is in PENDING state, waiting...&#xA;Get a pipeline run with id=30fff0d9-5ce9-48e1-8795-a3e292a6d9ef&#xA;Pipeline run with id=30fff0d9-5ce9-48e1-8795-a3e292a6d9ef is in RUNNING state, waiting...&#xA;Get a pipeline run with id=30fff0d9-5ce9-48e1-8795-a3e292a6d9ef&#xA;Pipeline run with id=30fff0d9-5ce9-48e1-8795-a3e292a6d9ef is in RUNNING state, waiting...&#xA;Get a pipeline run with id=30fff0d9-5ce9-48e1-8795-a3e292a6d9ef&#xA;Pipeline run with id=30fff0d9-5ce9-48e1-8795-a3e292a6d9ef is in RUNNING state, waiting...&#xA;Get a pipeline run with id=30fff0d9-5ce9-48e1-8795-a3e292a6d9ef&#xA;Pipeline run with id=30fff0d9-5ce9-48e1-8795-a3e292a6d9ef is in RUNNING state, waiting...&#xA;Get a pipeline run with id=30fff0d9-5ce9-48e1-8795-a3e292a6d9ef&#xA;Pipeline run with id=30fff0d9-5ce9-48e1-8795-a3e292a6d9ef is in RUNNING state, waiting...&#xA;Get a pipeline run with id=30fff0d9-5ce9-48e1-8795-a3e292a6d9ef&#xA;Pipeline run with id=30fff0d9-5ce9-48e1-8795-a3e292a6d9ef is in RUNNING state, waiting...&#xA;Get a pipeline run with id=30fff0d9-5ce9-48e1-8795-a3e292a6d9ef&#xA;Pipeline run with id=30fff0d9-5ce9-48e1-8795-a3e292a6d9ef is in RUNNING state, waiting...&#xA;Get a pipeline run with id=30fff0d9-5ce9-48e1-8795-a3e292a6d9ef&#xA;Pipeline run with id=30fff0d9-5ce9-48e1-8795-a3e292a6d9ef is in RUNNING state, waiting...&#xA;Get a pipeline run with id=30fff0d9-5ce9-48e1-8795-a3e292a6d9ef&#xA;Pipeline run with id=30fff0d9-5ce9-48e1-8795-a3e292a6d9ef is in RUNNING state, waiting...&#xA;Get a pipeline run with id=30fff0d9-5ce9-48e1-8795-a3e292a6d9ef&#xA;Pipeline run with id=30fff0d9-5ce9-48e1-8795-a3e292a6d9ef is in RUNNING state, waiting...&#xA;Get a pipeline run with id=30fff0d9-5ce9-48e1-8795-a3e292a6d9ef&#xA;Pipeline run with id=30fff0d9-5ce9-48e1-8795-a3e292a6d9ef is in RUNNING state, waiting...&#xA;Get a pipeline run with id=30fff0d9-5ce9-48e1-8795-a3e292a6d9ef&#xA;Pipeline run with id=30fff0d9-5ce9-48e1-8795-a3e292a6d9ef is in RUNNING state, waiting...&#xA;Get a pipeline run with id=30fff0d9-5ce9-48e1-8795-a3e292a6d9ef&#xA;Pipeline run with id=30fff0d9-5ce9-48e1-8795-a3e292a6d9ef is in RUNNING state, waiting...&#xA;Get a pipeline run with id=30fff0d9-5ce9-48e1-8795-a3e292a6d9ef&#xA;Pipeline run with id=30fff0d9-5ce9-48e1-8795-a3e292a6d9ef is in RUNNING state, waiting...&#xA;Get a pipeline run with id=30fff0d9-5ce9-48e1-8795-a3e292a6d9ef&#xA;Pipeline run with id=30fff0d9-5ce9-48e1-8795-a3e292a6d9ef is in RUNNING state, waiting...&#xA;Get a pipeline run with id=30fff0d9-5ce9-48e1-8795-a3e292a6d9ef&#xA;Pipeline run with id=30fff0d9-5ce9-48e1-8795-a3e292a6d9ef is in RUNNING state, waiting...&#xA;Get a pipeline run with id=30fff0d9-5ce9-48e1-8795-a3e292a6d9ef&#xA;Pipeline run with id=30fff0d9-5ce9-48e1-8795-a3e292a6d9ef is in RUNNING state, waiting...&#xA;Get a pipeline run with id=30fff0d9-5ce9-48e1-8795-a3e292a6d9ef&#xA;Pipeline run with id=30fff0d9-5ce9-48e1-8795-a3e292a6d9ef is in RUNNING state, waiting...&#xA;Get a pipeline run with id=30fff0d9-5ce9-48e1-8795-a3e292a6d9ef&#xA;Pipeline run with id=30fff0d9-5ce9-48e1-8795-a3e292a6d9ef is in RUNNING state, waiting...&#xA;Get a pipeline run with id=30fff0d9-5ce9-48e1-8795-a3e292a6d9ef&#xA;Pipeline run with id=30fff0d9-5ce9-48e1-8795-a3e292a6d9ef is in RUNNING state, waiting...&#xA;Get a pipeline run with id=30fff0d9-5ce9-48e1-8795-a3e292a6d9ef&#xA;Pipeline run with id=30fff0d9-5ce9-48e1-8795-a3e292a6d9ef is in RUNNING state, waiting...&#xA;Get a pipeline run with id=30fff0d9-5ce9-48e1-8795-a3e292a6d9ef&#xA;Pipeline run with id=30fff0d9-5ce9-48e1-8795-a3e292a6d9ef is in RUNNING state, waiting...&#xA;Get a pipeline run with id=30fff0d9-5ce9-48e1-8795-a3e292a6d9ef&#xA;Pipeline run with id=30fff0d9-5ce9-48e1-8795-a3e292a6d9ef is in RUNNING state, waiting...&#xA;Get a pipeline run with id=30fff0d9-5ce9-48e1-8795-a3e292a6d9ef&#xA;Pipeline run with id=30fff0d9-5ce9-48e1-8795-a3e292a6d9ef is in RUNNING state, waiting...&#xA;Get a pipeline run with id=30fff0d9-5ce9-48e1-8795-a3e292a6d9ef&#xA;Pipeline run with id=30fff0d9-5ce9-48e1-8795-a3e292a6d9ef is in RUNNING state, waiting...&#xA;Get a pipeline run with id=30fff0d9-5ce9-48e1-8795-a3e292a6d9ef&#xA;Pipeline run with id=30fff0d9-5ce9-48e1-8795-a3e292a6d9ef reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/flip_coin.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=30fff0d9-5ce9-48e1-8795-a3e292a6d9ef&#xA;Get a pipeline run with id=30fff0d9-5ce9-48e1-8795-a3e292a6d9ef&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/07/26 16:45:09.983 (2m10.637s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/07/26 16:45:09.984&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 30fff0d9-5ce9-48e1-8795-a3e292a6d9ef&#xA;Failed to terminate run 30fff0d9-5ce9-48e1-8795-a3e292a6d9ef&#xA;Terminate run 30fff0d9-5ce9-48e1-8795-a3e292a6d9ef&#xA;Deleting run 30fff0d9-5ce9-48e1-8795-a3e292a6d9ef&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=c25c935a-3180-49fc-aa87-2de090f000af (cascade=true)&#xA;Pipeline with id=c25c935a-3180-49fc-aa87-2de090f000af, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/07/26 16:45:10.32 (336ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/07/26 16:45:10.32&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/07/26 16:45:10.32 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/07/26 16:45:10.32&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/07/26 16:45:10.32 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload essential/iris_pipeline_compiled.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="156.306636945">
              <system-out>2026/07/07 16:45:35 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/07/26 16:42:58.75&#xA;Create an experiment with name E2EExperiment-1783442578750640049&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/07/26 16:42:59.01 (259ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/07/26 16:42:59.01&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x2fdb72162680&#xA;test-secret-1 created&#xA;test-secret-2 created&#xA;test-secret-3 created&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/07/26 16:42:59.087 (77ms)&#xA;&gt; Enter [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/07/26 16:42:59.087&#xA;Uploading pipeline file essential/iris_pipeline_compiled.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1783442579010342099, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml&#xA;Upload of pipeline file &#39;essential/iris_pipeline_compiled.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 6a74f886-628a-43c3-b320-3f0595a40719&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;6a74f886-628a-43c3-b320-3f0595a40719&#39; and name: &#39;e2e-test-1783442579010342099&#39;&#xA;Create a pipeline run for pipeline with id=6a74f886-628a-43c3-b320-3f0595a40719 and versionId=6da26447-01c2-495a-adb8-9d400e9db2ad&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=6b71371e-1663-427e-ad74-340df95026e0&#xA;Created Pipeline Run with id: 6b71371e-1663-427e-ad74-340df95026e0 for pipeline with id: 6a74f886-628a-43c3-b320-3f0595a40719&#xA;Waiting for pipeline run with id=6b71371e-1663-427e-ad74-340df95026e0 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=6b71371e-1663-427e-ad74-340df95026e0&#xA;Pipeline run with id=6b71371e-1663-427e-ad74-340df95026e0 is in PENDING state, waiting...&#xA;Get a pipeline run with id=6b71371e-1663-427e-ad74-340df95026e0&#xA;Pipeline run with id=6b71371e-1663-427e-ad74-340df95026e0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6b71371e-1663-427e-ad74-340df95026e0&#xA;Pipeline run with id=6b71371e-1663-427e-ad74-340df95026e0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6b71371e-1663-427e-ad74-340df95026e0&#xA;Pipeline run with id=6b71371e-1663-427e-ad74-340df95026e0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6b71371e-1663-427e-ad74-340df95026e0&#xA;Pipeline run with id=6b71371e-1663-427e-ad74-340df95026e0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6b71371e-1663-427e-ad74-340df95026e0&#xA;Pipeline run with id=6b71371e-1663-427e-ad74-340df95026e0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6b71371e-1663-427e-ad74-340df95026e0&#xA;Pipeline run with id=6b71371e-1663-427e-ad74-340df95026e0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6b71371e-1663-427e-ad74-340df95026e0&#xA;Pipeline run with id=6b71371e-1663-427e-ad74-340df95026e0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6b71371e-1663-427e-ad74-340df95026e0&#xA;Pipeline run with id=6b71371e-1663-427e-ad74-340df95026e0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6b71371e-1663-427e-ad74-340df95026e0&#xA;Pipeline run with id=6b71371e-1663-427e-ad74-340df95026e0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6b71371e-1663-427e-ad74-340df95026e0&#xA;Pipeline run with id=6b71371e-1663-427e-ad74-340df95026e0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6b71371e-1663-427e-ad74-340df95026e0&#xA;Pipeline run with id=6b71371e-1663-427e-ad74-340df95026e0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6b71371e-1663-427e-ad74-340df95026e0&#xA;Pipeline run with id=6b71371e-1663-427e-ad74-340df95026e0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6b71371e-1663-427e-ad74-340df95026e0&#xA;Pipeline run with id=6b71371e-1663-427e-ad74-340df95026e0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6b71371e-1663-427e-ad74-340df95026e0&#xA;Pipeline run with id=6b71371e-1663-427e-ad74-340df95026e0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6b71371e-1663-427e-ad74-340df95026e0&#xA;Pipeline run with id=6b71371e-1663-427e-ad74-340df95026e0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6b71371e-1663-427e-ad74-340df95026e0&#xA;Pipeline run with id=6b71371e-1663-427e-ad74-340df95026e0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6b71371e-1663-427e-ad74-340df95026e0&#xA;Pipeline run with id=6b71371e-1663-427e-ad74-340df95026e0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6b71371e-1663-427e-ad74-340df95026e0&#xA;Pipeline run with id=6b71371e-1663-427e-ad74-340df95026e0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6b71371e-1663-427e-ad74-340df95026e0&#xA;Pipeline run with id=6b71371e-1663-427e-ad74-340df95026e0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6b71371e-1663-427e-ad74-340df95026e0&#xA;Pipeline run with id=6b71371e-1663-427e-ad74-340df95026e0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6b71371e-1663-427e-ad74-340df95026e0&#xA;Pipeline run with id=6b71371e-1663-427e-ad74-340df95026e0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6b71371e-1663-427e-ad74-340df95026e0&#xA;Pipeline run with id=6b71371e-1663-427e-ad74-340df95026e0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6b71371e-1663-427e-ad74-340df95026e0&#xA;Pipeline run with id=6b71371e-1663-427e-ad74-340df95026e0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6b71371e-1663-427e-ad74-340df95026e0&#xA;Pipeline run with id=6b71371e-1663-427e-ad74-340df95026e0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6b71371e-1663-427e-ad74-340df95026e0&#xA;Pipeline run with id=6b71371e-1663-427e-ad74-340df95026e0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6b71371e-1663-427e-ad74-340df95026e0&#xA;Pipeline run with id=6b71371e-1663-427e-ad74-340df95026e0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6b71371e-1663-427e-ad74-340df95026e0&#xA;Pipeline run with id=6b71371e-1663-427e-ad74-340df95026e0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6b71371e-1663-427e-ad74-340df95026e0&#xA;Pipeline run with id=6b71371e-1663-427e-ad74-340df95026e0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6b71371e-1663-427e-ad74-340df95026e0&#xA;Pipeline run with id=6b71371e-1663-427e-ad74-340df95026e0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6b71371e-1663-427e-ad74-340df95026e0&#xA;Pipeline run with id=6b71371e-1663-427e-ad74-340df95026e0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6b71371e-1663-427e-ad74-340df95026e0&#xA;Pipeline run with id=6b71371e-1663-427e-ad74-340df95026e0 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;essential/iris_pipeline_compiled.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=6b71371e-1663-427e-ad74-340df95026e0&#xA;Get a pipeline run with id=6b71371e-1663-427e-ad74-340df95026e0&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/07/26 16:45:34.879 (2m35.792s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/07/26 16:45:34.879&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 6b71371e-1663-427e-ad74-340df95026e0&#xA;Failed to terminate run 6b71371e-1663-427e-ad74-340df95026e0&#xA;Terminate run 6b71371e-1663-427e-ad74-340df95026e0&#xA;Deleting run 6b71371e-1663-427e-ad74-340df95026e0&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=6a74f886-628a-43c3-b320-3f0595a40719 (cascade=true)&#xA;Pipeline with id=6a74f886-628a-43c3-b320-3f0595a40719, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/07/26 16:45:35.057 (177ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/07/26 16:45:35.057&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/07/26 16:45:35.057 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/07/26 16:45:35.057&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/07/26 16:45:35.057 (0s)&#xA;</system-err>
          </testcase>
      </testsuite>
  </testsuites>