<?xml version="1.0" encoding="UTF-8"?>
  <testsuites tests="5" disabled="0" errors="0" failures="0" time="161.316669144">
      <testsuite name="AIPipelinesE2ETests" package="/dspa/backend/test/end2end" tests="5" disabled="0" skipped="0" errors="0" failures="0" time="161.316669144" timestamp="2026-07-09T01:49:23">
          <properties>
              <property name="SuiteSucceeded" value="true"></property>
              <property name="SuiteHasProgrammaticFocus" value="false"></property>
              <property name="SpecialSuiteFailureReason" value=""></property>
              <property name="SuiteLabels" value="[]"></property>
              <property name="SuiteSemVerConstraints" value="[]"></property>
              <property name="RandomSeed" value="1783561559"></property>
              <property name="RandomizeAllSpecs" value="false"></property>
              <property name="LabelFilter" value="Smoke"></property>
              <property name="SemVerFilter" value=""></property>
              <property name="FocusStrings" value=""></property>
              <property name="SkipStrings" value=""></property>
              <property name="FocusFiles" value=""></property>
              <property name="SkipFiles" value=""></property>
              <property name="FailOnPending" value="false"></property>
              <property name="FailOnEmpty" value="false"></property>
              <property name="FailFast" value="false"></property>
              <property name="FlakeAttempts" value="0"></property>
              <property name="DryRun" value="false"></property>
              <property name="ParallelTotal" value="10"></property>
              <property name="OutputInterceptorMode" value=""></property>
          </properties>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload essential/component_with_pip_index_urls.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="46.010753594">
              <system-out>2026/07/09 01:50:10 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/09/26 01:49:23.999&#xA;Create an experiment with name E2EExperiment-1783561763999795091&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/09/26 01:49:24.227 (228ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/09/26 01:49:24.227&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x3e045576480&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/09/26 01:49:24.359 (131ms)&#xA;&gt; Enter [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/09/26 01:49:24.359&#xA;Uploading pipeline file essential/component_with_pip_index_urls.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1783561764227983555, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml&#xA;Upload of pipeline file &#39;essential/component_with_pip_index_urls.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 2c9c3d24-17e6-48f4-a349-0cd5d7b361f3&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;2c9c3d24-17e6-48f4-a349-0cd5d7b361f3&#39; and name: &#39;e2e-test-1783561764227983555&#39;&#xA;Create a pipeline run for pipeline with id=2c9c3d24-17e6-48f4-a349-0cd5d7b361f3 and versionId=c00e62c1-687e-4798-8be4-18d249ed4bd6&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=2cbc0488-84f9-4f71-85bf-0526b8c3de5f&#xA;Created Pipeline Run with id: 2cbc0488-84f9-4f71-85bf-0526b8c3de5f for pipeline with id: 2c9c3d24-17e6-48f4-a349-0cd5d7b361f3&#xA;Waiting for pipeline run with id=2cbc0488-84f9-4f71-85bf-0526b8c3de5f to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=2cbc0488-84f9-4f71-85bf-0526b8c3de5f&#xA;Pipeline run with id=2cbc0488-84f9-4f71-85bf-0526b8c3de5f is in PENDING state, waiting...&#xA;Get a pipeline run with id=2cbc0488-84f9-4f71-85bf-0526b8c3de5f&#xA;Pipeline run with id=2cbc0488-84f9-4f71-85bf-0526b8c3de5f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=2cbc0488-84f9-4f71-85bf-0526b8c3de5f&#xA;Pipeline run with id=2cbc0488-84f9-4f71-85bf-0526b8c3de5f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=2cbc0488-84f9-4f71-85bf-0526b8c3de5f&#xA;Pipeline run with id=2cbc0488-84f9-4f71-85bf-0526b8c3de5f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=2cbc0488-84f9-4f71-85bf-0526b8c3de5f&#xA;Pipeline run with id=2cbc0488-84f9-4f71-85bf-0526b8c3de5f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=2cbc0488-84f9-4f71-85bf-0526b8c3de5f&#xA;Pipeline run with id=2cbc0488-84f9-4f71-85bf-0526b8c3de5f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=2cbc0488-84f9-4f71-85bf-0526b8c3de5f&#xA;Pipeline run with id=2cbc0488-84f9-4f71-85bf-0526b8c3de5f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=2cbc0488-84f9-4f71-85bf-0526b8c3de5f&#xA;Pipeline run with id=2cbc0488-84f9-4f71-85bf-0526b8c3de5f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=2cbc0488-84f9-4f71-85bf-0526b8c3de5f&#xA;Pipeline run with id=2cbc0488-84f9-4f71-85bf-0526b8c3de5f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=2cbc0488-84f9-4f71-85bf-0526b8c3de5f&#xA;Pipeline run with id=2cbc0488-84f9-4f71-85bf-0526b8c3de5f reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;essential/component_with_pip_index_urls.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=2cbc0488-84f9-4f71-85bf-0526b8c3de5f&#xA;Get a pipeline run with id=2cbc0488-84f9-4f71-85bf-0526b8c3de5f&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/09/26 01:50:09.831 (45.472s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/09/26 01:50:09.831&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 2cbc0488-84f9-4f71-85bf-0526b8c3de5f&#xA;Failed to terminate run 2cbc0488-84f9-4f71-85bf-0526b8c3de5f&#xA;Terminate run 2cbc0488-84f9-4f71-85bf-0526b8c3de5f&#xA;Deleting run 2cbc0488-84f9-4f71-85bf-0526b8c3de5f&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=2c9c3d24-17e6-48f4-a349-0cd5d7b361f3 (cascade=true)&#xA;Pipeline with id=2c9c3d24-17e6-48f4-a349-0cd5d7b361f3, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/09/26 01:50:10.01 (179ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/09/26 01:50:10.01&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/09/26 01:50:10.01 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/09/26 01:50:10.01&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/09/26 01:50:10.01 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/pipeline_with_artifact_upload_download.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="101.065848706">
              <system-out>2026/07/09 01:51:05 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/09/26 01:49:23.999&#xA;Create an experiment with name E2EExperiment-1783561763999613257&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/09/26 01:49:24.178 (179ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/09/26 01:49:24.178&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x193d4c50380&#xA;test-secret-1 created&#xA;test-secret-2 created&#xA;test-secret-3 created&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/09/26 01:49:24.26 (81ms)&#xA;&gt; Enter [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/09/26 01:49:24.26&#xA;Uploading pipeline file critical/pipeline_with_artifact_upload_download.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1783561764178823481, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml&#xA;Upload of pipeline file &#39;critical/pipeline_with_artifact_upload_download.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 86eda94b-7494-4d9a-89e0-7d476f2ff383&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;86eda94b-7494-4d9a-89e0-7d476f2ff383&#39; and name: &#39;e2e-test-1783561764178823481&#39;&#xA;Create a pipeline run for pipeline with id=86eda94b-7494-4d9a-89e0-7d476f2ff383 and versionId=ba2aca56-b29b-4f5f-b0e2-c7e221da843d&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=52f8cc92-e70d-4085-8a3c-d8268ad304ce&#xA;Created Pipeline Run with id: 52f8cc92-e70d-4085-8a3c-d8268ad304ce for pipeline with id: 86eda94b-7494-4d9a-89e0-7d476f2ff383&#xA;Waiting for pipeline run with id=52f8cc92-e70d-4085-8a3c-d8268ad304ce to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=52f8cc92-e70d-4085-8a3c-d8268ad304ce&#xA;Pipeline run with id=52f8cc92-e70d-4085-8a3c-d8268ad304ce is in PENDING state, waiting...&#xA;Get a pipeline run with id=52f8cc92-e70d-4085-8a3c-d8268ad304ce&#xA;Pipeline run with id=52f8cc92-e70d-4085-8a3c-d8268ad304ce is in RUNNING state, waiting...&#xA;Get a pipeline run with id=52f8cc92-e70d-4085-8a3c-d8268ad304ce&#xA;Pipeline run with id=52f8cc92-e70d-4085-8a3c-d8268ad304ce is in RUNNING state, waiting...&#xA;Get a pipeline run with id=52f8cc92-e70d-4085-8a3c-d8268ad304ce&#xA;Pipeline run with id=52f8cc92-e70d-4085-8a3c-d8268ad304ce is in RUNNING state, waiting...&#xA;Get a pipeline run with id=52f8cc92-e70d-4085-8a3c-d8268ad304ce&#xA;Pipeline run with id=52f8cc92-e70d-4085-8a3c-d8268ad304ce is in RUNNING state, waiting...&#xA;Get a pipeline run with id=52f8cc92-e70d-4085-8a3c-d8268ad304ce&#xA;Pipeline run with id=52f8cc92-e70d-4085-8a3c-d8268ad304ce is in RUNNING state, waiting...&#xA;Get a pipeline run with id=52f8cc92-e70d-4085-8a3c-d8268ad304ce&#xA;Pipeline run with id=52f8cc92-e70d-4085-8a3c-d8268ad304ce is in RUNNING state, waiting...&#xA;Get a pipeline run with id=52f8cc92-e70d-4085-8a3c-d8268ad304ce&#xA;Pipeline run with id=52f8cc92-e70d-4085-8a3c-d8268ad304ce is in RUNNING state, waiting...&#xA;Get a pipeline run with id=52f8cc92-e70d-4085-8a3c-d8268ad304ce&#xA;Pipeline run with id=52f8cc92-e70d-4085-8a3c-d8268ad304ce is in RUNNING state, waiting...&#xA;Get a pipeline run with id=52f8cc92-e70d-4085-8a3c-d8268ad304ce&#xA;Pipeline run with id=52f8cc92-e70d-4085-8a3c-d8268ad304ce is in RUNNING state, waiting...&#xA;Get a pipeline run with id=52f8cc92-e70d-4085-8a3c-d8268ad304ce&#xA;Pipeline run with id=52f8cc92-e70d-4085-8a3c-d8268ad304ce is in RUNNING state, waiting...&#xA;Get a pipeline run with id=52f8cc92-e70d-4085-8a3c-d8268ad304ce&#xA;Pipeline run with id=52f8cc92-e70d-4085-8a3c-d8268ad304ce is in RUNNING state, waiting...&#xA;Get a pipeline run with id=52f8cc92-e70d-4085-8a3c-d8268ad304ce&#xA;Pipeline run with id=52f8cc92-e70d-4085-8a3c-d8268ad304ce is in RUNNING state, waiting...&#xA;Get a pipeline run with id=52f8cc92-e70d-4085-8a3c-d8268ad304ce&#xA;Pipeline run with id=52f8cc92-e70d-4085-8a3c-d8268ad304ce is in RUNNING state, waiting...&#xA;Get a pipeline run with id=52f8cc92-e70d-4085-8a3c-d8268ad304ce&#xA;Pipeline run with id=52f8cc92-e70d-4085-8a3c-d8268ad304ce is in RUNNING state, waiting...&#xA;Get a pipeline run with id=52f8cc92-e70d-4085-8a3c-d8268ad304ce&#xA;Pipeline run with id=52f8cc92-e70d-4085-8a3c-d8268ad304ce is in RUNNING state, waiting...&#xA;Get a pipeline run with id=52f8cc92-e70d-4085-8a3c-d8268ad304ce&#xA;Pipeline run with id=52f8cc92-e70d-4085-8a3c-d8268ad304ce is in RUNNING state, waiting...&#xA;Get a pipeline run with id=52f8cc92-e70d-4085-8a3c-d8268ad304ce&#xA;Pipeline run with id=52f8cc92-e70d-4085-8a3c-d8268ad304ce is in RUNNING state, waiting...&#xA;Get a pipeline run with id=52f8cc92-e70d-4085-8a3c-d8268ad304ce&#xA;Pipeline run with id=52f8cc92-e70d-4085-8a3c-d8268ad304ce is in RUNNING state, waiting...&#xA;Get a pipeline run with id=52f8cc92-e70d-4085-8a3c-d8268ad304ce&#xA;Pipeline run with id=52f8cc92-e70d-4085-8a3c-d8268ad304ce is in RUNNING state, waiting...&#xA;Get a pipeline run with id=52f8cc92-e70d-4085-8a3c-d8268ad304ce&#xA;Pipeline run with id=52f8cc92-e70d-4085-8a3c-d8268ad304ce reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/pipeline_with_artifact_upload_download.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=52f8cc92-e70d-4085-8a3c-d8268ad304ce&#xA;Get a pipeline run with id=52f8cc92-e70d-4085-8a3c-d8268ad304ce&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/09/26 01:51:04.835 (1m40.575s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/09/26 01:51:04.835&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 52f8cc92-e70d-4085-8a3c-d8268ad304ce&#xA;Failed to terminate run 52f8cc92-e70d-4085-8a3c-d8268ad304ce&#xA;Terminate run 52f8cc92-e70d-4085-8a3c-d8268ad304ce&#xA;Deleting run 52f8cc92-e70d-4085-8a3c-d8268ad304ce&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=86eda94b-7494-4d9a-89e0-7d476f2ff383 (cascade=true)&#xA;Pipeline with id=86eda94b-7494-4d9a-89e0-7d476f2ff383, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/09/26 01:51:05.065 (230ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/09/26 01:51:05.065&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/09/26 01:51:05.065 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/09/26 01:51:05.065&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/09/26 01:51:05.065 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/parallel_for_after_dependency.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="101.175522031">
              <system-out>2026/07/09 01:51:05 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/09/26 01:49:23.999&#xA;Create an experiment with name E2EExperiment-1783561763999441044&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/09/26 01:49:24.228 (229ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/09/26 01:49:24.228&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x1d1595708900&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/09/26 01:49:24.357 (129ms)&#xA;&gt; Enter [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/09/26 01:49:24.357&#xA;Uploading pipeline file critical/parallel_for_after_dependency.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1783561764228930807, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml&#xA;Upload of pipeline file &#39;critical/parallel_for_after_dependency.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 39c6c0f3-fc03-4829-8159-86e27093b071&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;39c6c0f3-fc03-4829-8159-86e27093b071&#39; and name: &#39;e2e-test-1783561764228930807&#39;&#xA;Create a pipeline run for pipeline with id=39c6c0f3-fc03-4829-8159-86e27093b071 and versionId=ca3fb716-1e81-4e5f-9869-c2126b77785a&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=21b9c99e-9a7f-4d66-b38f-e9eff930a703&#xA;Created Pipeline Run with id: 21b9c99e-9a7f-4d66-b38f-e9eff930a703 for pipeline with id: 39c6c0f3-fc03-4829-8159-86e27093b071&#xA;Waiting for pipeline run with id=21b9c99e-9a7f-4d66-b38f-e9eff930a703 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=21b9c99e-9a7f-4d66-b38f-e9eff930a703&#xA;Pipeline run with id=21b9c99e-9a7f-4d66-b38f-e9eff930a703 is in PENDING state, waiting...&#xA;Get a pipeline run with id=21b9c99e-9a7f-4d66-b38f-e9eff930a703&#xA;Pipeline run with id=21b9c99e-9a7f-4d66-b38f-e9eff930a703 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=21b9c99e-9a7f-4d66-b38f-e9eff930a703&#xA;Pipeline run with id=21b9c99e-9a7f-4d66-b38f-e9eff930a703 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=21b9c99e-9a7f-4d66-b38f-e9eff930a703&#xA;Pipeline run with id=21b9c99e-9a7f-4d66-b38f-e9eff930a703 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=21b9c99e-9a7f-4d66-b38f-e9eff930a703&#xA;Pipeline run with id=21b9c99e-9a7f-4d66-b38f-e9eff930a703 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=21b9c99e-9a7f-4d66-b38f-e9eff930a703&#xA;Pipeline run with id=21b9c99e-9a7f-4d66-b38f-e9eff930a703 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=21b9c99e-9a7f-4d66-b38f-e9eff930a703&#xA;Pipeline run with id=21b9c99e-9a7f-4d66-b38f-e9eff930a703 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=21b9c99e-9a7f-4d66-b38f-e9eff930a703&#xA;Pipeline run with id=21b9c99e-9a7f-4d66-b38f-e9eff930a703 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=21b9c99e-9a7f-4d66-b38f-e9eff930a703&#xA;Pipeline run with id=21b9c99e-9a7f-4d66-b38f-e9eff930a703 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=21b9c99e-9a7f-4d66-b38f-e9eff930a703&#xA;Pipeline run with id=21b9c99e-9a7f-4d66-b38f-e9eff930a703 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=21b9c99e-9a7f-4d66-b38f-e9eff930a703&#xA;Pipeline run with id=21b9c99e-9a7f-4d66-b38f-e9eff930a703 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=21b9c99e-9a7f-4d66-b38f-e9eff930a703&#xA;Pipeline run with id=21b9c99e-9a7f-4d66-b38f-e9eff930a703 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=21b9c99e-9a7f-4d66-b38f-e9eff930a703&#xA;Pipeline run with id=21b9c99e-9a7f-4d66-b38f-e9eff930a703 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=21b9c99e-9a7f-4d66-b38f-e9eff930a703&#xA;Pipeline run with id=21b9c99e-9a7f-4d66-b38f-e9eff930a703 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=21b9c99e-9a7f-4d66-b38f-e9eff930a703&#xA;Pipeline run with id=21b9c99e-9a7f-4d66-b38f-e9eff930a703 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=21b9c99e-9a7f-4d66-b38f-e9eff930a703&#xA;Pipeline run with id=21b9c99e-9a7f-4d66-b38f-e9eff930a703 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=21b9c99e-9a7f-4d66-b38f-e9eff930a703&#xA;Pipeline run with id=21b9c99e-9a7f-4d66-b38f-e9eff930a703 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=21b9c99e-9a7f-4d66-b38f-e9eff930a703&#xA;Pipeline run with id=21b9c99e-9a7f-4d66-b38f-e9eff930a703 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=21b9c99e-9a7f-4d66-b38f-e9eff930a703&#xA;Pipeline run with id=21b9c99e-9a7f-4d66-b38f-e9eff930a703 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=21b9c99e-9a7f-4d66-b38f-e9eff930a703&#xA;Pipeline run with id=21b9c99e-9a7f-4d66-b38f-e9eff930a703 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=21b9c99e-9a7f-4d66-b38f-e9eff930a703&#xA;Pipeline run with id=21b9c99e-9a7f-4d66-b38f-e9eff930a703 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/parallel_for_after_dependency.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=21b9c99e-9a7f-4d66-b38f-e9eff930a703&#xA;Get a pipeline run with id=21b9c99e-9a7f-4d66-b38f-e9eff930a703&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/09/26 01:51:04.912 (1m40.555s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/09/26 01:51:04.912&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 21b9c99e-9a7f-4d66-b38f-e9eff930a703&#xA;Failed to terminate run 21b9c99e-9a7f-4d66-b38f-e9eff930a703&#xA;Terminate run 21b9c99e-9a7f-4d66-b38f-e9eff930a703&#xA;Deleting run 21b9c99e-9a7f-4d66-b38f-e9eff930a703&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=39c6c0f3-fc03-4829-8159-86e27093b071 (cascade=true)&#xA;Pipeline with id=39c6c0f3-fc03-4829-8159-86e27093b071, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/09/26 01:51:05.174 (262ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/09/26 01:51:05.175&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/09/26 01:51:05.175 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/09/26 01:51:05.175&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/09/26 01:51:05.175 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/flip_coin.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="131.355023988">
              <system-out>2026/07/09 01:51:35 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/09/26 01:49:23.999&#xA;Create an experiment with name E2EExperiment-1783561763999199256&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/09/26 01:49:24.178 (179ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/09/26 01:49:24.178&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x1ae5145f2680&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/09/26 01:49:24.329 (152ms)&#xA;&gt; Enter [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/09/26 01:49:24.33&#xA;Uploading pipeline file critical/flip_coin.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1783561764178493236, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml&#xA;Upload of pipeline file &#39;critical/flip_coin.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 092416c8-32da-4d63-b540-f2e3fb2d02d9&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;092416c8-32da-4d63-b540-f2e3fb2d02d9&#39; and name: &#39;e2e-test-1783561764178493236&#39;&#xA;Create a pipeline run for pipeline with id=092416c8-32da-4d63-b540-f2e3fb2d02d9 and versionId=a891d127-09d7-491f-84ef-0a8ee751809a&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=713e9f49-0850-4817-a7b2-f6b9afbc4fa6&#xA;Created Pipeline Run with id: 713e9f49-0850-4817-a7b2-f6b9afbc4fa6 for pipeline with id: 092416c8-32da-4d63-b540-f2e3fb2d02d9&#xA;Waiting for pipeline run with id=713e9f49-0850-4817-a7b2-f6b9afbc4fa6 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=713e9f49-0850-4817-a7b2-f6b9afbc4fa6&#xA;Pipeline run with id=713e9f49-0850-4817-a7b2-f6b9afbc4fa6 is in PENDING state, waiting...&#xA;Get a pipeline run with id=713e9f49-0850-4817-a7b2-f6b9afbc4fa6&#xA;Pipeline run with id=713e9f49-0850-4817-a7b2-f6b9afbc4fa6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=713e9f49-0850-4817-a7b2-f6b9afbc4fa6&#xA;Pipeline run with id=713e9f49-0850-4817-a7b2-f6b9afbc4fa6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=713e9f49-0850-4817-a7b2-f6b9afbc4fa6&#xA;Pipeline run with id=713e9f49-0850-4817-a7b2-f6b9afbc4fa6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=713e9f49-0850-4817-a7b2-f6b9afbc4fa6&#xA;Pipeline run with id=713e9f49-0850-4817-a7b2-f6b9afbc4fa6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=713e9f49-0850-4817-a7b2-f6b9afbc4fa6&#xA;Pipeline run with id=713e9f49-0850-4817-a7b2-f6b9afbc4fa6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=713e9f49-0850-4817-a7b2-f6b9afbc4fa6&#xA;Pipeline run with id=713e9f49-0850-4817-a7b2-f6b9afbc4fa6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=713e9f49-0850-4817-a7b2-f6b9afbc4fa6&#xA;Pipeline run with id=713e9f49-0850-4817-a7b2-f6b9afbc4fa6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=713e9f49-0850-4817-a7b2-f6b9afbc4fa6&#xA;Pipeline run with id=713e9f49-0850-4817-a7b2-f6b9afbc4fa6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=713e9f49-0850-4817-a7b2-f6b9afbc4fa6&#xA;Pipeline run with id=713e9f49-0850-4817-a7b2-f6b9afbc4fa6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=713e9f49-0850-4817-a7b2-f6b9afbc4fa6&#xA;Pipeline run with id=713e9f49-0850-4817-a7b2-f6b9afbc4fa6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=713e9f49-0850-4817-a7b2-f6b9afbc4fa6&#xA;Pipeline run with id=713e9f49-0850-4817-a7b2-f6b9afbc4fa6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=713e9f49-0850-4817-a7b2-f6b9afbc4fa6&#xA;Pipeline run with id=713e9f49-0850-4817-a7b2-f6b9afbc4fa6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=713e9f49-0850-4817-a7b2-f6b9afbc4fa6&#xA;Pipeline run with id=713e9f49-0850-4817-a7b2-f6b9afbc4fa6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=713e9f49-0850-4817-a7b2-f6b9afbc4fa6&#xA;Pipeline run with id=713e9f49-0850-4817-a7b2-f6b9afbc4fa6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=713e9f49-0850-4817-a7b2-f6b9afbc4fa6&#xA;Pipeline run with id=713e9f49-0850-4817-a7b2-f6b9afbc4fa6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=713e9f49-0850-4817-a7b2-f6b9afbc4fa6&#xA;Pipeline run with id=713e9f49-0850-4817-a7b2-f6b9afbc4fa6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=713e9f49-0850-4817-a7b2-f6b9afbc4fa6&#xA;Pipeline run with id=713e9f49-0850-4817-a7b2-f6b9afbc4fa6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=713e9f49-0850-4817-a7b2-f6b9afbc4fa6&#xA;Pipeline run with id=713e9f49-0850-4817-a7b2-f6b9afbc4fa6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=713e9f49-0850-4817-a7b2-f6b9afbc4fa6&#xA;Pipeline run with id=713e9f49-0850-4817-a7b2-f6b9afbc4fa6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=713e9f49-0850-4817-a7b2-f6b9afbc4fa6&#xA;Pipeline run with id=713e9f49-0850-4817-a7b2-f6b9afbc4fa6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=713e9f49-0850-4817-a7b2-f6b9afbc4fa6&#xA;Pipeline run with id=713e9f49-0850-4817-a7b2-f6b9afbc4fa6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=713e9f49-0850-4817-a7b2-f6b9afbc4fa6&#xA;Pipeline run with id=713e9f49-0850-4817-a7b2-f6b9afbc4fa6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=713e9f49-0850-4817-a7b2-f6b9afbc4fa6&#xA;Pipeline run with id=713e9f49-0850-4817-a7b2-f6b9afbc4fa6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=713e9f49-0850-4817-a7b2-f6b9afbc4fa6&#xA;Pipeline run with id=713e9f49-0850-4817-a7b2-f6b9afbc4fa6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=713e9f49-0850-4817-a7b2-f6b9afbc4fa6&#xA;Pipeline run with id=713e9f49-0850-4817-a7b2-f6b9afbc4fa6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=713e9f49-0850-4817-a7b2-f6b9afbc4fa6&#xA;Pipeline run with id=713e9f49-0850-4817-a7b2-f6b9afbc4fa6 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/flip_coin.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=713e9f49-0850-4817-a7b2-f6b9afbc4fa6&#xA;Get a pipeline run with id=713e9f49-0850-4817-a7b2-f6b9afbc4fa6&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/09/26 01:51:35.071 (2m10.741s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/09/26 01:51:35.071&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 713e9f49-0850-4817-a7b2-f6b9afbc4fa6&#xA;Failed to terminate run 713e9f49-0850-4817-a7b2-f6b9afbc4fa6&#xA;Terminate run 713e9f49-0850-4817-a7b2-f6b9afbc4fa6&#xA;Deleting run 713e9f49-0850-4817-a7b2-f6b9afbc4fa6&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=092416c8-32da-4d63-b540-f2e3fb2d02d9 (cascade=true)&#xA;Pipeline with id=092416c8-32da-4d63-b540-f2e3fb2d02d9, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/09/26 01:51:35.354 (283ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/09/26 01:51:35.354&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/09/26 01:51:35.354 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/09/26 01:51:35.354&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/09/26 01:51:35.354 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload essential/iris_pipeline_compiled.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="161.113511397">
              <system-out>2026/07/09 01:52:05 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/09/26 01:49:24&#xA;Create an experiment with name E2EExperiment-1783561764000177081&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/09/26 01:49:24.214 (214ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/09/26 01:49:24.214&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x3f6fae5a080&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/09/26 01:49:24.332 (118ms)&#xA;&gt; Enter [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/09/26 01:49:24.332&#xA;Uploading pipeline file essential/iris_pipeline_compiled.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1783561764214825402, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml&#xA;Upload of pipeline file &#39;essential/iris_pipeline_compiled.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 021d408d-ddec-4907-85f4-6da595be468b&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;021d408d-ddec-4907-85f4-6da595be468b&#39; and name: &#39;e2e-test-1783561764214825402&#39;&#xA;Create a pipeline run for pipeline with id=021d408d-ddec-4907-85f4-6da595be468b and versionId=07b74d1f-ea67-478c-9b1e-68dada5baba4&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=94676aad-4dbc-4771-9853-54679c1244f8&#xA;Created Pipeline Run with id: 94676aad-4dbc-4771-9853-54679c1244f8 for pipeline with id: 021d408d-ddec-4907-85f4-6da595be468b&#xA;Waiting for pipeline run with id=94676aad-4dbc-4771-9853-54679c1244f8 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=94676aad-4dbc-4771-9853-54679c1244f8&#xA;Pipeline run with id=94676aad-4dbc-4771-9853-54679c1244f8 is in PENDING state, waiting...&#xA;Get a pipeline run with id=94676aad-4dbc-4771-9853-54679c1244f8&#xA;Pipeline run with id=94676aad-4dbc-4771-9853-54679c1244f8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=94676aad-4dbc-4771-9853-54679c1244f8&#xA;Pipeline run with id=94676aad-4dbc-4771-9853-54679c1244f8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=94676aad-4dbc-4771-9853-54679c1244f8&#xA;Pipeline run with id=94676aad-4dbc-4771-9853-54679c1244f8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=94676aad-4dbc-4771-9853-54679c1244f8&#xA;Pipeline run with id=94676aad-4dbc-4771-9853-54679c1244f8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=94676aad-4dbc-4771-9853-54679c1244f8&#xA;Pipeline run with id=94676aad-4dbc-4771-9853-54679c1244f8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=94676aad-4dbc-4771-9853-54679c1244f8&#xA;Pipeline run with id=94676aad-4dbc-4771-9853-54679c1244f8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=94676aad-4dbc-4771-9853-54679c1244f8&#xA;Pipeline run with id=94676aad-4dbc-4771-9853-54679c1244f8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=94676aad-4dbc-4771-9853-54679c1244f8&#xA;Pipeline run with id=94676aad-4dbc-4771-9853-54679c1244f8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=94676aad-4dbc-4771-9853-54679c1244f8&#xA;Pipeline run with id=94676aad-4dbc-4771-9853-54679c1244f8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=94676aad-4dbc-4771-9853-54679c1244f8&#xA;Pipeline run with id=94676aad-4dbc-4771-9853-54679c1244f8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=94676aad-4dbc-4771-9853-54679c1244f8&#xA;Pipeline run with id=94676aad-4dbc-4771-9853-54679c1244f8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=94676aad-4dbc-4771-9853-54679c1244f8&#xA;Pipeline run with id=94676aad-4dbc-4771-9853-54679c1244f8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=94676aad-4dbc-4771-9853-54679c1244f8&#xA;Pipeline run with id=94676aad-4dbc-4771-9853-54679c1244f8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=94676aad-4dbc-4771-9853-54679c1244f8&#xA;Pipeline run with id=94676aad-4dbc-4771-9853-54679c1244f8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=94676aad-4dbc-4771-9853-54679c1244f8&#xA;Pipeline run with id=94676aad-4dbc-4771-9853-54679c1244f8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=94676aad-4dbc-4771-9853-54679c1244f8&#xA;Pipeline run with id=94676aad-4dbc-4771-9853-54679c1244f8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=94676aad-4dbc-4771-9853-54679c1244f8&#xA;Pipeline run with id=94676aad-4dbc-4771-9853-54679c1244f8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=94676aad-4dbc-4771-9853-54679c1244f8&#xA;Pipeline run with id=94676aad-4dbc-4771-9853-54679c1244f8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=94676aad-4dbc-4771-9853-54679c1244f8&#xA;Pipeline run with id=94676aad-4dbc-4771-9853-54679c1244f8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=94676aad-4dbc-4771-9853-54679c1244f8&#xA;Pipeline run with id=94676aad-4dbc-4771-9853-54679c1244f8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=94676aad-4dbc-4771-9853-54679c1244f8&#xA;Pipeline run with id=94676aad-4dbc-4771-9853-54679c1244f8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=94676aad-4dbc-4771-9853-54679c1244f8&#xA;Pipeline run with id=94676aad-4dbc-4771-9853-54679c1244f8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=94676aad-4dbc-4771-9853-54679c1244f8&#xA;Pipeline run with id=94676aad-4dbc-4771-9853-54679c1244f8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=94676aad-4dbc-4771-9853-54679c1244f8&#xA;Pipeline run with id=94676aad-4dbc-4771-9853-54679c1244f8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=94676aad-4dbc-4771-9853-54679c1244f8&#xA;Pipeline run with id=94676aad-4dbc-4771-9853-54679c1244f8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=94676aad-4dbc-4771-9853-54679c1244f8&#xA;Pipeline run with id=94676aad-4dbc-4771-9853-54679c1244f8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=94676aad-4dbc-4771-9853-54679c1244f8&#xA;Pipeline run with id=94676aad-4dbc-4771-9853-54679c1244f8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=94676aad-4dbc-4771-9853-54679c1244f8&#xA;Pipeline run with id=94676aad-4dbc-4771-9853-54679c1244f8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=94676aad-4dbc-4771-9853-54679c1244f8&#xA;Pipeline run with id=94676aad-4dbc-4771-9853-54679c1244f8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=94676aad-4dbc-4771-9853-54679c1244f8&#xA;Pipeline run with id=94676aad-4dbc-4771-9853-54679c1244f8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=94676aad-4dbc-4771-9853-54679c1244f8&#xA;Pipeline run with id=94676aad-4dbc-4771-9853-54679c1244f8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=94676aad-4dbc-4771-9853-54679c1244f8&#xA;Pipeline run with id=94676aad-4dbc-4771-9853-54679c1244f8 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;essential/iris_pipeline_compiled.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=94676aad-4dbc-4771-9853-54679c1244f8&#xA;Get a pipeline run with id=94676aad-4dbc-4771-9853-54679c1244f8&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/09/26 01:52:04.85 (2m40.518s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/09/26 01:52:04.85&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 94676aad-4dbc-4771-9853-54679c1244f8&#xA;Failed to terminate run 94676aad-4dbc-4771-9853-54679c1244f8&#xA;Terminate run 94676aad-4dbc-4771-9853-54679c1244f8&#xA;Deleting run 94676aad-4dbc-4771-9853-54679c1244f8&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=021d408d-ddec-4907-85f4-6da595be468b (cascade=true)&#xA;Pipeline with id=021d408d-ddec-4907-85f4-6da595be468b, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/09/26 01:52:05.113 (263ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/09/26 01:52:05.113&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/09/26 01:52:05.113 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/09/26 01:52:05.114&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/09/26 01:52:05.114 (0s)&#xA;</system-err>
          </testcase>
      </testsuite>
  </testsuites>