<?xml version="1.0" encoding="UTF-8"?>
  <testsuites tests="5" disabled="0" errors="0" failures="0" time="156.431226761">
      <testsuite name="AIPipelinesE2ETests" package="/dspa/backend/test/end2end" tests="5" disabled="0" skipped="0" errors="0" failures="0" time="156.431226761" timestamp="2026-07-06T17:27:33">
          <properties>
              <property name="SuiteSucceeded" value="true"></property>
              <property name="SuiteHasProgrammaticFocus" value="false"></property>
              <property name="SpecialSuiteFailureReason" value=""></property>
              <property name="SuiteLabels" value="[]"></property>
              <property name="SuiteSemVerConstraints" value="[]"></property>
              <property name="RandomSeed" value="1783358673"></property>
              <property name="RandomizeAllSpecs" value="false"></property>
              <property name="LabelFilter" value="Smoke"></property>
              <property name="SemVerFilter" value=""></property>
              <property name="FocusStrings" value=""></property>
              <property name="SkipStrings" value=""></property>
              <property name="FocusFiles" value=""></property>
              <property name="SkipFiles" value=""></property>
              <property name="FailOnPending" value="false"></property>
              <property name="FailOnEmpty" value="false"></property>
              <property name="FailFast" value="false"></property>
              <property name="FlakeAttempts" value="0"></property>
              <property name="DryRun" value="false"></property>
              <property name="ParallelTotal" value="10"></property>
              <property name="OutputInterceptorMode" value=""></property>
          </properties>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/pipeline_with_artifact_upload_download.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="96.174184098">
              <system-out>2026/07/06 17:29:09 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/06/26 17:27:33.535&#xA;Create an experiment with name E2EExperiment-1783358853535437678&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/06/26 17:27:33.753 (218ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/06/26 17:27:33.753&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x4abdd7d2100&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/06/26 17:27:33.891 (138ms)&#xA;&gt; Enter [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/06/26 17:27:33.891&#xA;Uploading pipeline file critical/pipeline_with_artifact_upload_download.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1783358853753496355, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml&#xA;Upload of pipeline file &#39;critical/pipeline_with_artifact_upload_download.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 84a2061a-6378-413e-877b-f2c937d0a81f&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;84a2061a-6378-413e-877b-f2c937d0a81f&#39; and name: &#39;e2e-test-1783358853753496355&#39;&#xA;Create a pipeline run for pipeline with id=84a2061a-6378-413e-877b-f2c937d0a81f and versionId=73bc1058-9cf5-44d6-8825-54c9454021e4&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=25a479e5-80d7-4a70-97ca-bdff3a489d31&#xA;Created Pipeline Run with id: 25a479e5-80d7-4a70-97ca-bdff3a489d31 for pipeline with id: 84a2061a-6378-413e-877b-f2c937d0a81f&#xA;Waiting for pipeline run with id=25a479e5-80d7-4a70-97ca-bdff3a489d31 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=25a479e5-80d7-4a70-97ca-bdff3a489d31&#xA;Pipeline run with id=25a479e5-80d7-4a70-97ca-bdff3a489d31 is in PENDING state, waiting...&#xA;Get a pipeline run with id=25a479e5-80d7-4a70-97ca-bdff3a489d31&#xA;Pipeline run with id=25a479e5-80d7-4a70-97ca-bdff3a489d31 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=25a479e5-80d7-4a70-97ca-bdff3a489d31&#xA;Pipeline run with id=25a479e5-80d7-4a70-97ca-bdff3a489d31 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=25a479e5-80d7-4a70-97ca-bdff3a489d31&#xA;Pipeline run with id=25a479e5-80d7-4a70-97ca-bdff3a489d31 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=25a479e5-80d7-4a70-97ca-bdff3a489d31&#xA;Pipeline run with id=25a479e5-80d7-4a70-97ca-bdff3a489d31 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=25a479e5-80d7-4a70-97ca-bdff3a489d31&#xA;Pipeline run with id=25a479e5-80d7-4a70-97ca-bdff3a489d31 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=25a479e5-80d7-4a70-97ca-bdff3a489d31&#xA;Pipeline run with id=25a479e5-80d7-4a70-97ca-bdff3a489d31 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=25a479e5-80d7-4a70-97ca-bdff3a489d31&#xA;Pipeline run with id=25a479e5-80d7-4a70-97ca-bdff3a489d31 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=25a479e5-80d7-4a70-97ca-bdff3a489d31&#xA;Pipeline run with id=25a479e5-80d7-4a70-97ca-bdff3a489d31 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=25a479e5-80d7-4a70-97ca-bdff3a489d31&#xA;Pipeline run with id=25a479e5-80d7-4a70-97ca-bdff3a489d31 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=25a479e5-80d7-4a70-97ca-bdff3a489d31&#xA;Pipeline run with id=25a479e5-80d7-4a70-97ca-bdff3a489d31 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=25a479e5-80d7-4a70-97ca-bdff3a489d31&#xA;Pipeline run with id=25a479e5-80d7-4a70-97ca-bdff3a489d31 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=25a479e5-80d7-4a70-97ca-bdff3a489d31&#xA;Pipeline run with id=25a479e5-80d7-4a70-97ca-bdff3a489d31 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=25a479e5-80d7-4a70-97ca-bdff3a489d31&#xA;Pipeline run with id=25a479e5-80d7-4a70-97ca-bdff3a489d31 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=25a479e5-80d7-4a70-97ca-bdff3a489d31&#xA;Pipeline run with id=25a479e5-80d7-4a70-97ca-bdff3a489d31 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=25a479e5-80d7-4a70-97ca-bdff3a489d31&#xA;Pipeline run with id=25a479e5-80d7-4a70-97ca-bdff3a489d31 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=25a479e5-80d7-4a70-97ca-bdff3a489d31&#xA;Pipeline run with id=25a479e5-80d7-4a70-97ca-bdff3a489d31 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=25a479e5-80d7-4a70-97ca-bdff3a489d31&#xA;Pipeline run with id=25a479e5-80d7-4a70-97ca-bdff3a489d31 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=25a479e5-80d7-4a70-97ca-bdff3a489d31&#xA;Pipeline run with id=25a479e5-80d7-4a70-97ca-bdff3a489d31 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=25a479e5-80d7-4a70-97ca-bdff3a489d31&#xA;Pipeline run with id=25a479e5-80d7-4a70-97ca-bdff3a489d31 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/pipeline_with_artifact_upload_download.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=25a479e5-80d7-4a70-97ca-bdff3a489d31&#xA;Get a pipeline run with id=25a479e5-80d7-4a70-97ca-bdff3a489d31&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/06/26 17:29:09.435 (1m35.544s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/06/26 17:29:09.436&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 25a479e5-80d7-4a70-97ca-bdff3a489d31&#xA;Failed to terminate run 25a479e5-80d7-4a70-97ca-bdff3a489d31&#xA;Terminate run 25a479e5-80d7-4a70-97ca-bdff3a489d31&#xA;Deleting run 25a479e5-80d7-4a70-97ca-bdff3a489d31&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=84a2061a-6378-413e-877b-f2c937d0a81f (cascade=true)&#xA;Pipeline with id=84a2061a-6378-413e-877b-f2c937d0a81f, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/06/26 17:29:09.709 (273ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/06/26 17:29:09.709&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/06/26 17:29:09.709 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/06/26 17:29:09.71&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/06/26 17:29:09.71 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload essential/component_with_pip_index_urls.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="46.02709499">
              <system-out>2026/07/06 17:28:19 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/06/26 17:27:33.535&#xA;Create an experiment with name E2EExperiment-1783358853535038317&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/06/26 17:27:33.713 (179ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/06/26 17:27:33.714&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x3bc62c42ec00&#xA;test-secret-1 created&#xA;test-secret-2 created&#xA;test-secret-3 created&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/06/26 17:27:33.797 (84ms)&#xA;&gt; Enter [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/06/26 17:27:33.798&#xA;Uploading pipeline file essential/component_with_pip_index_urls.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1783358853714064599, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml&#xA;Upload of pipeline file &#39;essential/component_with_pip_index_urls.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 0c417966-1334-4ac4-8e74-79c6f94695a3&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;0c417966-1334-4ac4-8e74-79c6f94695a3&#39; and name: &#39;e2e-test-1783358853714064599&#39;&#xA;Create a pipeline run for pipeline with id=0c417966-1334-4ac4-8e74-79c6f94695a3 and versionId=07cb4a8f-c323-4ee5-9435-ae30858d0515&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=0260886f-481b-43c7-a968-6540c3fa8f90&#xA;Created Pipeline Run with id: 0260886f-481b-43c7-a968-6540c3fa8f90 for pipeline with id: 0c417966-1334-4ac4-8e74-79c6f94695a3&#xA;Waiting for pipeline run with id=0260886f-481b-43c7-a968-6540c3fa8f90 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=0260886f-481b-43c7-a968-6540c3fa8f90&#xA;Pipeline run with id=0260886f-481b-43c7-a968-6540c3fa8f90 is in PENDING state, waiting...&#xA;Get a pipeline run with id=0260886f-481b-43c7-a968-6540c3fa8f90&#xA;Pipeline run with id=0260886f-481b-43c7-a968-6540c3fa8f90 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0260886f-481b-43c7-a968-6540c3fa8f90&#xA;Pipeline run with id=0260886f-481b-43c7-a968-6540c3fa8f90 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0260886f-481b-43c7-a968-6540c3fa8f90&#xA;Pipeline run with id=0260886f-481b-43c7-a968-6540c3fa8f90 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0260886f-481b-43c7-a968-6540c3fa8f90&#xA;Pipeline run with id=0260886f-481b-43c7-a968-6540c3fa8f90 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0260886f-481b-43c7-a968-6540c3fa8f90&#xA;Pipeline run with id=0260886f-481b-43c7-a968-6540c3fa8f90 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0260886f-481b-43c7-a968-6540c3fa8f90&#xA;Pipeline run with id=0260886f-481b-43c7-a968-6540c3fa8f90 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0260886f-481b-43c7-a968-6540c3fa8f90&#xA;Pipeline run with id=0260886f-481b-43c7-a968-6540c3fa8f90 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0260886f-481b-43c7-a968-6540c3fa8f90&#xA;Pipeline run with id=0260886f-481b-43c7-a968-6540c3fa8f90 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0260886f-481b-43c7-a968-6540c3fa8f90&#xA;Pipeline run with id=0260886f-481b-43c7-a968-6540c3fa8f90 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;essential/component_with_pip_index_urls.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=0260886f-481b-43c7-a968-6540c3fa8f90&#xA;Get a pipeline run with id=0260886f-481b-43c7-a968-6540c3fa8f90&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/06/26 17:28:19.235 (45.437s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/06/26 17:28:19.235&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 0260886f-481b-43c7-a968-6540c3fa8f90&#xA;Failed to terminate run 0260886f-481b-43c7-a968-6540c3fa8f90&#xA;Terminate run 0260886f-481b-43c7-a968-6540c3fa8f90&#xA;Deleting run 0260886f-481b-43c7-a968-6540c3fa8f90&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=0c417966-1334-4ac4-8e74-79c6f94695a3 (cascade=true)&#xA;Pipeline with id=0c417966-1334-4ac4-8e74-79c6f94695a3, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/06/26 17:28:19.561 (326ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/06/26 17:28:19.562&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/06/26 17:28:19.562 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/06/26 17:28:19.562&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/06/26 17:28:19.562 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/parallel_for_after_dependency.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="96.043341489">
              <system-out>2026/07/06 17:29:09 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/06/26 17:27:33.534&#xA;Create an experiment with name E2EExperiment-1783358853534867782&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/06/26 17:27:33.714 (179ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/06/26 17:27:33.714&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x3ceac672ec80&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/06/26 17:27:33.865 (151ms)&#xA;&gt; Enter [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/06/26 17:27:33.865&#xA;Uploading pipeline file critical/parallel_for_after_dependency.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1783358853714453280, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml&#xA;Upload of pipeline file &#39;critical/parallel_for_after_dependency.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 8448ba80-e7e5-458c-9f6b-878ed4b5da9f&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;8448ba80-e7e5-458c-9f6b-878ed4b5da9f&#39; and name: &#39;e2e-test-1783358853714453280&#39;&#xA;Create a pipeline run for pipeline with id=8448ba80-e7e5-458c-9f6b-878ed4b5da9f and versionId=c354ac40-c06a-4f70-9b29-8a25bfde198d&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=9f4d7698-e4ab-4117-a65c-ebfc6f1bf74c&#xA;Created Pipeline Run with id: 9f4d7698-e4ab-4117-a65c-ebfc6f1bf74c for pipeline with id: 8448ba80-e7e5-458c-9f6b-878ed4b5da9f&#xA;Waiting for pipeline run with id=9f4d7698-e4ab-4117-a65c-ebfc6f1bf74c to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=9f4d7698-e4ab-4117-a65c-ebfc6f1bf74c&#xA;Pipeline run with id=9f4d7698-e4ab-4117-a65c-ebfc6f1bf74c is in PENDING state, waiting...&#xA;Get a pipeline run with id=9f4d7698-e4ab-4117-a65c-ebfc6f1bf74c&#xA;Pipeline run with id=9f4d7698-e4ab-4117-a65c-ebfc6f1bf74c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9f4d7698-e4ab-4117-a65c-ebfc6f1bf74c&#xA;Pipeline run with id=9f4d7698-e4ab-4117-a65c-ebfc6f1bf74c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9f4d7698-e4ab-4117-a65c-ebfc6f1bf74c&#xA;Pipeline run with id=9f4d7698-e4ab-4117-a65c-ebfc6f1bf74c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9f4d7698-e4ab-4117-a65c-ebfc6f1bf74c&#xA;Pipeline run with id=9f4d7698-e4ab-4117-a65c-ebfc6f1bf74c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9f4d7698-e4ab-4117-a65c-ebfc6f1bf74c&#xA;Pipeline run with id=9f4d7698-e4ab-4117-a65c-ebfc6f1bf74c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9f4d7698-e4ab-4117-a65c-ebfc6f1bf74c&#xA;Pipeline run with id=9f4d7698-e4ab-4117-a65c-ebfc6f1bf74c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9f4d7698-e4ab-4117-a65c-ebfc6f1bf74c&#xA;Pipeline run with id=9f4d7698-e4ab-4117-a65c-ebfc6f1bf74c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9f4d7698-e4ab-4117-a65c-ebfc6f1bf74c&#xA;Pipeline run with id=9f4d7698-e4ab-4117-a65c-ebfc6f1bf74c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9f4d7698-e4ab-4117-a65c-ebfc6f1bf74c&#xA;Pipeline run with id=9f4d7698-e4ab-4117-a65c-ebfc6f1bf74c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9f4d7698-e4ab-4117-a65c-ebfc6f1bf74c&#xA;Pipeline run with id=9f4d7698-e4ab-4117-a65c-ebfc6f1bf74c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9f4d7698-e4ab-4117-a65c-ebfc6f1bf74c&#xA;Pipeline run with id=9f4d7698-e4ab-4117-a65c-ebfc6f1bf74c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9f4d7698-e4ab-4117-a65c-ebfc6f1bf74c&#xA;Pipeline run with id=9f4d7698-e4ab-4117-a65c-ebfc6f1bf74c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9f4d7698-e4ab-4117-a65c-ebfc6f1bf74c&#xA;Pipeline run with id=9f4d7698-e4ab-4117-a65c-ebfc6f1bf74c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9f4d7698-e4ab-4117-a65c-ebfc6f1bf74c&#xA;Pipeline run with id=9f4d7698-e4ab-4117-a65c-ebfc6f1bf74c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9f4d7698-e4ab-4117-a65c-ebfc6f1bf74c&#xA;Pipeline run with id=9f4d7698-e4ab-4117-a65c-ebfc6f1bf74c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9f4d7698-e4ab-4117-a65c-ebfc6f1bf74c&#xA;Pipeline run with id=9f4d7698-e4ab-4117-a65c-ebfc6f1bf74c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9f4d7698-e4ab-4117-a65c-ebfc6f1bf74c&#xA;Pipeline run with id=9f4d7698-e4ab-4117-a65c-ebfc6f1bf74c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9f4d7698-e4ab-4117-a65c-ebfc6f1bf74c&#xA;Pipeline run with id=9f4d7698-e4ab-4117-a65c-ebfc6f1bf74c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9f4d7698-e4ab-4117-a65c-ebfc6f1bf74c&#xA;Pipeline run with id=9f4d7698-e4ab-4117-a65c-ebfc6f1bf74c reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/parallel_for_after_dependency.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=9f4d7698-e4ab-4117-a65c-ebfc6f1bf74c&#xA;Get a pipeline run with id=9f4d7698-e4ab-4117-a65c-ebfc6f1bf74c&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/06/26 17:29:09.393 (1m35.528s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/06/26 17:29:09.393&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 9f4d7698-e4ab-4117-a65c-ebfc6f1bf74c&#xA;Failed to terminate run 9f4d7698-e4ab-4117-a65c-ebfc6f1bf74c&#xA;Terminate run 9f4d7698-e4ab-4117-a65c-ebfc6f1bf74c&#xA;Deleting run 9f4d7698-e4ab-4117-a65c-ebfc6f1bf74c&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=8448ba80-e7e5-458c-9f6b-878ed4b5da9f (cascade=true)&#xA;Pipeline with id=8448ba80-e7e5-458c-9f6b-878ed4b5da9f, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/06/26 17:29:09.578 (184ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/06/26 17:29:09.578&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/06/26 17:29:09.578 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/06/26 17:29:09.578&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/06/26 17:29:09.578 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/flip_coin.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="126.377582409">
              <system-out>2026/07/06 17:29:39 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/06/26 17:27:33.534&#xA;Create an experiment with name E2EExperiment-1783358853534755059&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/06/26 17:27:33.714 (179ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/06/26 17:27:33.714&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0xc06238e4a00&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/06/26 17:27:33.866 (152ms)&#xA;&gt; Enter [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/06/26 17:27:33.866&#xA;Uploading pipeline file critical/flip_coin.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1783358853714411559, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml&#xA;Upload of pipeline file &#39;critical/flip_coin.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 874a880d-fc16-48e8-bb68-ffb01cacfa2e&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;874a880d-fc16-48e8-bb68-ffb01cacfa2e&#39; and name: &#39;e2e-test-1783358853714411559&#39;&#xA;Create a pipeline run for pipeline with id=874a880d-fc16-48e8-bb68-ffb01cacfa2e and versionId=bf356cc1-2028-4ef0-8310-3e8443c81b23&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=8e7e037f-3541-44f5-9b06-99b0225943d0&#xA;Created Pipeline Run with id: 8e7e037f-3541-44f5-9b06-99b0225943d0 for pipeline with id: 874a880d-fc16-48e8-bb68-ffb01cacfa2e&#xA;Waiting for pipeline run with id=8e7e037f-3541-44f5-9b06-99b0225943d0 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=8e7e037f-3541-44f5-9b06-99b0225943d0&#xA;Pipeline run with id=8e7e037f-3541-44f5-9b06-99b0225943d0 is in PENDING state, waiting...&#xA;Get a pipeline run with id=8e7e037f-3541-44f5-9b06-99b0225943d0&#xA;Pipeline run with id=8e7e037f-3541-44f5-9b06-99b0225943d0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8e7e037f-3541-44f5-9b06-99b0225943d0&#xA;Pipeline run with id=8e7e037f-3541-44f5-9b06-99b0225943d0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8e7e037f-3541-44f5-9b06-99b0225943d0&#xA;Pipeline run with id=8e7e037f-3541-44f5-9b06-99b0225943d0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8e7e037f-3541-44f5-9b06-99b0225943d0&#xA;Pipeline run with id=8e7e037f-3541-44f5-9b06-99b0225943d0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8e7e037f-3541-44f5-9b06-99b0225943d0&#xA;Pipeline run with id=8e7e037f-3541-44f5-9b06-99b0225943d0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8e7e037f-3541-44f5-9b06-99b0225943d0&#xA;Pipeline run with id=8e7e037f-3541-44f5-9b06-99b0225943d0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8e7e037f-3541-44f5-9b06-99b0225943d0&#xA;Pipeline run with id=8e7e037f-3541-44f5-9b06-99b0225943d0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8e7e037f-3541-44f5-9b06-99b0225943d0&#xA;Pipeline run with id=8e7e037f-3541-44f5-9b06-99b0225943d0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8e7e037f-3541-44f5-9b06-99b0225943d0&#xA;Pipeline run with id=8e7e037f-3541-44f5-9b06-99b0225943d0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8e7e037f-3541-44f5-9b06-99b0225943d0&#xA;Pipeline run with id=8e7e037f-3541-44f5-9b06-99b0225943d0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8e7e037f-3541-44f5-9b06-99b0225943d0&#xA;Pipeline run with id=8e7e037f-3541-44f5-9b06-99b0225943d0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8e7e037f-3541-44f5-9b06-99b0225943d0&#xA;Pipeline run with id=8e7e037f-3541-44f5-9b06-99b0225943d0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8e7e037f-3541-44f5-9b06-99b0225943d0&#xA;Pipeline run with id=8e7e037f-3541-44f5-9b06-99b0225943d0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8e7e037f-3541-44f5-9b06-99b0225943d0&#xA;Pipeline run with id=8e7e037f-3541-44f5-9b06-99b0225943d0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8e7e037f-3541-44f5-9b06-99b0225943d0&#xA;Pipeline run with id=8e7e037f-3541-44f5-9b06-99b0225943d0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8e7e037f-3541-44f5-9b06-99b0225943d0&#xA;Pipeline run with id=8e7e037f-3541-44f5-9b06-99b0225943d0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8e7e037f-3541-44f5-9b06-99b0225943d0&#xA;Pipeline run with id=8e7e037f-3541-44f5-9b06-99b0225943d0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8e7e037f-3541-44f5-9b06-99b0225943d0&#xA;Pipeline run with id=8e7e037f-3541-44f5-9b06-99b0225943d0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8e7e037f-3541-44f5-9b06-99b0225943d0&#xA;Pipeline run with id=8e7e037f-3541-44f5-9b06-99b0225943d0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8e7e037f-3541-44f5-9b06-99b0225943d0&#xA;Pipeline run with id=8e7e037f-3541-44f5-9b06-99b0225943d0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8e7e037f-3541-44f5-9b06-99b0225943d0&#xA;Pipeline run with id=8e7e037f-3541-44f5-9b06-99b0225943d0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8e7e037f-3541-44f5-9b06-99b0225943d0&#xA;Pipeline run with id=8e7e037f-3541-44f5-9b06-99b0225943d0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8e7e037f-3541-44f5-9b06-99b0225943d0&#xA;Pipeline run with id=8e7e037f-3541-44f5-9b06-99b0225943d0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8e7e037f-3541-44f5-9b06-99b0225943d0&#xA;Pipeline run with id=8e7e037f-3541-44f5-9b06-99b0225943d0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8e7e037f-3541-44f5-9b06-99b0225943d0&#xA;Pipeline run with id=8e7e037f-3541-44f5-9b06-99b0225943d0 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/flip_coin.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=8e7e037f-3541-44f5-9b06-99b0225943d0&#xA;Get a pipeline run with id=8e7e037f-3541-44f5-9b06-99b0225943d0&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/06/26 17:29:39.559 (2m5.693s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/06/26 17:29:39.559&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 8e7e037f-3541-44f5-9b06-99b0225943d0&#xA;Failed to terminate run 8e7e037f-3541-44f5-9b06-99b0225943d0&#xA;Terminate run 8e7e037f-3541-44f5-9b06-99b0225943d0&#xA;Deleting run 8e7e037f-3541-44f5-9b06-99b0225943d0&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=874a880d-fc16-48e8-bb68-ffb01cacfa2e (cascade=true)&#xA;Pipeline with id=874a880d-fc16-48e8-bb68-ffb01cacfa2e, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/06/26 17:29:39.912 (352ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/06/26 17:29:39.912&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/06/26 17:29:39.912 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/06/26 17:29:39.912&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/06/26 17:29:39.912 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload essential/iris_pipeline_compiled.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="156.232081764">
              <system-out>2026/07/06 17:30:09 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/06/26 17:27:33.535&#xA;Create an experiment with name E2EExperiment-1783358853535164240&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/06/26 17:27:33.713 (179ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/06/26 17:27:33.714&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x2203bfcc6a00&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/06/26 17:27:33.867 (154ms)&#xA;&gt; Enter [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/06/26 17:27:33.867&#xA;Uploading pipeline file essential/iris_pipeline_compiled.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1783358853714146012, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml&#xA;Upload of pipeline file &#39;essential/iris_pipeline_compiled.yaml&#39; successful&#xA;Listing pipeline versions for pipeline cedd4b69-cf47-497e-b467-e183857de8f9&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;cedd4b69-cf47-497e-b467-e183857de8f9&#39; and name: &#39;e2e-test-1783358853714146012&#39;&#xA;Create a pipeline run for pipeline with id=cedd4b69-cf47-497e-b467-e183857de8f9 and versionId=71d359fb-ec68-4510-8e92-0ab68ecbb83e&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=0d4d03ae-1846-40f7-a31a-6a58a6c0bf21&#xA;Created Pipeline Run with id: 0d4d03ae-1846-40f7-a31a-6a58a6c0bf21 for pipeline with id: cedd4b69-cf47-497e-b467-e183857de8f9&#xA;Waiting for pipeline run with id=0d4d03ae-1846-40f7-a31a-6a58a6c0bf21 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=0d4d03ae-1846-40f7-a31a-6a58a6c0bf21&#xA;Pipeline run with id=0d4d03ae-1846-40f7-a31a-6a58a6c0bf21 is in PENDING state, waiting...&#xA;Get a pipeline run with id=0d4d03ae-1846-40f7-a31a-6a58a6c0bf21&#xA;Pipeline run with id=0d4d03ae-1846-40f7-a31a-6a58a6c0bf21 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0d4d03ae-1846-40f7-a31a-6a58a6c0bf21&#xA;Pipeline run with id=0d4d03ae-1846-40f7-a31a-6a58a6c0bf21 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0d4d03ae-1846-40f7-a31a-6a58a6c0bf21&#xA;Pipeline run with id=0d4d03ae-1846-40f7-a31a-6a58a6c0bf21 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0d4d03ae-1846-40f7-a31a-6a58a6c0bf21&#xA;Pipeline run with id=0d4d03ae-1846-40f7-a31a-6a58a6c0bf21 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0d4d03ae-1846-40f7-a31a-6a58a6c0bf21&#xA;Pipeline run with id=0d4d03ae-1846-40f7-a31a-6a58a6c0bf21 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0d4d03ae-1846-40f7-a31a-6a58a6c0bf21&#xA;Pipeline run with id=0d4d03ae-1846-40f7-a31a-6a58a6c0bf21 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0d4d03ae-1846-40f7-a31a-6a58a6c0bf21&#xA;Pipeline run with id=0d4d03ae-1846-40f7-a31a-6a58a6c0bf21 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0d4d03ae-1846-40f7-a31a-6a58a6c0bf21&#xA;Pipeline run with id=0d4d03ae-1846-40f7-a31a-6a58a6c0bf21 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0d4d03ae-1846-40f7-a31a-6a58a6c0bf21&#xA;Pipeline run with id=0d4d03ae-1846-40f7-a31a-6a58a6c0bf21 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0d4d03ae-1846-40f7-a31a-6a58a6c0bf21&#xA;Pipeline run with id=0d4d03ae-1846-40f7-a31a-6a58a6c0bf21 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0d4d03ae-1846-40f7-a31a-6a58a6c0bf21&#xA;Pipeline run with id=0d4d03ae-1846-40f7-a31a-6a58a6c0bf21 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0d4d03ae-1846-40f7-a31a-6a58a6c0bf21&#xA;Pipeline run with id=0d4d03ae-1846-40f7-a31a-6a58a6c0bf21 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0d4d03ae-1846-40f7-a31a-6a58a6c0bf21&#xA;Pipeline run with id=0d4d03ae-1846-40f7-a31a-6a58a6c0bf21 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0d4d03ae-1846-40f7-a31a-6a58a6c0bf21&#xA;Pipeline run with id=0d4d03ae-1846-40f7-a31a-6a58a6c0bf21 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0d4d03ae-1846-40f7-a31a-6a58a6c0bf21&#xA;Pipeline run with id=0d4d03ae-1846-40f7-a31a-6a58a6c0bf21 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0d4d03ae-1846-40f7-a31a-6a58a6c0bf21&#xA;Pipeline run with id=0d4d03ae-1846-40f7-a31a-6a58a6c0bf21 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0d4d03ae-1846-40f7-a31a-6a58a6c0bf21&#xA;Pipeline run with id=0d4d03ae-1846-40f7-a31a-6a58a6c0bf21 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0d4d03ae-1846-40f7-a31a-6a58a6c0bf21&#xA;Pipeline run with id=0d4d03ae-1846-40f7-a31a-6a58a6c0bf21 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0d4d03ae-1846-40f7-a31a-6a58a6c0bf21&#xA;Pipeline run with id=0d4d03ae-1846-40f7-a31a-6a58a6c0bf21 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0d4d03ae-1846-40f7-a31a-6a58a6c0bf21&#xA;Pipeline run with id=0d4d03ae-1846-40f7-a31a-6a58a6c0bf21 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0d4d03ae-1846-40f7-a31a-6a58a6c0bf21&#xA;Pipeline run with id=0d4d03ae-1846-40f7-a31a-6a58a6c0bf21 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0d4d03ae-1846-40f7-a31a-6a58a6c0bf21&#xA;Pipeline run with id=0d4d03ae-1846-40f7-a31a-6a58a6c0bf21 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0d4d03ae-1846-40f7-a31a-6a58a6c0bf21&#xA;Pipeline run with id=0d4d03ae-1846-40f7-a31a-6a58a6c0bf21 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0d4d03ae-1846-40f7-a31a-6a58a6c0bf21&#xA;Pipeline run with id=0d4d03ae-1846-40f7-a31a-6a58a6c0bf21 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0d4d03ae-1846-40f7-a31a-6a58a6c0bf21&#xA;Pipeline run with id=0d4d03ae-1846-40f7-a31a-6a58a6c0bf21 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0d4d03ae-1846-40f7-a31a-6a58a6c0bf21&#xA;Pipeline run with id=0d4d03ae-1846-40f7-a31a-6a58a6c0bf21 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0d4d03ae-1846-40f7-a31a-6a58a6c0bf21&#xA;Pipeline run with id=0d4d03ae-1846-40f7-a31a-6a58a6c0bf21 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0d4d03ae-1846-40f7-a31a-6a58a6c0bf21&#xA;Pipeline run with id=0d4d03ae-1846-40f7-a31a-6a58a6c0bf21 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0d4d03ae-1846-40f7-a31a-6a58a6c0bf21&#xA;Pipeline run with id=0d4d03ae-1846-40f7-a31a-6a58a6c0bf21 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0d4d03ae-1846-40f7-a31a-6a58a6c0bf21&#xA;Pipeline run with id=0d4d03ae-1846-40f7-a31a-6a58a6c0bf21 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0d4d03ae-1846-40f7-a31a-6a58a6c0bf21&#xA;Pipeline run with id=0d4d03ae-1846-40f7-a31a-6a58a6c0bf21 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;essential/iris_pipeline_compiled.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=0d4d03ae-1846-40f7-a31a-6a58a6c0bf21&#xA;Get a pipeline run with id=0d4d03ae-1846-40f7-a31a-6a58a6c0bf21&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/06/26 17:30:09.533 (2m35.666s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/06/26 17:30:09.533&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 0d4d03ae-1846-40f7-a31a-6a58a6c0bf21&#xA;Failed to terminate run 0d4d03ae-1846-40f7-a31a-6a58a6c0bf21&#xA;Terminate run 0d4d03ae-1846-40f7-a31a-6a58a6c0bf21&#xA;Deleting run 0d4d03ae-1846-40f7-a31a-6a58a6c0bf21&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=cedd4b69-cf47-497e-b467-e183857de8f9 (cascade=true)&#xA;Pipeline with id=cedd4b69-cf47-497e-b467-e183857de8f9, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/06/26 17:30:09.767 (233ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/06/26 17:30:09.767&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/06/26 17:30:09.767 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/06/26 17:30:09.767&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/06/26 17:30:09.767 (0s)&#xA;</system-err>
          </testcase>
      </testsuite>
  </testsuites>