<?xml version="1.0" encoding="UTF-8"?>
  <testsuites tests="5" disabled="0" errors="0" failures="0" time="201.33937934">
      <testsuite name="AIPipelinesE2ETests" package="/dspa/backend/test/end2end" tests="5" disabled="0" skipped="0" errors="0" failures="0" time="201.33937934" timestamp="2026-07-16T15:35:52">
          <properties>
              <property name="SuiteSucceeded" value="true"></property>
              <property name="SuiteHasProgrammaticFocus" value="false"></property>
              <property name="SpecialSuiteFailureReason" value=""></property>
              <property name="SuiteLabels" value="[]"></property>
              <property name="SuiteSemVerConstraints" value="[]"></property>
              <property name="RandomSeed" value="1784215981"></property>
              <property name="RandomizeAllSpecs" value="false"></property>
              <property name="LabelFilter" value="Smoke"></property>
              <property name="SemVerFilter" value=""></property>
              <property name="FocusStrings" value=""></property>
              <property name="SkipStrings" value=""></property>
              <property name="FocusFiles" value=""></property>
              <property name="SkipFiles" value=""></property>
              <property name="FailOnPending" value="false"></property>
              <property name="FailOnEmpty" value="false"></property>
              <property name="FailFast" value="false"></property>
              <property name="FlakeAttempts" value="0"></property>
              <property name="DryRun" value="false"></property>
              <property name="ParallelTotal" value="10"></property>
              <property name="OutputInterceptorMode" value=""></property>
          </properties>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload essential/component_with_pip_index_urls.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="46.237005295">
              <system-out>2026/07/16 15:36:38 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/16/26 15:35:52.406&#xA;Create an experiment with name E2EExperiment-1784216152406582745&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/16/26 15:35:52.714 (308ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/16/26 15:35:52.714&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x2843b22f8780&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/16/26 15:35:52.803 (89ms)&#xA;&gt; Enter [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/16/26 15:35:52.803&#xA;Uploading pipeline file essential/component_with_pip_index_urls.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1784216152714883031, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml&#xA;Upload of pipeline file &#39;essential/component_with_pip_index_urls.yaml&#39; successful&#xA;Listing pipeline versions for pipeline d6103782-5547-42b6-b21c-5e1c6b8d2f8b&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;d6103782-5547-42b6-b21c-5e1c6b8d2f8b&#39; and name: &#39;e2e-test-1784216152714883031&#39;&#xA;Create a pipeline run for pipeline with id=d6103782-5547-42b6-b21c-5e1c6b8d2f8b and versionId=e7f7f6cd-9850-4f8c-b5d9-5e3555b128c6&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=02db3c86-b962-4805-809a-dbc7c3844be3&#xA;Created Pipeline Run with id: 02db3c86-b962-4805-809a-dbc7c3844be3 for pipeline with id: d6103782-5547-42b6-b21c-5e1c6b8d2f8b&#xA;Waiting for pipeline run with id=02db3c86-b962-4805-809a-dbc7c3844be3 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=02db3c86-b962-4805-809a-dbc7c3844be3&#xA;Pipeline run with id=02db3c86-b962-4805-809a-dbc7c3844be3 is in PENDING state, waiting...&#xA;Get a pipeline run with id=02db3c86-b962-4805-809a-dbc7c3844be3&#xA;Pipeline run with id=02db3c86-b962-4805-809a-dbc7c3844be3 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=02db3c86-b962-4805-809a-dbc7c3844be3&#xA;Pipeline run with id=02db3c86-b962-4805-809a-dbc7c3844be3 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=02db3c86-b962-4805-809a-dbc7c3844be3&#xA;Pipeline run with id=02db3c86-b962-4805-809a-dbc7c3844be3 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=02db3c86-b962-4805-809a-dbc7c3844be3&#xA;Pipeline run with id=02db3c86-b962-4805-809a-dbc7c3844be3 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=02db3c86-b962-4805-809a-dbc7c3844be3&#xA;Pipeline run with id=02db3c86-b962-4805-809a-dbc7c3844be3 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=02db3c86-b962-4805-809a-dbc7c3844be3&#xA;Pipeline run with id=02db3c86-b962-4805-809a-dbc7c3844be3 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=02db3c86-b962-4805-809a-dbc7c3844be3&#xA;Pipeline run with id=02db3c86-b962-4805-809a-dbc7c3844be3 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=02db3c86-b962-4805-809a-dbc7c3844be3&#xA;Pipeline run with id=02db3c86-b962-4805-809a-dbc7c3844be3 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=02db3c86-b962-4805-809a-dbc7c3844be3&#xA;Pipeline run with id=02db3c86-b962-4805-809a-dbc7c3844be3 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;essential/component_with_pip_index_urls.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=02db3c86-b962-4805-809a-dbc7c3844be3&#xA;Get a pipeline run with id=02db3c86-b962-4805-809a-dbc7c3844be3&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/16/26 15:36:38.478 (45.675s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/16/26 15:36:38.479&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 02db3c86-b962-4805-809a-dbc7c3844be3&#xA;Failed to terminate run 02db3c86-b962-4805-809a-dbc7c3844be3&#xA;Terminate run 02db3c86-b962-4805-809a-dbc7c3844be3&#xA;Deleting run 02db3c86-b962-4805-809a-dbc7c3844be3&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=d6103782-5547-42b6-b21c-5e1c6b8d2f8b (cascade=true)&#xA;Pipeline with id=d6103782-5547-42b6-b21c-5e1c6b8d2f8b, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/16/26 15:36:38.643 (164ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/16/26 15:36:38.643&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/16/26 15:36:38.644 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/16/26 15:36:38.644&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/16/26 15:36:38.644 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/parallel_for_after_dependency.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="96.319226822">
              <system-out>2026/07/16 15:37:28 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/16/26 15:35:52.406&#xA;Create an experiment with name E2EExperiment-1784216152406110599&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/16/26 15:35:52.713 (307ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/16/26 15:35:52.713&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0xbf2f73c600&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/16/26 15:35:52.803 (90ms)&#xA;&gt; Enter [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/16/26 15:35:52.803&#xA;Uploading pipeline file critical/parallel_for_after_dependency.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1784216152713341724, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml&#xA;Upload of pipeline file &#39;critical/parallel_for_after_dependency.yaml&#39; successful&#xA;Listing pipeline versions for pipeline b448fd98-1c39-4c7e-ab30-c611810498bb&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;b448fd98-1c39-4c7e-ab30-c611810498bb&#39; and name: &#39;e2e-test-1784216152713341724&#39;&#xA;Create a pipeline run for pipeline with id=b448fd98-1c39-4c7e-ab30-c611810498bb and versionId=8521d4df-2b24-4cb4-a768-356ccf6f18dc&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=f44c7608-310d-4ca6-8479-95fb0066dc25&#xA;Created Pipeline Run with id: f44c7608-310d-4ca6-8479-95fb0066dc25 for pipeline with id: b448fd98-1c39-4c7e-ab30-c611810498bb&#xA;Waiting for pipeline run with id=f44c7608-310d-4ca6-8479-95fb0066dc25 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=f44c7608-310d-4ca6-8479-95fb0066dc25&#xA;Pipeline run with id=f44c7608-310d-4ca6-8479-95fb0066dc25 is in PENDING state, waiting...&#xA;Get a pipeline run with id=f44c7608-310d-4ca6-8479-95fb0066dc25&#xA;Pipeline run with id=f44c7608-310d-4ca6-8479-95fb0066dc25 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f44c7608-310d-4ca6-8479-95fb0066dc25&#xA;Pipeline run with id=f44c7608-310d-4ca6-8479-95fb0066dc25 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f44c7608-310d-4ca6-8479-95fb0066dc25&#xA;Pipeline run with id=f44c7608-310d-4ca6-8479-95fb0066dc25 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f44c7608-310d-4ca6-8479-95fb0066dc25&#xA;Pipeline run with id=f44c7608-310d-4ca6-8479-95fb0066dc25 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f44c7608-310d-4ca6-8479-95fb0066dc25&#xA;Pipeline run with id=f44c7608-310d-4ca6-8479-95fb0066dc25 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f44c7608-310d-4ca6-8479-95fb0066dc25&#xA;Pipeline run with id=f44c7608-310d-4ca6-8479-95fb0066dc25 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f44c7608-310d-4ca6-8479-95fb0066dc25&#xA;Pipeline run with id=f44c7608-310d-4ca6-8479-95fb0066dc25 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f44c7608-310d-4ca6-8479-95fb0066dc25&#xA;Pipeline run with id=f44c7608-310d-4ca6-8479-95fb0066dc25 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f44c7608-310d-4ca6-8479-95fb0066dc25&#xA;Pipeline run with id=f44c7608-310d-4ca6-8479-95fb0066dc25 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f44c7608-310d-4ca6-8479-95fb0066dc25&#xA;Pipeline run with id=f44c7608-310d-4ca6-8479-95fb0066dc25 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f44c7608-310d-4ca6-8479-95fb0066dc25&#xA;Pipeline run with id=f44c7608-310d-4ca6-8479-95fb0066dc25 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f44c7608-310d-4ca6-8479-95fb0066dc25&#xA;Pipeline run with id=f44c7608-310d-4ca6-8479-95fb0066dc25 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f44c7608-310d-4ca6-8479-95fb0066dc25&#xA;Pipeline run with id=f44c7608-310d-4ca6-8479-95fb0066dc25 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f44c7608-310d-4ca6-8479-95fb0066dc25&#xA;Pipeline run with id=f44c7608-310d-4ca6-8479-95fb0066dc25 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f44c7608-310d-4ca6-8479-95fb0066dc25&#xA;Pipeline run with id=f44c7608-310d-4ca6-8479-95fb0066dc25 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f44c7608-310d-4ca6-8479-95fb0066dc25&#xA;Pipeline run with id=f44c7608-310d-4ca6-8479-95fb0066dc25 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f44c7608-310d-4ca6-8479-95fb0066dc25&#xA;Pipeline run with id=f44c7608-310d-4ca6-8479-95fb0066dc25 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f44c7608-310d-4ca6-8479-95fb0066dc25&#xA;Pipeline run with id=f44c7608-310d-4ca6-8479-95fb0066dc25 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f44c7608-310d-4ca6-8479-95fb0066dc25&#xA;Pipeline run with id=f44c7608-310d-4ca6-8479-95fb0066dc25 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/parallel_for_after_dependency.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=f44c7608-310d-4ca6-8479-95fb0066dc25&#xA;Get a pipeline run with id=f44c7608-310d-4ca6-8479-95fb0066dc25&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/16/26 15:37:28.494 (1m35.691s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/16/26 15:37:28.494&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run f44c7608-310d-4ca6-8479-95fb0066dc25&#xA;Failed to terminate run f44c7608-310d-4ca6-8479-95fb0066dc25&#xA;Terminate run f44c7608-310d-4ca6-8479-95fb0066dc25&#xA;Deleting run f44c7608-310d-4ca6-8479-95fb0066dc25&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=b448fd98-1c39-4c7e-ab30-c611810498bb (cascade=true)&#xA;Pipeline with id=b448fd98-1c39-4c7e-ab30-c611810498bb, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/16/26 15:37:28.725 (231ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/16/26 15:37:28.725&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/16/26 15:37:28.725 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/16/26 15:37:28.725&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/16/26 15:37:28.725 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/pipeline_with_artifact_upload_download.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="101.266397202">
              <system-out>2026/07/16 15:37:33 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/16/26 15:35:52.406&#xA;Create an experiment with name E2EExperiment-1784216152406594856&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/16/26 15:35:52.717 (310ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/16/26 15:35:52.717&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x383a2f0ce80&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/16/26 15:35:52.796 (79ms)&#xA;&gt; Enter [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/16/26 15:35:52.796&#xA;Uploading pipeline file critical/pipeline_with_artifact_upload_download.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1784216152717214394, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml&#xA;Upload of pipeline file &#39;critical/pipeline_with_artifact_upload_download.yaml&#39; successful&#xA;Listing pipeline versions for pipeline d916ec59-9823-4b2e-9fa4-7dba53385c03&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;d916ec59-9823-4b2e-9fa4-7dba53385c03&#39; and name: &#39;e2e-test-1784216152717214394&#39;&#xA;Create a pipeline run for pipeline with id=d916ec59-9823-4b2e-9fa4-7dba53385c03 and versionId=666c4eca-5792-4e4a-b0dc-bc7c29e43e17&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=c5a0b14d-e9b5-43da-879a-312260e8f4bb&#xA;Created Pipeline Run with id: c5a0b14d-e9b5-43da-879a-312260e8f4bb for pipeline with id: d916ec59-9823-4b2e-9fa4-7dba53385c03&#xA;Waiting for pipeline run with id=c5a0b14d-e9b5-43da-879a-312260e8f4bb to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=c5a0b14d-e9b5-43da-879a-312260e8f4bb&#xA;Pipeline run with id=c5a0b14d-e9b5-43da-879a-312260e8f4bb is in PENDING state, waiting...&#xA;Get a pipeline run with id=c5a0b14d-e9b5-43da-879a-312260e8f4bb&#xA;Pipeline run with id=c5a0b14d-e9b5-43da-879a-312260e8f4bb is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c5a0b14d-e9b5-43da-879a-312260e8f4bb&#xA;Pipeline run with id=c5a0b14d-e9b5-43da-879a-312260e8f4bb is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c5a0b14d-e9b5-43da-879a-312260e8f4bb&#xA;Pipeline run with id=c5a0b14d-e9b5-43da-879a-312260e8f4bb is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c5a0b14d-e9b5-43da-879a-312260e8f4bb&#xA;Pipeline run with id=c5a0b14d-e9b5-43da-879a-312260e8f4bb is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c5a0b14d-e9b5-43da-879a-312260e8f4bb&#xA;Pipeline run with id=c5a0b14d-e9b5-43da-879a-312260e8f4bb is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c5a0b14d-e9b5-43da-879a-312260e8f4bb&#xA;Pipeline run with id=c5a0b14d-e9b5-43da-879a-312260e8f4bb is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c5a0b14d-e9b5-43da-879a-312260e8f4bb&#xA;Pipeline run with id=c5a0b14d-e9b5-43da-879a-312260e8f4bb is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c5a0b14d-e9b5-43da-879a-312260e8f4bb&#xA;Pipeline run with id=c5a0b14d-e9b5-43da-879a-312260e8f4bb is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c5a0b14d-e9b5-43da-879a-312260e8f4bb&#xA;Pipeline run with id=c5a0b14d-e9b5-43da-879a-312260e8f4bb is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c5a0b14d-e9b5-43da-879a-312260e8f4bb&#xA;Pipeline run with id=c5a0b14d-e9b5-43da-879a-312260e8f4bb is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c5a0b14d-e9b5-43da-879a-312260e8f4bb&#xA;Pipeline run with id=c5a0b14d-e9b5-43da-879a-312260e8f4bb is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c5a0b14d-e9b5-43da-879a-312260e8f4bb&#xA;Pipeline run with id=c5a0b14d-e9b5-43da-879a-312260e8f4bb is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c5a0b14d-e9b5-43da-879a-312260e8f4bb&#xA;Pipeline run with id=c5a0b14d-e9b5-43da-879a-312260e8f4bb is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c5a0b14d-e9b5-43da-879a-312260e8f4bb&#xA;Pipeline run with id=c5a0b14d-e9b5-43da-879a-312260e8f4bb is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c5a0b14d-e9b5-43da-879a-312260e8f4bb&#xA;Pipeline run with id=c5a0b14d-e9b5-43da-879a-312260e8f4bb is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c5a0b14d-e9b5-43da-879a-312260e8f4bb&#xA;Pipeline run with id=c5a0b14d-e9b5-43da-879a-312260e8f4bb is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c5a0b14d-e9b5-43da-879a-312260e8f4bb&#xA;Pipeline run with id=c5a0b14d-e9b5-43da-879a-312260e8f4bb is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c5a0b14d-e9b5-43da-879a-312260e8f4bb&#xA;Pipeline run with id=c5a0b14d-e9b5-43da-879a-312260e8f4bb is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c5a0b14d-e9b5-43da-879a-312260e8f4bb&#xA;Pipeline run with id=c5a0b14d-e9b5-43da-879a-312260e8f4bb is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c5a0b14d-e9b5-43da-879a-312260e8f4bb&#xA;Pipeline run with id=c5a0b14d-e9b5-43da-879a-312260e8f4bb reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/pipeline_with_artifact_upload_download.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=c5a0b14d-e9b5-43da-879a-312260e8f4bb&#xA;Get a pipeline run with id=c5a0b14d-e9b5-43da-879a-312260e8f4bb&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/16/26 15:37:33.503 (1m40.707s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/16/26 15:37:33.503&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run c5a0b14d-e9b5-43da-879a-312260e8f4bb&#xA;Failed to terminate run c5a0b14d-e9b5-43da-879a-312260e8f4bb&#xA;Terminate run c5a0b14d-e9b5-43da-879a-312260e8f4bb&#xA;Deleting run c5a0b14d-e9b5-43da-879a-312260e8f4bb&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=d916ec59-9823-4b2e-9fa4-7dba53385c03 (cascade=true)&#xA;Pipeline with id=d916ec59-9823-4b2e-9fa4-7dba53385c03, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/16/26 15:37:33.672 (169ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/16/26 15:37:33.673&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/16/26 15:37:33.673 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/16/26 15:37:33.673&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/16/26 15:37:33.673 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/flip_coin.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="131.381088772">
              <system-out>2026/07/16 15:38:03 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/16/26 15:35:52.406&#xA;Create an experiment with name E2EExperiment-1784216152406084307&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/16/26 15:35:52.714 (309ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/16/26 15:35:52.714&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x1bbf7b0e0a80&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/16/26 15:35:52.802 (88ms)&#xA;&gt; Enter [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/16/26 15:35:52.802&#xA;Uploading pipeline file critical/flip_coin.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1784216152714830678, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml&#xA;Upload of pipeline file &#39;critical/flip_coin.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 3a481e7e-510d-4b13-95a7-b88a0f56a7c1&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;3a481e7e-510d-4b13-95a7-b88a0f56a7c1&#39; and name: &#39;e2e-test-1784216152714830678&#39;&#xA;Create a pipeline run for pipeline with id=3a481e7e-510d-4b13-95a7-b88a0f56a7c1 and versionId=b88dd02d-e044-458c-a88d-2a9865a21395&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=ee1fce4a-1e4d-4c69-9704-fa11e68bbdda&#xA;Created Pipeline Run with id: ee1fce4a-1e4d-4c69-9704-fa11e68bbdda for pipeline with id: 3a481e7e-510d-4b13-95a7-b88a0f56a7c1&#xA;Waiting for pipeline run with id=ee1fce4a-1e4d-4c69-9704-fa11e68bbdda to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=ee1fce4a-1e4d-4c69-9704-fa11e68bbdda&#xA;Pipeline run with id=ee1fce4a-1e4d-4c69-9704-fa11e68bbdda is in PENDING state, waiting...&#xA;Get a pipeline run with id=ee1fce4a-1e4d-4c69-9704-fa11e68bbdda&#xA;Pipeline run with id=ee1fce4a-1e4d-4c69-9704-fa11e68bbdda is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ee1fce4a-1e4d-4c69-9704-fa11e68bbdda&#xA;Pipeline run with id=ee1fce4a-1e4d-4c69-9704-fa11e68bbdda is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ee1fce4a-1e4d-4c69-9704-fa11e68bbdda&#xA;Pipeline run with id=ee1fce4a-1e4d-4c69-9704-fa11e68bbdda is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ee1fce4a-1e4d-4c69-9704-fa11e68bbdda&#xA;Pipeline run with id=ee1fce4a-1e4d-4c69-9704-fa11e68bbdda is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ee1fce4a-1e4d-4c69-9704-fa11e68bbdda&#xA;Pipeline run with id=ee1fce4a-1e4d-4c69-9704-fa11e68bbdda is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ee1fce4a-1e4d-4c69-9704-fa11e68bbdda&#xA;Pipeline run with id=ee1fce4a-1e4d-4c69-9704-fa11e68bbdda is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ee1fce4a-1e4d-4c69-9704-fa11e68bbdda&#xA;Pipeline run with id=ee1fce4a-1e4d-4c69-9704-fa11e68bbdda is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ee1fce4a-1e4d-4c69-9704-fa11e68bbdda&#xA;Pipeline run with id=ee1fce4a-1e4d-4c69-9704-fa11e68bbdda is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ee1fce4a-1e4d-4c69-9704-fa11e68bbdda&#xA;Pipeline run with id=ee1fce4a-1e4d-4c69-9704-fa11e68bbdda is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ee1fce4a-1e4d-4c69-9704-fa11e68bbdda&#xA;Pipeline run with id=ee1fce4a-1e4d-4c69-9704-fa11e68bbdda is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ee1fce4a-1e4d-4c69-9704-fa11e68bbdda&#xA;Pipeline run with id=ee1fce4a-1e4d-4c69-9704-fa11e68bbdda is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ee1fce4a-1e4d-4c69-9704-fa11e68bbdda&#xA;Pipeline run with id=ee1fce4a-1e4d-4c69-9704-fa11e68bbdda is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ee1fce4a-1e4d-4c69-9704-fa11e68bbdda&#xA;Pipeline run with id=ee1fce4a-1e4d-4c69-9704-fa11e68bbdda is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ee1fce4a-1e4d-4c69-9704-fa11e68bbdda&#xA;Pipeline run with id=ee1fce4a-1e4d-4c69-9704-fa11e68bbdda is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ee1fce4a-1e4d-4c69-9704-fa11e68bbdda&#xA;Pipeline run with id=ee1fce4a-1e4d-4c69-9704-fa11e68bbdda is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ee1fce4a-1e4d-4c69-9704-fa11e68bbdda&#xA;Pipeline run with id=ee1fce4a-1e4d-4c69-9704-fa11e68bbdda is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ee1fce4a-1e4d-4c69-9704-fa11e68bbdda&#xA;Pipeline run with id=ee1fce4a-1e4d-4c69-9704-fa11e68bbdda is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ee1fce4a-1e4d-4c69-9704-fa11e68bbdda&#xA;Pipeline run with id=ee1fce4a-1e4d-4c69-9704-fa11e68bbdda is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ee1fce4a-1e4d-4c69-9704-fa11e68bbdda&#xA;Pipeline run with id=ee1fce4a-1e4d-4c69-9704-fa11e68bbdda is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ee1fce4a-1e4d-4c69-9704-fa11e68bbdda&#xA;Pipeline run with id=ee1fce4a-1e4d-4c69-9704-fa11e68bbdda is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ee1fce4a-1e4d-4c69-9704-fa11e68bbdda&#xA;Pipeline run with id=ee1fce4a-1e4d-4c69-9704-fa11e68bbdda is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ee1fce4a-1e4d-4c69-9704-fa11e68bbdda&#xA;Pipeline run with id=ee1fce4a-1e4d-4c69-9704-fa11e68bbdda is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ee1fce4a-1e4d-4c69-9704-fa11e68bbdda&#xA;Pipeline run with id=ee1fce4a-1e4d-4c69-9704-fa11e68bbdda is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ee1fce4a-1e4d-4c69-9704-fa11e68bbdda&#xA;Pipeline run with id=ee1fce4a-1e4d-4c69-9704-fa11e68bbdda is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ee1fce4a-1e4d-4c69-9704-fa11e68bbdda&#xA;Pipeline run with id=ee1fce4a-1e4d-4c69-9704-fa11e68bbdda is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ee1fce4a-1e4d-4c69-9704-fa11e68bbdda&#xA;Pipeline run with id=ee1fce4a-1e4d-4c69-9704-fa11e68bbdda reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/flip_coin.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=ee1fce4a-1e4d-4c69-9704-fa11e68bbdda&#xA;Get a pipeline run with id=ee1fce4a-1e4d-4c69-9704-fa11e68bbdda&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/16/26 15:38:03.539 (2m10.737s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/16/26 15:38:03.54&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run ee1fce4a-1e4d-4c69-9704-fa11e68bbdda&#xA;Failed to terminate run ee1fce4a-1e4d-4c69-9704-fa11e68bbdda&#xA;Terminate run ee1fce4a-1e4d-4c69-9704-fa11e68bbdda&#xA;Deleting run ee1fce4a-1e4d-4c69-9704-fa11e68bbdda&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=3a481e7e-510d-4b13-95a7-b88a0f56a7c1 (cascade=true)&#xA;Pipeline with id=3a481e7e-510d-4b13-95a7-b88a0f56a7c1, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/16/26 15:38:03.787 (247ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/16/26 15:38:03.787&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/16/26 15:38:03.787 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/16/26 15:38:03.787&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/16/26 15:38:03.787 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload essential/iris_pipeline_compiled.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="201.219247881">
              <system-out>2026/07/16 15:39:13 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/16/26 15:35:52.411&#xA;Create an experiment with name E2EExperiment-1784216152411583220&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/16/26 15:35:52.713 (302ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/16/26 15:35:52.713&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x14ae6aea6900&#xA;test-secret-1 created&#xA;test-secret-2 created&#xA;test-secret-3 created&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/16/26 15:35:52.758 (45ms)&#xA;&gt; Enter [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/16/26 15:35:52.758&#xA;Uploading pipeline file essential/iris_pipeline_compiled.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1784216152713311332, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml&#xA;Upload of pipeline file &#39;essential/iris_pipeline_compiled.yaml&#39; successful&#xA;Listing pipeline versions for pipeline feb8b955-597e-46cf-b9d0-dd8a4a4b6cad&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;feb8b955-597e-46cf-b9d0-dd8a4a4b6cad&#39; and name: &#39;e2e-test-1784216152713311332&#39;&#xA;Create a pipeline run for pipeline with id=feb8b955-597e-46cf-b9d0-dd8a4a4b6cad and versionId=3ad34db6-f67f-43d1-8f3f-dfdb8f630ccc&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=ecd095a0-a7a3-41ad-aeac-753d56e62bc9&#xA;Created Pipeline Run with id: ecd095a0-a7a3-41ad-aeac-753d56e62bc9 for pipeline with id: feb8b955-597e-46cf-b9d0-dd8a4a4b6cad&#xA;Waiting for pipeline run with id=ecd095a0-a7a3-41ad-aeac-753d56e62bc9 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=ecd095a0-a7a3-41ad-aeac-753d56e62bc9&#xA;Pipeline run with id=ecd095a0-a7a3-41ad-aeac-753d56e62bc9 is in PENDING state, waiting...&#xA;Get a pipeline run with id=ecd095a0-a7a3-41ad-aeac-753d56e62bc9&#xA;Pipeline run with id=ecd095a0-a7a3-41ad-aeac-753d56e62bc9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ecd095a0-a7a3-41ad-aeac-753d56e62bc9&#xA;Pipeline run with id=ecd095a0-a7a3-41ad-aeac-753d56e62bc9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ecd095a0-a7a3-41ad-aeac-753d56e62bc9&#xA;Pipeline run with id=ecd095a0-a7a3-41ad-aeac-753d56e62bc9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ecd095a0-a7a3-41ad-aeac-753d56e62bc9&#xA;Pipeline run with id=ecd095a0-a7a3-41ad-aeac-753d56e62bc9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ecd095a0-a7a3-41ad-aeac-753d56e62bc9&#xA;Pipeline run with id=ecd095a0-a7a3-41ad-aeac-753d56e62bc9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ecd095a0-a7a3-41ad-aeac-753d56e62bc9&#xA;Pipeline run with id=ecd095a0-a7a3-41ad-aeac-753d56e62bc9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ecd095a0-a7a3-41ad-aeac-753d56e62bc9&#xA;Pipeline run with id=ecd095a0-a7a3-41ad-aeac-753d56e62bc9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ecd095a0-a7a3-41ad-aeac-753d56e62bc9&#xA;Pipeline run with id=ecd095a0-a7a3-41ad-aeac-753d56e62bc9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ecd095a0-a7a3-41ad-aeac-753d56e62bc9&#xA;Pipeline run with id=ecd095a0-a7a3-41ad-aeac-753d56e62bc9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ecd095a0-a7a3-41ad-aeac-753d56e62bc9&#xA;Pipeline run with id=ecd095a0-a7a3-41ad-aeac-753d56e62bc9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ecd095a0-a7a3-41ad-aeac-753d56e62bc9&#xA;Pipeline run with id=ecd095a0-a7a3-41ad-aeac-753d56e62bc9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ecd095a0-a7a3-41ad-aeac-753d56e62bc9&#xA;Pipeline run with id=ecd095a0-a7a3-41ad-aeac-753d56e62bc9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ecd095a0-a7a3-41ad-aeac-753d56e62bc9&#xA;Pipeline run with id=ecd095a0-a7a3-41ad-aeac-753d56e62bc9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ecd095a0-a7a3-41ad-aeac-753d56e62bc9&#xA;Pipeline run with id=ecd095a0-a7a3-41ad-aeac-753d56e62bc9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ecd095a0-a7a3-41ad-aeac-753d56e62bc9&#xA;Pipeline run with id=ecd095a0-a7a3-41ad-aeac-753d56e62bc9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ecd095a0-a7a3-41ad-aeac-753d56e62bc9&#xA;Pipeline run with id=ecd095a0-a7a3-41ad-aeac-753d56e62bc9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ecd095a0-a7a3-41ad-aeac-753d56e62bc9&#xA;Pipeline run with id=ecd095a0-a7a3-41ad-aeac-753d56e62bc9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ecd095a0-a7a3-41ad-aeac-753d56e62bc9&#xA;Pipeline run with id=ecd095a0-a7a3-41ad-aeac-753d56e62bc9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ecd095a0-a7a3-41ad-aeac-753d56e62bc9&#xA;Pipeline run with id=ecd095a0-a7a3-41ad-aeac-753d56e62bc9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ecd095a0-a7a3-41ad-aeac-753d56e62bc9&#xA;Pipeline run with id=ecd095a0-a7a3-41ad-aeac-753d56e62bc9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ecd095a0-a7a3-41ad-aeac-753d56e62bc9&#xA;Pipeline run with id=ecd095a0-a7a3-41ad-aeac-753d56e62bc9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ecd095a0-a7a3-41ad-aeac-753d56e62bc9&#xA;Pipeline run with id=ecd095a0-a7a3-41ad-aeac-753d56e62bc9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ecd095a0-a7a3-41ad-aeac-753d56e62bc9&#xA;Pipeline run with id=ecd095a0-a7a3-41ad-aeac-753d56e62bc9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ecd095a0-a7a3-41ad-aeac-753d56e62bc9&#xA;Pipeline run with id=ecd095a0-a7a3-41ad-aeac-753d56e62bc9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ecd095a0-a7a3-41ad-aeac-753d56e62bc9&#xA;Pipeline run with id=ecd095a0-a7a3-41ad-aeac-753d56e62bc9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ecd095a0-a7a3-41ad-aeac-753d56e62bc9&#xA;Pipeline run with id=ecd095a0-a7a3-41ad-aeac-753d56e62bc9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ecd095a0-a7a3-41ad-aeac-753d56e62bc9&#xA;Pipeline run with id=ecd095a0-a7a3-41ad-aeac-753d56e62bc9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ecd095a0-a7a3-41ad-aeac-753d56e62bc9&#xA;Pipeline run with id=ecd095a0-a7a3-41ad-aeac-753d56e62bc9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ecd095a0-a7a3-41ad-aeac-753d56e62bc9&#xA;Pipeline run with id=ecd095a0-a7a3-41ad-aeac-753d56e62bc9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ecd095a0-a7a3-41ad-aeac-753d56e62bc9&#xA;Pipeline run with id=ecd095a0-a7a3-41ad-aeac-753d56e62bc9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ecd095a0-a7a3-41ad-aeac-753d56e62bc9&#xA;Pipeline run with id=ecd095a0-a7a3-41ad-aeac-753d56e62bc9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ecd095a0-a7a3-41ad-aeac-753d56e62bc9&#xA;Pipeline run with id=ecd095a0-a7a3-41ad-aeac-753d56e62bc9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ecd095a0-a7a3-41ad-aeac-753d56e62bc9&#xA;Pipeline run with id=ecd095a0-a7a3-41ad-aeac-753d56e62bc9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ecd095a0-a7a3-41ad-aeac-753d56e62bc9&#xA;Pipeline run with id=ecd095a0-a7a3-41ad-aeac-753d56e62bc9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ecd095a0-a7a3-41ad-aeac-753d56e62bc9&#xA;Pipeline run with id=ecd095a0-a7a3-41ad-aeac-753d56e62bc9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ecd095a0-a7a3-41ad-aeac-753d56e62bc9&#xA;Pipeline run with id=ecd095a0-a7a3-41ad-aeac-753d56e62bc9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ecd095a0-a7a3-41ad-aeac-753d56e62bc9&#xA;Pipeline run with id=ecd095a0-a7a3-41ad-aeac-753d56e62bc9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ecd095a0-a7a3-41ad-aeac-753d56e62bc9&#xA;Pipeline run with id=ecd095a0-a7a3-41ad-aeac-753d56e62bc9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ecd095a0-a7a3-41ad-aeac-753d56e62bc9&#xA;Pipeline run with id=ecd095a0-a7a3-41ad-aeac-753d56e62bc9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ecd095a0-a7a3-41ad-aeac-753d56e62bc9&#xA;Pipeline run with id=ecd095a0-a7a3-41ad-aeac-753d56e62bc9 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;essential/iris_pipeline_compiled.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=ecd095a0-a7a3-41ad-aeac-753d56e62bc9&#xA;Get a pipeline run with id=ecd095a0-a7a3-41ad-aeac-753d56e62bc9&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/16/26 15:39:13.474 (3m20.716s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/16/26 15:39:13.474&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run ecd095a0-a7a3-41ad-aeac-753d56e62bc9&#xA;Failed to terminate run ecd095a0-a7a3-41ad-aeac-753d56e62bc9&#xA;Terminate run ecd095a0-a7a3-41ad-aeac-753d56e62bc9&#xA;Deleting run ecd095a0-a7a3-41ad-aeac-753d56e62bc9&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=feb8b955-597e-46cf-b9d0-dd8a4a4b6cad (cascade=true)&#xA;Pipeline with id=feb8b955-597e-46cf-b9d0-dd8a4a4b6cad, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/16/26 15:39:13.63 (157ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/16/26 15:39:13.631&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/16/26 15:39:13.631 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/16/26 15:39:13.631&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/16/26 15:39:13.631 (0s)&#xA;</system-err>
          </testcase>
      </testsuite>
  </testsuites>