<?xml version="1.0" encoding="UTF-8"?>
  <testsuites tests="5" disabled="0" errors="0" failures="0" time="156.306597038">
      <testsuite name="AIPipelinesE2ETests" package="/dspa/backend/test/end2end" tests="5" disabled="0" skipped="0" errors="0" failures="0" time="156.306597038" timestamp="2026-07-05T05:55:35">
          <properties>
              <property name="SuiteSucceeded" value="true"></property>
              <property name="SuiteHasProgrammaticFocus" value="false"></property>
              <property name="SpecialSuiteFailureReason" value=""></property>
              <property name="SuiteLabels" value="[]"></property>
              <property name="SuiteSemVerConstraints" value="[]"></property>
              <property name="RandomSeed" value="1783230725"></property>
              <property name="RandomizeAllSpecs" value="false"></property>
              <property name="LabelFilter" value="Smoke"></property>
              <property name="SemVerFilter" value=""></property>
              <property name="FocusStrings" value=""></property>
              <property name="SkipStrings" value=""></property>
              <property name="FocusFiles" value=""></property>
              <property name="SkipFiles" value=""></property>
              <property name="FailOnPending" value="false"></property>
              <property name="FailOnEmpty" value="false"></property>
              <property name="FailFast" value="false"></property>
              <property name="FlakeAttempts" value="0"></property>
              <property name="DryRun" value="false"></property>
              <property name="ParallelTotal" value="10"></property>
              <property name="OutputInterceptorMode" value=""></property>
          </properties>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload essential/component_with_pip_index_urls.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="46.28386632">
              <system-out>2026/07/05 05:56:21 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/05/26 05:55:35.333&#xA;Create an experiment with name E2EExperiment-1783230935333379797&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/05/26 05:55:35.613 (280ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/05/26 05:55:35.614&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x18d93a1d6000&#xA;test-secret-1 created&#xA;test-secret-2 created&#xA;test-secret-3 created&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/05/26 05:55:35.69 (76ms)&#xA;&gt; Enter [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/05/26 05:55:35.69&#xA;Uploading pipeline file essential/component_with_pip_index_urls.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1783230935614112376, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml&#xA;Upload of pipeline file &#39;essential/component_with_pip_index_urls.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 5b268b4b-8a8c-42ea-b972-74cd8a760fd0&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;5b268b4b-8a8c-42ea-b972-74cd8a760fd0&#39; and name: &#39;e2e-test-1783230935614112376&#39;&#xA;Create a pipeline run for pipeline with id=5b268b4b-8a8c-42ea-b972-74cd8a760fd0 and versionId=02e06fc0-7f0a-4c53-bae6-5e80b66a315d&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=d00fcede-359c-4c8f-b54c-221c405ebf8f&#xA;Created Pipeline Run with id: d00fcede-359c-4c8f-b54c-221c405ebf8f for pipeline with id: 5b268b4b-8a8c-42ea-b972-74cd8a760fd0&#xA;Waiting for pipeline run with id=d00fcede-359c-4c8f-b54c-221c405ebf8f to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=d00fcede-359c-4c8f-b54c-221c405ebf8f&#xA;Pipeline run with id=d00fcede-359c-4c8f-b54c-221c405ebf8f is in PENDING state, waiting...&#xA;Get a pipeline run with id=d00fcede-359c-4c8f-b54c-221c405ebf8f&#xA;Pipeline run with id=d00fcede-359c-4c8f-b54c-221c405ebf8f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d00fcede-359c-4c8f-b54c-221c405ebf8f&#xA;Pipeline run with id=d00fcede-359c-4c8f-b54c-221c405ebf8f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d00fcede-359c-4c8f-b54c-221c405ebf8f&#xA;Pipeline run with id=d00fcede-359c-4c8f-b54c-221c405ebf8f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d00fcede-359c-4c8f-b54c-221c405ebf8f&#xA;Pipeline run with id=d00fcede-359c-4c8f-b54c-221c405ebf8f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d00fcede-359c-4c8f-b54c-221c405ebf8f&#xA;Pipeline run with id=d00fcede-359c-4c8f-b54c-221c405ebf8f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d00fcede-359c-4c8f-b54c-221c405ebf8f&#xA;Pipeline run with id=d00fcede-359c-4c8f-b54c-221c405ebf8f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d00fcede-359c-4c8f-b54c-221c405ebf8f&#xA;Pipeline run with id=d00fcede-359c-4c8f-b54c-221c405ebf8f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d00fcede-359c-4c8f-b54c-221c405ebf8f&#xA;Pipeline run with id=d00fcede-359c-4c8f-b54c-221c405ebf8f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d00fcede-359c-4c8f-b54c-221c405ebf8f&#xA;Pipeline run with id=d00fcede-359c-4c8f-b54c-221c405ebf8f reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;essential/component_with_pip_index_urls.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=d00fcede-359c-4c8f-b54c-221c405ebf8f&#xA;Get a pipeline run with id=d00fcede-359c-4c8f-b54c-221c405ebf8f&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/05/26 05:56:21.186 (45.496s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/05/26 05:56:21.186&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run d00fcede-359c-4c8f-b54c-221c405ebf8f&#xA;Failed to terminate run d00fcede-359c-4c8f-b54c-221c405ebf8f&#xA;Terminate run d00fcede-359c-4c8f-b54c-221c405ebf8f&#xA;Deleting run d00fcede-359c-4c8f-b54c-221c405ebf8f&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=5b268b4b-8a8c-42ea-b972-74cd8a760fd0 (cascade=true)&#xA;Pipeline with id=5b268b4b-8a8c-42ea-b972-74cd8a760fd0, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/05/26 05:56:21.617 (431ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/05/26 05:56:21.617&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/05/26 05:56:21.617 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/05/26 05:56:21.617&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/05/26 05:56:21.617 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/pipeline_with_artifact_upload_download.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="96.092933688">
              <system-out>2026/07/05 05:57:11 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/05/26 05:55:35.333&#xA;Create an experiment with name E2EExperiment-1783230935333401118&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/05/26 05:55:35.613 (280ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/05/26 05:55:35.614&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x1bbc9a374680&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/05/26 05:55:35.756 (142ms)&#xA;&gt; Enter [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/05/26 05:55:35.756&#xA;Uploading pipeline file critical/pipeline_with_artifact_upload_download.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1783230935614175260, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml&#xA;Upload of pipeline file &#39;critical/pipeline_with_artifact_upload_download.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 5bacf5f9-8a7d-4f03-ad61-055742c2eebc&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;5bacf5f9-8a7d-4f03-ad61-055742c2eebc&#39; and name: &#39;e2e-test-1783230935614175260&#39;&#xA;Create a pipeline run for pipeline with id=5bacf5f9-8a7d-4f03-ad61-055742c2eebc and versionId=eceacd5d-0718-4690-ade2-38b816237c49&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=c5d7c67a-e877-4582-9079-164a599c7cf6&#xA;Created Pipeline Run with id: c5d7c67a-e877-4582-9079-164a599c7cf6 for pipeline with id: 5bacf5f9-8a7d-4f03-ad61-055742c2eebc&#xA;Waiting for pipeline run with id=c5d7c67a-e877-4582-9079-164a599c7cf6 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=c5d7c67a-e877-4582-9079-164a599c7cf6&#xA;Pipeline run with id=c5d7c67a-e877-4582-9079-164a599c7cf6 is in PENDING state, waiting...&#xA;Get a pipeline run with id=c5d7c67a-e877-4582-9079-164a599c7cf6&#xA;Pipeline run with id=c5d7c67a-e877-4582-9079-164a599c7cf6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c5d7c67a-e877-4582-9079-164a599c7cf6&#xA;Pipeline run with id=c5d7c67a-e877-4582-9079-164a599c7cf6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c5d7c67a-e877-4582-9079-164a599c7cf6&#xA;Pipeline run with id=c5d7c67a-e877-4582-9079-164a599c7cf6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c5d7c67a-e877-4582-9079-164a599c7cf6&#xA;Pipeline run with id=c5d7c67a-e877-4582-9079-164a599c7cf6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c5d7c67a-e877-4582-9079-164a599c7cf6&#xA;Pipeline run with id=c5d7c67a-e877-4582-9079-164a599c7cf6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c5d7c67a-e877-4582-9079-164a599c7cf6&#xA;Pipeline run with id=c5d7c67a-e877-4582-9079-164a599c7cf6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c5d7c67a-e877-4582-9079-164a599c7cf6&#xA;Pipeline run with id=c5d7c67a-e877-4582-9079-164a599c7cf6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c5d7c67a-e877-4582-9079-164a599c7cf6&#xA;Pipeline run with id=c5d7c67a-e877-4582-9079-164a599c7cf6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c5d7c67a-e877-4582-9079-164a599c7cf6&#xA;Pipeline run with id=c5d7c67a-e877-4582-9079-164a599c7cf6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c5d7c67a-e877-4582-9079-164a599c7cf6&#xA;Pipeline run with id=c5d7c67a-e877-4582-9079-164a599c7cf6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c5d7c67a-e877-4582-9079-164a599c7cf6&#xA;Pipeline run with id=c5d7c67a-e877-4582-9079-164a599c7cf6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c5d7c67a-e877-4582-9079-164a599c7cf6&#xA;Pipeline run with id=c5d7c67a-e877-4582-9079-164a599c7cf6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c5d7c67a-e877-4582-9079-164a599c7cf6&#xA;Pipeline run with id=c5d7c67a-e877-4582-9079-164a599c7cf6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c5d7c67a-e877-4582-9079-164a599c7cf6&#xA;Pipeline run with id=c5d7c67a-e877-4582-9079-164a599c7cf6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c5d7c67a-e877-4582-9079-164a599c7cf6&#xA;Pipeline run with id=c5d7c67a-e877-4582-9079-164a599c7cf6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c5d7c67a-e877-4582-9079-164a599c7cf6&#xA;Pipeline run with id=c5d7c67a-e877-4582-9079-164a599c7cf6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c5d7c67a-e877-4582-9079-164a599c7cf6&#xA;Pipeline run with id=c5d7c67a-e877-4582-9079-164a599c7cf6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c5d7c67a-e877-4582-9079-164a599c7cf6&#xA;Pipeline run with id=c5d7c67a-e877-4582-9079-164a599c7cf6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c5d7c67a-e877-4582-9079-164a599c7cf6&#xA;Pipeline run with id=c5d7c67a-e877-4582-9079-164a599c7cf6 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/pipeline_with_artifact_upload_download.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=c5d7c67a-e877-4582-9079-164a599c7cf6&#xA;Get a pipeline run with id=c5d7c67a-e877-4582-9079-164a599c7cf6&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/05/26 05:57:11.224 (1m35.468s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/05/26 05:57:11.225&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run c5d7c67a-e877-4582-9079-164a599c7cf6&#xA;Failed to terminate run c5d7c67a-e877-4582-9079-164a599c7cf6&#xA;Terminate run c5d7c67a-e877-4582-9079-164a599c7cf6&#xA;Deleting run c5d7c67a-e877-4582-9079-164a599c7cf6&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=5bacf5f9-8a7d-4f03-ad61-055742c2eebc (cascade=true)&#xA;Pipeline with id=5bacf5f9-8a7d-4f03-ad61-055742c2eebc, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/05/26 05:57:11.425 (201ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/05/26 05:57:11.426&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/05/26 05:57:11.426 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/05/26 05:57:11.426&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/05/26 05:57:11.426 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/parallel_for_after_dependency.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="96.279910078">
              <system-out>2026/07/05 05:57:11 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/05/26 05:55:35.333&#xA;Create an experiment with name E2EExperiment-1783230935333441791&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/05/26 05:55:35.618 (286ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/05/26 05:55:35.619&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x1a8392c0e180&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/05/26 05:55:35.745 (126ms)&#xA;&gt; Enter [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/05/26 05:55:35.745&#xA;Uploading pipeline file critical/parallel_for_after_dependency.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1783230935619195901, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml&#xA;Upload of pipeline file &#39;critical/parallel_for_after_dependency.yaml&#39; successful&#xA;Listing pipeline versions for pipeline d2d77a30-c76f-43bf-ad64-7aba3b076b19&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;d2d77a30-c76f-43bf-ad64-7aba3b076b19&#39; and name: &#39;e2e-test-1783230935619195901&#39;&#xA;Create a pipeline run for pipeline with id=d2d77a30-c76f-43bf-ad64-7aba3b076b19 and versionId=96f37f53-e4a8-4639-a2c0-67fcccaf7a48&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=96b12221-0ba8-4071-b0fb-fda70de5038f&#xA;Created Pipeline Run with id: 96b12221-0ba8-4071-b0fb-fda70de5038f for pipeline with id: d2d77a30-c76f-43bf-ad64-7aba3b076b19&#xA;Waiting for pipeline run with id=96b12221-0ba8-4071-b0fb-fda70de5038f to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=96b12221-0ba8-4071-b0fb-fda70de5038f&#xA;Pipeline run with id=96b12221-0ba8-4071-b0fb-fda70de5038f is in PENDING state, waiting...&#xA;Get a pipeline run with id=96b12221-0ba8-4071-b0fb-fda70de5038f&#xA;Pipeline run with id=96b12221-0ba8-4071-b0fb-fda70de5038f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=96b12221-0ba8-4071-b0fb-fda70de5038f&#xA;Pipeline run with id=96b12221-0ba8-4071-b0fb-fda70de5038f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=96b12221-0ba8-4071-b0fb-fda70de5038f&#xA;Pipeline run with id=96b12221-0ba8-4071-b0fb-fda70de5038f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=96b12221-0ba8-4071-b0fb-fda70de5038f&#xA;Pipeline run with id=96b12221-0ba8-4071-b0fb-fda70de5038f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=96b12221-0ba8-4071-b0fb-fda70de5038f&#xA;Pipeline run with id=96b12221-0ba8-4071-b0fb-fda70de5038f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=96b12221-0ba8-4071-b0fb-fda70de5038f&#xA;Pipeline run with id=96b12221-0ba8-4071-b0fb-fda70de5038f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=96b12221-0ba8-4071-b0fb-fda70de5038f&#xA;Pipeline run with id=96b12221-0ba8-4071-b0fb-fda70de5038f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=96b12221-0ba8-4071-b0fb-fda70de5038f&#xA;Pipeline run with id=96b12221-0ba8-4071-b0fb-fda70de5038f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=96b12221-0ba8-4071-b0fb-fda70de5038f&#xA;Pipeline run with id=96b12221-0ba8-4071-b0fb-fda70de5038f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=96b12221-0ba8-4071-b0fb-fda70de5038f&#xA;Pipeline run with id=96b12221-0ba8-4071-b0fb-fda70de5038f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=96b12221-0ba8-4071-b0fb-fda70de5038f&#xA;Pipeline run with id=96b12221-0ba8-4071-b0fb-fda70de5038f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=96b12221-0ba8-4071-b0fb-fda70de5038f&#xA;Pipeline run with id=96b12221-0ba8-4071-b0fb-fda70de5038f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=96b12221-0ba8-4071-b0fb-fda70de5038f&#xA;Pipeline run with id=96b12221-0ba8-4071-b0fb-fda70de5038f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=96b12221-0ba8-4071-b0fb-fda70de5038f&#xA;Pipeline run with id=96b12221-0ba8-4071-b0fb-fda70de5038f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=96b12221-0ba8-4071-b0fb-fda70de5038f&#xA;Pipeline run with id=96b12221-0ba8-4071-b0fb-fda70de5038f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=96b12221-0ba8-4071-b0fb-fda70de5038f&#xA;Pipeline run with id=96b12221-0ba8-4071-b0fb-fda70de5038f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=96b12221-0ba8-4071-b0fb-fda70de5038f&#xA;Pipeline run with id=96b12221-0ba8-4071-b0fb-fda70de5038f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=96b12221-0ba8-4071-b0fb-fda70de5038f&#xA;Pipeline run with id=96b12221-0ba8-4071-b0fb-fda70de5038f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=96b12221-0ba8-4071-b0fb-fda70de5038f&#xA;Pipeline run with id=96b12221-0ba8-4071-b0fb-fda70de5038f reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/parallel_for_after_dependency.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=96b12221-0ba8-4071-b0fb-fda70de5038f&#xA;Get a pipeline run with id=96b12221-0ba8-4071-b0fb-fda70de5038f&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/05/26 05:57:11.261 (1m35.516s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/05/26 05:57:11.261&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 96b12221-0ba8-4071-b0fb-fda70de5038f&#xA;Failed to terminate run 96b12221-0ba8-4071-b0fb-fda70de5038f&#xA;Terminate run 96b12221-0ba8-4071-b0fb-fda70de5038f&#xA;Deleting run 96b12221-0ba8-4071-b0fb-fda70de5038f&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=d2d77a30-c76f-43bf-ad64-7aba3b076b19 (cascade=true)&#xA;Pipeline with id=d2d77a30-c76f-43bf-ad64-7aba3b076b19, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/05/26 05:57:11.612 (351ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/05/26 05:57:11.613&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/05/26 05:57:11.613 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/05/26 05:57:11.613&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/05/26 05:57:11.613 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/flip_coin.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="131.573395581">
              <system-out>2026/07/05 05:57:46 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/05/26 05:55:35.332&#xA;Create an experiment with name E2EExperiment-1783230935332915287&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/05/26 05:55:35.789 (456ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/05/26 05:55:35.789&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x3208d51c0a00&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/05/26 05:55:35.927 (138ms)&#xA;&gt; Enter [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/05/26 05:55:35.927&#xA;Uploading pipeline file critical/flip_coin.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1783230935789412021, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml&#xA;Upload of pipeline file &#39;critical/flip_coin.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 0b438fda-5ac5-4a03-9b0a-f14a36e71616&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;0b438fda-5ac5-4a03-9b0a-f14a36e71616&#39; and name: &#39;e2e-test-1783230935789412021&#39;&#xA;Create a pipeline run for pipeline with id=0b438fda-5ac5-4a03-9b0a-f14a36e71616 and versionId=a0a62d59-9c54-4f78-bc37-f635cae31f34&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=144ee7f1-bc3e-4548-a980-a826fedf39ec&#xA;Created Pipeline Run with id: 144ee7f1-bc3e-4548-a980-a826fedf39ec for pipeline with id: 0b438fda-5ac5-4a03-9b0a-f14a36e71616&#xA;Waiting for pipeline run with id=144ee7f1-bc3e-4548-a980-a826fedf39ec to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=144ee7f1-bc3e-4548-a980-a826fedf39ec&#xA;Pipeline run with id=144ee7f1-bc3e-4548-a980-a826fedf39ec is in PENDING state, waiting...&#xA;Get a pipeline run with id=144ee7f1-bc3e-4548-a980-a826fedf39ec&#xA;Pipeline run with id=144ee7f1-bc3e-4548-a980-a826fedf39ec is in RUNNING state, waiting...&#xA;Get a pipeline run with id=144ee7f1-bc3e-4548-a980-a826fedf39ec&#xA;Pipeline run with id=144ee7f1-bc3e-4548-a980-a826fedf39ec is in RUNNING state, waiting...&#xA;Get a pipeline run with id=144ee7f1-bc3e-4548-a980-a826fedf39ec&#xA;Pipeline run with id=144ee7f1-bc3e-4548-a980-a826fedf39ec is in RUNNING state, waiting...&#xA;Get a pipeline run with id=144ee7f1-bc3e-4548-a980-a826fedf39ec&#xA;Pipeline run with id=144ee7f1-bc3e-4548-a980-a826fedf39ec is in RUNNING state, waiting...&#xA;Get a pipeline run with id=144ee7f1-bc3e-4548-a980-a826fedf39ec&#xA;Pipeline run with id=144ee7f1-bc3e-4548-a980-a826fedf39ec is in RUNNING state, waiting...&#xA;Get a pipeline run with id=144ee7f1-bc3e-4548-a980-a826fedf39ec&#xA;Pipeline run with id=144ee7f1-bc3e-4548-a980-a826fedf39ec is in RUNNING state, waiting...&#xA;Get a pipeline run with id=144ee7f1-bc3e-4548-a980-a826fedf39ec&#xA;Pipeline run with id=144ee7f1-bc3e-4548-a980-a826fedf39ec is in RUNNING state, waiting...&#xA;Get a pipeline run with id=144ee7f1-bc3e-4548-a980-a826fedf39ec&#xA;Pipeline run with id=144ee7f1-bc3e-4548-a980-a826fedf39ec is in RUNNING state, waiting...&#xA;Get a pipeline run with id=144ee7f1-bc3e-4548-a980-a826fedf39ec&#xA;Pipeline run with id=144ee7f1-bc3e-4548-a980-a826fedf39ec is in RUNNING state, waiting...&#xA;Get a pipeline run with id=144ee7f1-bc3e-4548-a980-a826fedf39ec&#xA;Pipeline run with id=144ee7f1-bc3e-4548-a980-a826fedf39ec is in RUNNING state, waiting...&#xA;Get a pipeline run with id=144ee7f1-bc3e-4548-a980-a826fedf39ec&#xA;Pipeline run with id=144ee7f1-bc3e-4548-a980-a826fedf39ec is in RUNNING state, waiting...&#xA;Get a pipeline run with id=144ee7f1-bc3e-4548-a980-a826fedf39ec&#xA;Pipeline run with id=144ee7f1-bc3e-4548-a980-a826fedf39ec is in RUNNING state, waiting...&#xA;Get a pipeline run with id=144ee7f1-bc3e-4548-a980-a826fedf39ec&#xA;Pipeline run with id=144ee7f1-bc3e-4548-a980-a826fedf39ec is in RUNNING state, waiting...&#xA;Get a pipeline run with id=144ee7f1-bc3e-4548-a980-a826fedf39ec&#xA;Pipeline run with id=144ee7f1-bc3e-4548-a980-a826fedf39ec is in RUNNING state, waiting...&#xA;Get a pipeline run with id=144ee7f1-bc3e-4548-a980-a826fedf39ec&#xA;Pipeline run with id=144ee7f1-bc3e-4548-a980-a826fedf39ec is in RUNNING state, waiting...&#xA;Get a pipeline run with id=144ee7f1-bc3e-4548-a980-a826fedf39ec&#xA;Pipeline run with id=144ee7f1-bc3e-4548-a980-a826fedf39ec is in RUNNING state, waiting...&#xA;Get a pipeline run with id=144ee7f1-bc3e-4548-a980-a826fedf39ec&#xA;Pipeline run with id=144ee7f1-bc3e-4548-a980-a826fedf39ec is in RUNNING state, waiting...&#xA;Get a pipeline run with id=144ee7f1-bc3e-4548-a980-a826fedf39ec&#xA;Pipeline run with id=144ee7f1-bc3e-4548-a980-a826fedf39ec is in RUNNING state, waiting...&#xA;Get a pipeline run with id=144ee7f1-bc3e-4548-a980-a826fedf39ec&#xA;Pipeline run with id=144ee7f1-bc3e-4548-a980-a826fedf39ec is in RUNNING state, waiting...&#xA;Get a pipeline run with id=144ee7f1-bc3e-4548-a980-a826fedf39ec&#xA;Pipeline run with id=144ee7f1-bc3e-4548-a980-a826fedf39ec is in RUNNING state, waiting...&#xA;Get a pipeline run with id=144ee7f1-bc3e-4548-a980-a826fedf39ec&#xA;Pipeline run with id=144ee7f1-bc3e-4548-a980-a826fedf39ec is in RUNNING state, waiting...&#xA;Get a pipeline run with id=144ee7f1-bc3e-4548-a980-a826fedf39ec&#xA;Pipeline run with id=144ee7f1-bc3e-4548-a980-a826fedf39ec is in RUNNING state, waiting...&#xA;Get a pipeline run with id=144ee7f1-bc3e-4548-a980-a826fedf39ec&#xA;Pipeline run with id=144ee7f1-bc3e-4548-a980-a826fedf39ec is in RUNNING state, waiting...&#xA;Get a pipeline run with id=144ee7f1-bc3e-4548-a980-a826fedf39ec&#xA;Pipeline run with id=144ee7f1-bc3e-4548-a980-a826fedf39ec is in RUNNING state, waiting...&#xA;Get a pipeline run with id=144ee7f1-bc3e-4548-a980-a826fedf39ec&#xA;Pipeline run with id=144ee7f1-bc3e-4548-a980-a826fedf39ec is in RUNNING state, waiting...&#xA;Get a pipeline run with id=144ee7f1-bc3e-4548-a980-a826fedf39ec&#xA;Pipeline run with id=144ee7f1-bc3e-4548-a980-a826fedf39ec reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/flip_coin.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=144ee7f1-bc3e-4548-a980-a826fedf39ec&#xA;Get a pipeline run with id=144ee7f1-bc3e-4548-a980-a826fedf39ec&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/05/26 05:57:46.527 (2m10.6s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/05/26 05:57:46.528&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 144ee7f1-bc3e-4548-a980-a826fedf39ec&#xA;Failed to terminate run 144ee7f1-bc3e-4548-a980-a826fedf39ec&#xA;Terminate run 144ee7f1-bc3e-4548-a980-a826fedf39ec&#xA;Deleting run 144ee7f1-bc3e-4548-a980-a826fedf39ec&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=0b438fda-5ac5-4a03-9b0a-f14a36e71616 (cascade=true)&#xA;Pipeline with id=0b438fda-5ac5-4a03-9b0a-f14a36e71616, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/05/26 05:57:46.906 (378ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/05/26 05:57:46.906&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/05/26 05:57:46.906 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/05/26 05:57:46.906&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/05/26 05:57:46.906 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload essential/iris_pipeline_compiled.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="156.106477637">
              <system-out>2026/07/05 05:58:11 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/05/26 05:55:35.333&#xA;Create an experiment with name E2EExperiment-1783230935333612762&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/05/26 05:55:35.615 (282ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/05/26 05:55:35.615&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x2511871a4100&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/05/26 05:55:35.756 (141ms)&#xA;&gt; Enter [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/05/26 05:55:35.756&#xA;Uploading pipeline file essential/iris_pipeline_compiled.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1783230935615299561, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml&#xA;Upload of pipeline file &#39;essential/iris_pipeline_compiled.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 3e3c87f0-652d-4180-b47a-189d175aa6c0&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;3e3c87f0-652d-4180-b47a-189d175aa6c0&#39; and name: &#39;e2e-test-1783230935615299561&#39;&#xA;Create a pipeline run for pipeline with id=3e3c87f0-652d-4180-b47a-189d175aa6c0 and versionId=db90b5e7-3319-4fe7-bada-38427dce9df4&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=e7ae1f06-6325-4d10-b832-be8d4192bee5&#xA;Created Pipeline Run with id: e7ae1f06-6325-4d10-b832-be8d4192bee5 for pipeline with id: 3e3c87f0-652d-4180-b47a-189d175aa6c0&#xA;Waiting for pipeline run with id=e7ae1f06-6325-4d10-b832-be8d4192bee5 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=e7ae1f06-6325-4d10-b832-be8d4192bee5&#xA;Pipeline run with id=e7ae1f06-6325-4d10-b832-be8d4192bee5 is in PENDING state, waiting...&#xA;Get a pipeline run with id=e7ae1f06-6325-4d10-b832-be8d4192bee5&#xA;Pipeline run with id=e7ae1f06-6325-4d10-b832-be8d4192bee5 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e7ae1f06-6325-4d10-b832-be8d4192bee5&#xA;Pipeline run with id=e7ae1f06-6325-4d10-b832-be8d4192bee5 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e7ae1f06-6325-4d10-b832-be8d4192bee5&#xA;Pipeline run with id=e7ae1f06-6325-4d10-b832-be8d4192bee5 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e7ae1f06-6325-4d10-b832-be8d4192bee5&#xA;Pipeline run with id=e7ae1f06-6325-4d10-b832-be8d4192bee5 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e7ae1f06-6325-4d10-b832-be8d4192bee5&#xA;Pipeline run with id=e7ae1f06-6325-4d10-b832-be8d4192bee5 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e7ae1f06-6325-4d10-b832-be8d4192bee5&#xA;Pipeline run with id=e7ae1f06-6325-4d10-b832-be8d4192bee5 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e7ae1f06-6325-4d10-b832-be8d4192bee5&#xA;Pipeline run with id=e7ae1f06-6325-4d10-b832-be8d4192bee5 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e7ae1f06-6325-4d10-b832-be8d4192bee5&#xA;Pipeline run with id=e7ae1f06-6325-4d10-b832-be8d4192bee5 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e7ae1f06-6325-4d10-b832-be8d4192bee5&#xA;Pipeline run with id=e7ae1f06-6325-4d10-b832-be8d4192bee5 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e7ae1f06-6325-4d10-b832-be8d4192bee5&#xA;Pipeline run with id=e7ae1f06-6325-4d10-b832-be8d4192bee5 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e7ae1f06-6325-4d10-b832-be8d4192bee5&#xA;Pipeline run with id=e7ae1f06-6325-4d10-b832-be8d4192bee5 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e7ae1f06-6325-4d10-b832-be8d4192bee5&#xA;Pipeline run with id=e7ae1f06-6325-4d10-b832-be8d4192bee5 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e7ae1f06-6325-4d10-b832-be8d4192bee5&#xA;Pipeline run with id=e7ae1f06-6325-4d10-b832-be8d4192bee5 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e7ae1f06-6325-4d10-b832-be8d4192bee5&#xA;Pipeline run with id=e7ae1f06-6325-4d10-b832-be8d4192bee5 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e7ae1f06-6325-4d10-b832-be8d4192bee5&#xA;Pipeline run with id=e7ae1f06-6325-4d10-b832-be8d4192bee5 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e7ae1f06-6325-4d10-b832-be8d4192bee5&#xA;Pipeline run with id=e7ae1f06-6325-4d10-b832-be8d4192bee5 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e7ae1f06-6325-4d10-b832-be8d4192bee5&#xA;Pipeline run with id=e7ae1f06-6325-4d10-b832-be8d4192bee5 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e7ae1f06-6325-4d10-b832-be8d4192bee5&#xA;Pipeline run with id=e7ae1f06-6325-4d10-b832-be8d4192bee5 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e7ae1f06-6325-4d10-b832-be8d4192bee5&#xA;Pipeline run with id=e7ae1f06-6325-4d10-b832-be8d4192bee5 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e7ae1f06-6325-4d10-b832-be8d4192bee5&#xA;Pipeline run with id=e7ae1f06-6325-4d10-b832-be8d4192bee5 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e7ae1f06-6325-4d10-b832-be8d4192bee5&#xA;Pipeline run with id=e7ae1f06-6325-4d10-b832-be8d4192bee5 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e7ae1f06-6325-4d10-b832-be8d4192bee5&#xA;Pipeline run with id=e7ae1f06-6325-4d10-b832-be8d4192bee5 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e7ae1f06-6325-4d10-b832-be8d4192bee5&#xA;Pipeline run with id=e7ae1f06-6325-4d10-b832-be8d4192bee5 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e7ae1f06-6325-4d10-b832-be8d4192bee5&#xA;Pipeline run with id=e7ae1f06-6325-4d10-b832-be8d4192bee5 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e7ae1f06-6325-4d10-b832-be8d4192bee5&#xA;Pipeline run with id=e7ae1f06-6325-4d10-b832-be8d4192bee5 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e7ae1f06-6325-4d10-b832-be8d4192bee5&#xA;Pipeline run with id=e7ae1f06-6325-4d10-b832-be8d4192bee5 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e7ae1f06-6325-4d10-b832-be8d4192bee5&#xA;Pipeline run with id=e7ae1f06-6325-4d10-b832-be8d4192bee5 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e7ae1f06-6325-4d10-b832-be8d4192bee5&#xA;Pipeline run with id=e7ae1f06-6325-4d10-b832-be8d4192bee5 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e7ae1f06-6325-4d10-b832-be8d4192bee5&#xA;Pipeline run with id=e7ae1f06-6325-4d10-b832-be8d4192bee5 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e7ae1f06-6325-4d10-b832-be8d4192bee5&#xA;Pipeline run with id=e7ae1f06-6325-4d10-b832-be8d4192bee5 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e7ae1f06-6325-4d10-b832-be8d4192bee5&#xA;Pipeline run with id=e7ae1f06-6325-4d10-b832-be8d4192bee5 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;essential/iris_pipeline_compiled.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=e7ae1f06-6325-4d10-b832-be8d4192bee5&#xA;Get a pipeline run with id=e7ae1f06-6325-4d10-b832-be8d4192bee5&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/05/26 05:58:11.226 (2m35.469s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/05/26 05:58:11.226&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run e7ae1f06-6325-4d10-b832-be8d4192bee5&#xA;Failed to terminate run e7ae1f06-6325-4d10-b832-be8d4192bee5&#xA;Terminate run e7ae1f06-6325-4d10-b832-be8d4192bee5&#xA;Deleting run e7ae1f06-6325-4d10-b832-be8d4192bee5&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=3e3c87f0-652d-4180-b47a-189d175aa6c0 (cascade=true)&#xA;Pipeline with id=3e3c87f0-652d-4180-b47a-189d175aa6c0, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/05/26 05:58:11.439 (214ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/05/26 05:58:11.44&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/05/26 05:58:11.44 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/05/26 05:58:11.44&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/05/26 05:58:11.44 (0s)&#xA;</system-err>
          </testcase>
      </testsuite>
  </testsuites>