<?xml version="1.0" encoding="UTF-8"?>
  <testsuites tests="5" disabled="0" errors="0" failures="0" time="156.131996355">
      <testsuite name="AIPipelinesE2ETests" package="/dspa/backend/test/end2end" tests="5" disabled="0" skipped="0" errors="0" failures="0" time="156.131996355" timestamp="2026-07-15T11:36:40">
          <properties>
              <property name="SuiteSucceeded" value="true"></property>
              <property name="SuiteHasProgrammaticFocus" value="false"></property>
              <property name="SpecialSuiteFailureReason" value=""></property>
              <property name="SuiteLabels" value="[]"></property>
              <property name="SuiteSemVerConstraints" value="[]"></property>
              <property name="RandomSeed" value="1784115211"></property>
              <property name="RandomizeAllSpecs" value="false"></property>
              <property name="LabelFilter" value="Smoke"></property>
              <property name="SemVerFilter" value=""></property>
              <property name="FocusStrings" value=""></property>
              <property name="SkipStrings" value=""></property>
              <property name="FocusFiles" value=""></property>
              <property name="SkipFiles" value=""></property>
              <property name="FailOnPending" value="false"></property>
              <property name="FailOnEmpty" value="false"></property>
              <property name="FailFast" value="false"></property>
              <property name="FlakeAttempts" value="0"></property>
              <property name="DryRun" value="false"></property>
              <property name="ParallelTotal" value="10"></property>
              <property name="OutputInterceptorMode" value=""></property>
          </properties>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload essential/component_with_pip_index_urls.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="46.302237394">
              <system-out>2026/07/15 11:37:26 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/15/26 11:36:40.513&#xA;Create an experiment with name E2EExperiment-1784115400513604149&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/15/26 11:36:40.814 (301ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/15/26 11:36:40.815&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x270582f54f00&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/15/26 11:36:40.941 (126ms)&#xA;&gt; Enter [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/15/26 11:36:40.941&#xA;Uploading pipeline file essential/component_with_pip_index_urls.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1784115400815060508, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml&#xA;Upload of pipeline file &#39;essential/component_with_pip_index_urls.yaml&#39; successful&#xA;Listing pipeline versions for pipeline ff927206-5062-42ed-aee1-6bcc39928219&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;ff927206-5062-42ed-aee1-6bcc39928219&#39; and name: &#39;e2e-test-1784115400815060508&#39;&#xA;Create a pipeline run for pipeline with id=ff927206-5062-42ed-aee1-6bcc39928219 and versionId=b9362cea-ace0-4ac3-a1b0-8c81dab6b8c7&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=7a8f1dd0-2053-4137-a30b-3879411987ee&#xA;Created Pipeline Run with id: 7a8f1dd0-2053-4137-a30b-3879411987ee for pipeline with id: ff927206-5062-42ed-aee1-6bcc39928219&#xA;Waiting for pipeline run with id=7a8f1dd0-2053-4137-a30b-3879411987ee to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=7a8f1dd0-2053-4137-a30b-3879411987ee&#xA;Pipeline run with id=7a8f1dd0-2053-4137-a30b-3879411987ee is in PENDING state, waiting...&#xA;Get a pipeline run with id=7a8f1dd0-2053-4137-a30b-3879411987ee&#xA;Pipeline run with id=7a8f1dd0-2053-4137-a30b-3879411987ee is in RUNNING state, waiting...&#xA;Get a pipeline run with id=7a8f1dd0-2053-4137-a30b-3879411987ee&#xA;Pipeline run with id=7a8f1dd0-2053-4137-a30b-3879411987ee is in RUNNING state, waiting...&#xA;Get a pipeline run with id=7a8f1dd0-2053-4137-a30b-3879411987ee&#xA;Pipeline run with id=7a8f1dd0-2053-4137-a30b-3879411987ee is in RUNNING state, waiting...&#xA;Get a pipeline run with id=7a8f1dd0-2053-4137-a30b-3879411987ee&#xA;Pipeline run with id=7a8f1dd0-2053-4137-a30b-3879411987ee is in RUNNING state, waiting...&#xA;Get a pipeline run with id=7a8f1dd0-2053-4137-a30b-3879411987ee&#xA;Pipeline run with id=7a8f1dd0-2053-4137-a30b-3879411987ee is in RUNNING state, waiting...&#xA;Get a pipeline run with id=7a8f1dd0-2053-4137-a30b-3879411987ee&#xA;Pipeline run with id=7a8f1dd0-2053-4137-a30b-3879411987ee is in RUNNING state, waiting...&#xA;Get a pipeline run with id=7a8f1dd0-2053-4137-a30b-3879411987ee&#xA;Pipeline run with id=7a8f1dd0-2053-4137-a30b-3879411987ee is in RUNNING state, waiting...&#xA;Get a pipeline run with id=7a8f1dd0-2053-4137-a30b-3879411987ee&#xA;Pipeline run with id=7a8f1dd0-2053-4137-a30b-3879411987ee is in RUNNING state, waiting...&#xA;Get a pipeline run with id=7a8f1dd0-2053-4137-a30b-3879411987ee&#xA;Pipeline run with id=7a8f1dd0-2053-4137-a30b-3879411987ee reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;essential/component_with_pip_index_urls.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=7a8f1dd0-2053-4137-a30b-3879411987ee&#xA;Get a pipeline run with id=7a8f1dd0-2053-4137-a30b-3879411987ee&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/15/26 11:37:26.503 (45.562s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/15/26 11:37:26.503&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 7a8f1dd0-2053-4137-a30b-3879411987ee&#xA;Failed to terminate run 7a8f1dd0-2053-4137-a30b-3879411987ee&#xA;Terminate run 7a8f1dd0-2053-4137-a30b-3879411987ee&#xA;Deleting run 7a8f1dd0-2053-4137-a30b-3879411987ee&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=ff927206-5062-42ed-aee1-6bcc39928219 (cascade=true)&#xA;Pipeline with id=ff927206-5062-42ed-aee1-6bcc39928219, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/15/26 11:37:26.815 (312ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/15/26 11:37:26.815&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/15/26 11:37:26.816 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/15/26 11:37:26.816&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/15/26 11:37:26.816 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/parallel_for_after_dependency.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="96.012779208">
              <system-out>2026/07/15 11:38:16 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/15/26 11:36:40.513&#xA;Create an experiment with name E2EExperiment-1784115400513276378&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/15/26 11:36:40.646 (133ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/15/26 11:36:40.646&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x29dec13c6180&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/15/26 11:36:40.778 (132ms)&#xA;&gt; Enter [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/15/26 11:36:40.779&#xA;Uploading pipeline file critical/parallel_for_after_dependency.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1784115400646462765, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml&#xA;Upload of pipeline file &#39;critical/parallel_for_after_dependency.yaml&#39; successful&#xA;Listing pipeline versions for pipeline d2439f6c-ac1e-4898-bc41-f67d49af206a&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;d2439f6c-ac1e-4898-bc41-f67d49af206a&#39; and name: &#39;e2e-test-1784115400646462765&#39;&#xA;Create a pipeline run for pipeline with id=d2439f6c-ac1e-4898-bc41-f67d49af206a and versionId=37b4744d-a37d-4420-86fe-5ca72443e693&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=167ff507-125a-44d2-a8b3-7f9b2e18d480&#xA;Created Pipeline Run with id: 167ff507-125a-44d2-a8b3-7f9b2e18d480 for pipeline with id: d2439f6c-ac1e-4898-bc41-f67d49af206a&#xA;Waiting for pipeline run with id=167ff507-125a-44d2-a8b3-7f9b2e18d480 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=167ff507-125a-44d2-a8b3-7f9b2e18d480&#xA;Pipeline run with id=167ff507-125a-44d2-a8b3-7f9b2e18d480 is in PENDING state, waiting...&#xA;Get a pipeline run with id=167ff507-125a-44d2-a8b3-7f9b2e18d480&#xA;Pipeline run with id=167ff507-125a-44d2-a8b3-7f9b2e18d480 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=167ff507-125a-44d2-a8b3-7f9b2e18d480&#xA;Pipeline run with id=167ff507-125a-44d2-a8b3-7f9b2e18d480 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=167ff507-125a-44d2-a8b3-7f9b2e18d480&#xA;Pipeline run with id=167ff507-125a-44d2-a8b3-7f9b2e18d480 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=167ff507-125a-44d2-a8b3-7f9b2e18d480&#xA;Pipeline run with id=167ff507-125a-44d2-a8b3-7f9b2e18d480 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=167ff507-125a-44d2-a8b3-7f9b2e18d480&#xA;Pipeline run with id=167ff507-125a-44d2-a8b3-7f9b2e18d480 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=167ff507-125a-44d2-a8b3-7f9b2e18d480&#xA;Pipeline run with id=167ff507-125a-44d2-a8b3-7f9b2e18d480 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=167ff507-125a-44d2-a8b3-7f9b2e18d480&#xA;Pipeline run with id=167ff507-125a-44d2-a8b3-7f9b2e18d480 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=167ff507-125a-44d2-a8b3-7f9b2e18d480&#xA;Pipeline run with id=167ff507-125a-44d2-a8b3-7f9b2e18d480 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=167ff507-125a-44d2-a8b3-7f9b2e18d480&#xA;Pipeline run with id=167ff507-125a-44d2-a8b3-7f9b2e18d480 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=167ff507-125a-44d2-a8b3-7f9b2e18d480&#xA;Pipeline run with id=167ff507-125a-44d2-a8b3-7f9b2e18d480 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=167ff507-125a-44d2-a8b3-7f9b2e18d480&#xA;Pipeline run with id=167ff507-125a-44d2-a8b3-7f9b2e18d480 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=167ff507-125a-44d2-a8b3-7f9b2e18d480&#xA;Pipeline run with id=167ff507-125a-44d2-a8b3-7f9b2e18d480 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=167ff507-125a-44d2-a8b3-7f9b2e18d480&#xA;Pipeline run with id=167ff507-125a-44d2-a8b3-7f9b2e18d480 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=167ff507-125a-44d2-a8b3-7f9b2e18d480&#xA;Pipeline run with id=167ff507-125a-44d2-a8b3-7f9b2e18d480 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=167ff507-125a-44d2-a8b3-7f9b2e18d480&#xA;Pipeline run with id=167ff507-125a-44d2-a8b3-7f9b2e18d480 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=167ff507-125a-44d2-a8b3-7f9b2e18d480&#xA;Pipeline run with id=167ff507-125a-44d2-a8b3-7f9b2e18d480 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=167ff507-125a-44d2-a8b3-7f9b2e18d480&#xA;Pipeline run with id=167ff507-125a-44d2-a8b3-7f9b2e18d480 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=167ff507-125a-44d2-a8b3-7f9b2e18d480&#xA;Pipeline run with id=167ff507-125a-44d2-a8b3-7f9b2e18d480 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=167ff507-125a-44d2-a8b3-7f9b2e18d480&#xA;Pipeline run with id=167ff507-125a-44d2-a8b3-7f9b2e18d480 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/parallel_for_after_dependency.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=167ff507-125a-44d2-a8b3-7f9b2e18d480&#xA;Get a pipeline run with id=167ff507-125a-44d2-a8b3-7f9b2e18d480&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/15/26 11:38:16.305 (1m35.526s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/15/26 11:38:16.305&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 167ff507-125a-44d2-a8b3-7f9b2e18d480&#xA;Failed to terminate run 167ff507-125a-44d2-a8b3-7f9b2e18d480&#xA;Terminate run 167ff507-125a-44d2-a8b3-7f9b2e18d480&#xA;Deleting run 167ff507-125a-44d2-a8b3-7f9b2e18d480&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=d2439f6c-ac1e-4898-bc41-f67d49af206a (cascade=true)&#xA;Pipeline with id=d2439f6c-ac1e-4898-bc41-f67d49af206a, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/15/26 11:38:16.525 (221ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/15/26 11:38:16.526&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/15/26 11:38:16.526 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/15/26 11:38:16.526&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/15/26 11:38:16.526 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/pipeline_with_artifact_upload_download.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="96.126691265">
              <system-out>2026/07/15 11:38:16 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/15/26 11:36:40.513&#xA;Create an experiment with name E2EExperiment-1784115400513552806&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/15/26 11:36:40.719 (206ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/15/26 11:36:40.719&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x2bac30e2c480&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/15/26 11:36:40.858 (139ms)&#xA;&gt; Enter [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/15/26 11:36:40.858&#xA;Uploading pipeline file critical/pipeline_with_artifact_upload_download.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1784115400719335289, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml&#xA;Upload of pipeline file &#39;critical/pipeline_with_artifact_upload_download.yaml&#39; successful&#xA;Listing pipeline versions for pipeline fb3b11a5-6db3-470c-8c17-1f718c3f991d&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;fb3b11a5-6db3-470c-8c17-1f718c3f991d&#39; and name: &#39;e2e-test-1784115400719335289&#39;&#xA;Create a pipeline run for pipeline with id=fb3b11a5-6db3-470c-8c17-1f718c3f991d and versionId=eaefd248-4ea0-45c4-b242-29a885c4e3fb&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=06511333-504d-4fc4-a13d-afaa3a0b898e&#xA;Created Pipeline Run with id: 06511333-504d-4fc4-a13d-afaa3a0b898e for pipeline with id: fb3b11a5-6db3-470c-8c17-1f718c3f991d&#xA;Waiting for pipeline run with id=06511333-504d-4fc4-a13d-afaa3a0b898e to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=06511333-504d-4fc4-a13d-afaa3a0b898e&#xA;Pipeline run with id=06511333-504d-4fc4-a13d-afaa3a0b898e is in PENDING state, waiting...&#xA;Get a pipeline run with id=06511333-504d-4fc4-a13d-afaa3a0b898e&#xA;Pipeline run with id=06511333-504d-4fc4-a13d-afaa3a0b898e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=06511333-504d-4fc4-a13d-afaa3a0b898e&#xA;Pipeline run with id=06511333-504d-4fc4-a13d-afaa3a0b898e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=06511333-504d-4fc4-a13d-afaa3a0b898e&#xA;Pipeline run with id=06511333-504d-4fc4-a13d-afaa3a0b898e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=06511333-504d-4fc4-a13d-afaa3a0b898e&#xA;Pipeline run with id=06511333-504d-4fc4-a13d-afaa3a0b898e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=06511333-504d-4fc4-a13d-afaa3a0b898e&#xA;Pipeline run with id=06511333-504d-4fc4-a13d-afaa3a0b898e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=06511333-504d-4fc4-a13d-afaa3a0b898e&#xA;Pipeline run with id=06511333-504d-4fc4-a13d-afaa3a0b898e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=06511333-504d-4fc4-a13d-afaa3a0b898e&#xA;Pipeline run with id=06511333-504d-4fc4-a13d-afaa3a0b898e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=06511333-504d-4fc4-a13d-afaa3a0b898e&#xA;Pipeline run with id=06511333-504d-4fc4-a13d-afaa3a0b898e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=06511333-504d-4fc4-a13d-afaa3a0b898e&#xA;Pipeline run with id=06511333-504d-4fc4-a13d-afaa3a0b898e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=06511333-504d-4fc4-a13d-afaa3a0b898e&#xA;Pipeline run with id=06511333-504d-4fc4-a13d-afaa3a0b898e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=06511333-504d-4fc4-a13d-afaa3a0b898e&#xA;Pipeline run with id=06511333-504d-4fc4-a13d-afaa3a0b898e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=06511333-504d-4fc4-a13d-afaa3a0b898e&#xA;Pipeline run with id=06511333-504d-4fc4-a13d-afaa3a0b898e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=06511333-504d-4fc4-a13d-afaa3a0b898e&#xA;Pipeline run with id=06511333-504d-4fc4-a13d-afaa3a0b898e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=06511333-504d-4fc4-a13d-afaa3a0b898e&#xA;Pipeline run with id=06511333-504d-4fc4-a13d-afaa3a0b898e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=06511333-504d-4fc4-a13d-afaa3a0b898e&#xA;Pipeline run with id=06511333-504d-4fc4-a13d-afaa3a0b898e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=06511333-504d-4fc4-a13d-afaa3a0b898e&#xA;Pipeline run with id=06511333-504d-4fc4-a13d-afaa3a0b898e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=06511333-504d-4fc4-a13d-afaa3a0b898e&#xA;Pipeline run with id=06511333-504d-4fc4-a13d-afaa3a0b898e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=06511333-504d-4fc4-a13d-afaa3a0b898e&#xA;Pipeline run with id=06511333-504d-4fc4-a13d-afaa3a0b898e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=06511333-504d-4fc4-a13d-afaa3a0b898e&#xA;Pipeline run with id=06511333-504d-4fc4-a13d-afaa3a0b898e reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/pipeline_with_artifact_upload_download.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=06511333-504d-4fc4-a13d-afaa3a0b898e&#xA;Get a pipeline run with id=06511333-504d-4fc4-a13d-afaa3a0b898e&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/15/26 11:38:16.466 (1m35.607s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/15/26 11:38:16.466&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 06511333-504d-4fc4-a13d-afaa3a0b898e&#xA;Failed to terminate run 06511333-504d-4fc4-a13d-afaa3a0b898e&#xA;Terminate run 06511333-504d-4fc4-a13d-afaa3a0b898e&#xA;Deleting run 06511333-504d-4fc4-a13d-afaa3a0b898e&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=fb3b11a5-6db3-470c-8c17-1f718c3f991d (cascade=true)&#xA;Pipeline with id=fb3b11a5-6db3-470c-8c17-1f718c3f991d, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/15/26 11:38:16.64 (174ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/15/26 11:38:16.64&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/15/26 11:38:16.64 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/15/26 11:38:16.64&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/15/26 11:38:16.64 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/flip_coin.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="126.151182609">
              <system-out>2026/07/15 11:38:46 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/15/26 11:36:40.513&#xA;Create an experiment with name E2EExperiment-1784115400513313190&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/15/26 11:36:40.719 (206ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/15/26 11:36:40.719&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x11b229364200&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/15/26 11:36:40.835 (116ms)&#xA;&gt; Enter [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/15/26 11:36:40.836&#xA;Uploading pipeline file critical/flip_coin.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1784115400719965840, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml&#xA;Upload of pipeline file &#39;critical/flip_coin.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 4906d6f6-986f-4f0a-996a-b2f6302ae3e6&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;4906d6f6-986f-4f0a-996a-b2f6302ae3e6&#39; and name: &#39;e2e-test-1784115400719965840&#39;&#xA;Create a pipeline run for pipeline with id=4906d6f6-986f-4f0a-996a-b2f6302ae3e6 and versionId=87902716-dfd3-4783-8646-fe4c0e6fb4af&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=d19d1325-d2fb-4286-9f57-cc4ce908dbbd&#xA;Created Pipeline Run with id: d19d1325-d2fb-4286-9f57-cc4ce908dbbd for pipeline with id: 4906d6f6-986f-4f0a-996a-b2f6302ae3e6&#xA;Waiting for pipeline run with id=d19d1325-d2fb-4286-9f57-cc4ce908dbbd to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=d19d1325-d2fb-4286-9f57-cc4ce908dbbd&#xA;Pipeline run with id=d19d1325-d2fb-4286-9f57-cc4ce908dbbd is in PENDING state, waiting...&#xA;Get a pipeline run with id=d19d1325-d2fb-4286-9f57-cc4ce908dbbd&#xA;Pipeline run with id=d19d1325-d2fb-4286-9f57-cc4ce908dbbd is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d19d1325-d2fb-4286-9f57-cc4ce908dbbd&#xA;Pipeline run with id=d19d1325-d2fb-4286-9f57-cc4ce908dbbd is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d19d1325-d2fb-4286-9f57-cc4ce908dbbd&#xA;Pipeline run with id=d19d1325-d2fb-4286-9f57-cc4ce908dbbd is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d19d1325-d2fb-4286-9f57-cc4ce908dbbd&#xA;Pipeline run with id=d19d1325-d2fb-4286-9f57-cc4ce908dbbd is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d19d1325-d2fb-4286-9f57-cc4ce908dbbd&#xA;Pipeline run with id=d19d1325-d2fb-4286-9f57-cc4ce908dbbd is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d19d1325-d2fb-4286-9f57-cc4ce908dbbd&#xA;Pipeline run with id=d19d1325-d2fb-4286-9f57-cc4ce908dbbd is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d19d1325-d2fb-4286-9f57-cc4ce908dbbd&#xA;Pipeline run with id=d19d1325-d2fb-4286-9f57-cc4ce908dbbd is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d19d1325-d2fb-4286-9f57-cc4ce908dbbd&#xA;Pipeline run with id=d19d1325-d2fb-4286-9f57-cc4ce908dbbd is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d19d1325-d2fb-4286-9f57-cc4ce908dbbd&#xA;Pipeline run with id=d19d1325-d2fb-4286-9f57-cc4ce908dbbd is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d19d1325-d2fb-4286-9f57-cc4ce908dbbd&#xA;Pipeline run with id=d19d1325-d2fb-4286-9f57-cc4ce908dbbd is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d19d1325-d2fb-4286-9f57-cc4ce908dbbd&#xA;Pipeline run with id=d19d1325-d2fb-4286-9f57-cc4ce908dbbd is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d19d1325-d2fb-4286-9f57-cc4ce908dbbd&#xA;Pipeline run with id=d19d1325-d2fb-4286-9f57-cc4ce908dbbd is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d19d1325-d2fb-4286-9f57-cc4ce908dbbd&#xA;Pipeline run with id=d19d1325-d2fb-4286-9f57-cc4ce908dbbd is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d19d1325-d2fb-4286-9f57-cc4ce908dbbd&#xA;Pipeline run with id=d19d1325-d2fb-4286-9f57-cc4ce908dbbd is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d19d1325-d2fb-4286-9f57-cc4ce908dbbd&#xA;Pipeline run with id=d19d1325-d2fb-4286-9f57-cc4ce908dbbd is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d19d1325-d2fb-4286-9f57-cc4ce908dbbd&#xA;Pipeline run with id=d19d1325-d2fb-4286-9f57-cc4ce908dbbd is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d19d1325-d2fb-4286-9f57-cc4ce908dbbd&#xA;Pipeline run with id=d19d1325-d2fb-4286-9f57-cc4ce908dbbd is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d19d1325-d2fb-4286-9f57-cc4ce908dbbd&#xA;Pipeline run with id=d19d1325-d2fb-4286-9f57-cc4ce908dbbd is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d19d1325-d2fb-4286-9f57-cc4ce908dbbd&#xA;Pipeline run with id=d19d1325-d2fb-4286-9f57-cc4ce908dbbd is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d19d1325-d2fb-4286-9f57-cc4ce908dbbd&#xA;Pipeline run with id=d19d1325-d2fb-4286-9f57-cc4ce908dbbd is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d19d1325-d2fb-4286-9f57-cc4ce908dbbd&#xA;Pipeline run with id=d19d1325-d2fb-4286-9f57-cc4ce908dbbd is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d19d1325-d2fb-4286-9f57-cc4ce908dbbd&#xA;Pipeline run with id=d19d1325-d2fb-4286-9f57-cc4ce908dbbd is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d19d1325-d2fb-4286-9f57-cc4ce908dbbd&#xA;Pipeline run with id=d19d1325-d2fb-4286-9f57-cc4ce908dbbd is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d19d1325-d2fb-4286-9f57-cc4ce908dbbd&#xA;Pipeline run with id=d19d1325-d2fb-4286-9f57-cc4ce908dbbd is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d19d1325-d2fb-4286-9f57-cc4ce908dbbd&#xA;Pipeline run with id=d19d1325-d2fb-4286-9f57-cc4ce908dbbd reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/flip_coin.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=d19d1325-d2fb-4286-9f57-cc4ce908dbbd&#xA;Get a pipeline run with id=d19d1325-d2fb-4286-9f57-cc4ce908dbbd&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/15/26 11:38:46.509 (2m5.673s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/15/26 11:38:46.509&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run d19d1325-d2fb-4286-9f57-cc4ce908dbbd&#xA;Failed to terminate run d19d1325-d2fb-4286-9f57-cc4ce908dbbd&#xA;Terminate run d19d1325-d2fb-4286-9f57-cc4ce908dbbd&#xA;Deleting run d19d1325-d2fb-4286-9f57-cc4ce908dbbd&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=4906d6f6-986f-4f0a-996a-b2f6302ae3e6 (cascade=true)&#xA;Pipeline with id=4906d6f6-986f-4f0a-996a-b2f6302ae3e6, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/15/26 11:38:46.664 (155ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/15/26 11:38:46.664&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/15/26 11:38:46.664 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/15/26 11:38:46.664&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/15/26 11:38:46.665 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload essential/iris_pipeline_compiled.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="155.929550828">
              <system-out>2026/07/15 11:39:16 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/15/26 11:36:40.513&#xA;Create an experiment with name E2EExperiment-1784115400513802402&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/15/26 11:36:40.646 (133ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/15/26 11:36:40.647&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x1fc2e4b2e800&#xA;test-secret-1 created&#xA;test-secret-2 created&#xA;test-secret-3 created&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/15/26 11:36:40.717 (70ms)&#xA;&gt; Enter [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/15/26 11:36:40.717&#xA;Uploading pipeline file essential/iris_pipeline_compiled.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1784115400647144289, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml&#xA;Upload of pipeline file &#39;essential/iris_pipeline_compiled.yaml&#39; successful&#xA;Listing pipeline versions for pipeline c35530f0-53af-4c23-b28c-8d90e323ede1&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;c35530f0-53af-4c23-b28c-8d90e323ede1&#39; and name: &#39;e2e-test-1784115400647144289&#39;&#xA;Create a pipeline run for pipeline with id=c35530f0-53af-4c23-b28c-8d90e323ede1 and versionId=2914d43d-b028-4bc5-890f-e4b39d5cb134&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=851dbc0e-59b9-4d87-b2b0-1d85c71e68b2&#xA;Created Pipeline Run with id: 851dbc0e-59b9-4d87-b2b0-1d85c71e68b2 for pipeline with id: c35530f0-53af-4c23-b28c-8d90e323ede1&#xA;Waiting for pipeline run with id=851dbc0e-59b9-4d87-b2b0-1d85c71e68b2 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=851dbc0e-59b9-4d87-b2b0-1d85c71e68b2&#xA;Pipeline run with id=851dbc0e-59b9-4d87-b2b0-1d85c71e68b2 is in PENDING state, waiting...&#xA;Get a pipeline run with id=851dbc0e-59b9-4d87-b2b0-1d85c71e68b2&#xA;Pipeline run with id=851dbc0e-59b9-4d87-b2b0-1d85c71e68b2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=851dbc0e-59b9-4d87-b2b0-1d85c71e68b2&#xA;Pipeline run with id=851dbc0e-59b9-4d87-b2b0-1d85c71e68b2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=851dbc0e-59b9-4d87-b2b0-1d85c71e68b2&#xA;Pipeline run with id=851dbc0e-59b9-4d87-b2b0-1d85c71e68b2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=851dbc0e-59b9-4d87-b2b0-1d85c71e68b2&#xA;Pipeline run with id=851dbc0e-59b9-4d87-b2b0-1d85c71e68b2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=851dbc0e-59b9-4d87-b2b0-1d85c71e68b2&#xA;Pipeline run with id=851dbc0e-59b9-4d87-b2b0-1d85c71e68b2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=851dbc0e-59b9-4d87-b2b0-1d85c71e68b2&#xA;Pipeline run with id=851dbc0e-59b9-4d87-b2b0-1d85c71e68b2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=851dbc0e-59b9-4d87-b2b0-1d85c71e68b2&#xA;Pipeline run with id=851dbc0e-59b9-4d87-b2b0-1d85c71e68b2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=851dbc0e-59b9-4d87-b2b0-1d85c71e68b2&#xA;Pipeline run with id=851dbc0e-59b9-4d87-b2b0-1d85c71e68b2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=851dbc0e-59b9-4d87-b2b0-1d85c71e68b2&#xA;Pipeline run with id=851dbc0e-59b9-4d87-b2b0-1d85c71e68b2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=851dbc0e-59b9-4d87-b2b0-1d85c71e68b2&#xA;Pipeline run with id=851dbc0e-59b9-4d87-b2b0-1d85c71e68b2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=851dbc0e-59b9-4d87-b2b0-1d85c71e68b2&#xA;Pipeline run with id=851dbc0e-59b9-4d87-b2b0-1d85c71e68b2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=851dbc0e-59b9-4d87-b2b0-1d85c71e68b2&#xA;Pipeline run with id=851dbc0e-59b9-4d87-b2b0-1d85c71e68b2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=851dbc0e-59b9-4d87-b2b0-1d85c71e68b2&#xA;Pipeline run with id=851dbc0e-59b9-4d87-b2b0-1d85c71e68b2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=851dbc0e-59b9-4d87-b2b0-1d85c71e68b2&#xA;Pipeline run with id=851dbc0e-59b9-4d87-b2b0-1d85c71e68b2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=851dbc0e-59b9-4d87-b2b0-1d85c71e68b2&#xA;Pipeline run with id=851dbc0e-59b9-4d87-b2b0-1d85c71e68b2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=851dbc0e-59b9-4d87-b2b0-1d85c71e68b2&#xA;Pipeline run with id=851dbc0e-59b9-4d87-b2b0-1d85c71e68b2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=851dbc0e-59b9-4d87-b2b0-1d85c71e68b2&#xA;Pipeline run with id=851dbc0e-59b9-4d87-b2b0-1d85c71e68b2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=851dbc0e-59b9-4d87-b2b0-1d85c71e68b2&#xA;Pipeline run with id=851dbc0e-59b9-4d87-b2b0-1d85c71e68b2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=851dbc0e-59b9-4d87-b2b0-1d85c71e68b2&#xA;Pipeline run with id=851dbc0e-59b9-4d87-b2b0-1d85c71e68b2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=851dbc0e-59b9-4d87-b2b0-1d85c71e68b2&#xA;Pipeline run with id=851dbc0e-59b9-4d87-b2b0-1d85c71e68b2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=851dbc0e-59b9-4d87-b2b0-1d85c71e68b2&#xA;Pipeline run with id=851dbc0e-59b9-4d87-b2b0-1d85c71e68b2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=851dbc0e-59b9-4d87-b2b0-1d85c71e68b2&#xA;Pipeline run with id=851dbc0e-59b9-4d87-b2b0-1d85c71e68b2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=851dbc0e-59b9-4d87-b2b0-1d85c71e68b2&#xA;Pipeline run with id=851dbc0e-59b9-4d87-b2b0-1d85c71e68b2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=851dbc0e-59b9-4d87-b2b0-1d85c71e68b2&#xA;Pipeline run with id=851dbc0e-59b9-4d87-b2b0-1d85c71e68b2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=851dbc0e-59b9-4d87-b2b0-1d85c71e68b2&#xA;Pipeline run with id=851dbc0e-59b9-4d87-b2b0-1d85c71e68b2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=851dbc0e-59b9-4d87-b2b0-1d85c71e68b2&#xA;Pipeline run with id=851dbc0e-59b9-4d87-b2b0-1d85c71e68b2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=851dbc0e-59b9-4d87-b2b0-1d85c71e68b2&#xA;Pipeline run with id=851dbc0e-59b9-4d87-b2b0-1d85c71e68b2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=851dbc0e-59b9-4d87-b2b0-1d85c71e68b2&#xA;Pipeline run with id=851dbc0e-59b9-4d87-b2b0-1d85c71e68b2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=851dbc0e-59b9-4d87-b2b0-1d85c71e68b2&#xA;Pipeline run with id=851dbc0e-59b9-4d87-b2b0-1d85c71e68b2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=851dbc0e-59b9-4d87-b2b0-1d85c71e68b2&#xA;Pipeline run with id=851dbc0e-59b9-4d87-b2b0-1d85c71e68b2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=851dbc0e-59b9-4d87-b2b0-1d85c71e68b2&#xA;Pipeline run with id=851dbc0e-59b9-4d87-b2b0-1d85c71e68b2 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;essential/iris_pipeline_compiled.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=851dbc0e-59b9-4d87-b2b0-1d85c71e68b2&#xA;Get a pipeline run with id=851dbc0e-59b9-4d87-b2b0-1d85c71e68b2&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/15/26 11:39:16.281 (2m35.564s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/15/26 11:39:16.281&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 851dbc0e-59b9-4d87-b2b0-1d85c71e68b2&#xA;Failed to terminate run 851dbc0e-59b9-4d87-b2b0-1d85c71e68b2&#xA;Terminate run 851dbc0e-59b9-4d87-b2b0-1d85c71e68b2&#xA;Deleting run 851dbc0e-59b9-4d87-b2b0-1d85c71e68b2&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=c35530f0-53af-4c23-b28c-8d90e323ede1 (cascade=true)&#xA;Pipeline with id=c35530f0-53af-4c23-b28c-8d90e323ede1, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/15/26 11:39:16.443 (162ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/15/26 11:39:16.443&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/15/26 11:39:16.443 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/15/26 11:39:16.444&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/15/26 11:39:16.444 (0s)&#xA;</system-err>
          </testcase>
      </testsuite>
  </testsuites>