<?xml version="1.0" encoding="UTF-8"?>
  <testsuites tests="5" disabled="0" errors="0" failures="0" time="190.90329344">
      <testsuite name="AIPipelinesE2ETests" package="/dspa/backend/test/end2end" tests="5" disabled="0" skipped="0" errors="0" failures="0" time="190.90329344" timestamp="2026-07-19T12:52:57">
          <properties>
              <property name="SuiteSucceeded" value="true"></property>
              <property name="SuiteHasProgrammaticFocus" value="false"></property>
              <property name="SpecialSuiteFailureReason" value=""></property>
              <property name="SuiteLabels" value="[]"></property>
              <property name="SuiteSemVerConstraints" value="[]"></property>
              <property name="RandomSeed" value="1784465418"></property>
              <property name="RandomizeAllSpecs" value="false"></property>
              <property name="LabelFilter" value="Smoke"></property>
              <property name="SemVerFilter" value=""></property>
              <property name="FocusStrings" value=""></property>
              <property name="SkipStrings" value=""></property>
              <property name="FocusFiles" value=""></property>
              <property name="SkipFiles" value=""></property>
              <property name="FailOnPending" value="false"></property>
              <property name="FailOnEmpty" value="false"></property>
              <property name="FailFast" value="false"></property>
              <property name="FlakeAttempts" value="0"></property>
              <property name="DryRun" value="false"></property>
              <property name="ParallelTotal" value="10"></property>
              <property name="OutputInterceptorMode" value=""></property>
          </properties>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload essential/iris_pipeline_compiled.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="190.780231353">
              <system-out>2026/07/19 12:56:08 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/19/26 12:52:57.817&#xA;Create an experiment with name E2EExperiment-1784465577817838952&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/19/26 12:52:57.898 (81ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/19/26 12:52:57.898&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x27cd9a3f7100&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/19/26 12:52:57.935 (37ms)&#xA;&gt; Enter [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/19/26 12:52:57.935&#xA;Uploading pipeline file essential/iris_pipeline_compiled.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1784465577898956006, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml&#xA;Upload of pipeline file &#39;essential/iris_pipeline_compiled.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 094a5fbc-7f79-44d8-a0a1-ec0b2e34bbcc&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;094a5fbc-7f79-44d8-a0a1-ec0b2e34bbcc&#39; and name: &#39;e2e-test-1784465577898956006&#39;&#xA;Create a pipeline run for pipeline with id=094a5fbc-7f79-44d8-a0a1-ec0b2e34bbcc and versionId=7947792b-d0bc-4271-8247-e2c53170fe4d&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=e2388b6d-5349-4024-9afd-bbc20037ae80&#xA;Created Pipeline Run with id: e2388b6d-5349-4024-9afd-bbc20037ae80 for pipeline with id: 094a5fbc-7f79-44d8-a0a1-ec0b2e34bbcc&#xA;Waiting for pipeline run with id=e2388b6d-5349-4024-9afd-bbc20037ae80 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=e2388b6d-5349-4024-9afd-bbc20037ae80&#xA;Pipeline run with id=e2388b6d-5349-4024-9afd-bbc20037ae80 is in PENDING state, waiting...&#xA;Get a pipeline run with id=e2388b6d-5349-4024-9afd-bbc20037ae80&#xA;Pipeline run with id=e2388b6d-5349-4024-9afd-bbc20037ae80 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e2388b6d-5349-4024-9afd-bbc20037ae80&#xA;Pipeline run with id=e2388b6d-5349-4024-9afd-bbc20037ae80 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e2388b6d-5349-4024-9afd-bbc20037ae80&#xA;Pipeline run with id=e2388b6d-5349-4024-9afd-bbc20037ae80 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e2388b6d-5349-4024-9afd-bbc20037ae80&#xA;Pipeline run with id=e2388b6d-5349-4024-9afd-bbc20037ae80 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e2388b6d-5349-4024-9afd-bbc20037ae80&#xA;Pipeline run with id=e2388b6d-5349-4024-9afd-bbc20037ae80 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e2388b6d-5349-4024-9afd-bbc20037ae80&#xA;Pipeline run with id=e2388b6d-5349-4024-9afd-bbc20037ae80 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e2388b6d-5349-4024-9afd-bbc20037ae80&#xA;Pipeline run with id=e2388b6d-5349-4024-9afd-bbc20037ae80 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e2388b6d-5349-4024-9afd-bbc20037ae80&#xA;Pipeline run with id=e2388b6d-5349-4024-9afd-bbc20037ae80 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e2388b6d-5349-4024-9afd-bbc20037ae80&#xA;Pipeline run with id=e2388b6d-5349-4024-9afd-bbc20037ae80 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e2388b6d-5349-4024-9afd-bbc20037ae80&#xA;Pipeline run with id=e2388b6d-5349-4024-9afd-bbc20037ae80 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e2388b6d-5349-4024-9afd-bbc20037ae80&#xA;Pipeline run with id=e2388b6d-5349-4024-9afd-bbc20037ae80 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e2388b6d-5349-4024-9afd-bbc20037ae80&#xA;Pipeline run with id=e2388b6d-5349-4024-9afd-bbc20037ae80 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e2388b6d-5349-4024-9afd-bbc20037ae80&#xA;Pipeline run with id=e2388b6d-5349-4024-9afd-bbc20037ae80 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e2388b6d-5349-4024-9afd-bbc20037ae80&#xA;Pipeline run with id=e2388b6d-5349-4024-9afd-bbc20037ae80 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e2388b6d-5349-4024-9afd-bbc20037ae80&#xA;Pipeline run with id=e2388b6d-5349-4024-9afd-bbc20037ae80 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e2388b6d-5349-4024-9afd-bbc20037ae80&#xA;Pipeline run with id=e2388b6d-5349-4024-9afd-bbc20037ae80 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e2388b6d-5349-4024-9afd-bbc20037ae80&#xA;Pipeline run with id=e2388b6d-5349-4024-9afd-bbc20037ae80 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e2388b6d-5349-4024-9afd-bbc20037ae80&#xA;Pipeline run with id=e2388b6d-5349-4024-9afd-bbc20037ae80 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e2388b6d-5349-4024-9afd-bbc20037ae80&#xA;Pipeline run with id=e2388b6d-5349-4024-9afd-bbc20037ae80 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e2388b6d-5349-4024-9afd-bbc20037ae80&#xA;Pipeline run with id=e2388b6d-5349-4024-9afd-bbc20037ae80 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e2388b6d-5349-4024-9afd-bbc20037ae80&#xA;Pipeline run with id=e2388b6d-5349-4024-9afd-bbc20037ae80 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e2388b6d-5349-4024-9afd-bbc20037ae80&#xA;Pipeline run with id=e2388b6d-5349-4024-9afd-bbc20037ae80 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e2388b6d-5349-4024-9afd-bbc20037ae80&#xA;Pipeline run with id=e2388b6d-5349-4024-9afd-bbc20037ae80 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e2388b6d-5349-4024-9afd-bbc20037ae80&#xA;Pipeline run with id=e2388b6d-5349-4024-9afd-bbc20037ae80 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e2388b6d-5349-4024-9afd-bbc20037ae80&#xA;Pipeline run with id=e2388b6d-5349-4024-9afd-bbc20037ae80 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e2388b6d-5349-4024-9afd-bbc20037ae80&#xA;Pipeline run with id=e2388b6d-5349-4024-9afd-bbc20037ae80 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e2388b6d-5349-4024-9afd-bbc20037ae80&#xA;Pipeline run with id=e2388b6d-5349-4024-9afd-bbc20037ae80 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e2388b6d-5349-4024-9afd-bbc20037ae80&#xA;Pipeline run with id=e2388b6d-5349-4024-9afd-bbc20037ae80 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e2388b6d-5349-4024-9afd-bbc20037ae80&#xA;Pipeline run with id=e2388b6d-5349-4024-9afd-bbc20037ae80 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e2388b6d-5349-4024-9afd-bbc20037ae80&#xA;Pipeline run with id=e2388b6d-5349-4024-9afd-bbc20037ae80 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e2388b6d-5349-4024-9afd-bbc20037ae80&#xA;Pipeline run with id=e2388b6d-5349-4024-9afd-bbc20037ae80 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e2388b6d-5349-4024-9afd-bbc20037ae80&#xA;Pipeline run with id=e2388b6d-5349-4024-9afd-bbc20037ae80 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e2388b6d-5349-4024-9afd-bbc20037ae80&#xA;Pipeline run with id=e2388b6d-5349-4024-9afd-bbc20037ae80 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e2388b6d-5349-4024-9afd-bbc20037ae80&#xA;Pipeline run with id=e2388b6d-5349-4024-9afd-bbc20037ae80 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e2388b6d-5349-4024-9afd-bbc20037ae80&#xA;Pipeline run with id=e2388b6d-5349-4024-9afd-bbc20037ae80 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e2388b6d-5349-4024-9afd-bbc20037ae80&#xA;Pipeline run with id=e2388b6d-5349-4024-9afd-bbc20037ae80 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e2388b6d-5349-4024-9afd-bbc20037ae80&#xA;Pipeline run with id=e2388b6d-5349-4024-9afd-bbc20037ae80 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e2388b6d-5349-4024-9afd-bbc20037ae80&#xA;Pipeline run with id=e2388b6d-5349-4024-9afd-bbc20037ae80 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;essential/iris_pipeline_compiled.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=e2388b6d-5349-4024-9afd-bbc20037ae80&#xA;Get a pipeline run with id=e2388b6d-5349-4024-9afd-bbc20037ae80&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/19/26 12:56:08.492 (3m10.557s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/19/26 12:56:08.492&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run e2388b6d-5349-4024-9afd-bbc20037ae80&#xA;Failed to terminate run e2388b6d-5349-4024-9afd-bbc20037ae80&#xA;Terminate run e2388b6d-5349-4024-9afd-bbc20037ae80&#xA;Deleting run e2388b6d-5349-4024-9afd-bbc20037ae80&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=094a5fbc-7f79-44d8-a0a1-ec0b2e34bbcc (cascade=true)&#xA;Pipeline with id=094a5fbc-7f79-44d8-a0a1-ec0b2e34bbcc, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/19/26 12:56:08.597 (105ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/19/26 12:56:08.598&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/19/26 12:56:08.598 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/19/26 12:56:08.598&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/19/26 12:56:08.598 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload essential/component_with_pip_index_urls.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="80.687667511">
              <system-out>2026/07/19 12:54:18 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/19/26 12:52:57.818&#xA;Create an experiment with name E2EExperiment-1784465577818154590&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/19/26 12:52:57.893 (76ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/19/26 12:52:57.893&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x1be52b95cb80&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/19/26 12:52:57.925 (31ms)&#xA;&gt; Enter [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/19/26 12:52:57.925&#xA;Uploading pipeline file essential/component_with_pip_index_urls.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1784465577894009883, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml&#xA;Upload of pipeline file &#39;essential/component_with_pip_index_urls.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 33824c70-ae2d-437b-af53-caf095ebd29d&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;33824c70-ae2d-437b-af53-caf095ebd29d&#39; and name: &#39;e2e-test-1784465577894009883&#39;&#xA;Create a pipeline run for pipeline with id=33824c70-ae2d-437b-af53-caf095ebd29d and versionId=fba45554-a6db-48ec-bed4-dbdbe48fdb1d&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=779a95ce-db55-4a13-953b-69428c57c213&#xA;Created Pipeline Run with id: 779a95ce-db55-4a13-953b-69428c57c213 for pipeline with id: 33824c70-ae2d-437b-af53-caf095ebd29d&#xA;Waiting for pipeline run with id=779a95ce-db55-4a13-953b-69428c57c213 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=779a95ce-db55-4a13-953b-69428c57c213&#xA;Pipeline run with id=779a95ce-db55-4a13-953b-69428c57c213 is in PENDING state, waiting...&#xA;Get a pipeline run with id=779a95ce-db55-4a13-953b-69428c57c213&#xA;Pipeline run with id=779a95ce-db55-4a13-953b-69428c57c213 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=779a95ce-db55-4a13-953b-69428c57c213&#xA;Pipeline run with id=779a95ce-db55-4a13-953b-69428c57c213 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=779a95ce-db55-4a13-953b-69428c57c213&#xA;Pipeline run with id=779a95ce-db55-4a13-953b-69428c57c213 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=779a95ce-db55-4a13-953b-69428c57c213&#xA;Pipeline run with id=779a95ce-db55-4a13-953b-69428c57c213 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=779a95ce-db55-4a13-953b-69428c57c213&#xA;Pipeline run with id=779a95ce-db55-4a13-953b-69428c57c213 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=779a95ce-db55-4a13-953b-69428c57c213&#xA;Pipeline run with id=779a95ce-db55-4a13-953b-69428c57c213 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=779a95ce-db55-4a13-953b-69428c57c213&#xA;Pipeline run with id=779a95ce-db55-4a13-953b-69428c57c213 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=779a95ce-db55-4a13-953b-69428c57c213&#xA;Pipeline run with id=779a95ce-db55-4a13-953b-69428c57c213 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=779a95ce-db55-4a13-953b-69428c57c213&#xA;Pipeline run with id=779a95ce-db55-4a13-953b-69428c57c213 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=779a95ce-db55-4a13-953b-69428c57c213&#xA;Pipeline run with id=779a95ce-db55-4a13-953b-69428c57c213 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=779a95ce-db55-4a13-953b-69428c57c213&#xA;Pipeline run with id=779a95ce-db55-4a13-953b-69428c57c213 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=779a95ce-db55-4a13-953b-69428c57c213&#xA;Pipeline run with id=779a95ce-db55-4a13-953b-69428c57c213 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=779a95ce-db55-4a13-953b-69428c57c213&#xA;Pipeline run with id=779a95ce-db55-4a13-953b-69428c57c213 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=779a95ce-db55-4a13-953b-69428c57c213&#xA;Pipeline run with id=779a95ce-db55-4a13-953b-69428c57c213 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=779a95ce-db55-4a13-953b-69428c57c213&#xA;Pipeline run with id=779a95ce-db55-4a13-953b-69428c57c213 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=779a95ce-db55-4a13-953b-69428c57c213&#xA;Pipeline run with id=779a95ce-db55-4a13-953b-69428c57c213 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;essential/component_with_pip_index_urls.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=779a95ce-db55-4a13-953b-69428c57c213&#xA;Get a pipeline run with id=779a95ce-db55-4a13-953b-69428c57c213&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/19/26 12:54:18.391 (1m20.466s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/19/26 12:54:18.391&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 779a95ce-db55-4a13-953b-69428c57c213&#xA;Failed to terminate run 779a95ce-db55-4a13-953b-69428c57c213&#xA;Terminate run 779a95ce-db55-4a13-953b-69428c57c213&#xA;Deleting run 779a95ce-db55-4a13-953b-69428c57c213&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=33824c70-ae2d-437b-af53-caf095ebd29d (cascade=true)&#xA;Pipeline with id=33824c70-ae2d-437b-af53-caf095ebd29d, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/19/26 12:54:18.505 (114ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/19/26 12:54:18.505&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/19/26 12:54:18.506 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/19/26 12:54:18.506&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/19/26 12:54:18.506 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/parallel_for_after_dependency.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="125.801514408">
              <system-out>2026/07/19 12:55:03 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/19/26 12:52:57.817&#xA;Create an experiment with name E2EExperiment-1784465577817822412&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/19/26 12:52:57.893 (76ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/19/26 12:52:57.893&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x26439c28a500&#xA;test-secret-1 created&#xA;test-secret-2 created&#xA;test-secret-3 created&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/19/26 12:52:57.921 (27ms)&#xA;&gt; Enter [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/19/26 12:52:57.921&#xA;Uploading pipeline file critical/parallel_for_after_dependency.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1784465577893924481, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml&#xA;Upload of pipeline file &#39;critical/parallel_for_after_dependency.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 8bb45ed3-82a0-43be-b467-e1625fca40a5&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;8bb45ed3-82a0-43be-b467-e1625fca40a5&#39; and name: &#39;e2e-test-1784465577893924481&#39;&#xA;Create a pipeline run for pipeline with id=8bb45ed3-82a0-43be-b467-e1625fca40a5 and versionId=6ac3ad6c-b45d-4706-9ee9-c606970dc251&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=826e8972-00c0-49d9-b756-ae2dae59245e&#xA;Created Pipeline Run with id: 826e8972-00c0-49d9-b756-ae2dae59245e for pipeline with id: 8bb45ed3-82a0-43be-b467-e1625fca40a5&#xA;Waiting for pipeline run with id=826e8972-00c0-49d9-b756-ae2dae59245e to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=826e8972-00c0-49d9-b756-ae2dae59245e&#xA;Pipeline run with id=826e8972-00c0-49d9-b756-ae2dae59245e is in PENDING state, waiting...&#xA;Get a pipeline run with id=826e8972-00c0-49d9-b756-ae2dae59245e&#xA;Pipeline run with id=826e8972-00c0-49d9-b756-ae2dae59245e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=826e8972-00c0-49d9-b756-ae2dae59245e&#xA;Pipeline run with id=826e8972-00c0-49d9-b756-ae2dae59245e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=826e8972-00c0-49d9-b756-ae2dae59245e&#xA;Pipeline run with id=826e8972-00c0-49d9-b756-ae2dae59245e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=826e8972-00c0-49d9-b756-ae2dae59245e&#xA;Pipeline run with id=826e8972-00c0-49d9-b756-ae2dae59245e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=826e8972-00c0-49d9-b756-ae2dae59245e&#xA;Pipeline run with id=826e8972-00c0-49d9-b756-ae2dae59245e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=826e8972-00c0-49d9-b756-ae2dae59245e&#xA;Pipeline run with id=826e8972-00c0-49d9-b756-ae2dae59245e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=826e8972-00c0-49d9-b756-ae2dae59245e&#xA;Pipeline run with id=826e8972-00c0-49d9-b756-ae2dae59245e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=826e8972-00c0-49d9-b756-ae2dae59245e&#xA;Pipeline run with id=826e8972-00c0-49d9-b756-ae2dae59245e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=826e8972-00c0-49d9-b756-ae2dae59245e&#xA;Pipeline run with id=826e8972-00c0-49d9-b756-ae2dae59245e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=826e8972-00c0-49d9-b756-ae2dae59245e&#xA;Pipeline run with id=826e8972-00c0-49d9-b756-ae2dae59245e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=826e8972-00c0-49d9-b756-ae2dae59245e&#xA;Pipeline run with id=826e8972-00c0-49d9-b756-ae2dae59245e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=826e8972-00c0-49d9-b756-ae2dae59245e&#xA;Pipeline run with id=826e8972-00c0-49d9-b756-ae2dae59245e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=826e8972-00c0-49d9-b756-ae2dae59245e&#xA;Pipeline run with id=826e8972-00c0-49d9-b756-ae2dae59245e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=826e8972-00c0-49d9-b756-ae2dae59245e&#xA;Pipeline run with id=826e8972-00c0-49d9-b756-ae2dae59245e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=826e8972-00c0-49d9-b756-ae2dae59245e&#xA;Pipeline run with id=826e8972-00c0-49d9-b756-ae2dae59245e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=826e8972-00c0-49d9-b756-ae2dae59245e&#xA;Pipeline run with id=826e8972-00c0-49d9-b756-ae2dae59245e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=826e8972-00c0-49d9-b756-ae2dae59245e&#xA;Pipeline run with id=826e8972-00c0-49d9-b756-ae2dae59245e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=826e8972-00c0-49d9-b756-ae2dae59245e&#xA;Pipeline run with id=826e8972-00c0-49d9-b756-ae2dae59245e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=826e8972-00c0-49d9-b756-ae2dae59245e&#xA;Pipeline run with id=826e8972-00c0-49d9-b756-ae2dae59245e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=826e8972-00c0-49d9-b756-ae2dae59245e&#xA;Pipeline run with id=826e8972-00c0-49d9-b756-ae2dae59245e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=826e8972-00c0-49d9-b756-ae2dae59245e&#xA;Pipeline run with id=826e8972-00c0-49d9-b756-ae2dae59245e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=826e8972-00c0-49d9-b756-ae2dae59245e&#xA;Pipeline run with id=826e8972-00c0-49d9-b756-ae2dae59245e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=826e8972-00c0-49d9-b756-ae2dae59245e&#xA;Pipeline run with id=826e8972-00c0-49d9-b756-ae2dae59245e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=826e8972-00c0-49d9-b756-ae2dae59245e&#xA;Pipeline run with id=826e8972-00c0-49d9-b756-ae2dae59245e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=826e8972-00c0-49d9-b756-ae2dae59245e&#xA;Pipeline run with id=826e8972-00c0-49d9-b756-ae2dae59245e reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/parallel_for_after_dependency.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=826e8972-00c0-49d9-b756-ae2dae59245e&#xA;Get a pipeline run with id=826e8972-00c0-49d9-b756-ae2dae59245e&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/19/26 12:55:03.493 (2m5.572s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/19/26 12:55:03.493&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 826e8972-00c0-49d9-b756-ae2dae59245e&#xA;Failed to terminate run 826e8972-00c0-49d9-b756-ae2dae59245e&#xA;Terminate run 826e8972-00c0-49d9-b756-ae2dae59245e&#xA;Deleting run 826e8972-00c0-49d9-b756-ae2dae59245e&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=8bb45ed3-82a0-43be-b467-e1625fca40a5 (cascade=true)&#xA;Pipeline with id=8bb45ed3-82a0-43be-b467-e1625fca40a5, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/19/26 12:55:03.619 (126ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/19/26 12:55:03.619&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/19/26 12:55:03.619 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/19/26 12:55:03.619&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/19/26 12:55:03.619 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/pipeline_with_artifact_upload_download.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="130.811792968">
              <system-out>2026/07/19 12:55:08 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/19/26 12:52:57.817&#xA;Create an experiment with name E2EExperiment-1784465577817822032&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/19/26 12:52:57.897 (80ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/19/26 12:52:57.898&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x3c86aba88c80&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/19/26 12:52:57.96 (62ms)&#xA;&gt; Enter [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/19/26 12:52:57.96&#xA;Uploading pipeline file critical/pipeline_with_artifact_upload_download.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1784465577898035243, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml&#xA;Upload of pipeline file &#39;critical/pipeline_with_artifact_upload_download.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 65221258-1ba7-47a3-ba6f-cfb89664fab8&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;65221258-1ba7-47a3-ba6f-cfb89664fab8&#39; and name: &#39;e2e-test-1784465577898035243&#39;&#xA;Create a pipeline run for pipeline with id=65221258-1ba7-47a3-ba6f-cfb89664fab8 and versionId=735f6428-e70d-4009-8c0c-f55326105f18&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=1fa6a6e4-1a61-4aad-8f0c-6f9172f3a58e&#xA;Created Pipeline Run with id: 1fa6a6e4-1a61-4aad-8f0c-6f9172f3a58e for pipeline with id: 65221258-1ba7-47a3-ba6f-cfb89664fab8&#xA;Waiting for pipeline run with id=1fa6a6e4-1a61-4aad-8f0c-6f9172f3a58e to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=1fa6a6e4-1a61-4aad-8f0c-6f9172f3a58e&#xA;Pipeline run with id=1fa6a6e4-1a61-4aad-8f0c-6f9172f3a58e is in PENDING state, waiting...&#xA;Get a pipeline run with id=1fa6a6e4-1a61-4aad-8f0c-6f9172f3a58e&#xA;Pipeline run with id=1fa6a6e4-1a61-4aad-8f0c-6f9172f3a58e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1fa6a6e4-1a61-4aad-8f0c-6f9172f3a58e&#xA;Pipeline run with id=1fa6a6e4-1a61-4aad-8f0c-6f9172f3a58e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1fa6a6e4-1a61-4aad-8f0c-6f9172f3a58e&#xA;Pipeline run with id=1fa6a6e4-1a61-4aad-8f0c-6f9172f3a58e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1fa6a6e4-1a61-4aad-8f0c-6f9172f3a58e&#xA;Pipeline run with id=1fa6a6e4-1a61-4aad-8f0c-6f9172f3a58e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1fa6a6e4-1a61-4aad-8f0c-6f9172f3a58e&#xA;Pipeline run with id=1fa6a6e4-1a61-4aad-8f0c-6f9172f3a58e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1fa6a6e4-1a61-4aad-8f0c-6f9172f3a58e&#xA;Pipeline run with id=1fa6a6e4-1a61-4aad-8f0c-6f9172f3a58e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1fa6a6e4-1a61-4aad-8f0c-6f9172f3a58e&#xA;Pipeline run with id=1fa6a6e4-1a61-4aad-8f0c-6f9172f3a58e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1fa6a6e4-1a61-4aad-8f0c-6f9172f3a58e&#xA;Pipeline run with id=1fa6a6e4-1a61-4aad-8f0c-6f9172f3a58e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1fa6a6e4-1a61-4aad-8f0c-6f9172f3a58e&#xA;Pipeline run with id=1fa6a6e4-1a61-4aad-8f0c-6f9172f3a58e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1fa6a6e4-1a61-4aad-8f0c-6f9172f3a58e&#xA;Pipeline run with id=1fa6a6e4-1a61-4aad-8f0c-6f9172f3a58e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1fa6a6e4-1a61-4aad-8f0c-6f9172f3a58e&#xA;Pipeline run with id=1fa6a6e4-1a61-4aad-8f0c-6f9172f3a58e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1fa6a6e4-1a61-4aad-8f0c-6f9172f3a58e&#xA;Pipeline run with id=1fa6a6e4-1a61-4aad-8f0c-6f9172f3a58e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1fa6a6e4-1a61-4aad-8f0c-6f9172f3a58e&#xA;Pipeline run with id=1fa6a6e4-1a61-4aad-8f0c-6f9172f3a58e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1fa6a6e4-1a61-4aad-8f0c-6f9172f3a58e&#xA;Pipeline run with id=1fa6a6e4-1a61-4aad-8f0c-6f9172f3a58e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1fa6a6e4-1a61-4aad-8f0c-6f9172f3a58e&#xA;Pipeline run with id=1fa6a6e4-1a61-4aad-8f0c-6f9172f3a58e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1fa6a6e4-1a61-4aad-8f0c-6f9172f3a58e&#xA;Pipeline run with id=1fa6a6e4-1a61-4aad-8f0c-6f9172f3a58e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1fa6a6e4-1a61-4aad-8f0c-6f9172f3a58e&#xA;Pipeline run with id=1fa6a6e4-1a61-4aad-8f0c-6f9172f3a58e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1fa6a6e4-1a61-4aad-8f0c-6f9172f3a58e&#xA;Pipeline run with id=1fa6a6e4-1a61-4aad-8f0c-6f9172f3a58e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1fa6a6e4-1a61-4aad-8f0c-6f9172f3a58e&#xA;Pipeline run with id=1fa6a6e4-1a61-4aad-8f0c-6f9172f3a58e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1fa6a6e4-1a61-4aad-8f0c-6f9172f3a58e&#xA;Pipeline run with id=1fa6a6e4-1a61-4aad-8f0c-6f9172f3a58e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1fa6a6e4-1a61-4aad-8f0c-6f9172f3a58e&#xA;Pipeline run with id=1fa6a6e4-1a61-4aad-8f0c-6f9172f3a58e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1fa6a6e4-1a61-4aad-8f0c-6f9172f3a58e&#xA;Pipeline run with id=1fa6a6e4-1a61-4aad-8f0c-6f9172f3a58e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1fa6a6e4-1a61-4aad-8f0c-6f9172f3a58e&#xA;Pipeline run with id=1fa6a6e4-1a61-4aad-8f0c-6f9172f3a58e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1fa6a6e4-1a61-4aad-8f0c-6f9172f3a58e&#xA;Pipeline run with id=1fa6a6e4-1a61-4aad-8f0c-6f9172f3a58e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1fa6a6e4-1a61-4aad-8f0c-6f9172f3a58e&#xA;Pipeline run with id=1fa6a6e4-1a61-4aad-8f0c-6f9172f3a58e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1fa6a6e4-1a61-4aad-8f0c-6f9172f3a58e&#xA;Pipeline run with id=1fa6a6e4-1a61-4aad-8f0c-6f9172f3a58e reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/pipeline_with_artifact_upload_download.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=1fa6a6e4-1a61-4aad-8f0c-6f9172f3a58e&#xA;Get a pipeline run with id=1fa6a6e4-1a61-4aad-8f0c-6f9172f3a58e&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/19/26 12:55:08.491 (2m10.531s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/19/26 12:55:08.491&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 1fa6a6e4-1a61-4aad-8f0c-6f9172f3a58e&#xA;Failed to terminate run 1fa6a6e4-1a61-4aad-8f0c-6f9172f3a58e&#xA;Terminate run 1fa6a6e4-1a61-4aad-8f0c-6f9172f3a58e&#xA;Deleting run 1fa6a6e4-1a61-4aad-8f0c-6f9172f3a58e&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=65221258-1ba7-47a3-ba6f-cfb89664fab8 (cascade=true)&#xA;Pipeline with id=65221258-1ba7-47a3-ba6f-cfb89664fab8, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/19/26 12:55:08.629 (138ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/19/26 12:55:08.629&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/19/26 12:55:08.629 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/19/26 12:55:08.629&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/19/26 12:55:08.629 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/flip_coin.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="160.892059863">
              <system-out>2026/07/19 12:55:38 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/19/26 12:52:57.817&#xA;Create an experiment with name E2EExperiment-1784465577817507074&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/19/26 12:52:57.896 (79ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/19/26 12:52:57.896&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x293e79938b00&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/19/26 12:52:57.941 (46ms)&#xA;&gt; Enter [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/19/26 12:52:57.942&#xA;Uploading pipeline file critical/flip_coin.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1784465577896210337, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml&#xA;Upload of pipeline file &#39;critical/flip_coin.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 0ecb0724-11ff-4e1d-a206-b88cc64e5122&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;0ecb0724-11ff-4e1d-a206-b88cc64e5122&#39; and name: &#39;e2e-test-1784465577896210337&#39;&#xA;Create a pipeline run for pipeline with id=0ecb0724-11ff-4e1d-a206-b88cc64e5122 and versionId=1e64796e-f852-46fa-9fd2-2f6b8aa15ce4&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=ddc8754e-3064-4fa7-a7c5-9f6fdc30ac1e&#xA;Created Pipeline Run with id: ddc8754e-3064-4fa7-a7c5-9f6fdc30ac1e for pipeline with id: 0ecb0724-11ff-4e1d-a206-b88cc64e5122&#xA;Waiting for pipeline run with id=ddc8754e-3064-4fa7-a7c5-9f6fdc30ac1e to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=ddc8754e-3064-4fa7-a7c5-9f6fdc30ac1e&#xA;Pipeline run with id=ddc8754e-3064-4fa7-a7c5-9f6fdc30ac1e is in PENDING state, waiting...&#xA;Get a pipeline run with id=ddc8754e-3064-4fa7-a7c5-9f6fdc30ac1e&#xA;Pipeline run with id=ddc8754e-3064-4fa7-a7c5-9f6fdc30ac1e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ddc8754e-3064-4fa7-a7c5-9f6fdc30ac1e&#xA;Pipeline run with id=ddc8754e-3064-4fa7-a7c5-9f6fdc30ac1e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ddc8754e-3064-4fa7-a7c5-9f6fdc30ac1e&#xA;Pipeline run with id=ddc8754e-3064-4fa7-a7c5-9f6fdc30ac1e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ddc8754e-3064-4fa7-a7c5-9f6fdc30ac1e&#xA;Pipeline run with id=ddc8754e-3064-4fa7-a7c5-9f6fdc30ac1e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ddc8754e-3064-4fa7-a7c5-9f6fdc30ac1e&#xA;Pipeline run with id=ddc8754e-3064-4fa7-a7c5-9f6fdc30ac1e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ddc8754e-3064-4fa7-a7c5-9f6fdc30ac1e&#xA;Pipeline run with id=ddc8754e-3064-4fa7-a7c5-9f6fdc30ac1e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ddc8754e-3064-4fa7-a7c5-9f6fdc30ac1e&#xA;Pipeline run with id=ddc8754e-3064-4fa7-a7c5-9f6fdc30ac1e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ddc8754e-3064-4fa7-a7c5-9f6fdc30ac1e&#xA;Pipeline run with id=ddc8754e-3064-4fa7-a7c5-9f6fdc30ac1e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ddc8754e-3064-4fa7-a7c5-9f6fdc30ac1e&#xA;Pipeline run with id=ddc8754e-3064-4fa7-a7c5-9f6fdc30ac1e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ddc8754e-3064-4fa7-a7c5-9f6fdc30ac1e&#xA;Pipeline run with id=ddc8754e-3064-4fa7-a7c5-9f6fdc30ac1e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ddc8754e-3064-4fa7-a7c5-9f6fdc30ac1e&#xA;Pipeline run with id=ddc8754e-3064-4fa7-a7c5-9f6fdc30ac1e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ddc8754e-3064-4fa7-a7c5-9f6fdc30ac1e&#xA;Pipeline run with id=ddc8754e-3064-4fa7-a7c5-9f6fdc30ac1e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ddc8754e-3064-4fa7-a7c5-9f6fdc30ac1e&#xA;Pipeline run with id=ddc8754e-3064-4fa7-a7c5-9f6fdc30ac1e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ddc8754e-3064-4fa7-a7c5-9f6fdc30ac1e&#xA;Pipeline run with id=ddc8754e-3064-4fa7-a7c5-9f6fdc30ac1e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ddc8754e-3064-4fa7-a7c5-9f6fdc30ac1e&#xA;Pipeline run with id=ddc8754e-3064-4fa7-a7c5-9f6fdc30ac1e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ddc8754e-3064-4fa7-a7c5-9f6fdc30ac1e&#xA;Pipeline run with id=ddc8754e-3064-4fa7-a7c5-9f6fdc30ac1e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ddc8754e-3064-4fa7-a7c5-9f6fdc30ac1e&#xA;Pipeline run with id=ddc8754e-3064-4fa7-a7c5-9f6fdc30ac1e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ddc8754e-3064-4fa7-a7c5-9f6fdc30ac1e&#xA;Pipeline run with id=ddc8754e-3064-4fa7-a7c5-9f6fdc30ac1e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ddc8754e-3064-4fa7-a7c5-9f6fdc30ac1e&#xA;Pipeline run with id=ddc8754e-3064-4fa7-a7c5-9f6fdc30ac1e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ddc8754e-3064-4fa7-a7c5-9f6fdc30ac1e&#xA;Pipeline run with id=ddc8754e-3064-4fa7-a7c5-9f6fdc30ac1e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ddc8754e-3064-4fa7-a7c5-9f6fdc30ac1e&#xA;Pipeline run with id=ddc8754e-3064-4fa7-a7c5-9f6fdc30ac1e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ddc8754e-3064-4fa7-a7c5-9f6fdc30ac1e&#xA;Pipeline run with id=ddc8754e-3064-4fa7-a7c5-9f6fdc30ac1e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ddc8754e-3064-4fa7-a7c5-9f6fdc30ac1e&#xA;Pipeline run with id=ddc8754e-3064-4fa7-a7c5-9f6fdc30ac1e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ddc8754e-3064-4fa7-a7c5-9f6fdc30ac1e&#xA;Pipeline run with id=ddc8754e-3064-4fa7-a7c5-9f6fdc30ac1e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ddc8754e-3064-4fa7-a7c5-9f6fdc30ac1e&#xA;Pipeline run with id=ddc8754e-3064-4fa7-a7c5-9f6fdc30ac1e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ddc8754e-3064-4fa7-a7c5-9f6fdc30ac1e&#xA;Pipeline run with id=ddc8754e-3064-4fa7-a7c5-9f6fdc30ac1e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ddc8754e-3064-4fa7-a7c5-9f6fdc30ac1e&#xA;Pipeline run with id=ddc8754e-3064-4fa7-a7c5-9f6fdc30ac1e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ddc8754e-3064-4fa7-a7c5-9f6fdc30ac1e&#xA;Pipeline run with id=ddc8754e-3064-4fa7-a7c5-9f6fdc30ac1e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ddc8754e-3064-4fa7-a7c5-9f6fdc30ac1e&#xA;Pipeline run with id=ddc8754e-3064-4fa7-a7c5-9f6fdc30ac1e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ddc8754e-3064-4fa7-a7c5-9f6fdc30ac1e&#xA;Pipeline run with id=ddc8754e-3064-4fa7-a7c5-9f6fdc30ac1e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ddc8754e-3064-4fa7-a7c5-9f6fdc30ac1e&#xA;Pipeline run with id=ddc8754e-3064-4fa7-a7c5-9f6fdc30ac1e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ddc8754e-3064-4fa7-a7c5-9f6fdc30ac1e&#xA;Pipeline run with id=ddc8754e-3064-4fa7-a7c5-9f6fdc30ac1e reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/flip_coin.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=ddc8754e-3064-4fa7-a7c5-9f6fdc30ac1e&#xA;Get a pipeline run with id=ddc8754e-3064-4fa7-a7c5-9f6fdc30ac1e&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/19/26 12:55:38.615 (2m40.674s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/19/26 12:55:38.616&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run ddc8754e-3064-4fa7-a7c5-9f6fdc30ac1e&#xA;Failed to terminate run ddc8754e-3064-4fa7-a7c5-9f6fdc30ac1e&#xA;Terminate run ddc8754e-3064-4fa7-a7c5-9f6fdc30ac1e&#xA;Deleting run ddc8754e-3064-4fa7-a7c5-9f6fdc30ac1e&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=0ecb0724-11ff-4e1d-a206-b88cc64e5122 (cascade=true)&#xA;Pipeline with id=0ecb0724-11ff-4e1d-a206-b88cc64e5122, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/19/26 12:55:38.709 (93ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/19/26 12:55:38.709&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/19/26 12:55:38.709 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/19/26 12:55:38.71&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/19/26 12:55:38.71 (0s)&#xA;</system-err>
          </testcase>
      </testsuite>
  </testsuites>