<?xml version="1.0" encoding="UTF-8"?>
  <testsuites tests="5" disabled="0" errors="0" failures="0" time="170.890058952">
      <testsuite name="AIPipelinesE2ETests" package="/dspa/backend/test/end2end" tests="5" disabled="0" skipped="0" errors="0" failures="0" time="170.890058952" timestamp="2026-07-19T23:11:54">
          <properties>
              <property name="SuiteSucceeded" value="true"></property>
              <property name="SuiteHasProgrammaticFocus" value="false"></property>
              <property name="SpecialSuiteFailureReason" value=""></property>
              <property name="SuiteLabels" value="[]"></property>
              <property name="SuiteSemVerConstraints" value="[]"></property>
              <property name="RandomSeed" value="1784502551"></property>
              <property name="RandomizeAllSpecs" value="false"></property>
              <property name="LabelFilter" value="Smoke"></property>
              <property name="SemVerFilter" value=""></property>
              <property name="FocusStrings" value=""></property>
              <property name="SkipStrings" value=""></property>
              <property name="FocusFiles" value=""></property>
              <property name="SkipFiles" value=""></property>
              <property name="FailOnPending" value="false"></property>
              <property name="FailOnEmpty" value="false"></property>
              <property name="FailFast" value="false"></property>
              <property name="FlakeAttempts" value="0"></property>
              <property name="DryRun" value="false"></property>
              <property name="ParallelTotal" value="10"></property>
              <property name="OutputInterceptorMode" value=""></property>
          </properties>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload essential/component_with_pip_index_urls.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="75.799947992">
              <system-out>2026/07/19 23:13:09 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/19/26 23:11:54.131&#xA;Create an experiment with name E2EExperiment-1784502714131351896&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/19/26 23:11:54.322 (191ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/19/26 23:11:54.323&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x69f772b5080&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/19/26 23:11:54.372 (49ms)&#xA;&gt; Enter [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/19/26 23:11:54.372&#xA;Uploading pipeline file essential/component_with_pip_index_urls.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1784502714323036018, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml&#xA;Upload of pipeline file &#39;essential/component_with_pip_index_urls.yaml&#39; successful&#xA;Listing pipeline versions for pipeline ee60d518-4bdb-4533-b630-64db6c25acea&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;ee60d518-4bdb-4533-b630-64db6c25acea&#39; and name: &#39;e2e-test-1784502714323036018&#39;&#xA;Create a pipeline run for pipeline with id=ee60d518-4bdb-4533-b630-64db6c25acea and versionId=cfeaadb9-e61c-45af-b6d4-c27949398a6e&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=60dcf03c-548a-4eff-b80b-79a615ab77c7&#xA;Created Pipeline Run with id: 60dcf03c-548a-4eff-b80b-79a615ab77c7 for pipeline with id: ee60d518-4bdb-4533-b630-64db6c25acea&#xA;Waiting for pipeline run with id=60dcf03c-548a-4eff-b80b-79a615ab77c7 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=60dcf03c-548a-4eff-b80b-79a615ab77c7&#xA;Pipeline run with id=60dcf03c-548a-4eff-b80b-79a615ab77c7 is in PENDING state, waiting...&#xA;Get a pipeline run with id=60dcf03c-548a-4eff-b80b-79a615ab77c7&#xA;Pipeline run with id=60dcf03c-548a-4eff-b80b-79a615ab77c7 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=60dcf03c-548a-4eff-b80b-79a615ab77c7&#xA;Pipeline run with id=60dcf03c-548a-4eff-b80b-79a615ab77c7 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=60dcf03c-548a-4eff-b80b-79a615ab77c7&#xA;Pipeline run with id=60dcf03c-548a-4eff-b80b-79a615ab77c7 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=60dcf03c-548a-4eff-b80b-79a615ab77c7&#xA;Pipeline run with id=60dcf03c-548a-4eff-b80b-79a615ab77c7 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=60dcf03c-548a-4eff-b80b-79a615ab77c7&#xA;Pipeline run with id=60dcf03c-548a-4eff-b80b-79a615ab77c7 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=60dcf03c-548a-4eff-b80b-79a615ab77c7&#xA;Pipeline run with id=60dcf03c-548a-4eff-b80b-79a615ab77c7 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=60dcf03c-548a-4eff-b80b-79a615ab77c7&#xA;Pipeline run with id=60dcf03c-548a-4eff-b80b-79a615ab77c7 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=60dcf03c-548a-4eff-b80b-79a615ab77c7&#xA;Pipeline run with id=60dcf03c-548a-4eff-b80b-79a615ab77c7 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=60dcf03c-548a-4eff-b80b-79a615ab77c7&#xA;Pipeline run with id=60dcf03c-548a-4eff-b80b-79a615ab77c7 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=60dcf03c-548a-4eff-b80b-79a615ab77c7&#xA;Pipeline run with id=60dcf03c-548a-4eff-b80b-79a615ab77c7 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=60dcf03c-548a-4eff-b80b-79a615ab77c7&#xA;Pipeline run with id=60dcf03c-548a-4eff-b80b-79a615ab77c7 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=60dcf03c-548a-4eff-b80b-79a615ab77c7&#xA;Pipeline run with id=60dcf03c-548a-4eff-b80b-79a615ab77c7 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=60dcf03c-548a-4eff-b80b-79a615ab77c7&#xA;Pipeline run with id=60dcf03c-548a-4eff-b80b-79a615ab77c7 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=60dcf03c-548a-4eff-b80b-79a615ab77c7&#xA;Pipeline run with id=60dcf03c-548a-4eff-b80b-79a615ab77c7 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=60dcf03c-548a-4eff-b80b-79a615ab77c7&#xA;Pipeline run with id=60dcf03c-548a-4eff-b80b-79a615ab77c7 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;essential/component_with_pip_index_urls.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=60dcf03c-548a-4eff-b80b-79a615ab77c7&#xA;Get a pipeline run with id=60dcf03c-548a-4eff-b80b-79a615ab77c7&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/19/26 23:13:09.771 (1m15.399s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/19/26 23:13:09.771&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 60dcf03c-548a-4eff-b80b-79a615ab77c7&#xA;Failed to terminate run 60dcf03c-548a-4eff-b80b-79a615ab77c7&#xA;Terminate run 60dcf03c-548a-4eff-b80b-79a615ab77c7&#xA;Deleting run 60dcf03c-548a-4eff-b80b-79a615ab77c7&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=ee60d518-4bdb-4533-b630-64db6c25acea (cascade=true)&#xA;Pipeline with id=ee60d518-4bdb-4533-b630-64db6c25acea, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/19/26 23:13:09.931 (159ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/19/26 23:13:09.931&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/19/26 23:13:09.931 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/19/26 23:13:09.931&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/19/26 23:13:09.931 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/parallel_for_after_dependency.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="120.823377322">
              <system-out>2026/07/19 23:13:54 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/19/26 23:11:54.13&#xA;Create an experiment with name E2EExperiment-1784502714130882143&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/19/26 23:11:54.322 (192ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/19/26 23:11:54.323&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x203b32a8e300&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/19/26 23:11:54.372 (49ms)&#xA;&gt; Enter [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/19/26 23:11:54.372&#xA;Uploading pipeline file critical/parallel_for_after_dependency.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1784502714323028998, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml&#xA;Upload of pipeline file &#39;critical/parallel_for_after_dependency.yaml&#39; successful&#xA;Listing pipeline versions for pipeline ee511249-3b5e-4027-bb64-7ac407714f37&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;ee511249-3b5e-4027-bb64-7ac407714f37&#39; and name: &#39;e2e-test-1784502714323028998&#39;&#xA;Create a pipeline run for pipeline with id=ee511249-3b5e-4027-bb64-7ac407714f37 and versionId=9aeb5812-8055-4a7c-a953-2f5012958732&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=fb8bda81-fb59-4320-b0e7-1289b25db8c5&#xA;Created Pipeline Run with id: fb8bda81-fb59-4320-b0e7-1289b25db8c5 for pipeline with id: ee511249-3b5e-4027-bb64-7ac407714f37&#xA;Waiting for pipeline run with id=fb8bda81-fb59-4320-b0e7-1289b25db8c5 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=fb8bda81-fb59-4320-b0e7-1289b25db8c5&#xA;Pipeline run with id=fb8bda81-fb59-4320-b0e7-1289b25db8c5 is in PENDING state, waiting...&#xA;Get a pipeline run with id=fb8bda81-fb59-4320-b0e7-1289b25db8c5&#xA;Pipeline run with id=fb8bda81-fb59-4320-b0e7-1289b25db8c5 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fb8bda81-fb59-4320-b0e7-1289b25db8c5&#xA;Pipeline run with id=fb8bda81-fb59-4320-b0e7-1289b25db8c5 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fb8bda81-fb59-4320-b0e7-1289b25db8c5&#xA;Pipeline run with id=fb8bda81-fb59-4320-b0e7-1289b25db8c5 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fb8bda81-fb59-4320-b0e7-1289b25db8c5&#xA;Pipeline run with id=fb8bda81-fb59-4320-b0e7-1289b25db8c5 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fb8bda81-fb59-4320-b0e7-1289b25db8c5&#xA;Pipeline run with id=fb8bda81-fb59-4320-b0e7-1289b25db8c5 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fb8bda81-fb59-4320-b0e7-1289b25db8c5&#xA;Pipeline run with id=fb8bda81-fb59-4320-b0e7-1289b25db8c5 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fb8bda81-fb59-4320-b0e7-1289b25db8c5&#xA;Pipeline run with id=fb8bda81-fb59-4320-b0e7-1289b25db8c5 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fb8bda81-fb59-4320-b0e7-1289b25db8c5&#xA;Pipeline run with id=fb8bda81-fb59-4320-b0e7-1289b25db8c5 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fb8bda81-fb59-4320-b0e7-1289b25db8c5&#xA;Pipeline run with id=fb8bda81-fb59-4320-b0e7-1289b25db8c5 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fb8bda81-fb59-4320-b0e7-1289b25db8c5&#xA;Pipeline run with id=fb8bda81-fb59-4320-b0e7-1289b25db8c5 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fb8bda81-fb59-4320-b0e7-1289b25db8c5&#xA;Pipeline run with id=fb8bda81-fb59-4320-b0e7-1289b25db8c5 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fb8bda81-fb59-4320-b0e7-1289b25db8c5&#xA;Pipeline run with id=fb8bda81-fb59-4320-b0e7-1289b25db8c5 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fb8bda81-fb59-4320-b0e7-1289b25db8c5&#xA;Pipeline run with id=fb8bda81-fb59-4320-b0e7-1289b25db8c5 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fb8bda81-fb59-4320-b0e7-1289b25db8c5&#xA;Pipeline run with id=fb8bda81-fb59-4320-b0e7-1289b25db8c5 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fb8bda81-fb59-4320-b0e7-1289b25db8c5&#xA;Pipeline run with id=fb8bda81-fb59-4320-b0e7-1289b25db8c5 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fb8bda81-fb59-4320-b0e7-1289b25db8c5&#xA;Pipeline run with id=fb8bda81-fb59-4320-b0e7-1289b25db8c5 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fb8bda81-fb59-4320-b0e7-1289b25db8c5&#xA;Pipeline run with id=fb8bda81-fb59-4320-b0e7-1289b25db8c5 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fb8bda81-fb59-4320-b0e7-1289b25db8c5&#xA;Pipeline run with id=fb8bda81-fb59-4320-b0e7-1289b25db8c5 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fb8bda81-fb59-4320-b0e7-1289b25db8c5&#xA;Pipeline run with id=fb8bda81-fb59-4320-b0e7-1289b25db8c5 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fb8bda81-fb59-4320-b0e7-1289b25db8c5&#xA;Pipeline run with id=fb8bda81-fb59-4320-b0e7-1289b25db8c5 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fb8bda81-fb59-4320-b0e7-1289b25db8c5&#xA;Pipeline run with id=fb8bda81-fb59-4320-b0e7-1289b25db8c5 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fb8bda81-fb59-4320-b0e7-1289b25db8c5&#xA;Pipeline run with id=fb8bda81-fb59-4320-b0e7-1289b25db8c5 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fb8bda81-fb59-4320-b0e7-1289b25db8c5&#xA;Pipeline run with id=fb8bda81-fb59-4320-b0e7-1289b25db8c5 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fb8bda81-fb59-4320-b0e7-1289b25db8c5&#xA;Pipeline run with id=fb8bda81-fb59-4320-b0e7-1289b25db8c5 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/parallel_for_after_dependency.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=fb8bda81-fb59-4320-b0e7-1289b25db8c5&#xA;Get a pipeline run with id=fb8bda81-fb59-4320-b0e7-1289b25db8c5&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/19/26 23:13:54.812 (2m0.44s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/19/26 23:13:54.812&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run fb8bda81-fb59-4320-b0e7-1289b25db8c5&#xA;Failed to terminate run fb8bda81-fb59-4320-b0e7-1289b25db8c5&#xA;Terminate run fb8bda81-fb59-4320-b0e7-1289b25db8c5&#xA;Deleting run fb8bda81-fb59-4320-b0e7-1289b25db8c5&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=ee511249-3b5e-4027-bb64-7ac407714f37 (cascade=true)&#xA;Pipeline with id=ee511249-3b5e-4027-bb64-7ac407714f37, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/19/26 23:13:54.954 (142ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/19/26 23:13:54.954&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/19/26 23:13:54.954 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/19/26 23:13:54.954&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/19/26 23:13:54.954 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/pipeline_with_artifact_upload_download.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="125.778740141">
              <system-out>2026/07/19 23:13:59 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/19/26 23:11:54.13&#xA;Create an experiment with name E2EExperiment-1784502714130996096&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/19/26 23:11:54.322 (192ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/19/26 23:11:54.323&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0xf1496d74b00&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/19/26 23:11:54.368 (45ms)&#xA;&gt; Enter [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/19/26 23:11:54.368&#xA;Uploading pipeline file critical/pipeline_with_artifact_upload_download.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1784502714323065059, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml&#xA;Upload of pipeline file &#39;critical/pipeline_with_artifact_upload_download.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 2316d632-3a16-4c2a-a3e2-943bbc8f2367&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;2316d632-3a16-4c2a-a3e2-943bbc8f2367&#39; and name: &#39;e2e-test-1784502714323065059&#39;&#xA;Create a pipeline run for pipeline with id=2316d632-3a16-4c2a-a3e2-943bbc8f2367 and versionId=1b5166e8-9026-4685-9f49-836628c63b41&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=212be8c2-66c4-4ba5-87db-2a7e1ae67cdf&#xA;Created Pipeline Run with id: 212be8c2-66c4-4ba5-87db-2a7e1ae67cdf for pipeline with id: 2316d632-3a16-4c2a-a3e2-943bbc8f2367&#xA;Waiting for pipeline run with id=212be8c2-66c4-4ba5-87db-2a7e1ae67cdf to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=212be8c2-66c4-4ba5-87db-2a7e1ae67cdf&#xA;Pipeline run with id=212be8c2-66c4-4ba5-87db-2a7e1ae67cdf is in PENDING state, waiting...&#xA;Get a pipeline run with id=212be8c2-66c4-4ba5-87db-2a7e1ae67cdf&#xA;Pipeline run with id=212be8c2-66c4-4ba5-87db-2a7e1ae67cdf is in RUNNING state, waiting...&#xA;Get a pipeline run with id=212be8c2-66c4-4ba5-87db-2a7e1ae67cdf&#xA;Pipeline run with id=212be8c2-66c4-4ba5-87db-2a7e1ae67cdf is in RUNNING state, waiting...&#xA;Get a pipeline run with id=212be8c2-66c4-4ba5-87db-2a7e1ae67cdf&#xA;Pipeline run with id=212be8c2-66c4-4ba5-87db-2a7e1ae67cdf is in RUNNING state, waiting...&#xA;Get a pipeline run with id=212be8c2-66c4-4ba5-87db-2a7e1ae67cdf&#xA;Pipeline run with id=212be8c2-66c4-4ba5-87db-2a7e1ae67cdf is in RUNNING state, waiting...&#xA;Get a pipeline run with id=212be8c2-66c4-4ba5-87db-2a7e1ae67cdf&#xA;Pipeline run with id=212be8c2-66c4-4ba5-87db-2a7e1ae67cdf is in RUNNING state, waiting...&#xA;Get a pipeline run with id=212be8c2-66c4-4ba5-87db-2a7e1ae67cdf&#xA;Pipeline run with id=212be8c2-66c4-4ba5-87db-2a7e1ae67cdf is in RUNNING state, waiting...&#xA;Get a pipeline run with id=212be8c2-66c4-4ba5-87db-2a7e1ae67cdf&#xA;Pipeline run with id=212be8c2-66c4-4ba5-87db-2a7e1ae67cdf is in RUNNING state, waiting...&#xA;Get a pipeline run with id=212be8c2-66c4-4ba5-87db-2a7e1ae67cdf&#xA;Pipeline run with id=212be8c2-66c4-4ba5-87db-2a7e1ae67cdf is in RUNNING state, waiting...&#xA;Get a pipeline run with id=212be8c2-66c4-4ba5-87db-2a7e1ae67cdf&#xA;Pipeline run with id=212be8c2-66c4-4ba5-87db-2a7e1ae67cdf is in RUNNING state, waiting...&#xA;Get a pipeline run with id=212be8c2-66c4-4ba5-87db-2a7e1ae67cdf&#xA;Pipeline run with id=212be8c2-66c4-4ba5-87db-2a7e1ae67cdf is in RUNNING state, waiting...&#xA;Get a pipeline run with id=212be8c2-66c4-4ba5-87db-2a7e1ae67cdf&#xA;Pipeline run with id=212be8c2-66c4-4ba5-87db-2a7e1ae67cdf is in RUNNING state, waiting...&#xA;Get a pipeline run with id=212be8c2-66c4-4ba5-87db-2a7e1ae67cdf&#xA;Pipeline run with id=212be8c2-66c4-4ba5-87db-2a7e1ae67cdf is in RUNNING state, waiting...&#xA;Get a pipeline run with id=212be8c2-66c4-4ba5-87db-2a7e1ae67cdf&#xA;Pipeline run with id=212be8c2-66c4-4ba5-87db-2a7e1ae67cdf is in RUNNING state, waiting...&#xA;Get a pipeline run with id=212be8c2-66c4-4ba5-87db-2a7e1ae67cdf&#xA;Pipeline run with id=212be8c2-66c4-4ba5-87db-2a7e1ae67cdf is in RUNNING state, waiting...&#xA;Get a pipeline run with id=212be8c2-66c4-4ba5-87db-2a7e1ae67cdf&#xA;Pipeline run with id=212be8c2-66c4-4ba5-87db-2a7e1ae67cdf is in RUNNING state, waiting...&#xA;Get a pipeline run with id=212be8c2-66c4-4ba5-87db-2a7e1ae67cdf&#xA;Pipeline run with id=212be8c2-66c4-4ba5-87db-2a7e1ae67cdf is in RUNNING state, waiting...&#xA;Get a pipeline run with id=212be8c2-66c4-4ba5-87db-2a7e1ae67cdf&#xA;Pipeline run with id=212be8c2-66c4-4ba5-87db-2a7e1ae67cdf is in RUNNING state, waiting...&#xA;Get a pipeline run with id=212be8c2-66c4-4ba5-87db-2a7e1ae67cdf&#xA;Pipeline run with id=212be8c2-66c4-4ba5-87db-2a7e1ae67cdf is in RUNNING state, waiting...&#xA;Get a pipeline run with id=212be8c2-66c4-4ba5-87db-2a7e1ae67cdf&#xA;Pipeline run with id=212be8c2-66c4-4ba5-87db-2a7e1ae67cdf is in RUNNING state, waiting...&#xA;Get a pipeline run with id=212be8c2-66c4-4ba5-87db-2a7e1ae67cdf&#xA;Pipeline run with id=212be8c2-66c4-4ba5-87db-2a7e1ae67cdf is in RUNNING state, waiting...&#xA;Get a pipeline run with id=212be8c2-66c4-4ba5-87db-2a7e1ae67cdf&#xA;Pipeline run with id=212be8c2-66c4-4ba5-87db-2a7e1ae67cdf is in RUNNING state, waiting...&#xA;Get a pipeline run with id=212be8c2-66c4-4ba5-87db-2a7e1ae67cdf&#xA;Pipeline run with id=212be8c2-66c4-4ba5-87db-2a7e1ae67cdf is in RUNNING state, waiting...&#xA;Get a pipeline run with id=212be8c2-66c4-4ba5-87db-2a7e1ae67cdf&#xA;Pipeline run with id=212be8c2-66c4-4ba5-87db-2a7e1ae67cdf is in RUNNING state, waiting...&#xA;Get a pipeline run with id=212be8c2-66c4-4ba5-87db-2a7e1ae67cdf&#xA;Pipeline run with id=212be8c2-66c4-4ba5-87db-2a7e1ae67cdf is in RUNNING state, waiting...&#xA;Get a pipeline run with id=212be8c2-66c4-4ba5-87db-2a7e1ae67cdf&#xA;Pipeline run with id=212be8c2-66c4-4ba5-87db-2a7e1ae67cdf reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/pipeline_with_artifact_upload_download.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=212be8c2-66c4-4ba5-87db-2a7e1ae67cdf&#xA;Get a pipeline run with id=212be8c2-66c4-4ba5-87db-2a7e1ae67cdf&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/19/26 23:13:59.798 (2m5.43s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/19/26 23:13:59.799&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 212be8c2-66c4-4ba5-87db-2a7e1ae67cdf&#xA;Failed to terminate run 212be8c2-66c4-4ba5-87db-2a7e1ae67cdf&#xA;Terminate run 212be8c2-66c4-4ba5-87db-2a7e1ae67cdf&#xA;Deleting run 212be8c2-66c4-4ba5-87db-2a7e1ae67cdf&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=2316d632-3a16-4c2a-a3e2-943bbc8f2367 (cascade=true)&#xA;Pipeline with id=2316d632-3a16-4c2a-a3e2-943bbc8f2367, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/19/26 23:13:59.909 (110ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/19/26 23:13:59.91&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/19/26 23:13:59.91 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/19/26 23:13:59.91&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/19/26 23:13:59.91 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/flip_coin.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="150.882681157">
              <system-out>2026/07/19 23:14:25 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/19/26 23:11:54.13&#xA;Create an experiment with name E2EExperiment-1784502714130904874&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/19/26 23:11:54.322 (192ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/19/26 23:11:54.322&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x259bb2b28780&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/19/26 23:11:54.371 (48ms)&#xA;&gt; Enter [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/19/26 23:11:54.371&#xA;Uploading pipeline file critical/flip_coin.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1784502714323010148, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml&#xA;Upload of pipeline file &#39;critical/flip_coin.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 5ad798fe-7d78-4528-8cff-d08a64a25ed0&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;5ad798fe-7d78-4528-8cff-d08a64a25ed0&#39; and name: &#39;e2e-test-1784502714323010148&#39;&#xA;Create a pipeline run for pipeline with id=5ad798fe-7d78-4528-8cff-d08a64a25ed0 and versionId=d90c96dd-d554-4fdb-8be5-55316dae00e2&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=22959d7c-72ea-4673-9db9-bc2088fc0a65&#xA;Created Pipeline Run with id: 22959d7c-72ea-4673-9db9-bc2088fc0a65 for pipeline with id: 5ad798fe-7d78-4528-8cff-d08a64a25ed0&#xA;Waiting for pipeline run with id=22959d7c-72ea-4673-9db9-bc2088fc0a65 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=22959d7c-72ea-4673-9db9-bc2088fc0a65&#xA;Pipeline run with id=22959d7c-72ea-4673-9db9-bc2088fc0a65 is in PENDING state, waiting...&#xA;Get a pipeline run with id=22959d7c-72ea-4673-9db9-bc2088fc0a65&#xA;Pipeline run with id=22959d7c-72ea-4673-9db9-bc2088fc0a65 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=22959d7c-72ea-4673-9db9-bc2088fc0a65&#xA;Pipeline run with id=22959d7c-72ea-4673-9db9-bc2088fc0a65 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=22959d7c-72ea-4673-9db9-bc2088fc0a65&#xA;Pipeline run with id=22959d7c-72ea-4673-9db9-bc2088fc0a65 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=22959d7c-72ea-4673-9db9-bc2088fc0a65&#xA;Pipeline run with id=22959d7c-72ea-4673-9db9-bc2088fc0a65 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=22959d7c-72ea-4673-9db9-bc2088fc0a65&#xA;Pipeline run with id=22959d7c-72ea-4673-9db9-bc2088fc0a65 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=22959d7c-72ea-4673-9db9-bc2088fc0a65&#xA;Pipeline run with id=22959d7c-72ea-4673-9db9-bc2088fc0a65 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=22959d7c-72ea-4673-9db9-bc2088fc0a65&#xA;Pipeline run with id=22959d7c-72ea-4673-9db9-bc2088fc0a65 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=22959d7c-72ea-4673-9db9-bc2088fc0a65&#xA;Pipeline run with id=22959d7c-72ea-4673-9db9-bc2088fc0a65 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=22959d7c-72ea-4673-9db9-bc2088fc0a65&#xA;Pipeline run with id=22959d7c-72ea-4673-9db9-bc2088fc0a65 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=22959d7c-72ea-4673-9db9-bc2088fc0a65&#xA;Pipeline run with id=22959d7c-72ea-4673-9db9-bc2088fc0a65 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=22959d7c-72ea-4673-9db9-bc2088fc0a65&#xA;Pipeline run with id=22959d7c-72ea-4673-9db9-bc2088fc0a65 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=22959d7c-72ea-4673-9db9-bc2088fc0a65&#xA;Pipeline run with id=22959d7c-72ea-4673-9db9-bc2088fc0a65 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=22959d7c-72ea-4673-9db9-bc2088fc0a65&#xA;Pipeline run with id=22959d7c-72ea-4673-9db9-bc2088fc0a65 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=22959d7c-72ea-4673-9db9-bc2088fc0a65&#xA;Pipeline run with id=22959d7c-72ea-4673-9db9-bc2088fc0a65 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=22959d7c-72ea-4673-9db9-bc2088fc0a65&#xA;Pipeline run with id=22959d7c-72ea-4673-9db9-bc2088fc0a65 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=22959d7c-72ea-4673-9db9-bc2088fc0a65&#xA;Pipeline run with id=22959d7c-72ea-4673-9db9-bc2088fc0a65 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=22959d7c-72ea-4673-9db9-bc2088fc0a65&#xA;Pipeline run with id=22959d7c-72ea-4673-9db9-bc2088fc0a65 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=22959d7c-72ea-4673-9db9-bc2088fc0a65&#xA;Pipeline run with id=22959d7c-72ea-4673-9db9-bc2088fc0a65 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=22959d7c-72ea-4673-9db9-bc2088fc0a65&#xA;Pipeline run with id=22959d7c-72ea-4673-9db9-bc2088fc0a65 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=22959d7c-72ea-4673-9db9-bc2088fc0a65&#xA;Pipeline run with id=22959d7c-72ea-4673-9db9-bc2088fc0a65 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=22959d7c-72ea-4673-9db9-bc2088fc0a65&#xA;Pipeline run with id=22959d7c-72ea-4673-9db9-bc2088fc0a65 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=22959d7c-72ea-4673-9db9-bc2088fc0a65&#xA;Pipeline run with id=22959d7c-72ea-4673-9db9-bc2088fc0a65 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=22959d7c-72ea-4673-9db9-bc2088fc0a65&#xA;Pipeline run with id=22959d7c-72ea-4673-9db9-bc2088fc0a65 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=22959d7c-72ea-4673-9db9-bc2088fc0a65&#xA;Pipeline run with id=22959d7c-72ea-4673-9db9-bc2088fc0a65 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=22959d7c-72ea-4673-9db9-bc2088fc0a65&#xA;Pipeline run with id=22959d7c-72ea-4673-9db9-bc2088fc0a65 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=22959d7c-72ea-4673-9db9-bc2088fc0a65&#xA;Pipeline run with id=22959d7c-72ea-4673-9db9-bc2088fc0a65 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=22959d7c-72ea-4673-9db9-bc2088fc0a65&#xA;Pipeline run with id=22959d7c-72ea-4673-9db9-bc2088fc0a65 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=22959d7c-72ea-4673-9db9-bc2088fc0a65&#xA;Pipeline run with id=22959d7c-72ea-4673-9db9-bc2088fc0a65 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=22959d7c-72ea-4673-9db9-bc2088fc0a65&#xA;Pipeline run with id=22959d7c-72ea-4673-9db9-bc2088fc0a65 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=22959d7c-72ea-4673-9db9-bc2088fc0a65&#xA;Pipeline run with id=22959d7c-72ea-4673-9db9-bc2088fc0a65 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/flip_coin.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=22959d7c-72ea-4673-9db9-bc2088fc0a65&#xA;Get a pipeline run with id=22959d7c-72ea-4673-9db9-bc2088fc0a65&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/19/26 23:14:24.878 (2m30.507s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/19/26 23:14:24.878&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 22959d7c-72ea-4673-9db9-bc2088fc0a65&#xA;Failed to terminate run 22959d7c-72ea-4673-9db9-bc2088fc0a65&#xA;Terminate run 22959d7c-72ea-4673-9db9-bc2088fc0a65&#xA;Deleting run 22959d7c-72ea-4673-9db9-bc2088fc0a65&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=5ad798fe-7d78-4528-8cff-d08a64a25ed0 (cascade=true)&#xA;Pipeline with id=5ad798fe-7d78-4528-8cff-d08a64a25ed0, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/19/26 23:14:25.013 (134ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/19/26 23:14:25.013&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/19/26 23:14:25.013 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/19/26 23:14:25.013&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/19/26 23:14:25.013 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload essential/iris_pipeline_compiled.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="170.780071849">
              <system-out>2026/07/19 23:14:44 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/19/26 23:11:54.131&#xA;Create an experiment with name E2EExperiment-1784502714131348926&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/19/26 23:11:54.322 (191ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/19/26 23:11:54.322&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x2d6e2e8c880&#xA;test-secret-1 created&#xA;test-secret-2 created&#xA;test-secret-3 created&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/19/26 23:11:54.352 (30ms)&#xA;&gt; Enter [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/19/26 23:11:54.353&#xA;Uploading pipeline file essential/iris_pipeline_compiled.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1784502714323033098, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml&#xA;Upload of pipeline file &#39;essential/iris_pipeline_compiled.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 203996d4-a877-4a00-b2fd-1e4ba7b41d00&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;203996d4-a877-4a00-b2fd-1e4ba7b41d00&#39; and name: &#39;e2e-test-1784502714323033098&#39;&#xA;Create a pipeline run for pipeline with id=203996d4-a877-4a00-b2fd-1e4ba7b41d00 and versionId=ce581a74-5b0b-466d-ab4c-1fc1ed3578ab&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=7f0f9f9a-1ef8-4918-a9bd-4e9fbb5de256&#xA;Created Pipeline Run with id: 7f0f9f9a-1ef8-4918-a9bd-4e9fbb5de256 for pipeline with id: 203996d4-a877-4a00-b2fd-1e4ba7b41d00&#xA;Waiting for pipeline run with id=7f0f9f9a-1ef8-4918-a9bd-4e9fbb5de256 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=7f0f9f9a-1ef8-4918-a9bd-4e9fbb5de256&#xA;Pipeline run with id=7f0f9f9a-1ef8-4918-a9bd-4e9fbb5de256 is in PENDING state, waiting...&#xA;Get a pipeline run with id=7f0f9f9a-1ef8-4918-a9bd-4e9fbb5de256&#xA;Pipeline run with id=7f0f9f9a-1ef8-4918-a9bd-4e9fbb5de256 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=7f0f9f9a-1ef8-4918-a9bd-4e9fbb5de256&#xA;Pipeline run with id=7f0f9f9a-1ef8-4918-a9bd-4e9fbb5de256 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=7f0f9f9a-1ef8-4918-a9bd-4e9fbb5de256&#xA;Pipeline run with id=7f0f9f9a-1ef8-4918-a9bd-4e9fbb5de256 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=7f0f9f9a-1ef8-4918-a9bd-4e9fbb5de256&#xA;Pipeline run with id=7f0f9f9a-1ef8-4918-a9bd-4e9fbb5de256 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=7f0f9f9a-1ef8-4918-a9bd-4e9fbb5de256&#xA;Pipeline run with id=7f0f9f9a-1ef8-4918-a9bd-4e9fbb5de256 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=7f0f9f9a-1ef8-4918-a9bd-4e9fbb5de256&#xA;Pipeline run with id=7f0f9f9a-1ef8-4918-a9bd-4e9fbb5de256 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=7f0f9f9a-1ef8-4918-a9bd-4e9fbb5de256&#xA;Pipeline run with id=7f0f9f9a-1ef8-4918-a9bd-4e9fbb5de256 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=7f0f9f9a-1ef8-4918-a9bd-4e9fbb5de256&#xA;Pipeline run with id=7f0f9f9a-1ef8-4918-a9bd-4e9fbb5de256 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=7f0f9f9a-1ef8-4918-a9bd-4e9fbb5de256&#xA;Pipeline run with id=7f0f9f9a-1ef8-4918-a9bd-4e9fbb5de256 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=7f0f9f9a-1ef8-4918-a9bd-4e9fbb5de256&#xA;Pipeline run with id=7f0f9f9a-1ef8-4918-a9bd-4e9fbb5de256 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=7f0f9f9a-1ef8-4918-a9bd-4e9fbb5de256&#xA;Pipeline run with id=7f0f9f9a-1ef8-4918-a9bd-4e9fbb5de256 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=7f0f9f9a-1ef8-4918-a9bd-4e9fbb5de256&#xA;Pipeline run with id=7f0f9f9a-1ef8-4918-a9bd-4e9fbb5de256 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=7f0f9f9a-1ef8-4918-a9bd-4e9fbb5de256&#xA;Pipeline run with id=7f0f9f9a-1ef8-4918-a9bd-4e9fbb5de256 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=7f0f9f9a-1ef8-4918-a9bd-4e9fbb5de256&#xA;Pipeline run with id=7f0f9f9a-1ef8-4918-a9bd-4e9fbb5de256 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=7f0f9f9a-1ef8-4918-a9bd-4e9fbb5de256&#xA;Pipeline run with id=7f0f9f9a-1ef8-4918-a9bd-4e9fbb5de256 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=7f0f9f9a-1ef8-4918-a9bd-4e9fbb5de256&#xA;Pipeline run with id=7f0f9f9a-1ef8-4918-a9bd-4e9fbb5de256 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=7f0f9f9a-1ef8-4918-a9bd-4e9fbb5de256&#xA;Pipeline run with id=7f0f9f9a-1ef8-4918-a9bd-4e9fbb5de256 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=7f0f9f9a-1ef8-4918-a9bd-4e9fbb5de256&#xA;Pipeline run with id=7f0f9f9a-1ef8-4918-a9bd-4e9fbb5de256 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=7f0f9f9a-1ef8-4918-a9bd-4e9fbb5de256&#xA;Pipeline run with id=7f0f9f9a-1ef8-4918-a9bd-4e9fbb5de256 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=7f0f9f9a-1ef8-4918-a9bd-4e9fbb5de256&#xA;Pipeline run with id=7f0f9f9a-1ef8-4918-a9bd-4e9fbb5de256 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=7f0f9f9a-1ef8-4918-a9bd-4e9fbb5de256&#xA;Pipeline run with id=7f0f9f9a-1ef8-4918-a9bd-4e9fbb5de256 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=7f0f9f9a-1ef8-4918-a9bd-4e9fbb5de256&#xA;Pipeline run with id=7f0f9f9a-1ef8-4918-a9bd-4e9fbb5de256 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=7f0f9f9a-1ef8-4918-a9bd-4e9fbb5de256&#xA;Pipeline run with id=7f0f9f9a-1ef8-4918-a9bd-4e9fbb5de256 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=7f0f9f9a-1ef8-4918-a9bd-4e9fbb5de256&#xA;Pipeline run with id=7f0f9f9a-1ef8-4918-a9bd-4e9fbb5de256 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=7f0f9f9a-1ef8-4918-a9bd-4e9fbb5de256&#xA;Pipeline run with id=7f0f9f9a-1ef8-4918-a9bd-4e9fbb5de256 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=7f0f9f9a-1ef8-4918-a9bd-4e9fbb5de256&#xA;Pipeline run with id=7f0f9f9a-1ef8-4918-a9bd-4e9fbb5de256 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=7f0f9f9a-1ef8-4918-a9bd-4e9fbb5de256&#xA;Pipeline run with id=7f0f9f9a-1ef8-4918-a9bd-4e9fbb5de256 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=7f0f9f9a-1ef8-4918-a9bd-4e9fbb5de256&#xA;Pipeline run with id=7f0f9f9a-1ef8-4918-a9bd-4e9fbb5de256 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=7f0f9f9a-1ef8-4918-a9bd-4e9fbb5de256&#xA;Pipeline run with id=7f0f9f9a-1ef8-4918-a9bd-4e9fbb5de256 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=7f0f9f9a-1ef8-4918-a9bd-4e9fbb5de256&#xA;Pipeline run with id=7f0f9f9a-1ef8-4918-a9bd-4e9fbb5de256 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=7f0f9f9a-1ef8-4918-a9bd-4e9fbb5de256&#xA;Pipeline run with id=7f0f9f9a-1ef8-4918-a9bd-4e9fbb5de256 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=7f0f9f9a-1ef8-4918-a9bd-4e9fbb5de256&#xA;Pipeline run with id=7f0f9f9a-1ef8-4918-a9bd-4e9fbb5de256 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=7f0f9f9a-1ef8-4918-a9bd-4e9fbb5de256&#xA;Pipeline run with id=7f0f9f9a-1ef8-4918-a9bd-4e9fbb5de256 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=7f0f9f9a-1ef8-4918-a9bd-4e9fbb5de256&#xA;Pipeline run with id=7f0f9f9a-1ef8-4918-a9bd-4e9fbb5de256 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;essential/iris_pipeline_compiled.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=7f0f9f9a-1ef8-4918-a9bd-4e9fbb5de256&#xA;Get a pipeline run with id=7f0f9f9a-1ef8-4918-a9bd-4e9fbb5de256&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/19/26 23:14:44.794 (2m50.441s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/19/26 23:14:44.794&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 7f0f9f9a-1ef8-4918-a9bd-4e9fbb5de256&#xA;Failed to terminate run 7f0f9f9a-1ef8-4918-a9bd-4e9fbb5de256&#xA;Terminate run 7f0f9f9a-1ef8-4918-a9bd-4e9fbb5de256&#xA;Deleting run 7f0f9f9a-1ef8-4918-a9bd-4e9fbb5de256&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=203996d4-a877-4a00-b2fd-1e4ba7b41d00 (cascade=true)&#xA;Pipeline with id=203996d4-a877-4a00-b2fd-1e4ba7b41d00, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/19/26 23:14:44.911 (117ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/19/26 23:14:44.911&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/19/26 23:14:44.911 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/19/26 23:14:44.911&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/19/26 23:14:44.911 (0s)&#xA;</system-err>
          </testcase>
      </testsuite>
  </testsuites>