<?xml version="1.0" encoding="UTF-8"?>
  <testsuites tests="5" disabled="0" errors="0" failures="0" time="202.814762811">
      <testsuite name="AIPipelinesE2ETests" package="/dspa/backend/test/end2end" tests="5" disabled="0" skipped="0" errors="0" failures="0" time="202.814762811" timestamp="2026-11-01T13:29:43">
          <properties>
              <property name="SuiteSucceeded" value="true"></property>
              <property name="SuiteHasProgrammaticFocus" value="false"></property>
              <property name="SpecialSuiteFailureReason" value=""></property>
              <property name="SuiteLabels" value="[]"></property>
              <property name="SuiteSemVerConstraints" value="[]"></property>
              <property name="RandomSeed" value="1793539617"></property>
              <property name="RandomizeAllSpecs" value="false"></property>
              <property name="LabelFilter" value="Smoke"></property>
              <property name="SemVerFilter" value=""></property>
              <property name="FocusStrings" value=""></property>
              <property name="SkipStrings" value=""></property>
              <property name="FocusFiles" value=""></property>
              <property name="SkipFiles" value=""></property>
              <property name="FailOnPending" value="false"></property>
              <property name="FailOnEmpty" value="false"></property>
              <property name="FailFast" value="false"></property>
              <property name="FlakeAttempts" value="0"></property>
              <property name="DryRun" value="false"></property>
              <property name="ParallelTotal" value="10"></property>
              <property name="OutputInterceptorMode" value=""></property>
          </properties>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload essential/component_with_pip_index_urls.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="101.954426011">
              <system-out>2026/11/01 13:31:25 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 11/01/26 13:29:43.941&#xA;Create an experiment with name E2EExperiment-1793539783941448811&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 11/01/26 13:29:44.417 (476ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 11/01/26 13:29:44.417&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x1b37ecdd6b00&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 11/01/26 13:29:48.935 (4.518s)&#xA;&gt; Enter [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 11/01/26 13:29:48.935&#xA;Uploading pipeline file essential/component_with_pip_index_urls.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1793539784417642704, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml&#xA;Upload of pipeline file &#39;essential/component_with_pip_index_urls.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 014d5868-aabc-41f8-8fb3-097f837a050d&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;014d5868-aabc-41f8-8fb3-097f837a050d&#39; and name: &#39;e2e-test-1793539784417642704&#39;&#xA;Create a pipeline run for pipeline with id=014d5868-aabc-41f8-8fb3-097f837a050d and versionId=2ced2609-3cde-4010-9bdb-f2d9125b499b&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=006c810d-73aa-4929-88ce-89d7f81d377f&#xA;Created Pipeline Run with id: 006c810d-73aa-4929-88ce-89d7f81d377f for pipeline with id: 014d5868-aabc-41f8-8fb3-097f837a050d&#xA;Waiting for pipeline run with id=006c810d-73aa-4929-88ce-89d7f81d377f to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=006c810d-73aa-4929-88ce-89d7f81d377f&#xA;Pipeline run with id=006c810d-73aa-4929-88ce-89d7f81d377f is in PENDING state, waiting...&#xA;Get a pipeline run with id=006c810d-73aa-4929-88ce-89d7f81d377f&#xA;Pipeline run with id=006c810d-73aa-4929-88ce-89d7f81d377f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=006c810d-73aa-4929-88ce-89d7f81d377f&#xA;Pipeline run with id=006c810d-73aa-4929-88ce-89d7f81d377f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=006c810d-73aa-4929-88ce-89d7f81d377f&#xA;Pipeline run with id=006c810d-73aa-4929-88ce-89d7f81d377f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=006c810d-73aa-4929-88ce-89d7f81d377f&#xA;Pipeline run with id=006c810d-73aa-4929-88ce-89d7f81d377f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=006c810d-73aa-4929-88ce-89d7f81d377f&#xA;Pipeline run with id=006c810d-73aa-4929-88ce-89d7f81d377f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=006c810d-73aa-4929-88ce-89d7f81d377f&#xA;Pipeline run with id=006c810d-73aa-4929-88ce-89d7f81d377f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=006c810d-73aa-4929-88ce-89d7f81d377f&#xA;Pipeline run with id=006c810d-73aa-4929-88ce-89d7f81d377f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=006c810d-73aa-4929-88ce-89d7f81d377f&#xA;Pipeline run with id=006c810d-73aa-4929-88ce-89d7f81d377f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=006c810d-73aa-4929-88ce-89d7f81d377f&#xA;Pipeline run with id=006c810d-73aa-4929-88ce-89d7f81d377f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=006c810d-73aa-4929-88ce-89d7f81d377f&#xA;Pipeline run with id=006c810d-73aa-4929-88ce-89d7f81d377f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=006c810d-73aa-4929-88ce-89d7f81d377f&#xA;Pipeline run with id=006c810d-73aa-4929-88ce-89d7f81d377f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=006c810d-73aa-4929-88ce-89d7f81d377f&#xA;Pipeline run with id=006c810d-73aa-4929-88ce-89d7f81d377f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=006c810d-73aa-4929-88ce-89d7f81d377f&#xA;Pipeline run with id=006c810d-73aa-4929-88ce-89d7f81d377f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=006c810d-73aa-4929-88ce-89d7f81d377f&#xA;Pipeline run with id=006c810d-73aa-4929-88ce-89d7f81d377f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=006c810d-73aa-4929-88ce-89d7f81d377f&#xA;Pipeline run with id=006c810d-73aa-4929-88ce-89d7f81d377f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=006c810d-73aa-4929-88ce-89d7f81d377f&#xA;Pipeline run with id=006c810d-73aa-4929-88ce-89d7f81d377f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=006c810d-73aa-4929-88ce-89d7f81d377f&#xA;Pipeline run with id=006c810d-73aa-4929-88ce-89d7f81d377f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=006c810d-73aa-4929-88ce-89d7f81d377f&#xA;Pipeline run with id=006c810d-73aa-4929-88ce-89d7f81d377f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=006c810d-73aa-4929-88ce-89d7f81d377f&#xA;Pipeline run with id=006c810d-73aa-4929-88ce-89d7f81d377f reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;essential/component_with_pip_index_urls.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=006c810d-73aa-4929-88ce-89d7f81d377f&#xA;Get a pipeline run with id=006c810d-73aa-4929-88ce-89d7f81d377f&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 11/01/26 13:31:25.07 (1m36.135s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 11/01/26 13:31:25.071&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 006c810d-73aa-4929-88ce-89d7f81d377f&#xA;Failed to terminate run 006c810d-73aa-4929-88ce-89d7f81d377f&#xA;Terminate run 006c810d-73aa-4929-88ce-89d7f81d377f&#xA;Deleting run 006c810d-73aa-4929-88ce-89d7f81d377f&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=014d5868-aabc-41f8-8fb3-097f837a050d (cascade=true)&#xA;Pipeline with id=014d5868-aabc-41f8-8fb3-097f837a050d, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 11/01/26 13:31:25.895 (825ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 11/01/26 13:31:25.896&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 11/01/26 13:31:25.896 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 11/01/26 13:31:25.896&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 11/01/26 13:31:25.896 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/parallel_for_after_dependency.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="127.35168605">
              <system-out>2026/11/01 13:31:51 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 11/01/26 13:29:43.941&#xA;Create an experiment with name E2EExperiment-1793539783941136655&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 11/01/26 13:29:44.415 (475ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 11/01/26 13:29:44.416&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x2961ed086e00&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 11/01/26 13:29:48.951 (4.535s)&#xA;&gt; Enter [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 11/01/26 13:29:48.951&#xA;Uploading pipeline file critical/parallel_for_after_dependency.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1793539784416149708, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml&#xA;Upload of pipeline file &#39;critical/parallel_for_after_dependency.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 7df88183-f50a-406b-a82d-0e208dcfa1f3&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;7df88183-f50a-406b-a82d-0e208dcfa1f3&#39; and name: &#39;e2e-test-1793539784416149708&#39;&#xA;Create a pipeline run for pipeline with id=7df88183-f50a-406b-a82d-0e208dcfa1f3 and versionId=297d1513-75c4-4545-a854-72d563c0dc85&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=5c58dbee-0961-45cb-b440-7c1107de5945&#xA;Created Pipeline Run with id: 5c58dbee-0961-45cb-b440-7c1107de5945 for pipeline with id: 7df88183-f50a-406b-a82d-0e208dcfa1f3&#xA;Waiting for pipeline run with id=5c58dbee-0961-45cb-b440-7c1107de5945 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=5c58dbee-0961-45cb-b440-7c1107de5945&#xA;Pipeline run with id=5c58dbee-0961-45cb-b440-7c1107de5945 is in PENDING state, waiting...&#xA;Get a pipeline run with id=5c58dbee-0961-45cb-b440-7c1107de5945&#xA;Pipeline run with id=5c58dbee-0961-45cb-b440-7c1107de5945 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=5c58dbee-0961-45cb-b440-7c1107de5945&#xA;Pipeline run with id=5c58dbee-0961-45cb-b440-7c1107de5945 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=5c58dbee-0961-45cb-b440-7c1107de5945&#xA;Pipeline run with id=5c58dbee-0961-45cb-b440-7c1107de5945 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=5c58dbee-0961-45cb-b440-7c1107de5945&#xA;Pipeline run with id=5c58dbee-0961-45cb-b440-7c1107de5945 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=5c58dbee-0961-45cb-b440-7c1107de5945&#xA;Pipeline run with id=5c58dbee-0961-45cb-b440-7c1107de5945 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=5c58dbee-0961-45cb-b440-7c1107de5945&#xA;Pipeline run with id=5c58dbee-0961-45cb-b440-7c1107de5945 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=5c58dbee-0961-45cb-b440-7c1107de5945&#xA;Pipeline run with id=5c58dbee-0961-45cb-b440-7c1107de5945 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=5c58dbee-0961-45cb-b440-7c1107de5945&#xA;Pipeline run with id=5c58dbee-0961-45cb-b440-7c1107de5945 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=5c58dbee-0961-45cb-b440-7c1107de5945&#xA;Pipeline run with id=5c58dbee-0961-45cb-b440-7c1107de5945 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=5c58dbee-0961-45cb-b440-7c1107de5945&#xA;Pipeline run with id=5c58dbee-0961-45cb-b440-7c1107de5945 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=5c58dbee-0961-45cb-b440-7c1107de5945&#xA;Pipeline run with id=5c58dbee-0961-45cb-b440-7c1107de5945 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=5c58dbee-0961-45cb-b440-7c1107de5945&#xA;Pipeline run with id=5c58dbee-0961-45cb-b440-7c1107de5945 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=5c58dbee-0961-45cb-b440-7c1107de5945&#xA;Pipeline run with id=5c58dbee-0961-45cb-b440-7c1107de5945 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=5c58dbee-0961-45cb-b440-7c1107de5945&#xA;Pipeline run with id=5c58dbee-0961-45cb-b440-7c1107de5945 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=5c58dbee-0961-45cb-b440-7c1107de5945&#xA;Pipeline run with id=5c58dbee-0961-45cb-b440-7c1107de5945 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=5c58dbee-0961-45cb-b440-7c1107de5945&#xA;Pipeline run with id=5c58dbee-0961-45cb-b440-7c1107de5945 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=5c58dbee-0961-45cb-b440-7c1107de5945&#xA;Pipeline run with id=5c58dbee-0961-45cb-b440-7c1107de5945 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=5c58dbee-0961-45cb-b440-7c1107de5945&#xA;Pipeline run with id=5c58dbee-0961-45cb-b440-7c1107de5945 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=5c58dbee-0961-45cb-b440-7c1107de5945&#xA;Pipeline run with id=5c58dbee-0961-45cb-b440-7c1107de5945 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=5c58dbee-0961-45cb-b440-7c1107de5945&#xA;Pipeline run with id=5c58dbee-0961-45cb-b440-7c1107de5945 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=5c58dbee-0961-45cb-b440-7c1107de5945&#xA;Pipeline run with id=5c58dbee-0961-45cb-b440-7c1107de5945 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=5c58dbee-0961-45cb-b440-7c1107de5945&#xA;Pipeline run with id=5c58dbee-0961-45cb-b440-7c1107de5945 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=5c58dbee-0961-45cb-b440-7c1107de5945&#xA;Pipeline run with id=5c58dbee-0961-45cb-b440-7c1107de5945 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=5c58dbee-0961-45cb-b440-7c1107de5945&#xA;Pipeline run with id=5c58dbee-0961-45cb-b440-7c1107de5945 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/parallel_for_after_dependency.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=5c58dbee-0961-45cb-b440-7c1107de5945&#xA;Get a pipeline run with id=5c58dbee-0961-45cb-b440-7c1107de5945&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 11/01/26 13:31:50.285 (2m1.334s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 11/01/26 13:31:50.285&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 5c58dbee-0961-45cb-b440-7c1107de5945&#xA;Failed to terminate run 5c58dbee-0961-45cb-b440-7c1107de5945&#xA;Terminate run 5c58dbee-0961-45cb-b440-7c1107de5945&#xA;Deleting run 5c58dbee-0961-45cb-b440-7c1107de5945&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=7df88183-f50a-406b-a82d-0e208dcfa1f3 (cascade=true)&#xA;Pipeline with id=7df88183-f50a-406b-a82d-0e208dcfa1f3, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 11/01/26 13:31:51.292 (1.007s)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 11/01/26 13:31:51.292&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 11/01/26 13:31:51.292 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 11/01/26 13:31:51.293&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 11/01/26 13:31:51.293 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/pipeline_with_artifact_upload_download.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="147.066072647">
              <system-out>2026/11/01 13:32:11 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 11/01/26 13:29:43.941&#xA;Create an experiment with name E2EExperiment-1793539783941309598&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 11/01/26 13:29:44.417 (476ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 11/01/26 13:29:44.417&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x15c5e2c2ca00&#xA;test-secret-1 created&#xA;test-secret-2 created&#xA;test-secret-3 created&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 11/01/26 13:29:48.892 (4.475s)&#xA;&gt; Enter [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 11/01/26 13:29:48.892&#xA;Uploading pipeline file critical/pipeline_with_artifact_upload_download.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1793539784417778907, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml&#xA;Upload of pipeline file &#39;critical/pipeline_with_artifact_upload_download.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 89a20f5f-ed24-498f-94fb-dc2598fd8ebe&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;89a20f5f-ed24-498f-94fb-dc2598fd8ebe&#39; and name: &#39;e2e-test-1793539784417778907&#39;&#xA;Create a pipeline run for pipeline with id=89a20f5f-ed24-498f-94fb-dc2598fd8ebe and versionId=f6fb1936-eb1e-4de0-b800-a54049357383&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=09ee0a85-cd78-48db-9355-8fc355b2b1a1&#xA;Created Pipeline Run with id: 09ee0a85-cd78-48db-9355-8fc355b2b1a1 for pipeline with id: 89a20f5f-ed24-498f-94fb-dc2598fd8ebe&#xA;Waiting for pipeline run with id=09ee0a85-cd78-48db-9355-8fc355b2b1a1 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=09ee0a85-cd78-48db-9355-8fc355b2b1a1&#xA;Pipeline run with id=09ee0a85-cd78-48db-9355-8fc355b2b1a1 is in PENDING state, waiting...&#xA;Get a pipeline run with id=09ee0a85-cd78-48db-9355-8fc355b2b1a1&#xA;Pipeline run with id=09ee0a85-cd78-48db-9355-8fc355b2b1a1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=09ee0a85-cd78-48db-9355-8fc355b2b1a1&#xA;Pipeline run with id=09ee0a85-cd78-48db-9355-8fc355b2b1a1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=09ee0a85-cd78-48db-9355-8fc355b2b1a1&#xA;Pipeline run with id=09ee0a85-cd78-48db-9355-8fc355b2b1a1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=09ee0a85-cd78-48db-9355-8fc355b2b1a1&#xA;Pipeline run with id=09ee0a85-cd78-48db-9355-8fc355b2b1a1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=09ee0a85-cd78-48db-9355-8fc355b2b1a1&#xA;Pipeline run with id=09ee0a85-cd78-48db-9355-8fc355b2b1a1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=09ee0a85-cd78-48db-9355-8fc355b2b1a1&#xA;Pipeline run with id=09ee0a85-cd78-48db-9355-8fc355b2b1a1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=09ee0a85-cd78-48db-9355-8fc355b2b1a1&#xA;Pipeline run with id=09ee0a85-cd78-48db-9355-8fc355b2b1a1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=09ee0a85-cd78-48db-9355-8fc355b2b1a1&#xA;Pipeline run with id=09ee0a85-cd78-48db-9355-8fc355b2b1a1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=09ee0a85-cd78-48db-9355-8fc355b2b1a1&#xA;Pipeline run with id=09ee0a85-cd78-48db-9355-8fc355b2b1a1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=09ee0a85-cd78-48db-9355-8fc355b2b1a1&#xA;Pipeline run with id=09ee0a85-cd78-48db-9355-8fc355b2b1a1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=09ee0a85-cd78-48db-9355-8fc355b2b1a1&#xA;Pipeline run with id=09ee0a85-cd78-48db-9355-8fc355b2b1a1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=09ee0a85-cd78-48db-9355-8fc355b2b1a1&#xA;Pipeline run with id=09ee0a85-cd78-48db-9355-8fc355b2b1a1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=09ee0a85-cd78-48db-9355-8fc355b2b1a1&#xA;Pipeline run with id=09ee0a85-cd78-48db-9355-8fc355b2b1a1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=09ee0a85-cd78-48db-9355-8fc355b2b1a1&#xA;Pipeline run with id=09ee0a85-cd78-48db-9355-8fc355b2b1a1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=09ee0a85-cd78-48db-9355-8fc355b2b1a1&#xA;Pipeline run with id=09ee0a85-cd78-48db-9355-8fc355b2b1a1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=09ee0a85-cd78-48db-9355-8fc355b2b1a1&#xA;Pipeline run with id=09ee0a85-cd78-48db-9355-8fc355b2b1a1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=09ee0a85-cd78-48db-9355-8fc355b2b1a1&#xA;Pipeline run with id=09ee0a85-cd78-48db-9355-8fc355b2b1a1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=09ee0a85-cd78-48db-9355-8fc355b2b1a1&#xA;Pipeline run with id=09ee0a85-cd78-48db-9355-8fc355b2b1a1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=09ee0a85-cd78-48db-9355-8fc355b2b1a1&#xA;Pipeline run with id=09ee0a85-cd78-48db-9355-8fc355b2b1a1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=09ee0a85-cd78-48db-9355-8fc355b2b1a1&#xA;Pipeline run with id=09ee0a85-cd78-48db-9355-8fc355b2b1a1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=09ee0a85-cd78-48db-9355-8fc355b2b1a1&#xA;Pipeline run with id=09ee0a85-cd78-48db-9355-8fc355b2b1a1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=09ee0a85-cd78-48db-9355-8fc355b2b1a1&#xA;Pipeline run with id=09ee0a85-cd78-48db-9355-8fc355b2b1a1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=09ee0a85-cd78-48db-9355-8fc355b2b1a1&#xA;Pipeline run with id=09ee0a85-cd78-48db-9355-8fc355b2b1a1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=09ee0a85-cd78-48db-9355-8fc355b2b1a1&#xA;Pipeline run with id=09ee0a85-cd78-48db-9355-8fc355b2b1a1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=09ee0a85-cd78-48db-9355-8fc355b2b1a1&#xA;Pipeline run with id=09ee0a85-cd78-48db-9355-8fc355b2b1a1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=09ee0a85-cd78-48db-9355-8fc355b2b1a1&#xA;Pipeline run with id=09ee0a85-cd78-48db-9355-8fc355b2b1a1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=09ee0a85-cd78-48db-9355-8fc355b2b1a1&#xA;Pipeline run with id=09ee0a85-cd78-48db-9355-8fc355b2b1a1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=09ee0a85-cd78-48db-9355-8fc355b2b1a1&#xA;Pipeline run with id=09ee0a85-cd78-48db-9355-8fc355b2b1a1 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/pipeline_with_artifact_upload_download.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=09ee0a85-cd78-48db-9355-8fc355b2b1a1&#xA;Get a pipeline run with id=09ee0a85-cd78-48db-9355-8fc355b2b1a1&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 11/01/26 13:32:10.204 (2m21.312s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 11/01/26 13:32:10.205&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 09ee0a85-cd78-48db-9355-8fc355b2b1a1&#xA;Failed to terminate run 09ee0a85-cd78-48db-9355-8fc355b2b1a1&#xA;Terminate run 09ee0a85-cd78-48db-9355-8fc355b2b1a1&#xA;Deleting run 09ee0a85-cd78-48db-9355-8fc355b2b1a1&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=89a20f5f-ed24-498f-94fb-dc2598fd8ebe (cascade=true)&#xA;Pipeline with id=89a20f5f-ed24-498f-94fb-dc2598fd8ebe, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 11/01/26 13:32:11.007 (802ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 11/01/26 13:32:11.007&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 11/01/26 13:32:11.007 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 11/01/26 13:32:11.007&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 11/01/26 13:32:11.007 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/flip_coin.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="172.40004473">
              <system-out>2026/11/01 13:32:36 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 11/01/26 13:29:43.941&#xA;Create an experiment with name E2EExperiment-1793539783941192076&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 11/01/26 13:29:44.417 (476ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 11/01/26 13:29:44.417&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x165df5b9e300&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 11/01/26 13:29:48.987 (4.57s)&#xA;&gt; Enter [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 11/01/26 13:29:48.987&#xA;Uploading pipeline file critical/flip_coin.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1793539784417764146, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml&#xA;Upload of pipeline file &#39;critical/flip_coin.yaml&#39; successful&#xA;Listing pipeline versions for pipeline fc9dcb3c-22d3-466e-83cb-bd8080baef6f&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;fc9dcb3c-22d3-466e-83cb-bd8080baef6f&#39; and name: &#39;e2e-test-1793539784417764146&#39;&#xA;Create a pipeline run for pipeline with id=fc9dcb3c-22d3-466e-83cb-bd8080baef6f and versionId=95eb7495-9574-475e-bfe0-5e63bd07d6bd&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=63883d1f-12f2-4e5c-996d-b5152df9f589&#xA;Created Pipeline Run with id: 63883d1f-12f2-4e5c-996d-b5152df9f589 for pipeline with id: fc9dcb3c-22d3-466e-83cb-bd8080baef6f&#xA;Waiting for pipeline run with id=63883d1f-12f2-4e5c-996d-b5152df9f589 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=63883d1f-12f2-4e5c-996d-b5152df9f589&#xA;Pipeline run with id=63883d1f-12f2-4e5c-996d-b5152df9f589 is in PENDING state, waiting...&#xA;Get a pipeline run with id=63883d1f-12f2-4e5c-996d-b5152df9f589&#xA;Pipeline run with id=63883d1f-12f2-4e5c-996d-b5152df9f589 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=63883d1f-12f2-4e5c-996d-b5152df9f589&#xA;Pipeline run with id=63883d1f-12f2-4e5c-996d-b5152df9f589 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=63883d1f-12f2-4e5c-996d-b5152df9f589&#xA;Pipeline run with id=63883d1f-12f2-4e5c-996d-b5152df9f589 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=63883d1f-12f2-4e5c-996d-b5152df9f589&#xA;Pipeline run with id=63883d1f-12f2-4e5c-996d-b5152df9f589 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=63883d1f-12f2-4e5c-996d-b5152df9f589&#xA;Pipeline run with id=63883d1f-12f2-4e5c-996d-b5152df9f589 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=63883d1f-12f2-4e5c-996d-b5152df9f589&#xA;Pipeline run with id=63883d1f-12f2-4e5c-996d-b5152df9f589 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=63883d1f-12f2-4e5c-996d-b5152df9f589&#xA;Pipeline run with id=63883d1f-12f2-4e5c-996d-b5152df9f589 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=63883d1f-12f2-4e5c-996d-b5152df9f589&#xA;Pipeline run with id=63883d1f-12f2-4e5c-996d-b5152df9f589 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=63883d1f-12f2-4e5c-996d-b5152df9f589&#xA;Pipeline run with id=63883d1f-12f2-4e5c-996d-b5152df9f589 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=63883d1f-12f2-4e5c-996d-b5152df9f589&#xA;Pipeline run with id=63883d1f-12f2-4e5c-996d-b5152df9f589 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=63883d1f-12f2-4e5c-996d-b5152df9f589&#xA;Pipeline run with id=63883d1f-12f2-4e5c-996d-b5152df9f589 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=63883d1f-12f2-4e5c-996d-b5152df9f589&#xA;Pipeline run with id=63883d1f-12f2-4e5c-996d-b5152df9f589 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=63883d1f-12f2-4e5c-996d-b5152df9f589&#xA;Pipeline run with id=63883d1f-12f2-4e5c-996d-b5152df9f589 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=63883d1f-12f2-4e5c-996d-b5152df9f589&#xA;Pipeline run with id=63883d1f-12f2-4e5c-996d-b5152df9f589 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=63883d1f-12f2-4e5c-996d-b5152df9f589&#xA;Pipeline run with id=63883d1f-12f2-4e5c-996d-b5152df9f589 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=63883d1f-12f2-4e5c-996d-b5152df9f589&#xA;Pipeline run with id=63883d1f-12f2-4e5c-996d-b5152df9f589 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=63883d1f-12f2-4e5c-996d-b5152df9f589&#xA;Pipeline run with id=63883d1f-12f2-4e5c-996d-b5152df9f589 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=63883d1f-12f2-4e5c-996d-b5152df9f589&#xA;Pipeline run with id=63883d1f-12f2-4e5c-996d-b5152df9f589 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=63883d1f-12f2-4e5c-996d-b5152df9f589&#xA;Pipeline run with id=63883d1f-12f2-4e5c-996d-b5152df9f589 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=63883d1f-12f2-4e5c-996d-b5152df9f589&#xA;Pipeline run with id=63883d1f-12f2-4e5c-996d-b5152df9f589 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=63883d1f-12f2-4e5c-996d-b5152df9f589&#xA;Pipeline run with id=63883d1f-12f2-4e5c-996d-b5152df9f589 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=63883d1f-12f2-4e5c-996d-b5152df9f589&#xA;Pipeline run with id=63883d1f-12f2-4e5c-996d-b5152df9f589 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=63883d1f-12f2-4e5c-996d-b5152df9f589&#xA;Pipeline run with id=63883d1f-12f2-4e5c-996d-b5152df9f589 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=63883d1f-12f2-4e5c-996d-b5152df9f589&#xA;Pipeline run with id=63883d1f-12f2-4e5c-996d-b5152df9f589 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=63883d1f-12f2-4e5c-996d-b5152df9f589&#xA;Pipeline run with id=63883d1f-12f2-4e5c-996d-b5152df9f589 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=63883d1f-12f2-4e5c-996d-b5152df9f589&#xA;Pipeline run with id=63883d1f-12f2-4e5c-996d-b5152df9f589 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=63883d1f-12f2-4e5c-996d-b5152df9f589&#xA;Pipeline run with id=63883d1f-12f2-4e5c-996d-b5152df9f589 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=63883d1f-12f2-4e5c-996d-b5152df9f589&#xA;Pipeline run with id=63883d1f-12f2-4e5c-996d-b5152df9f589 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=63883d1f-12f2-4e5c-996d-b5152df9f589&#xA;Pipeline run with id=63883d1f-12f2-4e5c-996d-b5152df9f589 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=63883d1f-12f2-4e5c-996d-b5152df9f589&#xA;Pipeline run with id=63883d1f-12f2-4e5c-996d-b5152df9f589 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=63883d1f-12f2-4e5c-996d-b5152df9f589&#xA;Pipeline run with id=63883d1f-12f2-4e5c-996d-b5152df9f589 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=63883d1f-12f2-4e5c-996d-b5152df9f589&#xA;Pipeline run with id=63883d1f-12f2-4e5c-996d-b5152df9f589 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=63883d1f-12f2-4e5c-996d-b5152df9f589&#xA;Pipeline run with id=63883d1f-12f2-4e5c-996d-b5152df9f589 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/flip_coin.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=63883d1f-12f2-4e5c-996d-b5152df9f589&#xA;Get a pipeline run with id=63883d1f-12f2-4e5c-996d-b5152df9f589&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 11/01/26 13:32:35.223 (2m46.236s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 11/01/26 13:32:35.223&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 63883d1f-12f2-4e5c-996d-b5152df9f589&#xA;Failed to terminate run 63883d1f-12f2-4e5c-996d-b5152df9f589&#xA;Terminate run 63883d1f-12f2-4e5c-996d-b5152df9f589&#xA;Deleting run 63883d1f-12f2-4e5c-996d-b5152df9f589&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=fc9dcb3c-22d3-466e-83cb-bd8080baef6f (cascade=true)&#xA;Pipeline with id=fc9dcb3c-22d3-466e-83cb-bd8080baef6f, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 11/01/26 13:32:36.341 (1.117s)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 11/01/26 13:32:36.341&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 11/01/26 13:32:36.341 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 11/01/26 13:32:36.341&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 11/01/26 13:32:36.341 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload essential/iris_pipeline_compiled.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="202.612798315">
              <system-out>2026/11/01 13:33:06 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 11/01/26 13:29:43.941&#xA;Create an experiment with name E2EExperiment-1793539783941672105&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 11/01/26 13:29:44.415 (474ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 11/01/26 13:29:44.415&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x1fbc9e148980&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 11/01/26 13:29:48.941 (4.526s)&#xA;&gt; Enter [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 11/01/26 13:29:48.941&#xA;Uploading pipeline file essential/iris_pipeline_compiled.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1793539784415849063, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml&#xA;Upload of pipeline file &#39;essential/iris_pipeline_compiled.yaml&#39; successful&#xA;Listing pipeline versions for pipeline a972bc5f-9734-4b02-9b2e-96c034c8452d&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;a972bc5f-9734-4b02-9b2e-96c034c8452d&#39; and name: &#39;e2e-test-1793539784415849063&#39;&#xA;Create a pipeline run for pipeline with id=a972bc5f-9734-4b02-9b2e-96c034c8452d and versionId=1101e2d8-eb44-4109-b7a7-38a593fb197f&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=2c3cb91e-0335-48a8-b060-de2f7da25b0d&#xA;Created Pipeline Run with id: 2c3cb91e-0335-48a8-b060-de2f7da25b0d for pipeline with id: a972bc5f-9734-4b02-9b2e-96c034c8452d&#xA;Waiting for pipeline run with id=2c3cb91e-0335-48a8-b060-de2f7da25b0d to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=2c3cb91e-0335-48a8-b060-de2f7da25b0d&#xA;Pipeline run with id=2c3cb91e-0335-48a8-b060-de2f7da25b0d is in PENDING state, waiting...&#xA;Get a pipeline run with id=2c3cb91e-0335-48a8-b060-de2f7da25b0d&#xA;Pipeline run with id=2c3cb91e-0335-48a8-b060-de2f7da25b0d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=2c3cb91e-0335-48a8-b060-de2f7da25b0d&#xA;Pipeline run with id=2c3cb91e-0335-48a8-b060-de2f7da25b0d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=2c3cb91e-0335-48a8-b060-de2f7da25b0d&#xA;Pipeline run with id=2c3cb91e-0335-48a8-b060-de2f7da25b0d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=2c3cb91e-0335-48a8-b060-de2f7da25b0d&#xA;Pipeline run with id=2c3cb91e-0335-48a8-b060-de2f7da25b0d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=2c3cb91e-0335-48a8-b060-de2f7da25b0d&#xA;Pipeline run with id=2c3cb91e-0335-48a8-b060-de2f7da25b0d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=2c3cb91e-0335-48a8-b060-de2f7da25b0d&#xA;Pipeline run with id=2c3cb91e-0335-48a8-b060-de2f7da25b0d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=2c3cb91e-0335-48a8-b060-de2f7da25b0d&#xA;Pipeline run with id=2c3cb91e-0335-48a8-b060-de2f7da25b0d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=2c3cb91e-0335-48a8-b060-de2f7da25b0d&#xA;Pipeline run with id=2c3cb91e-0335-48a8-b060-de2f7da25b0d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=2c3cb91e-0335-48a8-b060-de2f7da25b0d&#xA;Pipeline run with id=2c3cb91e-0335-48a8-b060-de2f7da25b0d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=2c3cb91e-0335-48a8-b060-de2f7da25b0d&#xA;Pipeline run with id=2c3cb91e-0335-48a8-b060-de2f7da25b0d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=2c3cb91e-0335-48a8-b060-de2f7da25b0d&#xA;Pipeline run with id=2c3cb91e-0335-48a8-b060-de2f7da25b0d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=2c3cb91e-0335-48a8-b060-de2f7da25b0d&#xA;Pipeline run with id=2c3cb91e-0335-48a8-b060-de2f7da25b0d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=2c3cb91e-0335-48a8-b060-de2f7da25b0d&#xA;Pipeline run with id=2c3cb91e-0335-48a8-b060-de2f7da25b0d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=2c3cb91e-0335-48a8-b060-de2f7da25b0d&#xA;Pipeline run with id=2c3cb91e-0335-48a8-b060-de2f7da25b0d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=2c3cb91e-0335-48a8-b060-de2f7da25b0d&#xA;Pipeline run with id=2c3cb91e-0335-48a8-b060-de2f7da25b0d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=2c3cb91e-0335-48a8-b060-de2f7da25b0d&#xA;Pipeline run with id=2c3cb91e-0335-48a8-b060-de2f7da25b0d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=2c3cb91e-0335-48a8-b060-de2f7da25b0d&#xA;Pipeline run with id=2c3cb91e-0335-48a8-b060-de2f7da25b0d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=2c3cb91e-0335-48a8-b060-de2f7da25b0d&#xA;Pipeline run with id=2c3cb91e-0335-48a8-b060-de2f7da25b0d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=2c3cb91e-0335-48a8-b060-de2f7da25b0d&#xA;Pipeline run with id=2c3cb91e-0335-48a8-b060-de2f7da25b0d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=2c3cb91e-0335-48a8-b060-de2f7da25b0d&#xA;Pipeline run with id=2c3cb91e-0335-48a8-b060-de2f7da25b0d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=2c3cb91e-0335-48a8-b060-de2f7da25b0d&#xA;Pipeline run with id=2c3cb91e-0335-48a8-b060-de2f7da25b0d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=2c3cb91e-0335-48a8-b060-de2f7da25b0d&#xA;Pipeline run with id=2c3cb91e-0335-48a8-b060-de2f7da25b0d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=2c3cb91e-0335-48a8-b060-de2f7da25b0d&#xA;Pipeline run with id=2c3cb91e-0335-48a8-b060-de2f7da25b0d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=2c3cb91e-0335-48a8-b060-de2f7da25b0d&#xA;Pipeline run with id=2c3cb91e-0335-48a8-b060-de2f7da25b0d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=2c3cb91e-0335-48a8-b060-de2f7da25b0d&#xA;Pipeline run with id=2c3cb91e-0335-48a8-b060-de2f7da25b0d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=2c3cb91e-0335-48a8-b060-de2f7da25b0d&#xA;Pipeline run with id=2c3cb91e-0335-48a8-b060-de2f7da25b0d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=2c3cb91e-0335-48a8-b060-de2f7da25b0d&#xA;Pipeline run with id=2c3cb91e-0335-48a8-b060-de2f7da25b0d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=2c3cb91e-0335-48a8-b060-de2f7da25b0d&#xA;Pipeline run with id=2c3cb91e-0335-48a8-b060-de2f7da25b0d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=2c3cb91e-0335-48a8-b060-de2f7da25b0d&#xA;Pipeline run with id=2c3cb91e-0335-48a8-b060-de2f7da25b0d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=2c3cb91e-0335-48a8-b060-de2f7da25b0d&#xA;Pipeline run with id=2c3cb91e-0335-48a8-b060-de2f7da25b0d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=2c3cb91e-0335-48a8-b060-de2f7da25b0d&#xA;Pipeline run with id=2c3cb91e-0335-48a8-b060-de2f7da25b0d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=2c3cb91e-0335-48a8-b060-de2f7da25b0d&#xA;Pipeline run with id=2c3cb91e-0335-48a8-b060-de2f7da25b0d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=2c3cb91e-0335-48a8-b060-de2f7da25b0d&#xA;Pipeline run with id=2c3cb91e-0335-48a8-b060-de2f7da25b0d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=2c3cb91e-0335-48a8-b060-de2f7da25b0d&#xA;Pipeline run with id=2c3cb91e-0335-48a8-b060-de2f7da25b0d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=2c3cb91e-0335-48a8-b060-de2f7da25b0d&#xA;Pipeline run with id=2c3cb91e-0335-48a8-b060-de2f7da25b0d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=2c3cb91e-0335-48a8-b060-de2f7da25b0d&#xA;Pipeline run with id=2c3cb91e-0335-48a8-b060-de2f7da25b0d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=2c3cb91e-0335-48a8-b060-de2f7da25b0d&#xA;Pipeline run with id=2c3cb91e-0335-48a8-b060-de2f7da25b0d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=2c3cb91e-0335-48a8-b060-de2f7da25b0d&#xA;Pipeline run with id=2c3cb91e-0335-48a8-b060-de2f7da25b0d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=2c3cb91e-0335-48a8-b060-de2f7da25b0d&#xA;Pipeline run with id=2c3cb91e-0335-48a8-b060-de2f7da25b0d reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;essential/iris_pipeline_compiled.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=2c3cb91e-0335-48a8-b060-de2f7da25b0d&#xA;Get a pipeline run with id=2c3cb91e-0335-48a8-b060-de2f7da25b0d&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 11/01/26 13:33:05.205 (3m16.264s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 11/01/26 13:33:05.205&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 2c3cb91e-0335-48a8-b060-de2f7da25b0d&#xA;Failed to terminate run 2c3cb91e-0335-48a8-b060-de2f7da25b0d&#xA;Terminate run 2c3cb91e-0335-48a8-b060-de2f7da25b0d&#xA;Deleting run 2c3cb91e-0335-48a8-b060-de2f7da25b0d&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=a972bc5f-9734-4b02-9b2e-96c034c8452d (cascade=true)&#xA;Pipeline with id=a972bc5f-9734-4b02-9b2e-96c034c8452d, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 11/01/26 13:33:06.554 (1.349s)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 11/01/26 13:33:06.554&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 11/01/26 13:33:06.554 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 11/01/26 13:33:06.554&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 11/01/26 13:33:06.554 (0s)&#xA;</system-err>
          </testcase>
      </testsuite>
  </testsuites>