<?xml version="1.0" encoding="UTF-8"?>
  <testsuites tests="5" disabled="0" errors="0" failures="0" time="181.120780604">
      <testsuite name="AIPipelinesE2ETests" package="/dspa/backend/test/end2end" tests="5" disabled="0" skipped="0" errors="0" failures="0" time="181.120780604" timestamp="2026-09-14T13:16:46">
          <properties>
              <property name="SuiteSucceeded" value="true"></property>
              <property name="SuiteHasProgrammaticFocus" value="false"></property>
              <property name="SpecialSuiteFailureReason" value=""></property>
              <property name="SuiteLabels" value="[]"></property>
              <property name="SuiteSemVerConstraints" value="[]"></property>
              <property name="RandomSeed" value="1789391607"></property>
              <property name="RandomizeAllSpecs" value="false"></property>
              <property name="LabelFilter" value="Smoke"></property>
              <property name="SemVerFilter" value=""></property>
              <property name="FocusStrings" value=""></property>
              <property name="SkipStrings" value=""></property>
              <property name="FocusFiles" value=""></property>
              <property name="SkipFiles" value=""></property>
              <property name="FailOnPending" value="false"></property>
              <property name="FailOnEmpty" value="false"></property>
              <property name="FailFast" value="false"></property>
              <property name="FlakeAttempts" value="0"></property>
              <property name="DryRun" value="false"></property>
              <property name="ParallelTotal" value="10"></property>
              <property name="OutputInterceptorMode" value=""></property>
          </properties>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload essential/component_with_pip_index_urls.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="80.944489804">
              <system-out>2026/09/14 13:18:07 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 09/14/26 13:16:46.216&#xA;Create an experiment with name E2EExperiment-1789391806216900827&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 09/14/26 13:16:46.382 (166ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 09/14/26 13:16:46.382&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x172a9acb4f00&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 09/14/26 13:16:46.521 (139ms)&#xA;&gt; Enter [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 09/14/26 13:16:46.522&#xA;Uploading pipeline file essential/component_with_pip_index_urls.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1789391806382905346, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml&#xA;Upload of pipeline file &#39;essential/component_with_pip_index_urls.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 97445afe-0966-4d52-9b08-6ad819d5f02f&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;97445afe-0966-4d52-9b08-6ad819d5f02f&#39; and name: &#39;e2e-test-1789391806382905346&#39;&#xA;Create a pipeline run for pipeline with id=97445afe-0966-4d52-9b08-6ad819d5f02f and versionId=5c261870-61de-43bc-83d8-431c5d589408&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=1c217716-ccfe-4dc5-9d40-ed99c06b5785&#xA;Created Pipeline Run with id: 1c217716-ccfe-4dc5-9d40-ed99c06b5785 for pipeline with id: 97445afe-0966-4d52-9b08-6ad819d5f02f&#xA;Waiting for pipeline run with id=1c217716-ccfe-4dc5-9d40-ed99c06b5785 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=1c217716-ccfe-4dc5-9d40-ed99c06b5785&#xA;Pipeline run with id=1c217716-ccfe-4dc5-9d40-ed99c06b5785 is in PENDING state, waiting...&#xA;Get a pipeline run with id=1c217716-ccfe-4dc5-9d40-ed99c06b5785&#xA;Pipeline run with id=1c217716-ccfe-4dc5-9d40-ed99c06b5785 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1c217716-ccfe-4dc5-9d40-ed99c06b5785&#xA;Pipeline run with id=1c217716-ccfe-4dc5-9d40-ed99c06b5785 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1c217716-ccfe-4dc5-9d40-ed99c06b5785&#xA;Pipeline run with id=1c217716-ccfe-4dc5-9d40-ed99c06b5785 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1c217716-ccfe-4dc5-9d40-ed99c06b5785&#xA;Pipeline run with id=1c217716-ccfe-4dc5-9d40-ed99c06b5785 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1c217716-ccfe-4dc5-9d40-ed99c06b5785&#xA;Pipeline run with id=1c217716-ccfe-4dc5-9d40-ed99c06b5785 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1c217716-ccfe-4dc5-9d40-ed99c06b5785&#xA;Pipeline run with id=1c217716-ccfe-4dc5-9d40-ed99c06b5785 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1c217716-ccfe-4dc5-9d40-ed99c06b5785&#xA;Pipeline run with id=1c217716-ccfe-4dc5-9d40-ed99c06b5785 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1c217716-ccfe-4dc5-9d40-ed99c06b5785&#xA;Pipeline run with id=1c217716-ccfe-4dc5-9d40-ed99c06b5785 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1c217716-ccfe-4dc5-9d40-ed99c06b5785&#xA;Pipeline run with id=1c217716-ccfe-4dc5-9d40-ed99c06b5785 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1c217716-ccfe-4dc5-9d40-ed99c06b5785&#xA;Pipeline run with id=1c217716-ccfe-4dc5-9d40-ed99c06b5785 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1c217716-ccfe-4dc5-9d40-ed99c06b5785&#xA;Pipeline run with id=1c217716-ccfe-4dc5-9d40-ed99c06b5785 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1c217716-ccfe-4dc5-9d40-ed99c06b5785&#xA;Pipeline run with id=1c217716-ccfe-4dc5-9d40-ed99c06b5785 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1c217716-ccfe-4dc5-9d40-ed99c06b5785&#xA;Pipeline run with id=1c217716-ccfe-4dc5-9d40-ed99c06b5785 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1c217716-ccfe-4dc5-9d40-ed99c06b5785&#xA;Pipeline run with id=1c217716-ccfe-4dc5-9d40-ed99c06b5785 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1c217716-ccfe-4dc5-9d40-ed99c06b5785&#xA;Pipeline run with id=1c217716-ccfe-4dc5-9d40-ed99c06b5785 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1c217716-ccfe-4dc5-9d40-ed99c06b5785&#xA;Pipeline run with id=1c217716-ccfe-4dc5-9d40-ed99c06b5785 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;essential/component_with_pip_index_urls.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=1c217716-ccfe-4dc5-9d40-ed99c06b5785&#xA;Get a pipeline run with id=1c217716-ccfe-4dc5-9d40-ed99c06b5785&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 09/14/26 13:18:07.046 (1m20.524s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 09/14/26 13:18:07.046&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 1c217716-ccfe-4dc5-9d40-ed99c06b5785&#xA;Failed to terminate run 1c217716-ccfe-4dc5-9d40-ed99c06b5785&#xA;Terminate run 1c217716-ccfe-4dc5-9d40-ed99c06b5785&#xA;Deleting run 1c217716-ccfe-4dc5-9d40-ed99c06b5785&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=97445afe-0966-4d52-9b08-6ad819d5f02f (cascade=true)&#xA;Pipeline with id=97445afe-0966-4d52-9b08-6ad819d5f02f, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 09/14/26 13:18:07.161 (115ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 09/14/26 13:18:07.161&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 09/14/26 13:18:07.161 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 09/14/26 13:18:07.161&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 09/14/26 13:18:07.161 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/parallel_for_after_dependency.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="116.006754208">
              <system-out>2026/09/14 13:18:42 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 09/14/26 13:16:46.216&#xA;Create an experiment with name E2EExperiment-1789391806216619639&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 09/14/26 13:16:46.382 (166ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 09/14/26 13:16:46.382&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x3a88528af380&#xA;test-secret-1 created&#xA;test-secret-2 created&#xA;test-secret-3 created&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 09/14/26 13:16:46.479 (97ms)&#xA;&gt; Enter [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 09/14/26 13:16:46.48&#xA;Uploading pipeline file critical/parallel_for_after_dependency.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1789391806382894975, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml&#xA;Upload of pipeline file &#39;critical/parallel_for_after_dependency.yaml&#39; successful&#xA;Listing pipeline versions for pipeline e7c8143b-6861-4e06-88de-a4f6c19d5fbb&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;e7c8143b-6861-4e06-88de-a4f6c19d5fbb&#39; and name: &#39;e2e-test-1789391806382894975&#39;&#xA;Create a pipeline run for pipeline with id=e7c8143b-6861-4e06-88de-a4f6c19d5fbb and versionId=a364c496-67da-493e-88ec-ff0a206b2547&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=1bbab0a5-b447-4377-862f-6e41fd72ed14&#xA;Created Pipeline Run with id: 1bbab0a5-b447-4377-862f-6e41fd72ed14 for pipeline with id: e7c8143b-6861-4e06-88de-a4f6c19d5fbb&#xA;Waiting for pipeline run with id=1bbab0a5-b447-4377-862f-6e41fd72ed14 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=1bbab0a5-b447-4377-862f-6e41fd72ed14&#xA;Pipeline run with id=1bbab0a5-b447-4377-862f-6e41fd72ed14 is in PENDING state, waiting...&#xA;Get a pipeline run with id=1bbab0a5-b447-4377-862f-6e41fd72ed14&#xA;Pipeline run with id=1bbab0a5-b447-4377-862f-6e41fd72ed14 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1bbab0a5-b447-4377-862f-6e41fd72ed14&#xA;Pipeline run with id=1bbab0a5-b447-4377-862f-6e41fd72ed14 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1bbab0a5-b447-4377-862f-6e41fd72ed14&#xA;Pipeline run with id=1bbab0a5-b447-4377-862f-6e41fd72ed14 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1bbab0a5-b447-4377-862f-6e41fd72ed14&#xA;Pipeline run with id=1bbab0a5-b447-4377-862f-6e41fd72ed14 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1bbab0a5-b447-4377-862f-6e41fd72ed14&#xA;Pipeline run with id=1bbab0a5-b447-4377-862f-6e41fd72ed14 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1bbab0a5-b447-4377-862f-6e41fd72ed14&#xA;Pipeline run with id=1bbab0a5-b447-4377-862f-6e41fd72ed14 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1bbab0a5-b447-4377-862f-6e41fd72ed14&#xA;Pipeline run with id=1bbab0a5-b447-4377-862f-6e41fd72ed14 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1bbab0a5-b447-4377-862f-6e41fd72ed14&#xA;Pipeline run with id=1bbab0a5-b447-4377-862f-6e41fd72ed14 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1bbab0a5-b447-4377-862f-6e41fd72ed14&#xA;Pipeline run with id=1bbab0a5-b447-4377-862f-6e41fd72ed14 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1bbab0a5-b447-4377-862f-6e41fd72ed14&#xA;Pipeline run with id=1bbab0a5-b447-4377-862f-6e41fd72ed14 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1bbab0a5-b447-4377-862f-6e41fd72ed14&#xA;Pipeline run with id=1bbab0a5-b447-4377-862f-6e41fd72ed14 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1bbab0a5-b447-4377-862f-6e41fd72ed14&#xA;Pipeline run with id=1bbab0a5-b447-4377-862f-6e41fd72ed14 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1bbab0a5-b447-4377-862f-6e41fd72ed14&#xA;Pipeline run with id=1bbab0a5-b447-4377-862f-6e41fd72ed14 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1bbab0a5-b447-4377-862f-6e41fd72ed14&#xA;Pipeline run with id=1bbab0a5-b447-4377-862f-6e41fd72ed14 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1bbab0a5-b447-4377-862f-6e41fd72ed14&#xA;Pipeline run with id=1bbab0a5-b447-4377-862f-6e41fd72ed14 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1bbab0a5-b447-4377-862f-6e41fd72ed14&#xA;Pipeline run with id=1bbab0a5-b447-4377-862f-6e41fd72ed14 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1bbab0a5-b447-4377-862f-6e41fd72ed14&#xA;Pipeline run with id=1bbab0a5-b447-4377-862f-6e41fd72ed14 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1bbab0a5-b447-4377-862f-6e41fd72ed14&#xA;Pipeline run with id=1bbab0a5-b447-4377-862f-6e41fd72ed14 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1bbab0a5-b447-4377-862f-6e41fd72ed14&#xA;Pipeline run with id=1bbab0a5-b447-4377-862f-6e41fd72ed14 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1bbab0a5-b447-4377-862f-6e41fd72ed14&#xA;Pipeline run with id=1bbab0a5-b447-4377-862f-6e41fd72ed14 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1bbab0a5-b447-4377-862f-6e41fd72ed14&#xA;Pipeline run with id=1bbab0a5-b447-4377-862f-6e41fd72ed14 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1bbab0a5-b447-4377-862f-6e41fd72ed14&#xA;Pipeline run with id=1bbab0a5-b447-4377-862f-6e41fd72ed14 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1bbab0a5-b447-4377-862f-6e41fd72ed14&#xA;Pipeline run with id=1bbab0a5-b447-4377-862f-6e41fd72ed14 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/parallel_for_after_dependency.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=1bbab0a5-b447-4377-862f-6e41fd72ed14&#xA;Get a pipeline run with id=1bbab0a5-b447-4377-862f-6e41fd72ed14&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 09/14/26 13:18:42.056 (1m55.577s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 09/14/26 13:18:42.056&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 1bbab0a5-b447-4377-862f-6e41fd72ed14&#xA;Failed to terminate run 1bbab0a5-b447-4377-862f-6e41fd72ed14&#xA;Terminate run 1bbab0a5-b447-4377-862f-6e41fd72ed14&#xA;Deleting run 1bbab0a5-b447-4377-862f-6e41fd72ed14&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=e7c8143b-6861-4e06-88de-a4f6c19d5fbb (cascade=true)&#xA;Pipeline with id=e7c8143b-6861-4e06-88de-a4f6c19d5fbb, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 09/14/26 13:18:42.223 (166ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 09/14/26 13:18:42.223&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 09/14/26 13:18:42.223 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 09/14/26 13:18:42.223&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 09/14/26 13:18:42.223 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/pipeline_with_artifact_upload_download.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="130.963277344">
              <system-out>2026/09/14 13:18:57 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 09/14/26 13:16:46.216&#xA;Create an experiment with name E2EExperiment-1789391806216957190&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 09/14/26 13:16:46.382 (166ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 09/14/26 13:16:46.382&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x35dfa4b74c00&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 09/14/26 13:16:46.536 (153ms)&#xA;&gt; Enter [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 09/14/26 13:16:46.536&#xA;Uploading pipeline file critical/pipeline_with_artifact_upload_download.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1789391806382972820, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml&#xA;Upload of pipeline file &#39;critical/pipeline_with_artifact_upload_download.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 8a298053-8973-458c-a66e-5221694143ff&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;8a298053-8973-458c-a66e-5221694143ff&#39; and name: &#39;e2e-test-1789391806382972820&#39;&#xA;Create a pipeline run for pipeline with id=8a298053-8973-458c-a66e-5221694143ff and versionId=5bc7c570-1bce-444c-a068-b12c7eaed0e6&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=95eed079-2b99-410c-b58a-9e2f8b082024&#xA;Created Pipeline Run with id: 95eed079-2b99-410c-b58a-9e2f8b082024 for pipeline with id: 8a298053-8973-458c-a66e-5221694143ff&#xA;Waiting for pipeline run with id=95eed079-2b99-410c-b58a-9e2f8b082024 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=95eed079-2b99-410c-b58a-9e2f8b082024&#xA;Pipeline run with id=95eed079-2b99-410c-b58a-9e2f8b082024 is in PENDING state, waiting...&#xA;Get a pipeline run with id=95eed079-2b99-410c-b58a-9e2f8b082024&#xA;Pipeline run with id=95eed079-2b99-410c-b58a-9e2f8b082024 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=95eed079-2b99-410c-b58a-9e2f8b082024&#xA;Pipeline run with id=95eed079-2b99-410c-b58a-9e2f8b082024 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=95eed079-2b99-410c-b58a-9e2f8b082024&#xA;Pipeline run with id=95eed079-2b99-410c-b58a-9e2f8b082024 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=95eed079-2b99-410c-b58a-9e2f8b082024&#xA;Pipeline run with id=95eed079-2b99-410c-b58a-9e2f8b082024 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=95eed079-2b99-410c-b58a-9e2f8b082024&#xA;Pipeline run with id=95eed079-2b99-410c-b58a-9e2f8b082024 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=95eed079-2b99-410c-b58a-9e2f8b082024&#xA;Pipeline run with id=95eed079-2b99-410c-b58a-9e2f8b082024 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=95eed079-2b99-410c-b58a-9e2f8b082024&#xA;Pipeline run with id=95eed079-2b99-410c-b58a-9e2f8b082024 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=95eed079-2b99-410c-b58a-9e2f8b082024&#xA;Pipeline run with id=95eed079-2b99-410c-b58a-9e2f8b082024 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=95eed079-2b99-410c-b58a-9e2f8b082024&#xA;Pipeline run with id=95eed079-2b99-410c-b58a-9e2f8b082024 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=95eed079-2b99-410c-b58a-9e2f8b082024&#xA;Pipeline run with id=95eed079-2b99-410c-b58a-9e2f8b082024 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=95eed079-2b99-410c-b58a-9e2f8b082024&#xA;Pipeline run with id=95eed079-2b99-410c-b58a-9e2f8b082024 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=95eed079-2b99-410c-b58a-9e2f8b082024&#xA;Pipeline run with id=95eed079-2b99-410c-b58a-9e2f8b082024 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=95eed079-2b99-410c-b58a-9e2f8b082024&#xA;Pipeline run with id=95eed079-2b99-410c-b58a-9e2f8b082024 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=95eed079-2b99-410c-b58a-9e2f8b082024&#xA;Pipeline run with id=95eed079-2b99-410c-b58a-9e2f8b082024 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=95eed079-2b99-410c-b58a-9e2f8b082024&#xA;Pipeline run with id=95eed079-2b99-410c-b58a-9e2f8b082024 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=95eed079-2b99-410c-b58a-9e2f8b082024&#xA;Pipeline run with id=95eed079-2b99-410c-b58a-9e2f8b082024 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=95eed079-2b99-410c-b58a-9e2f8b082024&#xA;Pipeline run with id=95eed079-2b99-410c-b58a-9e2f8b082024 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=95eed079-2b99-410c-b58a-9e2f8b082024&#xA;Pipeline run with id=95eed079-2b99-410c-b58a-9e2f8b082024 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=95eed079-2b99-410c-b58a-9e2f8b082024&#xA;Pipeline run with id=95eed079-2b99-410c-b58a-9e2f8b082024 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=95eed079-2b99-410c-b58a-9e2f8b082024&#xA;Pipeline run with id=95eed079-2b99-410c-b58a-9e2f8b082024 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=95eed079-2b99-410c-b58a-9e2f8b082024&#xA;Pipeline run with id=95eed079-2b99-410c-b58a-9e2f8b082024 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=95eed079-2b99-410c-b58a-9e2f8b082024&#xA;Pipeline run with id=95eed079-2b99-410c-b58a-9e2f8b082024 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=95eed079-2b99-410c-b58a-9e2f8b082024&#xA;Pipeline run with id=95eed079-2b99-410c-b58a-9e2f8b082024 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=95eed079-2b99-410c-b58a-9e2f8b082024&#xA;Pipeline run with id=95eed079-2b99-410c-b58a-9e2f8b082024 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=95eed079-2b99-410c-b58a-9e2f8b082024&#xA;Pipeline run with id=95eed079-2b99-410c-b58a-9e2f8b082024 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=95eed079-2b99-410c-b58a-9e2f8b082024&#xA;Pipeline run with id=95eed079-2b99-410c-b58a-9e2f8b082024 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/pipeline_with_artifact_upload_download.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=95eed079-2b99-410c-b58a-9e2f8b082024&#xA;Get a pipeline run with id=95eed079-2b99-410c-b58a-9e2f8b082024&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 09/14/26 13:18:57.038 (2m10.503s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 09/14/26 13:18:57.038&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 95eed079-2b99-410c-b58a-9e2f8b082024&#xA;Failed to terminate run 95eed079-2b99-410c-b58a-9e2f8b082024&#xA;Terminate run 95eed079-2b99-410c-b58a-9e2f8b082024&#xA;Deleting run 95eed079-2b99-410c-b58a-9e2f8b082024&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=8a298053-8973-458c-a66e-5221694143ff (cascade=true)&#xA;Pipeline with id=8a298053-8973-458c-a66e-5221694143ff, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 09/14/26 13:18:57.18 (141ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 09/14/26 13:18:57.18&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 09/14/26 13:18:57.18 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 09/14/26 13:18:57.18&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 09/14/26 13:18:57.18 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/flip_coin.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="165.954526974">
              <system-out>2026/09/14 13:19:32 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 09/14/26 13:16:46.217&#xA;Create an experiment with name E2EExperiment-1789391806217132281&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 09/14/26 13:16:46.382 (166ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 09/14/26 13:16:46.383&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0xfc8825aee80&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 09/14/26 13:16:46.523 (140ms)&#xA;&gt; Enter [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 09/14/26 13:16:46.523&#xA;Uploading pipeline file critical/flip_coin.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1789391806383120099, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml&#xA;Upload of pipeline file &#39;critical/flip_coin.yaml&#39; successful&#xA;Listing pipeline versions for pipeline dbba6975-7534-479b-b2b3-4a46a38bd7d4&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;dbba6975-7534-479b-b2b3-4a46a38bd7d4&#39; and name: &#39;e2e-test-1789391806383120099&#39;&#xA;Create a pipeline run for pipeline with id=dbba6975-7534-479b-b2b3-4a46a38bd7d4 and versionId=adc9e2ee-8e99-42a3-9834-5a379c690c87&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=3f34aa78-e6d5-4c5b-abe4-154618e5cdcf&#xA;Created Pipeline Run with id: 3f34aa78-e6d5-4c5b-abe4-154618e5cdcf for pipeline with id: dbba6975-7534-479b-b2b3-4a46a38bd7d4&#xA;Waiting for pipeline run with id=3f34aa78-e6d5-4c5b-abe4-154618e5cdcf to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=3f34aa78-e6d5-4c5b-abe4-154618e5cdcf&#xA;Pipeline run with id=3f34aa78-e6d5-4c5b-abe4-154618e5cdcf is in PENDING state, waiting...&#xA;Get a pipeline run with id=3f34aa78-e6d5-4c5b-abe4-154618e5cdcf&#xA;Pipeline run with id=3f34aa78-e6d5-4c5b-abe4-154618e5cdcf is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3f34aa78-e6d5-4c5b-abe4-154618e5cdcf&#xA;Pipeline run with id=3f34aa78-e6d5-4c5b-abe4-154618e5cdcf is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3f34aa78-e6d5-4c5b-abe4-154618e5cdcf&#xA;Pipeline run with id=3f34aa78-e6d5-4c5b-abe4-154618e5cdcf is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3f34aa78-e6d5-4c5b-abe4-154618e5cdcf&#xA;Pipeline run with id=3f34aa78-e6d5-4c5b-abe4-154618e5cdcf is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3f34aa78-e6d5-4c5b-abe4-154618e5cdcf&#xA;Pipeline run with id=3f34aa78-e6d5-4c5b-abe4-154618e5cdcf is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3f34aa78-e6d5-4c5b-abe4-154618e5cdcf&#xA;Pipeline run with id=3f34aa78-e6d5-4c5b-abe4-154618e5cdcf is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3f34aa78-e6d5-4c5b-abe4-154618e5cdcf&#xA;Pipeline run with id=3f34aa78-e6d5-4c5b-abe4-154618e5cdcf is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3f34aa78-e6d5-4c5b-abe4-154618e5cdcf&#xA;Pipeline run with id=3f34aa78-e6d5-4c5b-abe4-154618e5cdcf is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3f34aa78-e6d5-4c5b-abe4-154618e5cdcf&#xA;Pipeline run with id=3f34aa78-e6d5-4c5b-abe4-154618e5cdcf is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3f34aa78-e6d5-4c5b-abe4-154618e5cdcf&#xA;Pipeline run with id=3f34aa78-e6d5-4c5b-abe4-154618e5cdcf is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3f34aa78-e6d5-4c5b-abe4-154618e5cdcf&#xA;Pipeline run with id=3f34aa78-e6d5-4c5b-abe4-154618e5cdcf is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3f34aa78-e6d5-4c5b-abe4-154618e5cdcf&#xA;Pipeline run with id=3f34aa78-e6d5-4c5b-abe4-154618e5cdcf is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3f34aa78-e6d5-4c5b-abe4-154618e5cdcf&#xA;Pipeline run with id=3f34aa78-e6d5-4c5b-abe4-154618e5cdcf is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3f34aa78-e6d5-4c5b-abe4-154618e5cdcf&#xA;Pipeline run with id=3f34aa78-e6d5-4c5b-abe4-154618e5cdcf is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3f34aa78-e6d5-4c5b-abe4-154618e5cdcf&#xA;Pipeline run with id=3f34aa78-e6d5-4c5b-abe4-154618e5cdcf is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3f34aa78-e6d5-4c5b-abe4-154618e5cdcf&#xA;Pipeline run with id=3f34aa78-e6d5-4c5b-abe4-154618e5cdcf is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3f34aa78-e6d5-4c5b-abe4-154618e5cdcf&#xA;Pipeline run with id=3f34aa78-e6d5-4c5b-abe4-154618e5cdcf is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3f34aa78-e6d5-4c5b-abe4-154618e5cdcf&#xA;Pipeline run with id=3f34aa78-e6d5-4c5b-abe4-154618e5cdcf is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3f34aa78-e6d5-4c5b-abe4-154618e5cdcf&#xA;Pipeline run with id=3f34aa78-e6d5-4c5b-abe4-154618e5cdcf is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3f34aa78-e6d5-4c5b-abe4-154618e5cdcf&#xA;Pipeline run with id=3f34aa78-e6d5-4c5b-abe4-154618e5cdcf is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3f34aa78-e6d5-4c5b-abe4-154618e5cdcf&#xA;Pipeline run with id=3f34aa78-e6d5-4c5b-abe4-154618e5cdcf is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3f34aa78-e6d5-4c5b-abe4-154618e5cdcf&#xA;Pipeline run with id=3f34aa78-e6d5-4c5b-abe4-154618e5cdcf is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3f34aa78-e6d5-4c5b-abe4-154618e5cdcf&#xA;Pipeline run with id=3f34aa78-e6d5-4c5b-abe4-154618e5cdcf is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3f34aa78-e6d5-4c5b-abe4-154618e5cdcf&#xA;Pipeline run with id=3f34aa78-e6d5-4c5b-abe4-154618e5cdcf is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3f34aa78-e6d5-4c5b-abe4-154618e5cdcf&#xA;Pipeline run with id=3f34aa78-e6d5-4c5b-abe4-154618e5cdcf is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3f34aa78-e6d5-4c5b-abe4-154618e5cdcf&#xA;Pipeline run with id=3f34aa78-e6d5-4c5b-abe4-154618e5cdcf is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3f34aa78-e6d5-4c5b-abe4-154618e5cdcf&#xA;Pipeline run with id=3f34aa78-e6d5-4c5b-abe4-154618e5cdcf is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3f34aa78-e6d5-4c5b-abe4-154618e5cdcf&#xA;Pipeline run with id=3f34aa78-e6d5-4c5b-abe4-154618e5cdcf is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3f34aa78-e6d5-4c5b-abe4-154618e5cdcf&#xA;Pipeline run with id=3f34aa78-e6d5-4c5b-abe4-154618e5cdcf is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3f34aa78-e6d5-4c5b-abe4-154618e5cdcf&#xA;Pipeline run with id=3f34aa78-e6d5-4c5b-abe4-154618e5cdcf is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3f34aa78-e6d5-4c5b-abe4-154618e5cdcf&#xA;Pipeline run with id=3f34aa78-e6d5-4c5b-abe4-154618e5cdcf is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3f34aa78-e6d5-4c5b-abe4-154618e5cdcf&#xA;Pipeline run with id=3f34aa78-e6d5-4c5b-abe4-154618e5cdcf is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3f34aa78-e6d5-4c5b-abe4-154618e5cdcf&#xA;Pipeline run with id=3f34aa78-e6d5-4c5b-abe4-154618e5cdcf reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/flip_coin.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=3f34aa78-e6d5-4c5b-abe4-154618e5cdcf&#xA;Get a pipeline run with id=3f34aa78-e6d5-4c5b-abe4-154618e5cdcf&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 09/14/26 13:19:32.046 (2m45.524s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 09/14/26 13:19:32.047&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 3f34aa78-e6d5-4c5b-abe4-154618e5cdcf&#xA;Failed to terminate run 3f34aa78-e6d5-4c5b-abe4-154618e5cdcf&#xA;Terminate run 3f34aa78-e6d5-4c5b-abe4-154618e5cdcf&#xA;Deleting run 3f34aa78-e6d5-4c5b-abe4-154618e5cdcf&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=dbba6975-7534-479b-b2b3-4a46a38bd7d4 (cascade=true)&#xA;Pipeline with id=dbba6975-7534-479b-b2b3-4a46a38bd7d4, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 09/14/26 13:19:32.171 (124ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 09/14/26 13:19:32.171&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 09/14/26 13:19:32.171 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 09/14/26 13:19:32.171&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 09/14/26 13:19:32.171 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload essential/iris_pipeline_compiled.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="180.916881072">
              <system-out>2026/09/14 13:19:47 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 09/14/26 13:16:46.217&#xA;Create an experiment with name E2EExperiment-1789391806217160163&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 09/14/26 13:16:46.382 (165ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 09/14/26 13:16:46.382&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0xfc7f5cd0980&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 09/14/26 13:16:46.557 (175ms)&#xA;&gt; Enter [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 09/14/26 13:16:46.557&#xA;Uploading pipeline file essential/iris_pipeline_compiled.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1789391806382873114, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml&#xA;Upload of pipeline file &#39;essential/iris_pipeline_compiled.yaml&#39; successful&#xA;Listing pipeline versions for pipeline b708be17-7bae-4df1-a889-55f5a86039e1&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;b708be17-7bae-4df1-a889-55f5a86039e1&#39; and name: &#39;e2e-test-1789391806382873114&#39;&#xA;Create a pipeline run for pipeline with id=b708be17-7bae-4df1-a889-55f5a86039e1 and versionId=546927ba-4d41-4078-a713-ae9d1b08a251&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=53932063-e308-4ac6-9e91-b83533dbeeb6&#xA;Created Pipeline Run with id: 53932063-e308-4ac6-9e91-b83533dbeeb6 for pipeline with id: b708be17-7bae-4df1-a889-55f5a86039e1&#xA;Waiting for pipeline run with id=53932063-e308-4ac6-9e91-b83533dbeeb6 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=53932063-e308-4ac6-9e91-b83533dbeeb6&#xA;Pipeline run with id=53932063-e308-4ac6-9e91-b83533dbeeb6 is in PENDING state, waiting...&#xA;Get a pipeline run with id=53932063-e308-4ac6-9e91-b83533dbeeb6&#xA;Pipeline run with id=53932063-e308-4ac6-9e91-b83533dbeeb6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=53932063-e308-4ac6-9e91-b83533dbeeb6&#xA;Pipeline run with id=53932063-e308-4ac6-9e91-b83533dbeeb6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=53932063-e308-4ac6-9e91-b83533dbeeb6&#xA;Pipeline run with id=53932063-e308-4ac6-9e91-b83533dbeeb6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=53932063-e308-4ac6-9e91-b83533dbeeb6&#xA;Pipeline run with id=53932063-e308-4ac6-9e91-b83533dbeeb6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=53932063-e308-4ac6-9e91-b83533dbeeb6&#xA;Pipeline run with id=53932063-e308-4ac6-9e91-b83533dbeeb6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=53932063-e308-4ac6-9e91-b83533dbeeb6&#xA;Pipeline run with id=53932063-e308-4ac6-9e91-b83533dbeeb6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=53932063-e308-4ac6-9e91-b83533dbeeb6&#xA;Pipeline run with id=53932063-e308-4ac6-9e91-b83533dbeeb6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=53932063-e308-4ac6-9e91-b83533dbeeb6&#xA;Pipeline run with id=53932063-e308-4ac6-9e91-b83533dbeeb6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=53932063-e308-4ac6-9e91-b83533dbeeb6&#xA;Pipeline run with id=53932063-e308-4ac6-9e91-b83533dbeeb6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=53932063-e308-4ac6-9e91-b83533dbeeb6&#xA;Pipeline run with id=53932063-e308-4ac6-9e91-b83533dbeeb6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=53932063-e308-4ac6-9e91-b83533dbeeb6&#xA;Pipeline run with id=53932063-e308-4ac6-9e91-b83533dbeeb6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=53932063-e308-4ac6-9e91-b83533dbeeb6&#xA;Pipeline run with id=53932063-e308-4ac6-9e91-b83533dbeeb6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=53932063-e308-4ac6-9e91-b83533dbeeb6&#xA;Pipeline run with id=53932063-e308-4ac6-9e91-b83533dbeeb6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=53932063-e308-4ac6-9e91-b83533dbeeb6&#xA;Pipeline run with id=53932063-e308-4ac6-9e91-b83533dbeeb6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=53932063-e308-4ac6-9e91-b83533dbeeb6&#xA;Pipeline run with id=53932063-e308-4ac6-9e91-b83533dbeeb6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=53932063-e308-4ac6-9e91-b83533dbeeb6&#xA;Pipeline run with id=53932063-e308-4ac6-9e91-b83533dbeeb6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=53932063-e308-4ac6-9e91-b83533dbeeb6&#xA;Pipeline run with id=53932063-e308-4ac6-9e91-b83533dbeeb6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=53932063-e308-4ac6-9e91-b83533dbeeb6&#xA;Pipeline run with id=53932063-e308-4ac6-9e91-b83533dbeeb6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=53932063-e308-4ac6-9e91-b83533dbeeb6&#xA;Pipeline run with id=53932063-e308-4ac6-9e91-b83533dbeeb6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=53932063-e308-4ac6-9e91-b83533dbeeb6&#xA;Pipeline run with id=53932063-e308-4ac6-9e91-b83533dbeeb6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=53932063-e308-4ac6-9e91-b83533dbeeb6&#xA;Pipeline run with id=53932063-e308-4ac6-9e91-b83533dbeeb6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=53932063-e308-4ac6-9e91-b83533dbeeb6&#xA;Pipeline run with id=53932063-e308-4ac6-9e91-b83533dbeeb6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=53932063-e308-4ac6-9e91-b83533dbeeb6&#xA;Pipeline run with id=53932063-e308-4ac6-9e91-b83533dbeeb6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=53932063-e308-4ac6-9e91-b83533dbeeb6&#xA;Pipeline run with id=53932063-e308-4ac6-9e91-b83533dbeeb6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=53932063-e308-4ac6-9e91-b83533dbeeb6&#xA;Pipeline run with id=53932063-e308-4ac6-9e91-b83533dbeeb6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=53932063-e308-4ac6-9e91-b83533dbeeb6&#xA;Pipeline run with id=53932063-e308-4ac6-9e91-b83533dbeeb6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=53932063-e308-4ac6-9e91-b83533dbeeb6&#xA;Pipeline run with id=53932063-e308-4ac6-9e91-b83533dbeeb6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=53932063-e308-4ac6-9e91-b83533dbeeb6&#xA;Pipeline run with id=53932063-e308-4ac6-9e91-b83533dbeeb6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=53932063-e308-4ac6-9e91-b83533dbeeb6&#xA;Pipeline run with id=53932063-e308-4ac6-9e91-b83533dbeeb6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=53932063-e308-4ac6-9e91-b83533dbeeb6&#xA;Pipeline run with id=53932063-e308-4ac6-9e91-b83533dbeeb6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=53932063-e308-4ac6-9e91-b83533dbeeb6&#xA;Pipeline run with id=53932063-e308-4ac6-9e91-b83533dbeeb6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=53932063-e308-4ac6-9e91-b83533dbeeb6&#xA;Pipeline run with id=53932063-e308-4ac6-9e91-b83533dbeeb6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=53932063-e308-4ac6-9e91-b83533dbeeb6&#xA;Pipeline run with id=53932063-e308-4ac6-9e91-b83533dbeeb6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=53932063-e308-4ac6-9e91-b83533dbeeb6&#xA;Pipeline run with id=53932063-e308-4ac6-9e91-b83533dbeeb6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=53932063-e308-4ac6-9e91-b83533dbeeb6&#xA;Pipeline run with id=53932063-e308-4ac6-9e91-b83533dbeeb6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=53932063-e308-4ac6-9e91-b83533dbeeb6&#xA;Pipeline run with id=53932063-e308-4ac6-9e91-b83533dbeeb6 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;essential/iris_pipeline_compiled.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=53932063-e308-4ac6-9e91-b83533dbeeb6&#xA;Get a pipeline run with id=53932063-e308-4ac6-9e91-b83533dbeeb6&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 09/14/26 13:19:47.021 (3m0.464s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 09/14/26 13:19:47.022&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 53932063-e308-4ac6-9e91-b83533dbeeb6&#xA;Failed to terminate run 53932063-e308-4ac6-9e91-b83533dbeeb6&#xA;Terminate run 53932063-e308-4ac6-9e91-b83533dbeeb6&#xA;Deleting run 53932063-e308-4ac6-9e91-b83533dbeeb6&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=b708be17-7bae-4df1-a889-55f5a86039e1 (cascade=true)&#xA;Pipeline with id=b708be17-7bae-4df1-a889-55f5a86039e1, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 09/14/26 13:19:47.133 (112ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 09/14/26 13:19:47.134&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 09/14/26 13:19:47.134 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 09/14/26 13:19:47.134&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 09/14/26 13:19:47.134 (0s)&#xA;</system-err>
          </testcase>
      </testsuite>
  </testsuites>