<?xml version="1.0" encoding="UTF-8"?>
  <testsuites tests="5" disabled="0" errors="0" failures="0" time="180.931853894">
      <testsuite name="AIPipelinesE2ETests" package="/dspa/backend/test/end2end" tests="5" disabled="0" skipped="0" errors="0" failures="0" time="180.931853894" timestamp="2026-07-16T11:25:48">
          <properties>
              <property name="SuiteSucceeded" value="true"></property>
              <property name="SuiteHasProgrammaticFocus" value="false"></property>
              <property name="SpecialSuiteFailureReason" value=""></property>
              <property name="SuiteLabels" value="[]"></property>
              <property name="SuiteSemVerConstraints" value="[]"></property>
              <property name="RandomSeed" value="1784200977"></property>
              <property name="RandomizeAllSpecs" value="false"></property>
              <property name="LabelFilter" value="Smoke"></property>
              <property name="SemVerFilter" value=""></property>
              <property name="FocusStrings" value=""></property>
              <property name="SkipStrings" value=""></property>
              <property name="FocusFiles" value=""></property>
              <property name="SkipFiles" value=""></property>
              <property name="FailOnPending" value="false"></property>
              <property name="FailOnEmpty" value="false"></property>
              <property name="FailFast" value="false"></property>
              <property name="FlakeAttempts" value="0"></property>
              <property name="DryRun" value="false"></property>
              <property name="ParallelTotal" value="10"></property>
              <property name="OutputInterceptorMode" value=""></property>
          </properties>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload essential/iris_pipeline_compiled.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="180.80372084">
              <system-out>2026/07/16 11:28:49 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/16/26 11:25:48.36&#xA;Create an experiment with name E2EExperiment-1784201148360561528&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/16/26 11:25:48.538 (178ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/16/26 11:25:48.538&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x1d07f36a6e80&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/16/26 11:25:48.581 (43ms)&#xA;&gt; Enter [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/16/26 11:25:48.581&#xA;Uploading pipeline file essential/iris_pipeline_compiled.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1784201148538924468, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml&#xA;Upload of pipeline file &#39;essential/iris_pipeline_compiled.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 746f04ea-316e-4dde-821c-c0208c4414d9&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;746f04ea-316e-4dde-821c-c0208c4414d9&#39; and name: &#39;e2e-test-1784201148538924468&#39;&#xA;Create a pipeline run for pipeline with id=746f04ea-316e-4dde-821c-c0208c4414d9 and versionId=436e18f2-c3e3-4012-bf01-a1701814a030&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=6558e882-c2a2-457a-9bd0-8d6239c40486&#xA;Created Pipeline Run with id: 6558e882-c2a2-457a-9bd0-8d6239c40486 for pipeline with id: 746f04ea-316e-4dde-821c-c0208c4414d9&#xA;Waiting for pipeline run with id=6558e882-c2a2-457a-9bd0-8d6239c40486 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=6558e882-c2a2-457a-9bd0-8d6239c40486&#xA;Pipeline run with id=6558e882-c2a2-457a-9bd0-8d6239c40486 is in PENDING state, waiting...&#xA;Get a pipeline run with id=6558e882-c2a2-457a-9bd0-8d6239c40486&#xA;Pipeline run with id=6558e882-c2a2-457a-9bd0-8d6239c40486 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6558e882-c2a2-457a-9bd0-8d6239c40486&#xA;Pipeline run with id=6558e882-c2a2-457a-9bd0-8d6239c40486 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6558e882-c2a2-457a-9bd0-8d6239c40486&#xA;Pipeline run with id=6558e882-c2a2-457a-9bd0-8d6239c40486 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6558e882-c2a2-457a-9bd0-8d6239c40486&#xA;Pipeline run with id=6558e882-c2a2-457a-9bd0-8d6239c40486 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6558e882-c2a2-457a-9bd0-8d6239c40486&#xA;Pipeline run with id=6558e882-c2a2-457a-9bd0-8d6239c40486 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6558e882-c2a2-457a-9bd0-8d6239c40486&#xA;Pipeline run with id=6558e882-c2a2-457a-9bd0-8d6239c40486 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6558e882-c2a2-457a-9bd0-8d6239c40486&#xA;Pipeline run with id=6558e882-c2a2-457a-9bd0-8d6239c40486 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6558e882-c2a2-457a-9bd0-8d6239c40486&#xA;Pipeline run with id=6558e882-c2a2-457a-9bd0-8d6239c40486 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6558e882-c2a2-457a-9bd0-8d6239c40486&#xA;Pipeline run with id=6558e882-c2a2-457a-9bd0-8d6239c40486 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6558e882-c2a2-457a-9bd0-8d6239c40486&#xA;Pipeline run with id=6558e882-c2a2-457a-9bd0-8d6239c40486 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6558e882-c2a2-457a-9bd0-8d6239c40486&#xA;Pipeline run with id=6558e882-c2a2-457a-9bd0-8d6239c40486 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6558e882-c2a2-457a-9bd0-8d6239c40486&#xA;Pipeline run with id=6558e882-c2a2-457a-9bd0-8d6239c40486 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6558e882-c2a2-457a-9bd0-8d6239c40486&#xA;Pipeline run with id=6558e882-c2a2-457a-9bd0-8d6239c40486 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6558e882-c2a2-457a-9bd0-8d6239c40486&#xA;Pipeline run with id=6558e882-c2a2-457a-9bd0-8d6239c40486 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6558e882-c2a2-457a-9bd0-8d6239c40486&#xA;Pipeline run with id=6558e882-c2a2-457a-9bd0-8d6239c40486 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6558e882-c2a2-457a-9bd0-8d6239c40486&#xA;Pipeline run with id=6558e882-c2a2-457a-9bd0-8d6239c40486 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6558e882-c2a2-457a-9bd0-8d6239c40486&#xA;Pipeline run with id=6558e882-c2a2-457a-9bd0-8d6239c40486 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6558e882-c2a2-457a-9bd0-8d6239c40486&#xA;Pipeline run with id=6558e882-c2a2-457a-9bd0-8d6239c40486 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6558e882-c2a2-457a-9bd0-8d6239c40486&#xA;Pipeline run with id=6558e882-c2a2-457a-9bd0-8d6239c40486 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6558e882-c2a2-457a-9bd0-8d6239c40486&#xA;Pipeline run with id=6558e882-c2a2-457a-9bd0-8d6239c40486 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6558e882-c2a2-457a-9bd0-8d6239c40486&#xA;Pipeline run with id=6558e882-c2a2-457a-9bd0-8d6239c40486 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6558e882-c2a2-457a-9bd0-8d6239c40486&#xA;Pipeline run with id=6558e882-c2a2-457a-9bd0-8d6239c40486 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6558e882-c2a2-457a-9bd0-8d6239c40486&#xA;Pipeline run with id=6558e882-c2a2-457a-9bd0-8d6239c40486 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6558e882-c2a2-457a-9bd0-8d6239c40486&#xA;Pipeline run with id=6558e882-c2a2-457a-9bd0-8d6239c40486 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6558e882-c2a2-457a-9bd0-8d6239c40486&#xA;Pipeline run with id=6558e882-c2a2-457a-9bd0-8d6239c40486 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6558e882-c2a2-457a-9bd0-8d6239c40486&#xA;Pipeline run with id=6558e882-c2a2-457a-9bd0-8d6239c40486 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6558e882-c2a2-457a-9bd0-8d6239c40486&#xA;Pipeline run with id=6558e882-c2a2-457a-9bd0-8d6239c40486 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6558e882-c2a2-457a-9bd0-8d6239c40486&#xA;Pipeline run with id=6558e882-c2a2-457a-9bd0-8d6239c40486 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6558e882-c2a2-457a-9bd0-8d6239c40486&#xA;Pipeline run with id=6558e882-c2a2-457a-9bd0-8d6239c40486 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6558e882-c2a2-457a-9bd0-8d6239c40486&#xA;Pipeline run with id=6558e882-c2a2-457a-9bd0-8d6239c40486 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6558e882-c2a2-457a-9bd0-8d6239c40486&#xA;Pipeline run with id=6558e882-c2a2-457a-9bd0-8d6239c40486 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6558e882-c2a2-457a-9bd0-8d6239c40486&#xA;Pipeline run with id=6558e882-c2a2-457a-9bd0-8d6239c40486 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6558e882-c2a2-457a-9bd0-8d6239c40486&#xA;Pipeline run with id=6558e882-c2a2-457a-9bd0-8d6239c40486 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6558e882-c2a2-457a-9bd0-8d6239c40486&#xA;Pipeline run with id=6558e882-c2a2-457a-9bd0-8d6239c40486 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6558e882-c2a2-457a-9bd0-8d6239c40486&#xA;Pipeline run with id=6558e882-c2a2-457a-9bd0-8d6239c40486 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6558e882-c2a2-457a-9bd0-8d6239c40486&#xA;Pipeline run with id=6558e882-c2a2-457a-9bd0-8d6239c40486 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;essential/iris_pipeline_compiled.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=6558e882-c2a2-457a-9bd0-8d6239c40486&#xA;Get a pipeline run with id=6558e882-c2a2-457a-9bd0-8d6239c40486&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/16/26 11:28:49.073 (3m0.492s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/16/26 11:28:49.073&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 6558e882-c2a2-457a-9bd0-8d6239c40486&#xA;Failed to terminate run 6558e882-c2a2-457a-9bd0-8d6239c40486&#xA;Terminate run 6558e882-c2a2-457a-9bd0-8d6239c40486&#xA;Deleting run 6558e882-c2a2-457a-9bd0-8d6239c40486&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=746f04ea-316e-4dde-821c-c0208c4414d9 (cascade=true)&#xA;Pipeline with id=746f04ea-316e-4dde-821c-c0208c4414d9, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/16/26 11:28:49.164 (91ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/16/26 11:28:49.164&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/16/26 11:28:49.164 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/16/26 11:28:49.164&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/16/26 11:28:49.164 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload essential/component_with_pip_index_urls.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="75.717364166">
              <system-out>2026/07/16 11:27:04 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/16/26 11:25:48.36&#xA;Create an experiment with name E2EExperiment-1784201148360389063&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/16/26 11:25:48.538 (178ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/16/26 11:25:48.538&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x2fd562450400&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/16/26 11:25:48.581 (43ms)&#xA;&gt; Enter [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/16/26 11:25:48.581&#xA;Uploading pipeline file essential/component_with_pip_index_urls.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1784201148538976780, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml&#xA;Upload of pipeline file &#39;essential/component_with_pip_index_urls.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 02a9493d-189a-4149-b887-2303e7059441&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;02a9493d-189a-4149-b887-2303e7059441&#39; and name: &#39;e2e-test-1784201148538976780&#39;&#xA;Create a pipeline run for pipeline with id=02a9493d-189a-4149-b887-2303e7059441 and versionId=6433fcff-a483-4617-8df7-c2534950bb3e&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=9cb86eae-9afa-44fa-b222-c0259cc6b7f6&#xA;Created Pipeline Run with id: 9cb86eae-9afa-44fa-b222-c0259cc6b7f6 for pipeline with id: 02a9493d-189a-4149-b887-2303e7059441&#xA;Waiting for pipeline run with id=9cb86eae-9afa-44fa-b222-c0259cc6b7f6 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=9cb86eae-9afa-44fa-b222-c0259cc6b7f6&#xA;Pipeline run with id=9cb86eae-9afa-44fa-b222-c0259cc6b7f6 is in PENDING state, waiting...&#xA;Get a pipeline run with id=9cb86eae-9afa-44fa-b222-c0259cc6b7f6&#xA;Pipeline run with id=9cb86eae-9afa-44fa-b222-c0259cc6b7f6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9cb86eae-9afa-44fa-b222-c0259cc6b7f6&#xA;Pipeline run with id=9cb86eae-9afa-44fa-b222-c0259cc6b7f6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9cb86eae-9afa-44fa-b222-c0259cc6b7f6&#xA;Pipeline run with id=9cb86eae-9afa-44fa-b222-c0259cc6b7f6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9cb86eae-9afa-44fa-b222-c0259cc6b7f6&#xA;Pipeline run with id=9cb86eae-9afa-44fa-b222-c0259cc6b7f6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9cb86eae-9afa-44fa-b222-c0259cc6b7f6&#xA;Pipeline run with id=9cb86eae-9afa-44fa-b222-c0259cc6b7f6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9cb86eae-9afa-44fa-b222-c0259cc6b7f6&#xA;Pipeline run with id=9cb86eae-9afa-44fa-b222-c0259cc6b7f6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9cb86eae-9afa-44fa-b222-c0259cc6b7f6&#xA;Pipeline run with id=9cb86eae-9afa-44fa-b222-c0259cc6b7f6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9cb86eae-9afa-44fa-b222-c0259cc6b7f6&#xA;Pipeline run with id=9cb86eae-9afa-44fa-b222-c0259cc6b7f6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9cb86eae-9afa-44fa-b222-c0259cc6b7f6&#xA;Pipeline run with id=9cb86eae-9afa-44fa-b222-c0259cc6b7f6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9cb86eae-9afa-44fa-b222-c0259cc6b7f6&#xA;Pipeline run with id=9cb86eae-9afa-44fa-b222-c0259cc6b7f6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9cb86eae-9afa-44fa-b222-c0259cc6b7f6&#xA;Pipeline run with id=9cb86eae-9afa-44fa-b222-c0259cc6b7f6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9cb86eae-9afa-44fa-b222-c0259cc6b7f6&#xA;Pipeline run with id=9cb86eae-9afa-44fa-b222-c0259cc6b7f6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9cb86eae-9afa-44fa-b222-c0259cc6b7f6&#xA;Pipeline run with id=9cb86eae-9afa-44fa-b222-c0259cc6b7f6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9cb86eae-9afa-44fa-b222-c0259cc6b7f6&#xA;Pipeline run with id=9cb86eae-9afa-44fa-b222-c0259cc6b7f6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9cb86eae-9afa-44fa-b222-c0259cc6b7f6&#xA;Pipeline run with id=9cb86eae-9afa-44fa-b222-c0259cc6b7f6 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;essential/component_with_pip_index_urls.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=9cb86eae-9afa-44fa-b222-c0259cc6b7f6&#xA;Get a pipeline run with id=9cb86eae-9afa-44fa-b222-c0259cc6b7f6&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/16/26 11:27:03.989 (1m15.408s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/16/26 11:27:03.989&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 9cb86eae-9afa-44fa-b222-c0259cc6b7f6&#xA;Failed to terminate run 9cb86eae-9afa-44fa-b222-c0259cc6b7f6&#xA;Terminate run 9cb86eae-9afa-44fa-b222-c0259cc6b7f6&#xA;Deleting run 9cb86eae-9afa-44fa-b222-c0259cc6b7f6&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=02a9493d-189a-4149-b887-2303e7059441 (cascade=true)&#xA;Pipeline with id=02a9493d-189a-4149-b887-2303e7059441, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/16/26 11:27:04.077 (88ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/16/26 11:27:04.078&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/16/26 11:27:04.078 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/16/26 11:27:04.078&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/16/26 11:27:04.078 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/parallel_for_after_dependency.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="115.816153851">
              <system-out>2026/07/16 11:27:44 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/16/26 11:25:48.359&#xA;Create an experiment with name E2EExperiment-1784201148360008423&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/16/26 11:25:48.538 (179ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/16/26 11:25:48.538&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x138009780f80&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/16/26 11:25:48.58 (41ms)&#xA;&gt; Enter [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/16/26 11:25:48.58&#xA;Uploading pipeline file critical/parallel_for_after_dependency.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1784201148538993780, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml&#xA;Upload of pipeline file &#39;critical/parallel_for_after_dependency.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 2c3f4ec6-5922-4014-b321-bcc3d48cb4bb&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;2c3f4ec6-5922-4014-b321-bcc3d48cb4bb&#39; and name: &#39;e2e-test-1784201148538993780&#39;&#xA;Create a pipeline run for pipeline with id=2c3f4ec6-5922-4014-b321-bcc3d48cb4bb and versionId=81c83583-b668-4752-af76-a7e49406e2b1&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=0d8b992e-4d69-4d8e-8c84-01295fe527d9&#xA;Created Pipeline Run with id: 0d8b992e-4d69-4d8e-8c84-01295fe527d9 for pipeline with id: 2c3f4ec6-5922-4014-b321-bcc3d48cb4bb&#xA;Waiting for pipeline run with id=0d8b992e-4d69-4d8e-8c84-01295fe527d9 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=0d8b992e-4d69-4d8e-8c84-01295fe527d9&#xA;Pipeline run with id=0d8b992e-4d69-4d8e-8c84-01295fe527d9 is in PENDING state, waiting...&#xA;Get a pipeline run with id=0d8b992e-4d69-4d8e-8c84-01295fe527d9&#xA;Pipeline run with id=0d8b992e-4d69-4d8e-8c84-01295fe527d9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0d8b992e-4d69-4d8e-8c84-01295fe527d9&#xA;Pipeline run with id=0d8b992e-4d69-4d8e-8c84-01295fe527d9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0d8b992e-4d69-4d8e-8c84-01295fe527d9&#xA;Pipeline run with id=0d8b992e-4d69-4d8e-8c84-01295fe527d9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0d8b992e-4d69-4d8e-8c84-01295fe527d9&#xA;Pipeline run with id=0d8b992e-4d69-4d8e-8c84-01295fe527d9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0d8b992e-4d69-4d8e-8c84-01295fe527d9&#xA;Pipeline run with id=0d8b992e-4d69-4d8e-8c84-01295fe527d9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0d8b992e-4d69-4d8e-8c84-01295fe527d9&#xA;Pipeline run with id=0d8b992e-4d69-4d8e-8c84-01295fe527d9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0d8b992e-4d69-4d8e-8c84-01295fe527d9&#xA;Pipeline run with id=0d8b992e-4d69-4d8e-8c84-01295fe527d9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0d8b992e-4d69-4d8e-8c84-01295fe527d9&#xA;Pipeline run with id=0d8b992e-4d69-4d8e-8c84-01295fe527d9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0d8b992e-4d69-4d8e-8c84-01295fe527d9&#xA;Pipeline run with id=0d8b992e-4d69-4d8e-8c84-01295fe527d9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0d8b992e-4d69-4d8e-8c84-01295fe527d9&#xA;Pipeline run with id=0d8b992e-4d69-4d8e-8c84-01295fe527d9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0d8b992e-4d69-4d8e-8c84-01295fe527d9&#xA;Pipeline run with id=0d8b992e-4d69-4d8e-8c84-01295fe527d9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0d8b992e-4d69-4d8e-8c84-01295fe527d9&#xA;Pipeline run with id=0d8b992e-4d69-4d8e-8c84-01295fe527d9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0d8b992e-4d69-4d8e-8c84-01295fe527d9&#xA;Pipeline run with id=0d8b992e-4d69-4d8e-8c84-01295fe527d9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0d8b992e-4d69-4d8e-8c84-01295fe527d9&#xA;Pipeline run with id=0d8b992e-4d69-4d8e-8c84-01295fe527d9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0d8b992e-4d69-4d8e-8c84-01295fe527d9&#xA;Pipeline run with id=0d8b992e-4d69-4d8e-8c84-01295fe527d9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0d8b992e-4d69-4d8e-8c84-01295fe527d9&#xA;Pipeline run with id=0d8b992e-4d69-4d8e-8c84-01295fe527d9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0d8b992e-4d69-4d8e-8c84-01295fe527d9&#xA;Pipeline run with id=0d8b992e-4d69-4d8e-8c84-01295fe527d9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0d8b992e-4d69-4d8e-8c84-01295fe527d9&#xA;Pipeline run with id=0d8b992e-4d69-4d8e-8c84-01295fe527d9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0d8b992e-4d69-4d8e-8c84-01295fe527d9&#xA;Pipeline run with id=0d8b992e-4d69-4d8e-8c84-01295fe527d9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0d8b992e-4d69-4d8e-8c84-01295fe527d9&#xA;Pipeline run with id=0d8b992e-4d69-4d8e-8c84-01295fe527d9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0d8b992e-4d69-4d8e-8c84-01295fe527d9&#xA;Pipeline run with id=0d8b992e-4d69-4d8e-8c84-01295fe527d9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0d8b992e-4d69-4d8e-8c84-01295fe527d9&#xA;Pipeline run with id=0d8b992e-4d69-4d8e-8c84-01295fe527d9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0d8b992e-4d69-4d8e-8c84-01295fe527d9&#xA;Pipeline run with id=0d8b992e-4d69-4d8e-8c84-01295fe527d9 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/parallel_for_after_dependency.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=0d8b992e-4d69-4d8e-8c84-01295fe527d9&#xA;Get a pipeline run with id=0d8b992e-4d69-4d8e-8c84-01295fe527d9&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/16/26 11:27:44.019 (1m55.439s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/16/26 11:27:44.019&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 0d8b992e-4d69-4d8e-8c84-01295fe527d9&#xA;Failed to terminate run 0d8b992e-4d69-4d8e-8c84-01295fe527d9&#xA;Terminate run 0d8b992e-4d69-4d8e-8c84-01295fe527d9&#xA;Deleting run 0d8b992e-4d69-4d8e-8c84-01295fe527d9&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=2c3f4ec6-5922-4014-b321-bcc3d48cb4bb (cascade=true)&#xA;Pipeline with id=2c3f4ec6-5922-4014-b321-bcc3d48cb4bb, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/16/26 11:27:44.175 (156ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/16/26 11:27:44.176&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/16/26 11:27:44.176 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/16/26 11:27:44.176&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/16/26 11:27:44.176 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/pipeline_with_artifact_upload_download.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="125.759491943">
              <system-out>2026/07/16 11:27:54 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/16/26 11:25:48.36&#xA;Create an experiment with name E2EExperiment-1784201148360291331&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/16/26 11:25:48.538 (178ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/16/26 11:25:48.538&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x2df32440e780&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/16/26 11:25:48.581 (43ms)&#xA;&gt; Enter [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/16/26 11:25:48.581&#xA;Uploading pipeline file critical/pipeline_with_artifact_upload_download.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1784201148538769064, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml&#xA;Upload of pipeline file &#39;critical/pipeline_with_artifact_upload_download.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 23990572-5c31-4d51-ade3-54f846d673db&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;23990572-5c31-4d51-ade3-54f846d673db&#39; and name: &#39;e2e-test-1784201148538769064&#39;&#xA;Create a pipeline run for pipeline with id=23990572-5c31-4d51-ade3-54f846d673db and versionId=4123ff87-4ec8-49b7-83cf-c7d1764070d8&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=95f692ca-827e-4b5c-9646-7ac2fba7e091&#xA;Created Pipeline Run with id: 95f692ca-827e-4b5c-9646-7ac2fba7e091 for pipeline with id: 23990572-5c31-4d51-ade3-54f846d673db&#xA;Waiting for pipeline run with id=95f692ca-827e-4b5c-9646-7ac2fba7e091 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=95f692ca-827e-4b5c-9646-7ac2fba7e091&#xA;Pipeline run with id=95f692ca-827e-4b5c-9646-7ac2fba7e091 is in PENDING state, waiting...&#xA;Get a pipeline run with id=95f692ca-827e-4b5c-9646-7ac2fba7e091&#xA;Pipeline run with id=95f692ca-827e-4b5c-9646-7ac2fba7e091 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=95f692ca-827e-4b5c-9646-7ac2fba7e091&#xA;Pipeline run with id=95f692ca-827e-4b5c-9646-7ac2fba7e091 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=95f692ca-827e-4b5c-9646-7ac2fba7e091&#xA;Pipeline run with id=95f692ca-827e-4b5c-9646-7ac2fba7e091 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=95f692ca-827e-4b5c-9646-7ac2fba7e091&#xA;Pipeline run with id=95f692ca-827e-4b5c-9646-7ac2fba7e091 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=95f692ca-827e-4b5c-9646-7ac2fba7e091&#xA;Pipeline run with id=95f692ca-827e-4b5c-9646-7ac2fba7e091 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=95f692ca-827e-4b5c-9646-7ac2fba7e091&#xA;Pipeline run with id=95f692ca-827e-4b5c-9646-7ac2fba7e091 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=95f692ca-827e-4b5c-9646-7ac2fba7e091&#xA;Pipeline run with id=95f692ca-827e-4b5c-9646-7ac2fba7e091 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=95f692ca-827e-4b5c-9646-7ac2fba7e091&#xA;Pipeline run with id=95f692ca-827e-4b5c-9646-7ac2fba7e091 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=95f692ca-827e-4b5c-9646-7ac2fba7e091&#xA;Pipeline run with id=95f692ca-827e-4b5c-9646-7ac2fba7e091 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=95f692ca-827e-4b5c-9646-7ac2fba7e091&#xA;Pipeline run with id=95f692ca-827e-4b5c-9646-7ac2fba7e091 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=95f692ca-827e-4b5c-9646-7ac2fba7e091&#xA;Pipeline run with id=95f692ca-827e-4b5c-9646-7ac2fba7e091 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=95f692ca-827e-4b5c-9646-7ac2fba7e091&#xA;Pipeline run with id=95f692ca-827e-4b5c-9646-7ac2fba7e091 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=95f692ca-827e-4b5c-9646-7ac2fba7e091&#xA;Pipeline run with id=95f692ca-827e-4b5c-9646-7ac2fba7e091 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=95f692ca-827e-4b5c-9646-7ac2fba7e091&#xA;Pipeline run with id=95f692ca-827e-4b5c-9646-7ac2fba7e091 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=95f692ca-827e-4b5c-9646-7ac2fba7e091&#xA;Pipeline run with id=95f692ca-827e-4b5c-9646-7ac2fba7e091 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=95f692ca-827e-4b5c-9646-7ac2fba7e091&#xA;Pipeline run with id=95f692ca-827e-4b5c-9646-7ac2fba7e091 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=95f692ca-827e-4b5c-9646-7ac2fba7e091&#xA;Pipeline run with id=95f692ca-827e-4b5c-9646-7ac2fba7e091 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=95f692ca-827e-4b5c-9646-7ac2fba7e091&#xA;Pipeline run with id=95f692ca-827e-4b5c-9646-7ac2fba7e091 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=95f692ca-827e-4b5c-9646-7ac2fba7e091&#xA;Pipeline run with id=95f692ca-827e-4b5c-9646-7ac2fba7e091 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=95f692ca-827e-4b5c-9646-7ac2fba7e091&#xA;Pipeline run with id=95f692ca-827e-4b5c-9646-7ac2fba7e091 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=95f692ca-827e-4b5c-9646-7ac2fba7e091&#xA;Pipeline run with id=95f692ca-827e-4b5c-9646-7ac2fba7e091 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=95f692ca-827e-4b5c-9646-7ac2fba7e091&#xA;Pipeline run with id=95f692ca-827e-4b5c-9646-7ac2fba7e091 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=95f692ca-827e-4b5c-9646-7ac2fba7e091&#xA;Pipeline run with id=95f692ca-827e-4b5c-9646-7ac2fba7e091 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=95f692ca-827e-4b5c-9646-7ac2fba7e091&#xA;Pipeline run with id=95f692ca-827e-4b5c-9646-7ac2fba7e091 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=95f692ca-827e-4b5c-9646-7ac2fba7e091&#xA;Pipeline run with id=95f692ca-827e-4b5c-9646-7ac2fba7e091 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/pipeline_with_artifact_upload_download.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=95f692ca-827e-4b5c-9646-7ac2fba7e091&#xA;Get a pipeline run with id=95f692ca-827e-4b5c-9646-7ac2fba7e091&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/16/26 11:27:54.021 (2m5.44s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/16/26 11:27:54.021&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 95f692ca-827e-4b5c-9646-7ac2fba7e091&#xA;Failed to terminate run 95f692ca-827e-4b5c-9646-7ac2fba7e091&#xA;Terminate run 95f692ca-827e-4b5c-9646-7ac2fba7e091&#xA;Deleting run 95f692ca-827e-4b5c-9646-7ac2fba7e091&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=23990572-5c31-4d51-ade3-54f846d673db (cascade=true)&#xA;Pipeline with id=23990572-5c31-4d51-ade3-54f846d673db, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/16/26 11:27:54.119 (98ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/16/26 11:27:54.12&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/16/26 11:27:54.12 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/16/26 11:27:54.12&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/16/26 11:27:54.12 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/flip_coin.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="160.86907314">
              <system-out>2026/07/16 11:28:29 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/16/26 11:25:48.359&#xA;Create an experiment with name E2EExperiment-1784201148359757317&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/16/26 11:25:48.538 (179ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/16/26 11:25:48.538&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x3ff1d20b4f80&#xA;test-secret-1 created&#xA;test-secret-2 created&#xA;test-secret-3 created&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/16/26 11:25:48.566 (28ms)&#xA;&gt; Enter [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/16/26 11:25:48.566&#xA;Uploading pipeline file critical/flip_coin.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1784201148538800125, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml&#xA;Upload of pipeline file &#39;critical/flip_coin.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 9283e1b1-987e-499e-86e8-e69a6b976327&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;9283e1b1-987e-499e-86e8-e69a6b976327&#39; and name: &#39;e2e-test-1784201148538800125&#39;&#xA;Create a pipeline run for pipeline with id=9283e1b1-987e-499e-86e8-e69a6b976327 and versionId=4050dad0-4bd4-472f-ba3e-5ed1e73df9ea&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=c3d7654f-e553-4964-94bb-7db3bc6f7447&#xA;Created Pipeline Run with id: c3d7654f-e553-4964-94bb-7db3bc6f7447 for pipeline with id: 9283e1b1-987e-499e-86e8-e69a6b976327&#xA;Waiting for pipeline run with id=c3d7654f-e553-4964-94bb-7db3bc6f7447 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=c3d7654f-e553-4964-94bb-7db3bc6f7447&#xA;Pipeline run with id=c3d7654f-e553-4964-94bb-7db3bc6f7447 is in PENDING state, waiting...&#xA;Get a pipeline run with id=c3d7654f-e553-4964-94bb-7db3bc6f7447&#xA;Pipeline run with id=c3d7654f-e553-4964-94bb-7db3bc6f7447 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c3d7654f-e553-4964-94bb-7db3bc6f7447&#xA;Pipeline run with id=c3d7654f-e553-4964-94bb-7db3bc6f7447 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c3d7654f-e553-4964-94bb-7db3bc6f7447&#xA;Pipeline run with id=c3d7654f-e553-4964-94bb-7db3bc6f7447 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c3d7654f-e553-4964-94bb-7db3bc6f7447&#xA;Pipeline run with id=c3d7654f-e553-4964-94bb-7db3bc6f7447 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c3d7654f-e553-4964-94bb-7db3bc6f7447&#xA;Pipeline run with id=c3d7654f-e553-4964-94bb-7db3bc6f7447 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c3d7654f-e553-4964-94bb-7db3bc6f7447&#xA;Pipeline run with id=c3d7654f-e553-4964-94bb-7db3bc6f7447 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c3d7654f-e553-4964-94bb-7db3bc6f7447&#xA;Pipeline run with id=c3d7654f-e553-4964-94bb-7db3bc6f7447 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c3d7654f-e553-4964-94bb-7db3bc6f7447&#xA;Pipeline run with id=c3d7654f-e553-4964-94bb-7db3bc6f7447 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c3d7654f-e553-4964-94bb-7db3bc6f7447&#xA;Pipeline run with id=c3d7654f-e553-4964-94bb-7db3bc6f7447 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c3d7654f-e553-4964-94bb-7db3bc6f7447&#xA;Pipeline run with id=c3d7654f-e553-4964-94bb-7db3bc6f7447 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c3d7654f-e553-4964-94bb-7db3bc6f7447&#xA;Pipeline run with id=c3d7654f-e553-4964-94bb-7db3bc6f7447 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c3d7654f-e553-4964-94bb-7db3bc6f7447&#xA;Pipeline run with id=c3d7654f-e553-4964-94bb-7db3bc6f7447 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c3d7654f-e553-4964-94bb-7db3bc6f7447&#xA;Pipeline run with id=c3d7654f-e553-4964-94bb-7db3bc6f7447 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c3d7654f-e553-4964-94bb-7db3bc6f7447&#xA;Pipeline run with id=c3d7654f-e553-4964-94bb-7db3bc6f7447 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c3d7654f-e553-4964-94bb-7db3bc6f7447&#xA;Pipeline run with id=c3d7654f-e553-4964-94bb-7db3bc6f7447 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c3d7654f-e553-4964-94bb-7db3bc6f7447&#xA;Pipeline run with id=c3d7654f-e553-4964-94bb-7db3bc6f7447 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c3d7654f-e553-4964-94bb-7db3bc6f7447&#xA;Pipeline run with id=c3d7654f-e553-4964-94bb-7db3bc6f7447 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c3d7654f-e553-4964-94bb-7db3bc6f7447&#xA;Pipeline run with id=c3d7654f-e553-4964-94bb-7db3bc6f7447 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c3d7654f-e553-4964-94bb-7db3bc6f7447&#xA;Pipeline run with id=c3d7654f-e553-4964-94bb-7db3bc6f7447 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c3d7654f-e553-4964-94bb-7db3bc6f7447&#xA;Pipeline run with id=c3d7654f-e553-4964-94bb-7db3bc6f7447 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c3d7654f-e553-4964-94bb-7db3bc6f7447&#xA;Pipeline run with id=c3d7654f-e553-4964-94bb-7db3bc6f7447 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c3d7654f-e553-4964-94bb-7db3bc6f7447&#xA;Pipeline run with id=c3d7654f-e553-4964-94bb-7db3bc6f7447 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c3d7654f-e553-4964-94bb-7db3bc6f7447&#xA;Pipeline run with id=c3d7654f-e553-4964-94bb-7db3bc6f7447 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c3d7654f-e553-4964-94bb-7db3bc6f7447&#xA;Pipeline run with id=c3d7654f-e553-4964-94bb-7db3bc6f7447 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c3d7654f-e553-4964-94bb-7db3bc6f7447&#xA;Pipeline run with id=c3d7654f-e553-4964-94bb-7db3bc6f7447 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c3d7654f-e553-4964-94bb-7db3bc6f7447&#xA;Pipeline run with id=c3d7654f-e553-4964-94bb-7db3bc6f7447 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c3d7654f-e553-4964-94bb-7db3bc6f7447&#xA;Pipeline run with id=c3d7654f-e553-4964-94bb-7db3bc6f7447 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c3d7654f-e553-4964-94bb-7db3bc6f7447&#xA;Pipeline run with id=c3d7654f-e553-4964-94bb-7db3bc6f7447 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c3d7654f-e553-4964-94bb-7db3bc6f7447&#xA;Pipeline run with id=c3d7654f-e553-4964-94bb-7db3bc6f7447 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c3d7654f-e553-4964-94bb-7db3bc6f7447&#xA;Pipeline run with id=c3d7654f-e553-4964-94bb-7db3bc6f7447 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c3d7654f-e553-4964-94bb-7db3bc6f7447&#xA;Pipeline run with id=c3d7654f-e553-4964-94bb-7db3bc6f7447 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c3d7654f-e553-4964-94bb-7db3bc6f7447&#xA;Pipeline run with id=c3d7654f-e553-4964-94bb-7db3bc6f7447 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/flip_coin.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=c3d7654f-e553-4964-94bb-7db3bc6f7447&#xA;Get a pipeline run with id=c3d7654f-e553-4964-94bb-7db3bc6f7447&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/16/26 11:28:29.081 (2m40.515s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/16/26 11:28:29.081&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run c3d7654f-e553-4964-94bb-7db3bc6f7447&#xA;Failed to terminate run c3d7654f-e553-4964-94bb-7db3bc6f7447&#xA;Terminate run c3d7654f-e553-4964-94bb-7db3bc6f7447&#xA;Deleting run c3d7654f-e553-4964-94bb-7db3bc6f7447&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=9283e1b1-987e-499e-86e8-e69a6b976327 (cascade=true)&#xA;Pipeline with id=9283e1b1-987e-499e-86e8-e69a6b976327, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/16/26 11:28:29.228 (147ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/16/26 11:28:29.228&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/16/26 11:28:29.228 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/16/26 11:28:29.228&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/16/26 11:28:29.228 (0s)&#xA;</system-err>
          </testcase>
      </testsuite>
  </testsuites>