<?xml version="1.0" encoding="UTF-8"?>
  <testsuites tests="5" disabled="0" errors="0" failures="0" time="183.721078357">
      <testsuite name="AIPipelinesE2ETests" package="/dspa/backend/test/end2end" tests="5" disabled="0" skipped="0" errors="0" failures="0" time="183.721078357" timestamp="2026-07-15T11:56:44">
          <properties>
              <property name="SuiteSucceeded" value="true"></property>
              <property name="SuiteHasProgrammaticFocus" value="false"></property>
              <property name="SpecialSuiteFailureReason" value=""></property>
              <property name="SuiteLabels" value="[]"></property>
              <property name="SuiteSemVerConstraints" value="[]"></property>
              <property name="RandomSeed" value="1784116438"></property>
              <property name="RandomizeAllSpecs" value="false"></property>
              <property name="LabelFilter" value="Smoke"></property>
              <property name="SemVerFilter" value=""></property>
              <property name="FocusStrings" value=""></property>
              <property name="SkipStrings" value=""></property>
              <property name="FocusFiles" value=""></property>
              <property name="SkipFiles" value=""></property>
              <property name="FailOnPending" value="false"></property>
              <property name="FailOnEmpty" value="false"></property>
              <property name="FailFast" value="false"></property>
              <property name="FlakeAttempts" value="0"></property>
              <property name="DryRun" value="false"></property>
              <property name="ParallelTotal" value="10"></property>
              <property name="OutputInterceptorMode" value=""></property>
          </properties>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload essential/component_with_pip_index_urls.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="76.142663017">
              <system-out>2026/07/15 11:58:00 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/15/26 11:56:44.533&#xA;Create an experiment with name E2EExperiment-1784116604533749939&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/15/26 11:56:44.835 (301ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/15/26 11:56:44.835&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0xe23fd660280&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/15/26 11:56:45.017 (182ms)&#xA;&gt; Enter [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/15/26 11:56:45.017&#xA;Uploading pipeline file essential/component_with_pip_index_urls.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1784116604835248848, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml&#xA;Upload of pipeline file &#39;essential/component_with_pip_index_urls.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 90c2ec04-eb04-47a4-bdb5-d298becc8847&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;90c2ec04-eb04-47a4-bdb5-d298becc8847&#39; and name: &#39;e2e-test-1784116604835248848&#39;&#xA;Create a pipeline run for pipeline with id=90c2ec04-eb04-47a4-bdb5-d298becc8847 and versionId=c6f06083-bc4b-4bc5-a953-5afb252c9bff&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=91c22ee5-b41c-4daa-9a75-43d742768a7e&#xA;Created Pipeline Run with id: 91c22ee5-b41c-4daa-9a75-43d742768a7e for pipeline with id: 90c2ec04-eb04-47a4-bdb5-d298becc8847&#xA;Waiting for pipeline run with id=91c22ee5-b41c-4daa-9a75-43d742768a7e to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=91c22ee5-b41c-4daa-9a75-43d742768a7e&#xA;Pipeline run with id=91c22ee5-b41c-4daa-9a75-43d742768a7e is in PENDING state, waiting...&#xA;Get a pipeline run with id=91c22ee5-b41c-4daa-9a75-43d742768a7e&#xA;Pipeline run with id=91c22ee5-b41c-4daa-9a75-43d742768a7e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=91c22ee5-b41c-4daa-9a75-43d742768a7e&#xA;Pipeline run with id=91c22ee5-b41c-4daa-9a75-43d742768a7e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=91c22ee5-b41c-4daa-9a75-43d742768a7e&#xA;Pipeline run with id=91c22ee5-b41c-4daa-9a75-43d742768a7e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=91c22ee5-b41c-4daa-9a75-43d742768a7e&#xA;Pipeline run with id=91c22ee5-b41c-4daa-9a75-43d742768a7e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=91c22ee5-b41c-4daa-9a75-43d742768a7e&#xA;Pipeline run with id=91c22ee5-b41c-4daa-9a75-43d742768a7e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=91c22ee5-b41c-4daa-9a75-43d742768a7e&#xA;Pipeline run with id=91c22ee5-b41c-4daa-9a75-43d742768a7e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=91c22ee5-b41c-4daa-9a75-43d742768a7e&#xA;Pipeline run with id=91c22ee5-b41c-4daa-9a75-43d742768a7e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=91c22ee5-b41c-4daa-9a75-43d742768a7e&#xA;Pipeline run with id=91c22ee5-b41c-4daa-9a75-43d742768a7e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=91c22ee5-b41c-4daa-9a75-43d742768a7e&#xA;Pipeline run with id=91c22ee5-b41c-4daa-9a75-43d742768a7e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=91c22ee5-b41c-4daa-9a75-43d742768a7e&#xA;Pipeline run with id=91c22ee5-b41c-4daa-9a75-43d742768a7e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=91c22ee5-b41c-4daa-9a75-43d742768a7e&#xA;Pipeline run with id=91c22ee5-b41c-4daa-9a75-43d742768a7e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=91c22ee5-b41c-4daa-9a75-43d742768a7e&#xA;Pipeline run with id=91c22ee5-b41c-4daa-9a75-43d742768a7e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=91c22ee5-b41c-4daa-9a75-43d742768a7e&#xA;Pipeline run with id=91c22ee5-b41c-4daa-9a75-43d742768a7e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=91c22ee5-b41c-4daa-9a75-43d742768a7e&#xA;Pipeline run with id=91c22ee5-b41c-4daa-9a75-43d742768a7e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=91c22ee5-b41c-4daa-9a75-43d742768a7e&#xA;Pipeline run with id=91c22ee5-b41c-4daa-9a75-43d742768a7e reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;essential/component_with_pip_index_urls.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=91c22ee5-b41c-4daa-9a75-43d742768a7e&#xA;Get a pipeline run with id=91c22ee5-b41c-4daa-9a75-43d742768a7e&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/15/26 11:58:00.434 (1m15.418s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/15/26 11:58:00.435&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 91c22ee5-b41c-4daa-9a75-43d742768a7e&#xA;Failed to terminate run 91c22ee5-b41c-4daa-9a75-43d742768a7e&#xA;Terminate run 91c22ee5-b41c-4daa-9a75-43d742768a7e&#xA;Deleting run 91c22ee5-b41c-4daa-9a75-43d742768a7e&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=90c2ec04-eb04-47a4-bdb5-d298becc8847 (cascade=true)&#xA;Pipeline with id=90c2ec04-eb04-47a4-bdb5-d298becc8847, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/15/26 11:58:00.676 (241ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/15/26 11:58:00.676&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/15/26 11:58:00.676 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/15/26 11:58:00.676&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/15/26 11:58:00.676 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/parallel_for_after_dependency.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="125.867985062">
              <system-out>2026/07/15 11:58:50 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/15/26 11:56:44.531&#xA;Create an experiment with name E2EExperiment-1784116604531837095&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/15/26 11:56:44.712 (181ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/15/26 11:56:44.712&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x4d20ab10d00&#xA;test-secret-1 created&#xA;test-secret-2 created&#xA;test-secret-3 created&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/15/26 11:56:44.77 (58ms)&#xA;&gt; Enter [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/15/26 11:56:44.77&#xA;Uploading pipeline file critical/parallel_for_after_dependency.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1784116604712733132, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml&#xA;Upload of pipeline file &#39;critical/parallel_for_after_dependency.yaml&#39; successful&#xA;Listing pipeline versions for pipeline e85ada97-8a2d-4ea8-9279-c93ee4360904&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;e85ada97-8a2d-4ea8-9279-c93ee4360904&#39; and name: &#39;e2e-test-1784116604712733132&#39;&#xA;Create a pipeline run for pipeline with id=e85ada97-8a2d-4ea8-9279-c93ee4360904 and versionId=ea2e033e-9c14-4bdd-a736-9d0167a6721d&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=de92a30c-0a71-4bd1-b6ab-7f2b565ebcd2&#xA;Created Pipeline Run with id: de92a30c-0a71-4bd1-b6ab-7f2b565ebcd2 for pipeline with id: e85ada97-8a2d-4ea8-9279-c93ee4360904&#xA;Waiting for pipeline run with id=de92a30c-0a71-4bd1-b6ab-7f2b565ebcd2 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=de92a30c-0a71-4bd1-b6ab-7f2b565ebcd2&#xA;Pipeline run with id=de92a30c-0a71-4bd1-b6ab-7f2b565ebcd2 is in PENDING state, waiting...&#xA;Get a pipeline run with id=de92a30c-0a71-4bd1-b6ab-7f2b565ebcd2&#xA;Pipeline run with id=de92a30c-0a71-4bd1-b6ab-7f2b565ebcd2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=de92a30c-0a71-4bd1-b6ab-7f2b565ebcd2&#xA;Pipeline run with id=de92a30c-0a71-4bd1-b6ab-7f2b565ebcd2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=de92a30c-0a71-4bd1-b6ab-7f2b565ebcd2&#xA;Pipeline run with id=de92a30c-0a71-4bd1-b6ab-7f2b565ebcd2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=de92a30c-0a71-4bd1-b6ab-7f2b565ebcd2&#xA;Pipeline run with id=de92a30c-0a71-4bd1-b6ab-7f2b565ebcd2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=de92a30c-0a71-4bd1-b6ab-7f2b565ebcd2&#xA;Pipeline run with id=de92a30c-0a71-4bd1-b6ab-7f2b565ebcd2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=de92a30c-0a71-4bd1-b6ab-7f2b565ebcd2&#xA;Pipeline run with id=de92a30c-0a71-4bd1-b6ab-7f2b565ebcd2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=de92a30c-0a71-4bd1-b6ab-7f2b565ebcd2&#xA;Pipeline run with id=de92a30c-0a71-4bd1-b6ab-7f2b565ebcd2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=de92a30c-0a71-4bd1-b6ab-7f2b565ebcd2&#xA;Pipeline run with id=de92a30c-0a71-4bd1-b6ab-7f2b565ebcd2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=de92a30c-0a71-4bd1-b6ab-7f2b565ebcd2&#xA;Pipeline run with id=de92a30c-0a71-4bd1-b6ab-7f2b565ebcd2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=de92a30c-0a71-4bd1-b6ab-7f2b565ebcd2&#xA;Pipeline run with id=de92a30c-0a71-4bd1-b6ab-7f2b565ebcd2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=de92a30c-0a71-4bd1-b6ab-7f2b565ebcd2&#xA;Pipeline run with id=de92a30c-0a71-4bd1-b6ab-7f2b565ebcd2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=de92a30c-0a71-4bd1-b6ab-7f2b565ebcd2&#xA;Pipeline run with id=de92a30c-0a71-4bd1-b6ab-7f2b565ebcd2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=de92a30c-0a71-4bd1-b6ab-7f2b565ebcd2&#xA;Pipeline run with id=de92a30c-0a71-4bd1-b6ab-7f2b565ebcd2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=de92a30c-0a71-4bd1-b6ab-7f2b565ebcd2&#xA;Pipeline run with id=de92a30c-0a71-4bd1-b6ab-7f2b565ebcd2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=de92a30c-0a71-4bd1-b6ab-7f2b565ebcd2&#xA;Pipeline run with id=de92a30c-0a71-4bd1-b6ab-7f2b565ebcd2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=de92a30c-0a71-4bd1-b6ab-7f2b565ebcd2&#xA;Pipeline run with id=de92a30c-0a71-4bd1-b6ab-7f2b565ebcd2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=de92a30c-0a71-4bd1-b6ab-7f2b565ebcd2&#xA;Pipeline run with id=de92a30c-0a71-4bd1-b6ab-7f2b565ebcd2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=de92a30c-0a71-4bd1-b6ab-7f2b565ebcd2&#xA;Pipeline run with id=de92a30c-0a71-4bd1-b6ab-7f2b565ebcd2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=de92a30c-0a71-4bd1-b6ab-7f2b565ebcd2&#xA;Pipeline run with id=de92a30c-0a71-4bd1-b6ab-7f2b565ebcd2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=de92a30c-0a71-4bd1-b6ab-7f2b565ebcd2&#xA;Pipeline run with id=de92a30c-0a71-4bd1-b6ab-7f2b565ebcd2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=de92a30c-0a71-4bd1-b6ab-7f2b565ebcd2&#xA;Pipeline run with id=de92a30c-0a71-4bd1-b6ab-7f2b565ebcd2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=de92a30c-0a71-4bd1-b6ab-7f2b565ebcd2&#xA;Pipeline run with id=de92a30c-0a71-4bd1-b6ab-7f2b565ebcd2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=de92a30c-0a71-4bd1-b6ab-7f2b565ebcd2&#xA;Pipeline run with id=de92a30c-0a71-4bd1-b6ab-7f2b565ebcd2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=de92a30c-0a71-4bd1-b6ab-7f2b565ebcd2&#xA;Pipeline run with id=de92a30c-0a71-4bd1-b6ab-7f2b565ebcd2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=de92a30c-0a71-4bd1-b6ab-7f2b565ebcd2&#xA;Pipeline run with id=de92a30c-0a71-4bd1-b6ab-7f2b565ebcd2 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/parallel_for_after_dependency.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=de92a30c-0a71-4bd1-b6ab-7f2b565ebcd2&#xA;Get a pipeline run with id=de92a30c-0a71-4bd1-b6ab-7f2b565ebcd2&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/15/26 11:58:50.218 (2m5.448s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/15/26 11:58:50.218&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run de92a30c-0a71-4bd1-b6ab-7f2b565ebcd2&#xA;Failed to terminate run de92a30c-0a71-4bd1-b6ab-7f2b565ebcd2&#xA;Terminate run de92a30c-0a71-4bd1-b6ab-7f2b565ebcd2&#xA;Deleting run de92a30c-0a71-4bd1-b6ab-7f2b565ebcd2&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=e85ada97-8a2d-4ea8-9279-c93ee4360904 (cascade=true)&#xA;Pipeline with id=e85ada97-8a2d-4ea8-9279-c93ee4360904, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/15/26 11:58:50.399 (181ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/15/26 11:58:50.4&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/15/26 11:58:50.4 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/15/26 11:58:50.4&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/15/26 11:58:50.4 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/pipeline_with_artifact_upload_download.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="126.009576444">
              <system-out>2026/07/15 11:58:50 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/15/26 11:56:44.532&#xA;Create an experiment with name E2EExperiment-1784116604532157244&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/15/26 11:56:44.751 (219ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/15/26 11:56:44.751&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0xbaf6f678780&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/15/26 11:56:44.941 (190ms)&#xA;&gt; Enter [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/15/26 11:56:44.941&#xA;Uploading pipeline file critical/pipeline_with_artifact_upload_download.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1784116604751508028, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml&#xA;Upload of pipeline file &#39;critical/pipeline_with_artifact_upload_download.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 45f76b65-9a73-41b9-a459-494bcd0fa4cb&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;45f76b65-9a73-41b9-a459-494bcd0fa4cb&#39; and name: &#39;e2e-test-1784116604751508028&#39;&#xA;Create a pipeline run for pipeline with id=45f76b65-9a73-41b9-a459-494bcd0fa4cb and versionId=c94c6cec-2012-4e47-be02-b2b94ef57b8d&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=fe6634b4-f140-416e-ba8d-128f03b2b67b&#xA;Created Pipeline Run with id: fe6634b4-f140-416e-ba8d-128f03b2b67b for pipeline with id: 45f76b65-9a73-41b9-a459-494bcd0fa4cb&#xA;Waiting for pipeline run with id=fe6634b4-f140-416e-ba8d-128f03b2b67b to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=fe6634b4-f140-416e-ba8d-128f03b2b67b&#xA;Pipeline run with id=fe6634b4-f140-416e-ba8d-128f03b2b67b is in PENDING state, waiting...&#xA;Get a pipeline run with id=fe6634b4-f140-416e-ba8d-128f03b2b67b&#xA;Pipeline run with id=fe6634b4-f140-416e-ba8d-128f03b2b67b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fe6634b4-f140-416e-ba8d-128f03b2b67b&#xA;Pipeline run with id=fe6634b4-f140-416e-ba8d-128f03b2b67b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fe6634b4-f140-416e-ba8d-128f03b2b67b&#xA;Pipeline run with id=fe6634b4-f140-416e-ba8d-128f03b2b67b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fe6634b4-f140-416e-ba8d-128f03b2b67b&#xA;Pipeline run with id=fe6634b4-f140-416e-ba8d-128f03b2b67b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fe6634b4-f140-416e-ba8d-128f03b2b67b&#xA;Pipeline run with id=fe6634b4-f140-416e-ba8d-128f03b2b67b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fe6634b4-f140-416e-ba8d-128f03b2b67b&#xA;Pipeline run with id=fe6634b4-f140-416e-ba8d-128f03b2b67b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fe6634b4-f140-416e-ba8d-128f03b2b67b&#xA;Pipeline run with id=fe6634b4-f140-416e-ba8d-128f03b2b67b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fe6634b4-f140-416e-ba8d-128f03b2b67b&#xA;Pipeline run with id=fe6634b4-f140-416e-ba8d-128f03b2b67b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fe6634b4-f140-416e-ba8d-128f03b2b67b&#xA;Pipeline run with id=fe6634b4-f140-416e-ba8d-128f03b2b67b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fe6634b4-f140-416e-ba8d-128f03b2b67b&#xA;Pipeline run with id=fe6634b4-f140-416e-ba8d-128f03b2b67b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fe6634b4-f140-416e-ba8d-128f03b2b67b&#xA;Pipeline run with id=fe6634b4-f140-416e-ba8d-128f03b2b67b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fe6634b4-f140-416e-ba8d-128f03b2b67b&#xA;Pipeline run with id=fe6634b4-f140-416e-ba8d-128f03b2b67b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fe6634b4-f140-416e-ba8d-128f03b2b67b&#xA;Pipeline run with id=fe6634b4-f140-416e-ba8d-128f03b2b67b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fe6634b4-f140-416e-ba8d-128f03b2b67b&#xA;Pipeline run with id=fe6634b4-f140-416e-ba8d-128f03b2b67b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fe6634b4-f140-416e-ba8d-128f03b2b67b&#xA;Pipeline run with id=fe6634b4-f140-416e-ba8d-128f03b2b67b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fe6634b4-f140-416e-ba8d-128f03b2b67b&#xA;Pipeline run with id=fe6634b4-f140-416e-ba8d-128f03b2b67b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fe6634b4-f140-416e-ba8d-128f03b2b67b&#xA;Pipeline run with id=fe6634b4-f140-416e-ba8d-128f03b2b67b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fe6634b4-f140-416e-ba8d-128f03b2b67b&#xA;Pipeline run with id=fe6634b4-f140-416e-ba8d-128f03b2b67b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fe6634b4-f140-416e-ba8d-128f03b2b67b&#xA;Pipeline run with id=fe6634b4-f140-416e-ba8d-128f03b2b67b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fe6634b4-f140-416e-ba8d-128f03b2b67b&#xA;Pipeline run with id=fe6634b4-f140-416e-ba8d-128f03b2b67b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fe6634b4-f140-416e-ba8d-128f03b2b67b&#xA;Pipeline run with id=fe6634b4-f140-416e-ba8d-128f03b2b67b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fe6634b4-f140-416e-ba8d-128f03b2b67b&#xA;Pipeline run with id=fe6634b4-f140-416e-ba8d-128f03b2b67b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fe6634b4-f140-416e-ba8d-128f03b2b67b&#xA;Pipeline run with id=fe6634b4-f140-416e-ba8d-128f03b2b67b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fe6634b4-f140-416e-ba8d-128f03b2b67b&#xA;Pipeline run with id=fe6634b4-f140-416e-ba8d-128f03b2b67b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fe6634b4-f140-416e-ba8d-128f03b2b67b&#xA;Pipeline run with id=fe6634b4-f140-416e-ba8d-128f03b2b67b reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/pipeline_with_artifact_upload_download.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=fe6634b4-f140-416e-ba8d-128f03b2b67b&#xA;Get a pipeline run with id=fe6634b4-f140-416e-ba8d-128f03b2b67b&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/15/26 11:58:50.344 (2m5.403s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/15/26 11:58:50.344&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run fe6634b4-f140-416e-ba8d-128f03b2b67b&#xA;Failed to terminate run fe6634b4-f140-416e-ba8d-128f03b2b67b&#xA;Terminate run fe6634b4-f140-416e-ba8d-128f03b2b67b&#xA;Deleting run fe6634b4-f140-416e-ba8d-128f03b2b67b&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=45f76b65-9a73-41b9-a459-494bcd0fa4cb (cascade=true)&#xA;Pipeline with id=45f76b65-9a73-41b9-a459-494bcd0fa4cb, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/15/26 11:58:50.541 (197ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/15/26 11:58:50.542&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/15/26 11:58:50.542 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/15/26 11:58:50.542&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/15/26 11:58:50.542 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/flip_coin.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="162.363628761">
              <system-out>2026/07/15 11:59:26 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/15/26 11:56:44.531&#xA;Create an experiment with name E2EExperiment-1784116604531639393&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/15/26 11:56:44.842 (311ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/15/26 11:56:44.842&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x2533e3d34100&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/15/26 11:56:45.007 (165ms)&#xA;&gt; Enter [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/15/26 11:56:45.007&#xA;Uploading pipeline file critical/flip_coin.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1784116604842357000, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml&#xA;Upload of pipeline file &#39;critical/flip_coin.yaml&#39; successful&#xA;Listing pipeline versions for pipeline ed6e990f-2b57-4012-9b7d-aa44e9ce41d8&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;ed6e990f-2b57-4012-9b7d-aa44e9ce41d8&#39; and name: &#39;e2e-test-1784116604842357000&#39;&#xA;Create a pipeline run for pipeline with id=ed6e990f-2b57-4012-9b7d-aa44e9ce41d8 and versionId=7c735ad6-6d0d-4161-98de-52519a915105&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=e1bd96d2-cc6f-454e-be4d-378e99188e31&#xA;Created Pipeline Run with id: e1bd96d2-cc6f-454e-be4d-378e99188e31 for pipeline with id: ed6e990f-2b57-4012-9b7d-aa44e9ce41d8&#xA;Waiting for pipeline run with id=e1bd96d2-cc6f-454e-be4d-378e99188e31 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=e1bd96d2-cc6f-454e-be4d-378e99188e31&#xA;Pipeline run with id=e1bd96d2-cc6f-454e-be4d-378e99188e31 is in PENDING state, waiting...&#xA;Get a pipeline run with id=e1bd96d2-cc6f-454e-be4d-378e99188e31&#xA;Pipeline run with id=e1bd96d2-cc6f-454e-be4d-378e99188e31 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e1bd96d2-cc6f-454e-be4d-378e99188e31&#xA;Pipeline run with id=e1bd96d2-cc6f-454e-be4d-378e99188e31 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e1bd96d2-cc6f-454e-be4d-378e99188e31&#xA;Pipeline run with id=e1bd96d2-cc6f-454e-be4d-378e99188e31 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e1bd96d2-cc6f-454e-be4d-378e99188e31&#xA;Pipeline run with id=e1bd96d2-cc6f-454e-be4d-378e99188e31 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e1bd96d2-cc6f-454e-be4d-378e99188e31&#xA;Pipeline run with id=e1bd96d2-cc6f-454e-be4d-378e99188e31 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e1bd96d2-cc6f-454e-be4d-378e99188e31&#xA;Pipeline run with id=e1bd96d2-cc6f-454e-be4d-378e99188e31 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e1bd96d2-cc6f-454e-be4d-378e99188e31&#xA;Pipeline run with id=e1bd96d2-cc6f-454e-be4d-378e99188e31 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e1bd96d2-cc6f-454e-be4d-378e99188e31&#xA;Pipeline run with id=e1bd96d2-cc6f-454e-be4d-378e99188e31 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e1bd96d2-cc6f-454e-be4d-378e99188e31&#xA;Pipeline run with id=e1bd96d2-cc6f-454e-be4d-378e99188e31 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e1bd96d2-cc6f-454e-be4d-378e99188e31&#xA;Pipeline run with id=e1bd96d2-cc6f-454e-be4d-378e99188e31 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e1bd96d2-cc6f-454e-be4d-378e99188e31&#xA;Pipeline run with id=e1bd96d2-cc6f-454e-be4d-378e99188e31 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e1bd96d2-cc6f-454e-be4d-378e99188e31&#xA;Pipeline run with id=e1bd96d2-cc6f-454e-be4d-378e99188e31 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e1bd96d2-cc6f-454e-be4d-378e99188e31&#xA;Pipeline run with id=e1bd96d2-cc6f-454e-be4d-378e99188e31 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e1bd96d2-cc6f-454e-be4d-378e99188e31&#xA;Pipeline run with id=e1bd96d2-cc6f-454e-be4d-378e99188e31 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e1bd96d2-cc6f-454e-be4d-378e99188e31&#xA;Pipeline run with id=e1bd96d2-cc6f-454e-be4d-378e99188e31 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e1bd96d2-cc6f-454e-be4d-378e99188e31&#xA;Pipeline run with id=e1bd96d2-cc6f-454e-be4d-378e99188e31 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e1bd96d2-cc6f-454e-be4d-378e99188e31&#xA;Pipeline run with id=e1bd96d2-cc6f-454e-be4d-378e99188e31 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e1bd96d2-cc6f-454e-be4d-378e99188e31&#xA;Pipeline run with id=e1bd96d2-cc6f-454e-be4d-378e99188e31 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e1bd96d2-cc6f-454e-be4d-378e99188e31&#xA;Pipeline run with id=e1bd96d2-cc6f-454e-be4d-378e99188e31 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e1bd96d2-cc6f-454e-be4d-378e99188e31&#xA;Pipeline run with id=e1bd96d2-cc6f-454e-be4d-378e99188e31 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e1bd96d2-cc6f-454e-be4d-378e99188e31&#xA;Pipeline run with id=e1bd96d2-cc6f-454e-be4d-378e99188e31 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e1bd96d2-cc6f-454e-be4d-378e99188e31&#xA;Pipeline run with id=e1bd96d2-cc6f-454e-be4d-378e99188e31 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e1bd96d2-cc6f-454e-be4d-378e99188e31&#xA;Pipeline run with id=e1bd96d2-cc6f-454e-be4d-378e99188e31 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e1bd96d2-cc6f-454e-be4d-378e99188e31&#xA;Pipeline run with id=e1bd96d2-cc6f-454e-be4d-378e99188e31 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e1bd96d2-cc6f-454e-be4d-378e99188e31&#xA;Pipeline run with id=e1bd96d2-cc6f-454e-be4d-378e99188e31 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e1bd96d2-cc6f-454e-be4d-378e99188e31&#xA;Pipeline run with id=e1bd96d2-cc6f-454e-be4d-378e99188e31 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e1bd96d2-cc6f-454e-be4d-378e99188e31&#xA;Pipeline run with id=e1bd96d2-cc6f-454e-be4d-378e99188e31 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e1bd96d2-cc6f-454e-be4d-378e99188e31&#xA;Pipeline run with id=e1bd96d2-cc6f-454e-be4d-378e99188e31 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e1bd96d2-cc6f-454e-be4d-378e99188e31&#xA;Pipeline run with id=e1bd96d2-cc6f-454e-be4d-378e99188e31 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e1bd96d2-cc6f-454e-be4d-378e99188e31&#xA;Pipeline run with id=e1bd96d2-cc6f-454e-be4d-378e99188e31 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e1bd96d2-cc6f-454e-be4d-378e99188e31&#xA;Pipeline run with id=e1bd96d2-cc6f-454e-be4d-378e99188e31 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e1bd96d2-cc6f-454e-be4d-378e99188e31&#xA;Pipeline run with id=e1bd96d2-cc6f-454e-be4d-378e99188e31 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/flip_coin.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=e1bd96d2-cc6f-454e-be4d-378e99188e31&#xA;Get a pipeline run with id=e1bd96d2-cc6f-454e-be4d-378e99188e31&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/15/26 11:59:25.554 (2m40.547s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/15/26 11:59:25.554&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run e1bd96d2-cc6f-454e-be4d-378e99188e31&#xA;Failed to terminate run e1bd96d2-cc6f-454e-be4d-378e99188e31&#xA;Terminate run e1bd96d2-cc6f-454e-be4d-378e99188e31&#xA;Deleting run e1bd96d2-cc6f-454e-be4d-378e99188e31&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=ed6e990f-2b57-4012-9b7d-aa44e9ce41d8 (cascade=true)&#xA;Pipeline with id=ed6e990f-2b57-4012-9b7d-aa44e9ce41d8, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/15/26 11:59:26.895 (1.34s)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/15/26 11:59:26.895&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/15/26 11:59:26.895 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/15/26 11:59:26.895&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/15/26 11:59:26.895 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload essential/iris_pipeline_compiled.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="183.592547015">
              <system-out>2026/07/15 11:59:48 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/15/26 11:56:44.535&#xA;Create an experiment with name E2EExperiment-1784116604535221256&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/15/26 11:56:44.751 (216ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/15/26 11:56:44.751&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x190d6b45c480&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/15/26 11:56:44.906 (155ms)&#xA;&gt; Enter [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/15/26 11:56:44.906&#xA;Uploading pipeline file essential/iris_pipeline_compiled.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1784116604751769404, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml&#xA;Upload of pipeline file &#39;essential/iris_pipeline_compiled.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 67382577-f4bf-440e-a852-3cbb1503da16&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;67382577-f4bf-440e-a852-3cbb1503da16&#39; and name: &#39;e2e-test-1784116604751769404&#39;&#xA;Create a pipeline run for pipeline with id=67382577-f4bf-440e-a852-3cbb1503da16 and versionId=169e77ce-be1c-4179-8a6d-c1218297f5c8&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=072e3fd2-c0d0-46ef-9041-f691169cdaa8&#xA;Created Pipeline Run with id: 072e3fd2-c0d0-46ef-9041-f691169cdaa8 for pipeline with id: 67382577-f4bf-440e-a852-3cbb1503da16&#xA;Waiting for pipeline run with id=072e3fd2-c0d0-46ef-9041-f691169cdaa8 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=072e3fd2-c0d0-46ef-9041-f691169cdaa8&#xA;Pipeline run with id=072e3fd2-c0d0-46ef-9041-f691169cdaa8 is in PENDING state, waiting...&#xA;Get a pipeline run with id=072e3fd2-c0d0-46ef-9041-f691169cdaa8&#xA;Pipeline run with id=072e3fd2-c0d0-46ef-9041-f691169cdaa8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=072e3fd2-c0d0-46ef-9041-f691169cdaa8&#xA;Pipeline run with id=072e3fd2-c0d0-46ef-9041-f691169cdaa8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=072e3fd2-c0d0-46ef-9041-f691169cdaa8&#xA;Pipeline run with id=072e3fd2-c0d0-46ef-9041-f691169cdaa8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=072e3fd2-c0d0-46ef-9041-f691169cdaa8&#xA;Pipeline run with id=072e3fd2-c0d0-46ef-9041-f691169cdaa8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=072e3fd2-c0d0-46ef-9041-f691169cdaa8&#xA;Pipeline run with id=072e3fd2-c0d0-46ef-9041-f691169cdaa8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=072e3fd2-c0d0-46ef-9041-f691169cdaa8&#xA;Pipeline run with id=072e3fd2-c0d0-46ef-9041-f691169cdaa8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=072e3fd2-c0d0-46ef-9041-f691169cdaa8&#xA;Pipeline run with id=072e3fd2-c0d0-46ef-9041-f691169cdaa8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=072e3fd2-c0d0-46ef-9041-f691169cdaa8&#xA;Pipeline run with id=072e3fd2-c0d0-46ef-9041-f691169cdaa8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=072e3fd2-c0d0-46ef-9041-f691169cdaa8&#xA;Pipeline run with id=072e3fd2-c0d0-46ef-9041-f691169cdaa8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=072e3fd2-c0d0-46ef-9041-f691169cdaa8&#xA;Pipeline run with id=072e3fd2-c0d0-46ef-9041-f691169cdaa8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=072e3fd2-c0d0-46ef-9041-f691169cdaa8&#xA;Pipeline run with id=072e3fd2-c0d0-46ef-9041-f691169cdaa8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=072e3fd2-c0d0-46ef-9041-f691169cdaa8&#xA;Pipeline run with id=072e3fd2-c0d0-46ef-9041-f691169cdaa8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=072e3fd2-c0d0-46ef-9041-f691169cdaa8&#xA;Pipeline run with id=072e3fd2-c0d0-46ef-9041-f691169cdaa8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=072e3fd2-c0d0-46ef-9041-f691169cdaa8&#xA;Pipeline run with id=072e3fd2-c0d0-46ef-9041-f691169cdaa8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=072e3fd2-c0d0-46ef-9041-f691169cdaa8&#xA;Pipeline run with id=072e3fd2-c0d0-46ef-9041-f691169cdaa8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=072e3fd2-c0d0-46ef-9041-f691169cdaa8&#xA;Pipeline run with id=072e3fd2-c0d0-46ef-9041-f691169cdaa8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=072e3fd2-c0d0-46ef-9041-f691169cdaa8&#xA;Pipeline run with id=072e3fd2-c0d0-46ef-9041-f691169cdaa8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=072e3fd2-c0d0-46ef-9041-f691169cdaa8&#xA;Pipeline run with id=072e3fd2-c0d0-46ef-9041-f691169cdaa8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=072e3fd2-c0d0-46ef-9041-f691169cdaa8&#xA;Pipeline run with id=072e3fd2-c0d0-46ef-9041-f691169cdaa8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=072e3fd2-c0d0-46ef-9041-f691169cdaa8&#xA;Pipeline run with id=072e3fd2-c0d0-46ef-9041-f691169cdaa8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=072e3fd2-c0d0-46ef-9041-f691169cdaa8&#xA;Pipeline run with id=072e3fd2-c0d0-46ef-9041-f691169cdaa8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=072e3fd2-c0d0-46ef-9041-f691169cdaa8&#xA;Pipeline run with id=072e3fd2-c0d0-46ef-9041-f691169cdaa8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=072e3fd2-c0d0-46ef-9041-f691169cdaa8&#xA;Pipeline run with id=072e3fd2-c0d0-46ef-9041-f691169cdaa8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=072e3fd2-c0d0-46ef-9041-f691169cdaa8&#xA;Pipeline run with id=072e3fd2-c0d0-46ef-9041-f691169cdaa8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=072e3fd2-c0d0-46ef-9041-f691169cdaa8&#xA;Pipeline run with id=072e3fd2-c0d0-46ef-9041-f691169cdaa8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=072e3fd2-c0d0-46ef-9041-f691169cdaa8&#xA;Pipeline run with id=072e3fd2-c0d0-46ef-9041-f691169cdaa8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=072e3fd2-c0d0-46ef-9041-f691169cdaa8&#xA;Pipeline run with id=072e3fd2-c0d0-46ef-9041-f691169cdaa8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=072e3fd2-c0d0-46ef-9041-f691169cdaa8&#xA;Pipeline run with id=072e3fd2-c0d0-46ef-9041-f691169cdaa8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=072e3fd2-c0d0-46ef-9041-f691169cdaa8&#xA;Pipeline run with id=072e3fd2-c0d0-46ef-9041-f691169cdaa8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=072e3fd2-c0d0-46ef-9041-f691169cdaa8&#xA;Pipeline run with id=072e3fd2-c0d0-46ef-9041-f691169cdaa8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=072e3fd2-c0d0-46ef-9041-f691169cdaa8&#xA;Pipeline run with id=072e3fd2-c0d0-46ef-9041-f691169cdaa8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=072e3fd2-c0d0-46ef-9041-f691169cdaa8&#xA;Pipeline run with id=072e3fd2-c0d0-46ef-9041-f691169cdaa8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=072e3fd2-c0d0-46ef-9041-f691169cdaa8&#xA;Pipeline run with id=072e3fd2-c0d0-46ef-9041-f691169cdaa8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=072e3fd2-c0d0-46ef-9041-f691169cdaa8&#xA;Pipeline run with id=072e3fd2-c0d0-46ef-9041-f691169cdaa8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=072e3fd2-c0d0-46ef-9041-f691169cdaa8&#xA;Pipeline run with id=072e3fd2-c0d0-46ef-9041-f691169cdaa8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=072e3fd2-c0d0-46ef-9041-f691169cdaa8&#xA;Pipeline run with id=072e3fd2-c0d0-46ef-9041-f691169cdaa8 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;essential/iris_pipeline_compiled.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=072e3fd2-c0d0-46ef-9041-f691169cdaa8&#xA;Get a pipeline run with id=072e3fd2-c0d0-46ef-9041-f691169cdaa8&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/15/26 11:59:45.353 (3m0.447s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/15/26 11:59:45.354&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 072e3fd2-c0d0-46ef-9041-f691169cdaa8&#xA;Failed to terminate run 072e3fd2-c0d0-46ef-9041-f691169cdaa8&#xA;Terminate run 072e3fd2-c0d0-46ef-9041-f691169cdaa8&#xA;Deleting run 072e3fd2-c0d0-46ef-9041-f691169cdaa8&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=67382577-f4bf-440e-a852-3cbb1503da16 (cascade=true)&#xA;Pipeline with id=67382577-f4bf-440e-a852-3cbb1503da16, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/15/26 11:59:48.127 (2.774s)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/15/26 11:59:48.128&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/15/26 11:59:48.128 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/15/26 11:59:48.128&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/15/26 11:59:48.128 (0s)&#xA;</system-err>
          </testcase>
      </testsuite>
  </testsuites>