<?xml version="1.0" encoding="UTF-8"?>
  <testsuites tests="5" disabled="0" errors="0" failures="0" time="186.380787863">
      <testsuite name="AIPipelinesE2ETests" package="/dspa/backend/test/end2end" tests="5" disabled="0" skipped="0" errors="0" failures="0" time="186.380787863" timestamp="2026-09-06T11:01:47">
          <properties>
              <property name="SuiteSucceeded" value="true"></property>
              <property name="SuiteHasProgrammaticFocus" value="false"></property>
              <property name="SpecialSuiteFailureReason" value=""></property>
              <property name="SuiteLabels" value="[]"></property>
              <property name="SuiteSemVerConstraints" value="[]"></property>
              <property name="RandomSeed" value="1788692343"></property>
              <property name="RandomizeAllSpecs" value="false"></property>
              <property name="LabelFilter" value="Smoke"></property>
              <property name="SemVerFilter" value=""></property>
              <property name="FocusStrings" value=""></property>
              <property name="SkipStrings" value=""></property>
              <property name="FocusFiles" value=""></property>
              <property name="SkipFiles" value=""></property>
              <property name="FailOnPending" value="false"></property>
              <property name="FailOnEmpty" value="false"></property>
              <property name="FailFast" value="false"></property>
              <property name="FlakeAttempts" value="0"></property>
              <property name="DryRun" value="false"></property>
              <property name="ParallelTotal" value="10"></property>
              <property name="OutputInterceptorMode" value=""></property>
          </properties>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/flip_coin.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="156.175199008">
              <system-out>2026/09/06 11:04:23 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 09/06/26 11:01:47.435&#xA;Create an experiment with name E2EExperiment-1788692507435818613&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 09/06/26 11:01:47.742 (307ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 09/06/26 11:01:47.743&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x28f77f636900&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 09/06/26 11:01:47.916 (174ms)&#xA;&gt; Enter [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 09/06/26 11:01:47.917&#xA;Uploading pipeline file critical/flip_coin.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1788692507743102401, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml&#xA;Upload of pipeline file &#39;critical/flip_coin.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 2aeb1bc0-379e-4974-9f49-d74a541c9b04&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;2aeb1bc0-379e-4974-9f49-d74a541c9b04&#39; and name: &#39;e2e-test-1788692507743102401&#39;&#xA;Create a pipeline run for pipeline with id=2aeb1bc0-379e-4974-9f49-d74a541c9b04 and versionId=4ef89b0f-957c-4dd2-918c-9045557be555&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=ae3e493a-d49d-4df1-8826-efd29c94daf7&#xA;Created Pipeline Run with id: ae3e493a-d49d-4df1-8826-efd29c94daf7 for pipeline with id: 2aeb1bc0-379e-4974-9f49-d74a541c9b04&#xA;Waiting for pipeline run with id=ae3e493a-d49d-4df1-8826-efd29c94daf7 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=ae3e493a-d49d-4df1-8826-efd29c94daf7&#xA;Pipeline run with id=ae3e493a-d49d-4df1-8826-efd29c94daf7 is in PENDING state, waiting...&#xA;Get a pipeline run with id=ae3e493a-d49d-4df1-8826-efd29c94daf7&#xA;Pipeline run with id=ae3e493a-d49d-4df1-8826-efd29c94daf7 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ae3e493a-d49d-4df1-8826-efd29c94daf7&#xA;Pipeline run with id=ae3e493a-d49d-4df1-8826-efd29c94daf7 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ae3e493a-d49d-4df1-8826-efd29c94daf7&#xA;Pipeline run with id=ae3e493a-d49d-4df1-8826-efd29c94daf7 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ae3e493a-d49d-4df1-8826-efd29c94daf7&#xA;Pipeline run with id=ae3e493a-d49d-4df1-8826-efd29c94daf7 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ae3e493a-d49d-4df1-8826-efd29c94daf7&#xA;Pipeline run with id=ae3e493a-d49d-4df1-8826-efd29c94daf7 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ae3e493a-d49d-4df1-8826-efd29c94daf7&#xA;Pipeline run with id=ae3e493a-d49d-4df1-8826-efd29c94daf7 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ae3e493a-d49d-4df1-8826-efd29c94daf7&#xA;Pipeline run with id=ae3e493a-d49d-4df1-8826-efd29c94daf7 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ae3e493a-d49d-4df1-8826-efd29c94daf7&#xA;Pipeline run with id=ae3e493a-d49d-4df1-8826-efd29c94daf7 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ae3e493a-d49d-4df1-8826-efd29c94daf7&#xA;Pipeline run with id=ae3e493a-d49d-4df1-8826-efd29c94daf7 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ae3e493a-d49d-4df1-8826-efd29c94daf7&#xA;Pipeline run with id=ae3e493a-d49d-4df1-8826-efd29c94daf7 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ae3e493a-d49d-4df1-8826-efd29c94daf7&#xA;Pipeline run with id=ae3e493a-d49d-4df1-8826-efd29c94daf7 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ae3e493a-d49d-4df1-8826-efd29c94daf7&#xA;Pipeline run with id=ae3e493a-d49d-4df1-8826-efd29c94daf7 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ae3e493a-d49d-4df1-8826-efd29c94daf7&#xA;Pipeline run with id=ae3e493a-d49d-4df1-8826-efd29c94daf7 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ae3e493a-d49d-4df1-8826-efd29c94daf7&#xA;Pipeline run with id=ae3e493a-d49d-4df1-8826-efd29c94daf7 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ae3e493a-d49d-4df1-8826-efd29c94daf7&#xA;Pipeline run with id=ae3e493a-d49d-4df1-8826-efd29c94daf7 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ae3e493a-d49d-4df1-8826-efd29c94daf7&#xA;Pipeline run with id=ae3e493a-d49d-4df1-8826-efd29c94daf7 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ae3e493a-d49d-4df1-8826-efd29c94daf7&#xA;Pipeline run with id=ae3e493a-d49d-4df1-8826-efd29c94daf7 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ae3e493a-d49d-4df1-8826-efd29c94daf7&#xA;Pipeline run with id=ae3e493a-d49d-4df1-8826-efd29c94daf7 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ae3e493a-d49d-4df1-8826-efd29c94daf7&#xA;Pipeline run with id=ae3e493a-d49d-4df1-8826-efd29c94daf7 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ae3e493a-d49d-4df1-8826-efd29c94daf7&#xA;Pipeline run with id=ae3e493a-d49d-4df1-8826-efd29c94daf7 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ae3e493a-d49d-4df1-8826-efd29c94daf7&#xA;Pipeline run with id=ae3e493a-d49d-4df1-8826-efd29c94daf7 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ae3e493a-d49d-4df1-8826-efd29c94daf7&#xA;Pipeline run with id=ae3e493a-d49d-4df1-8826-efd29c94daf7 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ae3e493a-d49d-4df1-8826-efd29c94daf7&#xA;Pipeline run with id=ae3e493a-d49d-4df1-8826-efd29c94daf7 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ae3e493a-d49d-4df1-8826-efd29c94daf7&#xA;Pipeline run with id=ae3e493a-d49d-4df1-8826-efd29c94daf7 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ae3e493a-d49d-4df1-8826-efd29c94daf7&#xA;Pipeline run with id=ae3e493a-d49d-4df1-8826-efd29c94daf7 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ae3e493a-d49d-4df1-8826-efd29c94daf7&#xA;Pipeline run with id=ae3e493a-d49d-4df1-8826-efd29c94daf7 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ae3e493a-d49d-4df1-8826-efd29c94daf7&#xA;Pipeline run with id=ae3e493a-d49d-4df1-8826-efd29c94daf7 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ae3e493a-d49d-4df1-8826-efd29c94daf7&#xA;Pipeline run with id=ae3e493a-d49d-4df1-8826-efd29c94daf7 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ae3e493a-d49d-4df1-8826-efd29c94daf7&#xA;Pipeline run with id=ae3e493a-d49d-4df1-8826-efd29c94daf7 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ae3e493a-d49d-4df1-8826-efd29c94daf7&#xA;Pipeline run with id=ae3e493a-d49d-4df1-8826-efd29c94daf7 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ae3e493a-d49d-4df1-8826-efd29c94daf7&#xA;Pipeline run with id=ae3e493a-d49d-4df1-8826-efd29c94daf7 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/flip_coin.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=ae3e493a-d49d-4df1-8826-efd29c94daf7&#xA;Get a pipeline run with id=ae3e493a-d49d-4df1-8826-efd29c94daf7&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 09/06/26 11:04:23.498 (2m35.581s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 09/06/26 11:04:23.498&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run ae3e493a-d49d-4df1-8826-efd29c94daf7&#xA;Failed to terminate run ae3e493a-d49d-4df1-8826-efd29c94daf7&#xA;Terminate run ae3e493a-d49d-4df1-8826-efd29c94daf7&#xA;Deleting run ae3e493a-d49d-4df1-8826-efd29c94daf7&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=2aeb1bc0-379e-4974-9f49-d74a541c9b04 (cascade=true)&#xA;Pipeline with id=2aeb1bc0-379e-4974-9f49-d74a541c9b04, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 09/06/26 11:04:23.61 (112ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 09/06/26 11:04:23.61&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 09/06/26 11:04:23.611 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 09/06/26 11:04:23.611&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 09/06/26 11:04:23.611 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload essential/component_with_pip_index_urls.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="76.169241139">
              <system-out>2026/09/06 11:03:03 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 09/06/26 11:01:47.435&#xA;Create an experiment with name E2EExperiment-1788692507435960267&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 09/06/26 11:01:47.742 (307ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 09/06/26 11:01:47.743&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x32519ac08900&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 09/06/26 11:01:47.937 (194ms)&#xA;&gt; Enter [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 09/06/26 11:01:47.937&#xA;Uploading pipeline file essential/component_with_pip_index_urls.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1788692507743148243, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml&#xA;Upload of pipeline file &#39;essential/component_with_pip_index_urls.yaml&#39; successful&#xA;Listing pipeline versions for pipeline a3fc6618-27d7-418c-a1a6-bcf09f0f3cfb&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;a3fc6618-27d7-418c-a1a6-bcf09f0f3cfb&#39; and name: &#39;e2e-test-1788692507743148243&#39;&#xA;Create a pipeline run for pipeline with id=a3fc6618-27d7-418c-a1a6-bcf09f0f3cfb and versionId=714b57b4-3a4c-42cd-b223-afc0751f4696&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=28f0b7b7-d595-4bd1-a641-4b8d37448e11&#xA;Created Pipeline Run with id: 28f0b7b7-d595-4bd1-a641-4b8d37448e11 for pipeline with id: a3fc6618-27d7-418c-a1a6-bcf09f0f3cfb&#xA;Waiting for pipeline run with id=28f0b7b7-d595-4bd1-a641-4b8d37448e11 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=28f0b7b7-d595-4bd1-a641-4b8d37448e11&#xA;Pipeline run with id=28f0b7b7-d595-4bd1-a641-4b8d37448e11 is in PENDING state, waiting...&#xA;Get a pipeline run with id=28f0b7b7-d595-4bd1-a641-4b8d37448e11&#xA;Pipeline run with id=28f0b7b7-d595-4bd1-a641-4b8d37448e11 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=28f0b7b7-d595-4bd1-a641-4b8d37448e11&#xA;Pipeline run with id=28f0b7b7-d595-4bd1-a641-4b8d37448e11 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=28f0b7b7-d595-4bd1-a641-4b8d37448e11&#xA;Pipeline run with id=28f0b7b7-d595-4bd1-a641-4b8d37448e11 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=28f0b7b7-d595-4bd1-a641-4b8d37448e11&#xA;Pipeline run with id=28f0b7b7-d595-4bd1-a641-4b8d37448e11 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=28f0b7b7-d595-4bd1-a641-4b8d37448e11&#xA;Pipeline run with id=28f0b7b7-d595-4bd1-a641-4b8d37448e11 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=28f0b7b7-d595-4bd1-a641-4b8d37448e11&#xA;Pipeline run with id=28f0b7b7-d595-4bd1-a641-4b8d37448e11 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=28f0b7b7-d595-4bd1-a641-4b8d37448e11&#xA;Pipeline run with id=28f0b7b7-d595-4bd1-a641-4b8d37448e11 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=28f0b7b7-d595-4bd1-a641-4b8d37448e11&#xA;Pipeline run with id=28f0b7b7-d595-4bd1-a641-4b8d37448e11 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=28f0b7b7-d595-4bd1-a641-4b8d37448e11&#xA;Pipeline run with id=28f0b7b7-d595-4bd1-a641-4b8d37448e11 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=28f0b7b7-d595-4bd1-a641-4b8d37448e11&#xA;Pipeline run with id=28f0b7b7-d595-4bd1-a641-4b8d37448e11 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=28f0b7b7-d595-4bd1-a641-4b8d37448e11&#xA;Pipeline run with id=28f0b7b7-d595-4bd1-a641-4b8d37448e11 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=28f0b7b7-d595-4bd1-a641-4b8d37448e11&#xA;Pipeline run with id=28f0b7b7-d595-4bd1-a641-4b8d37448e11 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=28f0b7b7-d595-4bd1-a641-4b8d37448e11&#xA;Pipeline run with id=28f0b7b7-d595-4bd1-a641-4b8d37448e11 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=28f0b7b7-d595-4bd1-a641-4b8d37448e11&#xA;Pipeline run with id=28f0b7b7-d595-4bd1-a641-4b8d37448e11 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=28f0b7b7-d595-4bd1-a641-4b8d37448e11&#xA;Pipeline run with id=28f0b7b7-d595-4bd1-a641-4b8d37448e11 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;essential/component_with_pip_index_urls.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=28f0b7b7-d595-4bd1-a641-4b8d37448e11&#xA;Get a pipeline run with id=28f0b7b7-d595-4bd1-a641-4b8d37448e11&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 09/06/26 11:03:03.418 (1m15.481s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 09/06/26 11:03:03.418&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 28f0b7b7-d595-4bd1-a641-4b8d37448e11&#xA;Failed to terminate run 28f0b7b7-d595-4bd1-a641-4b8d37448e11&#xA;Terminate run 28f0b7b7-d595-4bd1-a641-4b8d37448e11&#xA;Deleting run 28f0b7b7-d595-4bd1-a641-4b8d37448e11&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=a3fc6618-27d7-418c-a1a6-bcf09f0f3cfb (cascade=true)&#xA;Pipeline with id=a3fc6618-27d7-418c-a1a6-bcf09f0f3cfb, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 09/06/26 11:03:03.605 (186ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 09/06/26 11:03:03.605&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 09/06/26 11:03:03.605 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 09/06/26 11:03:03.605&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 09/06/26 11:03:03.605 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/parallel_for_after_dependency.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="121.292318497">
              <system-out>2026/09/06 11:03:48 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 09/06/26 11:01:47.435&#xA;Create an experiment with name E2EExperiment-1788692507435860005&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 09/06/26 11:01:47.742 (307ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 09/06/26 11:01:47.743&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x393616f2480&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 09/06/26 11:01:47.932 (189ms)&#xA;&gt; Enter [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 09/06/26 11:01:47.932&#xA;Uploading pipeline file critical/parallel_for_after_dependency.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1788692507743155793, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml&#xA;Upload of pipeline file &#39;critical/parallel_for_after_dependency.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 29119f3f-30ae-477b-89c2-93645dd6c1dc&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;29119f3f-30ae-477b-89c2-93645dd6c1dc&#39; and name: &#39;e2e-test-1788692507743155793&#39;&#xA;Create a pipeline run for pipeline with id=29119f3f-30ae-477b-89c2-93645dd6c1dc and versionId=3b92f738-cc3f-45c2-a677-e5395a42f919&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=1ceedca6-76dc-40d7-88f8-5ef29efad468&#xA;Created Pipeline Run with id: 1ceedca6-76dc-40d7-88f8-5ef29efad468 for pipeline with id: 29119f3f-30ae-477b-89c2-93645dd6c1dc&#xA;Waiting for pipeline run with id=1ceedca6-76dc-40d7-88f8-5ef29efad468 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=1ceedca6-76dc-40d7-88f8-5ef29efad468&#xA;Pipeline run with id=1ceedca6-76dc-40d7-88f8-5ef29efad468 is in PENDING state, waiting...&#xA;Get a pipeline run with id=1ceedca6-76dc-40d7-88f8-5ef29efad468&#xA;Pipeline run with id=1ceedca6-76dc-40d7-88f8-5ef29efad468 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ceedca6-76dc-40d7-88f8-5ef29efad468&#xA;Pipeline run with id=1ceedca6-76dc-40d7-88f8-5ef29efad468 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ceedca6-76dc-40d7-88f8-5ef29efad468&#xA;Pipeline run with id=1ceedca6-76dc-40d7-88f8-5ef29efad468 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ceedca6-76dc-40d7-88f8-5ef29efad468&#xA;Pipeline run with id=1ceedca6-76dc-40d7-88f8-5ef29efad468 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ceedca6-76dc-40d7-88f8-5ef29efad468&#xA;Pipeline run with id=1ceedca6-76dc-40d7-88f8-5ef29efad468 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ceedca6-76dc-40d7-88f8-5ef29efad468&#xA;Pipeline run with id=1ceedca6-76dc-40d7-88f8-5ef29efad468 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ceedca6-76dc-40d7-88f8-5ef29efad468&#xA;Pipeline run with id=1ceedca6-76dc-40d7-88f8-5ef29efad468 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ceedca6-76dc-40d7-88f8-5ef29efad468&#xA;Pipeline run with id=1ceedca6-76dc-40d7-88f8-5ef29efad468 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ceedca6-76dc-40d7-88f8-5ef29efad468&#xA;Pipeline run with id=1ceedca6-76dc-40d7-88f8-5ef29efad468 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ceedca6-76dc-40d7-88f8-5ef29efad468&#xA;Pipeline run with id=1ceedca6-76dc-40d7-88f8-5ef29efad468 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ceedca6-76dc-40d7-88f8-5ef29efad468&#xA;Pipeline run with id=1ceedca6-76dc-40d7-88f8-5ef29efad468 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ceedca6-76dc-40d7-88f8-5ef29efad468&#xA;Pipeline run with id=1ceedca6-76dc-40d7-88f8-5ef29efad468 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ceedca6-76dc-40d7-88f8-5ef29efad468&#xA;Pipeline run with id=1ceedca6-76dc-40d7-88f8-5ef29efad468 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ceedca6-76dc-40d7-88f8-5ef29efad468&#xA;Pipeline run with id=1ceedca6-76dc-40d7-88f8-5ef29efad468 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ceedca6-76dc-40d7-88f8-5ef29efad468&#xA;Pipeline run with id=1ceedca6-76dc-40d7-88f8-5ef29efad468 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ceedca6-76dc-40d7-88f8-5ef29efad468&#xA;Pipeline run with id=1ceedca6-76dc-40d7-88f8-5ef29efad468 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ceedca6-76dc-40d7-88f8-5ef29efad468&#xA;Pipeline run with id=1ceedca6-76dc-40d7-88f8-5ef29efad468 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ceedca6-76dc-40d7-88f8-5ef29efad468&#xA;Pipeline run with id=1ceedca6-76dc-40d7-88f8-5ef29efad468 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ceedca6-76dc-40d7-88f8-5ef29efad468&#xA;Pipeline run with id=1ceedca6-76dc-40d7-88f8-5ef29efad468 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ceedca6-76dc-40d7-88f8-5ef29efad468&#xA;Pipeline run with id=1ceedca6-76dc-40d7-88f8-5ef29efad468 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ceedca6-76dc-40d7-88f8-5ef29efad468&#xA;Pipeline run with id=1ceedca6-76dc-40d7-88f8-5ef29efad468 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ceedca6-76dc-40d7-88f8-5ef29efad468&#xA;Pipeline run with id=1ceedca6-76dc-40d7-88f8-5ef29efad468 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ceedca6-76dc-40d7-88f8-5ef29efad468&#xA;Pipeline run with id=1ceedca6-76dc-40d7-88f8-5ef29efad468 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ceedca6-76dc-40d7-88f8-5ef29efad468&#xA;Pipeline run with id=1ceedca6-76dc-40d7-88f8-5ef29efad468 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/parallel_for_after_dependency.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=1ceedca6-76dc-40d7-88f8-5ef29efad468&#xA;Get a pipeline run with id=1ceedca6-76dc-40d7-88f8-5ef29efad468&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 09/06/26 11:03:48.533 (2m0.601s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 09/06/26 11:03:48.533&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 1ceedca6-76dc-40d7-88f8-5ef29efad468&#xA;Failed to terminate run 1ceedca6-76dc-40d7-88f8-5ef29efad468&#xA;Terminate run 1ceedca6-76dc-40d7-88f8-5ef29efad468&#xA;Deleting run 1ceedca6-76dc-40d7-88f8-5ef29efad468&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=29119f3f-30ae-477b-89c2-93645dd6c1dc (cascade=true)&#xA;Pipeline with id=29119f3f-30ae-477b-89c2-93645dd6c1dc, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 09/06/26 11:03:48.727 (194ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 09/06/26 11:03:48.728&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 09/06/26 11:03:48.728 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 09/06/26 11:03:48.728&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 09/06/26 11:03:48.728 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/pipeline_with_artifact_upload_download.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="126.129972475">
              <system-out>2026/09/06 11:03:53 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 09/06/26 11:01:47.435&#xA;Create an experiment with name E2EExperiment-1788692507435880765&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 09/06/26 11:01:47.742 (307ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 09/06/26 11:01:47.743&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x97b1d6caa80&#xA;test-secret-1 created&#xA;test-secret-2 created&#xA;test-secret-3 created&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 09/06/26 11:01:47.865 (122ms)&#xA;&gt; Enter [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 09/06/26 11:01:47.865&#xA;Uploading pipeline file critical/pipeline_with_artifact_upload_download.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1788692507743053330, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml&#xA;Upload of pipeline file &#39;critical/pipeline_with_artifact_upload_download.yaml&#39; successful&#xA;Listing pipeline versions for pipeline bf1265b2-7330-4186-baba-3c7f0c2b7a05&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;bf1265b2-7330-4186-baba-3c7f0c2b7a05&#39; and name: &#39;e2e-test-1788692507743053330&#39;&#xA;Create a pipeline run for pipeline with id=bf1265b2-7330-4186-baba-3c7f0c2b7a05 and versionId=ea7069f9-c510-43e1-9536-fe4b8a94637b&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=e2c2946a-a791-412c-b586-0f47b32ede23&#xA;Created Pipeline Run with id: e2c2946a-a791-412c-b586-0f47b32ede23 for pipeline with id: bf1265b2-7330-4186-baba-3c7f0c2b7a05&#xA;Waiting for pipeline run with id=e2c2946a-a791-412c-b586-0f47b32ede23 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=e2c2946a-a791-412c-b586-0f47b32ede23&#xA;Pipeline run with id=e2c2946a-a791-412c-b586-0f47b32ede23 is in PENDING state, waiting...&#xA;Get a pipeline run with id=e2c2946a-a791-412c-b586-0f47b32ede23&#xA;Pipeline run with id=e2c2946a-a791-412c-b586-0f47b32ede23 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e2c2946a-a791-412c-b586-0f47b32ede23&#xA;Pipeline run with id=e2c2946a-a791-412c-b586-0f47b32ede23 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e2c2946a-a791-412c-b586-0f47b32ede23&#xA;Pipeline run with id=e2c2946a-a791-412c-b586-0f47b32ede23 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e2c2946a-a791-412c-b586-0f47b32ede23&#xA;Pipeline run with id=e2c2946a-a791-412c-b586-0f47b32ede23 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e2c2946a-a791-412c-b586-0f47b32ede23&#xA;Pipeline run with id=e2c2946a-a791-412c-b586-0f47b32ede23 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e2c2946a-a791-412c-b586-0f47b32ede23&#xA;Pipeline run with id=e2c2946a-a791-412c-b586-0f47b32ede23 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e2c2946a-a791-412c-b586-0f47b32ede23&#xA;Pipeline run with id=e2c2946a-a791-412c-b586-0f47b32ede23 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e2c2946a-a791-412c-b586-0f47b32ede23&#xA;Pipeline run with id=e2c2946a-a791-412c-b586-0f47b32ede23 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e2c2946a-a791-412c-b586-0f47b32ede23&#xA;Pipeline run with id=e2c2946a-a791-412c-b586-0f47b32ede23 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e2c2946a-a791-412c-b586-0f47b32ede23&#xA;Pipeline run with id=e2c2946a-a791-412c-b586-0f47b32ede23 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e2c2946a-a791-412c-b586-0f47b32ede23&#xA;Pipeline run with id=e2c2946a-a791-412c-b586-0f47b32ede23 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e2c2946a-a791-412c-b586-0f47b32ede23&#xA;Pipeline run with id=e2c2946a-a791-412c-b586-0f47b32ede23 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e2c2946a-a791-412c-b586-0f47b32ede23&#xA;Pipeline run with id=e2c2946a-a791-412c-b586-0f47b32ede23 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e2c2946a-a791-412c-b586-0f47b32ede23&#xA;Pipeline run with id=e2c2946a-a791-412c-b586-0f47b32ede23 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e2c2946a-a791-412c-b586-0f47b32ede23&#xA;Pipeline run with id=e2c2946a-a791-412c-b586-0f47b32ede23 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e2c2946a-a791-412c-b586-0f47b32ede23&#xA;Pipeline run with id=e2c2946a-a791-412c-b586-0f47b32ede23 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e2c2946a-a791-412c-b586-0f47b32ede23&#xA;Pipeline run with id=e2c2946a-a791-412c-b586-0f47b32ede23 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e2c2946a-a791-412c-b586-0f47b32ede23&#xA;Pipeline run with id=e2c2946a-a791-412c-b586-0f47b32ede23 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e2c2946a-a791-412c-b586-0f47b32ede23&#xA;Pipeline run with id=e2c2946a-a791-412c-b586-0f47b32ede23 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e2c2946a-a791-412c-b586-0f47b32ede23&#xA;Pipeline run with id=e2c2946a-a791-412c-b586-0f47b32ede23 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e2c2946a-a791-412c-b586-0f47b32ede23&#xA;Pipeline run with id=e2c2946a-a791-412c-b586-0f47b32ede23 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e2c2946a-a791-412c-b586-0f47b32ede23&#xA;Pipeline run with id=e2c2946a-a791-412c-b586-0f47b32ede23 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e2c2946a-a791-412c-b586-0f47b32ede23&#xA;Pipeline run with id=e2c2946a-a791-412c-b586-0f47b32ede23 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e2c2946a-a791-412c-b586-0f47b32ede23&#xA;Pipeline run with id=e2c2946a-a791-412c-b586-0f47b32ede23 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e2c2946a-a791-412c-b586-0f47b32ede23&#xA;Pipeline run with id=e2c2946a-a791-412c-b586-0f47b32ede23 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/pipeline_with_artifact_upload_download.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=e2c2946a-a791-412c-b586-0f47b32ede23&#xA;Get a pipeline run with id=e2c2946a-a791-412c-b586-0f47b32ede23&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 09/06/26 11:03:53.444 (2m5.579s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 09/06/26 11:03:53.444&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run e2c2946a-a791-412c-b586-0f47b32ede23&#xA;Failed to terminate run e2c2946a-a791-412c-b586-0f47b32ede23&#xA;Terminate run e2c2946a-a791-412c-b586-0f47b32ede23&#xA;Deleting run e2c2946a-a791-412c-b586-0f47b32ede23&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=bf1265b2-7330-4186-baba-3c7f0c2b7a05 (cascade=true)&#xA;Pipeline with id=bf1265b2-7330-4186-baba-3c7f0c2b7a05, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 09/06/26 11:03:53.565 (121ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 09/06/26 11:03:53.566&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 09/06/26 11:03:53.566 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 09/06/26 11:03:53.566&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 09/06/26 11:03:53.566 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload essential/iris_pipeline_compiled.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="186.174695194">
              <system-out>2026/09/06 11:04:53 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 09/06/26 11:01:47.436&#xA;Create an experiment with name E2EExperiment-1788692507436239555&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 09/06/26 11:01:47.743 (307ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 09/06/26 11:01:47.743&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x602aa394980&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 09/06/26 11:01:47.887 (145ms)&#xA;&gt; Enter [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 09/06/26 11:01:47.888&#xA;Uploading pipeline file essential/iris_pipeline_compiled.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1788692507743282436, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml&#xA;Upload of pipeline file &#39;essential/iris_pipeline_compiled.yaml&#39; successful&#xA;Listing pipeline versions for pipeline ab4b38ad-f878-4702-943b-71063c2e9a1e&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;ab4b38ad-f878-4702-943b-71063c2e9a1e&#39; and name: &#39;e2e-test-1788692507743282436&#39;&#xA;Create a pipeline run for pipeline with id=ab4b38ad-f878-4702-943b-71063c2e9a1e and versionId=f2795346-21a3-4c4e-8b9c-d021c8dd8f3d&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=974a6276-594a-4e0d-b954-49121ddb17ec&#xA;Created Pipeline Run with id: 974a6276-594a-4e0d-b954-49121ddb17ec for pipeline with id: ab4b38ad-f878-4702-943b-71063c2e9a1e&#xA;Waiting for pipeline run with id=974a6276-594a-4e0d-b954-49121ddb17ec to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=974a6276-594a-4e0d-b954-49121ddb17ec&#xA;Pipeline run with id=974a6276-594a-4e0d-b954-49121ddb17ec is in PENDING state, waiting...&#xA;Get a pipeline run with id=974a6276-594a-4e0d-b954-49121ddb17ec&#xA;Pipeline run with id=974a6276-594a-4e0d-b954-49121ddb17ec is in RUNNING state, waiting...&#xA;Get a pipeline run with id=974a6276-594a-4e0d-b954-49121ddb17ec&#xA;Pipeline run with id=974a6276-594a-4e0d-b954-49121ddb17ec is in RUNNING state, waiting...&#xA;Get a pipeline run with id=974a6276-594a-4e0d-b954-49121ddb17ec&#xA;Pipeline run with id=974a6276-594a-4e0d-b954-49121ddb17ec is in RUNNING state, waiting...&#xA;Get a pipeline run with id=974a6276-594a-4e0d-b954-49121ddb17ec&#xA;Pipeline run with id=974a6276-594a-4e0d-b954-49121ddb17ec is in RUNNING state, waiting...&#xA;Get a pipeline run with id=974a6276-594a-4e0d-b954-49121ddb17ec&#xA;Pipeline run with id=974a6276-594a-4e0d-b954-49121ddb17ec is in RUNNING state, waiting...&#xA;Get a pipeline run with id=974a6276-594a-4e0d-b954-49121ddb17ec&#xA;Pipeline run with id=974a6276-594a-4e0d-b954-49121ddb17ec is in RUNNING state, waiting...&#xA;Get a pipeline run with id=974a6276-594a-4e0d-b954-49121ddb17ec&#xA;Pipeline run with id=974a6276-594a-4e0d-b954-49121ddb17ec is in RUNNING state, waiting...&#xA;Get a pipeline run with id=974a6276-594a-4e0d-b954-49121ddb17ec&#xA;Pipeline run with id=974a6276-594a-4e0d-b954-49121ddb17ec is in RUNNING state, waiting...&#xA;Get a pipeline run with id=974a6276-594a-4e0d-b954-49121ddb17ec&#xA;Pipeline run with id=974a6276-594a-4e0d-b954-49121ddb17ec is in RUNNING state, waiting...&#xA;Get a pipeline run with id=974a6276-594a-4e0d-b954-49121ddb17ec&#xA;Pipeline run with id=974a6276-594a-4e0d-b954-49121ddb17ec is in RUNNING state, waiting...&#xA;Get a pipeline run with id=974a6276-594a-4e0d-b954-49121ddb17ec&#xA;Pipeline run with id=974a6276-594a-4e0d-b954-49121ddb17ec is in RUNNING state, waiting...&#xA;Get a pipeline run with id=974a6276-594a-4e0d-b954-49121ddb17ec&#xA;Pipeline run with id=974a6276-594a-4e0d-b954-49121ddb17ec is in RUNNING state, waiting...&#xA;Get a pipeline run with id=974a6276-594a-4e0d-b954-49121ddb17ec&#xA;Pipeline run with id=974a6276-594a-4e0d-b954-49121ddb17ec is in RUNNING state, waiting...&#xA;Get a pipeline run with id=974a6276-594a-4e0d-b954-49121ddb17ec&#xA;Pipeline run with id=974a6276-594a-4e0d-b954-49121ddb17ec is in RUNNING state, waiting...&#xA;Get a pipeline run with id=974a6276-594a-4e0d-b954-49121ddb17ec&#xA;Pipeline run with id=974a6276-594a-4e0d-b954-49121ddb17ec is in RUNNING state, waiting...&#xA;Get a pipeline run with id=974a6276-594a-4e0d-b954-49121ddb17ec&#xA;Pipeline run with id=974a6276-594a-4e0d-b954-49121ddb17ec is in RUNNING state, waiting...&#xA;Get a pipeline run with id=974a6276-594a-4e0d-b954-49121ddb17ec&#xA;Pipeline run with id=974a6276-594a-4e0d-b954-49121ddb17ec is in RUNNING state, waiting...&#xA;Get a pipeline run with id=974a6276-594a-4e0d-b954-49121ddb17ec&#xA;Pipeline run with id=974a6276-594a-4e0d-b954-49121ddb17ec is in RUNNING state, waiting...&#xA;Get a pipeline run with id=974a6276-594a-4e0d-b954-49121ddb17ec&#xA;Pipeline run with id=974a6276-594a-4e0d-b954-49121ddb17ec is in RUNNING state, waiting...&#xA;Get a pipeline run with id=974a6276-594a-4e0d-b954-49121ddb17ec&#xA;Pipeline run with id=974a6276-594a-4e0d-b954-49121ddb17ec is in RUNNING state, waiting...&#xA;Get a pipeline run with id=974a6276-594a-4e0d-b954-49121ddb17ec&#xA;Pipeline run with id=974a6276-594a-4e0d-b954-49121ddb17ec is in RUNNING state, waiting...&#xA;Get a pipeline run with id=974a6276-594a-4e0d-b954-49121ddb17ec&#xA;Pipeline run with id=974a6276-594a-4e0d-b954-49121ddb17ec is in RUNNING state, waiting...&#xA;Get a pipeline run with id=974a6276-594a-4e0d-b954-49121ddb17ec&#xA;Pipeline run with id=974a6276-594a-4e0d-b954-49121ddb17ec is in RUNNING state, waiting...&#xA;Get a pipeline run with id=974a6276-594a-4e0d-b954-49121ddb17ec&#xA;Pipeline run with id=974a6276-594a-4e0d-b954-49121ddb17ec is in RUNNING state, waiting...&#xA;Get a pipeline run with id=974a6276-594a-4e0d-b954-49121ddb17ec&#xA;Pipeline run with id=974a6276-594a-4e0d-b954-49121ddb17ec is in RUNNING state, waiting...&#xA;Get a pipeline run with id=974a6276-594a-4e0d-b954-49121ddb17ec&#xA;Pipeline run with id=974a6276-594a-4e0d-b954-49121ddb17ec is in RUNNING state, waiting...&#xA;Get a pipeline run with id=974a6276-594a-4e0d-b954-49121ddb17ec&#xA;Pipeline run with id=974a6276-594a-4e0d-b954-49121ddb17ec is in RUNNING state, waiting...&#xA;Get a pipeline run with id=974a6276-594a-4e0d-b954-49121ddb17ec&#xA;Pipeline run with id=974a6276-594a-4e0d-b954-49121ddb17ec is in RUNNING state, waiting...&#xA;Get a pipeline run with id=974a6276-594a-4e0d-b954-49121ddb17ec&#xA;Pipeline run with id=974a6276-594a-4e0d-b954-49121ddb17ec is in RUNNING state, waiting...&#xA;Get a pipeline run with id=974a6276-594a-4e0d-b954-49121ddb17ec&#xA;Pipeline run with id=974a6276-594a-4e0d-b954-49121ddb17ec is in RUNNING state, waiting...&#xA;Get a pipeline run with id=974a6276-594a-4e0d-b954-49121ddb17ec&#xA;Pipeline run with id=974a6276-594a-4e0d-b954-49121ddb17ec is in RUNNING state, waiting...&#xA;Get a pipeline run with id=974a6276-594a-4e0d-b954-49121ddb17ec&#xA;Pipeline run with id=974a6276-594a-4e0d-b954-49121ddb17ec is in RUNNING state, waiting...&#xA;Get a pipeline run with id=974a6276-594a-4e0d-b954-49121ddb17ec&#xA;Pipeline run with id=974a6276-594a-4e0d-b954-49121ddb17ec is in RUNNING state, waiting...&#xA;Get a pipeline run with id=974a6276-594a-4e0d-b954-49121ddb17ec&#xA;Pipeline run with id=974a6276-594a-4e0d-b954-49121ddb17ec is in RUNNING state, waiting...&#xA;Get a pipeline run with id=974a6276-594a-4e0d-b954-49121ddb17ec&#xA;Pipeline run with id=974a6276-594a-4e0d-b954-49121ddb17ec is in RUNNING state, waiting...&#xA;Get a pipeline run with id=974a6276-594a-4e0d-b954-49121ddb17ec&#xA;Pipeline run with id=974a6276-594a-4e0d-b954-49121ddb17ec is in RUNNING state, waiting...&#xA;Get a pipeline run with id=974a6276-594a-4e0d-b954-49121ddb17ec&#xA;Pipeline run with id=974a6276-594a-4e0d-b954-49121ddb17ec reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;essential/iris_pipeline_compiled.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=974a6276-594a-4e0d-b954-49121ddb17ec&#xA;Get a pipeline run with id=974a6276-594a-4e0d-b954-49121ddb17ec&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 09/06/26 11:04:53.491 (3m5.603s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 09/06/26 11:04:53.491&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 974a6276-594a-4e0d-b954-49121ddb17ec&#xA;Failed to terminate run 974a6276-594a-4e0d-b954-49121ddb17ec&#xA;Terminate run 974a6276-594a-4e0d-b954-49121ddb17ec&#xA;Deleting run 974a6276-594a-4e0d-b954-49121ddb17ec&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=ab4b38ad-f878-4702-943b-71063c2e9a1e (cascade=true)&#xA;Pipeline with id=ab4b38ad-f878-4702-943b-71063c2e9a1e, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 09/06/26 11:04:53.61 (119ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 09/06/26 11:04:53.611&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 09/06/26 11:04:53.611 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 09/06/26 11:04:53.611&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 09/06/26 11:04:53.611 (0s)&#xA;</system-err>
          </testcase>
      </testsuite>
  </testsuites>