<?xml version="1.0" encoding="UTF-8"?>
  <testsuites tests="5" disabled="0" errors="0" failures="0" time="286.409810463">
      <testsuite name="AIPipelinesE2ETests" package="/dspa/backend/test/end2end" tests="5" disabled="0" skipped="0" errors="0" failures="0" time="286.409810463" timestamp="2026-07-14T16:23:52">
          <properties>
              <property name="SuiteSucceeded" value="true"></property>
              <property name="SuiteHasProgrammaticFocus" value="false"></property>
              <property name="SpecialSuiteFailureReason" value=""></property>
              <property name="SuiteLabels" value="[]"></property>
              <property name="SuiteSemVerConstraints" value="[]"></property>
              <property name="RandomSeed" value="1784046060"></property>
              <property name="RandomizeAllSpecs" value="false"></property>
              <property name="LabelFilter" value="Smoke"></property>
              <property name="SemVerFilter" value=""></property>
              <property name="FocusStrings" value=""></property>
              <property name="SkipStrings" value=""></property>
              <property name="FocusFiles" value=""></property>
              <property name="SkipFiles" value=""></property>
              <property name="FailOnPending" value="false"></property>
              <property name="FailOnEmpty" value="false"></property>
              <property name="FailFast" value="false"></property>
              <property name="FlakeAttempts" value="0"></property>
              <property name="DryRun" value="false"></property>
              <property name="ParallelTotal" value="10"></property>
              <property name="OutputInterceptorMode" value=""></property>
          </properties>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload essential/iris_pipeline_compiled.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="286.270164137">
              <system-out>2026/07/14 16:28:39 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/14/26 16:23:52.867&#xA;Create an experiment with name E2EExperiment-1784046232867796721&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/14/26 16:23:53.145 (278ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/14/26 16:23:53.145&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x1c7405d62900&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/14/26 16:23:53.245 (100ms)&#xA;&gt; Enter [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/14/26 16:23:53.245&#xA;Uploading pipeline file essential/iris_pipeline_compiled.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1784046233145517142, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml&#xA;Upload of pipeline file &#39;essential/iris_pipeline_compiled.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 1297e6bc-6958-40f3-b5b6-e829c869ae10&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;1297e6bc-6958-40f3-b5b6-e829c869ae10&#39; and name: &#39;e2e-test-1784046233145517142&#39;&#xA;Create a pipeline run for pipeline with id=1297e6bc-6958-40f3-b5b6-e829c869ae10 and versionId=7445122f-2186-47c4-91c3-8c14ec61bd92&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=537555f0-5607-43a3-9d79-4303d1042781&#xA;Created Pipeline Run with id: 537555f0-5607-43a3-9d79-4303d1042781 for pipeline with id: 1297e6bc-6958-40f3-b5b6-e829c869ae10&#xA;Waiting for pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781&#xA;Pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781 is in PENDING state, waiting...&#xA;Get a pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781&#xA;Pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781&#xA;Pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781&#xA;Pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781&#xA;Pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781&#xA;Pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781&#xA;Pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781&#xA;Pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781&#xA;Pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781&#xA;Pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781&#xA;Pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781&#xA;Pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781&#xA;Pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781&#xA;Pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781&#xA;Pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781&#xA;Pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781&#xA;Pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781&#xA;Pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781&#xA;Pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781&#xA;Pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781&#xA;Pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781&#xA;Pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781&#xA;Pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781&#xA;Pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781&#xA;Pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781&#xA;Pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781&#xA;Pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781&#xA;Pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781&#xA;Pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781&#xA;Pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781&#xA;Pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781&#xA;Pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781&#xA;Pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781&#xA;Pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781&#xA;Pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781&#xA;Pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781&#xA;Pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781&#xA;Pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781&#xA;Pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781&#xA;Pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781&#xA;Pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781&#xA;Pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781&#xA;Pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781&#xA;Pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781&#xA;Pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781&#xA;Pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781&#xA;Pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781&#xA;Pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781&#xA;Pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781&#xA;Pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781&#xA;Pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781&#xA;Pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781&#xA;Pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781&#xA;Pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781&#xA;Pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781&#xA;Pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781&#xA;Pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781&#xA;Pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;essential/iris_pipeline_compiled.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=537555f0-5607-43a3-9d79-4303d1042781&#xA;Get a pipeline run with id=537555f0-5607-43a3-9d79-4303d1042781&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/14/26 16:28:38.855 (4m45.61s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/14/26 16:28:38.855&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 537555f0-5607-43a3-9d79-4303d1042781&#xA;Failed to terminate run 537555f0-5607-43a3-9d79-4303d1042781&#xA;Terminate run 537555f0-5607-43a3-9d79-4303d1042781&#xA;Deleting run 537555f0-5607-43a3-9d79-4303d1042781&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=1297e6bc-6958-40f3-b5b6-e829c869ae10 (cascade=true)&#xA;Pipeline with id=1297e6bc-6958-40f3-b5b6-e829c869ae10, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/14/26 16:28:39.137 (282ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/14/26 16:28:39.138&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/14/26 16:28:39.138 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/14/26 16:28:39.138&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/14/26 16:28:39.138 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload essential/component_with_pip_index_urls.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="56.270047983">
              <system-out>2026/07/14 16:24:49 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/14/26 16:23:52.853&#xA;Create an experiment with name E2EExperiment-1784046232853362208&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/14/26 16:23:53.136 (283ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/14/26 16:23:53.136&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x16b74a5c6080&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/14/26 16:23:53.293 (157ms)&#xA;&gt; Enter [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/14/26 16:23:53.294&#xA;Uploading pipeline file essential/component_with_pip_index_urls.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1784046233136723735, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml&#xA;Upload of pipeline file &#39;essential/component_with_pip_index_urls.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 6334c93d-3afb-4e03-aa44-a8967ffe0b06&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;6334c93d-3afb-4e03-aa44-a8967ffe0b06&#39; and name: &#39;e2e-test-1784046233136723735&#39;&#xA;Create a pipeline run for pipeline with id=6334c93d-3afb-4e03-aa44-a8967ffe0b06 and versionId=05b63c66-0166-401a-bf9b-5772ec7a17e6&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=ac11de80-a6b4-408c-abac-cdf70b3a8137&#xA;Created Pipeline Run with id: ac11de80-a6b4-408c-abac-cdf70b3a8137 for pipeline with id: 6334c93d-3afb-4e03-aa44-a8967ffe0b06&#xA;Waiting for pipeline run with id=ac11de80-a6b4-408c-abac-cdf70b3a8137 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=ac11de80-a6b4-408c-abac-cdf70b3a8137&#xA;Pipeline run with id=ac11de80-a6b4-408c-abac-cdf70b3a8137 is in PENDING state, waiting...&#xA;Get a pipeline run with id=ac11de80-a6b4-408c-abac-cdf70b3a8137&#xA;Pipeline run with id=ac11de80-a6b4-408c-abac-cdf70b3a8137 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ac11de80-a6b4-408c-abac-cdf70b3a8137&#xA;Pipeline run with id=ac11de80-a6b4-408c-abac-cdf70b3a8137 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ac11de80-a6b4-408c-abac-cdf70b3a8137&#xA;Pipeline run with id=ac11de80-a6b4-408c-abac-cdf70b3a8137 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ac11de80-a6b4-408c-abac-cdf70b3a8137&#xA;Pipeline run with id=ac11de80-a6b4-408c-abac-cdf70b3a8137 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ac11de80-a6b4-408c-abac-cdf70b3a8137&#xA;Pipeline run with id=ac11de80-a6b4-408c-abac-cdf70b3a8137 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ac11de80-a6b4-408c-abac-cdf70b3a8137&#xA;Pipeline run with id=ac11de80-a6b4-408c-abac-cdf70b3a8137 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ac11de80-a6b4-408c-abac-cdf70b3a8137&#xA;Pipeline run with id=ac11de80-a6b4-408c-abac-cdf70b3a8137 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ac11de80-a6b4-408c-abac-cdf70b3a8137&#xA;Pipeline run with id=ac11de80-a6b4-408c-abac-cdf70b3a8137 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ac11de80-a6b4-408c-abac-cdf70b3a8137&#xA;Pipeline run with id=ac11de80-a6b4-408c-abac-cdf70b3a8137 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ac11de80-a6b4-408c-abac-cdf70b3a8137&#xA;Pipeline run with id=ac11de80-a6b4-408c-abac-cdf70b3a8137 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ac11de80-a6b4-408c-abac-cdf70b3a8137&#xA;Pipeline run with id=ac11de80-a6b4-408c-abac-cdf70b3a8137 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;essential/component_with_pip_index_urls.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=ac11de80-a6b4-408c-abac-cdf70b3a8137&#xA;Get a pipeline run with id=ac11de80-a6b4-408c-abac-cdf70b3a8137&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/14/26 16:24:48.879 (55.585s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/14/26 16:24:48.879&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run ac11de80-a6b4-408c-abac-cdf70b3a8137&#xA;Failed to terminate run ac11de80-a6b4-408c-abac-cdf70b3a8137&#xA;Terminate run ac11de80-a6b4-408c-abac-cdf70b3a8137&#xA;Deleting run ac11de80-a6b4-408c-abac-cdf70b3a8137&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=6334c93d-3afb-4e03-aa44-a8967ffe0b06 (cascade=true)&#xA;Pipeline with id=6334c93d-3afb-4e03-aa44-a8967ffe0b06, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/14/26 16:24:49.123 (244ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/14/26 16:24:49.123&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/14/26 16:24:49.123 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/14/26 16:24:49.123&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/14/26 16:24:49.123 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/parallel_for_after_dependency.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="136.268701297">
              <system-out>2026/07/14 16:26:09 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/14/26 16:23:52.836&#xA;Create an experiment with name E2EExperiment-1784046232836228066&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/14/26 16:23:53.136 (300ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/14/26 16:23:53.136&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0xf50ab854b80&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/14/26 16:23:53.243 (107ms)&#xA;&gt; Enter [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/14/26 16:23:53.243&#xA;Uploading pipeline file critical/parallel_for_after_dependency.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1784046233136628569, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml&#xA;Upload of pipeline file &#39;critical/parallel_for_after_dependency.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 0c6d3bab-fdb6-4bd6-bb3d-3c884dec7768&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;0c6d3bab-fdb6-4bd6-bb3d-3c884dec7768&#39; and name: &#39;e2e-test-1784046233136628569&#39;&#xA;Create a pipeline run for pipeline with id=0c6d3bab-fdb6-4bd6-bb3d-3c884dec7768 and versionId=76ec2698-b26e-436b-a5dc-666b760f0621&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=105b5a13-df5f-47a2-87f3-235bb6a982e9&#xA;Created Pipeline Run with id: 105b5a13-df5f-47a2-87f3-235bb6a982e9 for pipeline with id: 0c6d3bab-fdb6-4bd6-bb3d-3c884dec7768&#xA;Waiting for pipeline run with id=105b5a13-df5f-47a2-87f3-235bb6a982e9 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=105b5a13-df5f-47a2-87f3-235bb6a982e9&#xA;Pipeline run with id=105b5a13-df5f-47a2-87f3-235bb6a982e9 is in PENDING state, waiting...&#xA;Get a pipeline run with id=105b5a13-df5f-47a2-87f3-235bb6a982e9&#xA;Pipeline run with id=105b5a13-df5f-47a2-87f3-235bb6a982e9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=105b5a13-df5f-47a2-87f3-235bb6a982e9&#xA;Pipeline run with id=105b5a13-df5f-47a2-87f3-235bb6a982e9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=105b5a13-df5f-47a2-87f3-235bb6a982e9&#xA;Pipeline run with id=105b5a13-df5f-47a2-87f3-235bb6a982e9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=105b5a13-df5f-47a2-87f3-235bb6a982e9&#xA;Pipeline run with id=105b5a13-df5f-47a2-87f3-235bb6a982e9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=105b5a13-df5f-47a2-87f3-235bb6a982e9&#xA;Pipeline run with id=105b5a13-df5f-47a2-87f3-235bb6a982e9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=105b5a13-df5f-47a2-87f3-235bb6a982e9&#xA;Pipeline run with id=105b5a13-df5f-47a2-87f3-235bb6a982e9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=105b5a13-df5f-47a2-87f3-235bb6a982e9&#xA;Pipeline run with id=105b5a13-df5f-47a2-87f3-235bb6a982e9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=105b5a13-df5f-47a2-87f3-235bb6a982e9&#xA;Pipeline run with id=105b5a13-df5f-47a2-87f3-235bb6a982e9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=105b5a13-df5f-47a2-87f3-235bb6a982e9&#xA;Pipeline run with id=105b5a13-df5f-47a2-87f3-235bb6a982e9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=105b5a13-df5f-47a2-87f3-235bb6a982e9&#xA;Pipeline run with id=105b5a13-df5f-47a2-87f3-235bb6a982e9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=105b5a13-df5f-47a2-87f3-235bb6a982e9&#xA;Pipeline run with id=105b5a13-df5f-47a2-87f3-235bb6a982e9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=105b5a13-df5f-47a2-87f3-235bb6a982e9&#xA;Pipeline run with id=105b5a13-df5f-47a2-87f3-235bb6a982e9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=105b5a13-df5f-47a2-87f3-235bb6a982e9&#xA;Pipeline run with id=105b5a13-df5f-47a2-87f3-235bb6a982e9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=105b5a13-df5f-47a2-87f3-235bb6a982e9&#xA;Pipeline run with id=105b5a13-df5f-47a2-87f3-235bb6a982e9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=105b5a13-df5f-47a2-87f3-235bb6a982e9&#xA;Pipeline run with id=105b5a13-df5f-47a2-87f3-235bb6a982e9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=105b5a13-df5f-47a2-87f3-235bb6a982e9&#xA;Pipeline run with id=105b5a13-df5f-47a2-87f3-235bb6a982e9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=105b5a13-df5f-47a2-87f3-235bb6a982e9&#xA;Pipeline run with id=105b5a13-df5f-47a2-87f3-235bb6a982e9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=105b5a13-df5f-47a2-87f3-235bb6a982e9&#xA;Pipeline run with id=105b5a13-df5f-47a2-87f3-235bb6a982e9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=105b5a13-df5f-47a2-87f3-235bb6a982e9&#xA;Pipeline run with id=105b5a13-df5f-47a2-87f3-235bb6a982e9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=105b5a13-df5f-47a2-87f3-235bb6a982e9&#xA;Pipeline run with id=105b5a13-df5f-47a2-87f3-235bb6a982e9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=105b5a13-df5f-47a2-87f3-235bb6a982e9&#xA;Pipeline run with id=105b5a13-df5f-47a2-87f3-235bb6a982e9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=105b5a13-df5f-47a2-87f3-235bb6a982e9&#xA;Pipeline run with id=105b5a13-df5f-47a2-87f3-235bb6a982e9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=105b5a13-df5f-47a2-87f3-235bb6a982e9&#xA;Pipeline run with id=105b5a13-df5f-47a2-87f3-235bb6a982e9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=105b5a13-df5f-47a2-87f3-235bb6a982e9&#xA;Pipeline run with id=105b5a13-df5f-47a2-87f3-235bb6a982e9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=105b5a13-df5f-47a2-87f3-235bb6a982e9&#xA;Pipeline run with id=105b5a13-df5f-47a2-87f3-235bb6a982e9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=105b5a13-df5f-47a2-87f3-235bb6a982e9&#xA;Pipeline run with id=105b5a13-df5f-47a2-87f3-235bb6a982e9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=105b5a13-df5f-47a2-87f3-235bb6a982e9&#xA;Pipeline run with id=105b5a13-df5f-47a2-87f3-235bb6a982e9 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/parallel_for_after_dependency.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=105b5a13-df5f-47a2-87f3-235bb6a982e9&#xA;Get a pipeline run with id=105b5a13-df5f-47a2-87f3-235bb6a982e9&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/14/26 16:26:08.898 (2m15.655s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/14/26 16:26:08.898&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 105b5a13-df5f-47a2-87f3-235bb6a982e9&#xA;Failed to terminate run 105b5a13-df5f-47a2-87f3-235bb6a982e9&#xA;Terminate run 105b5a13-df5f-47a2-87f3-235bb6a982e9&#xA;Deleting run 105b5a13-df5f-47a2-87f3-235bb6a982e9&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=0c6d3bab-fdb6-4bd6-bb3d-3c884dec7768 (cascade=true)&#xA;Pipeline with id=0c6d3bab-fdb6-4bd6-bb3d-3c884dec7768, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/14/26 16:26:09.104 (206ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/14/26 16:26:09.105&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/14/26 16:26:09.105 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/14/26 16:26:09.105&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/14/26 16:26:09.105 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/pipeline_with_artifact_upload_download.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="141.245280103">
              <system-out>2026/07/14 16:26:14 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/14/26 16:23:52.836&#xA;Create an experiment with name E2EExperiment-1784046232836294800&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/14/26 16:23:53.144 (308ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/14/26 16:23:53.144&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x3250b8b98980&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/14/26 16:23:53.244 (100ms)&#xA;&gt; Enter [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/14/26 16:23:53.244&#xA;Uploading pipeline file critical/pipeline_with_artifact_upload_download.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1784046233144469749, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml&#xA;Upload of pipeline file &#39;critical/pipeline_with_artifact_upload_download.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 907b0503-dd4f-438f-971e-1e3b0d1546e9&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;907b0503-dd4f-438f-971e-1e3b0d1546e9&#39; and name: &#39;e2e-test-1784046233144469749&#39;&#xA;Create a pipeline run for pipeline with id=907b0503-dd4f-438f-971e-1e3b0d1546e9 and versionId=cd6bcb9c-ac3f-400c-9be5-27b604541513&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=d7b86c14-6346-4a2b-9694-efebce86d434&#xA;Created Pipeline Run with id: d7b86c14-6346-4a2b-9694-efebce86d434 for pipeline with id: 907b0503-dd4f-438f-971e-1e3b0d1546e9&#xA;Waiting for pipeline run with id=d7b86c14-6346-4a2b-9694-efebce86d434 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=d7b86c14-6346-4a2b-9694-efebce86d434&#xA;Pipeline run with id=d7b86c14-6346-4a2b-9694-efebce86d434 is in PENDING state, waiting...&#xA;Get a pipeline run with id=d7b86c14-6346-4a2b-9694-efebce86d434&#xA;Pipeline run with id=d7b86c14-6346-4a2b-9694-efebce86d434 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d7b86c14-6346-4a2b-9694-efebce86d434&#xA;Pipeline run with id=d7b86c14-6346-4a2b-9694-efebce86d434 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d7b86c14-6346-4a2b-9694-efebce86d434&#xA;Pipeline run with id=d7b86c14-6346-4a2b-9694-efebce86d434 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d7b86c14-6346-4a2b-9694-efebce86d434&#xA;Pipeline run with id=d7b86c14-6346-4a2b-9694-efebce86d434 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d7b86c14-6346-4a2b-9694-efebce86d434&#xA;Pipeline run with id=d7b86c14-6346-4a2b-9694-efebce86d434 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d7b86c14-6346-4a2b-9694-efebce86d434&#xA;Pipeline run with id=d7b86c14-6346-4a2b-9694-efebce86d434 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d7b86c14-6346-4a2b-9694-efebce86d434&#xA;Pipeline run with id=d7b86c14-6346-4a2b-9694-efebce86d434 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d7b86c14-6346-4a2b-9694-efebce86d434&#xA;Pipeline run with id=d7b86c14-6346-4a2b-9694-efebce86d434 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d7b86c14-6346-4a2b-9694-efebce86d434&#xA;Pipeline run with id=d7b86c14-6346-4a2b-9694-efebce86d434 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d7b86c14-6346-4a2b-9694-efebce86d434&#xA;Pipeline run with id=d7b86c14-6346-4a2b-9694-efebce86d434 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d7b86c14-6346-4a2b-9694-efebce86d434&#xA;Pipeline run with id=d7b86c14-6346-4a2b-9694-efebce86d434 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d7b86c14-6346-4a2b-9694-efebce86d434&#xA;Pipeline run with id=d7b86c14-6346-4a2b-9694-efebce86d434 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d7b86c14-6346-4a2b-9694-efebce86d434&#xA;Pipeline run with id=d7b86c14-6346-4a2b-9694-efebce86d434 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d7b86c14-6346-4a2b-9694-efebce86d434&#xA;Pipeline run with id=d7b86c14-6346-4a2b-9694-efebce86d434 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d7b86c14-6346-4a2b-9694-efebce86d434&#xA;Pipeline run with id=d7b86c14-6346-4a2b-9694-efebce86d434 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d7b86c14-6346-4a2b-9694-efebce86d434&#xA;Pipeline run with id=d7b86c14-6346-4a2b-9694-efebce86d434 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d7b86c14-6346-4a2b-9694-efebce86d434&#xA;Pipeline run with id=d7b86c14-6346-4a2b-9694-efebce86d434 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d7b86c14-6346-4a2b-9694-efebce86d434&#xA;Pipeline run with id=d7b86c14-6346-4a2b-9694-efebce86d434 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d7b86c14-6346-4a2b-9694-efebce86d434&#xA;Pipeline run with id=d7b86c14-6346-4a2b-9694-efebce86d434 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d7b86c14-6346-4a2b-9694-efebce86d434&#xA;Pipeline run with id=d7b86c14-6346-4a2b-9694-efebce86d434 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d7b86c14-6346-4a2b-9694-efebce86d434&#xA;Pipeline run with id=d7b86c14-6346-4a2b-9694-efebce86d434 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d7b86c14-6346-4a2b-9694-efebce86d434&#xA;Pipeline run with id=d7b86c14-6346-4a2b-9694-efebce86d434 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d7b86c14-6346-4a2b-9694-efebce86d434&#xA;Pipeline run with id=d7b86c14-6346-4a2b-9694-efebce86d434 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d7b86c14-6346-4a2b-9694-efebce86d434&#xA;Pipeline run with id=d7b86c14-6346-4a2b-9694-efebce86d434 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d7b86c14-6346-4a2b-9694-efebce86d434&#xA;Pipeline run with id=d7b86c14-6346-4a2b-9694-efebce86d434 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d7b86c14-6346-4a2b-9694-efebce86d434&#xA;Pipeline run with id=d7b86c14-6346-4a2b-9694-efebce86d434 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d7b86c14-6346-4a2b-9694-efebce86d434&#xA;Pipeline run with id=d7b86c14-6346-4a2b-9694-efebce86d434 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d7b86c14-6346-4a2b-9694-efebce86d434&#xA;Pipeline run with id=d7b86c14-6346-4a2b-9694-efebce86d434 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/pipeline_with_artifact_upload_download.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=d7b86c14-6346-4a2b-9694-efebce86d434&#xA;Get a pipeline run with id=d7b86c14-6346-4a2b-9694-efebce86d434&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/14/26 16:26:13.856 (2m20.613s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/14/26 16:26:13.857&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run d7b86c14-6346-4a2b-9694-efebce86d434&#xA;Failed to terminate run d7b86c14-6346-4a2b-9694-efebce86d434&#xA;Terminate run d7b86c14-6346-4a2b-9694-efebce86d434&#xA;Deleting run d7b86c14-6346-4a2b-9694-efebce86d434&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=907b0503-dd4f-438f-971e-1e3b0d1546e9 (cascade=true)&#xA;Pipeline with id=907b0503-dd4f-438f-971e-1e3b0d1546e9, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/14/26 16:26:14.081 (224ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/14/26 16:26:14.081&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/14/26 16:26:14.081 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/14/26 16:26:14.081&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/14/26 16:26:14.081 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/flip_coin.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="141.286027145">
              <system-out>2026/07/14 16:26:14 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/14/26 16:23:52.836&#xA;Create an experiment with name E2EExperiment-1784046232836154561&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/14/26 16:23:53.136 (300ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/14/26 16:23:53.136&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x331cd9438c00&#xA;test-secret-1 created&#xA;test-secret-2 created&#xA;test-secret-3 created&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/14/26 16:23:53.191 (55ms)&#xA;&gt; Enter [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/14/26 16:23:53.191&#xA;Uploading pipeline file critical/flip_coin.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1784046233136645240, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml&#xA;Upload of pipeline file &#39;critical/flip_coin.yaml&#39; successful&#xA;Listing pipeline versions for pipeline e370653a-6688-457f-96cf-b46abea6dede&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;e370653a-6688-457f-96cf-b46abea6dede&#39; and name: &#39;e2e-test-1784046233136645240&#39;&#xA;Create a pipeline run for pipeline with id=e370653a-6688-457f-96cf-b46abea6dede and versionId=9ecb703d-1aa7-42b2-b296-b273bb0f692b&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=9e5cc4fd-d766-4e2a-8de8-5bc495159205&#xA;Created Pipeline Run with id: 9e5cc4fd-d766-4e2a-8de8-5bc495159205 for pipeline with id: e370653a-6688-457f-96cf-b46abea6dede&#xA;Waiting for pipeline run with id=9e5cc4fd-d766-4e2a-8de8-5bc495159205 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=9e5cc4fd-d766-4e2a-8de8-5bc495159205&#xA;Pipeline run with id=9e5cc4fd-d766-4e2a-8de8-5bc495159205 is in PENDING state, waiting...&#xA;Get a pipeline run with id=9e5cc4fd-d766-4e2a-8de8-5bc495159205&#xA;Pipeline run with id=9e5cc4fd-d766-4e2a-8de8-5bc495159205 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9e5cc4fd-d766-4e2a-8de8-5bc495159205&#xA;Pipeline run with id=9e5cc4fd-d766-4e2a-8de8-5bc495159205 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9e5cc4fd-d766-4e2a-8de8-5bc495159205&#xA;Pipeline run with id=9e5cc4fd-d766-4e2a-8de8-5bc495159205 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9e5cc4fd-d766-4e2a-8de8-5bc495159205&#xA;Pipeline run with id=9e5cc4fd-d766-4e2a-8de8-5bc495159205 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9e5cc4fd-d766-4e2a-8de8-5bc495159205&#xA;Pipeline run with id=9e5cc4fd-d766-4e2a-8de8-5bc495159205 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9e5cc4fd-d766-4e2a-8de8-5bc495159205&#xA;Pipeline run with id=9e5cc4fd-d766-4e2a-8de8-5bc495159205 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9e5cc4fd-d766-4e2a-8de8-5bc495159205&#xA;Pipeline run with id=9e5cc4fd-d766-4e2a-8de8-5bc495159205 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9e5cc4fd-d766-4e2a-8de8-5bc495159205&#xA;Pipeline run with id=9e5cc4fd-d766-4e2a-8de8-5bc495159205 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9e5cc4fd-d766-4e2a-8de8-5bc495159205&#xA;Pipeline run with id=9e5cc4fd-d766-4e2a-8de8-5bc495159205 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9e5cc4fd-d766-4e2a-8de8-5bc495159205&#xA;Pipeline run with id=9e5cc4fd-d766-4e2a-8de8-5bc495159205 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9e5cc4fd-d766-4e2a-8de8-5bc495159205&#xA;Pipeline run with id=9e5cc4fd-d766-4e2a-8de8-5bc495159205 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9e5cc4fd-d766-4e2a-8de8-5bc495159205&#xA;Pipeline run with id=9e5cc4fd-d766-4e2a-8de8-5bc495159205 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9e5cc4fd-d766-4e2a-8de8-5bc495159205&#xA;Pipeline run with id=9e5cc4fd-d766-4e2a-8de8-5bc495159205 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9e5cc4fd-d766-4e2a-8de8-5bc495159205&#xA;Pipeline run with id=9e5cc4fd-d766-4e2a-8de8-5bc495159205 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9e5cc4fd-d766-4e2a-8de8-5bc495159205&#xA;Pipeline run with id=9e5cc4fd-d766-4e2a-8de8-5bc495159205 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9e5cc4fd-d766-4e2a-8de8-5bc495159205&#xA;Pipeline run with id=9e5cc4fd-d766-4e2a-8de8-5bc495159205 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9e5cc4fd-d766-4e2a-8de8-5bc495159205&#xA;Pipeline run with id=9e5cc4fd-d766-4e2a-8de8-5bc495159205 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9e5cc4fd-d766-4e2a-8de8-5bc495159205&#xA;Pipeline run with id=9e5cc4fd-d766-4e2a-8de8-5bc495159205 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9e5cc4fd-d766-4e2a-8de8-5bc495159205&#xA;Pipeline run with id=9e5cc4fd-d766-4e2a-8de8-5bc495159205 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9e5cc4fd-d766-4e2a-8de8-5bc495159205&#xA;Pipeline run with id=9e5cc4fd-d766-4e2a-8de8-5bc495159205 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9e5cc4fd-d766-4e2a-8de8-5bc495159205&#xA;Pipeline run with id=9e5cc4fd-d766-4e2a-8de8-5bc495159205 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9e5cc4fd-d766-4e2a-8de8-5bc495159205&#xA;Pipeline run with id=9e5cc4fd-d766-4e2a-8de8-5bc495159205 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9e5cc4fd-d766-4e2a-8de8-5bc495159205&#xA;Pipeline run with id=9e5cc4fd-d766-4e2a-8de8-5bc495159205 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9e5cc4fd-d766-4e2a-8de8-5bc495159205&#xA;Pipeline run with id=9e5cc4fd-d766-4e2a-8de8-5bc495159205 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9e5cc4fd-d766-4e2a-8de8-5bc495159205&#xA;Pipeline run with id=9e5cc4fd-d766-4e2a-8de8-5bc495159205 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9e5cc4fd-d766-4e2a-8de8-5bc495159205&#xA;Pipeline run with id=9e5cc4fd-d766-4e2a-8de8-5bc495159205 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9e5cc4fd-d766-4e2a-8de8-5bc495159205&#xA;Pipeline run with id=9e5cc4fd-d766-4e2a-8de8-5bc495159205 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9e5cc4fd-d766-4e2a-8de8-5bc495159205&#xA;Pipeline run with id=9e5cc4fd-d766-4e2a-8de8-5bc495159205 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/flip_coin.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=9e5cc4fd-d766-4e2a-8de8-5bc495159205&#xA;Get a pipeline run with id=9e5cc4fd-d766-4e2a-8de8-5bc495159205&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/14/26 16:26:13.898 (2m20.707s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/14/26 16:26:13.898&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 9e5cc4fd-d766-4e2a-8de8-5bc495159205&#xA;Failed to terminate run 9e5cc4fd-d766-4e2a-8de8-5bc495159205&#xA;Terminate run 9e5cc4fd-d766-4e2a-8de8-5bc495159205&#xA;Deleting run 9e5cc4fd-d766-4e2a-8de8-5bc495159205&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=e370653a-6688-457f-96cf-b46abea6dede (cascade=true)&#xA;Pipeline with id=e370653a-6688-457f-96cf-b46abea6dede, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/14/26 16:26:14.122 (223ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/14/26 16:26:14.122&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/14/26 16:26:14.122 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/14/26 16:26:14.122&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/14/26 16:26:14.122 (0s)&#xA;</system-err>
          </testcase>
      </testsuite>
  </testsuites>