<?xml version="1.0" encoding="UTF-8"?>
  <testsuites tests="5" disabled="0" errors="0" failures="0" time="186.281648395">
      <testsuite name="AIPipelinesE2ETests" package="/dspa/backend/test/end2end" tests="5" disabled="0" skipped="0" errors="0" failures="0" time="186.281648395" timestamp="2026-07-07T05:32:13">
          <properties>
              <property name="SuiteSucceeded" value="true"></property>
              <property name="SuiteHasProgrammaticFocus" value="false"></property>
              <property name="SpecialSuiteFailureReason" value=""></property>
              <property name="SuiteLabels" value="[]"></property>
              <property name="SuiteSemVerConstraints" value="[]"></property>
              <property name="RandomSeed" value="1783402174"></property>
              <property name="RandomizeAllSpecs" value="false"></property>
              <property name="LabelFilter" value="Smoke"></property>
              <property name="SemVerFilter" value=""></property>
              <property name="FocusStrings" value=""></property>
              <property name="SkipStrings" value=""></property>
              <property name="FocusFiles" value=""></property>
              <property name="SkipFiles" value=""></property>
              <property name="FailOnPending" value="false"></property>
              <property name="FailOnEmpty" value="false"></property>
              <property name="FailFast" value="false"></property>
              <property name="FlakeAttempts" value="0"></property>
              <property name="DryRun" value="false"></property>
              <property name="ParallelTotal" value="10"></property>
              <property name="OutputInterceptorMode" value=""></property>
          </properties>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload essential/iris_pipeline_compiled.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="186.121776601">
              <system-out>2026/07/07 05:35:20 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/07/26 05:32:13.923&#xA;Create an experiment with name E2EExperiment-1783402333923547663&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/07/26 05:32:14.221 (298ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/07/26 05:32:14.221&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x207e20194300&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/07/26 05:32:14.342 (121ms)&#xA;&gt; Enter [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/07/26 05:32:14.343&#xA;Uploading pipeline file essential/iris_pipeline_compiled.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1783402334221517382, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml&#xA;Upload of pipeline file &#39;essential/iris_pipeline_compiled.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 946c122c-de1f-495d-be48-8535afac0d40&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;946c122c-de1f-495d-be48-8535afac0d40&#39; and name: &#39;e2e-test-1783402334221517382&#39;&#xA;Create a pipeline run for pipeline with id=946c122c-de1f-495d-be48-8535afac0d40 and versionId=8f6d69e7-5f19-461c-a32f-fc167b64dbff&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=4167e6ff-63a2-433c-ab6f-d89302528dc3&#xA;Created Pipeline Run with id: 4167e6ff-63a2-433c-ab6f-d89302528dc3 for pipeline with id: 946c122c-de1f-495d-be48-8535afac0d40&#xA;Waiting for pipeline run with id=4167e6ff-63a2-433c-ab6f-d89302528dc3 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=4167e6ff-63a2-433c-ab6f-d89302528dc3&#xA;Pipeline run with id=4167e6ff-63a2-433c-ab6f-d89302528dc3 is in PENDING state, waiting...&#xA;Get a pipeline run with id=4167e6ff-63a2-433c-ab6f-d89302528dc3&#xA;Pipeline run with id=4167e6ff-63a2-433c-ab6f-d89302528dc3 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4167e6ff-63a2-433c-ab6f-d89302528dc3&#xA;Pipeline run with id=4167e6ff-63a2-433c-ab6f-d89302528dc3 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4167e6ff-63a2-433c-ab6f-d89302528dc3&#xA;Pipeline run with id=4167e6ff-63a2-433c-ab6f-d89302528dc3 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4167e6ff-63a2-433c-ab6f-d89302528dc3&#xA;Pipeline run with id=4167e6ff-63a2-433c-ab6f-d89302528dc3 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4167e6ff-63a2-433c-ab6f-d89302528dc3&#xA;Pipeline run with id=4167e6ff-63a2-433c-ab6f-d89302528dc3 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4167e6ff-63a2-433c-ab6f-d89302528dc3&#xA;Pipeline run with id=4167e6ff-63a2-433c-ab6f-d89302528dc3 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4167e6ff-63a2-433c-ab6f-d89302528dc3&#xA;Pipeline run with id=4167e6ff-63a2-433c-ab6f-d89302528dc3 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4167e6ff-63a2-433c-ab6f-d89302528dc3&#xA;Pipeline run with id=4167e6ff-63a2-433c-ab6f-d89302528dc3 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4167e6ff-63a2-433c-ab6f-d89302528dc3&#xA;Pipeline run with id=4167e6ff-63a2-433c-ab6f-d89302528dc3 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4167e6ff-63a2-433c-ab6f-d89302528dc3&#xA;Pipeline run with id=4167e6ff-63a2-433c-ab6f-d89302528dc3 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4167e6ff-63a2-433c-ab6f-d89302528dc3&#xA;Pipeline run with id=4167e6ff-63a2-433c-ab6f-d89302528dc3 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4167e6ff-63a2-433c-ab6f-d89302528dc3&#xA;Pipeline run with id=4167e6ff-63a2-433c-ab6f-d89302528dc3 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4167e6ff-63a2-433c-ab6f-d89302528dc3&#xA;Pipeline run with id=4167e6ff-63a2-433c-ab6f-d89302528dc3 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4167e6ff-63a2-433c-ab6f-d89302528dc3&#xA;Pipeline run with id=4167e6ff-63a2-433c-ab6f-d89302528dc3 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4167e6ff-63a2-433c-ab6f-d89302528dc3&#xA;Pipeline run with id=4167e6ff-63a2-433c-ab6f-d89302528dc3 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4167e6ff-63a2-433c-ab6f-d89302528dc3&#xA;Pipeline run with id=4167e6ff-63a2-433c-ab6f-d89302528dc3 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4167e6ff-63a2-433c-ab6f-d89302528dc3&#xA;Pipeline run with id=4167e6ff-63a2-433c-ab6f-d89302528dc3 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4167e6ff-63a2-433c-ab6f-d89302528dc3&#xA;Pipeline run with id=4167e6ff-63a2-433c-ab6f-d89302528dc3 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4167e6ff-63a2-433c-ab6f-d89302528dc3&#xA;Pipeline run with id=4167e6ff-63a2-433c-ab6f-d89302528dc3 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4167e6ff-63a2-433c-ab6f-d89302528dc3&#xA;Pipeline run with id=4167e6ff-63a2-433c-ab6f-d89302528dc3 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4167e6ff-63a2-433c-ab6f-d89302528dc3&#xA;Pipeline run with id=4167e6ff-63a2-433c-ab6f-d89302528dc3 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4167e6ff-63a2-433c-ab6f-d89302528dc3&#xA;Pipeline run with id=4167e6ff-63a2-433c-ab6f-d89302528dc3 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4167e6ff-63a2-433c-ab6f-d89302528dc3&#xA;Pipeline run with id=4167e6ff-63a2-433c-ab6f-d89302528dc3 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4167e6ff-63a2-433c-ab6f-d89302528dc3&#xA;Pipeline run with id=4167e6ff-63a2-433c-ab6f-d89302528dc3 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4167e6ff-63a2-433c-ab6f-d89302528dc3&#xA;Pipeline run with id=4167e6ff-63a2-433c-ab6f-d89302528dc3 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4167e6ff-63a2-433c-ab6f-d89302528dc3&#xA;Pipeline run with id=4167e6ff-63a2-433c-ab6f-d89302528dc3 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4167e6ff-63a2-433c-ab6f-d89302528dc3&#xA;Pipeline run with id=4167e6ff-63a2-433c-ab6f-d89302528dc3 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4167e6ff-63a2-433c-ab6f-d89302528dc3&#xA;Pipeline run with id=4167e6ff-63a2-433c-ab6f-d89302528dc3 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4167e6ff-63a2-433c-ab6f-d89302528dc3&#xA;Pipeline run with id=4167e6ff-63a2-433c-ab6f-d89302528dc3 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4167e6ff-63a2-433c-ab6f-d89302528dc3&#xA;Pipeline run with id=4167e6ff-63a2-433c-ab6f-d89302528dc3 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4167e6ff-63a2-433c-ab6f-d89302528dc3&#xA;Pipeline run with id=4167e6ff-63a2-433c-ab6f-d89302528dc3 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4167e6ff-63a2-433c-ab6f-d89302528dc3&#xA;Pipeline run with id=4167e6ff-63a2-433c-ab6f-d89302528dc3 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4167e6ff-63a2-433c-ab6f-d89302528dc3&#xA;Pipeline run with id=4167e6ff-63a2-433c-ab6f-d89302528dc3 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4167e6ff-63a2-433c-ab6f-d89302528dc3&#xA;Pipeline run with id=4167e6ff-63a2-433c-ab6f-d89302528dc3 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4167e6ff-63a2-433c-ab6f-d89302528dc3&#xA;Pipeline run with id=4167e6ff-63a2-433c-ab6f-d89302528dc3 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4167e6ff-63a2-433c-ab6f-d89302528dc3&#xA;Pipeline run with id=4167e6ff-63a2-433c-ab6f-d89302528dc3 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4167e6ff-63a2-433c-ab6f-d89302528dc3&#xA;Pipeline run with id=4167e6ff-63a2-433c-ab6f-d89302528dc3 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;essential/iris_pipeline_compiled.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=4167e6ff-63a2-433c-ab6f-d89302528dc3&#xA;Get a pipeline run with id=4167e6ff-63a2-433c-ab6f-d89302528dc3&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/07/26 05:35:19.892 (3m5.549s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/07/26 05:35:19.892&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 4167e6ff-63a2-433c-ab6f-d89302528dc3&#xA;Failed to terminate run 4167e6ff-63a2-433c-ab6f-d89302528dc3&#xA;Terminate run 4167e6ff-63a2-433c-ab6f-d89302528dc3&#xA;Deleting run 4167e6ff-63a2-433c-ab6f-d89302528dc3&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=946c122c-de1f-495d-be48-8535afac0d40 (cascade=true)&#xA;Pipeline with id=946c122c-de1f-495d-be48-8535afac0d40, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/07/26 05:35:20.045 (152ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/07/26 05:35:20.045&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/07/26 05:35:20.045 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/07/26 05:35:20.045&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/07/26 05:35:20.045 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload essential/component_with_pip_index_urls.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="81.273629401">
              <system-out>2026/07/07 05:33:35 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/07/26 05:32:13.923&#xA;Create an experiment with name E2EExperiment-1783402333923525851&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/07/26 05:32:14.119 (196ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/07/26 05:32:14.119&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x17837338a180&#xA;test-secret-1 created&#xA;test-secret-2 created&#xA;test-secret-3 created&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/07/26 05:32:14.199 (80ms)&#xA;&gt; Enter [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/07/26 05:32:14.2&#xA;Uploading pipeline file essential/component_with_pip_index_urls.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1783402334119775665, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml&#xA;Upload of pipeline file &#39;essential/component_with_pip_index_urls.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 6e64e5f6-a2b4-4fca-9e1c-a17149b3941d&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;6e64e5f6-a2b4-4fca-9e1c-a17149b3941d&#39; and name: &#39;e2e-test-1783402334119775665&#39;&#xA;Create a pipeline run for pipeline with id=6e64e5f6-a2b4-4fca-9e1c-a17149b3941d and versionId=ec300373-55f6-43e8-a4af-838b462e3246&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=be3339bf-f46c-4bde-865b-cab84f9d38b9&#xA;Created Pipeline Run with id: be3339bf-f46c-4bde-865b-cab84f9d38b9 for pipeline with id: 6e64e5f6-a2b4-4fca-9e1c-a17149b3941d&#xA;Waiting for pipeline run with id=be3339bf-f46c-4bde-865b-cab84f9d38b9 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=be3339bf-f46c-4bde-865b-cab84f9d38b9&#xA;Pipeline run with id=be3339bf-f46c-4bde-865b-cab84f9d38b9 is in PENDING state, waiting...&#xA;Get a pipeline run with id=be3339bf-f46c-4bde-865b-cab84f9d38b9&#xA;Pipeline run with id=be3339bf-f46c-4bde-865b-cab84f9d38b9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=be3339bf-f46c-4bde-865b-cab84f9d38b9&#xA;Pipeline run with id=be3339bf-f46c-4bde-865b-cab84f9d38b9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=be3339bf-f46c-4bde-865b-cab84f9d38b9&#xA;Pipeline run with id=be3339bf-f46c-4bde-865b-cab84f9d38b9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=be3339bf-f46c-4bde-865b-cab84f9d38b9&#xA;Pipeline run with id=be3339bf-f46c-4bde-865b-cab84f9d38b9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=be3339bf-f46c-4bde-865b-cab84f9d38b9&#xA;Pipeline run with id=be3339bf-f46c-4bde-865b-cab84f9d38b9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=be3339bf-f46c-4bde-865b-cab84f9d38b9&#xA;Pipeline run with id=be3339bf-f46c-4bde-865b-cab84f9d38b9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=be3339bf-f46c-4bde-865b-cab84f9d38b9&#xA;Pipeline run with id=be3339bf-f46c-4bde-865b-cab84f9d38b9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=be3339bf-f46c-4bde-865b-cab84f9d38b9&#xA;Pipeline run with id=be3339bf-f46c-4bde-865b-cab84f9d38b9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=be3339bf-f46c-4bde-865b-cab84f9d38b9&#xA;Pipeline run with id=be3339bf-f46c-4bde-865b-cab84f9d38b9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=be3339bf-f46c-4bde-865b-cab84f9d38b9&#xA;Pipeline run with id=be3339bf-f46c-4bde-865b-cab84f9d38b9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=be3339bf-f46c-4bde-865b-cab84f9d38b9&#xA;Pipeline run with id=be3339bf-f46c-4bde-865b-cab84f9d38b9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=be3339bf-f46c-4bde-865b-cab84f9d38b9&#xA;Pipeline run with id=be3339bf-f46c-4bde-865b-cab84f9d38b9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=be3339bf-f46c-4bde-865b-cab84f9d38b9&#xA;Pipeline run with id=be3339bf-f46c-4bde-865b-cab84f9d38b9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=be3339bf-f46c-4bde-865b-cab84f9d38b9&#xA;Pipeline run with id=be3339bf-f46c-4bde-865b-cab84f9d38b9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=be3339bf-f46c-4bde-865b-cab84f9d38b9&#xA;Pipeline run with id=be3339bf-f46c-4bde-865b-cab84f9d38b9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=be3339bf-f46c-4bde-865b-cab84f9d38b9&#xA;Pipeline run with id=be3339bf-f46c-4bde-865b-cab84f9d38b9 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;essential/component_with_pip_index_urls.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=be3339bf-f46c-4bde-865b-cab84f9d38b9&#xA;Get a pipeline run with id=be3339bf-f46c-4bde-865b-cab84f9d38b9&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/07/26 05:33:34.921 (1m20.722s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/07/26 05:33:34.922&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run be3339bf-f46c-4bde-865b-cab84f9d38b9&#xA;Failed to terminate run be3339bf-f46c-4bde-865b-cab84f9d38b9&#xA;Terminate run be3339bf-f46c-4bde-865b-cab84f9d38b9&#xA;Deleting run be3339bf-f46c-4bde-865b-cab84f9d38b9&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=6e64e5f6-a2b4-4fca-9e1c-a17149b3941d (cascade=true)&#xA;Pipeline with id=6e64e5f6-a2b4-4fca-9e1c-a17149b3941d, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/07/26 05:33:35.196 (275ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/07/26 05:33:35.197&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/07/26 05:33:35.197 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/07/26 05:33:35.197&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/07/26 05:33:35.197 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/parallel_for_after_dependency.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="121.427099353">
              <system-out>2026/07/07 05:34:15 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/07/26 05:32:13.923&#xA;Create an experiment with name E2EExperiment-1783402333923293035&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/07/26 05:32:14.125 (202ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/07/26 05:32:14.125&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x1de329178200&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/07/26 05:32:14.251 (126ms)&#xA;&gt; Enter [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/07/26 05:32:14.252&#xA;Uploading pipeline file critical/parallel_for_after_dependency.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1783402334125954269, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml&#xA;Upload of pipeline file &#39;critical/parallel_for_after_dependency.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 869cef1f-20cb-4bae-a1cb-81d15366ff2f&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;869cef1f-20cb-4bae-a1cb-81d15366ff2f&#39; and name: &#39;e2e-test-1783402334125954269&#39;&#xA;Create a pipeline run for pipeline with id=869cef1f-20cb-4bae-a1cb-81d15366ff2f and versionId=2bd67556-a9aa-4bbb-9bc8-6e5052f91075&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=713accd0-aba7-4c40-947b-740e07ac77ed&#xA;Created Pipeline Run with id: 713accd0-aba7-4c40-947b-740e07ac77ed for pipeline with id: 869cef1f-20cb-4bae-a1cb-81d15366ff2f&#xA;Waiting for pipeline run with id=713accd0-aba7-4c40-947b-740e07ac77ed to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=713accd0-aba7-4c40-947b-740e07ac77ed&#xA;Pipeline run with id=713accd0-aba7-4c40-947b-740e07ac77ed is in PENDING state, waiting...&#xA;Get a pipeline run with id=713accd0-aba7-4c40-947b-740e07ac77ed&#xA;Pipeline run with id=713accd0-aba7-4c40-947b-740e07ac77ed is in RUNNING state, waiting...&#xA;Get a pipeline run with id=713accd0-aba7-4c40-947b-740e07ac77ed&#xA;Pipeline run with id=713accd0-aba7-4c40-947b-740e07ac77ed is in RUNNING state, waiting...&#xA;Get a pipeline run with id=713accd0-aba7-4c40-947b-740e07ac77ed&#xA;Pipeline run with id=713accd0-aba7-4c40-947b-740e07ac77ed is in RUNNING state, waiting...&#xA;Get a pipeline run with id=713accd0-aba7-4c40-947b-740e07ac77ed&#xA;Pipeline run with id=713accd0-aba7-4c40-947b-740e07ac77ed is in RUNNING state, waiting...&#xA;Get a pipeline run with id=713accd0-aba7-4c40-947b-740e07ac77ed&#xA;Pipeline run with id=713accd0-aba7-4c40-947b-740e07ac77ed is in RUNNING state, waiting...&#xA;Get a pipeline run with id=713accd0-aba7-4c40-947b-740e07ac77ed&#xA;Pipeline run with id=713accd0-aba7-4c40-947b-740e07ac77ed is in RUNNING state, waiting...&#xA;Get a pipeline run with id=713accd0-aba7-4c40-947b-740e07ac77ed&#xA;Pipeline run with id=713accd0-aba7-4c40-947b-740e07ac77ed is in RUNNING state, waiting...&#xA;Get a pipeline run with id=713accd0-aba7-4c40-947b-740e07ac77ed&#xA;Pipeline run with id=713accd0-aba7-4c40-947b-740e07ac77ed is in RUNNING state, waiting...&#xA;Get a pipeline run with id=713accd0-aba7-4c40-947b-740e07ac77ed&#xA;Pipeline run with id=713accd0-aba7-4c40-947b-740e07ac77ed is in RUNNING state, waiting...&#xA;Get a pipeline run with id=713accd0-aba7-4c40-947b-740e07ac77ed&#xA;Pipeline run with id=713accd0-aba7-4c40-947b-740e07ac77ed is in RUNNING state, waiting...&#xA;Get a pipeline run with id=713accd0-aba7-4c40-947b-740e07ac77ed&#xA;Pipeline run with id=713accd0-aba7-4c40-947b-740e07ac77ed is in RUNNING state, waiting...&#xA;Get a pipeline run with id=713accd0-aba7-4c40-947b-740e07ac77ed&#xA;Pipeline run with id=713accd0-aba7-4c40-947b-740e07ac77ed is in RUNNING state, waiting...&#xA;Get a pipeline run with id=713accd0-aba7-4c40-947b-740e07ac77ed&#xA;Pipeline run with id=713accd0-aba7-4c40-947b-740e07ac77ed is in RUNNING state, waiting...&#xA;Get a pipeline run with id=713accd0-aba7-4c40-947b-740e07ac77ed&#xA;Pipeline run with id=713accd0-aba7-4c40-947b-740e07ac77ed is in RUNNING state, waiting...&#xA;Get a pipeline run with id=713accd0-aba7-4c40-947b-740e07ac77ed&#xA;Pipeline run with id=713accd0-aba7-4c40-947b-740e07ac77ed is in RUNNING state, waiting...&#xA;Get a pipeline run with id=713accd0-aba7-4c40-947b-740e07ac77ed&#xA;Pipeline run with id=713accd0-aba7-4c40-947b-740e07ac77ed is in RUNNING state, waiting...&#xA;Get a pipeline run with id=713accd0-aba7-4c40-947b-740e07ac77ed&#xA;Pipeline run with id=713accd0-aba7-4c40-947b-740e07ac77ed is in RUNNING state, waiting...&#xA;Get a pipeline run with id=713accd0-aba7-4c40-947b-740e07ac77ed&#xA;Pipeline run with id=713accd0-aba7-4c40-947b-740e07ac77ed is in RUNNING state, waiting...&#xA;Get a pipeline run with id=713accd0-aba7-4c40-947b-740e07ac77ed&#xA;Pipeline run with id=713accd0-aba7-4c40-947b-740e07ac77ed is in RUNNING state, waiting...&#xA;Get a pipeline run with id=713accd0-aba7-4c40-947b-740e07ac77ed&#xA;Pipeline run with id=713accd0-aba7-4c40-947b-740e07ac77ed is in RUNNING state, waiting...&#xA;Get a pipeline run with id=713accd0-aba7-4c40-947b-740e07ac77ed&#xA;Pipeline run with id=713accd0-aba7-4c40-947b-740e07ac77ed is in RUNNING state, waiting...&#xA;Get a pipeline run with id=713accd0-aba7-4c40-947b-740e07ac77ed&#xA;Pipeline run with id=713accd0-aba7-4c40-947b-740e07ac77ed is in RUNNING state, waiting...&#xA;Get a pipeline run with id=713accd0-aba7-4c40-947b-740e07ac77ed&#xA;Pipeline run with id=713accd0-aba7-4c40-947b-740e07ac77ed is in RUNNING state, waiting...&#xA;Get a pipeline run with id=713accd0-aba7-4c40-947b-740e07ac77ed&#xA;Pipeline run with id=713accd0-aba7-4c40-947b-740e07ac77ed reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/parallel_for_after_dependency.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=713accd0-aba7-4c40-947b-740e07ac77ed&#xA;Get a pipeline run with id=713accd0-aba7-4c40-947b-740e07ac77ed&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/07/26 05:34:14.981 (2m0.73s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/07/26 05:34:14.981&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 713accd0-aba7-4c40-947b-740e07ac77ed&#xA;Failed to terminate run 713accd0-aba7-4c40-947b-740e07ac77ed&#xA;Terminate run 713accd0-aba7-4c40-947b-740e07ac77ed&#xA;Deleting run 713accd0-aba7-4c40-947b-740e07ac77ed&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=869cef1f-20cb-4bae-a1cb-81d15366ff2f (cascade=true)&#xA;Pipeline with id=869cef1f-20cb-4bae-a1cb-81d15366ff2f, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/07/26 05:34:15.35 (368ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/07/26 05:34:15.35&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/07/26 05:34:15.35 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/07/26 05:34:15.35&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/07/26 05:34:15.35 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/pipeline_with_artifact_upload_download.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="131.166263293">
              <system-out>2026/07/07 05:34:25 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/07/26 05:32:13.923&#xA;Create an experiment with name E2EExperiment-1783402333923465207&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/07/26 05:32:14.119 (196ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/07/26 05:32:14.119&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x36ec339d2580&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/07/26 05:32:14.266 (147ms)&#xA;&gt; Enter [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/07/26 05:32:14.266&#xA;Uploading pipeline file critical/pipeline_with_artifact_upload_download.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1783402334119653117, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml&#xA;Upload of pipeline file &#39;critical/pipeline_with_artifact_upload_download.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 53128f6f-63f6-4680-aeed-3b4bad7cd856&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;53128f6f-63f6-4680-aeed-3b4bad7cd856&#39; and name: &#39;e2e-test-1783402334119653117&#39;&#xA;Create a pipeline run for pipeline with id=53128f6f-63f6-4680-aeed-3b4bad7cd856 and versionId=04548bec-72d9-4176-b232-11aa5ae4f6a3&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=91cb355a-1b05-4fa1-b627-602a7c432ad1&#xA;Created Pipeline Run with id: 91cb355a-1b05-4fa1-b627-602a7c432ad1 for pipeline with id: 53128f6f-63f6-4680-aeed-3b4bad7cd856&#xA;Waiting for pipeline run with id=91cb355a-1b05-4fa1-b627-602a7c432ad1 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=91cb355a-1b05-4fa1-b627-602a7c432ad1&#xA;Pipeline run with id=91cb355a-1b05-4fa1-b627-602a7c432ad1 is in PENDING state, waiting...&#xA;Get a pipeline run with id=91cb355a-1b05-4fa1-b627-602a7c432ad1&#xA;Pipeline run with id=91cb355a-1b05-4fa1-b627-602a7c432ad1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=91cb355a-1b05-4fa1-b627-602a7c432ad1&#xA;Pipeline run with id=91cb355a-1b05-4fa1-b627-602a7c432ad1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=91cb355a-1b05-4fa1-b627-602a7c432ad1&#xA;Pipeline run with id=91cb355a-1b05-4fa1-b627-602a7c432ad1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=91cb355a-1b05-4fa1-b627-602a7c432ad1&#xA;Pipeline run with id=91cb355a-1b05-4fa1-b627-602a7c432ad1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=91cb355a-1b05-4fa1-b627-602a7c432ad1&#xA;Pipeline run with id=91cb355a-1b05-4fa1-b627-602a7c432ad1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=91cb355a-1b05-4fa1-b627-602a7c432ad1&#xA;Pipeline run with id=91cb355a-1b05-4fa1-b627-602a7c432ad1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=91cb355a-1b05-4fa1-b627-602a7c432ad1&#xA;Pipeline run with id=91cb355a-1b05-4fa1-b627-602a7c432ad1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=91cb355a-1b05-4fa1-b627-602a7c432ad1&#xA;Pipeline run with id=91cb355a-1b05-4fa1-b627-602a7c432ad1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=91cb355a-1b05-4fa1-b627-602a7c432ad1&#xA;Pipeline run with id=91cb355a-1b05-4fa1-b627-602a7c432ad1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=91cb355a-1b05-4fa1-b627-602a7c432ad1&#xA;Pipeline run with id=91cb355a-1b05-4fa1-b627-602a7c432ad1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=91cb355a-1b05-4fa1-b627-602a7c432ad1&#xA;Pipeline run with id=91cb355a-1b05-4fa1-b627-602a7c432ad1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=91cb355a-1b05-4fa1-b627-602a7c432ad1&#xA;Pipeline run with id=91cb355a-1b05-4fa1-b627-602a7c432ad1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=91cb355a-1b05-4fa1-b627-602a7c432ad1&#xA;Pipeline run with id=91cb355a-1b05-4fa1-b627-602a7c432ad1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=91cb355a-1b05-4fa1-b627-602a7c432ad1&#xA;Pipeline run with id=91cb355a-1b05-4fa1-b627-602a7c432ad1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=91cb355a-1b05-4fa1-b627-602a7c432ad1&#xA;Pipeline run with id=91cb355a-1b05-4fa1-b627-602a7c432ad1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=91cb355a-1b05-4fa1-b627-602a7c432ad1&#xA;Pipeline run with id=91cb355a-1b05-4fa1-b627-602a7c432ad1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=91cb355a-1b05-4fa1-b627-602a7c432ad1&#xA;Pipeline run with id=91cb355a-1b05-4fa1-b627-602a7c432ad1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=91cb355a-1b05-4fa1-b627-602a7c432ad1&#xA;Pipeline run with id=91cb355a-1b05-4fa1-b627-602a7c432ad1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=91cb355a-1b05-4fa1-b627-602a7c432ad1&#xA;Pipeline run with id=91cb355a-1b05-4fa1-b627-602a7c432ad1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=91cb355a-1b05-4fa1-b627-602a7c432ad1&#xA;Pipeline run with id=91cb355a-1b05-4fa1-b627-602a7c432ad1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=91cb355a-1b05-4fa1-b627-602a7c432ad1&#xA;Pipeline run with id=91cb355a-1b05-4fa1-b627-602a7c432ad1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=91cb355a-1b05-4fa1-b627-602a7c432ad1&#xA;Pipeline run with id=91cb355a-1b05-4fa1-b627-602a7c432ad1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=91cb355a-1b05-4fa1-b627-602a7c432ad1&#xA;Pipeline run with id=91cb355a-1b05-4fa1-b627-602a7c432ad1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=91cb355a-1b05-4fa1-b627-602a7c432ad1&#xA;Pipeline run with id=91cb355a-1b05-4fa1-b627-602a7c432ad1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=91cb355a-1b05-4fa1-b627-602a7c432ad1&#xA;Pipeline run with id=91cb355a-1b05-4fa1-b627-602a7c432ad1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=91cb355a-1b05-4fa1-b627-602a7c432ad1&#xA;Pipeline run with id=91cb355a-1b05-4fa1-b627-602a7c432ad1 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/pipeline_with_artifact_upload_download.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=91cb355a-1b05-4fa1-b627-602a7c432ad1&#xA;Get a pipeline run with id=91cb355a-1b05-4fa1-b627-602a7c432ad1&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/07/26 05:34:24.933 (2m10.667s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/07/26 05:34:24.934&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 91cb355a-1b05-4fa1-b627-602a7c432ad1&#xA;Failed to terminate run 91cb355a-1b05-4fa1-b627-602a7c432ad1&#xA;Terminate run 91cb355a-1b05-4fa1-b627-602a7c432ad1&#xA;Deleting run 91cb355a-1b05-4fa1-b627-602a7c432ad1&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=53128f6f-63f6-4680-aeed-3b4bad7cd856 (cascade=true)&#xA;Pipeline with id=53128f6f-63f6-4680-aeed-3b4bad7cd856, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/07/26 05:34:25.089 (155ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/07/26 05:34:25.089&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/07/26 05:34:25.09 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/07/26 05:34:25.09&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/07/26 05:34:25.09 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/flip_coin.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="151.247696661">
              <system-out>2026/07/07 05:34:45 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/07/26 05:32:13.923&#xA;Create an experiment with name E2EExperiment-1783402333923019786&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/07/26 05:32:14.125 (202ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/07/26 05:32:14.125&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x286da37a1d80&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/07/26 05:32:14.267 (142ms)&#xA;&gt; Enter [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/07/26 05:32:14.267&#xA;Uploading pipeline file critical/flip_coin.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1783402334125386539, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml&#xA;Upload of pipeline file &#39;critical/flip_coin.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 770511ec-2ca7-4920-92ae-4299be6a38dc&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;770511ec-2ca7-4920-92ae-4299be6a38dc&#39; and name: &#39;e2e-test-1783402334125386539&#39;&#xA;Create a pipeline run for pipeline with id=770511ec-2ca7-4920-92ae-4299be6a38dc and versionId=5475a619-0880-40f5-8859-362104a4a87b&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=40ff6cd2-f2b8-479c-b7f3-2142b4e5ec88&#xA;Created Pipeline Run with id: 40ff6cd2-f2b8-479c-b7f3-2142b4e5ec88 for pipeline with id: 770511ec-2ca7-4920-92ae-4299be6a38dc&#xA;Waiting for pipeline run with id=40ff6cd2-f2b8-479c-b7f3-2142b4e5ec88 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=40ff6cd2-f2b8-479c-b7f3-2142b4e5ec88&#xA;Pipeline run with id=40ff6cd2-f2b8-479c-b7f3-2142b4e5ec88 is in PENDING state, waiting...&#xA;Get a pipeline run with id=40ff6cd2-f2b8-479c-b7f3-2142b4e5ec88&#xA;Pipeline run with id=40ff6cd2-f2b8-479c-b7f3-2142b4e5ec88 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=40ff6cd2-f2b8-479c-b7f3-2142b4e5ec88&#xA;Pipeline run with id=40ff6cd2-f2b8-479c-b7f3-2142b4e5ec88 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=40ff6cd2-f2b8-479c-b7f3-2142b4e5ec88&#xA;Pipeline run with id=40ff6cd2-f2b8-479c-b7f3-2142b4e5ec88 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=40ff6cd2-f2b8-479c-b7f3-2142b4e5ec88&#xA;Pipeline run with id=40ff6cd2-f2b8-479c-b7f3-2142b4e5ec88 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=40ff6cd2-f2b8-479c-b7f3-2142b4e5ec88&#xA;Pipeline run with id=40ff6cd2-f2b8-479c-b7f3-2142b4e5ec88 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=40ff6cd2-f2b8-479c-b7f3-2142b4e5ec88&#xA;Pipeline run with id=40ff6cd2-f2b8-479c-b7f3-2142b4e5ec88 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=40ff6cd2-f2b8-479c-b7f3-2142b4e5ec88&#xA;Pipeline run with id=40ff6cd2-f2b8-479c-b7f3-2142b4e5ec88 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=40ff6cd2-f2b8-479c-b7f3-2142b4e5ec88&#xA;Pipeline run with id=40ff6cd2-f2b8-479c-b7f3-2142b4e5ec88 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=40ff6cd2-f2b8-479c-b7f3-2142b4e5ec88&#xA;Pipeline run with id=40ff6cd2-f2b8-479c-b7f3-2142b4e5ec88 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=40ff6cd2-f2b8-479c-b7f3-2142b4e5ec88&#xA;Pipeline run with id=40ff6cd2-f2b8-479c-b7f3-2142b4e5ec88 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=40ff6cd2-f2b8-479c-b7f3-2142b4e5ec88&#xA;Pipeline run with id=40ff6cd2-f2b8-479c-b7f3-2142b4e5ec88 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=40ff6cd2-f2b8-479c-b7f3-2142b4e5ec88&#xA;Pipeline run with id=40ff6cd2-f2b8-479c-b7f3-2142b4e5ec88 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=40ff6cd2-f2b8-479c-b7f3-2142b4e5ec88&#xA;Pipeline run with id=40ff6cd2-f2b8-479c-b7f3-2142b4e5ec88 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=40ff6cd2-f2b8-479c-b7f3-2142b4e5ec88&#xA;Pipeline run with id=40ff6cd2-f2b8-479c-b7f3-2142b4e5ec88 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=40ff6cd2-f2b8-479c-b7f3-2142b4e5ec88&#xA;Pipeline run with id=40ff6cd2-f2b8-479c-b7f3-2142b4e5ec88 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=40ff6cd2-f2b8-479c-b7f3-2142b4e5ec88&#xA;Pipeline run with id=40ff6cd2-f2b8-479c-b7f3-2142b4e5ec88 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=40ff6cd2-f2b8-479c-b7f3-2142b4e5ec88&#xA;Pipeline run with id=40ff6cd2-f2b8-479c-b7f3-2142b4e5ec88 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=40ff6cd2-f2b8-479c-b7f3-2142b4e5ec88&#xA;Pipeline run with id=40ff6cd2-f2b8-479c-b7f3-2142b4e5ec88 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=40ff6cd2-f2b8-479c-b7f3-2142b4e5ec88&#xA;Pipeline run with id=40ff6cd2-f2b8-479c-b7f3-2142b4e5ec88 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=40ff6cd2-f2b8-479c-b7f3-2142b4e5ec88&#xA;Pipeline run with id=40ff6cd2-f2b8-479c-b7f3-2142b4e5ec88 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=40ff6cd2-f2b8-479c-b7f3-2142b4e5ec88&#xA;Pipeline run with id=40ff6cd2-f2b8-479c-b7f3-2142b4e5ec88 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=40ff6cd2-f2b8-479c-b7f3-2142b4e5ec88&#xA;Pipeline run with id=40ff6cd2-f2b8-479c-b7f3-2142b4e5ec88 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=40ff6cd2-f2b8-479c-b7f3-2142b4e5ec88&#xA;Pipeline run with id=40ff6cd2-f2b8-479c-b7f3-2142b4e5ec88 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=40ff6cd2-f2b8-479c-b7f3-2142b4e5ec88&#xA;Pipeline run with id=40ff6cd2-f2b8-479c-b7f3-2142b4e5ec88 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=40ff6cd2-f2b8-479c-b7f3-2142b4e5ec88&#xA;Pipeline run with id=40ff6cd2-f2b8-479c-b7f3-2142b4e5ec88 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=40ff6cd2-f2b8-479c-b7f3-2142b4e5ec88&#xA;Pipeline run with id=40ff6cd2-f2b8-479c-b7f3-2142b4e5ec88 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=40ff6cd2-f2b8-479c-b7f3-2142b4e5ec88&#xA;Pipeline run with id=40ff6cd2-f2b8-479c-b7f3-2142b4e5ec88 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=40ff6cd2-f2b8-479c-b7f3-2142b4e5ec88&#xA;Pipeline run with id=40ff6cd2-f2b8-479c-b7f3-2142b4e5ec88 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=40ff6cd2-f2b8-479c-b7f3-2142b4e5ec88&#xA;Pipeline run with id=40ff6cd2-f2b8-479c-b7f3-2142b4e5ec88 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=40ff6cd2-f2b8-479c-b7f3-2142b4e5ec88&#xA;Pipeline run with id=40ff6cd2-f2b8-479c-b7f3-2142b4e5ec88 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/flip_coin.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=40ff6cd2-f2b8-479c-b7f3-2142b4e5ec88&#xA;Get a pipeline run with id=40ff6cd2-f2b8-479c-b7f3-2142b4e5ec88&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/07/26 05:34:44.899 (2m30.632s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/07/26 05:34:44.899&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 40ff6cd2-f2b8-479c-b7f3-2142b4e5ec88&#xA;Failed to terminate run 40ff6cd2-f2b8-479c-b7f3-2142b4e5ec88&#xA;Terminate run 40ff6cd2-f2b8-479c-b7f3-2142b4e5ec88&#xA;Deleting run 40ff6cd2-f2b8-479c-b7f3-2142b4e5ec88&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=770511ec-2ca7-4920-92ae-4299be6a38dc (cascade=true)&#xA;Pipeline with id=770511ec-2ca7-4920-92ae-4299be6a38dc, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/07/26 05:34:45.17 (271ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/07/26 05:34:45.171&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/07/26 05:34:45.171 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/07/26 05:34:45.171&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/07/26 05:34:45.171 (0s)&#xA;</system-err>
          </testcase>
      </testsuite>
  </testsuites>