<?xml version="1.0" encoding="UTF-8"?>
  <testsuites tests="5" disabled="0" errors="0" failures="0" time="190.912460246">
      <testsuite name="AIPipelinesE2ETests" package="/dspa/backend/test/end2end" tests="5" disabled="0" skipped="0" errors="0" failures="0" time="190.912460246" timestamp="2026-07-16T16:03:44">
          <properties>
              <property name="SuiteSucceeded" value="true"></property>
              <property name="SuiteHasProgrammaticFocus" value="false"></property>
              <property name="SpecialSuiteFailureReason" value=""></property>
              <property name="SuiteLabels" value="[]"></property>
              <property name="SuiteSemVerConstraints" value="[]"></property>
              <property name="RandomSeed" value="1784217526"></property>
              <property name="RandomizeAllSpecs" value="false"></property>
              <property name="LabelFilter" value="Smoke"></property>
              <property name="SemVerFilter" value=""></property>
              <property name="FocusStrings" value=""></property>
              <property name="SkipStrings" value=""></property>
              <property name="FocusFiles" value=""></property>
              <property name="SkipFiles" value=""></property>
              <property name="FailOnPending" value="false"></property>
              <property name="FailOnEmpty" value="false"></property>
              <property name="FailFast" value="false"></property>
              <property name="FlakeAttempts" value="0"></property>
              <property name="DryRun" value="false"></property>
              <property name="ParallelTotal" value="10"></property>
              <property name="OutputInterceptorMode" value=""></property>
          </properties>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload essential/component_with_pip_index_urls.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="80.760557835">
              <system-out>2026/07/16 16:05:05 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/16/26 16:03:44.59&#xA;Create an experiment with name E2EExperiment-1784217824590527049&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/16/26 16:03:44.722 (132ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/16/26 16:03:44.722&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x1975bda98d80&#xA;test-secret-1 created&#xA;test-secret-2 created&#xA;test-secret-3 created&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/16/26 16:03:44.755 (32ms)&#xA;&gt; Enter [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/16/26 16:03:44.755&#xA;Uploading pipeline file essential/component_with_pip_index_urls.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1784217824722766258, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml&#xA;Upload of pipeline file &#39;essential/component_with_pip_index_urls.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 7586fa04-4e17-4119-8a0c-f83e8443e6a4&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;7586fa04-4e17-4119-8a0c-f83e8443e6a4&#39; and name: &#39;e2e-test-1784217824722766258&#39;&#xA;Create a pipeline run for pipeline with id=7586fa04-4e17-4119-8a0c-f83e8443e6a4 and versionId=41ecdd6c-aa89-4522-85a9-0dba39c487c0&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=6f69c34f-0f0d-44f7-ba99-678a26ad5e96&#xA;Created Pipeline Run with id: 6f69c34f-0f0d-44f7-ba99-678a26ad5e96 for pipeline with id: 7586fa04-4e17-4119-8a0c-f83e8443e6a4&#xA;Waiting for pipeline run with id=6f69c34f-0f0d-44f7-ba99-678a26ad5e96 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=6f69c34f-0f0d-44f7-ba99-678a26ad5e96&#xA;Pipeline run with id=6f69c34f-0f0d-44f7-ba99-678a26ad5e96 is in PENDING state, waiting...&#xA;Get a pipeline run with id=6f69c34f-0f0d-44f7-ba99-678a26ad5e96&#xA;Pipeline run with id=6f69c34f-0f0d-44f7-ba99-678a26ad5e96 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6f69c34f-0f0d-44f7-ba99-678a26ad5e96&#xA;Pipeline run with id=6f69c34f-0f0d-44f7-ba99-678a26ad5e96 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6f69c34f-0f0d-44f7-ba99-678a26ad5e96&#xA;Pipeline run with id=6f69c34f-0f0d-44f7-ba99-678a26ad5e96 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6f69c34f-0f0d-44f7-ba99-678a26ad5e96&#xA;Pipeline run with id=6f69c34f-0f0d-44f7-ba99-678a26ad5e96 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6f69c34f-0f0d-44f7-ba99-678a26ad5e96&#xA;Pipeline run with id=6f69c34f-0f0d-44f7-ba99-678a26ad5e96 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6f69c34f-0f0d-44f7-ba99-678a26ad5e96&#xA;Pipeline run with id=6f69c34f-0f0d-44f7-ba99-678a26ad5e96 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6f69c34f-0f0d-44f7-ba99-678a26ad5e96&#xA;Pipeline run with id=6f69c34f-0f0d-44f7-ba99-678a26ad5e96 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6f69c34f-0f0d-44f7-ba99-678a26ad5e96&#xA;Pipeline run with id=6f69c34f-0f0d-44f7-ba99-678a26ad5e96 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6f69c34f-0f0d-44f7-ba99-678a26ad5e96&#xA;Pipeline run with id=6f69c34f-0f0d-44f7-ba99-678a26ad5e96 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6f69c34f-0f0d-44f7-ba99-678a26ad5e96&#xA;Pipeline run with id=6f69c34f-0f0d-44f7-ba99-678a26ad5e96 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6f69c34f-0f0d-44f7-ba99-678a26ad5e96&#xA;Pipeline run with id=6f69c34f-0f0d-44f7-ba99-678a26ad5e96 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6f69c34f-0f0d-44f7-ba99-678a26ad5e96&#xA;Pipeline run with id=6f69c34f-0f0d-44f7-ba99-678a26ad5e96 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6f69c34f-0f0d-44f7-ba99-678a26ad5e96&#xA;Pipeline run with id=6f69c34f-0f0d-44f7-ba99-678a26ad5e96 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6f69c34f-0f0d-44f7-ba99-678a26ad5e96&#xA;Pipeline run with id=6f69c34f-0f0d-44f7-ba99-678a26ad5e96 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6f69c34f-0f0d-44f7-ba99-678a26ad5e96&#xA;Pipeline run with id=6f69c34f-0f0d-44f7-ba99-678a26ad5e96 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6f69c34f-0f0d-44f7-ba99-678a26ad5e96&#xA;Pipeline run with id=6f69c34f-0f0d-44f7-ba99-678a26ad5e96 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;essential/component_with_pip_index_urls.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=6f69c34f-0f0d-44f7-ba99-678a26ad5e96&#xA;Get a pipeline run with id=6f69c34f-0f0d-44f7-ba99-678a26ad5e96&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/16/26 16:05:05.262 (1m20.507s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/16/26 16:05:05.262&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 6f69c34f-0f0d-44f7-ba99-678a26ad5e96&#xA;Failed to terminate run 6f69c34f-0f0d-44f7-ba99-678a26ad5e96&#xA;Terminate run 6f69c34f-0f0d-44f7-ba99-678a26ad5e96&#xA;Deleting run 6f69c34f-0f0d-44f7-ba99-678a26ad5e96&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=7586fa04-4e17-4119-8a0c-f83e8443e6a4 (cascade=true)&#xA;Pipeline with id=7586fa04-4e17-4119-8a0c-f83e8443e6a4, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/16/26 16:05:05.35 (88ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/16/26 16:05:05.35&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/16/26 16:05:05.35 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/16/26 16:05:05.351&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/16/26 16:05:05.351 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/parallel_for_after_dependency.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="120.873449583">
              <system-out>2026/07/16 16:05:45 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/16/26 16:03:44.59&#xA;Create an experiment with name E2EExperiment-1784217824590131676&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/16/26 16:03:44.722 (132ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/16/26 16:03:44.722&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x19ae73c40700&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/16/26 16:03:44.772 (49ms)&#xA;&gt; Enter [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/16/26 16:03:44.772&#xA;Uploading pipeline file critical/parallel_for_after_dependency.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1784217824722842060, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml&#xA;Upload of pipeline file &#39;critical/parallel_for_after_dependency.yaml&#39; successful&#xA;Listing pipeline versions for pipeline c50c2c4d-d4a3-4464-8349-8007a022935b&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;c50c2c4d-d4a3-4464-8349-8007a022935b&#39; and name: &#39;e2e-test-1784217824722842060&#39;&#xA;Create a pipeline run for pipeline with id=c50c2c4d-d4a3-4464-8349-8007a022935b and versionId=26fdd494-04ed-4ac7-b695-dca7a6fe7080&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=ce24ead7-619e-4552-a20c-81a47f272b29&#xA;Created Pipeline Run with id: ce24ead7-619e-4552-a20c-81a47f272b29 for pipeline with id: c50c2c4d-d4a3-4464-8349-8007a022935b&#xA;Waiting for pipeline run with id=ce24ead7-619e-4552-a20c-81a47f272b29 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=ce24ead7-619e-4552-a20c-81a47f272b29&#xA;Pipeline run with id=ce24ead7-619e-4552-a20c-81a47f272b29 is in PENDING state, waiting...&#xA;Get a pipeline run with id=ce24ead7-619e-4552-a20c-81a47f272b29&#xA;Pipeline run with id=ce24ead7-619e-4552-a20c-81a47f272b29 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ce24ead7-619e-4552-a20c-81a47f272b29&#xA;Pipeline run with id=ce24ead7-619e-4552-a20c-81a47f272b29 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ce24ead7-619e-4552-a20c-81a47f272b29&#xA;Pipeline run with id=ce24ead7-619e-4552-a20c-81a47f272b29 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ce24ead7-619e-4552-a20c-81a47f272b29&#xA;Pipeline run with id=ce24ead7-619e-4552-a20c-81a47f272b29 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ce24ead7-619e-4552-a20c-81a47f272b29&#xA;Pipeline run with id=ce24ead7-619e-4552-a20c-81a47f272b29 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ce24ead7-619e-4552-a20c-81a47f272b29&#xA;Pipeline run with id=ce24ead7-619e-4552-a20c-81a47f272b29 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ce24ead7-619e-4552-a20c-81a47f272b29&#xA;Pipeline run with id=ce24ead7-619e-4552-a20c-81a47f272b29 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ce24ead7-619e-4552-a20c-81a47f272b29&#xA;Pipeline run with id=ce24ead7-619e-4552-a20c-81a47f272b29 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ce24ead7-619e-4552-a20c-81a47f272b29&#xA;Pipeline run with id=ce24ead7-619e-4552-a20c-81a47f272b29 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ce24ead7-619e-4552-a20c-81a47f272b29&#xA;Pipeline run with id=ce24ead7-619e-4552-a20c-81a47f272b29 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ce24ead7-619e-4552-a20c-81a47f272b29&#xA;Pipeline run with id=ce24ead7-619e-4552-a20c-81a47f272b29 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ce24ead7-619e-4552-a20c-81a47f272b29&#xA;Pipeline run with id=ce24ead7-619e-4552-a20c-81a47f272b29 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ce24ead7-619e-4552-a20c-81a47f272b29&#xA;Pipeline run with id=ce24ead7-619e-4552-a20c-81a47f272b29 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ce24ead7-619e-4552-a20c-81a47f272b29&#xA;Pipeline run with id=ce24ead7-619e-4552-a20c-81a47f272b29 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ce24ead7-619e-4552-a20c-81a47f272b29&#xA;Pipeline run with id=ce24ead7-619e-4552-a20c-81a47f272b29 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ce24ead7-619e-4552-a20c-81a47f272b29&#xA;Pipeline run with id=ce24ead7-619e-4552-a20c-81a47f272b29 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ce24ead7-619e-4552-a20c-81a47f272b29&#xA;Pipeline run with id=ce24ead7-619e-4552-a20c-81a47f272b29 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ce24ead7-619e-4552-a20c-81a47f272b29&#xA;Pipeline run with id=ce24ead7-619e-4552-a20c-81a47f272b29 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ce24ead7-619e-4552-a20c-81a47f272b29&#xA;Pipeline run with id=ce24ead7-619e-4552-a20c-81a47f272b29 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ce24ead7-619e-4552-a20c-81a47f272b29&#xA;Pipeline run with id=ce24ead7-619e-4552-a20c-81a47f272b29 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ce24ead7-619e-4552-a20c-81a47f272b29&#xA;Pipeline run with id=ce24ead7-619e-4552-a20c-81a47f272b29 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ce24ead7-619e-4552-a20c-81a47f272b29&#xA;Pipeline run with id=ce24ead7-619e-4552-a20c-81a47f272b29 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ce24ead7-619e-4552-a20c-81a47f272b29&#xA;Pipeline run with id=ce24ead7-619e-4552-a20c-81a47f272b29 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ce24ead7-619e-4552-a20c-81a47f272b29&#xA;Pipeline run with id=ce24ead7-619e-4552-a20c-81a47f272b29 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/parallel_for_after_dependency.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=ce24ead7-619e-4552-a20c-81a47f272b29&#xA;Get a pipeline run with id=ce24ead7-619e-4552-a20c-81a47f272b29&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/16/26 16:05:45.34 (2m0.568s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/16/26 16:05:45.34&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run ce24ead7-619e-4552-a20c-81a47f272b29&#xA;Failed to terminate run ce24ead7-619e-4552-a20c-81a47f272b29&#xA;Terminate run ce24ead7-619e-4552-a20c-81a47f272b29&#xA;Deleting run ce24ead7-619e-4552-a20c-81a47f272b29&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=c50c2c4d-d4a3-4464-8349-8007a022935b (cascade=true)&#xA;Pipeline with id=c50c2c4d-d4a3-4464-8349-8007a022935b, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/16/26 16:05:45.463 (123ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/16/26 16:05:45.463&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/16/26 16:05:45.463 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/16/26 16:05:45.464&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/16/26 16:05:45.464 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/pipeline_with_artifact_upload_download.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="130.817957045">
              <system-out>2026/07/16 16:05:55 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/16/26 16:03:44.589&#xA;Create an experiment with name E2EExperiment-1784217824590002012&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/16/26 16:03:44.722 (133ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/16/26 16:03:44.722&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0xbce7ec56a00&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/16/26 16:03:44.773 (51ms)&#xA;&gt; Enter [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/16/26 16:03:44.773&#xA;Uploading pipeline file critical/pipeline_with_artifact_upload_download.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1784217824722774408, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml&#xA;Upload of pipeline file &#39;critical/pipeline_with_artifact_upload_download.yaml&#39; successful&#xA;Listing pipeline versions for pipeline d5464855-cddb-4ed5-af60-1d57e27671e6&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;d5464855-cddb-4ed5-af60-1d57e27671e6&#39; and name: &#39;e2e-test-1784217824722774408&#39;&#xA;Create a pipeline run for pipeline with id=d5464855-cddb-4ed5-af60-1d57e27671e6 and versionId=f44d0791-53e3-4532-93d9-906c26aa30b4&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=440f56cf-7441-4723-bd02-7118a479287b&#xA;Created Pipeline Run with id: 440f56cf-7441-4723-bd02-7118a479287b for pipeline with id: d5464855-cddb-4ed5-af60-1d57e27671e6&#xA;Waiting for pipeline run with id=440f56cf-7441-4723-bd02-7118a479287b to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=440f56cf-7441-4723-bd02-7118a479287b&#xA;Pipeline run with id=440f56cf-7441-4723-bd02-7118a479287b is in PENDING state, waiting...&#xA;Get a pipeline run with id=440f56cf-7441-4723-bd02-7118a479287b&#xA;Pipeline run with id=440f56cf-7441-4723-bd02-7118a479287b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=440f56cf-7441-4723-bd02-7118a479287b&#xA;Pipeline run with id=440f56cf-7441-4723-bd02-7118a479287b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=440f56cf-7441-4723-bd02-7118a479287b&#xA;Pipeline run with id=440f56cf-7441-4723-bd02-7118a479287b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=440f56cf-7441-4723-bd02-7118a479287b&#xA;Pipeline run with id=440f56cf-7441-4723-bd02-7118a479287b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=440f56cf-7441-4723-bd02-7118a479287b&#xA;Pipeline run with id=440f56cf-7441-4723-bd02-7118a479287b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=440f56cf-7441-4723-bd02-7118a479287b&#xA;Pipeline run with id=440f56cf-7441-4723-bd02-7118a479287b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=440f56cf-7441-4723-bd02-7118a479287b&#xA;Pipeline run with id=440f56cf-7441-4723-bd02-7118a479287b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=440f56cf-7441-4723-bd02-7118a479287b&#xA;Pipeline run with id=440f56cf-7441-4723-bd02-7118a479287b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=440f56cf-7441-4723-bd02-7118a479287b&#xA;Pipeline run with id=440f56cf-7441-4723-bd02-7118a479287b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=440f56cf-7441-4723-bd02-7118a479287b&#xA;Pipeline run with id=440f56cf-7441-4723-bd02-7118a479287b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=440f56cf-7441-4723-bd02-7118a479287b&#xA;Pipeline run with id=440f56cf-7441-4723-bd02-7118a479287b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=440f56cf-7441-4723-bd02-7118a479287b&#xA;Pipeline run with id=440f56cf-7441-4723-bd02-7118a479287b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=440f56cf-7441-4723-bd02-7118a479287b&#xA;Pipeline run with id=440f56cf-7441-4723-bd02-7118a479287b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=440f56cf-7441-4723-bd02-7118a479287b&#xA;Pipeline run with id=440f56cf-7441-4723-bd02-7118a479287b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=440f56cf-7441-4723-bd02-7118a479287b&#xA;Pipeline run with id=440f56cf-7441-4723-bd02-7118a479287b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=440f56cf-7441-4723-bd02-7118a479287b&#xA;Pipeline run with id=440f56cf-7441-4723-bd02-7118a479287b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=440f56cf-7441-4723-bd02-7118a479287b&#xA;Pipeline run with id=440f56cf-7441-4723-bd02-7118a479287b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=440f56cf-7441-4723-bd02-7118a479287b&#xA;Pipeline run with id=440f56cf-7441-4723-bd02-7118a479287b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=440f56cf-7441-4723-bd02-7118a479287b&#xA;Pipeline run with id=440f56cf-7441-4723-bd02-7118a479287b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=440f56cf-7441-4723-bd02-7118a479287b&#xA;Pipeline run with id=440f56cf-7441-4723-bd02-7118a479287b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=440f56cf-7441-4723-bd02-7118a479287b&#xA;Pipeline run with id=440f56cf-7441-4723-bd02-7118a479287b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=440f56cf-7441-4723-bd02-7118a479287b&#xA;Pipeline run with id=440f56cf-7441-4723-bd02-7118a479287b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=440f56cf-7441-4723-bd02-7118a479287b&#xA;Pipeline run with id=440f56cf-7441-4723-bd02-7118a479287b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=440f56cf-7441-4723-bd02-7118a479287b&#xA;Pipeline run with id=440f56cf-7441-4723-bd02-7118a479287b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=440f56cf-7441-4723-bd02-7118a479287b&#xA;Pipeline run with id=440f56cf-7441-4723-bd02-7118a479287b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=440f56cf-7441-4723-bd02-7118a479287b&#xA;Pipeline run with id=440f56cf-7441-4723-bd02-7118a479287b reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/pipeline_with_artifact_upload_download.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=440f56cf-7441-4723-bd02-7118a479287b&#xA;Get a pipeline run with id=440f56cf-7441-4723-bd02-7118a479287b&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/16/26 16:05:55.296 (2m10.523s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/16/26 16:05:55.297&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 440f56cf-7441-4723-bd02-7118a479287b&#xA;Failed to terminate run 440f56cf-7441-4723-bd02-7118a479287b&#xA;Terminate run 440f56cf-7441-4723-bd02-7118a479287b&#xA;Deleting run 440f56cf-7441-4723-bd02-7118a479287b&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=d5464855-cddb-4ed5-af60-1d57e27671e6 (cascade=true)&#xA;Pipeline with id=d5464855-cddb-4ed5-af60-1d57e27671e6, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/16/26 16:05:55.407 (111ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/16/26 16:05:55.408&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/16/26 16:05:55.408 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/16/26 16:05:55.408&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/16/26 16:05:55.408 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/flip_coin.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="165.836633748">
              <system-out>2026/07/16 16:06:30 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/16/26 16:03:44.59&#xA;Create an experiment with name E2EExperiment-1784217824590067534&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/16/26 16:03:44.722 (132ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/16/26 16:03:44.722&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x154b7f26a400&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/16/26 16:03:44.773 (51ms)&#xA;&gt; Enter [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/16/26 16:03:44.774&#xA;Uploading pipeline file critical/flip_coin.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1784217824722765868, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml&#xA;Upload of pipeline file &#39;critical/flip_coin.yaml&#39; successful&#xA;Listing pipeline versions for pipeline ebd60e4a-a7ae-4b96-8c78-07c089751c47&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;ebd60e4a-a7ae-4b96-8c78-07c089751c47&#39; and name: &#39;e2e-test-1784217824722765868&#39;&#xA;Create a pipeline run for pipeline with id=ebd60e4a-a7ae-4b96-8c78-07c089751c47 and versionId=57ac4a72-2a55-4355-9b6e-a36ff123802a&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=3f2fee97-0888-456c-af1d-dc306c153a6f&#xA;Created Pipeline Run with id: 3f2fee97-0888-456c-af1d-dc306c153a6f for pipeline with id: ebd60e4a-a7ae-4b96-8c78-07c089751c47&#xA;Waiting for pipeline run with id=3f2fee97-0888-456c-af1d-dc306c153a6f to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=3f2fee97-0888-456c-af1d-dc306c153a6f&#xA;Pipeline run with id=3f2fee97-0888-456c-af1d-dc306c153a6f is in PENDING state, waiting...&#xA;Get a pipeline run with id=3f2fee97-0888-456c-af1d-dc306c153a6f&#xA;Pipeline run with id=3f2fee97-0888-456c-af1d-dc306c153a6f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3f2fee97-0888-456c-af1d-dc306c153a6f&#xA;Pipeline run with id=3f2fee97-0888-456c-af1d-dc306c153a6f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3f2fee97-0888-456c-af1d-dc306c153a6f&#xA;Pipeline run with id=3f2fee97-0888-456c-af1d-dc306c153a6f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3f2fee97-0888-456c-af1d-dc306c153a6f&#xA;Pipeline run with id=3f2fee97-0888-456c-af1d-dc306c153a6f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3f2fee97-0888-456c-af1d-dc306c153a6f&#xA;Pipeline run with id=3f2fee97-0888-456c-af1d-dc306c153a6f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3f2fee97-0888-456c-af1d-dc306c153a6f&#xA;Pipeline run with id=3f2fee97-0888-456c-af1d-dc306c153a6f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3f2fee97-0888-456c-af1d-dc306c153a6f&#xA;Pipeline run with id=3f2fee97-0888-456c-af1d-dc306c153a6f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3f2fee97-0888-456c-af1d-dc306c153a6f&#xA;Pipeline run with id=3f2fee97-0888-456c-af1d-dc306c153a6f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3f2fee97-0888-456c-af1d-dc306c153a6f&#xA;Pipeline run with id=3f2fee97-0888-456c-af1d-dc306c153a6f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3f2fee97-0888-456c-af1d-dc306c153a6f&#xA;Pipeline run with id=3f2fee97-0888-456c-af1d-dc306c153a6f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3f2fee97-0888-456c-af1d-dc306c153a6f&#xA;Pipeline run with id=3f2fee97-0888-456c-af1d-dc306c153a6f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3f2fee97-0888-456c-af1d-dc306c153a6f&#xA;Pipeline run with id=3f2fee97-0888-456c-af1d-dc306c153a6f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3f2fee97-0888-456c-af1d-dc306c153a6f&#xA;Pipeline run with id=3f2fee97-0888-456c-af1d-dc306c153a6f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3f2fee97-0888-456c-af1d-dc306c153a6f&#xA;Pipeline run with id=3f2fee97-0888-456c-af1d-dc306c153a6f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3f2fee97-0888-456c-af1d-dc306c153a6f&#xA;Pipeline run with id=3f2fee97-0888-456c-af1d-dc306c153a6f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3f2fee97-0888-456c-af1d-dc306c153a6f&#xA;Pipeline run with id=3f2fee97-0888-456c-af1d-dc306c153a6f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3f2fee97-0888-456c-af1d-dc306c153a6f&#xA;Pipeline run with id=3f2fee97-0888-456c-af1d-dc306c153a6f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3f2fee97-0888-456c-af1d-dc306c153a6f&#xA;Pipeline run with id=3f2fee97-0888-456c-af1d-dc306c153a6f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3f2fee97-0888-456c-af1d-dc306c153a6f&#xA;Pipeline run with id=3f2fee97-0888-456c-af1d-dc306c153a6f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3f2fee97-0888-456c-af1d-dc306c153a6f&#xA;Pipeline run with id=3f2fee97-0888-456c-af1d-dc306c153a6f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3f2fee97-0888-456c-af1d-dc306c153a6f&#xA;Pipeline run with id=3f2fee97-0888-456c-af1d-dc306c153a6f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3f2fee97-0888-456c-af1d-dc306c153a6f&#xA;Pipeline run with id=3f2fee97-0888-456c-af1d-dc306c153a6f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3f2fee97-0888-456c-af1d-dc306c153a6f&#xA;Pipeline run with id=3f2fee97-0888-456c-af1d-dc306c153a6f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3f2fee97-0888-456c-af1d-dc306c153a6f&#xA;Pipeline run with id=3f2fee97-0888-456c-af1d-dc306c153a6f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3f2fee97-0888-456c-af1d-dc306c153a6f&#xA;Pipeline run with id=3f2fee97-0888-456c-af1d-dc306c153a6f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3f2fee97-0888-456c-af1d-dc306c153a6f&#xA;Pipeline run with id=3f2fee97-0888-456c-af1d-dc306c153a6f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3f2fee97-0888-456c-af1d-dc306c153a6f&#xA;Pipeline run with id=3f2fee97-0888-456c-af1d-dc306c153a6f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3f2fee97-0888-456c-af1d-dc306c153a6f&#xA;Pipeline run with id=3f2fee97-0888-456c-af1d-dc306c153a6f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3f2fee97-0888-456c-af1d-dc306c153a6f&#xA;Pipeline run with id=3f2fee97-0888-456c-af1d-dc306c153a6f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3f2fee97-0888-456c-af1d-dc306c153a6f&#xA;Pipeline run with id=3f2fee97-0888-456c-af1d-dc306c153a6f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3f2fee97-0888-456c-af1d-dc306c153a6f&#xA;Pipeline run with id=3f2fee97-0888-456c-af1d-dc306c153a6f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3f2fee97-0888-456c-af1d-dc306c153a6f&#xA;Pipeline run with id=3f2fee97-0888-456c-af1d-dc306c153a6f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3f2fee97-0888-456c-af1d-dc306c153a6f&#xA;Pipeline run with id=3f2fee97-0888-456c-af1d-dc306c153a6f reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/flip_coin.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=3f2fee97-0888-456c-af1d-dc306c153a6f&#xA;Get a pipeline run with id=3f2fee97-0888-456c-af1d-dc306c153a6f&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/16/26 16:06:30.311 (2m45.538s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/16/26 16:06:30.312&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 3f2fee97-0888-456c-af1d-dc306c153a6f&#xA;Failed to terminate run 3f2fee97-0888-456c-af1d-dc306c153a6f&#xA;Terminate run 3f2fee97-0888-456c-af1d-dc306c153a6f&#xA;Deleting run 3f2fee97-0888-456c-af1d-dc306c153a6f&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=ebd60e4a-a7ae-4b96-8c78-07c089751c47 (cascade=true)&#xA;Pipeline with id=ebd60e4a-a7ae-4b96-8c78-07c089751c47, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/16/26 16:06:30.426 (114ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/16/26 16:06:30.426&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/16/26 16:06:30.426 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/16/26 16:06:30.427&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/16/26 16:06:30.427 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload essential/iris_pipeline_compiled.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="190.798693084">
              <system-out>2026/07/16 16:06:55 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/16/26 16:03:44.59&#xA;Create an experiment with name E2EExperiment-1784217824590422885&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/16/26 16:03:44.722 (132ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/16/26 16:03:44.722&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0xc3d86e2cd80&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/16/26 16:03:44.773 (51ms)&#xA;&gt; Enter [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/16/26 16:03:44.773&#xA;Uploading pipeline file essential/iris_pipeline_compiled.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1784217824722817729, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml&#xA;Upload of pipeline file &#39;essential/iris_pipeline_compiled.yaml&#39; successful&#xA;Listing pipeline versions for pipeline aa81cd90-4070-478b-a134-717797fcacd6&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;aa81cd90-4070-478b-a134-717797fcacd6&#39; and name: &#39;e2e-test-1784217824722817729&#39;&#xA;Create a pipeline run for pipeline with id=aa81cd90-4070-478b-a134-717797fcacd6 and versionId=d9be9647-afae-482f-887e-1e6af9555611&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=4aaa70da-88c4-494d-9f3c-69bb40aba05a&#xA;Created Pipeline Run with id: 4aaa70da-88c4-494d-9f3c-69bb40aba05a for pipeline with id: aa81cd90-4070-478b-a134-717797fcacd6&#xA;Waiting for pipeline run with id=4aaa70da-88c4-494d-9f3c-69bb40aba05a to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=4aaa70da-88c4-494d-9f3c-69bb40aba05a&#xA;Pipeline run with id=4aaa70da-88c4-494d-9f3c-69bb40aba05a is in PENDING state, waiting...&#xA;Get a pipeline run with id=4aaa70da-88c4-494d-9f3c-69bb40aba05a&#xA;Pipeline run with id=4aaa70da-88c4-494d-9f3c-69bb40aba05a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4aaa70da-88c4-494d-9f3c-69bb40aba05a&#xA;Pipeline run with id=4aaa70da-88c4-494d-9f3c-69bb40aba05a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4aaa70da-88c4-494d-9f3c-69bb40aba05a&#xA;Pipeline run with id=4aaa70da-88c4-494d-9f3c-69bb40aba05a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4aaa70da-88c4-494d-9f3c-69bb40aba05a&#xA;Pipeline run with id=4aaa70da-88c4-494d-9f3c-69bb40aba05a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4aaa70da-88c4-494d-9f3c-69bb40aba05a&#xA;Pipeline run with id=4aaa70da-88c4-494d-9f3c-69bb40aba05a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4aaa70da-88c4-494d-9f3c-69bb40aba05a&#xA;Pipeline run with id=4aaa70da-88c4-494d-9f3c-69bb40aba05a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4aaa70da-88c4-494d-9f3c-69bb40aba05a&#xA;Pipeline run with id=4aaa70da-88c4-494d-9f3c-69bb40aba05a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4aaa70da-88c4-494d-9f3c-69bb40aba05a&#xA;Pipeline run with id=4aaa70da-88c4-494d-9f3c-69bb40aba05a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4aaa70da-88c4-494d-9f3c-69bb40aba05a&#xA;Pipeline run with id=4aaa70da-88c4-494d-9f3c-69bb40aba05a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4aaa70da-88c4-494d-9f3c-69bb40aba05a&#xA;Pipeline run with id=4aaa70da-88c4-494d-9f3c-69bb40aba05a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4aaa70da-88c4-494d-9f3c-69bb40aba05a&#xA;Pipeline run with id=4aaa70da-88c4-494d-9f3c-69bb40aba05a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4aaa70da-88c4-494d-9f3c-69bb40aba05a&#xA;Pipeline run with id=4aaa70da-88c4-494d-9f3c-69bb40aba05a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4aaa70da-88c4-494d-9f3c-69bb40aba05a&#xA;Pipeline run with id=4aaa70da-88c4-494d-9f3c-69bb40aba05a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4aaa70da-88c4-494d-9f3c-69bb40aba05a&#xA;Pipeline run with id=4aaa70da-88c4-494d-9f3c-69bb40aba05a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4aaa70da-88c4-494d-9f3c-69bb40aba05a&#xA;Pipeline run with id=4aaa70da-88c4-494d-9f3c-69bb40aba05a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4aaa70da-88c4-494d-9f3c-69bb40aba05a&#xA;Pipeline run with id=4aaa70da-88c4-494d-9f3c-69bb40aba05a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4aaa70da-88c4-494d-9f3c-69bb40aba05a&#xA;Pipeline run with id=4aaa70da-88c4-494d-9f3c-69bb40aba05a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4aaa70da-88c4-494d-9f3c-69bb40aba05a&#xA;Pipeline run with id=4aaa70da-88c4-494d-9f3c-69bb40aba05a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4aaa70da-88c4-494d-9f3c-69bb40aba05a&#xA;Pipeline run with id=4aaa70da-88c4-494d-9f3c-69bb40aba05a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4aaa70da-88c4-494d-9f3c-69bb40aba05a&#xA;Pipeline run with id=4aaa70da-88c4-494d-9f3c-69bb40aba05a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4aaa70da-88c4-494d-9f3c-69bb40aba05a&#xA;Pipeline run with id=4aaa70da-88c4-494d-9f3c-69bb40aba05a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4aaa70da-88c4-494d-9f3c-69bb40aba05a&#xA;Pipeline run with id=4aaa70da-88c4-494d-9f3c-69bb40aba05a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4aaa70da-88c4-494d-9f3c-69bb40aba05a&#xA;Pipeline run with id=4aaa70da-88c4-494d-9f3c-69bb40aba05a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4aaa70da-88c4-494d-9f3c-69bb40aba05a&#xA;Pipeline run with id=4aaa70da-88c4-494d-9f3c-69bb40aba05a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4aaa70da-88c4-494d-9f3c-69bb40aba05a&#xA;Pipeline run with id=4aaa70da-88c4-494d-9f3c-69bb40aba05a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4aaa70da-88c4-494d-9f3c-69bb40aba05a&#xA;Pipeline run with id=4aaa70da-88c4-494d-9f3c-69bb40aba05a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4aaa70da-88c4-494d-9f3c-69bb40aba05a&#xA;Pipeline run with id=4aaa70da-88c4-494d-9f3c-69bb40aba05a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4aaa70da-88c4-494d-9f3c-69bb40aba05a&#xA;Pipeline run with id=4aaa70da-88c4-494d-9f3c-69bb40aba05a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4aaa70da-88c4-494d-9f3c-69bb40aba05a&#xA;Pipeline run with id=4aaa70da-88c4-494d-9f3c-69bb40aba05a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4aaa70da-88c4-494d-9f3c-69bb40aba05a&#xA;Pipeline run with id=4aaa70da-88c4-494d-9f3c-69bb40aba05a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4aaa70da-88c4-494d-9f3c-69bb40aba05a&#xA;Pipeline run with id=4aaa70da-88c4-494d-9f3c-69bb40aba05a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4aaa70da-88c4-494d-9f3c-69bb40aba05a&#xA;Pipeline run with id=4aaa70da-88c4-494d-9f3c-69bb40aba05a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4aaa70da-88c4-494d-9f3c-69bb40aba05a&#xA;Pipeline run with id=4aaa70da-88c4-494d-9f3c-69bb40aba05a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4aaa70da-88c4-494d-9f3c-69bb40aba05a&#xA;Pipeline run with id=4aaa70da-88c4-494d-9f3c-69bb40aba05a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4aaa70da-88c4-494d-9f3c-69bb40aba05a&#xA;Pipeline run with id=4aaa70da-88c4-494d-9f3c-69bb40aba05a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4aaa70da-88c4-494d-9f3c-69bb40aba05a&#xA;Pipeline run with id=4aaa70da-88c4-494d-9f3c-69bb40aba05a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4aaa70da-88c4-494d-9f3c-69bb40aba05a&#xA;Pipeline run with id=4aaa70da-88c4-494d-9f3c-69bb40aba05a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4aaa70da-88c4-494d-9f3c-69bb40aba05a&#xA;Pipeline run with id=4aaa70da-88c4-494d-9f3c-69bb40aba05a reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;essential/iris_pipeline_compiled.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=4aaa70da-88c4-494d-9f3c-69bb40aba05a&#xA;Get a pipeline run with id=4aaa70da-88c4-494d-9f3c-69bb40aba05a&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/16/26 16:06:55.279 (3m10.506s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/16/26 16:06:55.279&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 4aaa70da-88c4-494d-9f3c-69bb40aba05a&#xA;Failed to terminate run 4aaa70da-88c4-494d-9f3c-69bb40aba05a&#xA;Terminate run 4aaa70da-88c4-494d-9f3c-69bb40aba05a&#xA;Deleting run 4aaa70da-88c4-494d-9f3c-69bb40aba05a&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=aa81cd90-4070-478b-a134-717797fcacd6 (cascade=true)&#xA;Pipeline with id=aa81cd90-4070-478b-a134-717797fcacd6, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/16/26 16:06:55.388 (109ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/16/26 16:06:55.389&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/16/26 16:06:55.389 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/16/26 16:06:55.389&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/16/26 16:06:55.389 (0s)&#xA;</system-err>
          </testcase>
      </testsuite>
  </testsuites>