<?xml version="1.0" encoding="UTF-8"?>
  <testsuites tests="5" disabled="0" errors="0" failures="0" time="196.133443959">
      <testsuite name="AIPipelinesE2ETests" package="/dspa/backend/test/end2end" tests="5" disabled="0" skipped="0" errors="0" failures="0" time="196.133443959" timestamp="2026-09-09T11:41:50">
          <properties>
              <property name="SuiteSucceeded" value="true"></property>
              <property name="SuiteHasProgrammaticFocus" value="false"></property>
              <property name="SpecialSuiteFailureReason" value=""></property>
              <property name="SuiteLabels" value="[]"></property>
              <property name="SuiteSemVerConstraints" value="[]"></property>
              <property name="RandomSeed" value="1788953930"></property>
              <property name="RandomizeAllSpecs" value="false"></property>
              <property name="LabelFilter" value="Smoke"></property>
              <property name="SemVerFilter" value=""></property>
              <property name="FocusStrings" value=""></property>
              <property name="SkipStrings" value=""></property>
              <property name="FocusFiles" value=""></property>
              <property name="SkipFiles" value=""></property>
              <property name="FailOnPending" value="false"></property>
              <property name="FailOnEmpty" value="false"></property>
              <property name="FailFast" value="false"></property>
              <property name="FlakeAttempts" value="0"></property>
              <property name="DryRun" value="false"></property>
              <property name="ParallelTotal" value="10"></property>
              <property name="OutputInterceptorMode" value=""></property>
          </properties>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload essential/component_with_pip_index_urls.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="70.893114778">
              <system-out>2026/09/09 11:43:01 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 09/09/26 11:41:50.232&#xA;Create an experiment with name E2EExperiment-1788954110232262930&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 09/09/26 11:41:50.435 (203ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 09/09/26 11:41:50.435&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x1d1b07e50b00&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 09/09/26 11:41:50.574 (139ms)&#xA;&gt; Enter [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 09/09/26 11:41:50.574&#xA;Uploading pipeline file essential/component_with_pip_index_urls.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1788954110435854914, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml&#xA;Upload of pipeline file &#39;essential/component_with_pip_index_urls.yaml&#39; successful&#xA;Listing pipeline versions for pipeline c0be99a6-28d1-43c7-a8bf-531bd1f5f5d0&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;c0be99a6-28d1-43c7-a8bf-531bd1f5f5d0&#39; and name: &#39;e2e-test-1788954110435854914&#39;&#xA;Create a pipeline run for pipeline with id=c0be99a6-28d1-43c7-a8bf-531bd1f5f5d0 and versionId=27180017-1187-478d-9448-7f34066df990&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=2a2c6028-1b2c-49d9-a13c-126f6615c8cb&#xA;Created Pipeline Run with id: 2a2c6028-1b2c-49d9-a13c-126f6615c8cb for pipeline with id: c0be99a6-28d1-43c7-a8bf-531bd1f5f5d0&#xA;Waiting for pipeline run with id=2a2c6028-1b2c-49d9-a13c-126f6615c8cb to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=2a2c6028-1b2c-49d9-a13c-126f6615c8cb&#xA;Pipeline run with id=2a2c6028-1b2c-49d9-a13c-126f6615c8cb is in PENDING state, waiting...&#xA;Get a pipeline run with id=2a2c6028-1b2c-49d9-a13c-126f6615c8cb&#xA;Pipeline run with id=2a2c6028-1b2c-49d9-a13c-126f6615c8cb is in RUNNING state, waiting...&#xA;Get a pipeline run with id=2a2c6028-1b2c-49d9-a13c-126f6615c8cb&#xA;Pipeline run with id=2a2c6028-1b2c-49d9-a13c-126f6615c8cb is in RUNNING state, waiting...&#xA;Get a pipeline run with id=2a2c6028-1b2c-49d9-a13c-126f6615c8cb&#xA;Pipeline run with id=2a2c6028-1b2c-49d9-a13c-126f6615c8cb is in RUNNING state, waiting...&#xA;Get a pipeline run with id=2a2c6028-1b2c-49d9-a13c-126f6615c8cb&#xA;Pipeline run with id=2a2c6028-1b2c-49d9-a13c-126f6615c8cb is in RUNNING state, waiting...&#xA;Get a pipeline run with id=2a2c6028-1b2c-49d9-a13c-126f6615c8cb&#xA;Pipeline run with id=2a2c6028-1b2c-49d9-a13c-126f6615c8cb is in RUNNING state, waiting...&#xA;Get a pipeline run with id=2a2c6028-1b2c-49d9-a13c-126f6615c8cb&#xA;Pipeline run with id=2a2c6028-1b2c-49d9-a13c-126f6615c8cb is in RUNNING state, waiting...&#xA;Get a pipeline run with id=2a2c6028-1b2c-49d9-a13c-126f6615c8cb&#xA;Pipeline run with id=2a2c6028-1b2c-49d9-a13c-126f6615c8cb is in RUNNING state, waiting...&#xA;Get a pipeline run with id=2a2c6028-1b2c-49d9-a13c-126f6615c8cb&#xA;Pipeline run with id=2a2c6028-1b2c-49d9-a13c-126f6615c8cb is in RUNNING state, waiting...&#xA;Get a pipeline run with id=2a2c6028-1b2c-49d9-a13c-126f6615c8cb&#xA;Pipeline run with id=2a2c6028-1b2c-49d9-a13c-126f6615c8cb is in RUNNING state, waiting...&#xA;Get a pipeline run with id=2a2c6028-1b2c-49d9-a13c-126f6615c8cb&#xA;Pipeline run with id=2a2c6028-1b2c-49d9-a13c-126f6615c8cb is in RUNNING state, waiting...&#xA;Get a pipeline run with id=2a2c6028-1b2c-49d9-a13c-126f6615c8cb&#xA;Pipeline run with id=2a2c6028-1b2c-49d9-a13c-126f6615c8cb is in RUNNING state, waiting...&#xA;Get a pipeline run with id=2a2c6028-1b2c-49d9-a13c-126f6615c8cb&#xA;Pipeline run with id=2a2c6028-1b2c-49d9-a13c-126f6615c8cb is in RUNNING state, waiting...&#xA;Get a pipeline run with id=2a2c6028-1b2c-49d9-a13c-126f6615c8cb&#xA;Pipeline run with id=2a2c6028-1b2c-49d9-a13c-126f6615c8cb is in RUNNING state, waiting...&#xA;Get a pipeline run with id=2a2c6028-1b2c-49d9-a13c-126f6615c8cb&#xA;Pipeline run with id=2a2c6028-1b2c-49d9-a13c-126f6615c8cb reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;essential/component_with_pip_index_urls.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=2a2c6028-1b2c-49d9-a13c-126f6615c8cb&#xA;Get a pipeline run with id=2a2c6028-1b2c-49d9-a13c-126f6615c8cb&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 09/09/26 11:43:00.956 (1m10.381s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 09/09/26 11:43:00.956&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 2a2c6028-1b2c-49d9-a13c-126f6615c8cb&#xA;Failed to terminate run 2a2c6028-1b2c-49d9-a13c-126f6615c8cb&#xA;Terminate run 2a2c6028-1b2c-49d9-a13c-126f6615c8cb&#xA;Deleting run 2a2c6028-1b2c-49d9-a13c-126f6615c8cb&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=c0be99a6-28d1-43c7-a8bf-531bd1f5f5d0 (cascade=true)&#xA;Pipeline with id=c0be99a6-28d1-43c7-a8bf-531bd1f5f5d0, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 09/09/26 11:43:01.125 (169ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 09/09/26 11:43:01.125&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 09/09/26 11:43:01.125 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 09/09/26 11:43:01.125&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 09/09/26 11:43:01.125 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/parallel_for_after_dependency.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="110.944521413">
              <system-out>2026/09/09 11:43:41 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 09/09/26 11:41:50.228&#xA;Create an experiment with name E2EExperiment-1788954110228831685&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 09/09/26 11:41:50.435 (207ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 09/09/26 11:41:50.436&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x3c7f98eb5380&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 09/09/26 11:41:50.561 (125ms)&#xA;&gt; Enter [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 09/09/26 11:41:50.561&#xA;Uploading pipeline file critical/parallel_for_after_dependency.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1788954110436043317, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml&#xA;Upload of pipeline file &#39;critical/parallel_for_after_dependency.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 8a663a83-e017-4dc4-a29b-ac685e3f1952&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;8a663a83-e017-4dc4-a29b-ac685e3f1952&#39; and name: &#39;e2e-test-1788954110436043317&#39;&#xA;Create a pipeline run for pipeline with id=8a663a83-e017-4dc4-a29b-ac685e3f1952 and versionId=e6a515fd-ee0a-4aab-a109-015a956d79a3&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=31f64d53-fb61-4b06-866a-487bf821faa0&#xA;Created Pipeline Run with id: 31f64d53-fb61-4b06-866a-487bf821faa0 for pipeline with id: 8a663a83-e017-4dc4-a29b-ac685e3f1952&#xA;Waiting for pipeline run with id=31f64d53-fb61-4b06-866a-487bf821faa0 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=31f64d53-fb61-4b06-866a-487bf821faa0&#xA;Pipeline run with id=31f64d53-fb61-4b06-866a-487bf821faa0 is in PENDING state, waiting...&#xA;Get a pipeline run with id=31f64d53-fb61-4b06-866a-487bf821faa0&#xA;Pipeline run with id=31f64d53-fb61-4b06-866a-487bf821faa0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=31f64d53-fb61-4b06-866a-487bf821faa0&#xA;Pipeline run with id=31f64d53-fb61-4b06-866a-487bf821faa0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=31f64d53-fb61-4b06-866a-487bf821faa0&#xA;Pipeline run with id=31f64d53-fb61-4b06-866a-487bf821faa0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=31f64d53-fb61-4b06-866a-487bf821faa0&#xA;Pipeline run with id=31f64d53-fb61-4b06-866a-487bf821faa0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=31f64d53-fb61-4b06-866a-487bf821faa0&#xA;Pipeline run with id=31f64d53-fb61-4b06-866a-487bf821faa0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=31f64d53-fb61-4b06-866a-487bf821faa0&#xA;Pipeline run with id=31f64d53-fb61-4b06-866a-487bf821faa0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=31f64d53-fb61-4b06-866a-487bf821faa0&#xA;Pipeline run with id=31f64d53-fb61-4b06-866a-487bf821faa0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=31f64d53-fb61-4b06-866a-487bf821faa0&#xA;Pipeline run with id=31f64d53-fb61-4b06-866a-487bf821faa0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=31f64d53-fb61-4b06-866a-487bf821faa0&#xA;Pipeline run with id=31f64d53-fb61-4b06-866a-487bf821faa0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=31f64d53-fb61-4b06-866a-487bf821faa0&#xA;Pipeline run with id=31f64d53-fb61-4b06-866a-487bf821faa0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=31f64d53-fb61-4b06-866a-487bf821faa0&#xA;Pipeline run with id=31f64d53-fb61-4b06-866a-487bf821faa0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=31f64d53-fb61-4b06-866a-487bf821faa0&#xA;Pipeline run with id=31f64d53-fb61-4b06-866a-487bf821faa0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=31f64d53-fb61-4b06-866a-487bf821faa0&#xA;Pipeline run with id=31f64d53-fb61-4b06-866a-487bf821faa0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=31f64d53-fb61-4b06-866a-487bf821faa0&#xA;Pipeline run with id=31f64d53-fb61-4b06-866a-487bf821faa0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=31f64d53-fb61-4b06-866a-487bf821faa0&#xA;Pipeline run with id=31f64d53-fb61-4b06-866a-487bf821faa0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=31f64d53-fb61-4b06-866a-487bf821faa0&#xA;Pipeline run with id=31f64d53-fb61-4b06-866a-487bf821faa0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=31f64d53-fb61-4b06-866a-487bf821faa0&#xA;Pipeline run with id=31f64d53-fb61-4b06-866a-487bf821faa0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=31f64d53-fb61-4b06-866a-487bf821faa0&#xA;Pipeline run with id=31f64d53-fb61-4b06-866a-487bf821faa0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=31f64d53-fb61-4b06-866a-487bf821faa0&#xA;Pipeline run with id=31f64d53-fb61-4b06-866a-487bf821faa0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=31f64d53-fb61-4b06-866a-487bf821faa0&#xA;Pipeline run with id=31f64d53-fb61-4b06-866a-487bf821faa0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=31f64d53-fb61-4b06-866a-487bf821faa0&#xA;Pipeline run with id=31f64d53-fb61-4b06-866a-487bf821faa0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=31f64d53-fb61-4b06-866a-487bf821faa0&#xA;Pipeline run with id=31f64d53-fb61-4b06-866a-487bf821faa0 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/parallel_for_after_dependency.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=31f64d53-fb61-4b06-866a-487bf821faa0&#xA;Get a pipeline run with id=31f64d53-fb61-4b06-866a-487bf821faa0&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 09/09/26 11:43:41.034 (1m50.473s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 09/09/26 11:43:41.034&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 31f64d53-fb61-4b06-866a-487bf821faa0&#xA;Failed to terminate run 31f64d53-fb61-4b06-866a-487bf821faa0&#xA;Terminate run 31f64d53-fb61-4b06-866a-487bf821faa0&#xA;Deleting run 31f64d53-fb61-4b06-866a-487bf821faa0&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=8a663a83-e017-4dc4-a29b-ac685e3f1952 (cascade=true)&#xA;Pipeline with id=8a663a83-e017-4dc4-a29b-ac685e3f1952, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 09/09/26 11:43:41.173 (139ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 09/09/26 11:43:41.173&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 09/09/26 11:43:41.173 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 09/09/26 11:43:41.173&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 09/09/26 11:43:41.173 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/pipeline_with_artifact_upload_download.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="135.879296329">
              <system-out>2026/09/09 11:44:06 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 09/09/26 11:41:50.232&#xA;Create an experiment with name E2EExperiment-1788954110232183514&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 09/09/26 11:41:50.43 (198ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 09/09/26 11:41:50.43&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x3068437b6000&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 09/09/26 11:41:50.559 (129ms)&#xA;&gt; Enter [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 09/09/26 11:41:50.559&#xA;Uploading pipeline file critical/pipeline_with_artifact_upload_download.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1788954110430594224, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml&#xA;Upload of pipeline file &#39;critical/pipeline_with_artifact_upload_download.yaml&#39; successful&#xA;Listing pipeline versions for pipeline bff9fa91-7dd5-4555-8dbb-3689404395b5&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;bff9fa91-7dd5-4555-8dbb-3689404395b5&#39; and name: &#39;e2e-test-1788954110430594224&#39;&#xA;Create a pipeline run for pipeline with id=bff9fa91-7dd5-4555-8dbb-3689404395b5 and versionId=4282e88e-d359-4bd2-b66d-017bfea7064f&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=0de52ea2-3453-49f9-b6e9-4c6ce8e5c339&#xA;Created Pipeline Run with id: 0de52ea2-3453-49f9-b6e9-4c6ce8e5c339 for pipeline with id: bff9fa91-7dd5-4555-8dbb-3689404395b5&#xA;Waiting for pipeline run with id=0de52ea2-3453-49f9-b6e9-4c6ce8e5c339 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=0de52ea2-3453-49f9-b6e9-4c6ce8e5c339&#xA;Pipeline run with id=0de52ea2-3453-49f9-b6e9-4c6ce8e5c339 is in PENDING state, waiting...&#xA;Get a pipeline run with id=0de52ea2-3453-49f9-b6e9-4c6ce8e5c339&#xA;Pipeline run with id=0de52ea2-3453-49f9-b6e9-4c6ce8e5c339 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0de52ea2-3453-49f9-b6e9-4c6ce8e5c339&#xA;Pipeline run with id=0de52ea2-3453-49f9-b6e9-4c6ce8e5c339 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0de52ea2-3453-49f9-b6e9-4c6ce8e5c339&#xA;Pipeline run with id=0de52ea2-3453-49f9-b6e9-4c6ce8e5c339 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0de52ea2-3453-49f9-b6e9-4c6ce8e5c339&#xA;Pipeline run with id=0de52ea2-3453-49f9-b6e9-4c6ce8e5c339 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0de52ea2-3453-49f9-b6e9-4c6ce8e5c339&#xA;Pipeline run with id=0de52ea2-3453-49f9-b6e9-4c6ce8e5c339 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0de52ea2-3453-49f9-b6e9-4c6ce8e5c339&#xA;Pipeline run with id=0de52ea2-3453-49f9-b6e9-4c6ce8e5c339 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0de52ea2-3453-49f9-b6e9-4c6ce8e5c339&#xA;Pipeline run with id=0de52ea2-3453-49f9-b6e9-4c6ce8e5c339 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0de52ea2-3453-49f9-b6e9-4c6ce8e5c339&#xA;Pipeline run with id=0de52ea2-3453-49f9-b6e9-4c6ce8e5c339 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0de52ea2-3453-49f9-b6e9-4c6ce8e5c339&#xA;Pipeline run with id=0de52ea2-3453-49f9-b6e9-4c6ce8e5c339 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0de52ea2-3453-49f9-b6e9-4c6ce8e5c339&#xA;Pipeline run with id=0de52ea2-3453-49f9-b6e9-4c6ce8e5c339 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0de52ea2-3453-49f9-b6e9-4c6ce8e5c339&#xA;Pipeline run with id=0de52ea2-3453-49f9-b6e9-4c6ce8e5c339 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0de52ea2-3453-49f9-b6e9-4c6ce8e5c339&#xA;Pipeline run with id=0de52ea2-3453-49f9-b6e9-4c6ce8e5c339 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0de52ea2-3453-49f9-b6e9-4c6ce8e5c339&#xA;Pipeline run with id=0de52ea2-3453-49f9-b6e9-4c6ce8e5c339 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0de52ea2-3453-49f9-b6e9-4c6ce8e5c339&#xA;Pipeline run with id=0de52ea2-3453-49f9-b6e9-4c6ce8e5c339 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0de52ea2-3453-49f9-b6e9-4c6ce8e5c339&#xA;Pipeline run with id=0de52ea2-3453-49f9-b6e9-4c6ce8e5c339 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0de52ea2-3453-49f9-b6e9-4c6ce8e5c339&#xA;Pipeline run with id=0de52ea2-3453-49f9-b6e9-4c6ce8e5c339 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0de52ea2-3453-49f9-b6e9-4c6ce8e5c339&#xA;Pipeline run with id=0de52ea2-3453-49f9-b6e9-4c6ce8e5c339 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0de52ea2-3453-49f9-b6e9-4c6ce8e5c339&#xA;Pipeline run with id=0de52ea2-3453-49f9-b6e9-4c6ce8e5c339 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0de52ea2-3453-49f9-b6e9-4c6ce8e5c339&#xA;Pipeline run with id=0de52ea2-3453-49f9-b6e9-4c6ce8e5c339 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0de52ea2-3453-49f9-b6e9-4c6ce8e5c339&#xA;Pipeline run with id=0de52ea2-3453-49f9-b6e9-4c6ce8e5c339 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0de52ea2-3453-49f9-b6e9-4c6ce8e5c339&#xA;Pipeline run with id=0de52ea2-3453-49f9-b6e9-4c6ce8e5c339 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0de52ea2-3453-49f9-b6e9-4c6ce8e5c339&#xA;Pipeline run with id=0de52ea2-3453-49f9-b6e9-4c6ce8e5c339 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0de52ea2-3453-49f9-b6e9-4c6ce8e5c339&#xA;Pipeline run with id=0de52ea2-3453-49f9-b6e9-4c6ce8e5c339 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0de52ea2-3453-49f9-b6e9-4c6ce8e5c339&#xA;Pipeline run with id=0de52ea2-3453-49f9-b6e9-4c6ce8e5c339 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0de52ea2-3453-49f9-b6e9-4c6ce8e5c339&#xA;Pipeline run with id=0de52ea2-3453-49f9-b6e9-4c6ce8e5c339 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0de52ea2-3453-49f9-b6e9-4c6ce8e5c339&#xA;Pipeline run with id=0de52ea2-3453-49f9-b6e9-4c6ce8e5c339 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0de52ea2-3453-49f9-b6e9-4c6ce8e5c339&#xA;Pipeline run with id=0de52ea2-3453-49f9-b6e9-4c6ce8e5c339 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/pipeline_with_artifact_upload_download.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=0de52ea2-3453-49f9-b6e9-4c6ce8e5c339&#xA;Get a pipeline run with id=0de52ea2-3453-49f9-b6e9-4c6ce8e5c339&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 09/09/26 11:44:05.954 (2m15.395s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 09/09/26 11:44:05.955&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 0de52ea2-3453-49f9-b6e9-4c6ce8e5c339&#xA;Failed to terminate run 0de52ea2-3453-49f9-b6e9-4c6ce8e5c339&#xA;Terminate run 0de52ea2-3453-49f9-b6e9-4c6ce8e5c339&#xA;Deleting run 0de52ea2-3453-49f9-b6e9-4c6ce8e5c339&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=bff9fa91-7dd5-4555-8dbb-3689404395b5 (cascade=true)&#xA;Pipeline with id=bff9fa91-7dd5-4555-8dbb-3689404395b5, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 09/09/26 11:44:06.111 (156ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 09/09/26 11:44:06.111&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 09/09/26 11:44:06.111 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 09/09/26 11:44:06.111&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 09/09/26 11:44:06.112 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/flip_coin.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="165.86740452">
              <system-out>2026/09/09 11:44:36 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 09/09/26 11:41:50.228&#xA;Create an experiment with name E2EExperiment-1788954110228754240&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 09/09/26 11:41:50.435 (206ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 09/09/26 11:41:50.435&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x1aa7fa9fe280&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 09/09/26 11:41:50.564 (129ms)&#xA;&gt; Enter [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 09/09/26 11:41:50.564&#xA;Uploading pipeline file critical/flip_coin.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1788954110435177808, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml&#xA;Upload of pipeline file &#39;critical/flip_coin.yaml&#39; successful&#xA;Listing pipeline versions for pipeline c3f596cf-b656-4091-b55b-ce856abec158&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;c3f596cf-b656-4091-b55b-ce856abec158&#39; and name: &#39;e2e-test-1788954110435177808&#39;&#xA;Create a pipeline run for pipeline with id=c3f596cf-b656-4091-b55b-ce856abec158 and versionId=f7291e9a-5c8d-4551-91ae-101d50ce60a3&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=37877e37-294e-41b8-b8c7-ab29cbae00ec&#xA;Created Pipeline Run with id: 37877e37-294e-41b8-b8c7-ab29cbae00ec for pipeline with id: c3f596cf-b656-4091-b55b-ce856abec158&#xA;Waiting for pipeline run with id=37877e37-294e-41b8-b8c7-ab29cbae00ec to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=37877e37-294e-41b8-b8c7-ab29cbae00ec&#xA;Pipeline run with id=37877e37-294e-41b8-b8c7-ab29cbae00ec is in PENDING state, waiting...&#xA;Get a pipeline run with id=37877e37-294e-41b8-b8c7-ab29cbae00ec&#xA;Pipeline run with id=37877e37-294e-41b8-b8c7-ab29cbae00ec is in RUNNING state, waiting...&#xA;Get a pipeline run with id=37877e37-294e-41b8-b8c7-ab29cbae00ec&#xA;Pipeline run with id=37877e37-294e-41b8-b8c7-ab29cbae00ec is in RUNNING state, waiting...&#xA;Get a pipeline run with id=37877e37-294e-41b8-b8c7-ab29cbae00ec&#xA;Pipeline run with id=37877e37-294e-41b8-b8c7-ab29cbae00ec is in RUNNING state, waiting...&#xA;Get a pipeline run with id=37877e37-294e-41b8-b8c7-ab29cbae00ec&#xA;Pipeline run with id=37877e37-294e-41b8-b8c7-ab29cbae00ec is in RUNNING state, waiting...&#xA;Get a pipeline run with id=37877e37-294e-41b8-b8c7-ab29cbae00ec&#xA;Pipeline run with id=37877e37-294e-41b8-b8c7-ab29cbae00ec is in RUNNING state, waiting...&#xA;Get a pipeline run with id=37877e37-294e-41b8-b8c7-ab29cbae00ec&#xA;Pipeline run with id=37877e37-294e-41b8-b8c7-ab29cbae00ec is in RUNNING state, waiting...&#xA;Get a pipeline run with id=37877e37-294e-41b8-b8c7-ab29cbae00ec&#xA;Pipeline run with id=37877e37-294e-41b8-b8c7-ab29cbae00ec is in RUNNING state, waiting...&#xA;Get a pipeline run with id=37877e37-294e-41b8-b8c7-ab29cbae00ec&#xA;Pipeline run with id=37877e37-294e-41b8-b8c7-ab29cbae00ec is in RUNNING state, waiting...&#xA;Get a pipeline run with id=37877e37-294e-41b8-b8c7-ab29cbae00ec&#xA;Pipeline run with id=37877e37-294e-41b8-b8c7-ab29cbae00ec is in RUNNING state, waiting...&#xA;Get a pipeline run with id=37877e37-294e-41b8-b8c7-ab29cbae00ec&#xA;Pipeline run with id=37877e37-294e-41b8-b8c7-ab29cbae00ec is in RUNNING state, waiting...&#xA;Get a pipeline run with id=37877e37-294e-41b8-b8c7-ab29cbae00ec&#xA;Pipeline run with id=37877e37-294e-41b8-b8c7-ab29cbae00ec is in RUNNING state, waiting...&#xA;Get a pipeline run with id=37877e37-294e-41b8-b8c7-ab29cbae00ec&#xA;Pipeline run with id=37877e37-294e-41b8-b8c7-ab29cbae00ec is in RUNNING state, waiting...&#xA;Get a pipeline run with id=37877e37-294e-41b8-b8c7-ab29cbae00ec&#xA;Pipeline run with id=37877e37-294e-41b8-b8c7-ab29cbae00ec is in RUNNING state, waiting...&#xA;Get a pipeline run with id=37877e37-294e-41b8-b8c7-ab29cbae00ec&#xA;Pipeline run with id=37877e37-294e-41b8-b8c7-ab29cbae00ec is in RUNNING state, waiting...&#xA;Get a pipeline run with id=37877e37-294e-41b8-b8c7-ab29cbae00ec&#xA;Pipeline run with id=37877e37-294e-41b8-b8c7-ab29cbae00ec is in RUNNING state, waiting...&#xA;Get a pipeline run with id=37877e37-294e-41b8-b8c7-ab29cbae00ec&#xA;Pipeline run with id=37877e37-294e-41b8-b8c7-ab29cbae00ec is in RUNNING state, waiting...&#xA;Get a pipeline run with id=37877e37-294e-41b8-b8c7-ab29cbae00ec&#xA;Pipeline run with id=37877e37-294e-41b8-b8c7-ab29cbae00ec is in RUNNING state, waiting...&#xA;Get a pipeline run with id=37877e37-294e-41b8-b8c7-ab29cbae00ec&#xA;Pipeline run with id=37877e37-294e-41b8-b8c7-ab29cbae00ec is in RUNNING state, waiting...&#xA;Get a pipeline run with id=37877e37-294e-41b8-b8c7-ab29cbae00ec&#xA;Pipeline run with id=37877e37-294e-41b8-b8c7-ab29cbae00ec is in RUNNING state, waiting...&#xA;Get a pipeline run with id=37877e37-294e-41b8-b8c7-ab29cbae00ec&#xA;Pipeline run with id=37877e37-294e-41b8-b8c7-ab29cbae00ec is in RUNNING state, waiting...&#xA;Get a pipeline run with id=37877e37-294e-41b8-b8c7-ab29cbae00ec&#xA;Pipeline run with id=37877e37-294e-41b8-b8c7-ab29cbae00ec is in RUNNING state, waiting...&#xA;Get a pipeline run with id=37877e37-294e-41b8-b8c7-ab29cbae00ec&#xA;Pipeline run with id=37877e37-294e-41b8-b8c7-ab29cbae00ec is in RUNNING state, waiting...&#xA;Get a pipeline run with id=37877e37-294e-41b8-b8c7-ab29cbae00ec&#xA;Pipeline run with id=37877e37-294e-41b8-b8c7-ab29cbae00ec is in RUNNING state, waiting...&#xA;Get a pipeline run with id=37877e37-294e-41b8-b8c7-ab29cbae00ec&#xA;Pipeline run with id=37877e37-294e-41b8-b8c7-ab29cbae00ec is in RUNNING state, waiting...&#xA;Get a pipeline run with id=37877e37-294e-41b8-b8c7-ab29cbae00ec&#xA;Pipeline run with id=37877e37-294e-41b8-b8c7-ab29cbae00ec is in RUNNING state, waiting...&#xA;Get a pipeline run with id=37877e37-294e-41b8-b8c7-ab29cbae00ec&#xA;Pipeline run with id=37877e37-294e-41b8-b8c7-ab29cbae00ec is in RUNNING state, waiting...&#xA;Get a pipeline run with id=37877e37-294e-41b8-b8c7-ab29cbae00ec&#xA;Pipeline run with id=37877e37-294e-41b8-b8c7-ab29cbae00ec is in RUNNING state, waiting...&#xA;Get a pipeline run with id=37877e37-294e-41b8-b8c7-ab29cbae00ec&#xA;Pipeline run with id=37877e37-294e-41b8-b8c7-ab29cbae00ec is in RUNNING state, waiting...&#xA;Get a pipeline run with id=37877e37-294e-41b8-b8c7-ab29cbae00ec&#xA;Pipeline run with id=37877e37-294e-41b8-b8c7-ab29cbae00ec is in RUNNING state, waiting...&#xA;Get a pipeline run with id=37877e37-294e-41b8-b8c7-ab29cbae00ec&#xA;Pipeline run with id=37877e37-294e-41b8-b8c7-ab29cbae00ec is in RUNNING state, waiting...&#xA;Get a pipeline run with id=37877e37-294e-41b8-b8c7-ab29cbae00ec&#xA;Pipeline run with id=37877e37-294e-41b8-b8c7-ab29cbae00ec is in RUNNING state, waiting...&#xA;Get a pipeline run with id=37877e37-294e-41b8-b8c7-ab29cbae00ec&#xA;Pipeline run with id=37877e37-294e-41b8-b8c7-ab29cbae00ec is in RUNNING state, waiting...&#xA;Get a pipeline run with id=37877e37-294e-41b8-b8c7-ab29cbae00ec&#xA;Pipeline run with id=37877e37-294e-41b8-b8c7-ab29cbae00ec reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/flip_coin.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=37877e37-294e-41b8-b8c7-ab29cbae00ec&#xA;Get a pipeline run with id=37877e37-294e-41b8-b8c7-ab29cbae00ec&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 09/09/26 11:44:35.959 (2m45.396s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 09/09/26 11:44:35.96&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 37877e37-294e-41b8-b8c7-ab29cbae00ec&#xA;Failed to terminate run 37877e37-294e-41b8-b8c7-ab29cbae00ec&#xA;Terminate run 37877e37-294e-41b8-b8c7-ab29cbae00ec&#xA;Deleting run 37877e37-294e-41b8-b8c7-ab29cbae00ec&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=c3f596cf-b656-4091-b55b-ce856abec158 (cascade=true)&#xA;Pipeline with id=c3f596cf-b656-4091-b55b-ce856abec158, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 09/09/26 11:44:36.095 (136ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 09/09/26 11:44:36.096&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 09/09/26 11:44:36.096 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 09/09/26 11:44:36.096&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 09/09/26 11:44:36.096 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload essential/iris_pipeline_compiled.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="195.922678215">
              <system-out>2026/09/09 11:45:06 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 09/09/26 11:41:50.232&#xA;Create an experiment with name E2EExperiment-1788954110232761244&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 09/09/26 11:41:50.43 (198ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 09/09/26 11:41:50.43&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x1ee805ce4900&#xA;test-secret-1 created&#xA;test-secret-2 created&#xA;test-secret-3 created&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 09/09/26 11:41:50.518 (88ms)&#xA;&gt; Enter [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 09/09/26 11:41:50.519&#xA;Uploading pipeline file essential/iris_pipeline_compiled.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1788954110430838321, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml&#xA;Upload of pipeline file &#39;essential/iris_pipeline_compiled.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 0dee918a-ed8f-4a96-9f0d-cb0e95f34015&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;0dee918a-ed8f-4a96-9f0d-cb0e95f34015&#39; and name: &#39;e2e-test-1788954110430838321&#39;&#xA;Create a pipeline run for pipeline with id=0dee918a-ed8f-4a96-9f0d-cb0e95f34015 and versionId=1f72e795-aea1-4a1b-a7e7-9ce9a90e1991&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=416b16e6-7266-42c8-91c7-1f4f6a73e7a8&#xA;Created Pipeline Run with id: 416b16e6-7266-42c8-91c7-1f4f6a73e7a8 for pipeline with id: 0dee918a-ed8f-4a96-9f0d-cb0e95f34015&#xA;Waiting for pipeline run with id=416b16e6-7266-42c8-91c7-1f4f6a73e7a8 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=416b16e6-7266-42c8-91c7-1f4f6a73e7a8&#xA;Pipeline run with id=416b16e6-7266-42c8-91c7-1f4f6a73e7a8 is in PENDING state, waiting...&#xA;Get a pipeline run with id=416b16e6-7266-42c8-91c7-1f4f6a73e7a8&#xA;Pipeline run with id=416b16e6-7266-42c8-91c7-1f4f6a73e7a8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=416b16e6-7266-42c8-91c7-1f4f6a73e7a8&#xA;Pipeline run with id=416b16e6-7266-42c8-91c7-1f4f6a73e7a8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=416b16e6-7266-42c8-91c7-1f4f6a73e7a8&#xA;Pipeline run with id=416b16e6-7266-42c8-91c7-1f4f6a73e7a8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=416b16e6-7266-42c8-91c7-1f4f6a73e7a8&#xA;Pipeline run with id=416b16e6-7266-42c8-91c7-1f4f6a73e7a8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=416b16e6-7266-42c8-91c7-1f4f6a73e7a8&#xA;Pipeline run with id=416b16e6-7266-42c8-91c7-1f4f6a73e7a8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=416b16e6-7266-42c8-91c7-1f4f6a73e7a8&#xA;Pipeline run with id=416b16e6-7266-42c8-91c7-1f4f6a73e7a8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=416b16e6-7266-42c8-91c7-1f4f6a73e7a8&#xA;Pipeline run with id=416b16e6-7266-42c8-91c7-1f4f6a73e7a8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=416b16e6-7266-42c8-91c7-1f4f6a73e7a8&#xA;Pipeline run with id=416b16e6-7266-42c8-91c7-1f4f6a73e7a8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=416b16e6-7266-42c8-91c7-1f4f6a73e7a8&#xA;Pipeline run with id=416b16e6-7266-42c8-91c7-1f4f6a73e7a8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=416b16e6-7266-42c8-91c7-1f4f6a73e7a8&#xA;Pipeline run with id=416b16e6-7266-42c8-91c7-1f4f6a73e7a8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=416b16e6-7266-42c8-91c7-1f4f6a73e7a8&#xA;Pipeline run with id=416b16e6-7266-42c8-91c7-1f4f6a73e7a8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=416b16e6-7266-42c8-91c7-1f4f6a73e7a8&#xA;Pipeline run with id=416b16e6-7266-42c8-91c7-1f4f6a73e7a8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=416b16e6-7266-42c8-91c7-1f4f6a73e7a8&#xA;Pipeline run with id=416b16e6-7266-42c8-91c7-1f4f6a73e7a8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=416b16e6-7266-42c8-91c7-1f4f6a73e7a8&#xA;Pipeline run with id=416b16e6-7266-42c8-91c7-1f4f6a73e7a8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=416b16e6-7266-42c8-91c7-1f4f6a73e7a8&#xA;Pipeline run with id=416b16e6-7266-42c8-91c7-1f4f6a73e7a8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=416b16e6-7266-42c8-91c7-1f4f6a73e7a8&#xA;Pipeline run with id=416b16e6-7266-42c8-91c7-1f4f6a73e7a8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=416b16e6-7266-42c8-91c7-1f4f6a73e7a8&#xA;Pipeline run with id=416b16e6-7266-42c8-91c7-1f4f6a73e7a8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=416b16e6-7266-42c8-91c7-1f4f6a73e7a8&#xA;Pipeline run with id=416b16e6-7266-42c8-91c7-1f4f6a73e7a8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=416b16e6-7266-42c8-91c7-1f4f6a73e7a8&#xA;Pipeline run with id=416b16e6-7266-42c8-91c7-1f4f6a73e7a8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=416b16e6-7266-42c8-91c7-1f4f6a73e7a8&#xA;Pipeline run with id=416b16e6-7266-42c8-91c7-1f4f6a73e7a8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=416b16e6-7266-42c8-91c7-1f4f6a73e7a8&#xA;Pipeline run with id=416b16e6-7266-42c8-91c7-1f4f6a73e7a8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=416b16e6-7266-42c8-91c7-1f4f6a73e7a8&#xA;Pipeline run with id=416b16e6-7266-42c8-91c7-1f4f6a73e7a8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=416b16e6-7266-42c8-91c7-1f4f6a73e7a8&#xA;Pipeline run with id=416b16e6-7266-42c8-91c7-1f4f6a73e7a8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=416b16e6-7266-42c8-91c7-1f4f6a73e7a8&#xA;Pipeline run with id=416b16e6-7266-42c8-91c7-1f4f6a73e7a8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=416b16e6-7266-42c8-91c7-1f4f6a73e7a8&#xA;Pipeline run with id=416b16e6-7266-42c8-91c7-1f4f6a73e7a8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=416b16e6-7266-42c8-91c7-1f4f6a73e7a8&#xA;Pipeline run with id=416b16e6-7266-42c8-91c7-1f4f6a73e7a8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=416b16e6-7266-42c8-91c7-1f4f6a73e7a8&#xA;Pipeline run with id=416b16e6-7266-42c8-91c7-1f4f6a73e7a8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=416b16e6-7266-42c8-91c7-1f4f6a73e7a8&#xA;Pipeline run with id=416b16e6-7266-42c8-91c7-1f4f6a73e7a8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=416b16e6-7266-42c8-91c7-1f4f6a73e7a8&#xA;Pipeline run with id=416b16e6-7266-42c8-91c7-1f4f6a73e7a8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=416b16e6-7266-42c8-91c7-1f4f6a73e7a8&#xA;Pipeline run with id=416b16e6-7266-42c8-91c7-1f4f6a73e7a8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=416b16e6-7266-42c8-91c7-1f4f6a73e7a8&#xA;Pipeline run with id=416b16e6-7266-42c8-91c7-1f4f6a73e7a8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=416b16e6-7266-42c8-91c7-1f4f6a73e7a8&#xA;Pipeline run with id=416b16e6-7266-42c8-91c7-1f4f6a73e7a8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=416b16e6-7266-42c8-91c7-1f4f6a73e7a8&#xA;Pipeline run with id=416b16e6-7266-42c8-91c7-1f4f6a73e7a8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=416b16e6-7266-42c8-91c7-1f4f6a73e7a8&#xA;Pipeline run with id=416b16e6-7266-42c8-91c7-1f4f6a73e7a8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=416b16e6-7266-42c8-91c7-1f4f6a73e7a8&#xA;Pipeline run with id=416b16e6-7266-42c8-91c7-1f4f6a73e7a8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=416b16e6-7266-42c8-91c7-1f4f6a73e7a8&#xA;Pipeline run with id=416b16e6-7266-42c8-91c7-1f4f6a73e7a8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=416b16e6-7266-42c8-91c7-1f4f6a73e7a8&#xA;Pipeline run with id=416b16e6-7266-42c8-91c7-1f4f6a73e7a8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=416b16e6-7266-42c8-91c7-1f4f6a73e7a8&#xA;Pipeline run with id=416b16e6-7266-42c8-91c7-1f4f6a73e7a8 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=416b16e6-7266-42c8-91c7-1f4f6a73e7a8&#xA;Pipeline run with id=416b16e6-7266-42c8-91c7-1f4f6a73e7a8 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;essential/iris_pipeline_compiled.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=416b16e6-7266-42c8-91c7-1f4f6a73e7a8&#xA;Get a pipeline run with id=416b16e6-7266-42c8-91c7-1f4f6a73e7a8&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 09/09/26 11:45:06.031 (3m15.512s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 09/09/26 11:45:06.031&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 416b16e6-7266-42c8-91c7-1f4f6a73e7a8&#xA;Failed to terminate run 416b16e6-7266-42c8-91c7-1f4f6a73e7a8&#xA;Terminate run 416b16e6-7266-42c8-91c7-1f4f6a73e7a8&#xA;Deleting run 416b16e6-7266-42c8-91c7-1f4f6a73e7a8&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=0dee918a-ed8f-4a96-9f0d-cb0e95f34015 (cascade=true)&#xA;Pipeline with id=0dee918a-ed8f-4a96-9f0d-cb0e95f34015, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 09/09/26 11:45:06.155 (124ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 09/09/26 11:45:06.155&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 09/09/26 11:45:06.155 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 09/09/26 11:45:06.155&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 09/09/26 11:45:06.155 (0s)&#xA;</system-err>
          </testcase>
      </testsuite>
  </testsuites>