<?xml version="1.0" encoding="UTF-8"?>
  <testsuites tests="5" disabled="0" errors="0" failures="0" time="186.336315906">
      <testsuite name="AIPipelinesE2ETests" package="/dspa/backend/test/end2end" tests="5" disabled="0" skipped="0" errors="0" failures="0" time="186.336315906" timestamp="2026-07-05T13:53:28">
          <properties>
              <property name="SuiteSucceeded" value="true"></property>
              <property name="SuiteHasProgrammaticFocus" value="false"></property>
              <property name="SpecialSuiteFailureReason" value=""></property>
              <property name="SuiteLabels" value="[]"></property>
              <property name="SuiteSemVerConstraints" value="[]"></property>
              <property name="RandomSeed" value="1783259447"></property>
              <property name="RandomizeAllSpecs" value="false"></property>
              <property name="LabelFilter" value="Smoke"></property>
              <property name="SemVerFilter" value=""></property>
              <property name="FocusStrings" value=""></property>
              <property name="SkipStrings" value=""></property>
              <property name="FocusFiles" value=""></property>
              <property name="SkipFiles" value=""></property>
              <property name="FailOnPending" value="false"></property>
              <property name="FailOnEmpty" value="false"></property>
              <property name="FailFast" value="false"></property>
              <property name="FlakeAttempts" value="0"></property>
              <property name="DryRun" value="false"></property>
              <property name="ParallelTotal" value="10"></property>
              <property name="OutputInterceptorMode" value=""></property>
          </properties>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload essential/component_with_pip_index_urls.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="81.129286538">
              <system-out>2026/07/05 13:54:49 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/05/26 13:53:28.556&#xA;Create an experiment with name E2EExperiment-1783259608556892783&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/05/26 13:53:28.871 (314ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/05/26 13:53:28.871&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x3d3829484580&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/05/26 13:53:28.967 (96ms)&#xA;&gt; Enter [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/05/26 13:53:28.967&#xA;Uploading pipeline file essential/component_with_pip_index_urls.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1783259608871561657, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml&#xA;Upload of pipeline file &#39;essential/component_with_pip_index_urls.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 71b7da2d-0d34-4f02-bca7-1279143f167a&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;71b7da2d-0d34-4f02-bca7-1279143f167a&#39; and name: &#39;e2e-test-1783259608871561657&#39;&#xA;Create a pipeline run for pipeline with id=71b7da2d-0d34-4f02-bca7-1279143f167a and versionId=f0259b97-8989-48b9-a29d-cd6ea6d058d6&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=1aa61994-4171-430e-b104-c8968861a9d6&#xA;Created Pipeline Run with id: 1aa61994-4171-430e-b104-c8968861a9d6 for pipeline with id: 71b7da2d-0d34-4f02-bca7-1279143f167a&#xA;Waiting for pipeline run with id=1aa61994-4171-430e-b104-c8968861a9d6 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=1aa61994-4171-430e-b104-c8968861a9d6&#xA;Pipeline run with id=1aa61994-4171-430e-b104-c8968861a9d6 is in PENDING state, waiting...&#xA;Get a pipeline run with id=1aa61994-4171-430e-b104-c8968861a9d6&#xA;Pipeline run with id=1aa61994-4171-430e-b104-c8968861a9d6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1aa61994-4171-430e-b104-c8968861a9d6&#xA;Pipeline run with id=1aa61994-4171-430e-b104-c8968861a9d6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1aa61994-4171-430e-b104-c8968861a9d6&#xA;Pipeline run with id=1aa61994-4171-430e-b104-c8968861a9d6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1aa61994-4171-430e-b104-c8968861a9d6&#xA;Pipeline run with id=1aa61994-4171-430e-b104-c8968861a9d6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1aa61994-4171-430e-b104-c8968861a9d6&#xA;Pipeline run with id=1aa61994-4171-430e-b104-c8968861a9d6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1aa61994-4171-430e-b104-c8968861a9d6&#xA;Pipeline run with id=1aa61994-4171-430e-b104-c8968861a9d6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1aa61994-4171-430e-b104-c8968861a9d6&#xA;Pipeline run with id=1aa61994-4171-430e-b104-c8968861a9d6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1aa61994-4171-430e-b104-c8968861a9d6&#xA;Pipeline run with id=1aa61994-4171-430e-b104-c8968861a9d6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1aa61994-4171-430e-b104-c8968861a9d6&#xA;Pipeline run with id=1aa61994-4171-430e-b104-c8968861a9d6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1aa61994-4171-430e-b104-c8968861a9d6&#xA;Pipeline run with id=1aa61994-4171-430e-b104-c8968861a9d6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1aa61994-4171-430e-b104-c8968861a9d6&#xA;Pipeline run with id=1aa61994-4171-430e-b104-c8968861a9d6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1aa61994-4171-430e-b104-c8968861a9d6&#xA;Pipeline run with id=1aa61994-4171-430e-b104-c8968861a9d6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1aa61994-4171-430e-b104-c8968861a9d6&#xA;Pipeline run with id=1aa61994-4171-430e-b104-c8968861a9d6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1aa61994-4171-430e-b104-c8968861a9d6&#xA;Pipeline run with id=1aa61994-4171-430e-b104-c8968861a9d6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1aa61994-4171-430e-b104-c8968861a9d6&#xA;Pipeline run with id=1aa61994-4171-430e-b104-c8968861a9d6 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1aa61994-4171-430e-b104-c8968861a9d6&#xA;Pipeline run with id=1aa61994-4171-430e-b104-c8968861a9d6 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;essential/component_with_pip_index_urls.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=1aa61994-4171-430e-b104-c8968861a9d6&#xA;Get a pipeline run with id=1aa61994-4171-430e-b104-c8968861a9d6&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/05/26 13:54:49.555 (1m20.588s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/05/26 13:54:49.555&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 1aa61994-4171-430e-b104-c8968861a9d6&#xA;Failed to terminate run 1aa61994-4171-430e-b104-c8968861a9d6&#xA;Terminate run 1aa61994-4171-430e-b104-c8968861a9d6&#xA;Deleting run 1aa61994-4171-430e-b104-c8968861a9d6&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=71b7da2d-0d34-4f02-bca7-1279143f167a (cascade=true)&#xA;Pipeline with id=71b7da2d-0d34-4f02-bca7-1279143f167a, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/05/26 13:54:49.685 (130ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/05/26 13:54:49.686&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/05/26 13:54:49.686 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/05/26 13:54:49.686&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/05/26 13:54:49.686 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/parallel_for_after_dependency.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="121.38737697">
              <system-out>2026/07/05 13:55:29 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/05/26 13:53:28.556&#xA;Create an experiment with name E2EExperiment-1783259608556734529&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/05/26 13:53:28.87 (314ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/05/26 13:53:28.871&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x1502490f8500&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/05/26 13:53:28.973 (102ms)&#xA;&gt; Enter [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/05/26 13:53:28.973&#xA;Uploading pipeline file critical/parallel_for_after_dependency.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1783259608871176937, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml&#xA;Upload of pipeline file &#39;critical/parallel_for_after_dependency.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 2045860f-464f-4a17-aff9-b438f071d007&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;2045860f-464f-4a17-aff9-b438f071d007&#39; and name: &#39;e2e-test-1783259608871176937&#39;&#xA;Create a pipeline run for pipeline with id=2045860f-464f-4a17-aff9-b438f071d007 and versionId=01d32034-c40c-44cc-8a28-2f54aa344915&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=8fdd2ae3-8b02-4323-8f8e-c108ddcdeec1&#xA;Created Pipeline Run with id: 8fdd2ae3-8b02-4323-8f8e-c108ddcdeec1 for pipeline with id: 2045860f-464f-4a17-aff9-b438f071d007&#xA;Waiting for pipeline run with id=8fdd2ae3-8b02-4323-8f8e-c108ddcdeec1 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=8fdd2ae3-8b02-4323-8f8e-c108ddcdeec1&#xA;Pipeline run with id=8fdd2ae3-8b02-4323-8f8e-c108ddcdeec1 is in PENDING state, waiting...&#xA;Get a pipeline run with id=8fdd2ae3-8b02-4323-8f8e-c108ddcdeec1&#xA;Pipeline run with id=8fdd2ae3-8b02-4323-8f8e-c108ddcdeec1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8fdd2ae3-8b02-4323-8f8e-c108ddcdeec1&#xA;Pipeline run with id=8fdd2ae3-8b02-4323-8f8e-c108ddcdeec1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8fdd2ae3-8b02-4323-8f8e-c108ddcdeec1&#xA;Pipeline run with id=8fdd2ae3-8b02-4323-8f8e-c108ddcdeec1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8fdd2ae3-8b02-4323-8f8e-c108ddcdeec1&#xA;Pipeline run with id=8fdd2ae3-8b02-4323-8f8e-c108ddcdeec1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8fdd2ae3-8b02-4323-8f8e-c108ddcdeec1&#xA;Pipeline run with id=8fdd2ae3-8b02-4323-8f8e-c108ddcdeec1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8fdd2ae3-8b02-4323-8f8e-c108ddcdeec1&#xA;Pipeline run with id=8fdd2ae3-8b02-4323-8f8e-c108ddcdeec1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8fdd2ae3-8b02-4323-8f8e-c108ddcdeec1&#xA;Pipeline run with id=8fdd2ae3-8b02-4323-8f8e-c108ddcdeec1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8fdd2ae3-8b02-4323-8f8e-c108ddcdeec1&#xA;Pipeline run with id=8fdd2ae3-8b02-4323-8f8e-c108ddcdeec1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8fdd2ae3-8b02-4323-8f8e-c108ddcdeec1&#xA;Pipeline run with id=8fdd2ae3-8b02-4323-8f8e-c108ddcdeec1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8fdd2ae3-8b02-4323-8f8e-c108ddcdeec1&#xA;Pipeline run with id=8fdd2ae3-8b02-4323-8f8e-c108ddcdeec1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8fdd2ae3-8b02-4323-8f8e-c108ddcdeec1&#xA;Pipeline run with id=8fdd2ae3-8b02-4323-8f8e-c108ddcdeec1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8fdd2ae3-8b02-4323-8f8e-c108ddcdeec1&#xA;Pipeline run with id=8fdd2ae3-8b02-4323-8f8e-c108ddcdeec1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8fdd2ae3-8b02-4323-8f8e-c108ddcdeec1&#xA;Pipeline run with id=8fdd2ae3-8b02-4323-8f8e-c108ddcdeec1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8fdd2ae3-8b02-4323-8f8e-c108ddcdeec1&#xA;Pipeline run with id=8fdd2ae3-8b02-4323-8f8e-c108ddcdeec1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8fdd2ae3-8b02-4323-8f8e-c108ddcdeec1&#xA;Pipeline run with id=8fdd2ae3-8b02-4323-8f8e-c108ddcdeec1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8fdd2ae3-8b02-4323-8f8e-c108ddcdeec1&#xA;Pipeline run with id=8fdd2ae3-8b02-4323-8f8e-c108ddcdeec1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8fdd2ae3-8b02-4323-8f8e-c108ddcdeec1&#xA;Pipeline run with id=8fdd2ae3-8b02-4323-8f8e-c108ddcdeec1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8fdd2ae3-8b02-4323-8f8e-c108ddcdeec1&#xA;Pipeline run with id=8fdd2ae3-8b02-4323-8f8e-c108ddcdeec1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8fdd2ae3-8b02-4323-8f8e-c108ddcdeec1&#xA;Pipeline run with id=8fdd2ae3-8b02-4323-8f8e-c108ddcdeec1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8fdd2ae3-8b02-4323-8f8e-c108ddcdeec1&#xA;Pipeline run with id=8fdd2ae3-8b02-4323-8f8e-c108ddcdeec1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8fdd2ae3-8b02-4323-8f8e-c108ddcdeec1&#xA;Pipeline run with id=8fdd2ae3-8b02-4323-8f8e-c108ddcdeec1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8fdd2ae3-8b02-4323-8f8e-c108ddcdeec1&#xA;Pipeline run with id=8fdd2ae3-8b02-4323-8f8e-c108ddcdeec1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8fdd2ae3-8b02-4323-8f8e-c108ddcdeec1&#xA;Pipeline run with id=8fdd2ae3-8b02-4323-8f8e-c108ddcdeec1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8fdd2ae3-8b02-4323-8f8e-c108ddcdeec1&#xA;Pipeline run with id=8fdd2ae3-8b02-4323-8f8e-c108ddcdeec1 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/parallel_for_after_dependency.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=8fdd2ae3-8b02-4323-8f8e-c108ddcdeec1&#xA;Get a pipeline run with id=8fdd2ae3-8b02-4323-8f8e-c108ddcdeec1&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/05/26 13:55:29.615 (2m0.642s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/05/26 13:55:29.615&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 8fdd2ae3-8b02-4323-8f8e-c108ddcdeec1&#xA;Failed to terminate run 8fdd2ae3-8b02-4323-8f8e-c108ddcdeec1&#xA;Terminate run 8fdd2ae3-8b02-4323-8f8e-c108ddcdeec1&#xA;Deleting run 8fdd2ae3-8b02-4323-8f8e-c108ddcdeec1&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=2045860f-464f-4a17-aff9-b438f071d007 (cascade=true)&#xA;Pipeline with id=2045860f-464f-4a17-aff9-b438f071d007, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/05/26 13:55:29.943 (328ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/05/26 13:55:29.944&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/05/26 13:55:29.944 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/05/26 13:55:29.944&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/05/26 13:55:29.944 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/pipeline_with_artifact_upload_download.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="131.20537584">
              <system-out>2026/07/05 13:55:39 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/05/26 13:53:28.556&#xA;Create an experiment with name E2EExperiment-1783259608556476282&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/05/26 13:53:28.873 (317ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/05/26 13:53:28.874&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x38263f09e400&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/05/26 13:53:28.968 (94ms)&#xA;&gt; Enter [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/05/26 13:53:28.968&#xA;Uploading pipeline file critical/pipeline_with_artifact_upload_download.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1783259608874083701, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml&#xA;Upload of pipeline file &#39;critical/pipeline_with_artifact_upload_download.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 8293ac39-c7ed-4eca-823a-fe177f988250&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;8293ac39-c7ed-4eca-823a-fe177f988250&#39; and name: &#39;e2e-test-1783259608874083701&#39;&#xA;Create a pipeline run for pipeline with id=8293ac39-c7ed-4eca-823a-fe177f988250 and versionId=b0ee9b41-332b-4ad3-a145-ebf83c3ca542&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=4f22a523-e68e-49a7-bf3a-7f36f084b5b4&#xA;Created Pipeline Run with id: 4f22a523-e68e-49a7-bf3a-7f36f084b5b4 for pipeline with id: 8293ac39-c7ed-4eca-823a-fe177f988250&#xA;Waiting for pipeline run with id=4f22a523-e68e-49a7-bf3a-7f36f084b5b4 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=4f22a523-e68e-49a7-bf3a-7f36f084b5b4&#xA;Pipeline run with id=4f22a523-e68e-49a7-bf3a-7f36f084b5b4 is in PENDING state, waiting...&#xA;Get a pipeline run with id=4f22a523-e68e-49a7-bf3a-7f36f084b5b4&#xA;Pipeline run with id=4f22a523-e68e-49a7-bf3a-7f36f084b5b4 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4f22a523-e68e-49a7-bf3a-7f36f084b5b4&#xA;Pipeline run with id=4f22a523-e68e-49a7-bf3a-7f36f084b5b4 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4f22a523-e68e-49a7-bf3a-7f36f084b5b4&#xA;Pipeline run with id=4f22a523-e68e-49a7-bf3a-7f36f084b5b4 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4f22a523-e68e-49a7-bf3a-7f36f084b5b4&#xA;Pipeline run with id=4f22a523-e68e-49a7-bf3a-7f36f084b5b4 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4f22a523-e68e-49a7-bf3a-7f36f084b5b4&#xA;Pipeline run with id=4f22a523-e68e-49a7-bf3a-7f36f084b5b4 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4f22a523-e68e-49a7-bf3a-7f36f084b5b4&#xA;Pipeline run with id=4f22a523-e68e-49a7-bf3a-7f36f084b5b4 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4f22a523-e68e-49a7-bf3a-7f36f084b5b4&#xA;Pipeline run with id=4f22a523-e68e-49a7-bf3a-7f36f084b5b4 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4f22a523-e68e-49a7-bf3a-7f36f084b5b4&#xA;Pipeline run with id=4f22a523-e68e-49a7-bf3a-7f36f084b5b4 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4f22a523-e68e-49a7-bf3a-7f36f084b5b4&#xA;Pipeline run with id=4f22a523-e68e-49a7-bf3a-7f36f084b5b4 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4f22a523-e68e-49a7-bf3a-7f36f084b5b4&#xA;Pipeline run with id=4f22a523-e68e-49a7-bf3a-7f36f084b5b4 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4f22a523-e68e-49a7-bf3a-7f36f084b5b4&#xA;Pipeline run with id=4f22a523-e68e-49a7-bf3a-7f36f084b5b4 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4f22a523-e68e-49a7-bf3a-7f36f084b5b4&#xA;Pipeline run with id=4f22a523-e68e-49a7-bf3a-7f36f084b5b4 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4f22a523-e68e-49a7-bf3a-7f36f084b5b4&#xA;Pipeline run with id=4f22a523-e68e-49a7-bf3a-7f36f084b5b4 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4f22a523-e68e-49a7-bf3a-7f36f084b5b4&#xA;Pipeline run with id=4f22a523-e68e-49a7-bf3a-7f36f084b5b4 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4f22a523-e68e-49a7-bf3a-7f36f084b5b4&#xA;Pipeline run with id=4f22a523-e68e-49a7-bf3a-7f36f084b5b4 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4f22a523-e68e-49a7-bf3a-7f36f084b5b4&#xA;Pipeline run with id=4f22a523-e68e-49a7-bf3a-7f36f084b5b4 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4f22a523-e68e-49a7-bf3a-7f36f084b5b4&#xA;Pipeline run with id=4f22a523-e68e-49a7-bf3a-7f36f084b5b4 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4f22a523-e68e-49a7-bf3a-7f36f084b5b4&#xA;Pipeline run with id=4f22a523-e68e-49a7-bf3a-7f36f084b5b4 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4f22a523-e68e-49a7-bf3a-7f36f084b5b4&#xA;Pipeline run with id=4f22a523-e68e-49a7-bf3a-7f36f084b5b4 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4f22a523-e68e-49a7-bf3a-7f36f084b5b4&#xA;Pipeline run with id=4f22a523-e68e-49a7-bf3a-7f36f084b5b4 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4f22a523-e68e-49a7-bf3a-7f36f084b5b4&#xA;Pipeline run with id=4f22a523-e68e-49a7-bf3a-7f36f084b5b4 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4f22a523-e68e-49a7-bf3a-7f36f084b5b4&#xA;Pipeline run with id=4f22a523-e68e-49a7-bf3a-7f36f084b5b4 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4f22a523-e68e-49a7-bf3a-7f36f084b5b4&#xA;Pipeline run with id=4f22a523-e68e-49a7-bf3a-7f36f084b5b4 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4f22a523-e68e-49a7-bf3a-7f36f084b5b4&#xA;Pipeline run with id=4f22a523-e68e-49a7-bf3a-7f36f084b5b4 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4f22a523-e68e-49a7-bf3a-7f36f084b5b4&#xA;Pipeline run with id=4f22a523-e68e-49a7-bf3a-7f36f084b5b4 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4f22a523-e68e-49a7-bf3a-7f36f084b5b4&#xA;Pipeline run with id=4f22a523-e68e-49a7-bf3a-7f36f084b5b4 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/pipeline_with_artifact_upload_download.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=4f22a523-e68e-49a7-bf3a-7f36f084b5b4&#xA;Get a pipeline run with id=4f22a523-e68e-49a7-bf3a-7f36f084b5b4&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/05/26 13:55:39.605 (2m10.637s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/05/26 13:55:39.605&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 4f22a523-e68e-49a7-bf3a-7f36f084b5b4&#xA;Failed to terminate run 4f22a523-e68e-49a7-bf3a-7f36f084b5b4&#xA;Terminate run 4f22a523-e68e-49a7-bf3a-7f36f084b5b4&#xA;Deleting run 4f22a523-e68e-49a7-bf3a-7f36f084b5b4&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=8293ac39-c7ed-4eca-823a-fe177f988250 (cascade=true)&#xA;Pipeline with id=8293ac39-c7ed-4eca-823a-fe177f988250, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/05/26 13:55:39.761 (156ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/05/26 13:55:39.762&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/05/26 13:55:39.762 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/05/26 13:55:39.762&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/05/26 13:55:39.762 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/flip_coin.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="161.289728132">
              <system-out>2026/07/05 13:56:09 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/05/26 13:53:28.556&#xA;Create an experiment with name E2EExperiment-1783259608556375250&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/05/26 13:53:28.869 (313ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/05/26 13:53:28.87&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x3d78f4f86680&#xA;test-secret-1 created&#xA;test-secret-2 created&#xA;test-secret-3 created&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/05/26 13:53:28.92 (50ms)&#xA;&gt; Enter [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/05/26 13:53:28.92&#xA;Uploading pipeline file critical/flip_coin.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1783259608870130890, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml&#xA;Upload of pipeline file &#39;critical/flip_coin.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 4b0831b8-10b9-4785-bfc4-a04707f99d5c&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;4b0831b8-10b9-4785-bfc4-a04707f99d5c&#39; and name: &#39;e2e-test-1783259608870130890&#39;&#xA;Create a pipeline run for pipeline with id=4b0831b8-10b9-4785-bfc4-a04707f99d5c and versionId=68adedf2-5114-42ac-98ba-5021b13a5fbe&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=313a44ab-0a89-449d-9230-6f9dc2046f57&#xA;Created Pipeline Run with id: 313a44ab-0a89-449d-9230-6f9dc2046f57 for pipeline with id: 4b0831b8-10b9-4785-bfc4-a04707f99d5c&#xA;Waiting for pipeline run with id=313a44ab-0a89-449d-9230-6f9dc2046f57 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=313a44ab-0a89-449d-9230-6f9dc2046f57&#xA;Pipeline run with id=313a44ab-0a89-449d-9230-6f9dc2046f57 is in PENDING state, waiting...&#xA;Get a pipeline run with id=313a44ab-0a89-449d-9230-6f9dc2046f57&#xA;Pipeline run with id=313a44ab-0a89-449d-9230-6f9dc2046f57 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=313a44ab-0a89-449d-9230-6f9dc2046f57&#xA;Pipeline run with id=313a44ab-0a89-449d-9230-6f9dc2046f57 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=313a44ab-0a89-449d-9230-6f9dc2046f57&#xA;Pipeline run with id=313a44ab-0a89-449d-9230-6f9dc2046f57 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=313a44ab-0a89-449d-9230-6f9dc2046f57&#xA;Pipeline run with id=313a44ab-0a89-449d-9230-6f9dc2046f57 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=313a44ab-0a89-449d-9230-6f9dc2046f57&#xA;Pipeline run with id=313a44ab-0a89-449d-9230-6f9dc2046f57 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=313a44ab-0a89-449d-9230-6f9dc2046f57&#xA;Pipeline run with id=313a44ab-0a89-449d-9230-6f9dc2046f57 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=313a44ab-0a89-449d-9230-6f9dc2046f57&#xA;Pipeline run with id=313a44ab-0a89-449d-9230-6f9dc2046f57 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=313a44ab-0a89-449d-9230-6f9dc2046f57&#xA;Pipeline run with id=313a44ab-0a89-449d-9230-6f9dc2046f57 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=313a44ab-0a89-449d-9230-6f9dc2046f57&#xA;Pipeline run with id=313a44ab-0a89-449d-9230-6f9dc2046f57 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=313a44ab-0a89-449d-9230-6f9dc2046f57&#xA;Pipeline run with id=313a44ab-0a89-449d-9230-6f9dc2046f57 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=313a44ab-0a89-449d-9230-6f9dc2046f57&#xA;Pipeline run with id=313a44ab-0a89-449d-9230-6f9dc2046f57 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=313a44ab-0a89-449d-9230-6f9dc2046f57&#xA;Pipeline run with id=313a44ab-0a89-449d-9230-6f9dc2046f57 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=313a44ab-0a89-449d-9230-6f9dc2046f57&#xA;Pipeline run with id=313a44ab-0a89-449d-9230-6f9dc2046f57 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=313a44ab-0a89-449d-9230-6f9dc2046f57&#xA;Pipeline run with id=313a44ab-0a89-449d-9230-6f9dc2046f57 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=313a44ab-0a89-449d-9230-6f9dc2046f57&#xA;Pipeline run with id=313a44ab-0a89-449d-9230-6f9dc2046f57 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=313a44ab-0a89-449d-9230-6f9dc2046f57&#xA;Pipeline run with id=313a44ab-0a89-449d-9230-6f9dc2046f57 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=313a44ab-0a89-449d-9230-6f9dc2046f57&#xA;Pipeline run with id=313a44ab-0a89-449d-9230-6f9dc2046f57 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=313a44ab-0a89-449d-9230-6f9dc2046f57&#xA;Pipeline run with id=313a44ab-0a89-449d-9230-6f9dc2046f57 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=313a44ab-0a89-449d-9230-6f9dc2046f57&#xA;Pipeline run with id=313a44ab-0a89-449d-9230-6f9dc2046f57 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=313a44ab-0a89-449d-9230-6f9dc2046f57&#xA;Pipeline run with id=313a44ab-0a89-449d-9230-6f9dc2046f57 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=313a44ab-0a89-449d-9230-6f9dc2046f57&#xA;Pipeline run with id=313a44ab-0a89-449d-9230-6f9dc2046f57 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=313a44ab-0a89-449d-9230-6f9dc2046f57&#xA;Pipeline run with id=313a44ab-0a89-449d-9230-6f9dc2046f57 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=313a44ab-0a89-449d-9230-6f9dc2046f57&#xA;Pipeline run with id=313a44ab-0a89-449d-9230-6f9dc2046f57 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=313a44ab-0a89-449d-9230-6f9dc2046f57&#xA;Pipeline run with id=313a44ab-0a89-449d-9230-6f9dc2046f57 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=313a44ab-0a89-449d-9230-6f9dc2046f57&#xA;Pipeline run with id=313a44ab-0a89-449d-9230-6f9dc2046f57 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=313a44ab-0a89-449d-9230-6f9dc2046f57&#xA;Pipeline run with id=313a44ab-0a89-449d-9230-6f9dc2046f57 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=313a44ab-0a89-449d-9230-6f9dc2046f57&#xA;Pipeline run with id=313a44ab-0a89-449d-9230-6f9dc2046f57 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=313a44ab-0a89-449d-9230-6f9dc2046f57&#xA;Pipeline run with id=313a44ab-0a89-449d-9230-6f9dc2046f57 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=313a44ab-0a89-449d-9230-6f9dc2046f57&#xA;Pipeline run with id=313a44ab-0a89-449d-9230-6f9dc2046f57 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=313a44ab-0a89-449d-9230-6f9dc2046f57&#xA;Pipeline run with id=313a44ab-0a89-449d-9230-6f9dc2046f57 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=313a44ab-0a89-449d-9230-6f9dc2046f57&#xA;Pipeline run with id=313a44ab-0a89-449d-9230-6f9dc2046f57 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=313a44ab-0a89-449d-9230-6f9dc2046f57&#xA;Pipeline run with id=313a44ab-0a89-449d-9230-6f9dc2046f57 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/flip_coin.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=313a44ab-0a89-449d-9230-6f9dc2046f57&#xA;Get a pipeline run with id=313a44ab-0a89-449d-9230-6f9dc2046f57&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/05/26 13:56:09.574 (2m40.654s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/05/26 13:56:09.574&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 313a44ab-0a89-449d-9230-6f9dc2046f57&#xA;Failed to terminate run 313a44ab-0a89-449d-9230-6f9dc2046f57&#xA;Terminate run 313a44ab-0a89-449d-9230-6f9dc2046f57&#xA;Deleting run 313a44ab-0a89-449d-9230-6f9dc2046f57&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=4b0831b8-10b9-4785-bfc4-a04707f99d5c (cascade=true)&#xA;Pipeline with id=4b0831b8-10b9-4785-bfc4-a04707f99d5c, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/05/26 13:56:09.846 (271ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/05/26 13:56:09.846&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/05/26 13:56:09.846 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/05/26 13:56:09.846&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/05/26 13:56:09.846 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload essential/iris_pipeline_compiled.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="186.224547988">
              <system-out>2026/07/05 13:56:34 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/05/26 13:53:28.557&#xA;Create an experiment with name E2EExperiment-1783259608557088968&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/05/26 13:53:28.87 (314ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/05/26 13:53:28.871&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0xdf63adaca00&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/05/26 13:53:28.967 (97ms)&#xA;&gt; Enter [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/05/26 13:53:28.967&#xA;Uploading pipeline file essential/iris_pipeline_compiled.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1783259608871153926, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml&#xA;Upload of pipeline file &#39;essential/iris_pipeline_compiled.yaml&#39; successful&#xA;Listing pipeline versions for pipeline ede422af-7dca-41a9-8143-9722d94afffb&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;ede422af-7dca-41a9-8143-9722d94afffb&#39; and name: &#39;e2e-test-1783259608871153926&#39;&#xA;Create a pipeline run for pipeline with id=ede422af-7dca-41a9-8143-9722d94afffb and versionId=038f7d0a-bf79-4a0a-8d52-645a5967d42a&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=3aa809dc-02bc-439d-a64a-98bd1b32d79f&#xA;Created Pipeline Run with id: 3aa809dc-02bc-439d-a64a-98bd1b32d79f for pipeline with id: ede422af-7dca-41a9-8143-9722d94afffb&#xA;Waiting for pipeline run with id=3aa809dc-02bc-439d-a64a-98bd1b32d79f to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=3aa809dc-02bc-439d-a64a-98bd1b32d79f&#xA;Pipeline run with id=3aa809dc-02bc-439d-a64a-98bd1b32d79f is in PENDING state, waiting...&#xA;Get a pipeline run with id=3aa809dc-02bc-439d-a64a-98bd1b32d79f&#xA;Pipeline run with id=3aa809dc-02bc-439d-a64a-98bd1b32d79f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3aa809dc-02bc-439d-a64a-98bd1b32d79f&#xA;Pipeline run with id=3aa809dc-02bc-439d-a64a-98bd1b32d79f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3aa809dc-02bc-439d-a64a-98bd1b32d79f&#xA;Pipeline run with id=3aa809dc-02bc-439d-a64a-98bd1b32d79f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3aa809dc-02bc-439d-a64a-98bd1b32d79f&#xA;Pipeline run with id=3aa809dc-02bc-439d-a64a-98bd1b32d79f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3aa809dc-02bc-439d-a64a-98bd1b32d79f&#xA;Pipeline run with id=3aa809dc-02bc-439d-a64a-98bd1b32d79f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3aa809dc-02bc-439d-a64a-98bd1b32d79f&#xA;Pipeline run with id=3aa809dc-02bc-439d-a64a-98bd1b32d79f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3aa809dc-02bc-439d-a64a-98bd1b32d79f&#xA;Pipeline run with id=3aa809dc-02bc-439d-a64a-98bd1b32d79f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3aa809dc-02bc-439d-a64a-98bd1b32d79f&#xA;Pipeline run with id=3aa809dc-02bc-439d-a64a-98bd1b32d79f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3aa809dc-02bc-439d-a64a-98bd1b32d79f&#xA;Pipeline run with id=3aa809dc-02bc-439d-a64a-98bd1b32d79f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3aa809dc-02bc-439d-a64a-98bd1b32d79f&#xA;Pipeline run with id=3aa809dc-02bc-439d-a64a-98bd1b32d79f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3aa809dc-02bc-439d-a64a-98bd1b32d79f&#xA;Pipeline run with id=3aa809dc-02bc-439d-a64a-98bd1b32d79f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3aa809dc-02bc-439d-a64a-98bd1b32d79f&#xA;Pipeline run with id=3aa809dc-02bc-439d-a64a-98bd1b32d79f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3aa809dc-02bc-439d-a64a-98bd1b32d79f&#xA;Pipeline run with id=3aa809dc-02bc-439d-a64a-98bd1b32d79f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3aa809dc-02bc-439d-a64a-98bd1b32d79f&#xA;Pipeline run with id=3aa809dc-02bc-439d-a64a-98bd1b32d79f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3aa809dc-02bc-439d-a64a-98bd1b32d79f&#xA;Pipeline run with id=3aa809dc-02bc-439d-a64a-98bd1b32d79f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3aa809dc-02bc-439d-a64a-98bd1b32d79f&#xA;Pipeline run with id=3aa809dc-02bc-439d-a64a-98bd1b32d79f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3aa809dc-02bc-439d-a64a-98bd1b32d79f&#xA;Pipeline run with id=3aa809dc-02bc-439d-a64a-98bd1b32d79f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3aa809dc-02bc-439d-a64a-98bd1b32d79f&#xA;Pipeline run with id=3aa809dc-02bc-439d-a64a-98bd1b32d79f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3aa809dc-02bc-439d-a64a-98bd1b32d79f&#xA;Pipeline run with id=3aa809dc-02bc-439d-a64a-98bd1b32d79f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3aa809dc-02bc-439d-a64a-98bd1b32d79f&#xA;Pipeline run with id=3aa809dc-02bc-439d-a64a-98bd1b32d79f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3aa809dc-02bc-439d-a64a-98bd1b32d79f&#xA;Pipeline run with id=3aa809dc-02bc-439d-a64a-98bd1b32d79f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3aa809dc-02bc-439d-a64a-98bd1b32d79f&#xA;Pipeline run with id=3aa809dc-02bc-439d-a64a-98bd1b32d79f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3aa809dc-02bc-439d-a64a-98bd1b32d79f&#xA;Pipeline run with id=3aa809dc-02bc-439d-a64a-98bd1b32d79f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3aa809dc-02bc-439d-a64a-98bd1b32d79f&#xA;Pipeline run with id=3aa809dc-02bc-439d-a64a-98bd1b32d79f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3aa809dc-02bc-439d-a64a-98bd1b32d79f&#xA;Pipeline run with id=3aa809dc-02bc-439d-a64a-98bd1b32d79f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3aa809dc-02bc-439d-a64a-98bd1b32d79f&#xA;Pipeline run with id=3aa809dc-02bc-439d-a64a-98bd1b32d79f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3aa809dc-02bc-439d-a64a-98bd1b32d79f&#xA;Pipeline run with id=3aa809dc-02bc-439d-a64a-98bd1b32d79f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3aa809dc-02bc-439d-a64a-98bd1b32d79f&#xA;Pipeline run with id=3aa809dc-02bc-439d-a64a-98bd1b32d79f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3aa809dc-02bc-439d-a64a-98bd1b32d79f&#xA;Pipeline run with id=3aa809dc-02bc-439d-a64a-98bd1b32d79f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3aa809dc-02bc-439d-a64a-98bd1b32d79f&#xA;Pipeline run with id=3aa809dc-02bc-439d-a64a-98bd1b32d79f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3aa809dc-02bc-439d-a64a-98bd1b32d79f&#xA;Pipeline run with id=3aa809dc-02bc-439d-a64a-98bd1b32d79f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3aa809dc-02bc-439d-a64a-98bd1b32d79f&#xA;Pipeline run with id=3aa809dc-02bc-439d-a64a-98bd1b32d79f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3aa809dc-02bc-439d-a64a-98bd1b32d79f&#xA;Pipeline run with id=3aa809dc-02bc-439d-a64a-98bd1b32d79f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3aa809dc-02bc-439d-a64a-98bd1b32d79f&#xA;Pipeline run with id=3aa809dc-02bc-439d-a64a-98bd1b32d79f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3aa809dc-02bc-439d-a64a-98bd1b32d79f&#xA;Pipeline run with id=3aa809dc-02bc-439d-a64a-98bd1b32d79f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3aa809dc-02bc-439d-a64a-98bd1b32d79f&#xA;Pipeline run with id=3aa809dc-02bc-439d-a64a-98bd1b32d79f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3aa809dc-02bc-439d-a64a-98bd1b32d79f&#xA;Pipeline run with id=3aa809dc-02bc-439d-a64a-98bd1b32d79f reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;essential/iris_pipeline_compiled.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=3aa809dc-02bc-439d-a64a-98bd1b32d79f&#xA;Get a pipeline run with id=3aa809dc-02bc-439d-a64a-98bd1b32d79f&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/05/26 13:56:34.591 (3m5.624s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/05/26 13:56:34.592&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 3aa809dc-02bc-439d-a64a-98bd1b32d79f&#xA;Failed to terminate run 3aa809dc-02bc-439d-a64a-98bd1b32d79f&#xA;Terminate run 3aa809dc-02bc-439d-a64a-98bd1b32d79f&#xA;Deleting run 3aa809dc-02bc-439d-a64a-98bd1b32d79f&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=ede422af-7dca-41a9-8143-9722d94afffb (cascade=true)&#xA;Pipeline with id=ede422af-7dca-41a9-8143-9722d94afffb, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/05/26 13:56:34.781 (189ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/05/26 13:56:34.781&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/05/26 13:56:34.781 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/05/26 13:56:34.781&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/05/26 13:56:34.782 (0s)&#xA;</system-err>
          </testcase>
      </testsuite>
  </testsuites>