<?xml version="1.0" encoding="UTF-8"?>
  <testsuites tests="5" disabled="0" errors="0" failures="0" time="184.719479786">
      <testsuite name="AIPipelinesE2ETests" package="/dspa/backend/test/end2end" tests="5" disabled="0" skipped="0" errors="0" failures="0" time="184.719479786" timestamp="2026-07-15T16:41:40">
          <properties>
              <property name="SuiteSucceeded" value="true"></property>
              <property name="SuiteHasProgrammaticFocus" value="false"></property>
              <property name="SpecialSuiteFailureReason" value=""></property>
              <property name="SuiteLabels" value="[]"></property>
              <property name="SuiteSemVerConstraints" value="[]"></property>
              <property name="RandomSeed" value="1784133522"></property>
              <property name="RandomizeAllSpecs" value="false"></property>
              <property name="LabelFilter" value="Smoke"></property>
              <property name="SemVerFilter" value=""></property>
              <property name="FocusStrings" value=""></property>
              <property name="SkipStrings" value=""></property>
              <property name="FocusFiles" value=""></property>
              <property name="SkipFiles" value=""></property>
              <property name="FailOnPending" value="false"></property>
              <property name="FailOnEmpty" value="false"></property>
              <property name="FailFast" value="false"></property>
              <property name="FlakeAttempts" value="0"></property>
              <property name="DryRun" value="false"></property>
              <property name="ParallelTotal" value="10"></property>
              <property name="OutputInterceptorMode" value=""></property>
          </properties>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload essential/component_with_pip_index_urls.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="74.487464702">
              <system-out>2026/07/15 16:42:55 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/15/26 16:41:40.712&#xA;Create an experiment with name E2EExperiment-1784133700712672930&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/15/26 16:41:41.007 (295ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/15/26 16:41:41.007&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x3c2277f9c880&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/15/26 16:41:44.744 (3.737s)&#xA;&gt; Enter [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/15/26 16:41:44.744&#xA;Uploading pipeline file essential/component_with_pip_index_urls.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1784133701007640686, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml&#xA;Upload of pipeline file &#39;essential/component_with_pip_index_urls.yaml&#39; successful&#xA;Listing pipeline versions for pipeline b1b00fc1-dde1-4714-a05d-e22b9c8020e0&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;b1b00fc1-dde1-4714-a05d-e22b9c8020e0&#39; and name: &#39;e2e-test-1784133701007640686&#39;&#xA;Create a pipeline run for pipeline with id=b1b00fc1-dde1-4714-a05d-e22b9c8020e0 and versionId=c6a2c765-a09b-4feb-9583-b2c007c7c344&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=4a77d2ab-0a53-4e1d-ad94-55a1469bf2d7&#xA;Created Pipeline Run with id: 4a77d2ab-0a53-4e1d-ad94-55a1469bf2d7 for pipeline with id: b1b00fc1-dde1-4714-a05d-e22b9c8020e0&#xA;Waiting for pipeline run with id=4a77d2ab-0a53-4e1d-ad94-55a1469bf2d7 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=4a77d2ab-0a53-4e1d-ad94-55a1469bf2d7&#xA;Pipeline run with id=4a77d2ab-0a53-4e1d-ad94-55a1469bf2d7 is in PENDING state, waiting...&#xA;Get a pipeline run with id=4a77d2ab-0a53-4e1d-ad94-55a1469bf2d7&#xA;Pipeline run with id=4a77d2ab-0a53-4e1d-ad94-55a1469bf2d7 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4a77d2ab-0a53-4e1d-ad94-55a1469bf2d7&#xA;Pipeline run with id=4a77d2ab-0a53-4e1d-ad94-55a1469bf2d7 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4a77d2ab-0a53-4e1d-ad94-55a1469bf2d7&#xA;Pipeline run with id=4a77d2ab-0a53-4e1d-ad94-55a1469bf2d7 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4a77d2ab-0a53-4e1d-ad94-55a1469bf2d7&#xA;Pipeline run with id=4a77d2ab-0a53-4e1d-ad94-55a1469bf2d7 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4a77d2ab-0a53-4e1d-ad94-55a1469bf2d7&#xA;Pipeline run with id=4a77d2ab-0a53-4e1d-ad94-55a1469bf2d7 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4a77d2ab-0a53-4e1d-ad94-55a1469bf2d7&#xA;Pipeline run with id=4a77d2ab-0a53-4e1d-ad94-55a1469bf2d7 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4a77d2ab-0a53-4e1d-ad94-55a1469bf2d7&#xA;Pipeline run with id=4a77d2ab-0a53-4e1d-ad94-55a1469bf2d7 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4a77d2ab-0a53-4e1d-ad94-55a1469bf2d7&#xA;Pipeline run with id=4a77d2ab-0a53-4e1d-ad94-55a1469bf2d7 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4a77d2ab-0a53-4e1d-ad94-55a1469bf2d7&#xA;Pipeline run with id=4a77d2ab-0a53-4e1d-ad94-55a1469bf2d7 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4a77d2ab-0a53-4e1d-ad94-55a1469bf2d7&#xA;Pipeline run with id=4a77d2ab-0a53-4e1d-ad94-55a1469bf2d7 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4a77d2ab-0a53-4e1d-ad94-55a1469bf2d7&#xA;Pipeline run with id=4a77d2ab-0a53-4e1d-ad94-55a1469bf2d7 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4a77d2ab-0a53-4e1d-ad94-55a1469bf2d7&#xA;Pipeline run with id=4a77d2ab-0a53-4e1d-ad94-55a1469bf2d7 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4a77d2ab-0a53-4e1d-ad94-55a1469bf2d7&#xA;Pipeline run with id=4a77d2ab-0a53-4e1d-ad94-55a1469bf2d7 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4a77d2ab-0a53-4e1d-ad94-55a1469bf2d7&#xA;Pipeline run with id=4a77d2ab-0a53-4e1d-ad94-55a1469bf2d7 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;essential/component_with_pip_index_urls.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=4a77d2ab-0a53-4e1d-ad94-55a1469bf2d7&#xA;Get a pipeline run with id=4a77d2ab-0a53-4e1d-ad94-55a1469bf2d7&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/15/26 16:42:55.004 (1m10.259s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/15/26 16:42:55.004&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 4a77d2ab-0a53-4e1d-ad94-55a1469bf2d7&#xA;Failed to terminate run 4a77d2ab-0a53-4e1d-ad94-55a1469bf2d7&#xA;Terminate run 4a77d2ab-0a53-4e1d-ad94-55a1469bf2d7&#xA;Deleting run 4a77d2ab-0a53-4e1d-ad94-55a1469bf2d7&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=b1b00fc1-dde1-4714-a05d-e22b9c8020e0 (cascade=true)&#xA;Pipeline with id=b1b00fc1-dde1-4714-a05d-e22b9c8020e0, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/15/26 16:42:55.199 (196ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/15/26 16:42:55.2&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/15/26 16:42:55.2 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/15/26 16:42:55.2&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/15/26 16:42:55.2 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/parallel_for_after_dependency.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="120.604042781">
              <system-out>2026/07/15 16:43:41 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/15/26 16:41:40.712&#xA;Create an experiment with name E2EExperiment-1784133700712389104&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/15/26 16:41:41.008 (296ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/15/26 16:41:41.008&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x184a5caf4580&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/15/26 16:41:44.801 (3.793s)&#xA;&gt; Enter [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/15/26 16:41:44.801&#xA;Uploading pipeline file critical/parallel_for_after_dependency.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1784133701008490676, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml&#xA;Upload of pipeline file &#39;critical/parallel_for_after_dependency.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 32105d55-c70b-441c-8c2b-a99ce361970e&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;32105d55-c70b-441c-8c2b-a99ce361970e&#39; and name: &#39;e2e-test-1784133701008490676&#39;&#xA;Create a pipeline run for pipeline with id=32105d55-c70b-441c-8c2b-a99ce361970e and versionId=ed7ea8ef-34ed-47f6-984d-3c18c59f4744&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=3579c5df-00af-4a27-ae75-5ebadedd69e9&#xA;Created Pipeline Run with id: 3579c5df-00af-4a27-ae75-5ebadedd69e9 for pipeline with id: 32105d55-c70b-441c-8c2b-a99ce361970e&#xA;Waiting for pipeline run with id=3579c5df-00af-4a27-ae75-5ebadedd69e9 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=3579c5df-00af-4a27-ae75-5ebadedd69e9&#xA;Pipeline run with id=3579c5df-00af-4a27-ae75-5ebadedd69e9 is in PENDING state, waiting...&#xA;Get a pipeline run with id=3579c5df-00af-4a27-ae75-5ebadedd69e9&#xA;Pipeline run with id=3579c5df-00af-4a27-ae75-5ebadedd69e9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3579c5df-00af-4a27-ae75-5ebadedd69e9&#xA;Pipeline run with id=3579c5df-00af-4a27-ae75-5ebadedd69e9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3579c5df-00af-4a27-ae75-5ebadedd69e9&#xA;Pipeline run with id=3579c5df-00af-4a27-ae75-5ebadedd69e9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3579c5df-00af-4a27-ae75-5ebadedd69e9&#xA;Pipeline run with id=3579c5df-00af-4a27-ae75-5ebadedd69e9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3579c5df-00af-4a27-ae75-5ebadedd69e9&#xA;Pipeline run with id=3579c5df-00af-4a27-ae75-5ebadedd69e9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3579c5df-00af-4a27-ae75-5ebadedd69e9&#xA;Pipeline run with id=3579c5df-00af-4a27-ae75-5ebadedd69e9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3579c5df-00af-4a27-ae75-5ebadedd69e9&#xA;Pipeline run with id=3579c5df-00af-4a27-ae75-5ebadedd69e9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3579c5df-00af-4a27-ae75-5ebadedd69e9&#xA;Pipeline run with id=3579c5df-00af-4a27-ae75-5ebadedd69e9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3579c5df-00af-4a27-ae75-5ebadedd69e9&#xA;Pipeline run with id=3579c5df-00af-4a27-ae75-5ebadedd69e9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3579c5df-00af-4a27-ae75-5ebadedd69e9&#xA;Pipeline run with id=3579c5df-00af-4a27-ae75-5ebadedd69e9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3579c5df-00af-4a27-ae75-5ebadedd69e9&#xA;Pipeline run with id=3579c5df-00af-4a27-ae75-5ebadedd69e9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3579c5df-00af-4a27-ae75-5ebadedd69e9&#xA;Pipeline run with id=3579c5df-00af-4a27-ae75-5ebadedd69e9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3579c5df-00af-4a27-ae75-5ebadedd69e9&#xA;Pipeline run with id=3579c5df-00af-4a27-ae75-5ebadedd69e9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3579c5df-00af-4a27-ae75-5ebadedd69e9&#xA;Pipeline run with id=3579c5df-00af-4a27-ae75-5ebadedd69e9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3579c5df-00af-4a27-ae75-5ebadedd69e9&#xA;Pipeline run with id=3579c5df-00af-4a27-ae75-5ebadedd69e9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3579c5df-00af-4a27-ae75-5ebadedd69e9&#xA;Pipeline run with id=3579c5df-00af-4a27-ae75-5ebadedd69e9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3579c5df-00af-4a27-ae75-5ebadedd69e9&#xA;Pipeline run with id=3579c5df-00af-4a27-ae75-5ebadedd69e9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3579c5df-00af-4a27-ae75-5ebadedd69e9&#xA;Pipeline run with id=3579c5df-00af-4a27-ae75-5ebadedd69e9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3579c5df-00af-4a27-ae75-5ebadedd69e9&#xA;Pipeline run with id=3579c5df-00af-4a27-ae75-5ebadedd69e9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3579c5df-00af-4a27-ae75-5ebadedd69e9&#xA;Pipeline run with id=3579c5df-00af-4a27-ae75-5ebadedd69e9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3579c5df-00af-4a27-ae75-5ebadedd69e9&#xA;Pipeline run with id=3579c5df-00af-4a27-ae75-5ebadedd69e9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3579c5df-00af-4a27-ae75-5ebadedd69e9&#xA;Pipeline run with id=3579c5df-00af-4a27-ae75-5ebadedd69e9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3579c5df-00af-4a27-ae75-5ebadedd69e9&#xA;Pipeline run with id=3579c5df-00af-4a27-ae75-5ebadedd69e9 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/parallel_for_after_dependency.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=3579c5df-00af-4a27-ae75-5ebadedd69e9&#xA;Get a pipeline run with id=3579c5df-00af-4a27-ae75-5ebadedd69e9&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/15/26 16:43:41.142 (1m56.341s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/15/26 16:43:41.142&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 3579c5df-00af-4a27-ae75-5ebadedd69e9&#xA;Failed to terminate run 3579c5df-00af-4a27-ae75-5ebadedd69e9&#xA;Terminate run 3579c5df-00af-4a27-ae75-5ebadedd69e9&#xA;Deleting run 3579c5df-00af-4a27-ae75-5ebadedd69e9&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=32105d55-c70b-441c-8c2b-a99ce361970e (cascade=true)&#xA;Pipeline with id=32105d55-c70b-441c-8c2b-a99ce361970e, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/15/26 16:43:41.316 (174ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/15/26 16:43:41.316&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/15/26 16:43:41.316 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/15/26 16:43:41.316&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/15/26 16:43:41.316 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/pipeline_with_artifact_upload_download.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="125.443885003">
              <system-out>2026/07/15 16:43:46 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/15/26 16:41:40.712&#xA;Create an experiment with name E2EExperiment-1784133700712506296&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/15/26 16:41:41.008 (296ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/15/26 16:41:41.008&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x3b45fc202b80&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/15/26 16:41:44.787 (3.779s)&#xA;&gt; Enter [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/15/26 16:41:44.787&#xA;Uploading pipeline file critical/pipeline_with_artifact_upload_download.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1784133701008508576, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml&#xA;Upload of pipeline file &#39;critical/pipeline_with_artifact_upload_download.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 4657d8c9-a721-4b26-b33e-e363e650c86a&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;4657d8c9-a721-4b26-b33e-e363e650c86a&#39; and name: &#39;e2e-test-1784133701008508576&#39;&#xA;Create a pipeline run for pipeline with id=4657d8c9-a721-4b26-b33e-e363e650c86a and versionId=19e891d9-6d3a-4a79-8de2-68573fa6f4cc&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=24b5792e-1d70-46dd-86ff-6881cd2d3153&#xA;Created Pipeline Run with id: 24b5792e-1d70-46dd-86ff-6881cd2d3153 for pipeline with id: 4657d8c9-a721-4b26-b33e-e363e650c86a&#xA;Waiting for pipeline run with id=24b5792e-1d70-46dd-86ff-6881cd2d3153 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=24b5792e-1d70-46dd-86ff-6881cd2d3153&#xA;Pipeline run with id=24b5792e-1d70-46dd-86ff-6881cd2d3153 is in PENDING state, waiting...&#xA;Get a pipeline run with id=24b5792e-1d70-46dd-86ff-6881cd2d3153&#xA;Pipeline run with id=24b5792e-1d70-46dd-86ff-6881cd2d3153 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=24b5792e-1d70-46dd-86ff-6881cd2d3153&#xA;Pipeline run with id=24b5792e-1d70-46dd-86ff-6881cd2d3153 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=24b5792e-1d70-46dd-86ff-6881cd2d3153&#xA;Pipeline run with id=24b5792e-1d70-46dd-86ff-6881cd2d3153 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=24b5792e-1d70-46dd-86ff-6881cd2d3153&#xA;Pipeline run with id=24b5792e-1d70-46dd-86ff-6881cd2d3153 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=24b5792e-1d70-46dd-86ff-6881cd2d3153&#xA;Pipeline run with id=24b5792e-1d70-46dd-86ff-6881cd2d3153 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=24b5792e-1d70-46dd-86ff-6881cd2d3153&#xA;Pipeline run with id=24b5792e-1d70-46dd-86ff-6881cd2d3153 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=24b5792e-1d70-46dd-86ff-6881cd2d3153&#xA;Pipeline run with id=24b5792e-1d70-46dd-86ff-6881cd2d3153 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=24b5792e-1d70-46dd-86ff-6881cd2d3153&#xA;Pipeline run with id=24b5792e-1d70-46dd-86ff-6881cd2d3153 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=24b5792e-1d70-46dd-86ff-6881cd2d3153&#xA;Pipeline run with id=24b5792e-1d70-46dd-86ff-6881cd2d3153 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=24b5792e-1d70-46dd-86ff-6881cd2d3153&#xA;Pipeline run with id=24b5792e-1d70-46dd-86ff-6881cd2d3153 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=24b5792e-1d70-46dd-86ff-6881cd2d3153&#xA;Pipeline run with id=24b5792e-1d70-46dd-86ff-6881cd2d3153 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=24b5792e-1d70-46dd-86ff-6881cd2d3153&#xA;Pipeline run with id=24b5792e-1d70-46dd-86ff-6881cd2d3153 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=24b5792e-1d70-46dd-86ff-6881cd2d3153&#xA;Pipeline run with id=24b5792e-1d70-46dd-86ff-6881cd2d3153 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=24b5792e-1d70-46dd-86ff-6881cd2d3153&#xA;Pipeline run with id=24b5792e-1d70-46dd-86ff-6881cd2d3153 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=24b5792e-1d70-46dd-86ff-6881cd2d3153&#xA;Pipeline run with id=24b5792e-1d70-46dd-86ff-6881cd2d3153 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=24b5792e-1d70-46dd-86ff-6881cd2d3153&#xA;Pipeline run with id=24b5792e-1d70-46dd-86ff-6881cd2d3153 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=24b5792e-1d70-46dd-86ff-6881cd2d3153&#xA;Pipeline run with id=24b5792e-1d70-46dd-86ff-6881cd2d3153 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=24b5792e-1d70-46dd-86ff-6881cd2d3153&#xA;Pipeline run with id=24b5792e-1d70-46dd-86ff-6881cd2d3153 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=24b5792e-1d70-46dd-86ff-6881cd2d3153&#xA;Pipeline run with id=24b5792e-1d70-46dd-86ff-6881cd2d3153 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=24b5792e-1d70-46dd-86ff-6881cd2d3153&#xA;Pipeline run with id=24b5792e-1d70-46dd-86ff-6881cd2d3153 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=24b5792e-1d70-46dd-86ff-6881cd2d3153&#xA;Pipeline run with id=24b5792e-1d70-46dd-86ff-6881cd2d3153 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=24b5792e-1d70-46dd-86ff-6881cd2d3153&#xA;Pipeline run with id=24b5792e-1d70-46dd-86ff-6881cd2d3153 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=24b5792e-1d70-46dd-86ff-6881cd2d3153&#xA;Pipeline run with id=24b5792e-1d70-46dd-86ff-6881cd2d3153 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=24b5792e-1d70-46dd-86ff-6881cd2d3153&#xA;Pipeline run with id=24b5792e-1d70-46dd-86ff-6881cd2d3153 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/pipeline_with_artifact_upload_download.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=24b5792e-1d70-46dd-86ff-6881cd2d3153&#xA;Get a pipeline run with id=24b5792e-1d70-46dd-86ff-6881cd2d3153&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/15/26 16:43:45.865 (2m1.078s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/15/26 16:43:45.865&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 24b5792e-1d70-46dd-86ff-6881cd2d3153&#xA;Failed to terminate run 24b5792e-1d70-46dd-86ff-6881cd2d3153&#xA;Terminate run 24b5792e-1d70-46dd-86ff-6881cd2d3153&#xA;Deleting run 24b5792e-1d70-46dd-86ff-6881cd2d3153&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=4657d8c9-a721-4b26-b33e-e363e650c86a (cascade=true)&#xA;Pipeline with id=4657d8c9-a721-4b26-b33e-e363e650c86a, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/15/26 16:43:46.156 (290ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/15/26 16:43:46.156&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/15/26 16:43:46.156 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/15/26 16:43:46.156&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/15/26 16:43:46.156 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/flip_coin.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="160.985673103">
              <system-out>2026/07/15 16:44:21 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/15/26 16:41:40.712&#xA;Create an experiment with name E2EExperiment-1784133700712434095&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/15/26 16:41:41.007 (295ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/15/26 16:41:41.007&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x3db960706480&#xA;test-secret-1 created&#xA;test-secret-2 created&#xA;test-secret-3 created&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/15/26 16:41:41.059 (52ms)&#xA;&gt; Enter [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/15/26 16:41:41.059&#xA;Uploading pipeline file critical/flip_coin.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1784133701007640736, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml&#xA;Upload of pipeline file &#39;critical/flip_coin.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 49c7b914-fca5-4a62-b523-e1e644b2d11f&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;49c7b914-fca5-4a62-b523-e1e644b2d11f&#39; and name: &#39;e2e-test-1784133701007640736&#39;&#xA;Create a pipeline run for pipeline with id=49c7b914-fca5-4a62-b523-e1e644b2d11f and versionId=9a4e3350-22f2-455f-9624-ee79d7506c5e&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=d0a10c46-73ca-4e48-bb59-a5408b4745fe&#xA;Created Pipeline Run with id: d0a10c46-73ca-4e48-bb59-a5408b4745fe for pipeline with id: 49c7b914-fca5-4a62-b523-e1e644b2d11f&#xA;Waiting for pipeline run with id=d0a10c46-73ca-4e48-bb59-a5408b4745fe to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=d0a10c46-73ca-4e48-bb59-a5408b4745fe&#xA;Pipeline run with id=d0a10c46-73ca-4e48-bb59-a5408b4745fe is in PENDING state, waiting...&#xA;Get a pipeline run with id=d0a10c46-73ca-4e48-bb59-a5408b4745fe&#xA;Pipeline run with id=d0a10c46-73ca-4e48-bb59-a5408b4745fe is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d0a10c46-73ca-4e48-bb59-a5408b4745fe&#xA;Pipeline run with id=d0a10c46-73ca-4e48-bb59-a5408b4745fe is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d0a10c46-73ca-4e48-bb59-a5408b4745fe&#xA;Pipeline run with id=d0a10c46-73ca-4e48-bb59-a5408b4745fe is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d0a10c46-73ca-4e48-bb59-a5408b4745fe&#xA;Pipeline run with id=d0a10c46-73ca-4e48-bb59-a5408b4745fe is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d0a10c46-73ca-4e48-bb59-a5408b4745fe&#xA;Pipeline run with id=d0a10c46-73ca-4e48-bb59-a5408b4745fe is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d0a10c46-73ca-4e48-bb59-a5408b4745fe&#xA;Pipeline run with id=d0a10c46-73ca-4e48-bb59-a5408b4745fe is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d0a10c46-73ca-4e48-bb59-a5408b4745fe&#xA;Pipeline run with id=d0a10c46-73ca-4e48-bb59-a5408b4745fe is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d0a10c46-73ca-4e48-bb59-a5408b4745fe&#xA;Pipeline run with id=d0a10c46-73ca-4e48-bb59-a5408b4745fe is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d0a10c46-73ca-4e48-bb59-a5408b4745fe&#xA;Pipeline run with id=d0a10c46-73ca-4e48-bb59-a5408b4745fe is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d0a10c46-73ca-4e48-bb59-a5408b4745fe&#xA;Pipeline run with id=d0a10c46-73ca-4e48-bb59-a5408b4745fe is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d0a10c46-73ca-4e48-bb59-a5408b4745fe&#xA;Pipeline run with id=d0a10c46-73ca-4e48-bb59-a5408b4745fe is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d0a10c46-73ca-4e48-bb59-a5408b4745fe&#xA;Pipeline run with id=d0a10c46-73ca-4e48-bb59-a5408b4745fe is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d0a10c46-73ca-4e48-bb59-a5408b4745fe&#xA;Pipeline run with id=d0a10c46-73ca-4e48-bb59-a5408b4745fe is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d0a10c46-73ca-4e48-bb59-a5408b4745fe&#xA;Pipeline run with id=d0a10c46-73ca-4e48-bb59-a5408b4745fe is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d0a10c46-73ca-4e48-bb59-a5408b4745fe&#xA;Pipeline run with id=d0a10c46-73ca-4e48-bb59-a5408b4745fe is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d0a10c46-73ca-4e48-bb59-a5408b4745fe&#xA;Pipeline run with id=d0a10c46-73ca-4e48-bb59-a5408b4745fe is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d0a10c46-73ca-4e48-bb59-a5408b4745fe&#xA;Pipeline run with id=d0a10c46-73ca-4e48-bb59-a5408b4745fe is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d0a10c46-73ca-4e48-bb59-a5408b4745fe&#xA;Pipeline run with id=d0a10c46-73ca-4e48-bb59-a5408b4745fe is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d0a10c46-73ca-4e48-bb59-a5408b4745fe&#xA;Pipeline run with id=d0a10c46-73ca-4e48-bb59-a5408b4745fe is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d0a10c46-73ca-4e48-bb59-a5408b4745fe&#xA;Pipeline run with id=d0a10c46-73ca-4e48-bb59-a5408b4745fe is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d0a10c46-73ca-4e48-bb59-a5408b4745fe&#xA;Pipeline run with id=d0a10c46-73ca-4e48-bb59-a5408b4745fe is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d0a10c46-73ca-4e48-bb59-a5408b4745fe&#xA;Pipeline run with id=d0a10c46-73ca-4e48-bb59-a5408b4745fe is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d0a10c46-73ca-4e48-bb59-a5408b4745fe&#xA;Pipeline run with id=d0a10c46-73ca-4e48-bb59-a5408b4745fe is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d0a10c46-73ca-4e48-bb59-a5408b4745fe&#xA;Pipeline run with id=d0a10c46-73ca-4e48-bb59-a5408b4745fe is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d0a10c46-73ca-4e48-bb59-a5408b4745fe&#xA;Pipeline run with id=d0a10c46-73ca-4e48-bb59-a5408b4745fe is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d0a10c46-73ca-4e48-bb59-a5408b4745fe&#xA;Pipeline run with id=d0a10c46-73ca-4e48-bb59-a5408b4745fe is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d0a10c46-73ca-4e48-bb59-a5408b4745fe&#xA;Pipeline run with id=d0a10c46-73ca-4e48-bb59-a5408b4745fe is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d0a10c46-73ca-4e48-bb59-a5408b4745fe&#xA;Pipeline run with id=d0a10c46-73ca-4e48-bb59-a5408b4745fe is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d0a10c46-73ca-4e48-bb59-a5408b4745fe&#xA;Pipeline run with id=d0a10c46-73ca-4e48-bb59-a5408b4745fe is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d0a10c46-73ca-4e48-bb59-a5408b4745fe&#xA;Pipeline run with id=d0a10c46-73ca-4e48-bb59-a5408b4745fe is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d0a10c46-73ca-4e48-bb59-a5408b4745fe&#xA;Pipeline run with id=d0a10c46-73ca-4e48-bb59-a5408b4745fe is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d0a10c46-73ca-4e48-bb59-a5408b4745fe&#xA;Pipeline run with id=d0a10c46-73ca-4e48-bb59-a5408b4745fe reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/flip_coin.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=d0a10c46-73ca-4e48-bb59-a5408b4745fe&#xA;Get a pipeline run with id=d0a10c46-73ca-4e48-bb59-a5408b4745fe&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/15/26 16:44:21.487 (2m40.427s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/15/26 16:44:21.487&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run d0a10c46-73ca-4e48-bb59-a5408b4745fe&#xA;Failed to terminate run d0a10c46-73ca-4e48-bb59-a5408b4745fe&#xA;Terminate run d0a10c46-73ca-4e48-bb59-a5408b4745fe&#xA;Deleting run d0a10c46-73ca-4e48-bb59-a5408b4745fe&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=49c7b914-fca5-4a62-b523-e1e644b2d11f (cascade=true)&#xA;Pipeline with id=49c7b914-fca5-4a62-b523-e1e644b2d11f, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/15/26 16:44:21.697 (210ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/15/26 16:44:21.698&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/15/26 16:44:21.698 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/15/26 16:44:21.698&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/15/26 16:44:21.698 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload essential/iris_pipeline_compiled.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="184.561422732">
              <system-out>2026/07/15 16:44:45 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/15/26 16:41:40.712&#xA;Create an experiment with name E2EExperiment-1784133700712957377&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/15/26 16:41:41.012 (300ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/15/26 16:41:41.013&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x65c43760b80&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/15/26 16:41:44.812 (3.799s)&#xA;&gt; Enter [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/15/26 16:41:44.812&#xA;Uploading pipeline file essential/iris_pipeline_compiled.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1784133701013047272, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml&#xA;Upload of pipeline file &#39;essential/iris_pipeline_compiled.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 2fae19f3-2f55-4a6f-b3a7-e207c9af281b&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;2fae19f3-2f55-4a6f-b3a7-e207c9af281b&#39; and name: &#39;e2e-test-1784133701013047272&#39;&#xA;Create a pipeline run for pipeline with id=2fae19f3-2f55-4a6f-b3a7-e207c9af281b and versionId=f3c555bd-d910-46d4-90c0-44552274eced&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=ce861712-2abe-47a0-9e4f-4312e54de00e&#xA;Created Pipeline Run with id: ce861712-2abe-47a0-9e4f-4312e54de00e for pipeline with id: 2fae19f3-2f55-4a6f-b3a7-e207c9af281b&#xA;Waiting for pipeline run with id=ce861712-2abe-47a0-9e4f-4312e54de00e to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=ce861712-2abe-47a0-9e4f-4312e54de00e&#xA;Pipeline run with id=ce861712-2abe-47a0-9e4f-4312e54de00e is in PENDING state, waiting...&#xA;Get a pipeline run with id=ce861712-2abe-47a0-9e4f-4312e54de00e&#xA;Pipeline run with id=ce861712-2abe-47a0-9e4f-4312e54de00e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ce861712-2abe-47a0-9e4f-4312e54de00e&#xA;Pipeline run with id=ce861712-2abe-47a0-9e4f-4312e54de00e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ce861712-2abe-47a0-9e4f-4312e54de00e&#xA;Pipeline run with id=ce861712-2abe-47a0-9e4f-4312e54de00e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ce861712-2abe-47a0-9e4f-4312e54de00e&#xA;Pipeline run with id=ce861712-2abe-47a0-9e4f-4312e54de00e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ce861712-2abe-47a0-9e4f-4312e54de00e&#xA;Pipeline run with id=ce861712-2abe-47a0-9e4f-4312e54de00e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ce861712-2abe-47a0-9e4f-4312e54de00e&#xA;Pipeline run with id=ce861712-2abe-47a0-9e4f-4312e54de00e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ce861712-2abe-47a0-9e4f-4312e54de00e&#xA;Pipeline run with id=ce861712-2abe-47a0-9e4f-4312e54de00e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ce861712-2abe-47a0-9e4f-4312e54de00e&#xA;Pipeline run with id=ce861712-2abe-47a0-9e4f-4312e54de00e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ce861712-2abe-47a0-9e4f-4312e54de00e&#xA;Pipeline run with id=ce861712-2abe-47a0-9e4f-4312e54de00e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ce861712-2abe-47a0-9e4f-4312e54de00e&#xA;Pipeline run with id=ce861712-2abe-47a0-9e4f-4312e54de00e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ce861712-2abe-47a0-9e4f-4312e54de00e&#xA;Pipeline run with id=ce861712-2abe-47a0-9e4f-4312e54de00e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ce861712-2abe-47a0-9e4f-4312e54de00e&#xA;Pipeline run with id=ce861712-2abe-47a0-9e4f-4312e54de00e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ce861712-2abe-47a0-9e4f-4312e54de00e&#xA;Pipeline run with id=ce861712-2abe-47a0-9e4f-4312e54de00e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ce861712-2abe-47a0-9e4f-4312e54de00e&#xA;Pipeline run with id=ce861712-2abe-47a0-9e4f-4312e54de00e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ce861712-2abe-47a0-9e4f-4312e54de00e&#xA;Pipeline run with id=ce861712-2abe-47a0-9e4f-4312e54de00e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ce861712-2abe-47a0-9e4f-4312e54de00e&#xA;Pipeline run with id=ce861712-2abe-47a0-9e4f-4312e54de00e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ce861712-2abe-47a0-9e4f-4312e54de00e&#xA;Pipeline run with id=ce861712-2abe-47a0-9e4f-4312e54de00e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ce861712-2abe-47a0-9e4f-4312e54de00e&#xA;Pipeline run with id=ce861712-2abe-47a0-9e4f-4312e54de00e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ce861712-2abe-47a0-9e4f-4312e54de00e&#xA;Pipeline run with id=ce861712-2abe-47a0-9e4f-4312e54de00e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ce861712-2abe-47a0-9e4f-4312e54de00e&#xA;Pipeline run with id=ce861712-2abe-47a0-9e4f-4312e54de00e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ce861712-2abe-47a0-9e4f-4312e54de00e&#xA;Pipeline run with id=ce861712-2abe-47a0-9e4f-4312e54de00e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ce861712-2abe-47a0-9e4f-4312e54de00e&#xA;Pipeline run with id=ce861712-2abe-47a0-9e4f-4312e54de00e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ce861712-2abe-47a0-9e4f-4312e54de00e&#xA;Pipeline run with id=ce861712-2abe-47a0-9e4f-4312e54de00e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ce861712-2abe-47a0-9e4f-4312e54de00e&#xA;Pipeline run with id=ce861712-2abe-47a0-9e4f-4312e54de00e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ce861712-2abe-47a0-9e4f-4312e54de00e&#xA;Pipeline run with id=ce861712-2abe-47a0-9e4f-4312e54de00e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ce861712-2abe-47a0-9e4f-4312e54de00e&#xA;Pipeline run with id=ce861712-2abe-47a0-9e4f-4312e54de00e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ce861712-2abe-47a0-9e4f-4312e54de00e&#xA;Pipeline run with id=ce861712-2abe-47a0-9e4f-4312e54de00e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ce861712-2abe-47a0-9e4f-4312e54de00e&#xA;Pipeline run with id=ce861712-2abe-47a0-9e4f-4312e54de00e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ce861712-2abe-47a0-9e4f-4312e54de00e&#xA;Pipeline run with id=ce861712-2abe-47a0-9e4f-4312e54de00e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ce861712-2abe-47a0-9e4f-4312e54de00e&#xA;Pipeline run with id=ce861712-2abe-47a0-9e4f-4312e54de00e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ce861712-2abe-47a0-9e4f-4312e54de00e&#xA;Pipeline run with id=ce861712-2abe-47a0-9e4f-4312e54de00e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ce861712-2abe-47a0-9e4f-4312e54de00e&#xA;Pipeline run with id=ce861712-2abe-47a0-9e4f-4312e54de00e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ce861712-2abe-47a0-9e4f-4312e54de00e&#xA;Pipeline run with id=ce861712-2abe-47a0-9e4f-4312e54de00e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ce861712-2abe-47a0-9e4f-4312e54de00e&#xA;Pipeline run with id=ce861712-2abe-47a0-9e4f-4312e54de00e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ce861712-2abe-47a0-9e4f-4312e54de00e&#xA;Pipeline run with id=ce861712-2abe-47a0-9e4f-4312e54de00e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ce861712-2abe-47a0-9e4f-4312e54de00e&#xA;Pipeline run with id=ce861712-2abe-47a0-9e4f-4312e54de00e reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;essential/iris_pipeline_compiled.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=ce861712-2abe-47a0-9e4f-4312e54de00e&#xA;Get a pipeline run with id=ce861712-2abe-47a0-9e4f-4312e54de00e&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/15/26 16:44:45.129 (3m0.318s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/15/26 16:44:45.13&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run ce861712-2abe-47a0-9e4f-4312e54de00e&#xA;Failed to terminate run ce861712-2abe-47a0-9e4f-4312e54de00e&#xA;Terminate run ce861712-2abe-47a0-9e4f-4312e54de00e&#xA;Deleting run ce861712-2abe-47a0-9e4f-4312e54de00e&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=2fae19f3-2f55-4a6f-b3a7-e207c9af281b (cascade=true)&#xA;Pipeline with id=2fae19f3-2f55-4a6f-b3a7-e207c9af281b, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/15/26 16:44:45.274 (144ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/15/26 16:44:45.274&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/15/26 16:44:45.274 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/15/26 16:44:45.274&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/15/26 16:44:45.274 (0s)&#xA;</system-err>
          </testcase>
      </testsuite>
  </testsuites>