<?xml version="1.0" encoding="UTF-8"?>
  <testsuites tests="5" disabled="0" errors="0" failures="0" time="180.821949069">
      <testsuite name="AIPipelinesE2ETests" package="/dspa/backend/test/end2end" tests="5" disabled="0" skipped="0" errors="0" failures="0" time="180.821949069" timestamp="2026-07-16T05:51:00">
          <properties>
              <property name="SuiteSucceeded" value="true"></property>
              <property name="SuiteHasProgrammaticFocus" value="false"></property>
              <property name="SpecialSuiteFailureReason" value=""></property>
              <property name="SuiteLabels" value="[]"></property>
              <property name="SuiteSemVerConstraints" value="[]"></property>
              <property name="RandomSeed" value="1784180899"></property>
              <property name="RandomizeAllSpecs" value="false"></property>
              <property name="LabelFilter" value="Smoke"></property>
              <property name="SemVerFilter" value=""></property>
              <property name="FocusStrings" value=""></property>
              <property name="SkipStrings" value=""></property>
              <property name="FocusFiles" value=""></property>
              <property name="SkipFiles" value=""></property>
              <property name="FailOnPending" value="false"></property>
              <property name="FailOnEmpty" value="false"></property>
              <property name="FailFast" value="false"></property>
              <property name="FlakeAttempts" value="0"></property>
              <property name="DryRun" value="false"></property>
              <property name="ParallelTotal" value="10"></property>
              <property name="OutputInterceptorMode" value=""></property>
          </properties>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload essential/component_with_pip_index_urls.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="70.681030311">
              <system-out>2026/07/16 05:52:11 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/16/26 05:51:00.752&#xA;Create an experiment with name E2EExperiment-1784181060752194476&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/16/26 05:51:00.887 (135ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/16/26 05:51:00.887&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x21a533236880&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/16/26 05:51:00.945 (58ms)&#xA;&gt; Enter [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/16/26 05:51:00.946&#xA;Uploading pipeline file essential/component_with_pip_index_urls.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1784181060887476594, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml&#xA;Upload of pipeline file &#39;essential/component_with_pip_index_urls.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 98f6582d-9464-4d03-971a-ba021b46682c&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;98f6582d-9464-4d03-971a-ba021b46682c&#39; and name: &#39;e2e-test-1784181060887476594&#39;&#xA;Create a pipeline run for pipeline with id=98f6582d-9464-4d03-971a-ba021b46682c and versionId=65321b98-b999-4098-aa78-135c635d4c9f&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=edb98749-6383-4546-8f73-4df35776a99f&#xA;Created Pipeline Run with id: edb98749-6383-4546-8f73-4df35776a99f for pipeline with id: 98f6582d-9464-4d03-971a-ba021b46682c&#xA;Waiting for pipeline run with id=edb98749-6383-4546-8f73-4df35776a99f to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=edb98749-6383-4546-8f73-4df35776a99f&#xA;Pipeline run with id=edb98749-6383-4546-8f73-4df35776a99f is in PENDING state, waiting...&#xA;Get a pipeline run with id=edb98749-6383-4546-8f73-4df35776a99f&#xA;Pipeline run with id=edb98749-6383-4546-8f73-4df35776a99f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=edb98749-6383-4546-8f73-4df35776a99f&#xA;Pipeline run with id=edb98749-6383-4546-8f73-4df35776a99f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=edb98749-6383-4546-8f73-4df35776a99f&#xA;Pipeline run with id=edb98749-6383-4546-8f73-4df35776a99f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=edb98749-6383-4546-8f73-4df35776a99f&#xA;Pipeline run with id=edb98749-6383-4546-8f73-4df35776a99f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=edb98749-6383-4546-8f73-4df35776a99f&#xA;Pipeline run with id=edb98749-6383-4546-8f73-4df35776a99f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=edb98749-6383-4546-8f73-4df35776a99f&#xA;Pipeline run with id=edb98749-6383-4546-8f73-4df35776a99f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=edb98749-6383-4546-8f73-4df35776a99f&#xA;Pipeline run with id=edb98749-6383-4546-8f73-4df35776a99f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=edb98749-6383-4546-8f73-4df35776a99f&#xA;Pipeline run with id=edb98749-6383-4546-8f73-4df35776a99f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=edb98749-6383-4546-8f73-4df35776a99f&#xA;Pipeline run with id=edb98749-6383-4546-8f73-4df35776a99f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=edb98749-6383-4546-8f73-4df35776a99f&#xA;Pipeline run with id=edb98749-6383-4546-8f73-4df35776a99f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=edb98749-6383-4546-8f73-4df35776a99f&#xA;Pipeline run with id=edb98749-6383-4546-8f73-4df35776a99f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=edb98749-6383-4546-8f73-4df35776a99f&#xA;Pipeline run with id=edb98749-6383-4546-8f73-4df35776a99f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=edb98749-6383-4546-8f73-4df35776a99f&#xA;Pipeline run with id=edb98749-6383-4546-8f73-4df35776a99f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=edb98749-6383-4546-8f73-4df35776a99f&#xA;Pipeline run with id=edb98749-6383-4546-8f73-4df35776a99f reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;essential/component_with_pip_index_urls.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=edb98749-6383-4546-8f73-4df35776a99f&#xA;Get a pipeline run with id=edb98749-6383-4546-8f73-4df35776a99f&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/16/26 05:52:11.325 (1m10.38s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/16/26 05:52:11.325&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run edb98749-6383-4546-8f73-4df35776a99f&#xA;Failed to terminate run edb98749-6383-4546-8f73-4df35776a99f&#xA;Terminate run edb98749-6383-4546-8f73-4df35776a99f&#xA;Deleting run edb98749-6383-4546-8f73-4df35776a99f&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=98f6582d-9464-4d03-971a-ba021b46682c (cascade=true)&#xA;Pipeline with id=98f6582d-9464-4d03-971a-ba021b46682c, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/16/26 05:52:11.432 (107ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/16/26 05:52:11.433&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/16/26 05:52:11.433 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/16/26 05:52:11.433&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/16/26 05:52:11.433 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/parallel_for_after_dependency.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="115.767504175">
              <system-out>2026/07/16 05:52:56 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/16/26 05:51:00.752&#xA;Create an experiment with name E2EExperiment-1784181060752136485&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/16/26 05:51:00.893 (141ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/16/26 05:51:00.893&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x11deac9cec00&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/16/26 05:51:00.938 (46ms)&#xA;&gt; Enter [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/16/26 05:51:00.939&#xA;Uploading pipeline file critical/parallel_for_after_dependency.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1784181060893329642, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml&#xA;Upload of pipeline file &#39;critical/parallel_for_after_dependency.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 3b2b4f4b-c100-4895-8a33-0a2aacac6610&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;3b2b4f4b-c100-4895-8a33-0a2aacac6610&#39; and name: &#39;e2e-test-1784181060893329642&#39;&#xA;Create a pipeline run for pipeline with id=3b2b4f4b-c100-4895-8a33-0a2aacac6610 and versionId=e24590c3-f3cc-4adf-a33c-10c25515a32c&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=fffacb9c-ac4b-426c-b27f-c8510c23dde1&#xA;Created Pipeline Run with id: fffacb9c-ac4b-426c-b27f-c8510c23dde1 for pipeline with id: 3b2b4f4b-c100-4895-8a33-0a2aacac6610&#xA;Waiting for pipeline run with id=fffacb9c-ac4b-426c-b27f-c8510c23dde1 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=fffacb9c-ac4b-426c-b27f-c8510c23dde1&#xA;Pipeline run with id=fffacb9c-ac4b-426c-b27f-c8510c23dde1 is in PENDING state, waiting...&#xA;Get a pipeline run with id=fffacb9c-ac4b-426c-b27f-c8510c23dde1&#xA;Pipeline run with id=fffacb9c-ac4b-426c-b27f-c8510c23dde1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fffacb9c-ac4b-426c-b27f-c8510c23dde1&#xA;Pipeline run with id=fffacb9c-ac4b-426c-b27f-c8510c23dde1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fffacb9c-ac4b-426c-b27f-c8510c23dde1&#xA;Pipeline run with id=fffacb9c-ac4b-426c-b27f-c8510c23dde1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fffacb9c-ac4b-426c-b27f-c8510c23dde1&#xA;Pipeline run with id=fffacb9c-ac4b-426c-b27f-c8510c23dde1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fffacb9c-ac4b-426c-b27f-c8510c23dde1&#xA;Pipeline run with id=fffacb9c-ac4b-426c-b27f-c8510c23dde1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fffacb9c-ac4b-426c-b27f-c8510c23dde1&#xA;Pipeline run with id=fffacb9c-ac4b-426c-b27f-c8510c23dde1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fffacb9c-ac4b-426c-b27f-c8510c23dde1&#xA;Pipeline run with id=fffacb9c-ac4b-426c-b27f-c8510c23dde1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fffacb9c-ac4b-426c-b27f-c8510c23dde1&#xA;Pipeline run with id=fffacb9c-ac4b-426c-b27f-c8510c23dde1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fffacb9c-ac4b-426c-b27f-c8510c23dde1&#xA;Pipeline run with id=fffacb9c-ac4b-426c-b27f-c8510c23dde1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fffacb9c-ac4b-426c-b27f-c8510c23dde1&#xA;Pipeline run with id=fffacb9c-ac4b-426c-b27f-c8510c23dde1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fffacb9c-ac4b-426c-b27f-c8510c23dde1&#xA;Pipeline run with id=fffacb9c-ac4b-426c-b27f-c8510c23dde1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fffacb9c-ac4b-426c-b27f-c8510c23dde1&#xA;Pipeline run with id=fffacb9c-ac4b-426c-b27f-c8510c23dde1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fffacb9c-ac4b-426c-b27f-c8510c23dde1&#xA;Pipeline run with id=fffacb9c-ac4b-426c-b27f-c8510c23dde1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fffacb9c-ac4b-426c-b27f-c8510c23dde1&#xA;Pipeline run with id=fffacb9c-ac4b-426c-b27f-c8510c23dde1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fffacb9c-ac4b-426c-b27f-c8510c23dde1&#xA;Pipeline run with id=fffacb9c-ac4b-426c-b27f-c8510c23dde1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fffacb9c-ac4b-426c-b27f-c8510c23dde1&#xA;Pipeline run with id=fffacb9c-ac4b-426c-b27f-c8510c23dde1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fffacb9c-ac4b-426c-b27f-c8510c23dde1&#xA;Pipeline run with id=fffacb9c-ac4b-426c-b27f-c8510c23dde1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fffacb9c-ac4b-426c-b27f-c8510c23dde1&#xA;Pipeline run with id=fffacb9c-ac4b-426c-b27f-c8510c23dde1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fffacb9c-ac4b-426c-b27f-c8510c23dde1&#xA;Pipeline run with id=fffacb9c-ac4b-426c-b27f-c8510c23dde1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fffacb9c-ac4b-426c-b27f-c8510c23dde1&#xA;Pipeline run with id=fffacb9c-ac4b-426c-b27f-c8510c23dde1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fffacb9c-ac4b-426c-b27f-c8510c23dde1&#xA;Pipeline run with id=fffacb9c-ac4b-426c-b27f-c8510c23dde1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fffacb9c-ac4b-426c-b27f-c8510c23dde1&#xA;Pipeline run with id=fffacb9c-ac4b-426c-b27f-c8510c23dde1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fffacb9c-ac4b-426c-b27f-c8510c23dde1&#xA;Pipeline run with id=fffacb9c-ac4b-426c-b27f-c8510c23dde1 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/parallel_for_after_dependency.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=fffacb9c-ac4b-426c-b27f-c8510c23dde1&#xA;Get a pipeline run with id=fffacb9c-ac4b-426c-b27f-c8510c23dde1&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/16/26 05:52:56.408 (1m55.469s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/16/26 05:52:56.408&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run fffacb9c-ac4b-426c-b27f-c8510c23dde1&#xA;Failed to terminate run fffacb9c-ac4b-426c-b27f-c8510c23dde1&#xA;Terminate run fffacb9c-ac4b-426c-b27f-c8510c23dde1&#xA;Deleting run fffacb9c-ac4b-426c-b27f-c8510c23dde1&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=3b2b4f4b-c100-4895-8a33-0a2aacac6610 (cascade=true)&#xA;Pipeline with id=3b2b4f4b-c100-4895-8a33-0a2aacac6610, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/16/26 05:52:56.519 (111ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/16/26 05:52:56.519&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/16/26 05:52:56.519 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/16/26 05:52:56.519&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/16/26 05:52:56.519 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/pipeline_with_artifact_upload_download.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="120.759402923">
              <system-out>2026/07/16 05:53:01 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/16/26 05:51:00.752&#xA;Create an experiment with name E2EExperiment-1784181060752170355&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/16/26 05:51:00.894 (142ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/16/26 05:51:00.894&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x1fd6c1efae00&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/16/26 05:51:00.944 (50ms)&#xA;&gt; Enter [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/16/26 05:51:00.944&#xA;Uploading pipeline file critical/pipeline_with_artifact_upload_download.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1784181060894322112, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml&#xA;Upload of pipeline file &#39;critical/pipeline_with_artifact_upload_download.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 16884012-a953-4a2c-87a2-613d8f8dac8b&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;16884012-a953-4a2c-87a2-613d8f8dac8b&#39; and name: &#39;e2e-test-1784181060894322112&#39;&#xA;Create a pipeline run for pipeline with id=16884012-a953-4a2c-87a2-613d8f8dac8b and versionId=3ce0f821-860b-4441-8e45-6f447104d5df&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=9f82761f-5587-4f75-98dd-bc30534f02c7&#xA;Created Pipeline Run with id: 9f82761f-5587-4f75-98dd-bc30534f02c7 for pipeline with id: 16884012-a953-4a2c-87a2-613d8f8dac8b&#xA;Waiting for pipeline run with id=9f82761f-5587-4f75-98dd-bc30534f02c7 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=9f82761f-5587-4f75-98dd-bc30534f02c7&#xA;Pipeline run with id=9f82761f-5587-4f75-98dd-bc30534f02c7 is in PENDING state, waiting...&#xA;Get a pipeline run with id=9f82761f-5587-4f75-98dd-bc30534f02c7&#xA;Pipeline run with id=9f82761f-5587-4f75-98dd-bc30534f02c7 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9f82761f-5587-4f75-98dd-bc30534f02c7&#xA;Pipeline run with id=9f82761f-5587-4f75-98dd-bc30534f02c7 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9f82761f-5587-4f75-98dd-bc30534f02c7&#xA;Pipeline run with id=9f82761f-5587-4f75-98dd-bc30534f02c7 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9f82761f-5587-4f75-98dd-bc30534f02c7&#xA;Pipeline run with id=9f82761f-5587-4f75-98dd-bc30534f02c7 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9f82761f-5587-4f75-98dd-bc30534f02c7&#xA;Pipeline run with id=9f82761f-5587-4f75-98dd-bc30534f02c7 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9f82761f-5587-4f75-98dd-bc30534f02c7&#xA;Pipeline run with id=9f82761f-5587-4f75-98dd-bc30534f02c7 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9f82761f-5587-4f75-98dd-bc30534f02c7&#xA;Pipeline run with id=9f82761f-5587-4f75-98dd-bc30534f02c7 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9f82761f-5587-4f75-98dd-bc30534f02c7&#xA;Pipeline run with id=9f82761f-5587-4f75-98dd-bc30534f02c7 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9f82761f-5587-4f75-98dd-bc30534f02c7&#xA;Pipeline run with id=9f82761f-5587-4f75-98dd-bc30534f02c7 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9f82761f-5587-4f75-98dd-bc30534f02c7&#xA;Pipeline run with id=9f82761f-5587-4f75-98dd-bc30534f02c7 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9f82761f-5587-4f75-98dd-bc30534f02c7&#xA;Pipeline run with id=9f82761f-5587-4f75-98dd-bc30534f02c7 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9f82761f-5587-4f75-98dd-bc30534f02c7&#xA;Pipeline run with id=9f82761f-5587-4f75-98dd-bc30534f02c7 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9f82761f-5587-4f75-98dd-bc30534f02c7&#xA;Pipeline run with id=9f82761f-5587-4f75-98dd-bc30534f02c7 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9f82761f-5587-4f75-98dd-bc30534f02c7&#xA;Pipeline run with id=9f82761f-5587-4f75-98dd-bc30534f02c7 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9f82761f-5587-4f75-98dd-bc30534f02c7&#xA;Pipeline run with id=9f82761f-5587-4f75-98dd-bc30534f02c7 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9f82761f-5587-4f75-98dd-bc30534f02c7&#xA;Pipeline run with id=9f82761f-5587-4f75-98dd-bc30534f02c7 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9f82761f-5587-4f75-98dd-bc30534f02c7&#xA;Pipeline run with id=9f82761f-5587-4f75-98dd-bc30534f02c7 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9f82761f-5587-4f75-98dd-bc30534f02c7&#xA;Pipeline run with id=9f82761f-5587-4f75-98dd-bc30534f02c7 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9f82761f-5587-4f75-98dd-bc30534f02c7&#xA;Pipeline run with id=9f82761f-5587-4f75-98dd-bc30534f02c7 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9f82761f-5587-4f75-98dd-bc30534f02c7&#xA;Pipeline run with id=9f82761f-5587-4f75-98dd-bc30534f02c7 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9f82761f-5587-4f75-98dd-bc30534f02c7&#xA;Pipeline run with id=9f82761f-5587-4f75-98dd-bc30534f02c7 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9f82761f-5587-4f75-98dd-bc30534f02c7&#xA;Pipeline run with id=9f82761f-5587-4f75-98dd-bc30534f02c7 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9f82761f-5587-4f75-98dd-bc30534f02c7&#xA;Pipeline run with id=9f82761f-5587-4f75-98dd-bc30534f02c7 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9f82761f-5587-4f75-98dd-bc30534f02c7&#xA;Pipeline run with id=9f82761f-5587-4f75-98dd-bc30534f02c7 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/pipeline_with_artifact_upload_download.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=9f82761f-5587-4f75-98dd-bc30534f02c7&#xA;Get a pipeline run with id=9f82761f-5587-4f75-98dd-bc30534f02c7&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/16/26 05:53:01.41 (2m0.466s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/16/26 05:53:01.411&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 9f82761f-5587-4f75-98dd-bc30534f02c7&#xA;Failed to terminate run 9f82761f-5587-4f75-98dd-bc30534f02c7&#xA;Terminate run 9f82761f-5587-4f75-98dd-bc30534f02c7&#xA;Deleting run 9f82761f-5587-4f75-98dd-bc30534f02c7&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=16884012-a953-4a2c-87a2-613d8f8dac8b (cascade=true)&#xA;Pipeline with id=16884012-a953-4a2c-87a2-613d8f8dac8b, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/16/26 05:53:01.511 (100ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/16/26 05:53:01.511&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/16/26 05:53:01.511 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/16/26 05:53:01.512&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/16/26 05:53:01.512 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/flip_coin.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="150.808964279">
              <system-out>2026/07/16 05:53:31 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/16/26 05:51:00.751&#xA;Create an experiment with name E2EExperiment-1784181060751673355&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/16/26 05:51:00.884 (133ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/16/26 05:51:00.885&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x2b0348620e00&#xA;test-secret-1 created&#xA;test-secret-2 created&#xA;test-secret-3 created&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/16/26 05:51:00.924 (39ms)&#xA;&gt; Enter [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/16/26 05:51:00.924&#xA;Uploading pipeline file critical/flip_coin.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1784181060885101036, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml&#xA;Upload of pipeline file &#39;critical/flip_coin.yaml&#39; successful&#xA;Listing pipeline versions for pipeline d0cf83ad-7e48-4cfb-a313-f41ff1b22bd0&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;d0cf83ad-7e48-4cfb-a313-f41ff1b22bd0&#39; and name: &#39;e2e-test-1784181060885101036&#39;&#xA;Create a pipeline run for pipeline with id=d0cf83ad-7e48-4cfb-a313-f41ff1b22bd0 and versionId=21a83264-b2c8-4a88-9c61-8a1cdbd57c08&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=a58aab6f-604c-41ac-84b6-806b5b57c929&#xA;Created Pipeline Run with id: a58aab6f-604c-41ac-84b6-806b5b57c929 for pipeline with id: d0cf83ad-7e48-4cfb-a313-f41ff1b22bd0&#xA;Waiting for pipeline run with id=a58aab6f-604c-41ac-84b6-806b5b57c929 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=a58aab6f-604c-41ac-84b6-806b5b57c929&#xA;Pipeline run with id=a58aab6f-604c-41ac-84b6-806b5b57c929 is in PENDING state, waiting...&#xA;Get a pipeline run with id=a58aab6f-604c-41ac-84b6-806b5b57c929&#xA;Pipeline run with id=a58aab6f-604c-41ac-84b6-806b5b57c929 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=a58aab6f-604c-41ac-84b6-806b5b57c929&#xA;Pipeline run with id=a58aab6f-604c-41ac-84b6-806b5b57c929 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=a58aab6f-604c-41ac-84b6-806b5b57c929&#xA;Pipeline run with id=a58aab6f-604c-41ac-84b6-806b5b57c929 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=a58aab6f-604c-41ac-84b6-806b5b57c929&#xA;Pipeline run with id=a58aab6f-604c-41ac-84b6-806b5b57c929 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=a58aab6f-604c-41ac-84b6-806b5b57c929&#xA;Pipeline run with id=a58aab6f-604c-41ac-84b6-806b5b57c929 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=a58aab6f-604c-41ac-84b6-806b5b57c929&#xA;Pipeline run with id=a58aab6f-604c-41ac-84b6-806b5b57c929 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=a58aab6f-604c-41ac-84b6-806b5b57c929&#xA;Pipeline run with id=a58aab6f-604c-41ac-84b6-806b5b57c929 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=a58aab6f-604c-41ac-84b6-806b5b57c929&#xA;Pipeline run with id=a58aab6f-604c-41ac-84b6-806b5b57c929 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=a58aab6f-604c-41ac-84b6-806b5b57c929&#xA;Pipeline run with id=a58aab6f-604c-41ac-84b6-806b5b57c929 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=a58aab6f-604c-41ac-84b6-806b5b57c929&#xA;Pipeline run with id=a58aab6f-604c-41ac-84b6-806b5b57c929 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=a58aab6f-604c-41ac-84b6-806b5b57c929&#xA;Pipeline run with id=a58aab6f-604c-41ac-84b6-806b5b57c929 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=a58aab6f-604c-41ac-84b6-806b5b57c929&#xA;Pipeline run with id=a58aab6f-604c-41ac-84b6-806b5b57c929 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=a58aab6f-604c-41ac-84b6-806b5b57c929&#xA;Pipeline run with id=a58aab6f-604c-41ac-84b6-806b5b57c929 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=a58aab6f-604c-41ac-84b6-806b5b57c929&#xA;Pipeline run with id=a58aab6f-604c-41ac-84b6-806b5b57c929 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=a58aab6f-604c-41ac-84b6-806b5b57c929&#xA;Pipeline run with id=a58aab6f-604c-41ac-84b6-806b5b57c929 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=a58aab6f-604c-41ac-84b6-806b5b57c929&#xA;Pipeline run with id=a58aab6f-604c-41ac-84b6-806b5b57c929 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=a58aab6f-604c-41ac-84b6-806b5b57c929&#xA;Pipeline run with id=a58aab6f-604c-41ac-84b6-806b5b57c929 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=a58aab6f-604c-41ac-84b6-806b5b57c929&#xA;Pipeline run with id=a58aab6f-604c-41ac-84b6-806b5b57c929 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=a58aab6f-604c-41ac-84b6-806b5b57c929&#xA;Pipeline run with id=a58aab6f-604c-41ac-84b6-806b5b57c929 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=a58aab6f-604c-41ac-84b6-806b5b57c929&#xA;Pipeline run with id=a58aab6f-604c-41ac-84b6-806b5b57c929 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=a58aab6f-604c-41ac-84b6-806b5b57c929&#xA;Pipeline run with id=a58aab6f-604c-41ac-84b6-806b5b57c929 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=a58aab6f-604c-41ac-84b6-806b5b57c929&#xA;Pipeline run with id=a58aab6f-604c-41ac-84b6-806b5b57c929 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=a58aab6f-604c-41ac-84b6-806b5b57c929&#xA;Pipeline run with id=a58aab6f-604c-41ac-84b6-806b5b57c929 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=a58aab6f-604c-41ac-84b6-806b5b57c929&#xA;Pipeline run with id=a58aab6f-604c-41ac-84b6-806b5b57c929 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=a58aab6f-604c-41ac-84b6-806b5b57c929&#xA;Pipeline run with id=a58aab6f-604c-41ac-84b6-806b5b57c929 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=a58aab6f-604c-41ac-84b6-806b5b57c929&#xA;Pipeline run with id=a58aab6f-604c-41ac-84b6-806b5b57c929 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=a58aab6f-604c-41ac-84b6-806b5b57c929&#xA;Pipeline run with id=a58aab6f-604c-41ac-84b6-806b5b57c929 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=a58aab6f-604c-41ac-84b6-806b5b57c929&#xA;Pipeline run with id=a58aab6f-604c-41ac-84b6-806b5b57c929 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=a58aab6f-604c-41ac-84b6-806b5b57c929&#xA;Pipeline run with id=a58aab6f-604c-41ac-84b6-806b5b57c929 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=a58aab6f-604c-41ac-84b6-806b5b57c929&#xA;Pipeline run with id=a58aab6f-604c-41ac-84b6-806b5b57c929 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/flip_coin.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=a58aab6f-604c-41ac-84b6-806b5b57c929&#xA;Get a pipeline run with id=a58aab6f-604c-41ac-84b6-806b5b57c929&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/16/26 05:53:31.462 (2m30.538s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/16/26 05:53:31.463&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run a58aab6f-604c-41ac-84b6-806b5b57c929&#xA;Failed to terminate run a58aab6f-604c-41ac-84b6-806b5b57c929&#xA;Terminate run a58aab6f-604c-41ac-84b6-806b5b57c929&#xA;Deleting run a58aab6f-604c-41ac-84b6-806b5b57c929&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=d0cf83ad-7e48-4cfb-a313-f41ff1b22bd0 (cascade=true)&#xA;Pipeline with id=d0cf83ad-7e48-4cfb-a313-f41ff1b22bd0, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/16/26 05:53:31.56 (97ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/16/26 05:53:31.56&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/16/26 05:53:31.56 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/16/26 05:53:31.561&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/16/26 05:53:31.561 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload essential/iris_pipeline_compiled.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="180.712196644">
              <system-out>2026/07/16 05:54:01 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/16/26 05:51:00.752&#xA;Create an experiment with name E2EExperiment-1784181060752198996&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/16/26 05:51:00.894 (142ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/16/26 05:51:00.894&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x12a99a874480&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/16/26 05:51:00.945 (51ms)&#xA;&gt; Enter [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/16/26 05:51:00.945&#xA;Uploading pipeline file essential/iris_pipeline_compiled.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1784181060894277101, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml&#xA;Upload of pipeline file &#39;essential/iris_pipeline_compiled.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 0f6bccc9-d463-4627-8361-d541dd59838d&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;0f6bccc9-d463-4627-8361-d541dd59838d&#39; and name: &#39;e2e-test-1784181060894277101&#39;&#xA;Create a pipeline run for pipeline with id=0f6bccc9-d463-4627-8361-d541dd59838d and versionId=f9e583de-3cb9-4bf6-950c-7529aae932c5&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=9276b9c4-c0cf-4a19-ba05-6afd3e570934&#xA;Created Pipeline Run with id: 9276b9c4-c0cf-4a19-ba05-6afd3e570934 for pipeline with id: 0f6bccc9-d463-4627-8361-d541dd59838d&#xA;Waiting for pipeline run with id=9276b9c4-c0cf-4a19-ba05-6afd3e570934 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=9276b9c4-c0cf-4a19-ba05-6afd3e570934&#xA;Pipeline run with id=9276b9c4-c0cf-4a19-ba05-6afd3e570934 is in PENDING state, waiting...&#xA;Get a pipeline run with id=9276b9c4-c0cf-4a19-ba05-6afd3e570934&#xA;Pipeline run with id=9276b9c4-c0cf-4a19-ba05-6afd3e570934 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9276b9c4-c0cf-4a19-ba05-6afd3e570934&#xA;Pipeline run with id=9276b9c4-c0cf-4a19-ba05-6afd3e570934 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9276b9c4-c0cf-4a19-ba05-6afd3e570934&#xA;Pipeline run with id=9276b9c4-c0cf-4a19-ba05-6afd3e570934 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9276b9c4-c0cf-4a19-ba05-6afd3e570934&#xA;Pipeline run with id=9276b9c4-c0cf-4a19-ba05-6afd3e570934 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9276b9c4-c0cf-4a19-ba05-6afd3e570934&#xA;Pipeline run with id=9276b9c4-c0cf-4a19-ba05-6afd3e570934 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9276b9c4-c0cf-4a19-ba05-6afd3e570934&#xA;Pipeline run with id=9276b9c4-c0cf-4a19-ba05-6afd3e570934 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9276b9c4-c0cf-4a19-ba05-6afd3e570934&#xA;Pipeline run with id=9276b9c4-c0cf-4a19-ba05-6afd3e570934 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9276b9c4-c0cf-4a19-ba05-6afd3e570934&#xA;Pipeline run with id=9276b9c4-c0cf-4a19-ba05-6afd3e570934 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9276b9c4-c0cf-4a19-ba05-6afd3e570934&#xA;Pipeline run with id=9276b9c4-c0cf-4a19-ba05-6afd3e570934 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9276b9c4-c0cf-4a19-ba05-6afd3e570934&#xA;Pipeline run with id=9276b9c4-c0cf-4a19-ba05-6afd3e570934 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9276b9c4-c0cf-4a19-ba05-6afd3e570934&#xA;Pipeline run with id=9276b9c4-c0cf-4a19-ba05-6afd3e570934 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9276b9c4-c0cf-4a19-ba05-6afd3e570934&#xA;Pipeline run with id=9276b9c4-c0cf-4a19-ba05-6afd3e570934 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9276b9c4-c0cf-4a19-ba05-6afd3e570934&#xA;Pipeline run with id=9276b9c4-c0cf-4a19-ba05-6afd3e570934 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9276b9c4-c0cf-4a19-ba05-6afd3e570934&#xA;Pipeline run with id=9276b9c4-c0cf-4a19-ba05-6afd3e570934 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9276b9c4-c0cf-4a19-ba05-6afd3e570934&#xA;Pipeline run with id=9276b9c4-c0cf-4a19-ba05-6afd3e570934 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9276b9c4-c0cf-4a19-ba05-6afd3e570934&#xA;Pipeline run with id=9276b9c4-c0cf-4a19-ba05-6afd3e570934 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9276b9c4-c0cf-4a19-ba05-6afd3e570934&#xA;Pipeline run with id=9276b9c4-c0cf-4a19-ba05-6afd3e570934 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9276b9c4-c0cf-4a19-ba05-6afd3e570934&#xA;Pipeline run with id=9276b9c4-c0cf-4a19-ba05-6afd3e570934 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9276b9c4-c0cf-4a19-ba05-6afd3e570934&#xA;Pipeline run with id=9276b9c4-c0cf-4a19-ba05-6afd3e570934 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9276b9c4-c0cf-4a19-ba05-6afd3e570934&#xA;Pipeline run with id=9276b9c4-c0cf-4a19-ba05-6afd3e570934 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9276b9c4-c0cf-4a19-ba05-6afd3e570934&#xA;Pipeline run with id=9276b9c4-c0cf-4a19-ba05-6afd3e570934 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9276b9c4-c0cf-4a19-ba05-6afd3e570934&#xA;Pipeline run with id=9276b9c4-c0cf-4a19-ba05-6afd3e570934 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9276b9c4-c0cf-4a19-ba05-6afd3e570934&#xA;Pipeline run with id=9276b9c4-c0cf-4a19-ba05-6afd3e570934 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9276b9c4-c0cf-4a19-ba05-6afd3e570934&#xA;Pipeline run with id=9276b9c4-c0cf-4a19-ba05-6afd3e570934 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9276b9c4-c0cf-4a19-ba05-6afd3e570934&#xA;Pipeline run with id=9276b9c4-c0cf-4a19-ba05-6afd3e570934 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9276b9c4-c0cf-4a19-ba05-6afd3e570934&#xA;Pipeline run with id=9276b9c4-c0cf-4a19-ba05-6afd3e570934 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9276b9c4-c0cf-4a19-ba05-6afd3e570934&#xA;Pipeline run with id=9276b9c4-c0cf-4a19-ba05-6afd3e570934 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9276b9c4-c0cf-4a19-ba05-6afd3e570934&#xA;Pipeline run with id=9276b9c4-c0cf-4a19-ba05-6afd3e570934 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9276b9c4-c0cf-4a19-ba05-6afd3e570934&#xA;Pipeline run with id=9276b9c4-c0cf-4a19-ba05-6afd3e570934 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9276b9c4-c0cf-4a19-ba05-6afd3e570934&#xA;Pipeline run with id=9276b9c4-c0cf-4a19-ba05-6afd3e570934 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9276b9c4-c0cf-4a19-ba05-6afd3e570934&#xA;Pipeline run with id=9276b9c4-c0cf-4a19-ba05-6afd3e570934 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9276b9c4-c0cf-4a19-ba05-6afd3e570934&#xA;Pipeline run with id=9276b9c4-c0cf-4a19-ba05-6afd3e570934 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9276b9c4-c0cf-4a19-ba05-6afd3e570934&#xA;Pipeline run with id=9276b9c4-c0cf-4a19-ba05-6afd3e570934 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9276b9c4-c0cf-4a19-ba05-6afd3e570934&#xA;Pipeline run with id=9276b9c4-c0cf-4a19-ba05-6afd3e570934 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9276b9c4-c0cf-4a19-ba05-6afd3e570934&#xA;Pipeline run with id=9276b9c4-c0cf-4a19-ba05-6afd3e570934 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9276b9c4-c0cf-4a19-ba05-6afd3e570934&#xA;Pipeline run with id=9276b9c4-c0cf-4a19-ba05-6afd3e570934 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;essential/iris_pipeline_compiled.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=9276b9c4-c0cf-4a19-ba05-6afd3e570934&#xA;Get a pipeline run with id=9276b9c4-c0cf-4a19-ba05-6afd3e570934&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/16/26 05:54:01.338 (3m0.393s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/16/26 05:54:01.338&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 9276b9c4-c0cf-4a19-ba05-6afd3e570934&#xA;Failed to terminate run 9276b9c4-c0cf-4a19-ba05-6afd3e570934&#xA;Terminate run 9276b9c4-c0cf-4a19-ba05-6afd3e570934&#xA;Deleting run 9276b9c4-c0cf-4a19-ba05-6afd3e570934&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=0f6bccc9-d463-4627-8361-d541dd59838d (cascade=true)&#xA;Pipeline with id=0f6bccc9-d463-4627-8361-d541dd59838d, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/16/26 05:54:01.464 (125ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/16/26 05:54:01.464&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/16/26 05:54:01.464 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/16/26 05:54:01.464&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/16/26 05:54:01.464 (0s)&#xA;</system-err>
          </testcase>
      </testsuite>
  </testsuites>