<?xml version="1.0" encoding="UTF-8"?>
  <testsuites tests="5" disabled="0" errors="0" failures="0" time="180.925341095">
      <testsuite name="AIPipelinesE2ETests" package="/dspa/backend/test/end2end" tests="5" disabled="0" skipped="0" errors="0" failures="0" time="180.925341095" timestamp="2026-07-15T14:16:22">
          <properties>
              <property name="SuiteSucceeded" value="true"></property>
              <property name="SuiteHasProgrammaticFocus" value="false"></property>
              <property name="SpecialSuiteFailureReason" value=""></property>
              <property name="SuiteLabels" value="[]"></property>
              <property name="SuiteSemVerConstraints" value="[]"></property>
              <property name="RandomSeed" value="1784124798"></property>
              <property name="RandomizeAllSpecs" value="false"></property>
              <property name="LabelFilter" value="Smoke"></property>
              <property name="SemVerFilter" value=""></property>
              <property name="FocusStrings" value=""></property>
              <property name="SkipStrings" value=""></property>
              <property name="FocusFiles" value=""></property>
              <property name="SkipFiles" value=""></property>
              <property name="FailOnPending" value="false"></property>
              <property name="FailOnEmpty" value="false"></property>
              <property name="FailFast" value="false"></property>
              <property name="FlakeAttempts" value="0"></property>
              <property name="DryRun" value="false"></property>
              <property name="ParallelTotal" value="10"></property>
              <property name="OutputInterceptorMode" value=""></property>
          </properties>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/flip_coin.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="145.818407767">
              <system-out>2026/07/15 14:18:48 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/15/26 14:16:22.865&#xA;Create an experiment with name E2EExperiment-1784124982865221505&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/15/26 14:16:22.998 (133ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/15/26 14:16:22.998&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0xf0fbc618b80&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/15/26 14:16:23.06 (62ms)&#xA;&gt; Enter [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/15/26 14:16:23.06&#xA;Uploading pipeline file critical/flip_coin.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1784124982998320959, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml&#xA;Upload of pipeline file &#39;critical/flip_coin.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 3a375f1c-3bc9-4140-ada6-1992b43ab34e&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;3a375f1c-3bc9-4140-ada6-1992b43ab34e&#39; and name: &#39;e2e-test-1784124982998320959&#39;&#xA;Create a pipeline run for pipeline with id=3a375f1c-3bc9-4140-ada6-1992b43ab34e and versionId=22f220a5-c2b2-4716-be59-d4ae7beb985f&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=f890288f-2928-4639-acb1-dd39376b14a0&#xA;Created Pipeline Run with id: f890288f-2928-4639-acb1-dd39376b14a0 for pipeline with id: 3a375f1c-3bc9-4140-ada6-1992b43ab34e&#xA;Waiting for pipeline run with id=f890288f-2928-4639-acb1-dd39376b14a0 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=f890288f-2928-4639-acb1-dd39376b14a0&#xA;Pipeline run with id=f890288f-2928-4639-acb1-dd39376b14a0 is in PENDING state, waiting...&#xA;Get a pipeline run with id=f890288f-2928-4639-acb1-dd39376b14a0&#xA;Pipeline run with id=f890288f-2928-4639-acb1-dd39376b14a0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f890288f-2928-4639-acb1-dd39376b14a0&#xA;Pipeline run with id=f890288f-2928-4639-acb1-dd39376b14a0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f890288f-2928-4639-acb1-dd39376b14a0&#xA;Pipeline run with id=f890288f-2928-4639-acb1-dd39376b14a0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f890288f-2928-4639-acb1-dd39376b14a0&#xA;Pipeline run with id=f890288f-2928-4639-acb1-dd39376b14a0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f890288f-2928-4639-acb1-dd39376b14a0&#xA;Pipeline run with id=f890288f-2928-4639-acb1-dd39376b14a0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f890288f-2928-4639-acb1-dd39376b14a0&#xA;Pipeline run with id=f890288f-2928-4639-acb1-dd39376b14a0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f890288f-2928-4639-acb1-dd39376b14a0&#xA;Pipeline run with id=f890288f-2928-4639-acb1-dd39376b14a0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f890288f-2928-4639-acb1-dd39376b14a0&#xA;Pipeline run with id=f890288f-2928-4639-acb1-dd39376b14a0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f890288f-2928-4639-acb1-dd39376b14a0&#xA;Pipeline run with id=f890288f-2928-4639-acb1-dd39376b14a0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f890288f-2928-4639-acb1-dd39376b14a0&#xA;Pipeline run with id=f890288f-2928-4639-acb1-dd39376b14a0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f890288f-2928-4639-acb1-dd39376b14a0&#xA;Pipeline run with id=f890288f-2928-4639-acb1-dd39376b14a0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f890288f-2928-4639-acb1-dd39376b14a0&#xA;Pipeline run with id=f890288f-2928-4639-acb1-dd39376b14a0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f890288f-2928-4639-acb1-dd39376b14a0&#xA;Pipeline run with id=f890288f-2928-4639-acb1-dd39376b14a0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f890288f-2928-4639-acb1-dd39376b14a0&#xA;Pipeline run with id=f890288f-2928-4639-acb1-dd39376b14a0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f890288f-2928-4639-acb1-dd39376b14a0&#xA;Pipeline run with id=f890288f-2928-4639-acb1-dd39376b14a0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f890288f-2928-4639-acb1-dd39376b14a0&#xA;Pipeline run with id=f890288f-2928-4639-acb1-dd39376b14a0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f890288f-2928-4639-acb1-dd39376b14a0&#xA;Pipeline run with id=f890288f-2928-4639-acb1-dd39376b14a0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f890288f-2928-4639-acb1-dd39376b14a0&#xA;Pipeline run with id=f890288f-2928-4639-acb1-dd39376b14a0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f890288f-2928-4639-acb1-dd39376b14a0&#xA;Pipeline run with id=f890288f-2928-4639-acb1-dd39376b14a0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f890288f-2928-4639-acb1-dd39376b14a0&#xA;Pipeline run with id=f890288f-2928-4639-acb1-dd39376b14a0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f890288f-2928-4639-acb1-dd39376b14a0&#xA;Pipeline run with id=f890288f-2928-4639-acb1-dd39376b14a0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f890288f-2928-4639-acb1-dd39376b14a0&#xA;Pipeline run with id=f890288f-2928-4639-acb1-dd39376b14a0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f890288f-2928-4639-acb1-dd39376b14a0&#xA;Pipeline run with id=f890288f-2928-4639-acb1-dd39376b14a0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f890288f-2928-4639-acb1-dd39376b14a0&#xA;Pipeline run with id=f890288f-2928-4639-acb1-dd39376b14a0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f890288f-2928-4639-acb1-dd39376b14a0&#xA;Pipeline run with id=f890288f-2928-4639-acb1-dd39376b14a0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f890288f-2928-4639-acb1-dd39376b14a0&#xA;Pipeline run with id=f890288f-2928-4639-acb1-dd39376b14a0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f890288f-2928-4639-acb1-dd39376b14a0&#xA;Pipeline run with id=f890288f-2928-4639-acb1-dd39376b14a0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f890288f-2928-4639-acb1-dd39376b14a0&#xA;Pipeline run with id=f890288f-2928-4639-acb1-dd39376b14a0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f890288f-2928-4639-acb1-dd39376b14a0&#xA;Pipeline run with id=f890288f-2928-4639-acb1-dd39376b14a0 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/flip_coin.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=f890288f-2928-4639-acb1-dd39376b14a0&#xA;Get a pipeline run with id=f890288f-2928-4639-acb1-dd39376b14a0&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/15/26 14:18:48.552 (2m25.492s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/15/26 14:18:48.552&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run f890288f-2928-4639-acb1-dd39376b14a0&#xA;Failed to terminate run f890288f-2928-4639-acb1-dd39376b14a0&#xA;Terminate run f890288f-2928-4639-acb1-dd39376b14a0&#xA;Deleting run f890288f-2928-4639-acb1-dd39376b14a0&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=3a375f1c-3bc9-4140-ada6-1992b43ab34e (cascade=true)&#xA;Pipeline with id=3a375f1c-3bc9-4140-ada6-1992b43ab34e, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/15/26 14:18:48.683 (131ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/15/26 14:18:48.683&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/15/26 14:18:48.683 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/15/26 14:18:48.684&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/15/26 14:18:48.684 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload essential/component_with_pip_index_urls.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="75.644955511">
              <system-out>2026/07/15 14:17:38 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/15/26 14:16:22.865&#xA;Create an experiment with name E2EExperiment-1784124982865515542&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/15/26 14:16:23.001 (136ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/15/26 14:16:23.001&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0xc11e82fd280&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/15/26 14:16:23.06 (60ms)&#xA;&gt; Enter [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/15/26 14:16:23.06&#xA;Uploading pipeline file essential/component_with_pip_index_urls.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1784124983001314219, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml&#xA;Upload of pipeline file &#39;essential/component_with_pip_index_urls.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 0adafdc3-6c18-4b00-8fff-88aed2de4bf6&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;0adafdc3-6c18-4b00-8fff-88aed2de4bf6&#39; and name: &#39;e2e-test-1784124983001314219&#39;&#xA;Create a pipeline run for pipeline with id=0adafdc3-6c18-4b00-8fff-88aed2de4bf6 and versionId=11f15fce-4ddf-44c6-a4db-7e73db5c3bdc&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=08a34d03-6868-4f9f-8823-31865189652a&#xA;Created Pipeline Run with id: 08a34d03-6868-4f9f-8823-31865189652a for pipeline with id: 0adafdc3-6c18-4b00-8fff-88aed2de4bf6&#xA;Waiting for pipeline run with id=08a34d03-6868-4f9f-8823-31865189652a to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=08a34d03-6868-4f9f-8823-31865189652a&#xA;Pipeline run with id=08a34d03-6868-4f9f-8823-31865189652a is in PENDING state, waiting...&#xA;Get a pipeline run with id=08a34d03-6868-4f9f-8823-31865189652a&#xA;Pipeline run with id=08a34d03-6868-4f9f-8823-31865189652a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=08a34d03-6868-4f9f-8823-31865189652a&#xA;Pipeline run with id=08a34d03-6868-4f9f-8823-31865189652a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=08a34d03-6868-4f9f-8823-31865189652a&#xA;Pipeline run with id=08a34d03-6868-4f9f-8823-31865189652a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=08a34d03-6868-4f9f-8823-31865189652a&#xA;Pipeline run with id=08a34d03-6868-4f9f-8823-31865189652a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=08a34d03-6868-4f9f-8823-31865189652a&#xA;Pipeline run with id=08a34d03-6868-4f9f-8823-31865189652a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=08a34d03-6868-4f9f-8823-31865189652a&#xA;Pipeline run with id=08a34d03-6868-4f9f-8823-31865189652a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=08a34d03-6868-4f9f-8823-31865189652a&#xA;Pipeline run with id=08a34d03-6868-4f9f-8823-31865189652a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=08a34d03-6868-4f9f-8823-31865189652a&#xA;Pipeline run with id=08a34d03-6868-4f9f-8823-31865189652a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=08a34d03-6868-4f9f-8823-31865189652a&#xA;Pipeline run with id=08a34d03-6868-4f9f-8823-31865189652a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=08a34d03-6868-4f9f-8823-31865189652a&#xA;Pipeline run with id=08a34d03-6868-4f9f-8823-31865189652a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=08a34d03-6868-4f9f-8823-31865189652a&#xA;Pipeline run with id=08a34d03-6868-4f9f-8823-31865189652a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=08a34d03-6868-4f9f-8823-31865189652a&#xA;Pipeline run with id=08a34d03-6868-4f9f-8823-31865189652a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=08a34d03-6868-4f9f-8823-31865189652a&#xA;Pipeline run with id=08a34d03-6868-4f9f-8823-31865189652a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=08a34d03-6868-4f9f-8823-31865189652a&#xA;Pipeline run with id=08a34d03-6868-4f9f-8823-31865189652a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=08a34d03-6868-4f9f-8823-31865189652a&#xA;Pipeline run with id=08a34d03-6868-4f9f-8823-31865189652a reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;essential/component_with_pip_index_urls.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=08a34d03-6868-4f9f-8823-31865189652a&#xA;Get a pipeline run with id=08a34d03-6868-4f9f-8823-31865189652a&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/15/26 14:17:38.421 (1m15.36s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/15/26 14:17:38.421&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 08a34d03-6868-4f9f-8823-31865189652a&#xA;Failed to terminate run 08a34d03-6868-4f9f-8823-31865189652a&#xA;Terminate run 08a34d03-6868-4f9f-8823-31865189652a&#xA;Deleting run 08a34d03-6868-4f9f-8823-31865189652a&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=0adafdc3-6c18-4b00-8fff-88aed2de4bf6 (cascade=true)&#xA;Pipeline with id=0adafdc3-6c18-4b00-8fff-88aed2de4bf6, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/15/26 14:17:38.51 (89ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/15/26 14:17:38.51&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/15/26 14:17:38.51 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/15/26 14:17:38.51&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/15/26 14:17:38.51 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/parallel_for_after_dependency.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="115.712385207">
              <system-out>2026/07/15 14:18:18 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/15/26 14:16:22.865&#xA;Create an experiment with name E2EExperiment-1784124982865313310&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/15/26 14:16:22.998 (133ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/15/26 14:16:22.998&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x1768c5fd6d00&#xA;test-secret-1 created&#xA;test-secret-2 created&#xA;test-secret-3 created&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/15/26 14:16:23.046 (48ms)&#xA;&gt; Enter [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/15/26 14:16:23.046&#xA;Uploading pipeline file critical/parallel_for_after_dependency.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1784124982998311429, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml&#xA;Upload of pipeline file &#39;critical/parallel_for_after_dependency.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 5293a88e-ccdc-4ba6-9cc2-8ceef14f2454&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;5293a88e-ccdc-4ba6-9cc2-8ceef14f2454&#39; and name: &#39;e2e-test-1784124982998311429&#39;&#xA;Create a pipeline run for pipeline with id=5293a88e-ccdc-4ba6-9cc2-8ceef14f2454 and versionId=a7bc3328-185b-40bf-81dc-ae5f00115752&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=4b4de0ef-b733-4cf6-9015-0a305e6f7adc&#xA;Created Pipeline Run with id: 4b4de0ef-b733-4cf6-9015-0a305e6f7adc for pipeline with id: 5293a88e-ccdc-4ba6-9cc2-8ceef14f2454&#xA;Waiting for pipeline run with id=4b4de0ef-b733-4cf6-9015-0a305e6f7adc to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=4b4de0ef-b733-4cf6-9015-0a305e6f7adc&#xA;Pipeline run with id=4b4de0ef-b733-4cf6-9015-0a305e6f7adc is in PENDING state, waiting...&#xA;Get a pipeline run with id=4b4de0ef-b733-4cf6-9015-0a305e6f7adc&#xA;Pipeline run with id=4b4de0ef-b733-4cf6-9015-0a305e6f7adc is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4b4de0ef-b733-4cf6-9015-0a305e6f7adc&#xA;Pipeline run with id=4b4de0ef-b733-4cf6-9015-0a305e6f7adc is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4b4de0ef-b733-4cf6-9015-0a305e6f7adc&#xA;Pipeline run with id=4b4de0ef-b733-4cf6-9015-0a305e6f7adc is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4b4de0ef-b733-4cf6-9015-0a305e6f7adc&#xA;Pipeline run with id=4b4de0ef-b733-4cf6-9015-0a305e6f7adc is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4b4de0ef-b733-4cf6-9015-0a305e6f7adc&#xA;Pipeline run with id=4b4de0ef-b733-4cf6-9015-0a305e6f7adc is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4b4de0ef-b733-4cf6-9015-0a305e6f7adc&#xA;Pipeline run with id=4b4de0ef-b733-4cf6-9015-0a305e6f7adc is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4b4de0ef-b733-4cf6-9015-0a305e6f7adc&#xA;Pipeline run with id=4b4de0ef-b733-4cf6-9015-0a305e6f7adc is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4b4de0ef-b733-4cf6-9015-0a305e6f7adc&#xA;Pipeline run with id=4b4de0ef-b733-4cf6-9015-0a305e6f7adc is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4b4de0ef-b733-4cf6-9015-0a305e6f7adc&#xA;Pipeline run with id=4b4de0ef-b733-4cf6-9015-0a305e6f7adc is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4b4de0ef-b733-4cf6-9015-0a305e6f7adc&#xA;Pipeline run with id=4b4de0ef-b733-4cf6-9015-0a305e6f7adc is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4b4de0ef-b733-4cf6-9015-0a305e6f7adc&#xA;Pipeline run with id=4b4de0ef-b733-4cf6-9015-0a305e6f7adc is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4b4de0ef-b733-4cf6-9015-0a305e6f7adc&#xA;Pipeline run with id=4b4de0ef-b733-4cf6-9015-0a305e6f7adc is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4b4de0ef-b733-4cf6-9015-0a305e6f7adc&#xA;Pipeline run with id=4b4de0ef-b733-4cf6-9015-0a305e6f7adc is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4b4de0ef-b733-4cf6-9015-0a305e6f7adc&#xA;Pipeline run with id=4b4de0ef-b733-4cf6-9015-0a305e6f7adc is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4b4de0ef-b733-4cf6-9015-0a305e6f7adc&#xA;Pipeline run with id=4b4de0ef-b733-4cf6-9015-0a305e6f7adc is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4b4de0ef-b733-4cf6-9015-0a305e6f7adc&#xA;Pipeline run with id=4b4de0ef-b733-4cf6-9015-0a305e6f7adc is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4b4de0ef-b733-4cf6-9015-0a305e6f7adc&#xA;Pipeline run with id=4b4de0ef-b733-4cf6-9015-0a305e6f7adc is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4b4de0ef-b733-4cf6-9015-0a305e6f7adc&#xA;Pipeline run with id=4b4de0ef-b733-4cf6-9015-0a305e6f7adc is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4b4de0ef-b733-4cf6-9015-0a305e6f7adc&#xA;Pipeline run with id=4b4de0ef-b733-4cf6-9015-0a305e6f7adc is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4b4de0ef-b733-4cf6-9015-0a305e6f7adc&#xA;Pipeline run with id=4b4de0ef-b733-4cf6-9015-0a305e6f7adc is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4b4de0ef-b733-4cf6-9015-0a305e6f7adc&#xA;Pipeline run with id=4b4de0ef-b733-4cf6-9015-0a305e6f7adc is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4b4de0ef-b733-4cf6-9015-0a305e6f7adc&#xA;Pipeline run with id=4b4de0ef-b733-4cf6-9015-0a305e6f7adc is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4b4de0ef-b733-4cf6-9015-0a305e6f7adc&#xA;Pipeline run with id=4b4de0ef-b733-4cf6-9015-0a305e6f7adc reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/parallel_for_after_dependency.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=4b4de0ef-b733-4cf6-9015-0a305e6f7adc&#xA;Get a pipeline run with id=4b4de0ef-b733-4cf6-9015-0a305e6f7adc&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/15/26 14:18:18.436 (1m55.39s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/15/26 14:18:18.436&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 4b4de0ef-b733-4cf6-9015-0a305e6f7adc&#xA;Failed to terminate run 4b4de0ef-b733-4cf6-9015-0a305e6f7adc&#xA;Terminate run 4b4de0ef-b733-4cf6-9015-0a305e6f7adc&#xA;Deleting run 4b4de0ef-b733-4cf6-9015-0a305e6f7adc&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=5293a88e-ccdc-4ba6-9cc2-8ceef14f2454 (cascade=true)&#xA;Pipeline with id=5293a88e-ccdc-4ba6-9cc2-8ceef14f2454, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/15/26 14:18:18.577 (141ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/15/26 14:18:18.577&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/15/26 14:18:18.577 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/15/26 14:18:18.578&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/15/26 14:18:18.578 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/pipeline_with_artifact_upload_download.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="120.681366799">
              <system-out>2026/07/15 14:18:23 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/15/26 14:16:22.865&#xA;Create an experiment with name E2EExperiment-1784124982865424867&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/15/26 14:16:23.001 (136ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/15/26 14:16:23.001&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x3a64a18e480&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/15/26 14:16:23.06 (59ms)&#xA;&gt; Enter [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/15/26 14:16:23.06&#xA;Uploading pipeline file critical/pipeline_with_artifact_upload_download.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1784124983001645058, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml&#xA;Upload of pipeline file &#39;critical/pipeline_with_artifact_upload_download.yaml&#39; successful&#xA;Listing pipeline versions for pipeline bed9f206-d582-45bb-8e91-8c3df730c7c2&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;bed9f206-d582-45bb-8e91-8c3df730c7c2&#39; and name: &#39;e2e-test-1784124983001645058&#39;&#xA;Create a pipeline run for pipeline with id=bed9f206-d582-45bb-8e91-8c3df730c7c2 and versionId=53124d88-91e9-408b-8cc5-bb78d126ea3e&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=da06752c-a321-4af0-906b-f06f8a27e68e&#xA;Created Pipeline Run with id: da06752c-a321-4af0-906b-f06f8a27e68e for pipeline with id: bed9f206-d582-45bb-8e91-8c3df730c7c2&#xA;Waiting for pipeline run with id=da06752c-a321-4af0-906b-f06f8a27e68e to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=da06752c-a321-4af0-906b-f06f8a27e68e&#xA;Pipeline run with id=da06752c-a321-4af0-906b-f06f8a27e68e is in PENDING state, waiting...&#xA;Get a pipeline run with id=da06752c-a321-4af0-906b-f06f8a27e68e&#xA;Pipeline run with id=da06752c-a321-4af0-906b-f06f8a27e68e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=da06752c-a321-4af0-906b-f06f8a27e68e&#xA;Pipeline run with id=da06752c-a321-4af0-906b-f06f8a27e68e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=da06752c-a321-4af0-906b-f06f8a27e68e&#xA;Pipeline run with id=da06752c-a321-4af0-906b-f06f8a27e68e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=da06752c-a321-4af0-906b-f06f8a27e68e&#xA;Pipeline run with id=da06752c-a321-4af0-906b-f06f8a27e68e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=da06752c-a321-4af0-906b-f06f8a27e68e&#xA;Pipeline run with id=da06752c-a321-4af0-906b-f06f8a27e68e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=da06752c-a321-4af0-906b-f06f8a27e68e&#xA;Pipeline run with id=da06752c-a321-4af0-906b-f06f8a27e68e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=da06752c-a321-4af0-906b-f06f8a27e68e&#xA;Pipeline run with id=da06752c-a321-4af0-906b-f06f8a27e68e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=da06752c-a321-4af0-906b-f06f8a27e68e&#xA;Pipeline run with id=da06752c-a321-4af0-906b-f06f8a27e68e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=da06752c-a321-4af0-906b-f06f8a27e68e&#xA;Pipeline run with id=da06752c-a321-4af0-906b-f06f8a27e68e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=da06752c-a321-4af0-906b-f06f8a27e68e&#xA;Pipeline run with id=da06752c-a321-4af0-906b-f06f8a27e68e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=da06752c-a321-4af0-906b-f06f8a27e68e&#xA;Pipeline run with id=da06752c-a321-4af0-906b-f06f8a27e68e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=da06752c-a321-4af0-906b-f06f8a27e68e&#xA;Pipeline run with id=da06752c-a321-4af0-906b-f06f8a27e68e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=da06752c-a321-4af0-906b-f06f8a27e68e&#xA;Pipeline run with id=da06752c-a321-4af0-906b-f06f8a27e68e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=da06752c-a321-4af0-906b-f06f8a27e68e&#xA;Pipeline run with id=da06752c-a321-4af0-906b-f06f8a27e68e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=da06752c-a321-4af0-906b-f06f8a27e68e&#xA;Pipeline run with id=da06752c-a321-4af0-906b-f06f8a27e68e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=da06752c-a321-4af0-906b-f06f8a27e68e&#xA;Pipeline run with id=da06752c-a321-4af0-906b-f06f8a27e68e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=da06752c-a321-4af0-906b-f06f8a27e68e&#xA;Pipeline run with id=da06752c-a321-4af0-906b-f06f8a27e68e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=da06752c-a321-4af0-906b-f06f8a27e68e&#xA;Pipeline run with id=da06752c-a321-4af0-906b-f06f8a27e68e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=da06752c-a321-4af0-906b-f06f8a27e68e&#xA;Pipeline run with id=da06752c-a321-4af0-906b-f06f8a27e68e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=da06752c-a321-4af0-906b-f06f8a27e68e&#xA;Pipeline run with id=da06752c-a321-4af0-906b-f06f8a27e68e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=da06752c-a321-4af0-906b-f06f8a27e68e&#xA;Pipeline run with id=da06752c-a321-4af0-906b-f06f8a27e68e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=da06752c-a321-4af0-906b-f06f8a27e68e&#xA;Pipeline run with id=da06752c-a321-4af0-906b-f06f8a27e68e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=da06752c-a321-4af0-906b-f06f8a27e68e&#xA;Pipeline run with id=da06752c-a321-4af0-906b-f06f8a27e68e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=da06752c-a321-4af0-906b-f06f8a27e68e&#xA;Pipeline run with id=da06752c-a321-4af0-906b-f06f8a27e68e reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/pipeline_with_artifact_upload_download.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=da06752c-a321-4af0-906b-f06f8a27e68e&#xA;Get a pipeline run with id=da06752c-a321-4af0-906b-f06f8a27e68e&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/15/26 14:18:23.466 (2m0.406s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/15/26 14:18:23.466&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run da06752c-a321-4af0-906b-f06f8a27e68e&#xA;Failed to terminate run da06752c-a321-4af0-906b-f06f8a27e68e&#xA;Terminate run da06752c-a321-4af0-906b-f06f8a27e68e&#xA;Deleting run da06752c-a321-4af0-906b-f06f8a27e68e&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=bed9f206-d582-45bb-8e91-8c3df730c7c2 (cascade=true)&#xA;Pipeline with id=bed9f206-d582-45bb-8e91-8c3df730c7c2, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/15/26 14:18:23.546 (79ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/15/26 14:18:23.546&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/15/26 14:18:23.546 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/15/26 14:18:23.546&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/15/26 14:18:23.547 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload essential/iris_pipeline_compiled.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="180.797042263">
              <system-out>2026/07/15 14:19:23 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/15/26 14:16:22.865&#xA;Create an experiment with name E2EExperiment-1784124982865856631&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/15/26 14:16:23.101 (236ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/15/26 14:16:23.101&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x2b50e2517500&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/15/26 14:16:23.14 (38ms)&#xA;&gt; Enter [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/15/26 14:16:23.14&#xA;Uploading pipeline file essential/iris_pipeline_compiled.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1784124983101992373, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml&#xA;Upload of pipeline file &#39;essential/iris_pipeline_compiled.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 20e79540-15ec-4d2f-864b-9423ea2bae58&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;20e79540-15ec-4d2f-864b-9423ea2bae58&#39; and name: &#39;e2e-test-1784124983101992373&#39;&#xA;Create a pipeline run for pipeline with id=20e79540-15ec-4d2f-864b-9423ea2bae58 and versionId=45315ef4-9cc8-4504-bc9d-2e00bbc3c6ea&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=51ccc98e-bdf4-499c-bb68-59148115624f&#xA;Created Pipeline Run with id: 51ccc98e-bdf4-499c-bb68-59148115624f for pipeline with id: 20e79540-15ec-4d2f-864b-9423ea2bae58&#xA;Waiting for pipeline run with id=51ccc98e-bdf4-499c-bb68-59148115624f to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=51ccc98e-bdf4-499c-bb68-59148115624f&#xA;Pipeline run with id=51ccc98e-bdf4-499c-bb68-59148115624f is in PENDING state, waiting...&#xA;Get a pipeline run with id=51ccc98e-bdf4-499c-bb68-59148115624f&#xA;Pipeline run with id=51ccc98e-bdf4-499c-bb68-59148115624f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=51ccc98e-bdf4-499c-bb68-59148115624f&#xA;Pipeline run with id=51ccc98e-bdf4-499c-bb68-59148115624f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=51ccc98e-bdf4-499c-bb68-59148115624f&#xA;Pipeline run with id=51ccc98e-bdf4-499c-bb68-59148115624f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=51ccc98e-bdf4-499c-bb68-59148115624f&#xA;Pipeline run with id=51ccc98e-bdf4-499c-bb68-59148115624f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=51ccc98e-bdf4-499c-bb68-59148115624f&#xA;Pipeline run with id=51ccc98e-bdf4-499c-bb68-59148115624f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=51ccc98e-bdf4-499c-bb68-59148115624f&#xA;Pipeline run with id=51ccc98e-bdf4-499c-bb68-59148115624f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=51ccc98e-bdf4-499c-bb68-59148115624f&#xA;Pipeline run with id=51ccc98e-bdf4-499c-bb68-59148115624f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=51ccc98e-bdf4-499c-bb68-59148115624f&#xA;Pipeline run with id=51ccc98e-bdf4-499c-bb68-59148115624f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=51ccc98e-bdf4-499c-bb68-59148115624f&#xA;Pipeline run with id=51ccc98e-bdf4-499c-bb68-59148115624f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=51ccc98e-bdf4-499c-bb68-59148115624f&#xA;Pipeline run with id=51ccc98e-bdf4-499c-bb68-59148115624f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=51ccc98e-bdf4-499c-bb68-59148115624f&#xA;Pipeline run with id=51ccc98e-bdf4-499c-bb68-59148115624f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=51ccc98e-bdf4-499c-bb68-59148115624f&#xA;Pipeline run with id=51ccc98e-bdf4-499c-bb68-59148115624f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=51ccc98e-bdf4-499c-bb68-59148115624f&#xA;Pipeline run with id=51ccc98e-bdf4-499c-bb68-59148115624f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=51ccc98e-bdf4-499c-bb68-59148115624f&#xA;Pipeline run with id=51ccc98e-bdf4-499c-bb68-59148115624f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=51ccc98e-bdf4-499c-bb68-59148115624f&#xA;Pipeline run with id=51ccc98e-bdf4-499c-bb68-59148115624f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=51ccc98e-bdf4-499c-bb68-59148115624f&#xA;Pipeline run with id=51ccc98e-bdf4-499c-bb68-59148115624f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=51ccc98e-bdf4-499c-bb68-59148115624f&#xA;Pipeline run with id=51ccc98e-bdf4-499c-bb68-59148115624f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=51ccc98e-bdf4-499c-bb68-59148115624f&#xA;Pipeline run with id=51ccc98e-bdf4-499c-bb68-59148115624f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=51ccc98e-bdf4-499c-bb68-59148115624f&#xA;Pipeline run with id=51ccc98e-bdf4-499c-bb68-59148115624f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=51ccc98e-bdf4-499c-bb68-59148115624f&#xA;Pipeline run with id=51ccc98e-bdf4-499c-bb68-59148115624f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=51ccc98e-bdf4-499c-bb68-59148115624f&#xA;Pipeline run with id=51ccc98e-bdf4-499c-bb68-59148115624f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=51ccc98e-bdf4-499c-bb68-59148115624f&#xA;Pipeline run with id=51ccc98e-bdf4-499c-bb68-59148115624f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=51ccc98e-bdf4-499c-bb68-59148115624f&#xA;Pipeline run with id=51ccc98e-bdf4-499c-bb68-59148115624f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=51ccc98e-bdf4-499c-bb68-59148115624f&#xA;Pipeline run with id=51ccc98e-bdf4-499c-bb68-59148115624f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=51ccc98e-bdf4-499c-bb68-59148115624f&#xA;Pipeline run with id=51ccc98e-bdf4-499c-bb68-59148115624f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=51ccc98e-bdf4-499c-bb68-59148115624f&#xA;Pipeline run with id=51ccc98e-bdf4-499c-bb68-59148115624f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=51ccc98e-bdf4-499c-bb68-59148115624f&#xA;Pipeline run with id=51ccc98e-bdf4-499c-bb68-59148115624f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=51ccc98e-bdf4-499c-bb68-59148115624f&#xA;Pipeline run with id=51ccc98e-bdf4-499c-bb68-59148115624f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=51ccc98e-bdf4-499c-bb68-59148115624f&#xA;Pipeline run with id=51ccc98e-bdf4-499c-bb68-59148115624f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=51ccc98e-bdf4-499c-bb68-59148115624f&#xA;Pipeline run with id=51ccc98e-bdf4-499c-bb68-59148115624f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=51ccc98e-bdf4-499c-bb68-59148115624f&#xA;Pipeline run with id=51ccc98e-bdf4-499c-bb68-59148115624f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=51ccc98e-bdf4-499c-bb68-59148115624f&#xA;Pipeline run with id=51ccc98e-bdf4-499c-bb68-59148115624f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=51ccc98e-bdf4-499c-bb68-59148115624f&#xA;Pipeline run with id=51ccc98e-bdf4-499c-bb68-59148115624f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=51ccc98e-bdf4-499c-bb68-59148115624f&#xA;Pipeline run with id=51ccc98e-bdf4-499c-bb68-59148115624f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=51ccc98e-bdf4-499c-bb68-59148115624f&#xA;Pipeline run with id=51ccc98e-bdf4-499c-bb68-59148115624f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=51ccc98e-bdf4-499c-bb68-59148115624f&#xA;Pipeline run with id=51ccc98e-bdf4-499c-bb68-59148115624f reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;essential/iris_pipeline_compiled.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=51ccc98e-bdf4-499c-bb68-59148115624f&#xA;Get a pipeline run with id=51ccc98e-bdf4-499c-bb68-59148115624f&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/15/26 14:19:23.562 (3m0.422s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/15/26 14:19:23.562&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 51ccc98e-bdf4-499c-bb68-59148115624f&#xA;Failed to terminate run 51ccc98e-bdf4-499c-bb68-59148115624f&#xA;Terminate run 51ccc98e-bdf4-499c-bb68-59148115624f&#xA;Deleting run 51ccc98e-bdf4-499c-bb68-59148115624f&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=20e79540-15ec-4d2f-864b-9423ea2bae58 (cascade=true)&#xA;Pipeline with id=20e79540-15ec-4d2f-864b-9423ea2bae58, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/15/26 14:19:23.662 (100ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/15/26 14:19:23.662&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/15/26 14:19:23.662 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/15/26 14:19:23.663&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/15/26 14:19:23.663 (0s)&#xA;</system-err>
          </testcase>
      </testsuite>
  </testsuites>