<?xml version="1.0" encoding="UTF-8"?>
  <testsuites tests="5" disabled="0" errors="0" failures="0" time="196.172414704">
      <testsuite name="AIPipelinesE2ETests" package="/dspa/backend/test/end2end" tests="5" disabled="0" skipped="0" errors="0" failures="0" time="196.172414704" timestamp="2026-09-09T07:17:13">
          <properties>
              <property name="SuiteSucceeded" value="true"></property>
              <property name="SuiteHasProgrammaticFocus" value="false"></property>
              <property name="SpecialSuiteFailureReason" value=""></property>
              <property name="SuiteLabels" value="[]"></property>
              <property name="SuiteSemVerConstraints" value="[]"></property>
              <property name="RandomSeed" value="1788938058"></property>
              <property name="RandomizeAllSpecs" value="false"></property>
              <property name="LabelFilter" value="Smoke"></property>
              <property name="SemVerFilter" value=""></property>
              <property name="FocusStrings" value=""></property>
              <property name="SkipStrings" value=""></property>
              <property name="FocusFiles" value=""></property>
              <property name="SkipFiles" value=""></property>
              <property name="FailOnPending" value="false"></property>
              <property name="FailOnEmpty" value="false"></property>
              <property name="FailFast" value="false"></property>
              <property name="FlakeAttempts" value="0"></property>
              <property name="DryRun" value="false"></property>
              <property name="ParallelTotal" value="10"></property>
              <property name="OutputInterceptorMode" value=""></property>
          </properties>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/parallel_for_after_dependency.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="121.124948326">
              <system-out>2026/09/09 07:19:14 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 09/09/26 07:17:13.742&#xA;Create an experiment with name E2EExperiment-1788938233742114332&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 09/09/26 07:17:13.946 (205ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 09/09/26 07:17:13.947&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x11d428552680&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 09/09/26 07:17:14.086 (140ms)&#xA;&gt; Enter [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 09/09/26 07:17:14.086&#xA;Uploading pipeline file critical/parallel_for_after_dependency.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1788938233947054931, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml&#xA;Upload of pipeline file &#39;critical/parallel_for_after_dependency.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 473df9d3-210d-496f-9320-8fd0186f0e5d&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;473df9d3-210d-496f-9320-8fd0186f0e5d&#39; and name: &#39;e2e-test-1788938233947054931&#39;&#xA;Create a pipeline run for pipeline with id=473df9d3-210d-496f-9320-8fd0186f0e5d and versionId=881bbb93-ca39-416f-bd60-cef4e58b610e&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=42d8fca4-59ef-45a0-8941-29dd2bd7a117&#xA;Created Pipeline Run with id: 42d8fca4-59ef-45a0-8941-29dd2bd7a117 for pipeline with id: 473df9d3-210d-496f-9320-8fd0186f0e5d&#xA;Waiting for pipeline run with id=42d8fca4-59ef-45a0-8941-29dd2bd7a117 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=42d8fca4-59ef-45a0-8941-29dd2bd7a117&#xA;Pipeline run with id=42d8fca4-59ef-45a0-8941-29dd2bd7a117 is in PENDING state, waiting...&#xA;Get a pipeline run with id=42d8fca4-59ef-45a0-8941-29dd2bd7a117&#xA;Pipeline run with id=42d8fca4-59ef-45a0-8941-29dd2bd7a117 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=42d8fca4-59ef-45a0-8941-29dd2bd7a117&#xA;Pipeline run with id=42d8fca4-59ef-45a0-8941-29dd2bd7a117 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=42d8fca4-59ef-45a0-8941-29dd2bd7a117&#xA;Pipeline run with id=42d8fca4-59ef-45a0-8941-29dd2bd7a117 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=42d8fca4-59ef-45a0-8941-29dd2bd7a117&#xA;Pipeline run with id=42d8fca4-59ef-45a0-8941-29dd2bd7a117 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=42d8fca4-59ef-45a0-8941-29dd2bd7a117&#xA;Pipeline run with id=42d8fca4-59ef-45a0-8941-29dd2bd7a117 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=42d8fca4-59ef-45a0-8941-29dd2bd7a117&#xA;Pipeline run with id=42d8fca4-59ef-45a0-8941-29dd2bd7a117 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=42d8fca4-59ef-45a0-8941-29dd2bd7a117&#xA;Pipeline run with id=42d8fca4-59ef-45a0-8941-29dd2bd7a117 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=42d8fca4-59ef-45a0-8941-29dd2bd7a117&#xA;Pipeline run with id=42d8fca4-59ef-45a0-8941-29dd2bd7a117 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=42d8fca4-59ef-45a0-8941-29dd2bd7a117&#xA;Pipeline run with id=42d8fca4-59ef-45a0-8941-29dd2bd7a117 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=42d8fca4-59ef-45a0-8941-29dd2bd7a117&#xA;Pipeline run with id=42d8fca4-59ef-45a0-8941-29dd2bd7a117 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=42d8fca4-59ef-45a0-8941-29dd2bd7a117&#xA;Pipeline run with id=42d8fca4-59ef-45a0-8941-29dd2bd7a117 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=42d8fca4-59ef-45a0-8941-29dd2bd7a117&#xA;Pipeline run with id=42d8fca4-59ef-45a0-8941-29dd2bd7a117 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=42d8fca4-59ef-45a0-8941-29dd2bd7a117&#xA;Pipeline run with id=42d8fca4-59ef-45a0-8941-29dd2bd7a117 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=42d8fca4-59ef-45a0-8941-29dd2bd7a117&#xA;Pipeline run with id=42d8fca4-59ef-45a0-8941-29dd2bd7a117 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=42d8fca4-59ef-45a0-8941-29dd2bd7a117&#xA;Pipeline run with id=42d8fca4-59ef-45a0-8941-29dd2bd7a117 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=42d8fca4-59ef-45a0-8941-29dd2bd7a117&#xA;Pipeline run with id=42d8fca4-59ef-45a0-8941-29dd2bd7a117 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=42d8fca4-59ef-45a0-8941-29dd2bd7a117&#xA;Pipeline run with id=42d8fca4-59ef-45a0-8941-29dd2bd7a117 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=42d8fca4-59ef-45a0-8941-29dd2bd7a117&#xA;Pipeline run with id=42d8fca4-59ef-45a0-8941-29dd2bd7a117 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=42d8fca4-59ef-45a0-8941-29dd2bd7a117&#xA;Pipeline run with id=42d8fca4-59ef-45a0-8941-29dd2bd7a117 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=42d8fca4-59ef-45a0-8941-29dd2bd7a117&#xA;Pipeline run with id=42d8fca4-59ef-45a0-8941-29dd2bd7a117 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=42d8fca4-59ef-45a0-8941-29dd2bd7a117&#xA;Pipeline run with id=42d8fca4-59ef-45a0-8941-29dd2bd7a117 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=42d8fca4-59ef-45a0-8941-29dd2bd7a117&#xA;Pipeline run with id=42d8fca4-59ef-45a0-8941-29dd2bd7a117 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=42d8fca4-59ef-45a0-8941-29dd2bd7a117&#xA;Pipeline run with id=42d8fca4-59ef-45a0-8941-29dd2bd7a117 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=42d8fca4-59ef-45a0-8941-29dd2bd7a117&#xA;Pipeline run with id=42d8fca4-59ef-45a0-8941-29dd2bd7a117 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/parallel_for_after_dependency.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=42d8fca4-59ef-45a0-8941-29dd2bd7a117&#xA;Get a pipeline run with id=42d8fca4-59ef-45a0-8941-29dd2bd7a117&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 09/09/26 07:19:14.7 (2m0.614s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 09/09/26 07:19:14.7&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 42d8fca4-59ef-45a0-8941-29dd2bd7a117&#xA;Failed to terminate run 42d8fca4-59ef-45a0-8941-29dd2bd7a117&#xA;Terminate run 42d8fca4-59ef-45a0-8941-29dd2bd7a117&#xA;Deleting run 42d8fca4-59ef-45a0-8941-29dd2bd7a117&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=473df9d3-210d-496f-9320-8fd0186f0e5d (cascade=true)&#xA;Pipeline with id=473df9d3-210d-496f-9320-8fd0186f0e5d, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 09/09/26 07:19:14.866 (166ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 09/09/26 07:19:14.867&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 09/09/26 07:19:14.867 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 09/09/26 07:19:14.867&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 09/09/26 07:19:14.867 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload essential/component_with_pip_index_urls.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="71.029269596">
              <system-out>2026/09/09 07:18:24 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 09/09/26 07:17:13.76&#xA;Create an experiment with name E2EExperiment-1788938233760365568&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 09/09/26 07:17:13.942 (182ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 09/09/26 07:17:13.942&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x4c244454580&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 09/09/26 07:17:14.085 (143ms)&#xA;&gt; Enter [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 09/09/26 07:17:14.085&#xA;Uploading pipeline file essential/component_with_pip_index_urls.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1788938233942350098, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml&#xA;Upload of pipeline file &#39;essential/component_with_pip_index_urls.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 94c9137e-c556-438a-8294-505ee49576b3&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;94c9137e-c556-438a-8294-505ee49576b3&#39; and name: &#39;e2e-test-1788938233942350098&#39;&#xA;Create a pipeline run for pipeline with id=94c9137e-c556-438a-8294-505ee49576b3 and versionId=4b271995-16fd-4aa2-b426-a3a4239f6dd7&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=e5fbbdf9-19be-4a18-9159-a6a200a087b1&#xA;Created Pipeline Run with id: e5fbbdf9-19be-4a18-9159-a6a200a087b1 for pipeline with id: 94c9137e-c556-438a-8294-505ee49576b3&#xA;Waiting for pipeline run with id=e5fbbdf9-19be-4a18-9159-a6a200a087b1 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=e5fbbdf9-19be-4a18-9159-a6a200a087b1&#xA;Pipeline run with id=e5fbbdf9-19be-4a18-9159-a6a200a087b1 is in PENDING state, waiting...&#xA;Get a pipeline run with id=e5fbbdf9-19be-4a18-9159-a6a200a087b1&#xA;Pipeline run with id=e5fbbdf9-19be-4a18-9159-a6a200a087b1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e5fbbdf9-19be-4a18-9159-a6a200a087b1&#xA;Pipeline run with id=e5fbbdf9-19be-4a18-9159-a6a200a087b1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e5fbbdf9-19be-4a18-9159-a6a200a087b1&#xA;Pipeline run with id=e5fbbdf9-19be-4a18-9159-a6a200a087b1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e5fbbdf9-19be-4a18-9159-a6a200a087b1&#xA;Pipeline run with id=e5fbbdf9-19be-4a18-9159-a6a200a087b1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e5fbbdf9-19be-4a18-9159-a6a200a087b1&#xA;Pipeline run with id=e5fbbdf9-19be-4a18-9159-a6a200a087b1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e5fbbdf9-19be-4a18-9159-a6a200a087b1&#xA;Pipeline run with id=e5fbbdf9-19be-4a18-9159-a6a200a087b1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e5fbbdf9-19be-4a18-9159-a6a200a087b1&#xA;Pipeline run with id=e5fbbdf9-19be-4a18-9159-a6a200a087b1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e5fbbdf9-19be-4a18-9159-a6a200a087b1&#xA;Pipeline run with id=e5fbbdf9-19be-4a18-9159-a6a200a087b1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e5fbbdf9-19be-4a18-9159-a6a200a087b1&#xA;Pipeline run with id=e5fbbdf9-19be-4a18-9159-a6a200a087b1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e5fbbdf9-19be-4a18-9159-a6a200a087b1&#xA;Pipeline run with id=e5fbbdf9-19be-4a18-9159-a6a200a087b1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e5fbbdf9-19be-4a18-9159-a6a200a087b1&#xA;Pipeline run with id=e5fbbdf9-19be-4a18-9159-a6a200a087b1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e5fbbdf9-19be-4a18-9159-a6a200a087b1&#xA;Pipeline run with id=e5fbbdf9-19be-4a18-9159-a6a200a087b1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e5fbbdf9-19be-4a18-9159-a6a200a087b1&#xA;Pipeline run with id=e5fbbdf9-19be-4a18-9159-a6a200a087b1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e5fbbdf9-19be-4a18-9159-a6a200a087b1&#xA;Pipeline run with id=e5fbbdf9-19be-4a18-9159-a6a200a087b1 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;essential/component_with_pip_index_urls.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=e5fbbdf9-19be-4a18-9159-a6a200a087b1&#xA;Get a pipeline run with id=e5fbbdf9-19be-4a18-9159-a6a200a087b1&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 09/09/26 07:18:24.669 (1m10.584s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 09/09/26 07:18:24.669&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run e5fbbdf9-19be-4a18-9159-a6a200a087b1&#xA;Failed to terminate run e5fbbdf9-19be-4a18-9159-a6a200a087b1&#xA;Terminate run e5fbbdf9-19be-4a18-9159-a6a200a087b1&#xA;Deleting run e5fbbdf9-19be-4a18-9159-a6a200a087b1&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=94c9137e-c556-438a-8294-505ee49576b3 (cascade=true)&#xA;Pipeline with id=94c9137e-c556-438a-8294-505ee49576b3, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 09/09/26 07:18:24.789 (120ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 09/09/26 07:18:24.789&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 09/09/26 07:18:24.789 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 09/09/26 07:18:24.789&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 09/09/26 07:18:24.789 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/pipeline_with_artifact_upload_download.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="131.101789452">
              <system-out>2026/09/09 07:19:24 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 09/09/26 07:17:13.758&#xA;Create an experiment with name E2EExperiment-1788938233758665228&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 09/09/26 07:17:13.946 (188ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 09/09/26 07:17:13.947&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x5d5a6514100&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 09/09/26 07:17:14.083 (137ms)&#xA;&gt; Enter [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 09/09/26 07:17:14.084&#xA;Uploading pipeline file critical/pipeline_with_artifact_upload_download.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1788938233947133683, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml&#xA;Upload of pipeline file &#39;critical/pipeline_with_artifact_upload_download.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 277aec56-79d4-499d-b961-c5e9ced40b37&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;277aec56-79d4-499d-b961-c5e9ced40b37&#39; and name: &#39;e2e-test-1788938233947133683&#39;&#xA;Create a pipeline run for pipeline with id=277aec56-79d4-499d-b961-c5e9ced40b37 and versionId=588a69f6-5102-4658-a1a0-f1a31b7067a2&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=dfbe057b-5ecc-4198-a0c9-5a8ea62d1368&#xA;Created Pipeline Run with id: dfbe057b-5ecc-4198-a0c9-5a8ea62d1368 for pipeline with id: 277aec56-79d4-499d-b961-c5e9ced40b37&#xA;Waiting for pipeline run with id=dfbe057b-5ecc-4198-a0c9-5a8ea62d1368 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=dfbe057b-5ecc-4198-a0c9-5a8ea62d1368&#xA;Pipeline run with id=dfbe057b-5ecc-4198-a0c9-5a8ea62d1368 is in PENDING state, waiting...&#xA;Get a pipeline run with id=dfbe057b-5ecc-4198-a0c9-5a8ea62d1368&#xA;Pipeline run with id=dfbe057b-5ecc-4198-a0c9-5a8ea62d1368 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=dfbe057b-5ecc-4198-a0c9-5a8ea62d1368&#xA;Pipeline run with id=dfbe057b-5ecc-4198-a0c9-5a8ea62d1368 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=dfbe057b-5ecc-4198-a0c9-5a8ea62d1368&#xA;Pipeline run with id=dfbe057b-5ecc-4198-a0c9-5a8ea62d1368 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=dfbe057b-5ecc-4198-a0c9-5a8ea62d1368&#xA;Pipeline run with id=dfbe057b-5ecc-4198-a0c9-5a8ea62d1368 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=dfbe057b-5ecc-4198-a0c9-5a8ea62d1368&#xA;Pipeline run with id=dfbe057b-5ecc-4198-a0c9-5a8ea62d1368 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=dfbe057b-5ecc-4198-a0c9-5a8ea62d1368&#xA;Pipeline run with id=dfbe057b-5ecc-4198-a0c9-5a8ea62d1368 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=dfbe057b-5ecc-4198-a0c9-5a8ea62d1368&#xA;Pipeline run with id=dfbe057b-5ecc-4198-a0c9-5a8ea62d1368 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=dfbe057b-5ecc-4198-a0c9-5a8ea62d1368&#xA;Pipeline run with id=dfbe057b-5ecc-4198-a0c9-5a8ea62d1368 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=dfbe057b-5ecc-4198-a0c9-5a8ea62d1368&#xA;Pipeline run with id=dfbe057b-5ecc-4198-a0c9-5a8ea62d1368 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=dfbe057b-5ecc-4198-a0c9-5a8ea62d1368&#xA;Pipeline run with id=dfbe057b-5ecc-4198-a0c9-5a8ea62d1368 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=dfbe057b-5ecc-4198-a0c9-5a8ea62d1368&#xA;Pipeline run with id=dfbe057b-5ecc-4198-a0c9-5a8ea62d1368 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=dfbe057b-5ecc-4198-a0c9-5a8ea62d1368&#xA;Pipeline run with id=dfbe057b-5ecc-4198-a0c9-5a8ea62d1368 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=dfbe057b-5ecc-4198-a0c9-5a8ea62d1368&#xA;Pipeline run with id=dfbe057b-5ecc-4198-a0c9-5a8ea62d1368 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=dfbe057b-5ecc-4198-a0c9-5a8ea62d1368&#xA;Pipeline run with id=dfbe057b-5ecc-4198-a0c9-5a8ea62d1368 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=dfbe057b-5ecc-4198-a0c9-5a8ea62d1368&#xA;Pipeline run with id=dfbe057b-5ecc-4198-a0c9-5a8ea62d1368 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=dfbe057b-5ecc-4198-a0c9-5a8ea62d1368&#xA;Pipeline run with id=dfbe057b-5ecc-4198-a0c9-5a8ea62d1368 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=dfbe057b-5ecc-4198-a0c9-5a8ea62d1368&#xA;Pipeline run with id=dfbe057b-5ecc-4198-a0c9-5a8ea62d1368 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=dfbe057b-5ecc-4198-a0c9-5a8ea62d1368&#xA;Pipeline run with id=dfbe057b-5ecc-4198-a0c9-5a8ea62d1368 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=dfbe057b-5ecc-4198-a0c9-5a8ea62d1368&#xA;Pipeline run with id=dfbe057b-5ecc-4198-a0c9-5a8ea62d1368 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=dfbe057b-5ecc-4198-a0c9-5a8ea62d1368&#xA;Pipeline run with id=dfbe057b-5ecc-4198-a0c9-5a8ea62d1368 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=dfbe057b-5ecc-4198-a0c9-5a8ea62d1368&#xA;Pipeline run with id=dfbe057b-5ecc-4198-a0c9-5a8ea62d1368 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=dfbe057b-5ecc-4198-a0c9-5a8ea62d1368&#xA;Pipeline run with id=dfbe057b-5ecc-4198-a0c9-5a8ea62d1368 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=dfbe057b-5ecc-4198-a0c9-5a8ea62d1368&#xA;Pipeline run with id=dfbe057b-5ecc-4198-a0c9-5a8ea62d1368 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=dfbe057b-5ecc-4198-a0c9-5a8ea62d1368&#xA;Pipeline run with id=dfbe057b-5ecc-4198-a0c9-5a8ea62d1368 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=dfbe057b-5ecc-4198-a0c9-5a8ea62d1368&#xA;Pipeline run with id=dfbe057b-5ecc-4198-a0c9-5a8ea62d1368 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=dfbe057b-5ecc-4198-a0c9-5a8ea62d1368&#xA;Pipeline run with id=dfbe057b-5ecc-4198-a0c9-5a8ea62d1368 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/pipeline_with_artifact_upload_download.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=dfbe057b-5ecc-4198-a0c9-5a8ea62d1368&#xA;Get a pipeline run with id=dfbe057b-5ecc-4198-a0c9-5a8ea62d1368&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 09/09/26 07:19:24.672 (2m10.589s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 09/09/26 07:19:24.672&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run dfbe057b-5ecc-4198-a0c9-5a8ea62d1368&#xA;Failed to terminate run dfbe057b-5ecc-4198-a0c9-5a8ea62d1368&#xA;Terminate run dfbe057b-5ecc-4198-a0c9-5a8ea62d1368&#xA;Deleting run dfbe057b-5ecc-4198-a0c9-5a8ea62d1368&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=277aec56-79d4-499d-b961-c5e9ced40b37 (cascade=true)&#xA;Pipeline with id=277aec56-79d4-499d-b961-c5e9ced40b37, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 09/09/26 07:19:24.86 (187ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 09/09/26 07:19:24.86&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 09/09/26 07:19:24.86 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 09/09/26 07:19:24.861&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 09/09/26 07:19:24.861 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/flip_coin.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="161.050673129">
              <system-out>2026/09/09 07:19:54 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 09/09/26 07:17:13.741&#xA;Create an experiment with name E2EExperiment-1788938233742011940&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 09/09/26 07:17:13.941 (199ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 09/09/26 07:17:13.941&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x346472476d80&#xA;test-secret-1 created&#xA;test-secret-2 created&#xA;test-secret-3 created&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 09/09/26 07:17:14.041 (100ms)&#xA;&gt; Enter [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 09/09/26 07:17:14.042&#xA;Uploading pipeline file critical/flip_coin.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1788938233941469808, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml&#xA;Upload of pipeline file &#39;critical/flip_coin.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 9e6d91db-f1c6-4808-b522-1bc105d5c1c3&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;9e6d91db-f1c6-4808-b522-1bc105d5c1c3&#39; and name: &#39;e2e-test-1788938233941469808&#39;&#xA;Create a pipeline run for pipeline with id=9e6d91db-f1c6-4808-b522-1bc105d5c1c3 and versionId=5fc18a45-4af7-431e-bb18-f17a6c4699d8&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=6dac8602-13cf-423d-8039-6db44336e767&#xA;Created Pipeline Run with id: 6dac8602-13cf-423d-8039-6db44336e767 for pipeline with id: 9e6d91db-f1c6-4808-b522-1bc105d5c1c3&#xA;Waiting for pipeline run with id=6dac8602-13cf-423d-8039-6db44336e767 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=6dac8602-13cf-423d-8039-6db44336e767&#xA;Pipeline run with id=6dac8602-13cf-423d-8039-6db44336e767 is in PENDING state, waiting...&#xA;Get a pipeline run with id=6dac8602-13cf-423d-8039-6db44336e767&#xA;Pipeline run with id=6dac8602-13cf-423d-8039-6db44336e767 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6dac8602-13cf-423d-8039-6db44336e767&#xA;Pipeline run with id=6dac8602-13cf-423d-8039-6db44336e767 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6dac8602-13cf-423d-8039-6db44336e767&#xA;Pipeline run with id=6dac8602-13cf-423d-8039-6db44336e767 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6dac8602-13cf-423d-8039-6db44336e767&#xA;Pipeline run with id=6dac8602-13cf-423d-8039-6db44336e767 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6dac8602-13cf-423d-8039-6db44336e767&#xA;Pipeline run with id=6dac8602-13cf-423d-8039-6db44336e767 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6dac8602-13cf-423d-8039-6db44336e767&#xA;Pipeline run with id=6dac8602-13cf-423d-8039-6db44336e767 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6dac8602-13cf-423d-8039-6db44336e767&#xA;Pipeline run with id=6dac8602-13cf-423d-8039-6db44336e767 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6dac8602-13cf-423d-8039-6db44336e767&#xA;Pipeline run with id=6dac8602-13cf-423d-8039-6db44336e767 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6dac8602-13cf-423d-8039-6db44336e767&#xA;Pipeline run with id=6dac8602-13cf-423d-8039-6db44336e767 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6dac8602-13cf-423d-8039-6db44336e767&#xA;Pipeline run with id=6dac8602-13cf-423d-8039-6db44336e767 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6dac8602-13cf-423d-8039-6db44336e767&#xA;Pipeline run with id=6dac8602-13cf-423d-8039-6db44336e767 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6dac8602-13cf-423d-8039-6db44336e767&#xA;Pipeline run with id=6dac8602-13cf-423d-8039-6db44336e767 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6dac8602-13cf-423d-8039-6db44336e767&#xA;Pipeline run with id=6dac8602-13cf-423d-8039-6db44336e767 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6dac8602-13cf-423d-8039-6db44336e767&#xA;Pipeline run with id=6dac8602-13cf-423d-8039-6db44336e767 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6dac8602-13cf-423d-8039-6db44336e767&#xA;Pipeline run with id=6dac8602-13cf-423d-8039-6db44336e767 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6dac8602-13cf-423d-8039-6db44336e767&#xA;Pipeline run with id=6dac8602-13cf-423d-8039-6db44336e767 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6dac8602-13cf-423d-8039-6db44336e767&#xA;Pipeline run with id=6dac8602-13cf-423d-8039-6db44336e767 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6dac8602-13cf-423d-8039-6db44336e767&#xA;Pipeline run with id=6dac8602-13cf-423d-8039-6db44336e767 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6dac8602-13cf-423d-8039-6db44336e767&#xA;Pipeline run with id=6dac8602-13cf-423d-8039-6db44336e767 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6dac8602-13cf-423d-8039-6db44336e767&#xA;Pipeline run with id=6dac8602-13cf-423d-8039-6db44336e767 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6dac8602-13cf-423d-8039-6db44336e767&#xA;Pipeline run with id=6dac8602-13cf-423d-8039-6db44336e767 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6dac8602-13cf-423d-8039-6db44336e767&#xA;Pipeline run with id=6dac8602-13cf-423d-8039-6db44336e767 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6dac8602-13cf-423d-8039-6db44336e767&#xA;Pipeline run with id=6dac8602-13cf-423d-8039-6db44336e767 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6dac8602-13cf-423d-8039-6db44336e767&#xA;Pipeline run with id=6dac8602-13cf-423d-8039-6db44336e767 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6dac8602-13cf-423d-8039-6db44336e767&#xA;Pipeline run with id=6dac8602-13cf-423d-8039-6db44336e767 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6dac8602-13cf-423d-8039-6db44336e767&#xA;Pipeline run with id=6dac8602-13cf-423d-8039-6db44336e767 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6dac8602-13cf-423d-8039-6db44336e767&#xA;Pipeline run with id=6dac8602-13cf-423d-8039-6db44336e767 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6dac8602-13cf-423d-8039-6db44336e767&#xA;Pipeline run with id=6dac8602-13cf-423d-8039-6db44336e767 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6dac8602-13cf-423d-8039-6db44336e767&#xA;Pipeline run with id=6dac8602-13cf-423d-8039-6db44336e767 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6dac8602-13cf-423d-8039-6db44336e767&#xA;Pipeline run with id=6dac8602-13cf-423d-8039-6db44336e767 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6dac8602-13cf-423d-8039-6db44336e767&#xA;Pipeline run with id=6dac8602-13cf-423d-8039-6db44336e767 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=6dac8602-13cf-423d-8039-6db44336e767&#xA;Pipeline run with id=6dac8602-13cf-423d-8039-6db44336e767 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/flip_coin.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=6dac8602-13cf-423d-8039-6db44336e767&#xA;Get a pipeline run with id=6dac8602-13cf-423d-8039-6db44336e767&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 09/09/26 07:19:54.683 (2m40.642s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 09/09/26 07:19:54.683&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 6dac8602-13cf-423d-8039-6db44336e767&#xA;Failed to terminate run 6dac8602-13cf-423d-8039-6db44336e767&#xA;Terminate run 6dac8602-13cf-423d-8039-6db44336e767&#xA;Deleting run 6dac8602-13cf-423d-8039-6db44336e767&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=9e6d91db-f1c6-4808-b522-1bc105d5c1c3 (cascade=true)&#xA;Pipeline with id=9e6d91db-f1c6-4808-b522-1bc105d5c1c3, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 09/09/26 07:19:54.792 (109ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 09/09/26 07:19:54.793&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 09/09/26 07:19:54.793 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 09/09/26 07:19:54.793&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 09/09/26 07:19:54.793 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload essential/iris_pipeline_compiled.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="196.010708858">
              <system-out>2026/09/09 07:20:29 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 09/09/26 07:17:13.763&#xA;Create an experiment with name E2EExperiment-1788938233763698508&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 09/09/26 07:17:13.946 (183ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 09/09/26 07:17:13.946&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x1072f0e8a800&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 09/09/26 07:17:14.086 (140ms)&#xA;&gt; Enter [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 09/09/26 07:17:14.086&#xA;Uploading pipeline file essential/iris_pipeline_compiled.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1788938233946939418, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml&#xA;Upload of pipeline file &#39;essential/iris_pipeline_compiled.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 6f63cf9b-7fee-4e72-88c5-178e6f09c576&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;6f63cf9b-7fee-4e72-88c5-178e6f09c576&#39; and name: &#39;e2e-test-1788938233946939418&#39;&#xA;Create a pipeline run for pipeline with id=6f63cf9b-7fee-4e72-88c5-178e6f09c576 and versionId=6e07813b-d50a-4b1c-b65f-4a1942dd8b88&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=d6d1d6d0-6093-4f3f-95cc-2fec37f98b59&#xA;Created Pipeline Run with id: d6d1d6d0-6093-4f3f-95cc-2fec37f98b59 for pipeline with id: 6f63cf9b-7fee-4e72-88c5-178e6f09c576&#xA;Waiting for pipeline run with id=d6d1d6d0-6093-4f3f-95cc-2fec37f98b59 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=d6d1d6d0-6093-4f3f-95cc-2fec37f98b59&#xA;Pipeline run with id=d6d1d6d0-6093-4f3f-95cc-2fec37f98b59 is in PENDING state, waiting...&#xA;Get a pipeline run with id=d6d1d6d0-6093-4f3f-95cc-2fec37f98b59&#xA;Pipeline run with id=d6d1d6d0-6093-4f3f-95cc-2fec37f98b59 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d6d1d6d0-6093-4f3f-95cc-2fec37f98b59&#xA;Pipeline run with id=d6d1d6d0-6093-4f3f-95cc-2fec37f98b59 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d6d1d6d0-6093-4f3f-95cc-2fec37f98b59&#xA;Pipeline run with id=d6d1d6d0-6093-4f3f-95cc-2fec37f98b59 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d6d1d6d0-6093-4f3f-95cc-2fec37f98b59&#xA;Pipeline run with id=d6d1d6d0-6093-4f3f-95cc-2fec37f98b59 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d6d1d6d0-6093-4f3f-95cc-2fec37f98b59&#xA;Pipeline run with id=d6d1d6d0-6093-4f3f-95cc-2fec37f98b59 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d6d1d6d0-6093-4f3f-95cc-2fec37f98b59&#xA;Pipeline run with id=d6d1d6d0-6093-4f3f-95cc-2fec37f98b59 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d6d1d6d0-6093-4f3f-95cc-2fec37f98b59&#xA;Pipeline run with id=d6d1d6d0-6093-4f3f-95cc-2fec37f98b59 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d6d1d6d0-6093-4f3f-95cc-2fec37f98b59&#xA;Pipeline run with id=d6d1d6d0-6093-4f3f-95cc-2fec37f98b59 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d6d1d6d0-6093-4f3f-95cc-2fec37f98b59&#xA;Pipeline run with id=d6d1d6d0-6093-4f3f-95cc-2fec37f98b59 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d6d1d6d0-6093-4f3f-95cc-2fec37f98b59&#xA;Pipeline run with id=d6d1d6d0-6093-4f3f-95cc-2fec37f98b59 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d6d1d6d0-6093-4f3f-95cc-2fec37f98b59&#xA;Pipeline run with id=d6d1d6d0-6093-4f3f-95cc-2fec37f98b59 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d6d1d6d0-6093-4f3f-95cc-2fec37f98b59&#xA;Pipeline run with id=d6d1d6d0-6093-4f3f-95cc-2fec37f98b59 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d6d1d6d0-6093-4f3f-95cc-2fec37f98b59&#xA;Pipeline run with id=d6d1d6d0-6093-4f3f-95cc-2fec37f98b59 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d6d1d6d0-6093-4f3f-95cc-2fec37f98b59&#xA;Pipeline run with id=d6d1d6d0-6093-4f3f-95cc-2fec37f98b59 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d6d1d6d0-6093-4f3f-95cc-2fec37f98b59&#xA;Pipeline run with id=d6d1d6d0-6093-4f3f-95cc-2fec37f98b59 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d6d1d6d0-6093-4f3f-95cc-2fec37f98b59&#xA;Pipeline run with id=d6d1d6d0-6093-4f3f-95cc-2fec37f98b59 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d6d1d6d0-6093-4f3f-95cc-2fec37f98b59&#xA;Pipeline run with id=d6d1d6d0-6093-4f3f-95cc-2fec37f98b59 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d6d1d6d0-6093-4f3f-95cc-2fec37f98b59&#xA;Pipeline run with id=d6d1d6d0-6093-4f3f-95cc-2fec37f98b59 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d6d1d6d0-6093-4f3f-95cc-2fec37f98b59&#xA;Pipeline run with id=d6d1d6d0-6093-4f3f-95cc-2fec37f98b59 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d6d1d6d0-6093-4f3f-95cc-2fec37f98b59&#xA;Pipeline run with id=d6d1d6d0-6093-4f3f-95cc-2fec37f98b59 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d6d1d6d0-6093-4f3f-95cc-2fec37f98b59&#xA;Pipeline run with id=d6d1d6d0-6093-4f3f-95cc-2fec37f98b59 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d6d1d6d0-6093-4f3f-95cc-2fec37f98b59&#xA;Pipeline run with id=d6d1d6d0-6093-4f3f-95cc-2fec37f98b59 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d6d1d6d0-6093-4f3f-95cc-2fec37f98b59&#xA;Pipeline run with id=d6d1d6d0-6093-4f3f-95cc-2fec37f98b59 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d6d1d6d0-6093-4f3f-95cc-2fec37f98b59&#xA;Pipeline run with id=d6d1d6d0-6093-4f3f-95cc-2fec37f98b59 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d6d1d6d0-6093-4f3f-95cc-2fec37f98b59&#xA;Pipeline run with id=d6d1d6d0-6093-4f3f-95cc-2fec37f98b59 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d6d1d6d0-6093-4f3f-95cc-2fec37f98b59&#xA;Pipeline run with id=d6d1d6d0-6093-4f3f-95cc-2fec37f98b59 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d6d1d6d0-6093-4f3f-95cc-2fec37f98b59&#xA;Pipeline run with id=d6d1d6d0-6093-4f3f-95cc-2fec37f98b59 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d6d1d6d0-6093-4f3f-95cc-2fec37f98b59&#xA;Pipeline run with id=d6d1d6d0-6093-4f3f-95cc-2fec37f98b59 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d6d1d6d0-6093-4f3f-95cc-2fec37f98b59&#xA;Pipeline run with id=d6d1d6d0-6093-4f3f-95cc-2fec37f98b59 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d6d1d6d0-6093-4f3f-95cc-2fec37f98b59&#xA;Pipeline run with id=d6d1d6d0-6093-4f3f-95cc-2fec37f98b59 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d6d1d6d0-6093-4f3f-95cc-2fec37f98b59&#xA;Pipeline run with id=d6d1d6d0-6093-4f3f-95cc-2fec37f98b59 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d6d1d6d0-6093-4f3f-95cc-2fec37f98b59&#xA;Pipeline run with id=d6d1d6d0-6093-4f3f-95cc-2fec37f98b59 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d6d1d6d0-6093-4f3f-95cc-2fec37f98b59&#xA;Pipeline run with id=d6d1d6d0-6093-4f3f-95cc-2fec37f98b59 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d6d1d6d0-6093-4f3f-95cc-2fec37f98b59&#xA;Pipeline run with id=d6d1d6d0-6093-4f3f-95cc-2fec37f98b59 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d6d1d6d0-6093-4f3f-95cc-2fec37f98b59&#xA;Pipeline run with id=d6d1d6d0-6093-4f3f-95cc-2fec37f98b59 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d6d1d6d0-6093-4f3f-95cc-2fec37f98b59&#xA;Pipeline run with id=d6d1d6d0-6093-4f3f-95cc-2fec37f98b59 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d6d1d6d0-6093-4f3f-95cc-2fec37f98b59&#xA;Pipeline run with id=d6d1d6d0-6093-4f3f-95cc-2fec37f98b59 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d6d1d6d0-6093-4f3f-95cc-2fec37f98b59&#xA;Pipeline run with id=d6d1d6d0-6093-4f3f-95cc-2fec37f98b59 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d6d1d6d0-6093-4f3f-95cc-2fec37f98b59&#xA;Pipeline run with id=d6d1d6d0-6093-4f3f-95cc-2fec37f98b59 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;essential/iris_pipeline_compiled.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=d6d1d6d0-6093-4f3f-95cc-2fec37f98b59&#xA;Get a pipeline run with id=d6d1d6d0-6093-4f3f-95cc-2fec37f98b59&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 09/09/26 07:20:29.656 (3m15.57s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 09/09/26 07:20:29.656&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run d6d1d6d0-6093-4f3f-95cc-2fec37f98b59&#xA;Failed to terminate run d6d1d6d0-6093-4f3f-95cc-2fec37f98b59&#xA;Terminate run d6d1d6d0-6093-4f3f-95cc-2fec37f98b59&#xA;Deleting run d6d1d6d0-6093-4f3f-95cc-2fec37f98b59&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=6f63cf9b-7fee-4e72-88c5-178e6f09c576 (cascade=true)&#xA;Pipeline with id=6f63cf9b-7fee-4e72-88c5-178e6f09c576, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 09/09/26 07:20:29.774 (117ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 09/09/26 07:20:29.774&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 09/09/26 07:20:29.774 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 09/09/26 07:20:29.774&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 09/09/26 07:20:29.774 (0s)&#xA;</system-err>
          </testcase>
      </testsuite>
  </testsuites>