<?xml version="1.0" encoding="UTF-8"?>
  <testsuites tests="5" disabled="0" errors="0" failures="0" time="176.089282689">
      <testsuite name="AIPipelinesE2ETests" package="/dspa/backend/test/end2end" tests="5" disabled="0" skipped="0" errors="0" failures="0" time="176.089282689" timestamp="2026-09-06T17:46:05">
          <properties>
              <property name="SuiteSucceeded" value="true"></property>
              <property name="SuiteHasProgrammaticFocus" value="false"></property>
              <property name="SpecialSuiteFailureReason" value=""></property>
              <property name="SuiteLabels" value="[]"></property>
              <property name="SuiteSemVerConstraints" value="[]"></property>
              <property name="RandomSeed" value="1788716606"></property>
              <property name="RandomizeAllSpecs" value="false"></property>
              <property name="LabelFilter" value="Smoke"></property>
              <property name="SemVerFilter" value=""></property>
              <property name="FocusStrings" value=""></property>
              <property name="SkipStrings" value=""></property>
              <property name="FocusFiles" value=""></property>
              <property name="SkipFiles" value=""></property>
              <property name="FailOnPending" value="false"></property>
              <property name="FailOnEmpty" value="false"></property>
              <property name="FailFast" value="false"></property>
              <property name="FlakeAttempts" value="0"></property>
              <property name="DryRun" value="false"></property>
              <property name="ParallelTotal" value="10"></property>
              <property name="OutputInterceptorMode" value=""></property>
          </properties>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload essential/component_with_pip_index_urls.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="70.883007995">
              <system-out>2026/09/06 17:47:16 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 09/06/26 17:46:05.936&#xA;Create an experiment with name E2EExperiment-1788716765936209017&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 09/06/26 17:46:06.1 (164ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 09/06/26 17:46:06.1&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x11057f8cb00&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 09/06/26 17:46:06.249 (149ms)&#xA;&gt; Enter [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 09/06/26 17:46:06.25&#xA;Uploading pipeline file essential/component_with_pip_index_urls.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1788716766100839664, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml&#xA;Upload of pipeline file &#39;essential/component_with_pip_index_urls.yaml&#39; successful&#xA;Listing pipeline versions for pipeline cd2669ea-2621-44bd-b6e5-c3f12591f392&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;cd2669ea-2621-44bd-b6e5-c3f12591f392&#39; and name: &#39;e2e-test-1788716766100839664&#39;&#xA;Create a pipeline run for pipeline with id=cd2669ea-2621-44bd-b6e5-c3f12591f392 and versionId=49747bf4-77ea-42c5-afa1-5c836a710e2a&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=95c40d98-7c40-4255-8e12-3ef8a8b55351&#xA;Created Pipeline Run with id: 95c40d98-7c40-4255-8e12-3ef8a8b55351 for pipeline with id: cd2669ea-2621-44bd-b6e5-c3f12591f392&#xA;Waiting for pipeline run with id=95c40d98-7c40-4255-8e12-3ef8a8b55351 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=95c40d98-7c40-4255-8e12-3ef8a8b55351&#xA;Pipeline run with id=95c40d98-7c40-4255-8e12-3ef8a8b55351 is in PENDING state, waiting...&#xA;Get a pipeline run with id=95c40d98-7c40-4255-8e12-3ef8a8b55351&#xA;Pipeline run with id=95c40d98-7c40-4255-8e12-3ef8a8b55351 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=95c40d98-7c40-4255-8e12-3ef8a8b55351&#xA;Pipeline run with id=95c40d98-7c40-4255-8e12-3ef8a8b55351 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=95c40d98-7c40-4255-8e12-3ef8a8b55351&#xA;Pipeline run with id=95c40d98-7c40-4255-8e12-3ef8a8b55351 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=95c40d98-7c40-4255-8e12-3ef8a8b55351&#xA;Pipeline run with id=95c40d98-7c40-4255-8e12-3ef8a8b55351 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=95c40d98-7c40-4255-8e12-3ef8a8b55351&#xA;Pipeline run with id=95c40d98-7c40-4255-8e12-3ef8a8b55351 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=95c40d98-7c40-4255-8e12-3ef8a8b55351&#xA;Pipeline run with id=95c40d98-7c40-4255-8e12-3ef8a8b55351 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=95c40d98-7c40-4255-8e12-3ef8a8b55351&#xA;Pipeline run with id=95c40d98-7c40-4255-8e12-3ef8a8b55351 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=95c40d98-7c40-4255-8e12-3ef8a8b55351&#xA;Pipeline run with id=95c40d98-7c40-4255-8e12-3ef8a8b55351 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=95c40d98-7c40-4255-8e12-3ef8a8b55351&#xA;Pipeline run with id=95c40d98-7c40-4255-8e12-3ef8a8b55351 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=95c40d98-7c40-4255-8e12-3ef8a8b55351&#xA;Pipeline run with id=95c40d98-7c40-4255-8e12-3ef8a8b55351 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=95c40d98-7c40-4255-8e12-3ef8a8b55351&#xA;Pipeline run with id=95c40d98-7c40-4255-8e12-3ef8a8b55351 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=95c40d98-7c40-4255-8e12-3ef8a8b55351&#xA;Pipeline run with id=95c40d98-7c40-4255-8e12-3ef8a8b55351 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=95c40d98-7c40-4255-8e12-3ef8a8b55351&#xA;Pipeline run with id=95c40d98-7c40-4255-8e12-3ef8a8b55351 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=95c40d98-7c40-4255-8e12-3ef8a8b55351&#xA;Pipeline run with id=95c40d98-7c40-4255-8e12-3ef8a8b55351 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;essential/component_with_pip_index_urls.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=95c40d98-7c40-4255-8e12-3ef8a8b55351&#xA;Get a pipeline run with id=95c40d98-7c40-4255-8e12-3ef8a8b55351&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 09/06/26 17:47:16.691 (1m10.441s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 09/06/26 17:47:16.691&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 95c40d98-7c40-4255-8e12-3ef8a8b55351&#xA;Failed to terminate run 95c40d98-7c40-4255-8e12-3ef8a8b55351&#xA;Terminate run 95c40d98-7c40-4255-8e12-3ef8a8b55351&#xA;Deleting run 95c40d98-7c40-4255-8e12-3ef8a8b55351&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=cd2669ea-2621-44bd-b6e5-c3f12591f392 (cascade=true)&#xA;Pipeline with id=cd2669ea-2621-44bd-b6e5-c3f12591f392, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 09/06/26 17:47:16.819 (127ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 09/06/26 17:47:16.819&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 09/06/26 17:47:16.819 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 09/06/26 17:47:16.819&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 09/06/26 17:47:16.819 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/parallel_for_after_dependency.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="115.966309466">
              <system-out>2026/09/06 17:48:01 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 09/06/26 17:46:05.935&#xA;Create an experiment with name E2EExperiment-1788716765935966282&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 09/06/26 17:46:06.101 (166ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 09/06/26 17:46:06.102&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x137b86330e00&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 09/06/26 17:46:06.243 (141ms)&#xA;&gt; Enter [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 09/06/26 17:46:06.243&#xA;Uploading pipeline file critical/parallel_for_after_dependency.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1788716766102063027, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml&#xA;Upload of pipeline file &#39;critical/parallel_for_after_dependency.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 9bfc98ea-1cec-4476-b12e-6cdd0ae62724&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;9bfc98ea-1cec-4476-b12e-6cdd0ae62724&#39; and name: &#39;e2e-test-1788716766102063027&#39;&#xA;Create a pipeline run for pipeline with id=9bfc98ea-1cec-4476-b12e-6cdd0ae62724 and versionId=806b0104-5673-4d2b-82cd-a9ff72e9b18d&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=4cdedfa6-a465-44a2-809e-bbad429aaabd&#xA;Created Pipeline Run with id: 4cdedfa6-a465-44a2-809e-bbad429aaabd for pipeline with id: 9bfc98ea-1cec-4476-b12e-6cdd0ae62724&#xA;Waiting for pipeline run with id=4cdedfa6-a465-44a2-809e-bbad429aaabd to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=4cdedfa6-a465-44a2-809e-bbad429aaabd&#xA;Pipeline run with id=4cdedfa6-a465-44a2-809e-bbad429aaabd is in PENDING state, waiting...&#xA;Get a pipeline run with id=4cdedfa6-a465-44a2-809e-bbad429aaabd&#xA;Pipeline run with id=4cdedfa6-a465-44a2-809e-bbad429aaabd is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4cdedfa6-a465-44a2-809e-bbad429aaabd&#xA;Pipeline run with id=4cdedfa6-a465-44a2-809e-bbad429aaabd is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4cdedfa6-a465-44a2-809e-bbad429aaabd&#xA;Pipeline run with id=4cdedfa6-a465-44a2-809e-bbad429aaabd is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4cdedfa6-a465-44a2-809e-bbad429aaabd&#xA;Pipeline run with id=4cdedfa6-a465-44a2-809e-bbad429aaabd is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4cdedfa6-a465-44a2-809e-bbad429aaabd&#xA;Pipeline run with id=4cdedfa6-a465-44a2-809e-bbad429aaabd is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4cdedfa6-a465-44a2-809e-bbad429aaabd&#xA;Pipeline run with id=4cdedfa6-a465-44a2-809e-bbad429aaabd is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4cdedfa6-a465-44a2-809e-bbad429aaabd&#xA;Pipeline run with id=4cdedfa6-a465-44a2-809e-bbad429aaabd is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4cdedfa6-a465-44a2-809e-bbad429aaabd&#xA;Pipeline run with id=4cdedfa6-a465-44a2-809e-bbad429aaabd is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4cdedfa6-a465-44a2-809e-bbad429aaabd&#xA;Pipeline run with id=4cdedfa6-a465-44a2-809e-bbad429aaabd is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4cdedfa6-a465-44a2-809e-bbad429aaabd&#xA;Pipeline run with id=4cdedfa6-a465-44a2-809e-bbad429aaabd is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4cdedfa6-a465-44a2-809e-bbad429aaabd&#xA;Pipeline run with id=4cdedfa6-a465-44a2-809e-bbad429aaabd is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4cdedfa6-a465-44a2-809e-bbad429aaabd&#xA;Pipeline run with id=4cdedfa6-a465-44a2-809e-bbad429aaabd is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4cdedfa6-a465-44a2-809e-bbad429aaabd&#xA;Pipeline run with id=4cdedfa6-a465-44a2-809e-bbad429aaabd is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4cdedfa6-a465-44a2-809e-bbad429aaabd&#xA;Pipeline run with id=4cdedfa6-a465-44a2-809e-bbad429aaabd is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4cdedfa6-a465-44a2-809e-bbad429aaabd&#xA;Pipeline run with id=4cdedfa6-a465-44a2-809e-bbad429aaabd is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4cdedfa6-a465-44a2-809e-bbad429aaabd&#xA;Pipeline run with id=4cdedfa6-a465-44a2-809e-bbad429aaabd is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4cdedfa6-a465-44a2-809e-bbad429aaabd&#xA;Pipeline run with id=4cdedfa6-a465-44a2-809e-bbad429aaabd is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4cdedfa6-a465-44a2-809e-bbad429aaabd&#xA;Pipeline run with id=4cdedfa6-a465-44a2-809e-bbad429aaabd is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4cdedfa6-a465-44a2-809e-bbad429aaabd&#xA;Pipeline run with id=4cdedfa6-a465-44a2-809e-bbad429aaabd is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4cdedfa6-a465-44a2-809e-bbad429aaabd&#xA;Pipeline run with id=4cdedfa6-a465-44a2-809e-bbad429aaabd is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4cdedfa6-a465-44a2-809e-bbad429aaabd&#xA;Pipeline run with id=4cdedfa6-a465-44a2-809e-bbad429aaabd is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4cdedfa6-a465-44a2-809e-bbad429aaabd&#xA;Pipeline run with id=4cdedfa6-a465-44a2-809e-bbad429aaabd is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4cdedfa6-a465-44a2-809e-bbad429aaabd&#xA;Pipeline run with id=4cdedfa6-a465-44a2-809e-bbad429aaabd reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/parallel_for_after_dependency.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=4cdedfa6-a465-44a2-809e-bbad429aaabd&#xA;Get a pipeline run with id=4cdedfa6-a465-44a2-809e-bbad429aaabd&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 09/06/26 17:48:01.722 (1m55.479s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 09/06/26 17:48:01.722&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 4cdedfa6-a465-44a2-809e-bbad429aaabd&#xA;Failed to terminate run 4cdedfa6-a465-44a2-809e-bbad429aaabd&#xA;Terminate run 4cdedfa6-a465-44a2-809e-bbad429aaabd&#xA;Deleting run 4cdedfa6-a465-44a2-809e-bbad429aaabd&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=9bfc98ea-1cec-4476-b12e-6cdd0ae62724 (cascade=true)&#xA;Pipeline with id=9bfc98ea-1cec-4476-b12e-6cdd0ae62724, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 09/06/26 17:48:01.902 (179ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 09/06/26 17:48:01.902&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 09/06/26 17:48:01.902 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 09/06/26 17:48:01.902&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 09/06/26 17:48:01.902 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/pipeline_with_artifact_upload_download.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="115.970929225">
              <system-out>2026/09/06 17:48:01 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 09/06/26 17:46:05.936&#xA;Create an experiment with name E2EExperiment-1788716765936164456&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 09/06/26 17:46:06.095 (160ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 09/06/26 17:46:06.095&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x1b681c68c880&#xA;test-secret-1 created&#xA;test-secret-2 created&#xA;test-secret-3 created&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 09/06/26 17:46:06.201 (105ms)&#xA;&gt; Enter [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 09/06/26 17:46:06.201&#xA;Uploading pipeline file critical/pipeline_with_artifact_upload_download.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1788716766096035603, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml&#xA;Upload of pipeline file &#39;critical/pipeline_with_artifact_upload_download.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 2a248923-702d-4a94-8417-55fdfd9b845b&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;2a248923-702d-4a94-8417-55fdfd9b845b&#39; and name: &#39;e2e-test-1788716766096035603&#39;&#xA;Create a pipeline run for pipeline with id=2a248923-702d-4a94-8417-55fdfd9b845b and versionId=3f42c205-c933-4477-bb2a-a36aac5c698f&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=b6e496b9-9c8f-446d-8b10-6e85dc92f0ce&#xA;Created Pipeline Run with id: b6e496b9-9c8f-446d-8b10-6e85dc92f0ce for pipeline with id: 2a248923-702d-4a94-8417-55fdfd9b845b&#xA;Waiting for pipeline run with id=b6e496b9-9c8f-446d-8b10-6e85dc92f0ce to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=b6e496b9-9c8f-446d-8b10-6e85dc92f0ce&#xA;Pipeline run with id=b6e496b9-9c8f-446d-8b10-6e85dc92f0ce is in PENDING state, waiting...&#xA;Get a pipeline run with id=b6e496b9-9c8f-446d-8b10-6e85dc92f0ce&#xA;Pipeline run with id=b6e496b9-9c8f-446d-8b10-6e85dc92f0ce is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b6e496b9-9c8f-446d-8b10-6e85dc92f0ce&#xA;Pipeline run with id=b6e496b9-9c8f-446d-8b10-6e85dc92f0ce is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b6e496b9-9c8f-446d-8b10-6e85dc92f0ce&#xA;Pipeline run with id=b6e496b9-9c8f-446d-8b10-6e85dc92f0ce is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b6e496b9-9c8f-446d-8b10-6e85dc92f0ce&#xA;Pipeline run with id=b6e496b9-9c8f-446d-8b10-6e85dc92f0ce is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b6e496b9-9c8f-446d-8b10-6e85dc92f0ce&#xA;Pipeline run with id=b6e496b9-9c8f-446d-8b10-6e85dc92f0ce is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b6e496b9-9c8f-446d-8b10-6e85dc92f0ce&#xA;Pipeline run with id=b6e496b9-9c8f-446d-8b10-6e85dc92f0ce is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b6e496b9-9c8f-446d-8b10-6e85dc92f0ce&#xA;Pipeline run with id=b6e496b9-9c8f-446d-8b10-6e85dc92f0ce is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b6e496b9-9c8f-446d-8b10-6e85dc92f0ce&#xA;Pipeline run with id=b6e496b9-9c8f-446d-8b10-6e85dc92f0ce is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b6e496b9-9c8f-446d-8b10-6e85dc92f0ce&#xA;Pipeline run with id=b6e496b9-9c8f-446d-8b10-6e85dc92f0ce is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b6e496b9-9c8f-446d-8b10-6e85dc92f0ce&#xA;Pipeline run with id=b6e496b9-9c8f-446d-8b10-6e85dc92f0ce is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b6e496b9-9c8f-446d-8b10-6e85dc92f0ce&#xA;Pipeline run with id=b6e496b9-9c8f-446d-8b10-6e85dc92f0ce is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b6e496b9-9c8f-446d-8b10-6e85dc92f0ce&#xA;Pipeline run with id=b6e496b9-9c8f-446d-8b10-6e85dc92f0ce is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b6e496b9-9c8f-446d-8b10-6e85dc92f0ce&#xA;Pipeline run with id=b6e496b9-9c8f-446d-8b10-6e85dc92f0ce is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b6e496b9-9c8f-446d-8b10-6e85dc92f0ce&#xA;Pipeline run with id=b6e496b9-9c8f-446d-8b10-6e85dc92f0ce is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b6e496b9-9c8f-446d-8b10-6e85dc92f0ce&#xA;Pipeline run with id=b6e496b9-9c8f-446d-8b10-6e85dc92f0ce is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b6e496b9-9c8f-446d-8b10-6e85dc92f0ce&#xA;Pipeline run with id=b6e496b9-9c8f-446d-8b10-6e85dc92f0ce is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b6e496b9-9c8f-446d-8b10-6e85dc92f0ce&#xA;Pipeline run with id=b6e496b9-9c8f-446d-8b10-6e85dc92f0ce is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b6e496b9-9c8f-446d-8b10-6e85dc92f0ce&#xA;Pipeline run with id=b6e496b9-9c8f-446d-8b10-6e85dc92f0ce is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b6e496b9-9c8f-446d-8b10-6e85dc92f0ce&#xA;Pipeline run with id=b6e496b9-9c8f-446d-8b10-6e85dc92f0ce is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b6e496b9-9c8f-446d-8b10-6e85dc92f0ce&#xA;Pipeline run with id=b6e496b9-9c8f-446d-8b10-6e85dc92f0ce is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b6e496b9-9c8f-446d-8b10-6e85dc92f0ce&#xA;Pipeline run with id=b6e496b9-9c8f-446d-8b10-6e85dc92f0ce is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b6e496b9-9c8f-446d-8b10-6e85dc92f0ce&#xA;Pipeline run with id=b6e496b9-9c8f-446d-8b10-6e85dc92f0ce is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b6e496b9-9c8f-446d-8b10-6e85dc92f0ce&#xA;Pipeline run with id=b6e496b9-9c8f-446d-8b10-6e85dc92f0ce reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/pipeline_with_artifact_upload_download.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=b6e496b9-9c8f-446d-8b10-6e85dc92f0ce&#xA;Get a pipeline run with id=b6e496b9-9c8f-446d-8b10-6e85dc92f0ce&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 09/06/26 17:48:01.74 (1m55.539s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 09/06/26 17:48:01.74&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run b6e496b9-9c8f-446d-8b10-6e85dc92f0ce&#xA;Failed to terminate run b6e496b9-9c8f-446d-8b10-6e85dc92f0ce&#xA;Terminate run b6e496b9-9c8f-446d-8b10-6e85dc92f0ce&#xA;Deleting run b6e496b9-9c8f-446d-8b10-6e85dc92f0ce&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=2a248923-702d-4a94-8417-55fdfd9b845b (cascade=true)&#xA;Pipeline with id=2a248923-702d-4a94-8417-55fdfd9b845b, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 09/06/26 17:48:01.906 (166ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 09/06/26 17:48:01.907&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 09/06/26 17:48:01.907 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 09/06/26 17:48:01.907&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 09/06/26 17:48:01.907 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/flip_coin.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="155.94763234">
              <system-out>2026/09/06 17:48:41 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 09/06/26 17:46:05.935&#xA;Create an experiment with name E2EExperiment-1788716765935961792&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 09/06/26 17:46:06.101 (166ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 09/06/26 17:46:06.101&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0xb34afe18b80&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 09/06/26 17:46:06.249 (147ms)&#xA;&gt; Enter [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 09/06/26 17:46:06.249&#xA;Uploading pipeline file critical/flip_coin.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1788716766101936415, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml&#xA;Upload of pipeline file &#39;critical/flip_coin.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 62e4ee56-b403-4d0b-972b-7285f25eb0d3&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;62e4ee56-b403-4d0b-972b-7285f25eb0d3&#39; and name: &#39;e2e-test-1788716766101936415&#39;&#xA;Create a pipeline run for pipeline with id=62e4ee56-b403-4d0b-972b-7285f25eb0d3 and versionId=03dc5520-618d-4dc4-9370-984c2e4c0e8e&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=09acf7af-8d6e-4c9f-8ae8-4766e3962a0f&#xA;Created Pipeline Run with id: 09acf7af-8d6e-4c9f-8ae8-4766e3962a0f for pipeline with id: 62e4ee56-b403-4d0b-972b-7285f25eb0d3&#xA;Waiting for pipeline run with id=09acf7af-8d6e-4c9f-8ae8-4766e3962a0f to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=09acf7af-8d6e-4c9f-8ae8-4766e3962a0f&#xA;Pipeline run with id=09acf7af-8d6e-4c9f-8ae8-4766e3962a0f is in PENDING state, waiting...&#xA;Get a pipeline run with id=09acf7af-8d6e-4c9f-8ae8-4766e3962a0f&#xA;Pipeline run with id=09acf7af-8d6e-4c9f-8ae8-4766e3962a0f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=09acf7af-8d6e-4c9f-8ae8-4766e3962a0f&#xA;Pipeline run with id=09acf7af-8d6e-4c9f-8ae8-4766e3962a0f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=09acf7af-8d6e-4c9f-8ae8-4766e3962a0f&#xA;Pipeline run with id=09acf7af-8d6e-4c9f-8ae8-4766e3962a0f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=09acf7af-8d6e-4c9f-8ae8-4766e3962a0f&#xA;Pipeline run with id=09acf7af-8d6e-4c9f-8ae8-4766e3962a0f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=09acf7af-8d6e-4c9f-8ae8-4766e3962a0f&#xA;Pipeline run with id=09acf7af-8d6e-4c9f-8ae8-4766e3962a0f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=09acf7af-8d6e-4c9f-8ae8-4766e3962a0f&#xA;Pipeline run with id=09acf7af-8d6e-4c9f-8ae8-4766e3962a0f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=09acf7af-8d6e-4c9f-8ae8-4766e3962a0f&#xA;Pipeline run with id=09acf7af-8d6e-4c9f-8ae8-4766e3962a0f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=09acf7af-8d6e-4c9f-8ae8-4766e3962a0f&#xA;Pipeline run with id=09acf7af-8d6e-4c9f-8ae8-4766e3962a0f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=09acf7af-8d6e-4c9f-8ae8-4766e3962a0f&#xA;Pipeline run with id=09acf7af-8d6e-4c9f-8ae8-4766e3962a0f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=09acf7af-8d6e-4c9f-8ae8-4766e3962a0f&#xA;Pipeline run with id=09acf7af-8d6e-4c9f-8ae8-4766e3962a0f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=09acf7af-8d6e-4c9f-8ae8-4766e3962a0f&#xA;Pipeline run with id=09acf7af-8d6e-4c9f-8ae8-4766e3962a0f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=09acf7af-8d6e-4c9f-8ae8-4766e3962a0f&#xA;Pipeline run with id=09acf7af-8d6e-4c9f-8ae8-4766e3962a0f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=09acf7af-8d6e-4c9f-8ae8-4766e3962a0f&#xA;Pipeline run with id=09acf7af-8d6e-4c9f-8ae8-4766e3962a0f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=09acf7af-8d6e-4c9f-8ae8-4766e3962a0f&#xA;Pipeline run with id=09acf7af-8d6e-4c9f-8ae8-4766e3962a0f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=09acf7af-8d6e-4c9f-8ae8-4766e3962a0f&#xA;Pipeline run with id=09acf7af-8d6e-4c9f-8ae8-4766e3962a0f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=09acf7af-8d6e-4c9f-8ae8-4766e3962a0f&#xA;Pipeline run with id=09acf7af-8d6e-4c9f-8ae8-4766e3962a0f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=09acf7af-8d6e-4c9f-8ae8-4766e3962a0f&#xA;Pipeline run with id=09acf7af-8d6e-4c9f-8ae8-4766e3962a0f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=09acf7af-8d6e-4c9f-8ae8-4766e3962a0f&#xA;Pipeline run with id=09acf7af-8d6e-4c9f-8ae8-4766e3962a0f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=09acf7af-8d6e-4c9f-8ae8-4766e3962a0f&#xA;Pipeline run with id=09acf7af-8d6e-4c9f-8ae8-4766e3962a0f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=09acf7af-8d6e-4c9f-8ae8-4766e3962a0f&#xA;Pipeline run with id=09acf7af-8d6e-4c9f-8ae8-4766e3962a0f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=09acf7af-8d6e-4c9f-8ae8-4766e3962a0f&#xA;Pipeline run with id=09acf7af-8d6e-4c9f-8ae8-4766e3962a0f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=09acf7af-8d6e-4c9f-8ae8-4766e3962a0f&#xA;Pipeline run with id=09acf7af-8d6e-4c9f-8ae8-4766e3962a0f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=09acf7af-8d6e-4c9f-8ae8-4766e3962a0f&#xA;Pipeline run with id=09acf7af-8d6e-4c9f-8ae8-4766e3962a0f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=09acf7af-8d6e-4c9f-8ae8-4766e3962a0f&#xA;Pipeline run with id=09acf7af-8d6e-4c9f-8ae8-4766e3962a0f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=09acf7af-8d6e-4c9f-8ae8-4766e3962a0f&#xA;Pipeline run with id=09acf7af-8d6e-4c9f-8ae8-4766e3962a0f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=09acf7af-8d6e-4c9f-8ae8-4766e3962a0f&#xA;Pipeline run with id=09acf7af-8d6e-4c9f-8ae8-4766e3962a0f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=09acf7af-8d6e-4c9f-8ae8-4766e3962a0f&#xA;Pipeline run with id=09acf7af-8d6e-4c9f-8ae8-4766e3962a0f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=09acf7af-8d6e-4c9f-8ae8-4766e3962a0f&#xA;Pipeline run with id=09acf7af-8d6e-4c9f-8ae8-4766e3962a0f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=09acf7af-8d6e-4c9f-8ae8-4766e3962a0f&#xA;Pipeline run with id=09acf7af-8d6e-4c9f-8ae8-4766e3962a0f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=09acf7af-8d6e-4c9f-8ae8-4766e3962a0f&#xA;Pipeline run with id=09acf7af-8d6e-4c9f-8ae8-4766e3962a0f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=09acf7af-8d6e-4c9f-8ae8-4766e3962a0f&#xA;Pipeline run with id=09acf7af-8d6e-4c9f-8ae8-4766e3962a0f reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/flip_coin.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=09acf7af-8d6e-4c9f-8ae8-4766e3962a0f&#xA;Get a pipeline run with id=09acf7af-8d6e-4c9f-8ae8-4766e3962a0f&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 09/06/26 17:48:41.745 (2m35.496s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 09/06/26 17:48:41.746&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 09acf7af-8d6e-4c9f-8ae8-4766e3962a0f&#xA;Failed to terminate run 09acf7af-8d6e-4c9f-8ae8-4766e3962a0f&#xA;Terminate run 09acf7af-8d6e-4c9f-8ae8-4766e3962a0f&#xA;Deleting run 09acf7af-8d6e-4c9f-8ae8-4766e3962a0f&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=62e4ee56-b403-4d0b-972b-7285f25eb0d3 (cascade=true)&#xA;Pipeline with id=62e4ee56-b403-4d0b-972b-7285f25eb0d3, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 09/06/26 17:48:41.883 (137ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 09/06/26 17:48:41.883&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 09/06/26 17:48:41.883 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 09/06/26 17:48:41.883&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 09/06/26 17:48:41.884 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload essential/iris_pipeline_compiled.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="175.939098366">
              <system-out>2026/09/06 17:49:01 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 09/06/26 17:46:05.952&#xA;Create an experiment with name E2EExperiment-1788716765952770811&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 09/06/26 17:46:06.101 (149ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 09/06/26 17:46:06.102&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x1c2fddb14c80&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 09/06/26 17:46:06.24 (138ms)&#xA;&gt; Enter [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 09/06/26 17:46:06.24&#xA;Uploading pipeline file essential/iris_pipeline_compiled.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1788716766102070657, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml&#xA;Upload of pipeline file &#39;essential/iris_pipeline_compiled.yaml&#39; successful&#xA;Listing pipeline versions for pipeline ff3c18f6-3a33-4e1b-94e9-290faa6e75cd&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;ff3c18f6-3a33-4e1b-94e9-290faa6e75cd&#39; and name: &#39;e2e-test-1788716766102070657&#39;&#xA;Create a pipeline run for pipeline with id=ff3c18f6-3a33-4e1b-94e9-290faa6e75cd and versionId=8bbfae76-cc24-458b-8a18-bfedd64e65ce&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=8e67d8af-0e2e-4032-8a17-f2399bb617b0&#xA;Created Pipeline Run with id: 8e67d8af-0e2e-4032-8a17-f2399bb617b0 for pipeline with id: ff3c18f6-3a33-4e1b-94e9-290faa6e75cd&#xA;Waiting for pipeline run with id=8e67d8af-0e2e-4032-8a17-f2399bb617b0 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=8e67d8af-0e2e-4032-8a17-f2399bb617b0&#xA;Pipeline run with id=8e67d8af-0e2e-4032-8a17-f2399bb617b0 is in PENDING state, waiting...&#xA;Get a pipeline run with id=8e67d8af-0e2e-4032-8a17-f2399bb617b0&#xA;Pipeline run with id=8e67d8af-0e2e-4032-8a17-f2399bb617b0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8e67d8af-0e2e-4032-8a17-f2399bb617b0&#xA;Pipeline run with id=8e67d8af-0e2e-4032-8a17-f2399bb617b0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8e67d8af-0e2e-4032-8a17-f2399bb617b0&#xA;Pipeline run with id=8e67d8af-0e2e-4032-8a17-f2399bb617b0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8e67d8af-0e2e-4032-8a17-f2399bb617b0&#xA;Pipeline run with id=8e67d8af-0e2e-4032-8a17-f2399bb617b0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8e67d8af-0e2e-4032-8a17-f2399bb617b0&#xA;Pipeline run with id=8e67d8af-0e2e-4032-8a17-f2399bb617b0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8e67d8af-0e2e-4032-8a17-f2399bb617b0&#xA;Pipeline run with id=8e67d8af-0e2e-4032-8a17-f2399bb617b0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8e67d8af-0e2e-4032-8a17-f2399bb617b0&#xA;Pipeline run with id=8e67d8af-0e2e-4032-8a17-f2399bb617b0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8e67d8af-0e2e-4032-8a17-f2399bb617b0&#xA;Pipeline run with id=8e67d8af-0e2e-4032-8a17-f2399bb617b0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8e67d8af-0e2e-4032-8a17-f2399bb617b0&#xA;Pipeline run with id=8e67d8af-0e2e-4032-8a17-f2399bb617b0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8e67d8af-0e2e-4032-8a17-f2399bb617b0&#xA;Pipeline run with id=8e67d8af-0e2e-4032-8a17-f2399bb617b0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8e67d8af-0e2e-4032-8a17-f2399bb617b0&#xA;Pipeline run with id=8e67d8af-0e2e-4032-8a17-f2399bb617b0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8e67d8af-0e2e-4032-8a17-f2399bb617b0&#xA;Pipeline run with id=8e67d8af-0e2e-4032-8a17-f2399bb617b0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8e67d8af-0e2e-4032-8a17-f2399bb617b0&#xA;Pipeline run with id=8e67d8af-0e2e-4032-8a17-f2399bb617b0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8e67d8af-0e2e-4032-8a17-f2399bb617b0&#xA;Pipeline run with id=8e67d8af-0e2e-4032-8a17-f2399bb617b0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8e67d8af-0e2e-4032-8a17-f2399bb617b0&#xA;Pipeline run with id=8e67d8af-0e2e-4032-8a17-f2399bb617b0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8e67d8af-0e2e-4032-8a17-f2399bb617b0&#xA;Pipeline run with id=8e67d8af-0e2e-4032-8a17-f2399bb617b0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8e67d8af-0e2e-4032-8a17-f2399bb617b0&#xA;Pipeline run with id=8e67d8af-0e2e-4032-8a17-f2399bb617b0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8e67d8af-0e2e-4032-8a17-f2399bb617b0&#xA;Pipeline run with id=8e67d8af-0e2e-4032-8a17-f2399bb617b0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8e67d8af-0e2e-4032-8a17-f2399bb617b0&#xA;Pipeline run with id=8e67d8af-0e2e-4032-8a17-f2399bb617b0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8e67d8af-0e2e-4032-8a17-f2399bb617b0&#xA;Pipeline run with id=8e67d8af-0e2e-4032-8a17-f2399bb617b0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8e67d8af-0e2e-4032-8a17-f2399bb617b0&#xA;Pipeline run with id=8e67d8af-0e2e-4032-8a17-f2399bb617b0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8e67d8af-0e2e-4032-8a17-f2399bb617b0&#xA;Pipeline run with id=8e67d8af-0e2e-4032-8a17-f2399bb617b0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8e67d8af-0e2e-4032-8a17-f2399bb617b0&#xA;Pipeline run with id=8e67d8af-0e2e-4032-8a17-f2399bb617b0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8e67d8af-0e2e-4032-8a17-f2399bb617b0&#xA;Pipeline run with id=8e67d8af-0e2e-4032-8a17-f2399bb617b0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8e67d8af-0e2e-4032-8a17-f2399bb617b0&#xA;Pipeline run with id=8e67d8af-0e2e-4032-8a17-f2399bb617b0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8e67d8af-0e2e-4032-8a17-f2399bb617b0&#xA;Pipeline run with id=8e67d8af-0e2e-4032-8a17-f2399bb617b0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8e67d8af-0e2e-4032-8a17-f2399bb617b0&#xA;Pipeline run with id=8e67d8af-0e2e-4032-8a17-f2399bb617b0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8e67d8af-0e2e-4032-8a17-f2399bb617b0&#xA;Pipeline run with id=8e67d8af-0e2e-4032-8a17-f2399bb617b0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8e67d8af-0e2e-4032-8a17-f2399bb617b0&#xA;Pipeline run with id=8e67d8af-0e2e-4032-8a17-f2399bb617b0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8e67d8af-0e2e-4032-8a17-f2399bb617b0&#xA;Pipeline run with id=8e67d8af-0e2e-4032-8a17-f2399bb617b0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8e67d8af-0e2e-4032-8a17-f2399bb617b0&#xA;Pipeline run with id=8e67d8af-0e2e-4032-8a17-f2399bb617b0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8e67d8af-0e2e-4032-8a17-f2399bb617b0&#xA;Pipeline run with id=8e67d8af-0e2e-4032-8a17-f2399bb617b0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8e67d8af-0e2e-4032-8a17-f2399bb617b0&#xA;Pipeline run with id=8e67d8af-0e2e-4032-8a17-f2399bb617b0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8e67d8af-0e2e-4032-8a17-f2399bb617b0&#xA;Pipeline run with id=8e67d8af-0e2e-4032-8a17-f2399bb617b0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8e67d8af-0e2e-4032-8a17-f2399bb617b0&#xA;Pipeline run with id=8e67d8af-0e2e-4032-8a17-f2399bb617b0 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;essential/iris_pipeline_compiled.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=8e67d8af-0e2e-4032-8a17-f2399bb617b0&#xA;Get a pipeline run with id=8e67d8af-0e2e-4032-8a17-f2399bb617b0&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 09/06/26 17:49:01.731 (2m55.491s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 09/06/26 17:49:01.731&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 8e67d8af-0e2e-4032-8a17-f2399bb617b0&#xA;Failed to terminate run 8e67d8af-0e2e-4032-8a17-f2399bb617b0&#xA;Terminate run 8e67d8af-0e2e-4032-8a17-f2399bb617b0&#xA;Deleting run 8e67d8af-0e2e-4032-8a17-f2399bb617b0&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=ff3c18f6-3a33-4e1b-94e9-290faa6e75cd (cascade=true)&#xA;Pipeline with id=ff3c18f6-3a33-4e1b-94e9-290faa6e75cd, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 09/06/26 17:49:01.891 (160ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 09/06/26 17:49:01.892&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 09/06/26 17:49:01.892 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 09/06/26 17:49:01.892&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 09/06/26 17:49:01.892 (0s)&#xA;</system-err>
          </testcase>
      </testsuite>
  </testsuites>