<?xml version="1.0" encoding="UTF-8"?>
  <testsuites tests="5" disabled="0" errors="0" failures="0" time="175.925485797">
      <testsuite name="AIPipelinesE2ETests" package="/dspa/backend/test/end2end" tests="5" disabled="0" skipped="0" errors="0" failures="0" time="175.925485797" timestamp="2026-07-14T11:48:32">
          <properties>
              <property name="SuiteSucceeded" value="true"></property>
              <property name="SuiteHasProgrammaticFocus" value="false"></property>
              <property name="SpecialSuiteFailureReason" value=""></property>
              <property name="SuiteLabels" value="[]"></property>
              <property name="SuiteSemVerConstraints" value="[]"></property>
              <property name="RandomSeed" value="1784029542"></property>
              <property name="RandomizeAllSpecs" value="false"></property>
              <property name="LabelFilter" value="Smoke"></property>
              <property name="SemVerFilter" value=""></property>
              <property name="FocusStrings" value=""></property>
              <property name="SkipStrings" value=""></property>
              <property name="FocusFiles" value=""></property>
              <property name="SkipFiles" value=""></property>
              <property name="FailOnPending" value="false"></property>
              <property name="FailOnEmpty" value="false"></property>
              <property name="FailFast" value="false"></property>
              <property name="FlakeAttempts" value="0"></property>
              <property name="DryRun" value="false"></property>
              <property name="ParallelTotal" value="10"></property>
              <property name="OutputInterceptorMode" value=""></property>
          </properties>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload essential/component_with_pip_index_urls.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="75.794357353">
              <system-out>2026/07/14 11:49:48 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/14/26 11:48:32.251&#xA;Create an experiment with name E2EExperiment-1784029712251034421&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/14/26 11:48:32.462 (211ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/14/26 11:48:32.462&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x12f87152180&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/14/26 11:48:32.519 (57ms)&#xA;&gt; Enter [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/14/26 11:48:32.519&#xA;Uploading pipeline file essential/component_with_pip_index_urls.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1784029712462742506, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml&#xA;Upload of pipeline file &#39;essential/component_with_pip_index_urls.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 951ab504-9aa5-4abd-a863-1cb3c4ab47c3&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;951ab504-9aa5-4abd-a863-1cb3c4ab47c3&#39; and name: &#39;e2e-test-1784029712462742506&#39;&#xA;Create a pipeline run for pipeline with id=951ab504-9aa5-4abd-a863-1cb3c4ab47c3 and versionId=7d4d4413-97b6-41c5-af2e-866780d05b76&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=ab19aa0f-df8c-4dfa-be34-8b88ec44af91&#xA;Created Pipeline Run with id: ab19aa0f-df8c-4dfa-be34-8b88ec44af91 for pipeline with id: 951ab504-9aa5-4abd-a863-1cb3c4ab47c3&#xA;Waiting for pipeline run with id=ab19aa0f-df8c-4dfa-be34-8b88ec44af91 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=ab19aa0f-df8c-4dfa-be34-8b88ec44af91&#xA;Pipeline run with id=ab19aa0f-df8c-4dfa-be34-8b88ec44af91 is in PENDING state, waiting...&#xA;Get a pipeline run with id=ab19aa0f-df8c-4dfa-be34-8b88ec44af91&#xA;Pipeline run with id=ab19aa0f-df8c-4dfa-be34-8b88ec44af91 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ab19aa0f-df8c-4dfa-be34-8b88ec44af91&#xA;Pipeline run with id=ab19aa0f-df8c-4dfa-be34-8b88ec44af91 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ab19aa0f-df8c-4dfa-be34-8b88ec44af91&#xA;Pipeline run with id=ab19aa0f-df8c-4dfa-be34-8b88ec44af91 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ab19aa0f-df8c-4dfa-be34-8b88ec44af91&#xA;Pipeline run with id=ab19aa0f-df8c-4dfa-be34-8b88ec44af91 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ab19aa0f-df8c-4dfa-be34-8b88ec44af91&#xA;Pipeline run with id=ab19aa0f-df8c-4dfa-be34-8b88ec44af91 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ab19aa0f-df8c-4dfa-be34-8b88ec44af91&#xA;Pipeline run with id=ab19aa0f-df8c-4dfa-be34-8b88ec44af91 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ab19aa0f-df8c-4dfa-be34-8b88ec44af91&#xA;Pipeline run with id=ab19aa0f-df8c-4dfa-be34-8b88ec44af91 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ab19aa0f-df8c-4dfa-be34-8b88ec44af91&#xA;Pipeline run with id=ab19aa0f-df8c-4dfa-be34-8b88ec44af91 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ab19aa0f-df8c-4dfa-be34-8b88ec44af91&#xA;Pipeline run with id=ab19aa0f-df8c-4dfa-be34-8b88ec44af91 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ab19aa0f-df8c-4dfa-be34-8b88ec44af91&#xA;Pipeline run with id=ab19aa0f-df8c-4dfa-be34-8b88ec44af91 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ab19aa0f-df8c-4dfa-be34-8b88ec44af91&#xA;Pipeline run with id=ab19aa0f-df8c-4dfa-be34-8b88ec44af91 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ab19aa0f-df8c-4dfa-be34-8b88ec44af91&#xA;Pipeline run with id=ab19aa0f-df8c-4dfa-be34-8b88ec44af91 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ab19aa0f-df8c-4dfa-be34-8b88ec44af91&#xA;Pipeline run with id=ab19aa0f-df8c-4dfa-be34-8b88ec44af91 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ab19aa0f-df8c-4dfa-be34-8b88ec44af91&#xA;Pipeline run with id=ab19aa0f-df8c-4dfa-be34-8b88ec44af91 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ab19aa0f-df8c-4dfa-be34-8b88ec44af91&#xA;Pipeline run with id=ab19aa0f-df8c-4dfa-be34-8b88ec44af91 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;essential/component_with_pip_index_urls.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=ab19aa0f-df8c-4dfa-be34-8b88ec44af91&#xA;Get a pipeline run with id=ab19aa0f-df8c-4dfa-be34-8b88ec44af91&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/14/26 11:49:47.918 (1m15.399s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/14/26 11:49:47.918&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run ab19aa0f-df8c-4dfa-be34-8b88ec44af91&#xA;Failed to terminate run ab19aa0f-df8c-4dfa-be34-8b88ec44af91&#xA;Terminate run ab19aa0f-df8c-4dfa-be34-8b88ec44af91&#xA;Deleting run ab19aa0f-df8c-4dfa-be34-8b88ec44af91&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=951ab504-9aa5-4abd-a863-1cb3c4ab47c3 (cascade=true)&#xA;Pipeline with id=951ab504-9aa5-4abd-a863-1cb3c4ab47c3, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/14/26 11:49:48.045 (126ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/14/26 11:49:48.045&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/14/26 11:49:48.045 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/14/26 11:49:48.046&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/14/26 11:49:48.046 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/parallel_for_after_dependency.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="115.809713903">
              <system-out>2026/07/14 11:50:28 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/14/26 11:48:32.251&#xA;Create an experiment with name E2EExperiment-1784029712251024410&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/14/26 11:48:32.462 (212ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/14/26 11:48:32.462&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x3cb68e1cc600&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/14/26 11:48:32.525 (63ms)&#xA;&gt; Enter [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/14/26 11:48:32.525&#xA;Uploading pipeline file critical/parallel_for_after_dependency.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1784029712462833791, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml&#xA;Upload of pipeline file &#39;critical/parallel_for_after_dependency.yaml&#39; successful&#xA;Listing pipeline versions for pipeline fba9f931-a230-41a8-8374-805adf255786&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;fba9f931-a230-41a8-8374-805adf255786&#39; and name: &#39;e2e-test-1784029712462833791&#39;&#xA;Create a pipeline run for pipeline with id=fba9f931-a230-41a8-8374-805adf255786 and versionId=7124d492-7ea7-4d85-a354-cdd0ba46f5a1&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=4e6a77be-a5ef-4a67-aafa-bdca0191a623&#xA;Created Pipeline Run with id: 4e6a77be-a5ef-4a67-aafa-bdca0191a623 for pipeline with id: fba9f931-a230-41a8-8374-805adf255786&#xA;Waiting for pipeline run with id=4e6a77be-a5ef-4a67-aafa-bdca0191a623 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=4e6a77be-a5ef-4a67-aafa-bdca0191a623&#xA;Pipeline run with id=4e6a77be-a5ef-4a67-aafa-bdca0191a623 is in PENDING state, waiting...&#xA;Get a pipeline run with id=4e6a77be-a5ef-4a67-aafa-bdca0191a623&#xA;Pipeline run with id=4e6a77be-a5ef-4a67-aafa-bdca0191a623 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4e6a77be-a5ef-4a67-aafa-bdca0191a623&#xA;Pipeline run with id=4e6a77be-a5ef-4a67-aafa-bdca0191a623 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4e6a77be-a5ef-4a67-aafa-bdca0191a623&#xA;Pipeline run with id=4e6a77be-a5ef-4a67-aafa-bdca0191a623 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4e6a77be-a5ef-4a67-aafa-bdca0191a623&#xA;Pipeline run with id=4e6a77be-a5ef-4a67-aafa-bdca0191a623 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4e6a77be-a5ef-4a67-aafa-bdca0191a623&#xA;Pipeline run with id=4e6a77be-a5ef-4a67-aafa-bdca0191a623 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4e6a77be-a5ef-4a67-aafa-bdca0191a623&#xA;Pipeline run with id=4e6a77be-a5ef-4a67-aafa-bdca0191a623 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4e6a77be-a5ef-4a67-aafa-bdca0191a623&#xA;Pipeline run with id=4e6a77be-a5ef-4a67-aafa-bdca0191a623 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4e6a77be-a5ef-4a67-aafa-bdca0191a623&#xA;Pipeline run with id=4e6a77be-a5ef-4a67-aafa-bdca0191a623 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4e6a77be-a5ef-4a67-aafa-bdca0191a623&#xA;Pipeline run with id=4e6a77be-a5ef-4a67-aafa-bdca0191a623 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4e6a77be-a5ef-4a67-aafa-bdca0191a623&#xA;Pipeline run with id=4e6a77be-a5ef-4a67-aafa-bdca0191a623 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4e6a77be-a5ef-4a67-aafa-bdca0191a623&#xA;Pipeline run with id=4e6a77be-a5ef-4a67-aafa-bdca0191a623 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4e6a77be-a5ef-4a67-aafa-bdca0191a623&#xA;Pipeline run with id=4e6a77be-a5ef-4a67-aafa-bdca0191a623 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4e6a77be-a5ef-4a67-aafa-bdca0191a623&#xA;Pipeline run with id=4e6a77be-a5ef-4a67-aafa-bdca0191a623 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4e6a77be-a5ef-4a67-aafa-bdca0191a623&#xA;Pipeline run with id=4e6a77be-a5ef-4a67-aafa-bdca0191a623 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4e6a77be-a5ef-4a67-aafa-bdca0191a623&#xA;Pipeline run with id=4e6a77be-a5ef-4a67-aafa-bdca0191a623 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4e6a77be-a5ef-4a67-aafa-bdca0191a623&#xA;Pipeline run with id=4e6a77be-a5ef-4a67-aafa-bdca0191a623 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4e6a77be-a5ef-4a67-aafa-bdca0191a623&#xA;Pipeline run with id=4e6a77be-a5ef-4a67-aafa-bdca0191a623 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4e6a77be-a5ef-4a67-aafa-bdca0191a623&#xA;Pipeline run with id=4e6a77be-a5ef-4a67-aafa-bdca0191a623 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4e6a77be-a5ef-4a67-aafa-bdca0191a623&#xA;Pipeline run with id=4e6a77be-a5ef-4a67-aafa-bdca0191a623 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4e6a77be-a5ef-4a67-aafa-bdca0191a623&#xA;Pipeline run with id=4e6a77be-a5ef-4a67-aafa-bdca0191a623 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4e6a77be-a5ef-4a67-aafa-bdca0191a623&#xA;Pipeline run with id=4e6a77be-a5ef-4a67-aafa-bdca0191a623 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4e6a77be-a5ef-4a67-aafa-bdca0191a623&#xA;Pipeline run with id=4e6a77be-a5ef-4a67-aafa-bdca0191a623 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4e6a77be-a5ef-4a67-aafa-bdca0191a623&#xA;Pipeline run with id=4e6a77be-a5ef-4a67-aafa-bdca0191a623 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/parallel_for_after_dependency.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=4e6a77be-a5ef-4a67-aafa-bdca0191a623&#xA;Get a pipeline run with id=4e6a77be-a5ef-4a67-aafa-bdca0191a623&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/14/26 11:50:27.945 (1m55.419s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/14/26 11:50:27.945&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 4e6a77be-a5ef-4a67-aafa-bdca0191a623&#xA;Failed to terminate run 4e6a77be-a5ef-4a67-aafa-bdca0191a623&#xA;Terminate run 4e6a77be-a5ef-4a67-aafa-bdca0191a623&#xA;Deleting run 4e6a77be-a5ef-4a67-aafa-bdca0191a623&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=fba9f931-a230-41a8-8374-805adf255786 (cascade=true)&#xA;Pipeline with id=fba9f931-a230-41a8-8374-805adf255786, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/14/26 11:50:28.06 (115ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/14/26 11:50:28.06&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/14/26 11:50:28.06 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/14/26 11:50:28.061&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/14/26 11:50:28.061 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/pipeline_with_artifact_upload_download.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="120.761451221">
              <system-out>2026/07/14 11:50:33 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/14/26 11:48:32.251&#xA;Create an experiment with name E2EExperiment-1784029712251077703&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/14/26 11:48:32.462 (211ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/14/26 11:48:32.462&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x26b79cfd6e00&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/14/26 11:48:32.525 (63ms)&#xA;&gt; Enter [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/14/26 11:48:32.525&#xA;Uploading pipeline file critical/pipeline_with_artifact_upload_download.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1784029712462588217, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml&#xA;Upload of pipeline file &#39;critical/pipeline_with_artifact_upload_download.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 72195c35-9e3e-4bcc-84f9-5179b8405ac7&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;72195c35-9e3e-4bcc-84f9-5179b8405ac7&#39; and name: &#39;e2e-test-1784029712462588217&#39;&#xA;Create a pipeline run for pipeline with id=72195c35-9e3e-4bcc-84f9-5179b8405ac7 and versionId=e0ad17ae-efdd-4639-97c8-ef43b82705da&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=d12da1d9-7ee1-4181-8959-e42a65b041bf&#xA;Created Pipeline Run with id: d12da1d9-7ee1-4181-8959-e42a65b041bf for pipeline with id: 72195c35-9e3e-4bcc-84f9-5179b8405ac7&#xA;Waiting for pipeline run with id=d12da1d9-7ee1-4181-8959-e42a65b041bf to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=d12da1d9-7ee1-4181-8959-e42a65b041bf&#xA;Pipeline run with id=d12da1d9-7ee1-4181-8959-e42a65b041bf is in PENDING state, waiting...&#xA;Get a pipeline run with id=d12da1d9-7ee1-4181-8959-e42a65b041bf&#xA;Pipeline run with id=d12da1d9-7ee1-4181-8959-e42a65b041bf is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d12da1d9-7ee1-4181-8959-e42a65b041bf&#xA;Pipeline run with id=d12da1d9-7ee1-4181-8959-e42a65b041bf is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d12da1d9-7ee1-4181-8959-e42a65b041bf&#xA;Pipeline run with id=d12da1d9-7ee1-4181-8959-e42a65b041bf is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d12da1d9-7ee1-4181-8959-e42a65b041bf&#xA;Pipeline run with id=d12da1d9-7ee1-4181-8959-e42a65b041bf is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d12da1d9-7ee1-4181-8959-e42a65b041bf&#xA;Pipeline run with id=d12da1d9-7ee1-4181-8959-e42a65b041bf is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d12da1d9-7ee1-4181-8959-e42a65b041bf&#xA;Pipeline run with id=d12da1d9-7ee1-4181-8959-e42a65b041bf is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d12da1d9-7ee1-4181-8959-e42a65b041bf&#xA;Pipeline run with id=d12da1d9-7ee1-4181-8959-e42a65b041bf is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d12da1d9-7ee1-4181-8959-e42a65b041bf&#xA;Pipeline run with id=d12da1d9-7ee1-4181-8959-e42a65b041bf is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d12da1d9-7ee1-4181-8959-e42a65b041bf&#xA;Pipeline run with id=d12da1d9-7ee1-4181-8959-e42a65b041bf is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d12da1d9-7ee1-4181-8959-e42a65b041bf&#xA;Pipeline run with id=d12da1d9-7ee1-4181-8959-e42a65b041bf is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d12da1d9-7ee1-4181-8959-e42a65b041bf&#xA;Pipeline run with id=d12da1d9-7ee1-4181-8959-e42a65b041bf is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d12da1d9-7ee1-4181-8959-e42a65b041bf&#xA;Pipeline run with id=d12da1d9-7ee1-4181-8959-e42a65b041bf is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d12da1d9-7ee1-4181-8959-e42a65b041bf&#xA;Pipeline run with id=d12da1d9-7ee1-4181-8959-e42a65b041bf is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d12da1d9-7ee1-4181-8959-e42a65b041bf&#xA;Pipeline run with id=d12da1d9-7ee1-4181-8959-e42a65b041bf is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d12da1d9-7ee1-4181-8959-e42a65b041bf&#xA;Pipeline run with id=d12da1d9-7ee1-4181-8959-e42a65b041bf is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d12da1d9-7ee1-4181-8959-e42a65b041bf&#xA;Pipeline run with id=d12da1d9-7ee1-4181-8959-e42a65b041bf is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d12da1d9-7ee1-4181-8959-e42a65b041bf&#xA;Pipeline run with id=d12da1d9-7ee1-4181-8959-e42a65b041bf is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d12da1d9-7ee1-4181-8959-e42a65b041bf&#xA;Pipeline run with id=d12da1d9-7ee1-4181-8959-e42a65b041bf is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d12da1d9-7ee1-4181-8959-e42a65b041bf&#xA;Pipeline run with id=d12da1d9-7ee1-4181-8959-e42a65b041bf is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d12da1d9-7ee1-4181-8959-e42a65b041bf&#xA;Pipeline run with id=d12da1d9-7ee1-4181-8959-e42a65b041bf is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d12da1d9-7ee1-4181-8959-e42a65b041bf&#xA;Pipeline run with id=d12da1d9-7ee1-4181-8959-e42a65b041bf is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d12da1d9-7ee1-4181-8959-e42a65b041bf&#xA;Pipeline run with id=d12da1d9-7ee1-4181-8959-e42a65b041bf is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d12da1d9-7ee1-4181-8959-e42a65b041bf&#xA;Pipeline run with id=d12da1d9-7ee1-4181-8959-e42a65b041bf is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d12da1d9-7ee1-4181-8959-e42a65b041bf&#xA;Pipeline run with id=d12da1d9-7ee1-4181-8959-e42a65b041bf reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/pipeline_with_artifact_upload_download.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=d12da1d9-7ee1-4181-8959-e42a65b041bf&#xA;Get a pipeline run with id=d12da1d9-7ee1-4181-8959-e42a65b041bf&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/14/26 11:50:32.918 (2m0.393s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/14/26 11:50:32.918&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run d12da1d9-7ee1-4181-8959-e42a65b041bf&#xA;Failed to terminate run d12da1d9-7ee1-4181-8959-e42a65b041bf&#xA;Terminate run d12da1d9-7ee1-4181-8959-e42a65b041bf&#xA;Deleting run d12da1d9-7ee1-4181-8959-e42a65b041bf&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=72195c35-9e3e-4bcc-84f9-5179b8405ac7 (cascade=true)&#xA;Pipeline with id=72195c35-9e3e-4bcc-84f9-5179b8405ac7, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/14/26 11:50:33.012 (94ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/14/26 11:50:33.012&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/14/26 11:50:33.012 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/14/26 11:50:33.013&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/14/26 11:50:33.013 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/flip_coin.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="145.852394813">
              <system-out>2026/07/14 11:50:58 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/14/26 11:48:32.25&#xA;Create an experiment with name E2EExperiment-1784029712250801948&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/14/26 11:48:32.462 (212ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/14/26 11:48:32.462&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x2f687e2c5080&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/14/26 11:48:32.522 (60ms)&#xA;&gt; Enter [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/14/26 11:48:32.523&#xA;Uploading pipeline file critical/flip_coin.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1784029712462728865, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml&#xA;Upload of pipeline file &#39;critical/flip_coin.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 5e25e556-a0f1-4761-8a0c-a88e6abdd6c7&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;5e25e556-a0f1-4761-8a0c-a88e6abdd6c7&#39; and name: &#39;e2e-test-1784029712462728865&#39;&#xA;Create a pipeline run for pipeline with id=5e25e556-a0f1-4761-8a0c-a88e6abdd6c7 and versionId=9c3b4b13-8fe3-468d-995a-56af1c3b6244&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=5e95dbed-6531-43aa-b9f6-1da5d8b68c53&#xA;Created Pipeline Run with id: 5e95dbed-6531-43aa-b9f6-1da5d8b68c53 for pipeline with id: 5e25e556-a0f1-4761-8a0c-a88e6abdd6c7&#xA;Waiting for pipeline run with id=5e95dbed-6531-43aa-b9f6-1da5d8b68c53 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=5e95dbed-6531-43aa-b9f6-1da5d8b68c53&#xA;Pipeline run with id=5e95dbed-6531-43aa-b9f6-1da5d8b68c53 is in PENDING state, waiting...&#xA;Get a pipeline run with id=5e95dbed-6531-43aa-b9f6-1da5d8b68c53&#xA;Pipeline run with id=5e95dbed-6531-43aa-b9f6-1da5d8b68c53 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=5e95dbed-6531-43aa-b9f6-1da5d8b68c53&#xA;Pipeline run with id=5e95dbed-6531-43aa-b9f6-1da5d8b68c53 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=5e95dbed-6531-43aa-b9f6-1da5d8b68c53&#xA;Pipeline run with id=5e95dbed-6531-43aa-b9f6-1da5d8b68c53 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=5e95dbed-6531-43aa-b9f6-1da5d8b68c53&#xA;Pipeline run with id=5e95dbed-6531-43aa-b9f6-1da5d8b68c53 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=5e95dbed-6531-43aa-b9f6-1da5d8b68c53&#xA;Pipeline run with id=5e95dbed-6531-43aa-b9f6-1da5d8b68c53 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=5e95dbed-6531-43aa-b9f6-1da5d8b68c53&#xA;Pipeline run with id=5e95dbed-6531-43aa-b9f6-1da5d8b68c53 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=5e95dbed-6531-43aa-b9f6-1da5d8b68c53&#xA;Pipeline run with id=5e95dbed-6531-43aa-b9f6-1da5d8b68c53 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=5e95dbed-6531-43aa-b9f6-1da5d8b68c53&#xA;Pipeline run with id=5e95dbed-6531-43aa-b9f6-1da5d8b68c53 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=5e95dbed-6531-43aa-b9f6-1da5d8b68c53&#xA;Pipeline run with id=5e95dbed-6531-43aa-b9f6-1da5d8b68c53 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=5e95dbed-6531-43aa-b9f6-1da5d8b68c53&#xA;Pipeline run with id=5e95dbed-6531-43aa-b9f6-1da5d8b68c53 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=5e95dbed-6531-43aa-b9f6-1da5d8b68c53&#xA;Pipeline run with id=5e95dbed-6531-43aa-b9f6-1da5d8b68c53 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=5e95dbed-6531-43aa-b9f6-1da5d8b68c53&#xA;Pipeline run with id=5e95dbed-6531-43aa-b9f6-1da5d8b68c53 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=5e95dbed-6531-43aa-b9f6-1da5d8b68c53&#xA;Pipeline run with id=5e95dbed-6531-43aa-b9f6-1da5d8b68c53 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=5e95dbed-6531-43aa-b9f6-1da5d8b68c53&#xA;Pipeline run with id=5e95dbed-6531-43aa-b9f6-1da5d8b68c53 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=5e95dbed-6531-43aa-b9f6-1da5d8b68c53&#xA;Pipeline run with id=5e95dbed-6531-43aa-b9f6-1da5d8b68c53 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=5e95dbed-6531-43aa-b9f6-1da5d8b68c53&#xA;Pipeline run with id=5e95dbed-6531-43aa-b9f6-1da5d8b68c53 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=5e95dbed-6531-43aa-b9f6-1da5d8b68c53&#xA;Pipeline run with id=5e95dbed-6531-43aa-b9f6-1da5d8b68c53 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=5e95dbed-6531-43aa-b9f6-1da5d8b68c53&#xA;Pipeline run with id=5e95dbed-6531-43aa-b9f6-1da5d8b68c53 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=5e95dbed-6531-43aa-b9f6-1da5d8b68c53&#xA;Pipeline run with id=5e95dbed-6531-43aa-b9f6-1da5d8b68c53 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=5e95dbed-6531-43aa-b9f6-1da5d8b68c53&#xA;Pipeline run with id=5e95dbed-6531-43aa-b9f6-1da5d8b68c53 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=5e95dbed-6531-43aa-b9f6-1da5d8b68c53&#xA;Pipeline run with id=5e95dbed-6531-43aa-b9f6-1da5d8b68c53 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=5e95dbed-6531-43aa-b9f6-1da5d8b68c53&#xA;Pipeline run with id=5e95dbed-6531-43aa-b9f6-1da5d8b68c53 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=5e95dbed-6531-43aa-b9f6-1da5d8b68c53&#xA;Pipeline run with id=5e95dbed-6531-43aa-b9f6-1da5d8b68c53 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=5e95dbed-6531-43aa-b9f6-1da5d8b68c53&#xA;Pipeline run with id=5e95dbed-6531-43aa-b9f6-1da5d8b68c53 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=5e95dbed-6531-43aa-b9f6-1da5d8b68c53&#xA;Pipeline run with id=5e95dbed-6531-43aa-b9f6-1da5d8b68c53 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=5e95dbed-6531-43aa-b9f6-1da5d8b68c53&#xA;Pipeline run with id=5e95dbed-6531-43aa-b9f6-1da5d8b68c53 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=5e95dbed-6531-43aa-b9f6-1da5d8b68c53&#xA;Pipeline run with id=5e95dbed-6531-43aa-b9f6-1da5d8b68c53 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=5e95dbed-6531-43aa-b9f6-1da5d8b68c53&#xA;Pipeline run with id=5e95dbed-6531-43aa-b9f6-1da5d8b68c53 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=5e95dbed-6531-43aa-b9f6-1da5d8b68c53&#xA;Pipeline run with id=5e95dbed-6531-43aa-b9f6-1da5d8b68c53 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/flip_coin.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=5e95dbed-6531-43aa-b9f6-1da5d8b68c53&#xA;Get a pipeline run with id=5e95dbed-6531-43aa-b9f6-1da5d8b68c53&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/14/26 11:50:58.002 (2m25.48s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/14/26 11:50:58.003&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 5e95dbed-6531-43aa-b9f6-1da5d8b68c53&#xA;Failed to terminate run 5e95dbed-6531-43aa-b9f6-1da5d8b68c53&#xA;Terminate run 5e95dbed-6531-43aa-b9f6-1da5d8b68c53&#xA;Deleting run 5e95dbed-6531-43aa-b9f6-1da5d8b68c53&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=5e25e556-a0f1-4761-8a0c-a88e6abdd6c7 (cascade=true)&#xA;Pipeline with id=5e25e556-a0f1-4761-8a0c-a88e6abdd6c7, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/14/26 11:50:58.102 (100ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/14/26 11:50:58.103&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/14/26 11:50:58.103 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/14/26 11:50:58.103&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/14/26 11:50:58.103 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload essential/iris_pipeline_compiled.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="175.817165712">
              <system-out>2026/07/14 11:51:28 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/14/26 11:48:32.251&#xA;Create an experiment with name E2EExperiment-1784029712251059142&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/14/26 11:48:32.462 (211ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/14/26 11:48:32.462&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x1dce1963ed80&#xA;test-secret-1 created&#xA;test-secret-2 created&#xA;test-secret-3 created&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/14/26 11:48:32.493 (31ms)&#xA;&gt; Enter [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/14/26 11:48:32.493&#xA;Uploading pipeline file essential/iris_pipeline_compiled.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1784029712462683693, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml&#xA;Upload of pipeline file &#39;essential/iris_pipeline_compiled.yaml&#39; successful&#xA;Listing pipeline versions for pipeline c070e7e7-e1c8-430e-abff-d700dacafc57&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;c070e7e7-e1c8-430e-abff-d700dacafc57&#39; and name: &#39;e2e-test-1784029712462683693&#39;&#xA;Create a pipeline run for pipeline with id=c070e7e7-e1c8-430e-abff-d700dacafc57 and versionId=cc640a1f-d2d2-457f-bc51-51e39a2f3786&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=9f7d3e66-b5a2-45a6-a8be-33628fa003d2&#xA;Created Pipeline Run with id: 9f7d3e66-b5a2-45a6-a8be-33628fa003d2 for pipeline with id: c070e7e7-e1c8-430e-abff-d700dacafc57&#xA;Waiting for pipeline run with id=9f7d3e66-b5a2-45a6-a8be-33628fa003d2 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=9f7d3e66-b5a2-45a6-a8be-33628fa003d2&#xA;Pipeline run with id=9f7d3e66-b5a2-45a6-a8be-33628fa003d2 is in PENDING state, waiting...&#xA;Get a pipeline run with id=9f7d3e66-b5a2-45a6-a8be-33628fa003d2&#xA;Pipeline run with id=9f7d3e66-b5a2-45a6-a8be-33628fa003d2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9f7d3e66-b5a2-45a6-a8be-33628fa003d2&#xA;Pipeline run with id=9f7d3e66-b5a2-45a6-a8be-33628fa003d2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9f7d3e66-b5a2-45a6-a8be-33628fa003d2&#xA;Pipeline run with id=9f7d3e66-b5a2-45a6-a8be-33628fa003d2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9f7d3e66-b5a2-45a6-a8be-33628fa003d2&#xA;Pipeline run with id=9f7d3e66-b5a2-45a6-a8be-33628fa003d2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9f7d3e66-b5a2-45a6-a8be-33628fa003d2&#xA;Pipeline run with id=9f7d3e66-b5a2-45a6-a8be-33628fa003d2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9f7d3e66-b5a2-45a6-a8be-33628fa003d2&#xA;Pipeline run with id=9f7d3e66-b5a2-45a6-a8be-33628fa003d2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9f7d3e66-b5a2-45a6-a8be-33628fa003d2&#xA;Pipeline run with id=9f7d3e66-b5a2-45a6-a8be-33628fa003d2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9f7d3e66-b5a2-45a6-a8be-33628fa003d2&#xA;Pipeline run with id=9f7d3e66-b5a2-45a6-a8be-33628fa003d2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9f7d3e66-b5a2-45a6-a8be-33628fa003d2&#xA;Pipeline run with id=9f7d3e66-b5a2-45a6-a8be-33628fa003d2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9f7d3e66-b5a2-45a6-a8be-33628fa003d2&#xA;Pipeline run with id=9f7d3e66-b5a2-45a6-a8be-33628fa003d2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9f7d3e66-b5a2-45a6-a8be-33628fa003d2&#xA;Pipeline run with id=9f7d3e66-b5a2-45a6-a8be-33628fa003d2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9f7d3e66-b5a2-45a6-a8be-33628fa003d2&#xA;Pipeline run with id=9f7d3e66-b5a2-45a6-a8be-33628fa003d2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9f7d3e66-b5a2-45a6-a8be-33628fa003d2&#xA;Pipeline run with id=9f7d3e66-b5a2-45a6-a8be-33628fa003d2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9f7d3e66-b5a2-45a6-a8be-33628fa003d2&#xA;Pipeline run with id=9f7d3e66-b5a2-45a6-a8be-33628fa003d2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9f7d3e66-b5a2-45a6-a8be-33628fa003d2&#xA;Pipeline run with id=9f7d3e66-b5a2-45a6-a8be-33628fa003d2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9f7d3e66-b5a2-45a6-a8be-33628fa003d2&#xA;Pipeline run with id=9f7d3e66-b5a2-45a6-a8be-33628fa003d2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9f7d3e66-b5a2-45a6-a8be-33628fa003d2&#xA;Pipeline run with id=9f7d3e66-b5a2-45a6-a8be-33628fa003d2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9f7d3e66-b5a2-45a6-a8be-33628fa003d2&#xA;Pipeline run with id=9f7d3e66-b5a2-45a6-a8be-33628fa003d2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9f7d3e66-b5a2-45a6-a8be-33628fa003d2&#xA;Pipeline run with id=9f7d3e66-b5a2-45a6-a8be-33628fa003d2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9f7d3e66-b5a2-45a6-a8be-33628fa003d2&#xA;Pipeline run with id=9f7d3e66-b5a2-45a6-a8be-33628fa003d2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9f7d3e66-b5a2-45a6-a8be-33628fa003d2&#xA;Pipeline run with id=9f7d3e66-b5a2-45a6-a8be-33628fa003d2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9f7d3e66-b5a2-45a6-a8be-33628fa003d2&#xA;Pipeline run with id=9f7d3e66-b5a2-45a6-a8be-33628fa003d2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9f7d3e66-b5a2-45a6-a8be-33628fa003d2&#xA;Pipeline run with id=9f7d3e66-b5a2-45a6-a8be-33628fa003d2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9f7d3e66-b5a2-45a6-a8be-33628fa003d2&#xA;Pipeline run with id=9f7d3e66-b5a2-45a6-a8be-33628fa003d2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9f7d3e66-b5a2-45a6-a8be-33628fa003d2&#xA;Pipeline run with id=9f7d3e66-b5a2-45a6-a8be-33628fa003d2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9f7d3e66-b5a2-45a6-a8be-33628fa003d2&#xA;Pipeline run with id=9f7d3e66-b5a2-45a6-a8be-33628fa003d2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9f7d3e66-b5a2-45a6-a8be-33628fa003d2&#xA;Pipeline run with id=9f7d3e66-b5a2-45a6-a8be-33628fa003d2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9f7d3e66-b5a2-45a6-a8be-33628fa003d2&#xA;Pipeline run with id=9f7d3e66-b5a2-45a6-a8be-33628fa003d2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9f7d3e66-b5a2-45a6-a8be-33628fa003d2&#xA;Pipeline run with id=9f7d3e66-b5a2-45a6-a8be-33628fa003d2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9f7d3e66-b5a2-45a6-a8be-33628fa003d2&#xA;Pipeline run with id=9f7d3e66-b5a2-45a6-a8be-33628fa003d2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9f7d3e66-b5a2-45a6-a8be-33628fa003d2&#xA;Pipeline run with id=9f7d3e66-b5a2-45a6-a8be-33628fa003d2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9f7d3e66-b5a2-45a6-a8be-33628fa003d2&#xA;Pipeline run with id=9f7d3e66-b5a2-45a6-a8be-33628fa003d2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9f7d3e66-b5a2-45a6-a8be-33628fa003d2&#xA;Pipeline run with id=9f7d3e66-b5a2-45a6-a8be-33628fa003d2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9f7d3e66-b5a2-45a6-a8be-33628fa003d2&#xA;Pipeline run with id=9f7d3e66-b5a2-45a6-a8be-33628fa003d2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9f7d3e66-b5a2-45a6-a8be-33628fa003d2&#xA;Pipeline run with id=9f7d3e66-b5a2-45a6-a8be-33628fa003d2 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;essential/iris_pipeline_compiled.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=9f7d3e66-b5a2-45a6-a8be-33628fa003d2&#xA;Get a pipeline run with id=9f7d3e66-b5a2-45a6-a8be-33628fa003d2&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/14/26 11:51:27.944 (2m55.451s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/14/26 11:51:27.944&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 9f7d3e66-b5a2-45a6-a8be-33628fa003d2&#xA;Failed to terminate run 9f7d3e66-b5a2-45a6-a8be-33628fa003d2&#xA;Terminate run 9f7d3e66-b5a2-45a6-a8be-33628fa003d2&#xA;Deleting run 9f7d3e66-b5a2-45a6-a8be-33628fa003d2&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=c070e7e7-e1c8-430e-abff-d700dacafc57 (cascade=true)&#xA;Pipeline with id=c070e7e7-e1c8-430e-abff-d700dacafc57, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/14/26 11:51:28.067 (123ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/14/26 11:51:28.068&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/14/26 11:51:28.068 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/14/26 11:51:28.068&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/14/26 11:51:28.068 (0s)&#xA;</system-err>
          </testcase>
      </testsuite>
  </testsuites>