<?xml version="1.0" encoding="UTF-8"?>
  <testsuites tests="5" disabled="0" errors="0" failures="0" time="180.834396897">
      <testsuite name="AIPipelinesE2ETests" package="/dspa/backend/test/end2end" tests="5" disabled="0" skipped="0" errors="0" failures="0" time="180.834396897" timestamp="2026-07-16T18:34:24">
          <properties>
              <property name="SuiteSucceeded" value="true"></property>
              <property name="SuiteHasProgrammaticFocus" value="false"></property>
              <property name="SpecialSuiteFailureReason" value=""></property>
              <property name="SuiteLabels" value="[]"></property>
              <property name="SuiteSemVerConstraints" value="[]"></property>
              <property name="RandomSeed" value="1784226682"></property>
              <property name="RandomizeAllSpecs" value="false"></property>
              <property name="LabelFilter" value="Smoke"></property>
              <property name="SemVerFilter" value=""></property>
              <property name="FocusStrings" value=""></property>
              <property name="SkipStrings" value=""></property>
              <property name="FocusFiles" value=""></property>
              <property name="SkipFiles" value=""></property>
              <property name="FailOnPending" value="false"></property>
              <property name="FailOnEmpty" value="false"></property>
              <property name="FailFast" value="false"></property>
              <property name="FlakeAttempts" value="0"></property>
              <property name="DryRun" value="false"></property>
              <property name="ParallelTotal" value="10"></property>
              <property name="OutputInterceptorMode" value=""></property>
          </properties>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload essential/component_with_pip_index_urls.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="75.692140463">
              <system-out>2026/07/16 18:35:40 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/16/26 18:34:25.047&#xA;Create an experiment with name E2EExperiment-1784226865047098460&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/16/26 18:34:25.207 (161ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/16/26 18:34:25.207&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x2e5448bfec80&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/16/26 18:34:25.264 (57ms)&#xA;&gt; Enter [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/16/26 18:34:25.266&#xA;Uploading pipeline file essential/component_with_pip_index_urls.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1784226865207865330, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml&#xA;Upload of pipeline file &#39;essential/component_with_pip_index_urls.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 72c74c07-ef41-4a0a-aecc-1b4ba81b03fb&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;72c74c07-ef41-4a0a-aecc-1b4ba81b03fb&#39; and name: &#39;e2e-test-1784226865207865330&#39;&#xA;Create a pipeline run for pipeline with id=72c74c07-ef41-4a0a-aecc-1b4ba81b03fb and versionId=7c8b0a27-9dd6-4efb-aaa6-607a84caf91f&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=ee4fd0fc-e3e3-48a4-99d8-fa115dc0bbde&#xA;Created Pipeline Run with id: ee4fd0fc-e3e3-48a4-99d8-fa115dc0bbde for pipeline with id: 72c74c07-ef41-4a0a-aecc-1b4ba81b03fb&#xA;Waiting for pipeline run with id=ee4fd0fc-e3e3-48a4-99d8-fa115dc0bbde to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=ee4fd0fc-e3e3-48a4-99d8-fa115dc0bbde&#xA;Pipeline run with id=ee4fd0fc-e3e3-48a4-99d8-fa115dc0bbde is in PENDING state, waiting...&#xA;Get a pipeline run with id=ee4fd0fc-e3e3-48a4-99d8-fa115dc0bbde&#xA;Pipeline run with id=ee4fd0fc-e3e3-48a4-99d8-fa115dc0bbde is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ee4fd0fc-e3e3-48a4-99d8-fa115dc0bbde&#xA;Pipeline run with id=ee4fd0fc-e3e3-48a4-99d8-fa115dc0bbde is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ee4fd0fc-e3e3-48a4-99d8-fa115dc0bbde&#xA;Pipeline run with id=ee4fd0fc-e3e3-48a4-99d8-fa115dc0bbde is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ee4fd0fc-e3e3-48a4-99d8-fa115dc0bbde&#xA;Pipeline run with id=ee4fd0fc-e3e3-48a4-99d8-fa115dc0bbde is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ee4fd0fc-e3e3-48a4-99d8-fa115dc0bbde&#xA;Pipeline run with id=ee4fd0fc-e3e3-48a4-99d8-fa115dc0bbde is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ee4fd0fc-e3e3-48a4-99d8-fa115dc0bbde&#xA;Pipeline run with id=ee4fd0fc-e3e3-48a4-99d8-fa115dc0bbde is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ee4fd0fc-e3e3-48a4-99d8-fa115dc0bbde&#xA;Pipeline run with id=ee4fd0fc-e3e3-48a4-99d8-fa115dc0bbde is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ee4fd0fc-e3e3-48a4-99d8-fa115dc0bbde&#xA;Pipeline run with id=ee4fd0fc-e3e3-48a4-99d8-fa115dc0bbde is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ee4fd0fc-e3e3-48a4-99d8-fa115dc0bbde&#xA;Pipeline run with id=ee4fd0fc-e3e3-48a4-99d8-fa115dc0bbde is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ee4fd0fc-e3e3-48a4-99d8-fa115dc0bbde&#xA;Pipeline run with id=ee4fd0fc-e3e3-48a4-99d8-fa115dc0bbde is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ee4fd0fc-e3e3-48a4-99d8-fa115dc0bbde&#xA;Pipeline run with id=ee4fd0fc-e3e3-48a4-99d8-fa115dc0bbde is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ee4fd0fc-e3e3-48a4-99d8-fa115dc0bbde&#xA;Pipeline run with id=ee4fd0fc-e3e3-48a4-99d8-fa115dc0bbde is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ee4fd0fc-e3e3-48a4-99d8-fa115dc0bbde&#xA;Pipeline run with id=ee4fd0fc-e3e3-48a4-99d8-fa115dc0bbde is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ee4fd0fc-e3e3-48a4-99d8-fa115dc0bbde&#xA;Pipeline run with id=ee4fd0fc-e3e3-48a4-99d8-fa115dc0bbde is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ee4fd0fc-e3e3-48a4-99d8-fa115dc0bbde&#xA;Pipeline run with id=ee4fd0fc-e3e3-48a4-99d8-fa115dc0bbde reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;essential/component_with_pip_index_urls.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=ee4fd0fc-e3e3-48a4-99d8-fa115dc0bbde&#xA;Get a pipeline run with id=ee4fd0fc-e3e3-48a4-99d8-fa115dc0bbde&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/16/26 18:35:40.65 (1m15.384s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/16/26 18:35:40.65&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run ee4fd0fc-e3e3-48a4-99d8-fa115dc0bbde&#xA;Failed to terminate run ee4fd0fc-e3e3-48a4-99d8-fa115dc0bbde&#xA;Terminate run ee4fd0fc-e3e3-48a4-99d8-fa115dc0bbde&#xA;Deleting run ee4fd0fc-e3e3-48a4-99d8-fa115dc0bbde&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=72c74c07-ef41-4a0a-aecc-1b4ba81b03fb (cascade=true)&#xA;Pipeline with id=72c74c07-ef41-4a0a-aecc-1b4ba81b03fb, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/16/26 18:35:40.739 (89ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/16/26 18:35:40.739&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/16/26 18:35:40.739 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/16/26 18:35:40.739&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/16/26 18:35:40.739 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/parallel_for_after_dependency.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="115.722871469">
              <system-out>2026/07/16 18:36:20 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/16/26 18:34:25.046&#xA;Create an experiment with name E2EExperiment-1784226865046793134&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/16/26 18:34:25.209 (163ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/16/26 18:34:25.209&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x39063815af00&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/16/26 18:34:25.262 (52ms)&#xA;&gt; Enter [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/16/26 18:34:25.266&#xA;Uploading pipeline file critical/parallel_for_after_dependency.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1784226865210018131, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml&#xA;Upload of pipeline file &#39;critical/parallel_for_after_dependency.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 7b3c1132-80aa-4a4d-8e31-104b6de193a9&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;7b3c1132-80aa-4a4d-8e31-104b6de193a9&#39; and name: &#39;e2e-test-1784226865210018131&#39;&#xA;Create a pipeline run for pipeline with id=7b3c1132-80aa-4a4d-8e31-104b6de193a9 and versionId=a3fe4e43-4fdd-47e6-9c68-4d0c79a2a541&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=0d7a0129-4110-43d3-aa6b-3d03fa71bccc&#xA;Created Pipeline Run with id: 0d7a0129-4110-43d3-aa6b-3d03fa71bccc for pipeline with id: 7b3c1132-80aa-4a4d-8e31-104b6de193a9&#xA;Waiting for pipeline run with id=0d7a0129-4110-43d3-aa6b-3d03fa71bccc to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=0d7a0129-4110-43d3-aa6b-3d03fa71bccc&#xA;Pipeline run with id=0d7a0129-4110-43d3-aa6b-3d03fa71bccc is in PENDING state, waiting...&#xA;Get a pipeline run with id=0d7a0129-4110-43d3-aa6b-3d03fa71bccc&#xA;Pipeline run with id=0d7a0129-4110-43d3-aa6b-3d03fa71bccc is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0d7a0129-4110-43d3-aa6b-3d03fa71bccc&#xA;Pipeline run with id=0d7a0129-4110-43d3-aa6b-3d03fa71bccc is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0d7a0129-4110-43d3-aa6b-3d03fa71bccc&#xA;Pipeline run with id=0d7a0129-4110-43d3-aa6b-3d03fa71bccc is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0d7a0129-4110-43d3-aa6b-3d03fa71bccc&#xA;Pipeline run with id=0d7a0129-4110-43d3-aa6b-3d03fa71bccc is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0d7a0129-4110-43d3-aa6b-3d03fa71bccc&#xA;Pipeline run with id=0d7a0129-4110-43d3-aa6b-3d03fa71bccc is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0d7a0129-4110-43d3-aa6b-3d03fa71bccc&#xA;Pipeline run with id=0d7a0129-4110-43d3-aa6b-3d03fa71bccc is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0d7a0129-4110-43d3-aa6b-3d03fa71bccc&#xA;Pipeline run with id=0d7a0129-4110-43d3-aa6b-3d03fa71bccc is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0d7a0129-4110-43d3-aa6b-3d03fa71bccc&#xA;Pipeline run with id=0d7a0129-4110-43d3-aa6b-3d03fa71bccc is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0d7a0129-4110-43d3-aa6b-3d03fa71bccc&#xA;Pipeline run with id=0d7a0129-4110-43d3-aa6b-3d03fa71bccc is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0d7a0129-4110-43d3-aa6b-3d03fa71bccc&#xA;Pipeline run with id=0d7a0129-4110-43d3-aa6b-3d03fa71bccc is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0d7a0129-4110-43d3-aa6b-3d03fa71bccc&#xA;Pipeline run with id=0d7a0129-4110-43d3-aa6b-3d03fa71bccc is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0d7a0129-4110-43d3-aa6b-3d03fa71bccc&#xA;Pipeline run with id=0d7a0129-4110-43d3-aa6b-3d03fa71bccc is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0d7a0129-4110-43d3-aa6b-3d03fa71bccc&#xA;Pipeline run with id=0d7a0129-4110-43d3-aa6b-3d03fa71bccc is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0d7a0129-4110-43d3-aa6b-3d03fa71bccc&#xA;Pipeline run with id=0d7a0129-4110-43d3-aa6b-3d03fa71bccc is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0d7a0129-4110-43d3-aa6b-3d03fa71bccc&#xA;Pipeline run with id=0d7a0129-4110-43d3-aa6b-3d03fa71bccc is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0d7a0129-4110-43d3-aa6b-3d03fa71bccc&#xA;Pipeline run with id=0d7a0129-4110-43d3-aa6b-3d03fa71bccc is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0d7a0129-4110-43d3-aa6b-3d03fa71bccc&#xA;Pipeline run with id=0d7a0129-4110-43d3-aa6b-3d03fa71bccc is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0d7a0129-4110-43d3-aa6b-3d03fa71bccc&#xA;Pipeline run with id=0d7a0129-4110-43d3-aa6b-3d03fa71bccc is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0d7a0129-4110-43d3-aa6b-3d03fa71bccc&#xA;Pipeline run with id=0d7a0129-4110-43d3-aa6b-3d03fa71bccc is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0d7a0129-4110-43d3-aa6b-3d03fa71bccc&#xA;Pipeline run with id=0d7a0129-4110-43d3-aa6b-3d03fa71bccc is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0d7a0129-4110-43d3-aa6b-3d03fa71bccc&#xA;Pipeline run with id=0d7a0129-4110-43d3-aa6b-3d03fa71bccc is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0d7a0129-4110-43d3-aa6b-3d03fa71bccc&#xA;Pipeline run with id=0d7a0129-4110-43d3-aa6b-3d03fa71bccc is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0d7a0129-4110-43d3-aa6b-3d03fa71bccc&#xA;Pipeline run with id=0d7a0129-4110-43d3-aa6b-3d03fa71bccc reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/parallel_for_after_dependency.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=0d7a0129-4110-43d3-aa6b-3d03fa71bccc&#xA;Get a pipeline run with id=0d7a0129-4110-43d3-aa6b-3d03fa71bccc&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/16/26 18:36:20.667 (1m55.401s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/16/26 18:36:20.667&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 0d7a0129-4110-43d3-aa6b-3d03fa71bccc&#xA;Failed to terminate run 0d7a0129-4110-43d3-aa6b-3d03fa71bccc&#xA;Terminate run 0d7a0129-4110-43d3-aa6b-3d03fa71bccc&#xA;Deleting run 0d7a0129-4110-43d3-aa6b-3d03fa71bccc&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=7b3c1132-80aa-4a4d-8e31-104b6de193a9 (cascade=true)&#xA;Pipeline with id=7b3c1132-80aa-4a4d-8e31-104b6de193a9, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/16/26 18:36:20.769 (102ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/16/26 18:36:20.769&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/16/26 18:36:20.769 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/16/26 18:36:20.769&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/16/26 18:36:20.769 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/pipeline_with_artifact_upload_download.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="120.706225162">
              <system-out>2026/07/16 18:36:25 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/16/26 18:34:25.046&#xA;Create an experiment with name E2EExperiment-1784226865046748120&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/16/26 18:34:25.207 (160ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/16/26 18:34:25.207&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x188be553b000&#xA;test-secret-1 created&#xA;test-secret-2 created&#xA;test-secret-3 created&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/16/26 18:34:25.24 (34ms)&#xA;&gt; Enter [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/16/26 18:34:25.241&#xA;Uploading pipeline file critical/pipeline_with_artifact_upload_download.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1784226865207312834, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml&#xA;Upload of pipeline file &#39;critical/pipeline_with_artifact_upload_download.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 895d35d0-6167-4745-a27c-47d1316b11e0&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;895d35d0-6167-4745-a27c-47d1316b11e0&#39; and name: &#39;e2e-test-1784226865207312834&#39;&#xA;Create a pipeline run for pipeline with id=895d35d0-6167-4745-a27c-47d1316b11e0 and versionId=c654b398-bff5-407b-8562-8210c93d6540&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=737a9dd1-2f8a-4b07-a2cf-df8f73bc9ada&#xA;Created Pipeline Run with id: 737a9dd1-2f8a-4b07-a2cf-df8f73bc9ada for pipeline with id: 895d35d0-6167-4745-a27c-47d1316b11e0&#xA;Waiting for pipeline run with id=737a9dd1-2f8a-4b07-a2cf-df8f73bc9ada to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=737a9dd1-2f8a-4b07-a2cf-df8f73bc9ada&#xA;Pipeline run with id=737a9dd1-2f8a-4b07-a2cf-df8f73bc9ada is in PENDING state, waiting...&#xA;Get a pipeline run with id=737a9dd1-2f8a-4b07-a2cf-df8f73bc9ada&#xA;Pipeline run with id=737a9dd1-2f8a-4b07-a2cf-df8f73bc9ada is in RUNNING state, waiting...&#xA;Get a pipeline run with id=737a9dd1-2f8a-4b07-a2cf-df8f73bc9ada&#xA;Pipeline run with id=737a9dd1-2f8a-4b07-a2cf-df8f73bc9ada is in RUNNING state, waiting...&#xA;Get a pipeline run with id=737a9dd1-2f8a-4b07-a2cf-df8f73bc9ada&#xA;Pipeline run with id=737a9dd1-2f8a-4b07-a2cf-df8f73bc9ada is in RUNNING state, waiting...&#xA;Get a pipeline run with id=737a9dd1-2f8a-4b07-a2cf-df8f73bc9ada&#xA;Pipeline run with id=737a9dd1-2f8a-4b07-a2cf-df8f73bc9ada is in RUNNING state, waiting...&#xA;Get a pipeline run with id=737a9dd1-2f8a-4b07-a2cf-df8f73bc9ada&#xA;Pipeline run with id=737a9dd1-2f8a-4b07-a2cf-df8f73bc9ada is in RUNNING state, waiting...&#xA;Get a pipeline run with id=737a9dd1-2f8a-4b07-a2cf-df8f73bc9ada&#xA;Pipeline run with id=737a9dd1-2f8a-4b07-a2cf-df8f73bc9ada is in RUNNING state, waiting...&#xA;Get a pipeline run with id=737a9dd1-2f8a-4b07-a2cf-df8f73bc9ada&#xA;Pipeline run with id=737a9dd1-2f8a-4b07-a2cf-df8f73bc9ada is in RUNNING state, waiting...&#xA;Get a pipeline run with id=737a9dd1-2f8a-4b07-a2cf-df8f73bc9ada&#xA;Pipeline run with id=737a9dd1-2f8a-4b07-a2cf-df8f73bc9ada is in RUNNING state, waiting...&#xA;Get a pipeline run with id=737a9dd1-2f8a-4b07-a2cf-df8f73bc9ada&#xA;Pipeline run with id=737a9dd1-2f8a-4b07-a2cf-df8f73bc9ada is in RUNNING state, waiting...&#xA;Get a pipeline run with id=737a9dd1-2f8a-4b07-a2cf-df8f73bc9ada&#xA;Pipeline run with id=737a9dd1-2f8a-4b07-a2cf-df8f73bc9ada is in RUNNING state, waiting...&#xA;Get a pipeline run with id=737a9dd1-2f8a-4b07-a2cf-df8f73bc9ada&#xA;Pipeline run with id=737a9dd1-2f8a-4b07-a2cf-df8f73bc9ada is in RUNNING state, waiting...&#xA;Get a pipeline run with id=737a9dd1-2f8a-4b07-a2cf-df8f73bc9ada&#xA;Pipeline run with id=737a9dd1-2f8a-4b07-a2cf-df8f73bc9ada is in RUNNING state, waiting...&#xA;Get a pipeline run with id=737a9dd1-2f8a-4b07-a2cf-df8f73bc9ada&#xA;Pipeline run with id=737a9dd1-2f8a-4b07-a2cf-df8f73bc9ada is in RUNNING state, waiting...&#xA;Get a pipeline run with id=737a9dd1-2f8a-4b07-a2cf-df8f73bc9ada&#xA;Pipeline run with id=737a9dd1-2f8a-4b07-a2cf-df8f73bc9ada is in RUNNING state, waiting...&#xA;Get a pipeline run with id=737a9dd1-2f8a-4b07-a2cf-df8f73bc9ada&#xA;Pipeline run with id=737a9dd1-2f8a-4b07-a2cf-df8f73bc9ada is in RUNNING state, waiting...&#xA;Get a pipeline run with id=737a9dd1-2f8a-4b07-a2cf-df8f73bc9ada&#xA;Pipeline run with id=737a9dd1-2f8a-4b07-a2cf-df8f73bc9ada is in RUNNING state, waiting...&#xA;Get a pipeline run with id=737a9dd1-2f8a-4b07-a2cf-df8f73bc9ada&#xA;Pipeline run with id=737a9dd1-2f8a-4b07-a2cf-df8f73bc9ada is in RUNNING state, waiting...&#xA;Get a pipeline run with id=737a9dd1-2f8a-4b07-a2cf-df8f73bc9ada&#xA;Pipeline run with id=737a9dd1-2f8a-4b07-a2cf-df8f73bc9ada is in RUNNING state, waiting...&#xA;Get a pipeline run with id=737a9dd1-2f8a-4b07-a2cf-df8f73bc9ada&#xA;Pipeline run with id=737a9dd1-2f8a-4b07-a2cf-df8f73bc9ada is in RUNNING state, waiting...&#xA;Get a pipeline run with id=737a9dd1-2f8a-4b07-a2cf-df8f73bc9ada&#xA;Pipeline run with id=737a9dd1-2f8a-4b07-a2cf-df8f73bc9ada is in RUNNING state, waiting...&#xA;Get a pipeline run with id=737a9dd1-2f8a-4b07-a2cf-df8f73bc9ada&#xA;Pipeline run with id=737a9dd1-2f8a-4b07-a2cf-df8f73bc9ada is in RUNNING state, waiting...&#xA;Get a pipeline run with id=737a9dd1-2f8a-4b07-a2cf-df8f73bc9ada&#xA;Pipeline run with id=737a9dd1-2f8a-4b07-a2cf-df8f73bc9ada is in RUNNING state, waiting...&#xA;Get a pipeline run with id=737a9dd1-2f8a-4b07-a2cf-df8f73bc9ada&#xA;Pipeline run with id=737a9dd1-2f8a-4b07-a2cf-df8f73bc9ada is in RUNNING state, waiting...&#xA;Get a pipeline run with id=737a9dd1-2f8a-4b07-a2cf-df8f73bc9ada&#xA;Pipeline run with id=737a9dd1-2f8a-4b07-a2cf-df8f73bc9ada reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/pipeline_with_artifact_upload_download.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=737a9dd1-2f8a-4b07-a2cf-df8f73bc9ada&#xA;Get a pipeline run with id=737a9dd1-2f8a-4b07-a2cf-df8f73bc9ada&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/16/26 18:36:25.659 (2m0.419s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/16/26 18:36:25.659&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 737a9dd1-2f8a-4b07-a2cf-df8f73bc9ada&#xA;Failed to terminate run 737a9dd1-2f8a-4b07-a2cf-df8f73bc9ada&#xA;Terminate run 737a9dd1-2f8a-4b07-a2cf-df8f73bc9ada&#xA;Deleting run 737a9dd1-2f8a-4b07-a2cf-df8f73bc9ada&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=895d35d0-6167-4745-a27c-47d1316b11e0 (cascade=true)&#xA;Pipeline with id=895d35d0-6167-4745-a27c-47d1316b11e0, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/16/26 18:36:25.752 (93ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/16/26 18:36:25.752&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/16/26 18:36:25.753 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/16/26 18:36:25.753&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/16/26 18:36:25.753 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/flip_coin.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="155.866562036">
              <system-out>2026/07/16 18:37:00 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/16/26 18:34:25.046&#xA;Create an experiment with name E2EExperiment-1784226865046789434&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/16/26 18:34:25.207 (160ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/16/26 18:34:25.207&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x2c0d0f208580&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/16/26 18:34:25.267 (60ms)&#xA;&gt; Enter [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/16/26 18:34:25.267&#xA;Uploading pipeline file critical/flip_coin.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1784226865207274610, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml&#xA;Upload of pipeline file &#39;critical/flip_coin.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 85f72420-e964-456c-b347-71ecbdee6fb0&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;85f72420-e964-456c-b347-71ecbdee6fb0&#39; and name: &#39;e2e-test-1784226865207274610&#39;&#xA;Create a pipeline run for pipeline with id=85f72420-e964-456c-b347-71ecbdee6fb0 and versionId=5c075a57-6174-4870-8dc6-17c565d501f6&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=359c97e9-479d-48ca-8240-83bea33e82d9&#xA;Created Pipeline Run with id: 359c97e9-479d-48ca-8240-83bea33e82d9 for pipeline with id: 85f72420-e964-456c-b347-71ecbdee6fb0&#xA;Waiting for pipeline run with id=359c97e9-479d-48ca-8240-83bea33e82d9 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=359c97e9-479d-48ca-8240-83bea33e82d9&#xA;Pipeline run with id=359c97e9-479d-48ca-8240-83bea33e82d9 is in PENDING state, waiting...&#xA;Get a pipeline run with id=359c97e9-479d-48ca-8240-83bea33e82d9&#xA;Pipeline run with id=359c97e9-479d-48ca-8240-83bea33e82d9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=359c97e9-479d-48ca-8240-83bea33e82d9&#xA;Pipeline run with id=359c97e9-479d-48ca-8240-83bea33e82d9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=359c97e9-479d-48ca-8240-83bea33e82d9&#xA;Pipeline run with id=359c97e9-479d-48ca-8240-83bea33e82d9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=359c97e9-479d-48ca-8240-83bea33e82d9&#xA;Pipeline run with id=359c97e9-479d-48ca-8240-83bea33e82d9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=359c97e9-479d-48ca-8240-83bea33e82d9&#xA;Pipeline run with id=359c97e9-479d-48ca-8240-83bea33e82d9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=359c97e9-479d-48ca-8240-83bea33e82d9&#xA;Pipeline run with id=359c97e9-479d-48ca-8240-83bea33e82d9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=359c97e9-479d-48ca-8240-83bea33e82d9&#xA;Pipeline run with id=359c97e9-479d-48ca-8240-83bea33e82d9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=359c97e9-479d-48ca-8240-83bea33e82d9&#xA;Pipeline run with id=359c97e9-479d-48ca-8240-83bea33e82d9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=359c97e9-479d-48ca-8240-83bea33e82d9&#xA;Pipeline run with id=359c97e9-479d-48ca-8240-83bea33e82d9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=359c97e9-479d-48ca-8240-83bea33e82d9&#xA;Pipeline run with id=359c97e9-479d-48ca-8240-83bea33e82d9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=359c97e9-479d-48ca-8240-83bea33e82d9&#xA;Pipeline run with id=359c97e9-479d-48ca-8240-83bea33e82d9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=359c97e9-479d-48ca-8240-83bea33e82d9&#xA;Pipeline run with id=359c97e9-479d-48ca-8240-83bea33e82d9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=359c97e9-479d-48ca-8240-83bea33e82d9&#xA;Pipeline run with id=359c97e9-479d-48ca-8240-83bea33e82d9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=359c97e9-479d-48ca-8240-83bea33e82d9&#xA;Pipeline run with id=359c97e9-479d-48ca-8240-83bea33e82d9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=359c97e9-479d-48ca-8240-83bea33e82d9&#xA;Pipeline run with id=359c97e9-479d-48ca-8240-83bea33e82d9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=359c97e9-479d-48ca-8240-83bea33e82d9&#xA;Pipeline run with id=359c97e9-479d-48ca-8240-83bea33e82d9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=359c97e9-479d-48ca-8240-83bea33e82d9&#xA;Pipeline run with id=359c97e9-479d-48ca-8240-83bea33e82d9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=359c97e9-479d-48ca-8240-83bea33e82d9&#xA;Pipeline run with id=359c97e9-479d-48ca-8240-83bea33e82d9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=359c97e9-479d-48ca-8240-83bea33e82d9&#xA;Pipeline run with id=359c97e9-479d-48ca-8240-83bea33e82d9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=359c97e9-479d-48ca-8240-83bea33e82d9&#xA;Pipeline run with id=359c97e9-479d-48ca-8240-83bea33e82d9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=359c97e9-479d-48ca-8240-83bea33e82d9&#xA;Pipeline run with id=359c97e9-479d-48ca-8240-83bea33e82d9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=359c97e9-479d-48ca-8240-83bea33e82d9&#xA;Pipeline run with id=359c97e9-479d-48ca-8240-83bea33e82d9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=359c97e9-479d-48ca-8240-83bea33e82d9&#xA;Pipeline run with id=359c97e9-479d-48ca-8240-83bea33e82d9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=359c97e9-479d-48ca-8240-83bea33e82d9&#xA;Pipeline run with id=359c97e9-479d-48ca-8240-83bea33e82d9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=359c97e9-479d-48ca-8240-83bea33e82d9&#xA;Pipeline run with id=359c97e9-479d-48ca-8240-83bea33e82d9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=359c97e9-479d-48ca-8240-83bea33e82d9&#xA;Pipeline run with id=359c97e9-479d-48ca-8240-83bea33e82d9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=359c97e9-479d-48ca-8240-83bea33e82d9&#xA;Pipeline run with id=359c97e9-479d-48ca-8240-83bea33e82d9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=359c97e9-479d-48ca-8240-83bea33e82d9&#xA;Pipeline run with id=359c97e9-479d-48ca-8240-83bea33e82d9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=359c97e9-479d-48ca-8240-83bea33e82d9&#xA;Pipeline run with id=359c97e9-479d-48ca-8240-83bea33e82d9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=359c97e9-479d-48ca-8240-83bea33e82d9&#xA;Pipeline run with id=359c97e9-479d-48ca-8240-83bea33e82d9 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=359c97e9-479d-48ca-8240-83bea33e82d9&#xA;Pipeline run with id=359c97e9-479d-48ca-8240-83bea33e82d9 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/flip_coin.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=359c97e9-479d-48ca-8240-83bea33e82d9&#xA;Get a pipeline run with id=359c97e9-479d-48ca-8240-83bea33e82d9&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/16/26 18:37:00.798 (2m35.531s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/16/26 18:37:00.798&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 359c97e9-479d-48ca-8240-83bea33e82d9&#xA;Failed to terminate run 359c97e9-479d-48ca-8240-83bea33e82d9&#xA;Terminate run 359c97e9-479d-48ca-8240-83bea33e82d9&#xA;Deleting run 359c97e9-479d-48ca-8240-83bea33e82d9&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=85f72420-e964-456c-b347-71ecbdee6fb0 (cascade=true)&#xA;Pipeline with id=85f72420-e964-456c-b347-71ecbdee6fb0, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/16/26 18:37:00.913 (114ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/16/26 18:37:00.913&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/16/26 18:37:00.913 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/16/26 18:37:00.913&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/16/26 18:37:00.913 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload essential/iris_pipeline_compiled.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="180.704169557">
              <system-out>2026/07/16 18:37:25 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/16/26 18:34:25.047&#xA;Create an experiment with name E2EExperiment-1784226865047230631&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/16/26 18:34:25.208 (161ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/16/26 18:34:25.208&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x99a2c906300&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/16/26 18:34:25.262 (54ms)&#xA;&gt; Enter [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/16/26 18:34:25.266&#xA;Uploading pipeline file essential/iris_pipeline_compiled.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1784226865208431918, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml&#xA;Upload of pipeline file &#39;essential/iris_pipeline_compiled.yaml&#39; successful&#xA;Listing pipeline versions for pipeline f5cdc162-6977-4051-b242-828022fb826c&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;f5cdc162-6977-4051-b242-828022fb826c&#39; and name: &#39;e2e-test-1784226865208431918&#39;&#xA;Create a pipeline run for pipeline with id=f5cdc162-6977-4051-b242-828022fb826c and versionId=bb952e1c-adc9-42bb-994a-776df1957f06&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=7b8cc32e-50dc-4030-934a-4bbdc08dae1a&#xA;Created Pipeline Run with id: 7b8cc32e-50dc-4030-934a-4bbdc08dae1a for pipeline with id: f5cdc162-6977-4051-b242-828022fb826c&#xA;Waiting for pipeline run with id=7b8cc32e-50dc-4030-934a-4bbdc08dae1a to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=7b8cc32e-50dc-4030-934a-4bbdc08dae1a&#xA;Pipeline run with id=7b8cc32e-50dc-4030-934a-4bbdc08dae1a is in PENDING state, waiting...&#xA;Get a pipeline run with id=7b8cc32e-50dc-4030-934a-4bbdc08dae1a&#xA;Pipeline run with id=7b8cc32e-50dc-4030-934a-4bbdc08dae1a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=7b8cc32e-50dc-4030-934a-4bbdc08dae1a&#xA;Pipeline run with id=7b8cc32e-50dc-4030-934a-4bbdc08dae1a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=7b8cc32e-50dc-4030-934a-4bbdc08dae1a&#xA;Pipeline run with id=7b8cc32e-50dc-4030-934a-4bbdc08dae1a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=7b8cc32e-50dc-4030-934a-4bbdc08dae1a&#xA;Pipeline run with id=7b8cc32e-50dc-4030-934a-4bbdc08dae1a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=7b8cc32e-50dc-4030-934a-4bbdc08dae1a&#xA;Pipeline run with id=7b8cc32e-50dc-4030-934a-4bbdc08dae1a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=7b8cc32e-50dc-4030-934a-4bbdc08dae1a&#xA;Pipeline run with id=7b8cc32e-50dc-4030-934a-4bbdc08dae1a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=7b8cc32e-50dc-4030-934a-4bbdc08dae1a&#xA;Pipeline run with id=7b8cc32e-50dc-4030-934a-4bbdc08dae1a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=7b8cc32e-50dc-4030-934a-4bbdc08dae1a&#xA;Pipeline run with id=7b8cc32e-50dc-4030-934a-4bbdc08dae1a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=7b8cc32e-50dc-4030-934a-4bbdc08dae1a&#xA;Pipeline run with id=7b8cc32e-50dc-4030-934a-4bbdc08dae1a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=7b8cc32e-50dc-4030-934a-4bbdc08dae1a&#xA;Pipeline run with id=7b8cc32e-50dc-4030-934a-4bbdc08dae1a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=7b8cc32e-50dc-4030-934a-4bbdc08dae1a&#xA;Pipeline run with id=7b8cc32e-50dc-4030-934a-4bbdc08dae1a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=7b8cc32e-50dc-4030-934a-4bbdc08dae1a&#xA;Pipeline run with id=7b8cc32e-50dc-4030-934a-4bbdc08dae1a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=7b8cc32e-50dc-4030-934a-4bbdc08dae1a&#xA;Pipeline run with id=7b8cc32e-50dc-4030-934a-4bbdc08dae1a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=7b8cc32e-50dc-4030-934a-4bbdc08dae1a&#xA;Pipeline run with id=7b8cc32e-50dc-4030-934a-4bbdc08dae1a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=7b8cc32e-50dc-4030-934a-4bbdc08dae1a&#xA;Pipeline run with id=7b8cc32e-50dc-4030-934a-4bbdc08dae1a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=7b8cc32e-50dc-4030-934a-4bbdc08dae1a&#xA;Pipeline run with id=7b8cc32e-50dc-4030-934a-4bbdc08dae1a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=7b8cc32e-50dc-4030-934a-4bbdc08dae1a&#xA;Pipeline run with id=7b8cc32e-50dc-4030-934a-4bbdc08dae1a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=7b8cc32e-50dc-4030-934a-4bbdc08dae1a&#xA;Pipeline run with id=7b8cc32e-50dc-4030-934a-4bbdc08dae1a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=7b8cc32e-50dc-4030-934a-4bbdc08dae1a&#xA;Pipeline run with id=7b8cc32e-50dc-4030-934a-4bbdc08dae1a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=7b8cc32e-50dc-4030-934a-4bbdc08dae1a&#xA;Pipeline run with id=7b8cc32e-50dc-4030-934a-4bbdc08dae1a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=7b8cc32e-50dc-4030-934a-4bbdc08dae1a&#xA;Pipeline run with id=7b8cc32e-50dc-4030-934a-4bbdc08dae1a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=7b8cc32e-50dc-4030-934a-4bbdc08dae1a&#xA;Pipeline run with id=7b8cc32e-50dc-4030-934a-4bbdc08dae1a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=7b8cc32e-50dc-4030-934a-4bbdc08dae1a&#xA;Pipeline run with id=7b8cc32e-50dc-4030-934a-4bbdc08dae1a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=7b8cc32e-50dc-4030-934a-4bbdc08dae1a&#xA;Pipeline run with id=7b8cc32e-50dc-4030-934a-4bbdc08dae1a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=7b8cc32e-50dc-4030-934a-4bbdc08dae1a&#xA;Pipeline run with id=7b8cc32e-50dc-4030-934a-4bbdc08dae1a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=7b8cc32e-50dc-4030-934a-4bbdc08dae1a&#xA;Pipeline run with id=7b8cc32e-50dc-4030-934a-4bbdc08dae1a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=7b8cc32e-50dc-4030-934a-4bbdc08dae1a&#xA;Pipeline run with id=7b8cc32e-50dc-4030-934a-4bbdc08dae1a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=7b8cc32e-50dc-4030-934a-4bbdc08dae1a&#xA;Pipeline run with id=7b8cc32e-50dc-4030-934a-4bbdc08dae1a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=7b8cc32e-50dc-4030-934a-4bbdc08dae1a&#xA;Pipeline run with id=7b8cc32e-50dc-4030-934a-4bbdc08dae1a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=7b8cc32e-50dc-4030-934a-4bbdc08dae1a&#xA;Pipeline run with id=7b8cc32e-50dc-4030-934a-4bbdc08dae1a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=7b8cc32e-50dc-4030-934a-4bbdc08dae1a&#xA;Pipeline run with id=7b8cc32e-50dc-4030-934a-4bbdc08dae1a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=7b8cc32e-50dc-4030-934a-4bbdc08dae1a&#xA;Pipeline run with id=7b8cc32e-50dc-4030-934a-4bbdc08dae1a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=7b8cc32e-50dc-4030-934a-4bbdc08dae1a&#xA;Pipeline run with id=7b8cc32e-50dc-4030-934a-4bbdc08dae1a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=7b8cc32e-50dc-4030-934a-4bbdc08dae1a&#xA;Pipeline run with id=7b8cc32e-50dc-4030-934a-4bbdc08dae1a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=7b8cc32e-50dc-4030-934a-4bbdc08dae1a&#xA;Pipeline run with id=7b8cc32e-50dc-4030-934a-4bbdc08dae1a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=7b8cc32e-50dc-4030-934a-4bbdc08dae1a&#xA;Pipeline run with id=7b8cc32e-50dc-4030-934a-4bbdc08dae1a reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;essential/iris_pipeline_compiled.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=7b8cc32e-50dc-4030-934a-4bbdc08dae1a&#xA;Get a pipeline run with id=7b8cc32e-50dc-4030-934a-4bbdc08dae1a&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/16/26 18:37:25.658 (3m0.392s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/16/26 18:37:25.658&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 7b8cc32e-50dc-4030-934a-4bbdc08dae1a&#xA;Failed to terminate run 7b8cc32e-50dc-4030-934a-4bbdc08dae1a&#xA;Terminate run 7b8cc32e-50dc-4030-934a-4bbdc08dae1a&#xA;Deleting run 7b8cc32e-50dc-4030-934a-4bbdc08dae1a&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=f5cdc162-6977-4051-b242-828022fb826c (cascade=true)&#xA;Pipeline with id=f5cdc162-6977-4051-b242-828022fb826c, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/16/26 18:37:25.751 (93ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/16/26 18:37:25.751&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/16/26 18:37:25.751 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/16/26 18:37:25.751&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/16/26 18:37:25.751 (0s)&#xA;</system-err>
          </testcase>
      </testsuite>
  </testsuites>