<?xml version="1.0" encoding="UTF-8"?>
  <testsuites tests="5" disabled="0" errors="0" failures="0" time="171.366467647">
      <testsuite name="AIPipelinesE2ETests" package="/dspa/backend/test/end2end" tests="5" disabled="0" skipped="0" errors="0" failures="0" time="171.366467647" timestamp="2026-07-07T06:32:45">
          <properties>
              <property name="SuiteSucceeded" value="true"></property>
              <property name="SuiteHasProgrammaticFocus" value="false"></property>
              <property name="SpecialSuiteFailureReason" value=""></property>
              <property name="SuiteLabels" value="[]"></property>
              <property name="SuiteSemVerConstraints" value="[]"></property>
              <property name="RandomSeed" value="1783405805"></property>
              <property name="RandomizeAllSpecs" value="false"></property>
              <property name="LabelFilter" value="Smoke"></property>
              <property name="SemVerFilter" value=""></property>
              <property name="FocusStrings" value=""></property>
              <property name="SkipStrings" value=""></property>
              <property name="FocusFiles" value=""></property>
              <property name="SkipFiles" value=""></property>
              <property name="FailOnPending" value="false"></property>
              <property name="FailOnEmpty" value="false"></property>
              <property name="FailFast" value="false"></property>
              <property name="FlakeAttempts" value="0"></property>
              <property name="DryRun" value="false"></property>
              <property name="ParallelTotal" value="10"></property>
              <property name="OutputInterceptorMode" value=""></property>
          </properties>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/flip_coin.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="156.231025595">
              <system-out>2026/07/07 06:35:21 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/07/26 06:32:45.545&#xA;Create an experiment with name E2EExperiment-1783405965545212469&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/07/26 06:32:45.77 (225ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/07/26 06:32:45.77&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x70d06a28900&#xA;test-secret-1 created&#xA;test-secret-2 created&#xA;test-secret-3 created&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/07/26 06:32:45.814 (44ms)&#xA;&gt; Enter [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/07/26 06:32:45.815&#xA;Uploading pipeline file critical/flip_coin.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1783405965770883597, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml&#xA;Upload of pipeline file &#39;critical/flip_coin.yaml&#39; successful&#xA;Listing pipeline versions for pipeline becbc43b-31ee-4c06-9755-8aad536cd355&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;becbc43b-31ee-4c06-9755-8aad536cd355&#39; and name: &#39;e2e-test-1783405965770883597&#39;&#xA;Create a pipeline run for pipeline with id=becbc43b-31ee-4c06-9755-8aad536cd355 and versionId=f3b300bc-f0cc-4b80-a7ff-50b97c7eb015&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=4f0408d6-36ae-44aa-88c8-92bfa9685600&#xA;Created Pipeline Run with id: 4f0408d6-36ae-44aa-88c8-92bfa9685600 for pipeline with id: becbc43b-31ee-4c06-9755-8aad536cd355&#xA;Waiting for pipeline run with id=4f0408d6-36ae-44aa-88c8-92bfa9685600 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=4f0408d6-36ae-44aa-88c8-92bfa9685600&#xA;Pipeline run with id=4f0408d6-36ae-44aa-88c8-92bfa9685600 is in PENDING state, waiting...&#xA;Get a pipeline run with id=4f0408d6-36ae-44aa-88c8-92bfa9685600&#xA;Pipeline run with id=4f0408d6-36ae-44aa-88c8-92bfa9685600 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4f0408d6-36ae-44aa-88c8-92bfa9685600&#xA;Pipeline run with id=4f0408d6-36ae-44aa-88c8-92bfa9685600 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4f0408d6-36ae-44aa-88c8-92bfa9685600&#xA;Pipeline run with id=4f0408d6-36ae-44aa-88c8-92bfa9685600 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4f0408d6-36ae-44aa-88c8-92bfa9685600&#xA;Pipeline run with id=4f0408d6-36ae-44aa-88c8-92bfa9685600 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4f0408d6-36ae-44aa-88c8-92bfa9685600&#xA;Pipeline run with id=4f0408d6-36ae-44aa-88c8-92bfa9685600 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4f0408d6-36ae-44aa-88c8-92bfa9685600&#xA;Pipeline run with id=4f0408d6-36ae-44aa-88c8-92bfa9685600 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4f0408d6-36ae-44aa-88c8-92bfa9685600&#xA;Pipeline run with id=4f0408d6-36ae-44aa-88c8-92bfa9685600 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4f0408d6-36ae-44aa-88c8-92bfa9685600&#xA;Pipeline run with id=4f0408d6-36ae-44aa-88c8-92bfa9685600 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4f0408d6-36ae-44aa-88c8-92bfa9685600&#xA;Pipeline run with id=4f0408d6-36ae-44aa-88c8-92bfa9685600 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4f0408d6-36ae-44aa-88c8-92bfa9685600&#xA;Pipeline run with id=4f0408d6-36ae-44aa-88c8-92bfa9685600 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4f0408d6-36ae-44aa-88c8-92bfa9685600&#xA;Pipeline run with id=4f0408d6-36ae-44aa-88c8-92bfa9685600 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4f0408d6-36ae-44aa-88c8-92bfa9685600&#xA;Pipeline run with id=4f0408d6-36ae-44aa-88c8-92bfa9685600 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4f0408d6-36ae-44aa-88c8-92bfa9685600&#xA;Pipeline run with id=4f0408d6-36ae-44aa-88c8-92bfa9685600 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4f0408d6-36ae-44aa-88c8-92bfa9685600&#xA;Pipeline run with id=4f0408d6-36ae-44aa-88c8-92bfa9685600 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4f0408d6-36ae-44aa-88c8-92bfa9685600&#xA;Pipeline run with id=4f0408d6-36ae-44aa-88c8-92bfa9685600 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4f0408d6-36ae-44aa-88c8-92bfa9685600&#xA;Pipeline run with id=4f0408d6-36ae-44aa-88c8-92bfa9685600 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4f0408d6-36ae-44aa-88c8-92bfa9685600&#xA;Pipeline run with id=4f0408d6-36ae-44aa-88c8-92bfa9685600 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4f0408d6-36ae-44aa-88c8-92bfa9685600&#xA;Pipeline run with id=4f0408d6-36ae-44aa-88c8-92bfa9685600 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4f0408d6-36ae-44aa-88c8-92bfa9685600&#xA;Pipeline run with id=4f0408d6-36ae-44aa-88c8-92bfa9685600 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4f0408d6-36ae-44aa-88c8-92bfa9685600&#xA;Pipeline run with id=4f0408d6-36ae-44aa-88c8-92bfa9685600 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4f0408d6-36ae-44aa-88c8-92bfa9685600&#xA;Pipeline run with id=4f0408d6-36ae-44aa-88c8-92bfa9685600 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4f0408d6-36ae-44aa-88c8-92bfa9685600&#xA;Pipeline run with id=4f0408d6-36ae-44aa-88c8-92bfa9685600 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4f0408d6-36ae-44aa-88c8-92bfa9685600&#xA;Pipeline run with id=4f0408d6-36ae-44aa-88c8-92bfa9685600 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4f0408d6-36ae-44aa-88c8-92bfa9685600&#xA;Pipeline run with id=4f0408d6-36ae-44aa-88c8-92bfa9685600 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4f0408d6-36ae-44aa-88c8-92bfa9685600&#xA;Pipeline run with id=4f0408d6-36ae-44aa-88c8-92bfa9685600 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4f0408d6-36ae-44aa-88c8-92bfa9685600&#xA;Pipeline run with id=4f0408d6-36ae-44aa-88c8-92bfa9685600 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4f0408d6-36ae-44aa-88c8-92bfa9685600&#xA;Pipeline run with id=4f0408d6-36ae-44aa-88c8-92bfa9685600 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4f0408d6-36ae-44aa-88c8-92bfa9685600&#xA;Pipeline run with id=4f0408d6-36ae-44aa-88c8-92bfa9685600 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4f0408d6-36ae-44aa-88c8-92bfa9685600&#xA;Pipeline run with id=4f0408d6-36ae-44aa-88c8-92bfa9685600 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4f0408d6-36ae-44aa-88c8-92bfa9685600&#xA;Pipeline run with id=4f0408d6-36ae-44aa-88c8-92bfa9685600 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=4f0408d6-36ae-44aa-88c8-92bfa9685600&#xA;Pipeline run with id=4f0408d6-36ae-44aa-88c8-92bfa9685600 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/flip_coin.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=4f0408d6-36ae-44aa-88c8-92bfa9685600&#xA;Get a pipeline run with id=4f0408d6-36ae-44aa-88c8-92bfa9685600&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/07/26 06:35:21.485 (2m35.67s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/07/26 06:35:21.485&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 4f0408d6-36ae-44aa-88c8-92bfa9685600&#xA;Failed to terminate run 4f0408d6-36ae-44aa-88c8-92bfa9685600&#xA;Terminate run 4f0408d6-36ae-44aa-88c8-92bfa9685600&#xA;Deleting run 4f0408d6-36ae-44aa-88c8-92bfa9685600&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=becbc43b-31ee-4c06-9755-8aad536cd355 (cascade=true)&#xA;Pipeline with id=becbc43b-31ee-4c06-9755-8aad536cd355, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/07/26 06:35:21.775 (290ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/07/26 06:35:21.776&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/07/26 06:35:21.776 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/07/26 06:35:21.776&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/07/26 06:35:21.776 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload essential/component_with_pip_index_urls.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="75.957654529">
              <system-out>2026/07/07 06:34:01 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/07/26 06:32:45.545&#xA;Create an experiment with name E2EExperiment-1783405965545588648&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/07/26 06:32:45.778 (233ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/07/26 06:32:45.778&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x9065c414b00&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/07/26 06:32:45.868 (90ms)&#xA;&gt; Enter [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/07/26 06:32:45.868&#xA;Uploading pipeline file essential/component_with_pip_index_urls.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1783405965778521060, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml&#xA;Upload of pipeline file &#39;essential/component_with_pip_index_urls.yaml&#39; successful&#xA;Listing pipeline versions for pipeline d97a4f68-e045-4daa-8f38-82c586880e59&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;d97a4f68-e045-4daa-8f38-82c586880e59&#39; and name: &#39;e2e-test-1783405965778521060&#39;&#xA;Create a pipeline run for pipeline with id=d97a4f68-e045-4daa-8f38-82c586880e59 and versionId=90530afb-22d4-428c-98da-97dcde010a3a&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=e49d4493-d6b6-4079-a5ef-2a9180b5897e&#xA;Created Pipeline Run with id: e49d4493-d6b6-4079-a5ef-2a9180b5897e for pipeline with id: d97a4f68-e045-4daa-8f38-82c586880e59&#xA;Waiting for pipeline run with id=e49d4493-d6b6-4079-a5ef-2a9180b5897e to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=e49d4493-d6b6-4079-a5ef-2a9180b5897e&#xA;Pipeline run with id=e49d4493-d6b6-4079-a5ef-2a9180b5897e is in PENDING state, waiting...&#xA;Get a pipeline run with id=e49d4493-d6b6-4079-a5ef-2a9180b5897e&#xA;Pipeline run with id=e49d4493-d6b6-4079-a5ef-2a9180b5897e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e49d4493-d6b6-4079-a5ef-2a9180b5897e&#xA;Pipeline run with id=e49d4493-d6b6-4079-a5ef-2a9180b5897e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e49d4493-d6b6-4079-a5ef-2a9180b5897e&#xA;Pipeline run with id=e49d4493-d6b6-4079-a5ef-2a9180b5897e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e49d4493-d6b6-4079-a5ef-2a9180b5897e&#xA;Pipeline run with id=e49d4493-d6b6-4079-a5ef-2a9180b5897e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e49d4493-d6b6-4079-a5ef-2a9180b5897e&#xA;Pipeline run with id=e49d4493-d6b6-4079-a5ef-2a9180b5897e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e49d4493-d6b6-4079-a5ef-2a9180b5897e&#xA;Pipeline run with id=e49d4493-d6b6-4079-a5ef-2a9180b5897e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e49d4493-d6b6-4079-a5ef-2a9180b5897e&#xA;Pipeline run with id=e49d4493-d6b6-4079-a5ef-2a9180b5897e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e49d4493-d6b6-4079-a5ef-2a9180b5897e&#xA;Pipeline run with id=e49d4493-d6b6-4079-a5ef-2a9180b5897e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e49d4493-d6b6-4079-a5ef-2a9180b5897e&#xA;Pipeline run with id=e49d4493-d6b6-4079-a5ef-2a9180b5897e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e49d4493-d6b6-4079-a5ef-2a9180b5897e&#xA;Pipeline run with id=e49d4493-d6b6-4079-a5ef-2a9180b5897e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e49d4493-d6b6-4079-a5ef-2a9180b5897e&#xA;Pipeline run with id=e49d4493-d6b6-4079-a5ef-2a9180b5897e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e49d4493-d6b6-4079-a5ef-2a9180b5897e&#xA;Pipeline run with id=e49d4493-d6b6-4079-a5ef-2a9180b5897e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e49d4493-d6b6-4079-a5ef-2a9180b5897e&#xA;Pipeline run with id=e49d4493-d6b6-4079-a5ef-2a9180b5897e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e49d4493-d6b6-4079-a5ef-2a9180b5897e&#xA;Pipeline run with id=e49d4493-d6b6-4079-a5ef-2a9180b5897e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e49d4493-d6b6-4079-a5ef-2a9180b5897e&#xA;Pipeline run with id=e49d4493-d6b6-4079-a5ef-2a9180b5897e reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;essential/component_with_pip_index_urls.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=e49d4493-d6b6-4079-a5ef-2a9180b5897e&#xA;Get a pipeline run with id=e49d4493-d6b6-4079-a5ef-2a9180b5897e&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/07/26 06:34:01.323 (1m15.455s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/07/26 06:34:01.323&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run e49d4493-d6b6-4079-a5ef-2a9180b5897e&#xA;Failed to terminate run e49d4493-d6b6-4079-a5ef-2a9180b5897e&#xA;Terminate run e49d4493-d6b6-4079-a5ef-2a9180b5897e&#xA;Deleting run e49d4493-d6b6-4079-a5ef-2a9180b5897e&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=d97a4f68-e045-4daa-8f38-82c586880e59 (cascade=true)&#xA;Pipeline with id=d97a4f68-e045-4daa-8f38-82c586880e59, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/07/26 06:34:01.502 (180ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/07/26 06:34:01.503&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/07/26 06:34:01.503 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/07/26 06:34:01.503&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/07/26 06:34:01.503 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/pipeline_with_artifact_upload_download.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="120.932036541">
              <system-out>2026/07/07 06:34:46 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/07/26 06:32:45.545&#xA;Create an experiment with name E2EExperiment-1783405965545572608&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/07/26 06:32:45.778 (233ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/07/26 06:32:45.778&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x24dcabca8c00&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/07/26 06:32:45.88 (102ms)&#xA;&gt; Enter [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/07/26 06:32:45.881&#xA;Uploading pipeline file critical/pipeline_with_artifact_upload_download.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1783405965779025452, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml&#xA;Upload of pipeline file &#39;critical/pipeline_with_artifact_upload_download.yaml&#39; successful&#xA;Listing pipeline versions for pipeline b664355f-b519-46d7-89c0-8d32c67c4b6a&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;b664355f-b519-46d7-89c0-8d32c67c4b6a&#39; and name: &#39;e2e-test-1783405965779025452&#39;&#xA;Create a pipeline run for pipeline with id=b664355f-b519-46d7-89c0-8d32c67c4b6a and versionId=4514afdb-e135-41e2-b8db-f014a6e6d504&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=c58042d2-f2e1-4451-bc9e-e7fe47bc2795&#xA;Created Pipeline Run with id: c58042d2-f2e1-4451-bc9e-e7fe47bc2795 for pipeline with id: b664355f-b519-46d7-89c0-8d32c67c4b6a&#xA;Waiting for pipeline run with id=c58042d2-f2e1-4451-bc9e-e7fe47bc2795 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=c58042d2-f2e1-4451-bc9e-e7fe47bc2795&#xA;Pipeline run with id=c58042d2-f2e1-4451-bc9e-e7fe47bc2795 is in PENDING state, waiting...&#xA;Get a pipeline run with id=c58042d2-f2e1-4451-bc9e-e7fe47bc2795&#xA;Pipeline run with id=c58042d2-f2e1-4451-bc9e-e7fe47bc2795 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c58042d2-f2e1-4451-bc9e-e7fe47bc2795&#xA;Pipeline run with id=c58042d2-f2e1-4451-bc9e-e7fe47bc2795 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c58042d2-f2e1-4451-bc9e-e7fe47bc2795&#xA;Pipeline run with id=c58042d2-f2e1-4451-bc9e-e7fe47bc2795 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c58042d2-f2e1-4451-bc9e-e7fe47bc2795&#xA;Pipeline run with id=c58042d2-f2e1-4451-bc9e-e7fe47bc2795 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c58042d2-f2e1-4451-bc9e-e7fe47bc2795&#xA;Pipeline run with id=c58042d2-f2e1-4451-bc9e-e7fe47bc2795 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c58042d2-f2e1-4451-bc9e-e7fe47bc2795&#xA;Pipeline run with id=c58042d2-f2e1-4451-bc9e-e7fe47bc2795 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c58042d2-f2e1-4451-bc9e-e7fe47bc2795&#xA;Pipeline run with id=c58042d2-f2e1-4451-bc9e-e7fe47bc2795 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c58042d2-f2e1-4451-bc9e-e7fe47bc2795&#xA;Pipeline run with id=c58042d2-f2e1-4451-bc9e-e7fe47bc2795 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c58042d2-f2e1-4451-bc9e-e7fe47bc2795&#xA;Pipeline run with id=c58042d2-f2e1-4451-bc9e-e7fe47bc2795 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c58042d2-f2e1-4451-bc9e-e7fe47bc2795&#xA;Pipeline run with id=c58042d2-f2e1-4451-bc9e-e7fe47bc2795 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c58042d2-f2e1-4451-bc9e-e7fe47bc2795&#xA;Pipeline run with id=c58042d2-f2e1-4451-bc9e-e7fe47bc2795 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c58042d2-f2e1-4451-bc9e-e7fe47bc2795&#xA;Pipeline run with id=c58042d2-f2e1-4451-bc9e-e7fe47bc2795 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c58042d2-f2e1-4451-bc9e-e7fe47bc2795&#xA;Pipeline run with id=c58042d2-f2e1-4451-bc9e-e7fe47bc2795 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c58042d2-f2e1-4451-bc9e-e7fe47bc2795&#xA;Pipeline run with id=c58042d2-f2e1-4451-bc9e-e7fe47bc2795 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c58042d2-f2e1-4451-bc9e-e7fe47bc2795&#xA;Pipeline run with id=c58042d2-f2e1-4451-bc9e-e7fe47bc2795 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c58042d2-f2e1-4451-bc9e-e7fe47bc2795&#xA;Pipeline run with id=c58042d2-f2e1-4451-bc9e-e7fe47bc2795 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c58042d2-f2e1-4451-bc9e-e7fe47bc2795&#xA;Pipeline run with id=c58042d2-f2e1-4451-bc9e-e7fe47bc2795 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c58042d2-f2e1-4451-bc9e-e7fe47bc2795&#xA;Pipeline run with id=c58042d2-f2e1-4451-bc9e-e7fe47bc2795 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c58042d2-f2e1-4451-bc9e-e7fe47bc2795&#xA;Pipeline run with id=c58042d2-f2e1-4451-bc9e-e7fe47bc2795 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c58042d2-f2e1-4451-bc9e-e7fe47bc2795&#xA;Pipeline run with id=c58042d2-f2e1-4451-bc9e-e7fe47bc2795 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c58042d2-f2e1-4451-bc9e-e7fe47bc2795&#xA;Pipeline run with id=c58042d2-f2e1-4451-bc9e-e7fe47bc2795 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c58042d2-f2e1-4451-bc9e-e7fe47bc2795&#xA;Pipeline run with id=c58042d2-f2e1-4451-bc9e-e7fe47bc2795 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c58042d2-f2e1-4451-bc9e-e7fe47bc2795&#xA;Pipeline run with id=c58042d2-f2e1-4451-bc9e-e7fe47bc2795 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=c58042d2-f2e1-4451-bc9e-e7fe47bc2795&#xA;Pipeline run with id=c58042d2-f2e1-4451-bc9e-e7fe47bc2795 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/pipeline_with_artifact_upload_download.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=c58042d2-f2e1-4451-bc9e-e7fe47bc2795&#xA;Get a pipeline run with id=c58042d2-f2e1-4451-bc9e-e7fe47bc2795&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/07/26 06:34:46.339 (2m0.459s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/07/26 06:34:46.339&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run c58042d2-f2e1-4451-bc9e-e7fe47bc2795&#xA;Failed to terminate run c58042d2-f2e1-4451-bc9e-e7fe47bc2795&#xA;Terminate run c58042d2-f2e1-4451-bc9e-e7fe47bc2795&#xA;Deleting run c58042d2-f2e1-4451-bc9e-e7fe47bc2795&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=b664355f-b519-46d7-89c0-8d32c67c4b6a (cascade=true)&#xA;Pipeline with id=b664355f-b519-46d7-89c0-8d32c67c4b6a, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/07/26 06:34:46.477 (137ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/07/26 06:34:46.477&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/07/26 06:34:46.477 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/07/26 06:34:46.477&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/07/26 06:34:46.478 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/parallel_for_after_dependency.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="125.936604811">
              <system-out>2026/07/07 06:34:51 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/07/26 06:32:45.545&#xA;Create an experiment with name E2EExperiment-1783405965545345272&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/07/26 06:32:45.773 (228ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/07/26 06:32:45.774&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x398c50026380&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/07/26 06:32:45.854 (81ms)&#xA;&gt; Enter [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/07/26 06:32:45.855&#xA;Uploading pipeline file critical/parallel_for_after_dependency.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1783405965774084864, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml&#xA;Upload of pipeline file &#39;critical/parallel_for_after_dependency.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 08f14b82-1589-470f-8d64-5da75d9fb85f&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;08f14b82-1589-470f-8d64-5da75d9fb85f&#39; and name: &#39;e2e-test-1783405965774084864&#39;&#xA;Create a pipeline run for pipeline with id=08f14b82-1589-470f-8d64-5da75d9fb85f and versionId=675e2ceb-9b83-498b-9d55-9da9668374f7&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=3b0aaf2a-b2b1-4522-a862-b8b8acd23a94&#xA;Created Pipeline Run with id: 3b0aaf2a-b2b1-4522-a862-b8b8acd23a94 for pipeline with id: 08f14b82-1589-470f-8d64-5da75d9fb85f&#xA;Waiting for pipeline run with id=3b0aaf2a-b2b1-4522-a862-b8b8acd23a94 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=3b0aaf2a-b2b1-4522-a862-b8b8acd23a94&#xA;Pipeline run with id=3b0aaf2a-b2b1-4522-a862-b8b8acd23a94 is in PENDING state, waiting...&#xA;Get a pipeline run with id=3b0aaf2a-b2b1-4522-a862-b8b8acd23a94&#xA;Pipeline run with id=3b0aaf2a-b2b1-4522-a862-b8b8acd23a94 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3b0aaf2a-b2b1-4522-a862-b8b8acd23a94&#xA;Pipeline run with id=3b0aaf2a-b2b1-4522-a862-b8b8acd23a94 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3b0aaf2a-b2b1-4522-a862-b8b8acd23a94&#xA;Pipeline run with id=3b0aaf2a-b2b1-4522-a862-b8b8acd23a94 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3b0aaf2a-b2b1-4522-a862-b8b8acd23a94&#xA;Pipeline run with id=3b0aaf2a-b2b1-4522-a862-b8b8acd23a94 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3b0aaf2a-b2b1-4522-a862-b8b8acd23a94&#xA;Pipeline run with id=3b0aaf2a-b2b1-4522-a862-b8b8acd23a94 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3b0aaf2a-b2b1-4522-a862-b8b8acd23a94&#xA;Pipeline run with id=3b0aaf2a-b2b1-4522-a862-b8b8acd23a94 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3b0aaf2a-b2b1-4522-a862-b8b8acd23a94&#xA;Pipeline run with id=3b0aaf2a-b2b1-4522-a862-b8b8acd23a94 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3b0aaf2a-b2b1-4522-a862-b8b8acd23a94&#xA;Pipeline run with id=3b0aaf2a-b2b1-4522-a862-b8b8acd23a94 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3b0aaf2a-b2b1-4522-a862-b8b8acd23a94&#xA;Pipeline run with id=3b0aaf2a-b2b1-4522-a862-b8b8acd23a94 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3b0aaf2a-b2b1-4522-a862-b8b8acd23a94&#xA;Pipeline run with id=3b0aaf2a-b2b1-4522-a862-b8b8acd23a94 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3b0aaf2a-b2b1-4522-a862-b8b8acd23a94&#xA;Pipeline run with id=3b0aaf2a-b2b1-4522-a862-b8b8acd23a94 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3b0aaf2a-b2b1-4522-a862-b8b8acd23a94&#xA;Pipeline run with id=3b0aaf2a-b2b1-4522-a862-b8b8acd23a94 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3b0aaf2a-b2b1-4522-a862-b8b8acd23a94&#xA;Pipeline run with id=3b0aaf2a-b2b1-4522-a862-b8b8acd23a94 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3b0aaf2a-b2b1-4522-a862-b8b8acd23a94&#xA;Pipeline run with id=3b0aaf2a-b2b1-4522-a862-b8b8acd23a94 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3b0aaf2a-b2b1-4522-a862-b8b8acd23a94&#xA;Pipeline run with id=3b0aaf2a-b2b1-4522-a862-b8b8acd23a94 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3b0aaf2a-b2b1-4522-a862-b8b8acd23a94&#xA;Pipeline run with id=3b0aaf2a-b2b1-4522-a862-b8b8acd23a94 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3b0aaf2a-b2b1-4522-a862-b8b8acd23a94&#xA;Pipeline run with id=3b0aaf2a-b2b1-4522-a862-b8b8acd23a94 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3b0aaf2a-b2b1-4522-a862-b8b8acd23a94&#xA;Pipeline run with id=3b0aaf2a-b2b1-4522-a862-b8b8acd23a94 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3b0aaf2a-b2b1-4522-a862-b8b8acd23a94&#xA;Pipeline run with id=3b0aaf2a-b2b1-4522-a862-b8b8acd23a94 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3b0aaf2a-b2b1-4522-a862-b8b8acd23a94&#xA;Pipeline run with id=3b0aaf2a-b2b1-4522-a862-b8b8acd23a94 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3b0aaf2a-b2b1-4522-a862-b8b8acd23a94&#xA;Pipeline run with id=3b0aaf2a-b2b1-4522-a862-b8b8acd23a94 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3b0aaf2a-b2b1-4522-a862-b8b8acd23a94&#xA;Pipeline run with id=3b0aaf2a-b2b1-4522-a862-b8b8acd23a94 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3b0aaf2a-b2b1-4522-a862-b8b8acd23a94&#xA;Pipeline run with id=3b0aaf2a-b2b1-4522-a862-b8b8acd23a94 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3b0aaf2a-b2b1-4522-a862-b8b8acd23a94&#xA;Pipeline run with id=3b0aaf2a-b2b1-4522-a862-b8b8acd23a94 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3b0aaf2a-b2b1-4522-a862-b8b8acd23a94&#xA;Pipeline run with id=3b0aaf2a-b2b1-4522-a862-b8b8acd23a94 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/parallel_for_after_dependency.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=3b0aaf2a-b2b1-4522-a862-b8b8acd23a94&#xA;Get a pipeline run with id=3b0aaf2a-b2b1-4522-a862-b8b8acd23a94&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/07/26 06:34:51.262 (2m5.408s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/07/26 06:34:51.262&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 3b0aaf2a-b2b1-4522-a862-b8b8acd23a94&#xA;Failed to terminate run 3b0aaf2a-b2b1-4522-a862-b8b8acd23a94&#xA;Terminate run 3b0aaf2a-b2b1-4522-a862-b8b8acd23a94&#xA;Deleting run 3b0aaf2a-b2b1-4522-a862-b8b8acd23a94&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=08f14b82-1589-470f-8d64-5da75d9fb85f (cascade=true)&#xA;Pipeline with id=08f14b82-1589-470f-8d64-5da75d9fb85f, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/07/26 06:34:51.481 (219ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/07/26 06:34:51.482&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/07/26 06:34:51.482 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/07/26 06:34:51.482&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/07/26 06:34:51.482 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload essential/iris_pipeline_compiled.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="171.166598499">
              <system-out>2026/07/07 06:35:36 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/07/26 06:32:45.545&#xA;Create an experiment with name E2EExperiment-1783405965545773633&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/07/26 06:32:45.778 (233ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/07/26 06:32:45.778&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x1e2fa2088b00&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/07/26 06:32:45.88 (102ms)&#xA;&gt; Enter [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/07/26 06:32:45.88&#xA;Uploading pipeline file essential/iris_pipeline_compiled.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1783405965779000642, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml&#xA;Upload of pipeline file &#39;essential/iris_pipeline_compiled.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 810af918-0a2a-4eeb-8b8d-978d522b393a&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;810af918-0a2a-4eeb-8b8d-978d522b393a&#39; and name: &#39;e2e-test-1783405965779000642&#39;&#xA;Create a pipeline run for pipeline with id=810af918-0a2a-4eeb-8b8d-978d522b393a and versionId=9c86e07f-a33b-46f1-9555-70dab05f0ed5&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=fd98ccbb-0f92-4a6b-a0c8-d2b541befe43&#xA;Created Pipeline Run with id: fd98ccbb-0f92-4a6b-a0c8-d2b541befe43 for pipeline with id: 810af918-0a2a-4eeb-8b8d-978d522b393a&#xA;Waiting for pipeline run with id=fd98ccbb-0f92-4a6b-a0c8-d2b541befe43 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=fd98ccbb-0f92-4a6b-a0c8-d2b541befe43&#xA;Pipeline run with id=fd98ccbb-0f92-4a6b-a0c8-d2b541befe43 is in PENDING state, waiting...&#xA;Get a pipeline run with id=fd98ccbb-0f92-4a6b-a0c8-d2b541befe43&#xA;Pipeline run with id=fd98ccbb-0f92-4a6b-a0c8-d2b541befe43 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fd98ccbb-0f92-4a6b-a0c8-d2b541befe43&#xA;Pipeline run with id=fd98ccbb-0f92-4a6b-a0c8-d2b541befe43 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fd98ccbb-0f92-4a6b-a0c8-d2b541befe43&#xA;Pipeline run with id=fd98ccbb-0f92-4a6b-a0c8-d2b541befe43 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fd98ccbb-0f92-4a6b-a0c8-d2b541befe43&#xA;Pipeline run with id=fd98ccbb-0f92-4a6b-a0c8-d2b541befe43 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fd98ccbb-0f92-4a6b-a0c8-d2b541befe43&#xA;Pipeline run with id=fd98ccbb-0f92-4a6b-a0c8-d2b541befe43 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fd98ccbb-0f92-4a6b-a0c8-d2b541befe43&#xA;Pipeline run with id=fd98ccbb-0f92-4a6b-a0c8-d2b541befe43 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fd98ccbb-0f92-4a6b-a0c8-d2b541befe43&#xA;Pipeline run with id=fd98ccbb-0f92-4a6b-a0c8-d2b541befe43 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fd98ccbb-0f92-4a6b-a0c8-d2b541befe43&#xA;Pipeline run with id=fd98ccbb-0f92-4a6b-a0c8-d2b541befe43 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fd98ccbb-0f92-4a6b-a0c8-d2b541befe43&#xA;Pipeline run with id=fd98ccbb-0f92-4a6b-a0c8-d2b541befe43 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fd98ccbb-0f92-4a6b-a0c8-d2b541befe43&#xA;Pipeline run with id=fd98ccbb-0f92-4a6b-a0c8-d2b541befe43 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fd98ccbb-0f92-4a6b-a0c8-d2b541befe43&#xA;Pipeline run with id=fd98ccbb-0f92-4a6b-a0c8-d2b541befe43 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fd98ccbb-0f92-4a6b-a0c8-d2b541befe43&#xA;Pipeline run with id=fd98ccbb-0f92-4a6b-a0c8-d2b541befe43 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fd98ccbb-0f92-4a6b-a0c8-d2b541befe43&#xA;Pipeline run with id=fd98ccbb-0f92-4a6b-a0c8-d2b541befe43 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fd98ccbb-0f92-4a6b-a0c8-d2b541befe43&#xA;Pipeline run with id=fd98ccbb-0f92-4a6b-a0c8-d2b541befe43 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fd98ccbb-0f92-4a6b-a0c8-d2b541befe43&#xA;Pipeline run with id=fd98ccbb-0f92-4a6b-a0c8-d2b541befe43 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fd98ccbb-0f92-4a6b-a0c8-d2b541befe43&#xA;Pipeline run with id=fd98ccbb-0f92-4a6b-a0c8-d2b541befe43 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fd98ccbb-0f92-4a6b-a0c8-d2b541befe43&#xA;Pipeline run with id=fd98ccbb-0f92-4a6b-a0c8-d2b541befe43 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fd98ccbb-0f92-4a6b-a0c8-d2b541befe43&#xA;Pipeline run with id=fd98ccbb-0f92-4a6b-a0c8-d2b541befe43 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fd98ccbb-0f92-4a6b-a0c8-d2b541befe43&#xA;Pipeline run with id=fd98ccbb-0f92-4a6b-a0c8-d2b541befe43 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fd98ccbb-0f92-4a6b-a0c8-d2b541befe43&#xA;Pipeline run with id=fd98ccbb-0f92-4a6b-a0c8-d2b541befe43 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fd98ccbb-0f92-4a6b-a0c8-d2b541befe43&#xA;Pipeline run with id=fd98ccbb-0f92-4a6b-a0c8-d2b541befe43 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fd98ccbb-0f92-4a6b-a0c8-d2b541befe43&#xA;Pipeline run with id=fd98ccbb-0f92-4a6b-a0c8-d2b541befe43 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fd98ccbb-0f92-4a6b-a0c8-d2b541befe43&#xA;Pipeline run with id=fd98ccbb-0f92-4a6b-a0c8-d2b541befe43 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fd98ccbb-0f92-4a6b-a0c8-d2b541befe43&#xA;Pipeline run with id=fd98ccbb-0f92-4a6b-a0c8-d2b541befe43 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fd98ccbb-0f92-4a6b-a0c8-d2b541befe43&#xA;Pipeline run with id=fd98ccbb-0f92-4a6b-a0c8-d2b541befe43 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fd98ccbb-0f92-4a6b-a0c8-d2b541befe43&#xA;Pipeline run with id=fd98ccbb-0f92-4a6b-a0c8-d2b541befe43 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fd98ccbb-0f92-4a6b-a0c8-d2b541befe43&#xA;Pipeline run with id=fd98ccbb-0f92-4a6b-a0c8-d2b541befe43 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fd98ccbb-0f92-4a6b-a0c8-d2b541befe43&#xA;Pipeline run with id=fd98ccbb-0f92-4a6b-a0c8-d2b541befe43 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fd98ccbb-0f92-4a6b-a0c8-d2b541befe43&#xA;Pipeline run with id=fd98ccbb-0f92-4a6b-a0c8-d2b541befe43 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fd98ccbb-0f92-4a6b-a0c8-d2b541befe43&#xA;Pipeline run with id=fd98ccbb-0f92-4a6b-a0c8-d2b541befe43 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fd98ccbb-0f92-4a6b-a0c8-d2b541befe43&#xA;Pipeline run with id=fd98ccbb-0f92-4a6b-a0c8-d2b541befe43 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fd98ccbb-0f92-4a6b-a0c8-d2b541befe43&#xA;Pipeline run with id=fd98ccbb-0f92-4a6b-a0c8-d2b541befe43 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fd98ccbb-0f92-4a6b-a0c8-d2b541befe43&#xA;Pipeline run with id=fd98ccbb-0f92-4a6b-a0c8-d2b541befe43 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fd98ccbb-0f92-4a6b-a0c8-d2b541befe43&#xA;Pipeline run with id=fd98ccbb-0f92-4a6b-a0c8-d2b541befe43 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;essential/iris_pipeline_compiled.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=fd98ccbb-0f92-4a6b-a0c8-d2b541befe43&#xA;Get a pipeline run with id=fd98ccbb-0f92-4a6b-a0c8-d2b541befe43&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/07/26 06:35:36.395 (2m50.514s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/07/26 06:35:36.395&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run fd98ccbb-0f92-4a6b-a0c8-d2b541befe43&#xA;Failed to terminate run fd98ccbb-0f92-4a6b-a0c8-d2b541befe43&#xA;Terminate run fd98ccbb-0f92-4a6b-a0c8-d2b541befe43&#xA;Deleting run fd98ccbb-0f92-4a6b-a0c8-d2b541befe43&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=810af918-0a2a-4eeb-8b8d-978d522b393a (cascade=true)&#xA;Pipeline with id=810af918-0a2a-4eeb-8b8d-978d522b393a, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/07/26 06:35:36.712 (317ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/07/26 06:35:36.712&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/07/26 06:35:36.712 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/07/26 06:35:36.712&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/07/26 06:35:36.712 (0s)&#xA;</system-err>
          </testcase>
      </testsuite>
  </testsuites>