<?xml version="1.0" encoding="UTF-8"?>
  <testsuites tests="5" disabled="0" errors="0" failures="0" time="185.966394903">
      <testsuite name="AIPipelinesE2ETests" package="/dspa/backend/test/end2end" tests="5" disabled="0" skipped="0" errors="0" failures="0" time="185.966394903" timestamp="2026-07-14T06:29:15">
          <properties>
              <property name="SuiteSucceeded" value="true"></property>
              <property name="SuiteHasProgrammaticFocus" value="false"></property>
              <property name="SpecialSuiteFailureReason" value=""></property>
              <property name="SuiteLabels" value="[]"></property>
              <property name="SuiteSemVerConstraints" value="[]"></property>
              <property name="RandomSeed" value="1784010394"></property>
              <property name="RandomizeAllSpecs" value="false"></property>
              <property name="LabelFilter" value="Smoke"></property>
              <property name="SemVerFilter" value=""></property>
              <property name="FocusStrings" value=""></property>
              <property name="SkipStrings" value=""></property>
              <property name="FocusFiles" value=""></property>
              <property name="SkipFiles" value=""></property>
              <property name="FailOnPending" value="false"></property>
              <property name="FailOnEmpty" value="false"></property>
              <property name="FailFast" value="false"></property>
              <property name="FlakeAttempts" value="0"></property>
              <property name="DryRun" value="false"></property>
              <property name="ParallelTotal" value="10"></property>
              <property name="OutputInterceptorMode" value=""></property>
          </properties>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload essential/component_with_pip_index_urls.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="75.72070449">
              <system-out>2026/07/14 06:30:31 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/14/26 06:29:15.922&#xA;Create an experiment with name E2EExperiment-1784010555922138946&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/14/26 06:29:16.129 (207ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/14/26 06:29:16.129&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x218275a92900&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/14/26 06:29:16.173 (44ms)&#xA;&gt; Enter [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/14/26 06:29:16.173&#xA;Uploading pipeline file essential/component_with_pip_index_urls.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1784010556129665145, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml&#xA;Upload of pipeline file &#39;essential/component_with_pip_index_urls.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 57eb2eba-1a81-41bc-92b8-ab37e9b06728&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;57eb2eba-1a81-41bc-92b8-ab37e9b06728&#39; and name: &#39;e2e-test-1784010556129665145&#39;&#xA;Create a pipeline run for pipeline with id=57eb2eba-1a81-41bc-92b8-ab37e9b06728 and versionId=845042da-016b-4d1f-810e-f7980ad1c190&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=8493ae71-00a6-4f5a-b4d9-8effddd48784&#xA;Created Pipeline Run with id: 8493ae71-00a6-4f5a-b4d9-8effddd48784 for pipeline with id: 57eb2eba-1a81-41bc-92b8-ab37e9b06728&#xA;Waiting for pipeline run with id=8493ae71-00a6-4f5a-b4d9-8effddd48784 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=8493ae71-00a6-4f5a-b4d9-8effddd48784&#xA;Pipeline run with id=8493ae71-00a6-4f5a-b4d9-8effddd48784 is in PENDING state, waiting...&#xA;Get a pipeline run with id=8493ae71-00a6-4f5a-b4d9-8effddd48784&#xA;Pipeline run with id=8493ae71-00a6-4f5a-b4d9-8effddd48784 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8493ae71-00a6-4f5a-b4d9-8effddd48784&#xA;Pipeline run with id=8493ae71-00a6-4f5a-b4d9-8effddd48784 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8493ae71-00a6-4f5a-b4d9-8effddd48784&#xA;Pipeline run with id=8493ae71-00a6-4f5a-b4d9-8effddd48784 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8493ae71-00a6-4f5a-b4d9-8effddd48784&#xA;Pipeline run with id=8493ae71-00a6-4f5a-b4d9-8effddd48784 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8493ae71-00a6-4f5a-b4d9-8effddd48784&#xA;Pipeline run with id=8493ae71-00a6-4f5a-b4d9-8effddd48784 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8493ae71-00a6-4f5a-b4d9-8effddd48784&#xA;Pipeline run with id=8493ae71-00a6-4f5a-b4d9-8effddd48784 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8493ae71-00a6-4f5a-b4d9-8effddd48784&#xA;Pipeline run with id=8493ae71-00a6-4f5a-b4d9-8effddd48784 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8493ae71-00a6-4f5a-b4d9-8effddd48784&#xA;Pipeline run with id=8493ae71-00a6-4f5a-b4d9-8effddd48784 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8493ae71-00a6-4f5a-b4d9-8effddd48784&#xA;Pipeline run with id=8493ae71-00a6-4f5a-b4d9-8effddd48784 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8493ae71-00a6-4f5a-b4d9-8effddd48784&#xA;Pipeline run with id=8493ae71-00a6-4f5a-b4d9-8effddd48784 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8493ae71-00a6-4f5a-b4d9-8effddd48784&#xA;Pipeline run with id=8493ae71-00a6-4f5a-b4d9-8effddd48784 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8493ae71-00a6-4f5a-b4d9-8effddd48784&#xA;Pipeline run with id=8493ae71-00a6-4f5a-b4d9-8effddd48784 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8493ae71-00a6-4f5a-b4d9-8effddd48784&#xA;Pipeline run with id=8493ae71-00a6-4f5a-b4d9-8effddd48784 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8493ae71-00a6-4f5a-b4d9-8effddd48784&#xA;Pipeline run with id=8493ae71-00a6-4f5a-b4d9-8effddd48784 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8493ae71-00a6-4f5a-b4d9-8effddd48784&#xA;Pipeline run with id=8493ae71-00a6-4f5a-b4d9-8effddd48784 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;essential/component_with_pip_index_urls.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=8493ae71-00a6-4f5a-b4d9-8effddd48784&#xA;Get a pipeline run with id=8493ae71-00a6-4f5a-b4d9-8effddd48784&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/14/26 06:30:31.531 (1m15.358s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/14/26 06:30:31.531&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 8493ae71-00a6-4f5a-b4d9-8effddd48784&#xA;Failed to terminate run 8493ae71-00a6-4f5a-b4d9-8effddd48784&#xA;Terminate run 8493ae71-00a6-4f5a-b4d9-8effddd48784&#xA;Deleting run 8493ae71-00a6-4f5a-b4d9-8effddd48784&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=57eb2eba-1a81-41bc-92b8-ab37e9b06728 (cascade=true)&#xA;Pipeline with id=57eb2eba-1a81-41bc-92b8-ab37e9b06728, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/14/26 06:30:31.642 (111ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/14/26 06:30:31.643&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/14/26 06:30:31.643 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/14/26 06:30:31.643&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/14/26 06:30:31.643 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/pipeline_with_artifact_upload_download.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="120.912434719">
              <system-out>2026/07/14 06:31:16 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/14/26 06:29:15.922&#xA;Create an experiment with name E2EExperiment-1784010555922581414&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/14/26 06:29:16.129 (207ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/14/26 06:29:16.129&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x93935d18e00&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/14/26 06:29:16.174 (45ms)&#xA;&gt; Enter [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/14/26 06:29:16.174&#xA;Uploading pipeline file critical/pipeline_with_artifact_upload_download.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1784010556129889829, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml&#xA;Upload of pipeline file &#39;critical/pipeline_with_artifact_upload_download.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 08ec2115-a269-4ead-939c-5a06970de8f6&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;08ec2115-a269-4ead-939c-5a06970de8f6&#39; and name: &#39;e2e-test-1784010556129889829&#39;&#xA;Create a pipeline run for pipeline with id=08ec2115-a269-4ead-939c-5a06970de8f6 and versionId=e76c009b-e4d6-45b7-b9b8-967ad461002b&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=1ee0053b-b0f3-4557-8d09-6d8a0c793e3d&#xA;Created Pipeline Run with id: 1ee0053b-b0f3-4557-8d09-6d8a0c793e3d for pipeline with id: 08ec2115-a269-4ead-939c-5a06970de8f6&#xA;Waiting for pipeline run with id=1ee0053b-b0f3-4557-8d09-6d8a0c793e3d to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=1ee0053b-b0f3-4557-8d09-6d8a0c793e3d&#xA;Pipeline run with id=1ee0053b-b0f3-4557-8d09-6d8a0c793e3d is in PENDING state, waiting...&#xA;Get a pipeline run with id=1ee0053b-b0f3-4557-8d09-6d8a0c793e3d&#xA;Pipeline run with id=1ee0053b-b0f3-4557-8d09-6d8a0c793e3d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ee0053b-b0f3-4557-8d09-6d8a0c793e3d&#xA;Pipeline run with id=1ee0053b-b0f3-4557-8d09-6d8a0c793e3d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ee0053b-b0f3-4557-8d09-6d8a0c793e3d&#xA;Pipeline run with id=1ee0053b-b0f3-4557-8d09-6d8a0c793e3d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ee0053b-b0f3-4557-8d09-6d8a0c793e3d&#xA;Pipeline run with id=1ee0053b-b0f3-4557-8d09-6d8a0c793e3d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ee0053b-b0f3-4557-8d09-6d8a0c793e3d&#xA;Pipeline run with id=1ee0053b-b0f3-4557-8d09-6d8a0c793e3d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ee0053b-b0f3-4557-8d09-6d8a0c793e3d&#xA;Pipeline run with id=1ee0053b-b0f3-4557-8d09-6d8a0c793e3d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ee0053b-b0f3-4557-8d09-6d8a0c793e3d&#xA;Pipeline run with id=1ee0053b-b0f3-4557-8d09-6d8a0c793e3d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ee0053b-b0f3-4557-8d09-6d8a0c793e3d&#xA;Pipeline run with id=1ee0053b-b0f3-4557-8d09-6d8a0c793e3d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ee0053b-b0f3-4557-8d09-6d8a0c793e3d&#xA;Pipeline run with id=1ee0053b-b0f3-4557-8d09-6d8a0c793e3d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ee0053b-b0f3-4557-8d09-6d8a0c793e3d&#xA;Pipeline run with id=1ee0053b-b0f3-4557-8d09-6d8a0c793e3d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ee0053b-b0f3-4557-8d09-6d8a0c793e3d&#xA;Pipeline run with id=1ee0053b-b0f3-4557-8d09-6d8a0c793e3d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ee0053b-b0f3-4557-8d09-6d8a0c793e3d&#xA;Pipeline run with id=1ee0053b-b0f3-4557-8d09-6d8a0c793e3d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ee0053b-b0f3-4557-8d09-6d8a0c793e3d&#xA;Pipeline run with id=1ee0053b-b0f3-4557-8d09-6d8a0c793e3d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ee0053b-b0f3-4557-8d09-6d8a0c793e3d&#xA;Pipeline run with id=1ee0053b-b0f3-4557-8d09-6d8a0c793e3d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ee0053b-b0f3-4557-8d09-6d8a0c793e3d&#xA;Pipeline run with id=1ee0053b-b0f3-4557-8d09-6d8a0c793e3d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ee0053b-b0f3-4557-8d09-6d8a0c793e3d&#xA;Pipeline run with id=1ee0053b-b0f3-4557-8d09-6d8a0c793e3d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ee0053b-b0f3-4557-8d09-6d8a0c793e3d&#xA;Pipeline run with id=1ee0053b-b0f3-4557-8d09-6d8a0c793e3d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ee0053b-b0f3-4557-8d09-6d8a0c793e3d&#xA;Pipeline run with id=1ee0053b-b0f3-4557-8d09-6d8a0c793e3d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ee0053b-b0f3-4557-8d09-6d8a0c793e3d&#xA;Pipeline run with id=1ee0053b-b0f3-4557-8d09-6d8a0c793e3d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ee0053b-b0f3-4557-8d09-6d8a0c793e3d&#xA;Pipeline run with id=1ee0053b-b0f3-4557-8d09-6d8a0c793e3d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ee0053b-b0f3-4557-8d09-6d8a0c793e3d&#xA;Pipeline run with id=1ee0053b-b0f3-4557-8d09-6d8a0c793e3d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ee0053b-b0f3-4557-8d09-6d8a0c793e3d&#xA;Pipeline run with id=1ee0053b-b0f3-4557-8d09-6d8a0c793e3d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ee0053b-b0f3-4557-8d09-6d8a0c793e3d&#xA;Pipeline run with id=1ee0053b-b0f3-4557-8d09-6d8a0c793e3d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ee0053b-b0f3-4557-8d09-6d8a0c793e3d&#xA;Pipeline run with id=1ee0053b-b0f3-4557-8d09-6d8a0c793e3d reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/pipeline_with_artifact_upload_download.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=1ee0053b-b0f3-4557-8d09-6d8a0c793e3d&#xA;Get a pipeline run with id=1ee0053b-b0f3-4557-8d09-6d8a0c793e3d&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/14/26 06:31:16.715 (2m0.54s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/14/26 06:31:16.715&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 1ee0053b-b0f3-4557-8d09-6d8a0c793e3d&#xA;Failed to terminate run 1ee0053b-b0f3-4557-8d09-6d8a0c793e3d&#xA;Terminate run 1ee0053b-b0f3-4557-8d09-6d8a0c793e3d&#xA;Deleting run 1ee0053b-b0f3-4557-8d09-6d8a0c793e3d&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=08ec2115-a269-4ead-939c-5a06970de8f6 (cascade=true)&#xA;Pipeline with id=08ec2115-a269-4ead-939c-5a06970de8f6, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/14/26 06:31:16.834 (119ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/14/26 06:31:16.834&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/14/26 06:31:16.834 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/14/26 06:31:16.835&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/14/26 06:31:16.835 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/parallel_for_after_dependency.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="125.898186396">
              <system-out>2026/07/14 06:31:21 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/14/26 06:29:15.921&#xA;Create an experiment with name E2EExperiment-1784010555921976234&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/14/26 06:29:16.124 (202ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/14/26 06:29:16.124&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0xcea4b0cac80&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/14/26 06:29:16.169 (45ms)&#xA;&gt; Enter [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/14/26 06:29:16.17&#xA;Uploading pipeline file critical/parallel_for_after_dependency.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1784010556124705206, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml&#xA;Upload of pipeline file &#39;critical/parallel_for_after_dependency.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 58644c35-7b68-4531-ba6b-1dc1064d8133&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;58644c35-7b68-4531-ba6b-1dc1064d8133&#39; and name: &#39;e2e-test-1784010556124705206&#39;&#xA;Create a pipeline run for pipeline with id=58644c35-7b68-4531-ba6b-1dc1064d8133 and versionId=634a9515-ea8b-4758-bc74-8cdd9f9802fe&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=abb3a084-5297-4a2b-b3ad-6eeea36f3409&#xA;Created Pipeline Run with id: abb3a084-5297-4a2b-b3ad-6eeea36f3409 for pipeline with id: 58644c35-7b68-4531-ba6b-1dc1064d8133&#xA;Waiting for pipeline run with id=abb3a084-5297-4a2b-b3ad-6eeea36f3409 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=abb3a084-5297-4a2b-b3ad-6eeea36f3409&#xA;Pipeline run with id=abb3a084-5297-4a2b-b3ad-6eeea36f3409 is in PENDING state, waiting...&#xA;Get a pipeline run with id=abb3a084-5297-4a2b-b3ad-6eeea36f3409&#xA;Pipeline run with id=abb3a084-5297-4a2b-b3ad-6eeea36f3409 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=abb3a084-5297-4a2b-b3ad-6eeea36f3409&#xA;Pipeline run with id=abb3a084-5297-4a2b-b3ad-6eeea36f3409 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=abb3a084-5297-4a2b-b3ad-6eeea36f3409&#xA;Pipeline run with id=abb3a084-5297-4a2b-b3ad-6eeea36f3409 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=abb3a084-5297-4a2b-b3ad-6eeea36f3409&#xA;Pipeline run with id=abb3a084-5297-4a2b-b3ad-6eeea36f3409 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=abb3a084-5297-4a2b-b3ad-6eeea36f3409&#xA;Pipeline run with id=abb3a084-5297-4a2b-b3ad-6eeea36f3409 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=abb3a084-5297-4a2b-b3ad-6eeea36f3409&#xA;Pipeline run with id=abb3a084-5297-4a2b-b3ad-6eeea36f3409 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=abb3a084-5297-4a2b-b3ad-6eeea36f3409&#xA;Pipeline run with id=abb3a084-5297-4a2b-b3ad-6eeea36f3409 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=abb3a084-5297-4a2b-b3ad-6eeea36f3409&#xA;Pipeline run with id=abb3a084-5297-4a2b-b3ad-6eeea36f3409 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=abb3a084-5297-4a2b-b3ad-6eeea36f3409&#xA;Pipeline run with id=abb3a084-5297-4a2b-b3ad-6eeea36f3409 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=abb3a084-5297-4a2b-b3ad-6eeea36f3409&#xA;Pipeline run with id=abb3a084-5297-4a2b-b3ad-6eeea36f3409 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=abb3a084-5297-4a2b-b3ad-6eeea36f3409&#xA;Pipeline run with id=abb3a084-5297-4a2b-b3ad-6eeea36f3409 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=abb3a084-5297-4a2b-b3ad-6eeea36f3409&#xA;Pipeline run with id=abb3a084-5297-4a2b-b3ad-6eeea36f3409 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=abb3a084-5297-4a2b-b3ad-6eeea36f3409&#xA;Pipeline run with id=abb3a084-5297-4a2b-b3ad-6eeea36f3409 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=abb3a084-5297-4a2b-b3ad-6eeea36f3409&#xA;Pipeline run with id=abb3a084-5297-4a2b-b3ad-6eeea36f3409 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=abb3a084-5297-4a2b-b3ad-6eeea36f3409&#xA;Pipeline run with id=abb3a084-5297-4a2b-b3ad-6eeea36f3409 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=abb3a084-5297-4a2b-b3ad-6eeea36f3409&#xA;Pipeline run with id=abb3a084-5297-4a2b-b3ad-6eeea36f3409 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=abb3a084-5297-4a2b-b3ad-6eeea36f3409&#xA;Pipeline run with id=abb3a084-5297-4a2b-b3ad-6eeea36f3409 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=abb3a084-5297-4a2b-b3ad-6eeea36f3409&#xA;Pipeline run with id=abb3a084-5297-4a2b-b3ad-6eeea36f3409 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=abb3a084-5297-4a2b-b3ad-6eeea36f3409&#xA;Pipeline run with id=abb3a084-5297-4a2b-b3ad-6eeea36f3409 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=abb3a084-5297-4a2b-b3ad-6eeea36f3409&#xA;Pipeline run with id=abb3a084-5297-4a2b-b3ad-6eeea36f3409 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=abb3a084-5297-4a2b-b3ad-6eeea36f3409&#xA;Pipeline run with id=abb3a084-5297-4a2b-b3ad-6eeea36f3409 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=abb3a084-5297-4a2b-b3ad-6eeea36f3409&#xA;Pipeline run with id=abb3a084-5297-4a2b-b3ad-6eeea36f3409 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=abb3a084-5297-4a2b-b3ad-6eeea36f3409&#xA;Pipeline run with id=abb3a084-5297-4a2b-b3ad-6eeea36f3409 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=abb3a084-5297-4a2b-b3ad-6eeea36f3409&#xA;Pipeline run with id=abb3a084-5297-4a2b-b3ad-6eeea36f3409 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=abb3a084-5297-4a2b-b3ad-6eeea36f3409&#xA;Pipeline run with id=abb3a084-5297-4a2b-b3ad-6eeea36f3409 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/parallel_for_after_dependency.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=abb3a084-5297-4a2b-b3ad-6eeea36f3409&#xA;Get a pipeline run with id=abb3a084-5297-4a2b-b3ad-6eeea36f3409&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/14/26 06:31:21.656 (2m5.487s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/14/26 06:31:21.657&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run abb3a084-5297-4a2b-b3ad-6eeea36f3409&#xA;Failed to terminate run abb3a084-5297-4a2b-b3ad-6eeea36f3409&#xA;Terminate run abb3a084-5297-4a2b-b3ad-6eeea36f3409&#xA;Deleting run abb3a084-5297-4a2b-b3ad-6eeea36f3409&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=58644c35-7b68-4531-ba6b-1dc1064d8133 (cascade=true)&#xA;Pipeline with id=58644c35-7b68-4531-ba6b-1dc1064d8133, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/14/26 06:31:21.82 (163ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/14/26 06:31:21.82&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/14/26 06:31:21.82 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/14/26 06:31:21.82&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/14/26 06:31:21.82 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/flip_coin.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="156.050915014">
              <system-out>2026/07/14 06:31:51 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/14/26 06:29:15.921&#xA;Create an experiment with name E2EExperiment-1784010555921998834&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/14/26 06:29:16.125 (203ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/14/26 06:29:16.125&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x23c6adb28580&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/14/26 06:29:16.17 (45ms)&#xA;&gt; Enter [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/14/26 06:29:16.171&#xA;Uploading pipeline file critical/flip_coin.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1784010556125627933, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml&#xA;Upload of pipeline file &#39;critical/flip_coin.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 43a95c22-ce05-471a-9789-bc758cb72cca&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;43a95c22-ce05-471a-9789-bc758cb72cca&#39; and name: &#39;e2e-test-1784010556125627933&#39;&#xA;Create a pipeline run for pipeline with id=43a95c22-ce05-471a-9789-bc758cb72cca and versionId=4746b388-28be-46ea-8eb6-e11f7a3c09f1&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=bda7edcb-33bc-4a27-80e9-b94993842089&#xA;Created Pipeline Run with id: bda7edcb-33bc-4a27-80e9-b94993842089 for pipeline with id: 43a95c22-ce05-471a-9789-bc758cb72cca&#xA;Waiting for pipeline run with id=bda7edcb-33bc-4a27-80e9-b94993842089 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=bda7edcb-33bc-4a27-80e9-b94993842089&#xA;Pipeline run with id=bda7edcb-33bc-4a27-80e9-b94993842089 is in PENDING state, waiting...&#xA;Get a pipeline run with id=bda7edcb-33bc-4a27-80e9-b94993842089&#xA;Pipeline run with id=bda7edcb-33bc-4a27-80e9-b94993842089 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=bda7edcb-33bc-4a27-80e9-b94993842089&#xA;Pipeline run with id=bda7edcb-33bc-4a27-80e9-b94993842089 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=bda7edcb-33bc-4a27-80e9-b94993842089&#xA;Pipeline run with id=bda7edcb-33bc-4a27-80e9-b94993842089 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=bda7edcb-33bc-4a27-80e9-b94993842089&#xA;Pipeline run with id=bda7edcb-33bc-4a27-80e9-b94993842089 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=bda7edcb-33bc-4a27-80e9-b94993842089&#xA;Pipeline run with id=bda7edcb-33bc-4a27-80e9-b94993842089 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=bda7edcb-33bc-4a27-80e9-b94993842089&#xA;Pipeline run with id=bda7edcb-33bc-4a27-80e9-b94993842089 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=bda7edcb-33bc-4a27-80e9-b94993842089&#xA;Pipeline run with id=bda7edcb-33bc-4a27-80e9-b94993842089 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=bda7edcb-33bc-4a27-80e9-b94993842089&#xA;Pipeline run with id=bda7edcb-33bc-4a27-80e9-b94993842089 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=bda7edcb-33bc-4a27-80e9-b94993842089&#xA;Pipeline run with id=bda7edcb-33bc-4a27-80e9-b94993842089 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=bda7edcb-33bc-4a27-80e9-b94993842089&#xA;Pipeline run with id=bda7edcb-33bc-4a27-80e9-b94993842089 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=bda7edcb-33bc-4a27-80e9-b94993842089&#xA;Pipeline run with id=bda7edcb-33bc-4a27-80e9-b94993842089 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=bda7edcb-33bc-4a27-80e9-b94993842089&#xA;Pipeline run with id=bda7edcb-33bc-4a27-80e9-b94993842089 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=bda7edcb-33bc-4a27-80e9-b94993842089&#xA;Pipeline run with id=bda7edcb-33bc-4a27-80e9-b94993842089 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=bda7edcb-33bc-4a27-80e9-b94993842089&#xA;Pipeline run with id=bda7edcb-33bc-4a27-80e9-b94993842089 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=bda7edcb-33bc-4a27-80e9-b94993842089&#xA;Pipeline run with id=bda7edcb-33bc-4a27-80e9-b94993842089 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=bda7edcb-33bc-4a27-80e9-b94993842089&#xA;Pipeline run with id=bda7edcb-33bc-4a27-80e9-b94993842089 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=bda7edcb-33bc-4a27-80e9-b94993842089&#xA;Pipeline run with id=bda7edcb-33bc-4a27-80e9-b94993842089 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=bda7edcb-33bc-4a27-80e9-b94993842089&#xA;Pipeline run with id=bda7edcb-33bc-4a27-80e9-b94993842089 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=bda7edcb-33bc-4a27-80e9-b94993842089&#xA;Pipeline run with id=bda7edcb-33bc-4a27-80e9-b94993842089 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=bda7edcb-33bc-4a27-80e9-b94993842089&#xA;Pipeline run with id=bda7edcb-33bc-4a27-80e9-b94993842089 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=bda7edcb-33bc-4a27-80e9-b94993842089&#xA;Pipeline run with id=bda7edcb-33bc-4a27-80e9-b94993842089 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=bda7edcb-33bc-4a27-80e9-b94993842089&#xA;Pipeline run with id=bda7edcb-33bc-4a27-80e9-b94993842089 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=bda7edcb-33bc-4a27-80e9-b94993842089&#xA;Pipeline run with id=bda7edcb-33bc-4a27-80e9-b94993842089 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=bda7edcb-33bc-4a27-80e9-b94993842089&#xA;Pipeline run with id=bda7edcb-33bc-4a27-80e9-b94993842089 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=bda7edcb-33bc-4a27-80e9-b94993842089&#xA;Pipeline run with id=bda7edcb-33bc-4a27-80e9-b94993842089 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=bda7edcb-33bc-4a27-80e9-b94993842089&#xA;Pipeline run with id=bda7edcb-33bc-4a27-80e9-b94993842089 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=bda7edcb-33bc-4a27-80e9-b94993842089&#xA;Pipeline run with id=bda7edcb-33bc-4a27-80e9-b94993842089 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=bda7edcb-33bc-4a27-80e9-b94993842089&#xA;Pipeline run with id=bda7edcb-33bc-4a27-80e9-b94993842089 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=bda7edcb-33bc-4a27-80e9-b94993842089&#xA;Pipeline run with id=bda7edcb-33bc-4a27-80e9-b94993842089 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=bda7edcb-33bc-4a27-80e9-b94993842089&#xA;Pipeline run with id=bda7edcb-33bc-4a27-80e9-b94993842089 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=bda7edcb-33bc-4a27-80e9-b94993842089&#xA;Pipeline run with id=bda7edcb-33bc-4a27-80e9-b94993842089 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/flip_coin.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=bda7edcb-33bc-4a27-80e9-b94993842089&#xA;Get a pipeline run with id=bda7edcb-33bc-4a27-80e9-b94993842089&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/14/26 06:31:51.781 (2m35.611s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/14/26 06:31:51.781&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run bda7edcb-33bc-4a27-80e9-b94993842089&#xA;Failed to terminate run bda7edcb-33bc-4a27-80e9-b94993842089&#xA;Terminate run bda7edcb-33bc-4a27-80e9-b94993842089&#xA;Deleting run bda7edcb-33bc-4a27-80e9-b94993842089&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=43a95c22-ce05-471a-9789-bc758cb72cca (cascade=true)&#xA;Pipeline with id=43a95c22-ce05-471a-9789-bc758cb72cca, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/14/26 06:31:51.972 (191ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/14/26 06:31:51.973&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/14/26 06:31:51.973 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/14/26 06:31:51.973&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/14/26 06:31:51.973 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload essential/iris_pipeline_compiled.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="185.850857702">
              <system-out>2026/07/14 06:32:21 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/14/26 06:29:15.922&#xA;Create an experiment with name E2EExperiment-1784010555922500573&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/14/26 06:29:16.125 (203ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/14/26 06:29:16.125&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x1220c9060f00&#xA;test-secret-1 created&#xA;test-secret-2 created&#xA;test-secret-3 created&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/14/26 06:29:16.156 (31ms)&#xA;&gt; Enter [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/14/26 06:29:16.156&#xA;Uploading pipeline file essential/iris_pipeline_compiled.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1784010556125676093, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml&#xA;Upload of pipeline file &#39;essential/iris_pipeline_compiled.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 9a30d016-2e2d-49db-96a8-4ffe07cd1842&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;9a30d016-2e2d-49db-96a8-4ffe07cd1842&#39; and name: &#39;e2e-test-1784010556125676093&#39;&#xA;Create a pipeline run for pipeline with id=9a30d016-2e2d-49db-96a8-4ffe07cd1842 and versionId=1cbcf093-a1b4-493b-8003-60719f452047&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=a89c20b7-a4ec-4180-989f-26f14c2e228c&#xA;Created Pipeline Run with id: a89c20b7-a4ec-4180-989f-26f14c2e228c for pipeline with id: 9a30d016-2e2d-49db-96a8-4ffe07cd1842&#xA;Waiting for pipeline run with id=a89c20b7-a4ec-4180-989f-26f14c2e228c to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=a89c20b7-a4ec-4180-989f-26f14c2e228c&#xA;Pipeline run with id=a89c20b7-a4ec-4180-989f-26f14c2e228c is in PENDING state, waiting...&#xA;Get a pipeline run with id=a89c20b7-a4ec-4180-989f-26f14c2e228c&#xA;Pipeline run with id=a89c20b7-a4ec-4180-989f-26f14c2e228c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=a89c20b7-a4ec-4180-989f-26f14c2e228c&#xA;Pipeline run with id=a89c20b7-a4ec-4180-989f-26f14c2e228c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=a89c20b7-a4ec-4180-989f-26f14c2e228c&#xA;Pipeline run with id=a89c20b7-a4ec-4180-989f-26f14c2e228c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=a89c20b7-a4ec-4180-989f-26f14c2e228c&#xA;Pipeline run with id=a89c20b7-a4ec-4180-989f-26f14c2e228c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=a89c20b7-a4ec-4180-989f-26f14c2e228c&#xA;Pipeline run with id=a89c20b7-a4ec-4180-989f-26f14c2e228c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=a89c20b7-a4ec-4180-989f-26f14c2e228c&#xA;Pipeline run with id=a89c20b7-a4ec-4180-989f-26f14c2e228c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=a89c20b7-a4ec-4180-989f-26f14c2e228c&#xA;Pipeline run with id=a89c20b7-a4ec-4180-989f-26f14c2e228c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=a89c20b7-a4ec-4180-989f-26f14c2e228c&#xA;Pipeline run with id=a89c20b7-a4ec-4180-989f-26f14c2e228c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=a89c20b7-a4ec-4180-989f-26f14c2e228c&#xA;Pipeline run with id=a89c20b7-a4ec-4180-989f-26f14c2e228c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=a89c20b7-a4ec-4180-989f-26f14c2e228c&#xA;Pipeline run with id=a89c20b7-a4ec-4180-989f-26f14c2e228c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=a89c20b7-a4ec-4180-989f-26f14c2e228c&#xA;Pipeline run with id=a89c20b7-a4ec-4180-989f-26f14c2e228c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=a89c20b7-a4ec-4180-989f-26f14c2e228c&#xA;Pipeline run with id=a89c20b7-a4ec-4180-989f-26f14c2e228c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=a89c20b7-a4ec-4180-989f-26f14c2e228c&#xA;Pipeline run with id=a89c20b7-a4ec-4180-989f-26f14c2e228c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=a89c20b7-a4ec-4180-989f-26f14c2e228c&#xA;Pipeline run with id=a89c20b7-a4ec-4180-989f-26f14c2e228c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=a89c20b7-a4ec-4180-989f-26f14c2e228c&#xA;Pipeline run with id=a89c20b7-a4ec-4180-989f-26f14c2e228c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=a89c20b7-a4ec-4180-989f-26f14c2e228c&#xA;Pipeline run with id=a89c20b7-a4ec-4180-989f-26f14c2e228c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=a89c20b7-a4ec-4180-989f-26f14c2e228c&#xA;Pipeline run with id=a89c20b7-a4ec-4180-989f-26f14c2e228c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=a89c20b7-a4ec-4180-989f-26f14c2e228c&#xA;Pipeline run with id=a89c20b7-a4ec-4180-989f-26f14c2e228c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=a89c20b7-a4ec-4180-989f-26f14c2e228c&#xA;Pipeline run with id=a89c20b7-a4ec-4180-989f-26f14c2e228c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=a89c20b7-a4ec-4180-989f-26f14c2e228c&#xA;Pipeline run with id=a89c20b7-a4ec-4180-989f-26f14c2e228c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=a89c20b7-a4ec-4180-989f-26f14c2e228c&#xA;Pipeline run with id=a89c20b7-a4ec-4180-989f-26f14c2e228c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=a89c20b7-a4ec-4180-989f-26f14c2e228c&#xA;Pipeline run with id=a89c20b7-a4ec-4180-989f-26f14c2e228c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=a89c20b7-a4ec-4180-989f-26f14c2e228c&#xA;Pipeline run with id=a89c20b7-a4ec-4180-989f-26f14c2e228c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=a89c20b7-a4ec-4180-989f-26f14c2e228c&#xA;Pipeline run with id=a89c20b7-a4ec-4180-989f-26f14c2e228c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=a89c20b7-a4ec-4180-989f-26f14c2e228c&#xA;Pipeline run with id=a89c20b7-a4ec-4180-989f-26f14c2e228c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=a89c20b7-a4ec-4180-989f-26f14c2e228c&#xA;Pipeline run with id=a89c20b7-a4ec-4180-989f-26f14c2e228c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=a89c20b7-a4ec-4180-989f-26f14c2e228c&#xA;Pipeline run with id=a89c20b7-a4ec-4180-989f-26f14c2e228c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=a89c20b7-a4ec-4180-989f-26f14c2e228c&#xA;Pipeline run with id=a89c20b7-a4ec-4180-989f-26f14c2e228c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=a89c20b7-a4ec-4180-989f-26f14c2e228c&#xA;Pipeline run with id=a89c20b7-a4ec-4180-989f-26f14c2e228c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=a89c20b7-a4ec-4180-989f-26f14c2e228c&#xA;Pipeline run with id=a89c20b7-a4ec-4180-989f-26f14c2e228c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=a89c20b7-a4ec-4180-989f-26f14c2e228c&#xA;Pipeline run with id=a89c20b7-a4ec-4180-989f-26f14c2e228c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=a89c20b7-a4ec-4180-989f-26f14c2e228c&#xA;Pipeline run with id=a89c20b7-a4ec-4180-989f-26f14c2e228c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=a89c20b7-a4ec-4180-989f-26f14c2e228c&#xA;Pipeline run with id=a89c20b7-a4ec-4180-989f-26f14c2e228c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=a89c20b7-a4ec-4180-989f-26f14c2e228c&#xA;Pipeline run with id=a89c20b7-a4ec-4180-989f-26f14c2e228c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=a89c20b7-a4ec-4180-989f-26f14c2e228c&#xA;Pipeline run with id=a89c20b7-a4ec-4180-989f-26f14c2e228c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=a89c20b7-a4ec-4180-989f-26f14c2e228c&#xA;Pipeline run with id=a89c20b7-a4ec-4180-989f-26f14c2e228c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=a89c20b7-a4ec-4180-989f-26f14c2e228c&#xA;Pipeline run with id=a89c20b7-a4ec-4180-989f-26f14c2e228c reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;essential/iris_pipeline_compiled.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=a89c20b7-a4ec-4180-989f-26f14c2e228c&#xA;Get a pipeline run with id=a89c20b7-a4ec-4180-989f-26f14c2e228c&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/14/26 06:32:21.663 (3m5.507s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/14/26 06:32:21.663&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run a89c20b7-a4ec-4180-989f-26f14c2e228c&#xA;Failed to terminate run a89c20b7-a4ec-4180-989f-26f14c2e228c&#xA;Terminate run a89c20b7-a4ec-4180-989f-26f14c2e228c&#xA;Deleting run a89c20b7-a4ec-4180-989f-26f14c2e228c&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=9a30d016-2e2d-49db-96a8-4ffe07cd1842 (cascade=true)&#xA;Pipeline with id=9a30d016-2e2d-49db-96a8-4ffe07cd1842, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/14/26 06:32:21.772 (109ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/14/26 06:32:21.773&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/14/26 06:32:21.773 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/14/26 06:32:21.773&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/14/26 06:32:21.773 (0s)&#xA;</system-err>
          </testcase>
      </testsuite>
  </testsuites>