<?xml version="1.0" encoding="UTF-8"?>
  <testsuites tests="5" disabled="0" errors="0" failures="0" time="195.974048023">
      <testsuite name="AIPipelinesE2ETests" package="/dspa/backend/test/end2end" tests="5" disabled="0" skipped="0" errors="0" failures="0" time="195.974048023" timestamp="2026-09-15T21:32:32">
          <properties>
              <property name="SuiteSucceeded" value="true"></property>
              <property name="SuiteHasProgrammaticFocus" value="false"></property>
              <property name="SpecialSuiteFailureReason" value=""></property>
              <property name="SuiteLabels" value="[]"></property>
              <property name="SuiteSemVerConstraints" value="[]"></property>
              <property name="RandomSeed" value="1789507779"></property>
              <property name="RandomizeAllSpecs" value="false"></property>
              <property name="LabelFilter" value="Smoke"></property>
              <property name="SemVerFilter" value=""></property>
              <property name="FocusStrings" value=""></property>
              <property name="SkipStrings" value=""></property>
              <property name="FocusFiles" value=""></property>
              <property name="SkipFiles" value=""></property>
              <property name="FailOnPending" value="false"></property>
              <property name="FailOnEmpty" value="false"></property>
              <property name="FailFast" value="false"></property>
              <property name="FlakeAttempts" value="0"></property>
              <property name="DryRun" value="false"></property>
              <property name="ParallelTotal" value="10"></property>
              <property name="OutputInterceptorMode" value=""></property>
          </properties>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/parallel_for_after_dependency.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="126.077006259">
              <system-out>2026/09/15 21:34:38 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 09/15/26 21:32:32.468&#xA;Create an experiment with name E2EExperiment-1789507952468109227&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 09/15/26 21:32:32.695 (228ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 09/15/26 21:32:32.695&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x3263ce8cf080&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 09/15/26 21:32:32.852 (157ms)&#xA;&gt; Enter [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 09/15/26 21:32:32.852&#xA;Uploading pipeline file critical/parallel_for_after_dependency.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1789507952695863141, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml&#xA;Upload of pipeline file &#39;critical/parallel_for_after_dependency.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 24bccabc-f9de-4de6-a4fe-4e6e3fa07272&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;24bccabc-f9de-4de6-a4fe-4e6e3fa07272&#39; and name: &#39;e2e-test-1789507952695863141&#39;&#xA;Create a pipeline run for pipeline with id=24bccabc-f9de-4de6-a4fe-4e6e3fa07272 and versionId=4c6ff5fe-9985-48e8-ba70-082eac248b9e&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=21050d37-60bf-4b77-9604-eca910f20299&#xA;Created Pipeline Run with id: 21050d37-60bf-4b77-9604-eca910f20299 for pipeline with id: 24bccabc-f9de-4de6-a4fe-4e6e3fa07272&#xA;Waiting for pipeline run with id=21050d37-60bf-4b77-9604-eca910f20299 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=21050d37-60bf-4b77-9604-eca910f20299&#xA;Pipeline run with id=21050d37-60bf-4b77-9604-eca910f20299 is in PENDING state, waiting...&#xA;Get a pipeline run with id=21050d37-60bf-4b77-9604-eca910f20299&#xA;Pipeline run with id=21050d37-60bf-4b77-9604-eca910f20299 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=21050d37-60bf-4b77-9604-eca910f20299&#xA;Pipeline run with id=21050d37-60bf-4b77-9604-eca910f20299 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=21050d37-60bf-4b77-9604-eca910f20299&#xA;Pipeline run with id=21050d37-60bf-4b77-9604-eca910f20299 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=21050d37-60bf-4b77-9604-eca910f20299&#xA;Pipeline run with id=21050d37-60bf-4b77-9604-eca910f20299 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=21050d37-60bf-4b77-9604-eca910f20299&#xA;Pipeline run with id=21050d37-60bf-4b77-9604-eca910f20299 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=21050d37-60bf-4b77-9604-eca910f20299&#xA;Pipeline run with id=21050d37-60bf-4b77-9604-eca910f20299 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=21050d37-60bf-4b77-9604-eca910f20299&#xA;Pipeline run with id=21050d37-60bf-4b77-9604-eca910f20299 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=21050d37-60bf-4b77-9604-eca910f20299&#xA;Pipeline run with id=21050d37-60bf-4b77-9604-eca910f20299 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=21050d37-60bf-4b77-9604-eca910f20299&#xA;Pipeline run with id=21050d37-60bf-4b77-9604-eca910f20299 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=21050d37-60bf-4b77-9604-eca910f20299&#xA;Pipeline run with id=21050d37-60bf-4b77-9604-eca910f20299 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=21050d37-60bf-4b77-9604-eca910f20299&#xA;Pipeline run with id=21050d37-60bf-4b77-9604-eca910f20299 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=21050d37-60bf-4b77-9604-eca910f20299&#xA;Pipeline run with id=21050d37-60bf-4b77-9604-eca910f20299 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=21050d37-60bf-4b77-9604-eca910f20299&#xA;Pipeline run with id=21050d37-60bf-4b77-9604-eca910f20299 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=21050d37-60bf-4b77-9604-eca910f20299&#xA;Pipeline run with id=21050d37-60bf-4b77-9604-eca910f20299 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=21050d37-60bf-4b77-9604-eca910f20299&#xA;Pipeline run with id=21050d37-60bf-4b77-9604-eca910f20299 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=21050d37-60bf-4b77-9604-eca910f20299&#xA;Pipeline run with id=21050d37-60bf-4b77-9604-eca910f20299 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=21050d37-60bf-4b77-9604-eca910f20299&#xA;Pipeline run with id=21050d37-60bf-4b77-9604-eca910f20299 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=21050d37-60bf-4b77-9604-eca910f20299&#xA;Pipeline run with id=21050d37-60bf-4b77-9604-eca910f20299 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=21050d37-60bf-4b77-9604-eca910f20299&#xA;Pipeline run with id=21050d37-60bf-4b77-9604-eca910f20299 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=21050d37-60bf-4b77-9604-eca910f20299&#xA;Pipeline run with id=21050d37-60bf-4b77-9604-eca910f20299 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=21050d37-60bf-4b77-9604-eca910f20299&#xA;Pipeline run with id=21050d37-60bf-4b77-9604-eca910f20299 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=21050d37-60bf-4b77-9604-eca910f20299&#xA;Pipeline run with id=21050d37-60bf-4b77-9604-eca910f20299 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=21050d37-60bf-4b77-9604-eca910f20299&#xA;Pipeline run with id=21050d37-60bf-4b77-9604-eca910f20299 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=21050d37-60bf-4b77-9604-eca910f20299&#xA;Pipeline run with id=21050d37-60bf-4b77-9604-eca910f20299 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=21050d37-60bf-4b77-9604-eca910f20299&#xA;Pipeline run with id=21050d37-60bf-4b77-9604-eca910f20299 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/parallel_for_after_dependency.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=21050d37-60bf-4b77-9604-eca910f20299&#xA;Get a pipeline run with id=21050d37-60bf-4b77-9604-eca910f20299&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 09/15/26 21:34:38.391 (2m5.539s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 09/15/26 21:34:38.391&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 21050d37-60bf-4b77-9604-eca910f20299&#xA;Failed to terminate run 21050d37-60bf-4b77-9604-eca910f20299&#xA;Terminate run 21050d37-60bf-4b77-9604-eca910f20299&#xA;Deleting run 21050d37-60bf-4b77-9604-eca910f20299&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=24bccabc-f9de-4de6-a4fe-4e6e3fa07272 (cascade=true)&#xA;Pipeline with id=24bccabc-f9de-4de6-a4fe-4e6e3fa07272, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 09/15/26 21:34:38.544 (153ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 09/15/26 21:34:38.545&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 09/15/26 21:34:38.545 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 09/15/26 21:34:38.545&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 09/15/26 21:34:38.545 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload essential/component_with_pip_index_urls.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="85.861788078">
              <system-out>2026/09/15 21:33:58 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 09/15/26 21:32:32.47&#xA;Create an experiment with name E2EExperiment-1789507952470804375&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 09/15/26 21:32:32.694 (224ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 09/15/26 21:32:32.694&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x161541276800&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 09/15/26 21:32:32.824 (130ms)&#xA;&gt; Enter [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 09/15/26 21:32:32.825&#xA;Uploading pipeline file essential/component_with_pip_index_urls.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1789507952694895593, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml&#xA;Upload of pipeline file &#39;essential/component_with_pip_index_urls.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 4191ef3c-071e-4893-9d06-1056ba962077&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;4191ef3c-071e-4893-9d06-1056ba962077&#39; and name: &#39;e2e-test-1789507952694895593&#39;&#xA;Create a pipeline run for pipeline with id=4191ef3c-071e-4893-9d06-1056ba962077 and versionId=a9df6694-9b5e-43d4-b881-a0f3d9a61696&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=f9db6b18-f64a-4813-8cd7-364ee6e47ca0&#xA;Created Pipeline Run with id: f9db6b18-f64a-4813-8cd7-364ee6e47ca0 for pipeline with id: 4191ef3c-071e-4893-9d06-1056ba962077&#xA;Waiting for pipeline run with id=f9db6b18-f64a-4813-8cd7-364ee6e47ca0 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=f9db6b18-f64a-4813-8cd7-364ee6e47ca0&#xA;Pipeline run with id=f9db6b18-f64a-4813-8cd7-364ee6e47ca0 is in PENDING state, waiting...&#xA;Get a pipeline run with id=f9db6b18-f64a-4813-8cd7-364ee6e47ca0&#xA;Pipeline run with id=f9db6b18-f64a-4813-8cd7-364ee6e47ca0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f9db6b18-f64a-4813-8cd7-364ee6e47ca0&#xA;Pipeline run with id=f9db6b18-f64a-4813-8cd7-364ee6e47ca0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f9db6b18-f64a-4813-8cd7-364ee6e47ca0&#xA;Pipeline run with id=f9db6b18-f64a-4813-8cd7-364ee6e47ca0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f9db6b18-f64a-4813-8cd7-364ee6e47ca0&#xA;Pipeline run with id=f9db6b18-f64a-4813-8cd7-364ee6e47ca0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f9db6b18-f64a-4813-8cd7-364ee6e47ca0&#xA;Pipeline run with id=f9db6b18-f64a-4813-8cd7-364ee6e47ca0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f9db6b18-f64a-4813-8cd7-364ee6e47ca0&#xA;Pipeline run with id=f9db6b18-f64a-4813-8cd7-364ee6e47ca0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f9db6b18-f64a-4813-8cd7-364ee6e47ca0&#xA;Pipeline run with id=f9db6b18-f64a-4813-8cd7-364ee6e47ca0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f9db6b18-f64a-4813-8cd7-364ee6e47ca0&#xA;Pipeline run with id=f9db6b18-f64a-4813-8cd7-364ee6e47ca0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f9db6b18-f64a-4813-8cd7-364ee6e47ca0&#xA;Pipeline run with id=f9db6b18-f64a-4813-8cd7-364ee6e47ca0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f9db6b18-f64a-4813-8cd7-364ee6e47ca0&#xA;Pipeline run with id=f9db6b18-f64a-4813-8cd7-364ee6e47ca0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f9db6b18-f64a-4813-8cd7-364ee6e47ca0&#xA;Pipeline run with id=f9db6b18-f64a-4813-8cd7-364ee6e47ca0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f9db6b18-f64a-4813-8cd7-364ee6e47ca0&#xA;Pipeline run with id=f9db6b18-f64a-4813-8cd7-364ee6e47ca0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f9db6b18-f64a-4813-8cd7-364ee6e47ca0&#xA;Pipeline run with id=f9db6b18-f64a-4813-8cd7-364ee6e47ca0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f9db6b18-f64a-4813-8cd7-364ee6e47ca0&#xA;Pipeline run with id=f9db6b18-f64a-4813-8cd7-364ee6e47ca0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f9db6b18-f64a-4813-8cd7-364ee6e47ca0&#xA;Pipeline run with id=f9db6b18-f64a-4813-8cd7-364ee6e47ca0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f9db6b18-f64a-4813-8cd7-364ee6e47ca0&#xA;Pipeline run with id=f9db6b18-f64a-4813-8cd7-364ee6e47ca0 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f9db6b18-f64a-4813-8cd7-364ee6e47ca0&#xA;Pipeline run with id=f9db6b18-f64a-4813-8cd7-364ee6e47ca0 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;essential/component_with_pip_index_urls.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=f9db6b18-f64a-4813-8cd7-364ee6e47ca0&#xA;Get a pipeline run with id=f9db6b18-f64a-4813-8cd7-364ee6e47ca0&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 09/15/26 21:33:58.127 (1m25.302s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 09/15/26 21:33:58.127&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run f9db6b18-f64a-4813-8cd7-364ee6e47ca0&#xA;Failed to terminate run f9db6b18-f64a-4813-8cd7-364ee6e47ca0&#xA;Terminate run f9db6b18-f64a-4813-8cd7-364ee6e47ca0&#xA;Deleting run f9db6b18-f64a-4813-8cd7-364ee6e47ca0&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=4191ef3c-071e-4893-9d06-1056ba962077 (cascade=true)&#xA;Pipeline with id=4191ef3c-071e-4893-9d06-1056ba962077, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 09/15/26 21:33:58.332 (205ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 09/15/26 21:33:58.332&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 09/15/26 21:33:58.332 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 09/15/26 21:33:58.332&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 09/15/26 21:33:58.332 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/pipeline_with_artifact_upload_download.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="130.950320999">
              <system-out>2026/09/15 21:34:43 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 09/15/26 21:32:32.468&#xA;Create an experiment with name E2EExperiment-1789507952468321453&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 09/15/26 21:32:32.695 (227ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 09/15/26 21:32:32.695&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x292ff9054e80&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 09/15/26 21:32:32.874 (179ms)&#xA;&gt; Enter [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 09/15/26 21:32:32.875&#xA;Uploading pipeline file critical/pipeline_with_artifact_upload_download.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1789507952695896452, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml&#xA;Upload of pipeline file &#39;critical/pipeline_with_artifact_upload_download.yaml&#39; successful&#xA;Listing pipeline versions for pipeline da4fdbbb-895c-45f8-9a5b-1eca22fe13d2&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;da4fdbbb-895c-45f8-9a5b-1eca22fe13d2&#39; and name: &#39;e2e-test-1789507952695896452&#39;&#xA;Create a pipeline run for pipeline with id=da4fdbbb-895c-45f8-9a5b-1eca22fe13d2 and versionId=fd3d266c-e0f0-4b2f-8319-e90493533acf&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=d043966c-c391-4060-912a-235181effd0e&#xA;Created Pipeline Run with id: d043966c-c391-4060-912a-235181effd0e for pipeline with id: da4fdbbb-895c-45f8-9a5b-1eca22fe13d2&#xA;Waiting for pipeline run with id=d043966c-c391-4060-912a-235181effd0e to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=d043966c-c391-4060-912a-235181effd0e&#xA;Pipeline run with id=d043966c-c391-4060-912a-235181effd0e is in PENDING state, waiting...&#xA;Get a pipeline run with id=d043966c-c391-4060-912a-235181effd0e&#xA;Pipeline run with id=d043966c-c391-4060-912a-235181effd0e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d043966c-c391-4060-912a-235181effd0e&#xA;Pipeline run with id=d043966c-c391-4060-912a-235181effd0e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d043966c-c391-4060-912a-235181effd0e&#xA;Pipeline run with id=d043966c-c391-4060-912a-235181effd0e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d043966c-c391-4060-912a-235181effd0e&#xA;Pipeline run with id=d043966c-c391-4060-912a-235181effd0e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d043966c-c391-4060-912a-235181effd0e&#xA;Pipeline run with id=d043966c-c391-4060-912a-235181effd0e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d043966c-c391-4060-912a-235181effd0e&#xA;Pipeline run with id=d043966c-c391-4060-912a-235181effd0e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d043966c-c391-4060-912a-235181effd0e&#xA;Pipeline run with id=d043966c-c391-4060-912a-235181effd0e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d043966c-c391-4060-912a-235181effd0e&#xA;Pipeline run with id=d043966c-c391-4060-912a-235181effd0e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d043966c-c391-4060-912a-235181effd0e&#xA;Pipeline run with id=d043966c-c391-4060-912a-235181effd0e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d043966c-c391-4060-912a-235181effd0e&#xA;Pipeline run with id=d043966c-c391-4060-912a-235181effd0e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d043966c-c391-4060-912a-235181effd0e&#xA;Pipeline run with id=d043966c-c391-4060-912a-235181effd0e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d043966c-c391-4060-912a-235181effd0e&#xA;Pipeline run with id=d043966c-c391-4060-912a-235181effd0e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d043966c-c391-4060-912a-235181effd0e&#xA;Pipeline run with id=d043966c-c391-4060-912a-235181effd0e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d043966c-c391-4060-912a-235181effd0e&#xA;Pipeline run with id=d043966c-c391-4060-912a-235181effd0e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d043966c-c391-4060-912a-235181effd0e&#xA;Pipeline run with id=d043966c-c391-4060-912a-235181effd0e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d043966c-c391-4060-912a-235181effd0e&#xA;Pipeline run with id=d043966c-c391-4060-912a-235181effd0e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d043966c-c391-4060-912a-235181effd0e&#xA;Pipeline run with id=d043966c-c391-4060-912a-235181effd0e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d043966c-c391-4060-912a-235181effd0e&#xA;Pipeline run with id=d043966c-c391-4060-912a-235181effd0e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d043966c-c391-4060-912a-235181effd0e&#xA;Pipeline run with id=d043966c-c391-4060-912a-235181effd0e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d043966c-c391-4060-912a-235181effd0e&#xA;Pipeline run with id=d043966c-c391-4060-912a-235181effd0e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d043966c-c391-4060-912a-235181effd0e&#xA;Pipeline run with id=d043966c-c391-4060-912a-235181effd0e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d043966c-c391-4060-912a-235181effd0e&#xA;Pipeline run with id=d043966c-c391-4060-912a-235181effd0e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d043966c-c391-4060-912a-235181effd0e&#xA;Pipeline run with id=d043966c-c391-4060-912a-235181effd0e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d043966c-c391-4060-912a-235181effd0e&#xA;Pipeline run with id=d043966c-c391-4060-912a-235181effd0e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d043966c-c391-4060-912a-235181effd0e&#xA;Pipeline run with id=d043966c-c391-4060-912a-235181effd0e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=d043966c-c391-4060-912a-235181effd0e&#xA;Pipeline run with id=d043966c-c391-4060-912a-235181effd0e reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/pipeline_with_artifact_upload_download.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=d043966c-c391-4060-912a-235181effd0e&#xA;Get a pipeline run with id=d043966c-c391-4060-912a-235181effd0e&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 09/15/26 21:34:43.324 (2m10.45s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 09/15/26 21:34:43.325&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run d043966c-c391-4060-912a-235181effd0e&#xA;Failed to terminate run d043966c-c391-4060-912a-235181effd0e&#xA;Terminate run d043966c-c391-4060-912a-235181effd0e&#xA;Deleting run d043966c-c391-4060-912a-235181effd0e&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=da4fdbbb-895c-45f8-9a5b-1eca22fe13d2 (cascade=true)&#xA;Pipeline with id=da4fdbbb-895c-45f8-9a5b-1eca22fe13d2, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 09/15/26 21:34:43.418 (93ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 09/15/26 21:34:43.418&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 09/15/26 21:34:43.418 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 09/15/26 21:34:43.419&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 09/15/26 21:34:43.419 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/flip_coin.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="166.113393954">
              <system-out>2026/09/15 21:35:18 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 09/15/26 21:32:32.468&#xA;Create an experiment with name E2EExperiment-1789507952468017344&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 09/15/26 21:32:32.695 (228ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 09/15/26 21:32:32.695&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x20ed75652300&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 09/15/26 21:32:32.875 (179ms)&#xA;&gt; Enter [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 09/15/26 21:32:32.875&#xA;Uploading pipeline file critical/flip_coin.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1789507952695829610, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml&#xA;Upload of pipeline file &#39;critical/flip_coin.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 301292b2-ace3-4354-b44a-5284fd070355&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;301292b2-ace3-4354-b44a-5284fd070355&#39; and name: &#39;e2e-test-1789507952695829610&#39;&#xA;Create a pipeline run for pipeline with id=301292b2-ace3-4354-b44a-5284fd070355 and versionId=1b5eb456-bb6a-4555-a012-3b4e5a652053&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=f28effd0-6815-413b-ad23-99d8973df10d&#xA;Created Pipeline Run with id: f28effd0-6815-413b-ad23-99d8973df10d for pipeline with id: 301292b2-ace3-4354-b44a-5284fd070355&#xA;Waiting for pipeline run with id=f28effd0-6815-413b-ad23-99d8973df10d to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=f28effd0-6815-413b-ad23-99d8973df10d&#xA;Pipeline run with id=f28effd0-6815-413b-ad23-99d8973df10d is in PENDING state, waiting...&#xA;Get a pipeline run with id=f28effd0-6815-413b-ad23-99d8973df10d&#xA;Pipeline run with id=f28effd0-6815-413b-ad23-99d8973df10d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f28effd0-6815-413b-ad23-99d8973df10d&#xA;Pipeline run with id=f28effd0-6815-413b-ad23-99d8973df10d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f28effd0-6815-413b-ad23-99d8973df10d&#xA;Pipeline run with id=f28effd0-6815-413b-ad23-99d8973df10d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f28effd0-6815-413b-ad23-99d8973df10d&#xA;Pipeline run with id=f28effd0-6815-413b-ad23-99d8973df10d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f28effd0-6815-413b-ad23-99d8973df10d&#xA;Pipeline run with id=f28effd0-6815-413b-ad23-99d8973df10d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f28effd0-6815-413b-ad23-99d8973df10d&#xA;Pipeline run with id=f28effd0-6815-413b-ad23-99d8973df10d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f28effd0-6815-413b-ad23-99d8973df10d&#xA;Pipeline run with id=f28effd0-6815-413b-ad23-99d8973df10d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f28effd0-6815-413b-ad23-99d8973df10d&#xA;Pipeline run with id=f28effd0-6815-413b-ad23-99d8973df10d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f28effd0-6815-413b-ad23-99d8973df10d&#xA;Pipeline run with id=f28effd0-6815-413b-ad23-99d8973df10d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f28effd0-6815-413b-ad23-99d8973df10d&#xA;Pipeline run with id=f28effd0-6815-413b-ad23-99d8973df10d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f28effd0-6815-413b-ad23-99d8973df10d&#xA;Pipeline run with id=f28effd0-6815-413b-ad23-99d8973df10d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f28effd0-6815-413b-ad23-99d8973df10d&#xA;Pipeline run with id=f28effd0-6815-413b-ad23-99d8973df10d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f28effd0-6815-413b-ad23-99d8973df10d&#xA;Pipeline run with id=f28effd0-6815-413b-ad23-99d8973df10d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f28effd0-6815-413b-ad23-99d8973df10d&#xA;Pipeline run with id=f28effd0-6815-413b-ad23-99d8973df10d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f28effd0-6815-413b-ad23-99d8973df10d&#xA;Pipeline run with id=f28effd0-6815-413b-ad23-99d8973df10d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f28effd0-6815-413b-ad23-99d8973df10d&#xA;Pipeline run with id=f28effd0-6815-413b-ad23-99d8973df10d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f28effd0-6815-413b-ad23-99d8973df10d&#xA;Pipeline run with id=f28effd0-6815-413b-ad23-99d8973df10d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f28effd0-6815-413b-ad23-99d8973df10d&#xA;Pipeline run with id=f28effd0-6815-413b-ad23-99d8973df10d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f28effd0-6815-413b-ad23-99d8973df10d&#xA;Pipeline run with id=f28effd0-6815-413b-ad23-99d8973df10d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f28effd0-6815-413b-ad23-99d8973df10d&#xA;Pipeline run with id=f28effd0-6815-413b-ad23-99d8973df10d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f28effd0-6815-413b-ad23-99d8973df10d&#xA;Pipeline run with id=f28effd0-6815-413b-ad23-99d8973df10d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f28effd0-6815-413b-ad23-99d8973df10d&#xA;Pipeline run with id=f28effd0-6815-413b-ad23-99d8973df10d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f28effd0-6815-413b-ad23-99d8973df10d&#xA;Pipeline run with id=f28effd0-6815-413b-ad23-99d8973df10d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f28effd0-6815-413b-ad23-99d8973df10d&#xA;Pipeline run with id=f28effd0-6815-413b-ad23-99d8973df10d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f28effd0-6815-413b-ad23-99d8973df10d&#xA;Pipeline run with id=f28effd0-6815-413b-ad23-99d8973df10d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f28effd0-6815-413b-ad23-99d8973df10d&#xA;Pipeline run with id=f28effd0-6815-413b-ad23-99d8973df10d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f28effd0-6815-413b-ad23-99d8973df10d&#xA;Pipeline run with id=f28effd0-6815-413b-ad23-99d8973df10d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f28effd0-6815-413b-ad23-99d8973df10d&#xA;Pipeline run with id=f28effd0-6815-413b-ad23-99d8973df10d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f28effd0-6815-413b-ad23-99d8973df10d&#xA;Pipeline run with id=f28effd0-6815-413b-ad23-99d8973df10d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f28effd0-6815-413b-ad23-99d8973df10d&#xA;Pipeline run with id=f28effd0-6815-413b-ad23-99d8973df10d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f28effd0-6815-413b-ad23-99d8973df10d&#xA;Pipeline run with id=f28effd0-6815-413b-ad23-99d8973df10d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f28effd0-6815-413b-ad23-99d8973df10d&#xA;Pipeline run with id=f28effd0-6815-413b-ad23-99d8973df10d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=f28effd0-6815-413b-ad23-99d8973df10d&#xA;Pipeline run with id=f28effd0-6815-413b-ad23-99d8973df10d reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/flip_coin.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=f28effd0-6815-413b-ad23-99d8973df10d&#xA;Get a pipeline run with id=f28effd0-6815-413b-ad23-99d8973df10d&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 09/15/26 21:35:18.465 (2m45.59s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 09/15/26 21:35:18.465&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run f28effd0-6815-413b-ad23-99d8973df10d&#xA;Failed to terminate run f28effd0-6815-413b-ad23-99d8973df10d&#xA;Terminate run f28effd0-6815-413b-ad23-99d8973df10d&#xA;Deleting run f28effd0-6815-413b-ad23-99d8973df10d&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=301292b2-ace3-4354-b44a-5284fd070355 (cascade=true)&#xA;Pipeline with id=301292b2-ace3-4354-b44a-5284fd070355, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 09/15/26 21:35:18.581 (115ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 09/15/26 21:35:18.581&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 09/15/26 21:35:18.581 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 09/15/26 21:35:18.581&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 09/15/26 21:35:18.582 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload essential/iris_pipeline_compiled.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="195.821432775">
              <system-out>2026/09/15 21:35:48 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 09/15/26 21:32:32.478&#xA;Create an experiment with name E2EExperiment-1789507952478891711&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 09/15/26 21:32:32.689 (211ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 09/15/26 21:32:32.689&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x33f6ff4dcb00&#xA;test-secret-1 created&#xA;test-secret-2 created&#xA;test-secret-3 created&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 09/15/26 21:32:32.797 (108ms)&#xA;&gt; Enter [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 09/15/26 21:32:32.797&#xA;Uploading pipeline file essential/iris_pipeline_compiled.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1789507952689828466, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml&#xA;Upload of pipeline file &#39;essential/iris_pipeline_compiled.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 8379716d-d8a5-4ea5-af68-fd55cd164742&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;8379716d-d8a5-4ea5-af68-fd55cd164742&#39; and name: &#39;e2e-test-1789507952689828466&#39;&#xA;Create a pipeline run for pipeline with id=8379716d-d8a5-4ea5-af68-fd55cd164742 and versionId=f9b65204-655e-4378-9fb3-e1e9f24ca669&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=76be78df-fe97-4a89-8c30-daaff0f00edb&#xA;Created Pipeline Run with id: 76be78df-fe97-4a89-8c30-daaff0f00edb for pipeline with id: 8379716d-d8a5-4ea5-af68-fd55cd164742&#xA;Waiting for pipeline run with id=76be78df-fe97-4a89-8c30-daaff0f00edb to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=76be78df-fe97-4a89-8c30-daaff0f00edb&#xA;Pipeline run with id=76be78df-fe97-4a89-8c30-daaff0f00edb is in PENDING state, waiting...&#xA;Get a pipeline run with id=76be78df-fe97-4a89-8c30-daaff0f00edb&#xA;Pipeline run with id=76be78df-fe97-4a89-8c30-daaff0f00edb is in RUNNING state, waiting...&#xA;Get a pipeline run with id=76be78df-fe97-4a89-8c30-daaff0f00edb&#xA;Pipeline run with id=76be78df-fe97-4a89-8c30-daaff0f00edb is in RUNNING state, waiting...&#xA;Get a pipeline run with id=76be78df-fe97-4a89-8c30-daaff0f00edb&#xA;Pipeline run with id=76be78df-fe97-4a89-8c30-daaff0f00edb is in RUNNING state, waiting...&#xA;Get a pipeline run with id=76be78df-fe97-4a89-8c30-daaff0f00edb&#xA;Pipeline run with id=76be78df-fe97-4a89-8c30-daaff0f00edb is in RUNNING state, waiting...&#xA;Get a pipeline run with id=76be78df-fe97-4a89-8c30-daaff0f00edb&#xA;Pipeline run with id=76be78df-fe97-4a89-8c30-daaff0f00edb is in RUNNING state, waiting...&#xA;Get a pipeline run with id=76be78df-fe97-4a89-8c30-daaff0f00edb&#xA;Pipeline run with id=76be78df-fe97-4a89-8c30-daaff0f00edb is in RUNNING state, waiting...&#xA;Get a pipeline run with id=76be78df-fe97-4a89-8c30-daaff0f00edb&#xA;Pipeline run with id=76be78df-fe97-4a89-8c30-daaff0f00edb is in RUNNING state, waiting...&#xA;Get a pipeline run with id=76be78df-fe97-4a89-8c30-daaff0f00edb&#xA;Pipeline run with id=76be78df-fe97-4a89-8c30-daaff0f00edb is in RUNNING state, waiting...&#xA;Get a pipeline run with id=76be78df-fe97-4a89-8c30-daaff0f00edb&#xA;Pipeline run with id=76be78df-fe97-4a89-8c30-daaff0f00edb is in RUNNING state, waiting...&#xA;Get a pipeline run with id=76be78df-fe97-4a89-8c30-daaff0f00edb&#xA;Pipeline run with id=76be78df-fe97-4a89-8c30-daaff0f00edb is in RUNNING state, waiting...&#xA;Get a pipeline run with id=76be78df-fe97-4a89-8c30-daaff0f00edb&#xA;Pipeline run with id=76be78df-fe97-4a89-8c30-daaff0f00edb is in RUNNING state, waiting...&#xA;Get a pipeline run with id=76be78df-fe97-4a89-8c30-daaff0f00edb&#xA;Pipeline run with id=76be78df-fe97-4a89-8c30-daaff0f00edb is in RUNNING state, waiting...&#xA;Get a pipeline run with id=76be78df-fe97-4a89-8c30-daaff0f00edb&#xA;Pipeline run with id=76be78df-fe97-4a89-8c30-daaff0f00edb is in RUNNING state, waiting...&#xA;Get a pipeline run with id=76be78df-fe97-4a89-8c30-daaff0f00edb&#xA;Pipeline run with id=76be78df-fe97-4a89-8c30-daaff0f00edb is in RUNNING state, waiting...&#xA;Get a pipeline run with id=76be78df-fe97-4a89-8c30-daaff0f00edb&#xA;Pipeline run with id=76be78df-fe97-4a89-8c30-daaff0f00edb is in RUNNING state, waiting...&#xA;Get a pipeline run with id=76be78df-fe97-4a89-8c30-daaff0f00edb&#xA;Pipeline run with id=76be78df-fe97-4a89-8c30-daaff0f00edb is in RUNNING state, waiting...&#xA;Get a pipeline run with id=76be78df-fe97-4a89-8c30-daaff0f00edb&#xA;Pipeline run with id=76be78df-fe97-4a89-8c30-daaff0f00edb is in RUNNING state, waiting...&#xA;Get a pipeline run with id=76be78df-fe97-4a89-8c30-daaff0f00edb&#xA;Pipeline run with id=76be78df-fe97-4a89-8c30-daaff0f00edb is in RUNNING state, waiting...&#xA;Get a pipeline run with id=76be78df-fe97-4a89-8c30-daaff0f00edb&#xA;Pipeline run with id=76be78df-fe97-4a89-8c30-daaff0f00edb is in RUNNING state, waiting...&#xA;Get a pipeline run with id=76be78df-fe97-4a89-8c30-daaff0f00edb&#xA;Pipeline run with id=76be78df-fe97-4a89-8c30-daaff0f00edb is in RUNNING state, waiting...&#xA;Get a pipeline run with id=76be78df-fe97-4a89-8c30-daaff0f00edb&#xA;Pipeline run with id=76be78df-fe97-4a89-8c30-daaff0f00edb is in RUNNING state, waiting...&#xA;Get a pipeline run with id=76be78df-fe97-4a89-8c30-daaff0f00edb&#xA;Pipeline run with id=76be78df-fe97-4a89-8c30-daaff0f00edb is in RUNNING state, waiting...&#xA;Get a pipeline run with id=76be78df-fe97-4a89-8c30-daaff0f00edb&#xA;Pipeline run with id=76be78df-fe97-4a89-8c30-daaff0f00edb is in RUNNING state, waiting...&#xA;Get a pipeline run with id=76be78df-fe97-4a89-8c30-daaff0f00edb&#xA;Pipeline run with id=76be78df-fe97-4a89-8c30-daaff0f00edb is in RUNNING state, waiting...&#xA;Get a pipeline run with id=76be78df-fe97-4a89-8c30-daaff0f00edb&#xA;Pipeline run with id=76be78df-fe97-4a89-8c30-daaff0f00edb is in RUNNING state, waiting...&#xA;Get a pipeline run with id=76be78df-fe97-4a89-8c30-daaff0f00edb&#xA;Pipeline run with id=76be78df-fe97-4a89-8c30-daaff0f00edb is in RUNNING state, waiting...&#xA;Get a pipeline run with id=76be78df-fe97-4a89-8c30-daaff0f00edb&#xA;Pipeline run with id=76be78df-fe97-4a89-8c30-daaff0f00edb is in RUNNING state, waiting...&#xA;Get a pipeline run with id=76be78df-fe97-4a89-8c30-daaff0f00edb&#xA;Pipeline run with id=76be78df-fe97-4a89-8c30-daaff0f00edb is in RUNNING state, waiting...&#xA;Get a pipeline run with id=76be78df-fe97-4a89-8c30-daaff0f00edb&#xA;Pipeline run with id=76be78df-fe97-4a89-8c30-daaff0f00edb is in RUNNING state, waiting...&#xA;Get a pipeline run with id=76be78df-fe97-4a89-8c30-daaff0f00edb&#xA;Pipeline run with id=76be78df-fe97-4a89-8c30-daaff0f00edb is in RUNNING state, waiting...&#xA;Get a pipeline run with id=76be78df-fe97-4a89-8c30-daaff0f00edb&#xA;Pipeline run with id=76be78df-fe97-4a89-8c30-daaff0f00edb is in RUNNING state, waiting...&#xA;Get a pipeline run with id=76be78df-fe97-4a89-8c30-daaff0f00edb&#xA;Pipeline run with id=76be78df-fe97-4a89-8c30-daaff0f00edb is in RUNNING state, waiting...&#xA;Get a pipeline run with id=76be78df-fe97-4a89-8c30-daaff0f00edb&#xA;Pipeline run with id=76be78df-fe97-4a89-8c30-daaff0f00edb is in RUNNING state, waiting...&#xA;Get a pipeline run with id=76be78df-fe97-4a89-8c30-daaff0f00edb&#xA;Pipeline run with id=76be78df-fe97-4a89-8c30-daaff0f00edb is in RUNNING state, waiting...&#xA;Get a pipeline run with id=76be78df-fe97-4a89-8c30-daaff0f00edb&#xA;Pipeline run with id=76be78df-fe97-4a89-8c30-daaff0f00edb is in RUNNING state, waiting...&#xA;Get a pipeline run with id=76be78df-fe97-4a89-8c30-daaff0f00edb&#xA;Pipeline run with id=76be78df-fe97-4a89-8c30-daaff0f00edb is in RUNNING state, waiting...&#xA;Get a pipeline run with id=76be78df-fe97-4a89-8c30-daaff0f00edb&#xA;Pipeline run with id=76be78df-fe97-4a89-8c30-daaff0f00edb is in RUNNING state, waiting...&#xA;Get a pipeline run with id=76be78df-fe97-4a89-8c30-daaff0f00edb&#xA;Pipeline run with id=76be78df-fe97-4a89-8c30-daaff0f00edb is in RUNNING state, waiting...&#xA;Get a pipeline run with id=76be78df-fe97-4a89-8c30-daaff0f00edb&#xA;Pipeline run with id=76be78df-fe97-4a89-8c30-daaff0f00edb reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;essential/iris_pipeline_compiled.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=76be78df-fe97-4a89-8c30-daaff0f00edb&#xA;Get a pipeline run with id=76be78df-fe97-4a89-8c30-daaff0f00edb&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 09/15/26 21:35:48.198 (3m15.401s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 09/15/26 21:35:48.198&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 76be78df-fe97-4a89-8c30-daaff0f00edb&#xA;Failed to terminate run 76be78df-fe97-4a89-8c30-daaff0f00edb&#xA;Terminate run 76be78df-fe97-4a89-8c30-daaff0f00edb&#xA;Deleting run 76be78df-fe97-4a89-8c30-daaff0f00edb&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=8379716d-d8a5-4ea5-af68-fd55cd164742 (cascade=true)&#xA;Pipeline with id=8379716d-d8a5-4ea5-af68-fd55cd164742, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 09/15/26 21:35:48.3 (101ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 09/15/26 21:35:48.3&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 09/15/26 21:35:48.3 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 09/15/26 21:35:48.3&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 09/15/26 21:35:48.3 (0s)&#xA;</system-err>
          </testcase>
      </testsuite>
  </testsuites>