<?xml version="1.0" encoding="UTF-8"?>
  <testsuites tests="5" disabled="0" errors="0" failures="0" time="186.047126736">
      <testsuite name="AIPipelinesE2ETests" package="/dspa/backend/test/end2end" tests="5" disabled="0" skipped="0" errors="0" failures="0" time="186.047126736" timestamp="2026-07-05T07:01:18">
          <properties>
              <property name="SuiteSucceeded" value="true"></property>
              <property name="SuiteHasProgrammaticFocus" value="false"></property>
              <property name="SpecialSuiteFailureReason" value=""></property>
              <property name="SuiteLabels" value="[]"></property>
              <property name="SuiteSemVerConstraints" value="[]"></property>
              <property name="RandomSeed" value="1783234717"></property>
              <property name="RandomizeAllSpecs" value="false"></property>
              <property name="LabelFilter" value="Smoke"></property>
              <property name="SemVerFilter" value=""></property>
              <property name="FocusStrings" value=""></property>
              <property name="SkipStrings" value=""></property>
              <property name="FocusFiles" value=""></property>
              <property name="SkipFiles" value=""></property>
              <property name="FailOnPending" value="false"></property>
              <property name="FailOnEmpty" value="false"></property>
              <property name="FailFast" value="false"></property>
              <property name="FlakeAttempts" value="0"></property>
              <property name="DryRun" value="false"></property>
              <property name="ParallelTotal" value="10"></property>
              <property name="OutputInterceptorMode" value=""></property>
          </properties>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/parallel_for_after_dependency.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="116.023126029">
              <system-out>2026/07/05 07:03:14 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/05/26 07:01:18.257&#xA;Create an experiment with name E2EExperiment-1783234878257153014&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/05/26 07:01:18.566 (309ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/05/26 07:01:18.566&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x96fe41c8d80&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/05/26 07:01:18.609 (43ms)&#xA;&gt; Enter [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/05/26 07:01:18.609&#xA;Uploading pipeline file critical/parallel_for_after_dependency.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1783234878566621435, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml&#xA;Upload of pipeline file &#39;critical/parallel_for_after_dependency.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 0f3e1176-7217-4bdf-843d-8db0dd3a07db&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;0f3e1176-7217-4bdf-843d-8db0dd3a07db&#39; and name: &#39;e2e-test-1783234878566621435&#39;&#xA;Create a pipeline run for pipeline with id=0f3e1176-7217-4bdf-843d-8db0dd3a07db and versionId=c8ad1ca1-740c-467c-9c69-13d4cf9e2183&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=1d8fe117-1622-43d3-a1a4-45f6a4a8f9e1&#xA;Created Pipeline Run with id: 1d8fe117-1622-43d3-a1a4-45f6a4a8f9e1 for pipeline with id: 0f3e1176-7217-4bdf-843d-8db0dd3a07db&#xA;Waiting for pipeline run with id=1d8fe117-1622-43d3-a1a4-45f6a4a8f9e1 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=1d8fe117-1622-43d3-a1a4-45f6a4a8f9e1&#xA;Pipeline run with id=1d8fe117-1622-43d3-a1a4-45f6a4a8f9e1 is in PENDING state, waiting...&#xA;Get a pipeline run with id=1d8fe117-1622-43d3-a1a4-45f6a4a8f9e1&#xA;Pipeline run with id=1d8fe117-1622-43d3-a1a4-45f6a4a8f9e1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1d8fe117-1622-43d3-a1a4-45f6a4a8f9e1&#xA;Pipeline run with id=1d8fe117-1622-43d3-a1a4-45f6a4a8f9e1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1d8fe117-1622-43d3-a1a4-45f6a4a8f9e1&#xA;Pipeline run with id=1d8fe117-1622-43d3-a1a4-45f6a4a8f9e1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1d8fe117-1622-43d3-a1a4-45f6a4a8f9e1&#xA;Pipeline run with id=1d8fe117-1622-43d3-a1a4-45f6a4a8f9e1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1d8fe117-1622-43d3-a1a4-45f6a4a8f9e1&#xA;Pipeline run with id=1d8fe117-1622-43d3-a1a4-45f6a4a8f9e1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1d8fe117-1622-43d3-a1a4-45f6a4a8f9e1&#xA;Pipeline run with id=1d8fe117-1622-43d3-a1a4-45f6a4a8f9e1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1d8fe117-1622-43d3-a1a4-45f6a4a8f9e1&#xA;Pipeline run with id=1d8fe117-1622-43d3-a1a4-45f6a4a8f9e1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1d8fe117-1622-43d3-a1a4-45f6a4a8f9e1&#xA;Pipeline run with id=1d8fe117-1622-43d3-a1a4-45f6a4a8f9e1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1d8fe117-1622-43d3-a1a4-45f6a4a8f9e1&#xA;Pipeline run with id=1d8fe117-1622-43d3-a1a4-45f6a4a8f9e1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1d8fe117-1622-43d3-a1a4-45f6a4a8f9e1&#xA;Pipeline run with id=1d8fe117-1622-43d3-a1a4-45f6a4a8f9e1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1d8fe117-1622-43d3-a1a4-45f6a4a8f9e1&#xA;Pipeline run with id=1d8fe117-1622-43d3-a1a4-45f6a4a8f9e1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1d8fe117-1622-43d3-a1a4-45f6a4a8f9e1&#xA;Pipeline run with id=1d8fe117-1622-43d3-a1a4-45f6a4a8f9e1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1d8fe117-1622-43d3-a1a4-45f6a4a8f9e1&#xA;Pipeline run with id=1d8fe117-1622-43d3-a1a4-45f6a4a8f9e1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1d8fe117-1622-43d3-a1a4-45f6a4a8f9e1&#xA;Pipeline run with id=1d8fe117-1622-43d3-a1a4-45f6a4a8f9e1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1d8fe117-1622-43d3-a1a4-45f6a4a8f9e1&#xA;Pipeline run with id=1d8fe117-1622-43d3-a1a4-45f6a4a8f9e1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1d8fe117-1622-43d3-a1a4-45f6a4a8f9e1&#xA;Pipeline run with id=1d8fe117-1622-43d3-a1a4-45f6a4a8f9e1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1d8fe117-1622-43d3-a1a4-45f6a4a8f9e1&#xA;Pipeline run with id=1d8fe117-1622-43d3-a1a4-45f6a4a8f9e1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1d8fe117-1622-43d3-a1a4-45f6a4a8f9e1&#xA;Pipeline run with id=1d8fe117-1622-43d3-a1a4-45f6a4a8f9e1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1d8fe117-1622-43d3-a1a4-45f6a4a8f9e1&#xA;Pipeline run with id=1d8fe117-1622-43d3-a1a4-45f6a4a8f9e1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1d8fe117-1622-43d3-a1a4-45f6a4a8f9e1&#xA;Pipeline run with id=1d8fe117-1622-43d3-a1a4-45f6a4a8f9e1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1d8fe117-1622-43d3-a1a4-45f6a4a8f9e1&#xA;Pipeline run with id=1d8fe117-1622-43d3-a1a4-45f6a4a8f9e1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1d8fe117-1622-43d3-a1a4-45f6a4a8f9e1&#xA;Pipeline run with id=1d8fe117-1622-43d3-a1a4-45f6a4a8f9e1 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1d8fe117-1622-43d3-a1a4-45f6a4a8f9e1&#xA;Pipeline run with id=1d8fe117-1622-43d3-a1a4-45f6a4a8f9e1 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/parallel_for_after_dependency.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=1d8fe117-1622-43d3-a1a4-45f6a4a8f9e1&#xA;Get a pipeline run with id=1d8fe117-1622-43d3-a1a4-45f6a4a8f9e1&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/05/26 07:03:14.159 (1m55.55s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/05/26 07:03:14.159&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 1d8fe117-1622-43d3-a1a4-45f6a4a8f9e1&#xA;Failed to terminate run 1d8fe117-1622-43d3-a1a4-45f6a4a8f9e1&#xA;Terminate run 1d8fe117-1622-43d3-a1a4-45f6a4a8f9e1&#xA;Deleting run 1d8fe117-1622-43d3-a1a4-45f6a4a8f9e1&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=0f3e1176-7217-4bdf-843d-8db0dd3a07db (cascade=true)&#xA;Pipeline with id=0f3e1176-7217-4bdf-843d-8db0dd3a07db, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/05/26 07:03:14.28 (121ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/05/26 07:03:14.28&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/05/26 07:03:14.28 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/05/26 07:03:14.28&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/05/26 07:03:14.28 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload essential/component_with_pip_index_urls.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="80.944623106">
              <system-out>2026/07/05 07:02:39 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/05/26 07:01:18.257&#xA;Create an experiment with name E2EExperiment-1783234878257092553&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/05/26 07:01:18.565 (309ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/05/26 07:01:18.565&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x1aaf4be8f00&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/05/26 07:01:18.62 (54ms)&#xA;&gt; Enter [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/05/26 07:01:18.62&#xA;Uploading pipeline file essential/component_with_pip_index_urls.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1783234878566012348, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml&#xA;Upload of pipeline file &#39;essential/component_with_pip_index_urls.yaml&#39; successful&#xA;Listing pipeline versions for pipeline ac65f85e-0f75-445b-8fdd-89e79f8f382a&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;ac65f85e-0f75-445b-8fdd-89e79f8f382a&#39; and name: &#39;e2e-test-1783234878566012348&#39;&#xA;Create a pipeline run for pipeline with id=ac65f85e-0f75-445b-8fdd-89e79f8f382a and versionId=9c168353-1797-42f0-817d-50ae1349b4c6&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=b2f4f1cf-372c-415d-8efb-199aff886a79&#xA;Created Pipeline Run with id: b2f4f1cf-372c-415d-8efb-199aff886a79 for pipeline with id: ac65f85e-0f75-445b-8fdd-89e79f8f382a&#xA;Waiting for pipeline run with id=b2f4f1cf-372c-415d-8efb-199aff886a79 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=b2f4f1cf-372c-415d-8efb-199aff886a79&#xA;Pipeline run with id=b2f4f1cf-372c-415d-8efb-199aff886a79 is in PENDING state, waiting...&#xA;Get a pipeline run with id=b2f4f1cf-372c-415d-8efb-199aff886a79&#xA;Pipeline run with id=b2f4f1cf-372c-415d-8efb-199aff886a79 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b2f4f1cf-372c-415d-8efb-199aff886a79&#xA;Pipeline run with id=b2f4f1cf-372c-415d-8efb-199aff886a79 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b2f4f1cf-372c-415d-8efb-199aff886a79&#xA;Pipeline run with id=b2f4f1cf-372c-415d-8efb-199aff886a79 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b2f4f1cf-372c-415d-8efb-199aff886a79&#xA;Pipeline run with id=b2f4f1cf-372c-415d-8efb-199aff886a79 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b2f4f1cf-372c-415d-8efb-199aff886a79&#xA;Pipeline run with id=b2f4f1cf-372c-415d-8efb-199aff886a79 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b2f4f1cf-372c-415d-8efb-199aff886a79&#xA;Pipeline run with id=b2f4f1cf-372c-415d-8efb-199aff886a79 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b2f4f1cf-372c-415d-8efb-199aff886a79&#xA;Pipeline run with id=b2f4f1cf-372c-415d-8efb-199aff886a79 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b2f4f1cf-372c-415d-8efb-199aff886a79&#xA;Pipeline run with id=b2f4f1cf-372c-415d-8efb-199aff886a79 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b2f4f1cf-372c-415d-8efb-199aff886a79&#xA;Pipeline run with id=b2f4f1cf-372c-415d-8efb-199aff886a79 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b2f4f1cf-372c-415d-8efb-199aff886a79&#xA;Pipeline run with id=b2f4f1cf-372c-415d-8efb-199aff886a79 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b2f4f1cf-372c-415d-8efb-199aff886a79&#xA;Pipeline run with id=b2f4f1cf-372c-415d-8efb-199aff886a79 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b2f4f1cf-372c-415d-8efb-199aff886a79&#xA;Pipeline run with id=b2f4f1cf-372c-415d-8efb-199aff886a79 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b2f4f1cf-372c-415d-8efb-199aff886a79&#xA;Pipeline run with id=b2f4f1cf-372c-415d-8efb-199aff886a79 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b2f4f1cf-372c-415d-8efb-199aff886a79&#xA;Pipeline run with id=b2f4f1cf-372c-415d-8efb-199aff886a79 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b2f4f1cf-372c-415d-8efb-199aff886a79&#xA;Pipeline run with id=b2f4f1cf-372c-415d-8efb-199aff886a79 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b2f4f1cf-372c-415d-8efb-199aff886a79&#xA;Pipeline run with id=b2f4f1cf-372c-415d-8efb-199aff886a79 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;essential/component_with_pip_index_urls.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=b2f4f1cf-372c-415d-8efb-199aff886a79&#xA;Get a pipeline run with id=b2f4f1cf-372c-415d-8efb-199aff886a79&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/05/26 07:02:39.09 (1m20.47s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/05/26 07:02:39.09&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run b2f4f1cf-372c-415d-8efb-199aff886a79&#xA;Failed to terminate run b2f4f1cf-372c-415d-8efb-199aff886a79&#xA;Terminate run b2f4f1cf-372c-415d-8efb-199aff886a79&#xA;Deleting run b2f4f1cf-372c-415d-8efb-199aff886a79&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=ac65f85e-0f75-445b-8fdd-89e79f8f382a (cascade=true)&#xA;Pipeline with id=ac65f85e-0f75-445b-8fdd-89e79f8f382a, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/05/26 07:02:39.201 (111ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/05/26 07:02:39.202&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/05/26 07:02:39.202 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/05/26 07:02:39.202&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/05/26 07:02:39.202 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/pipeline_with_artifact_upload_download.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="125.932764008">
              <system-out>2026/07/05 07:03:24 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/05/26 07:01:18.257&#xA;Create an experiment with name E2EExperiment-1783234878257207506&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/05/26 07:01:18.561 (304ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/05/26 07:01:18.561&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x3c91efb7e900&#xA;test-secret-1 created&#xA;test-secret-2 created&#xA;test-secret-3 created&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/05/26 07:01:18.595 (34ms)&#xA;&gt; Enter [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/05/26 07:01:18.596&#xA;Uploading pipeline file critical/pipeline_with_artifact_upload_download.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1783234878561412128, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml&#xA;Upload of pipeline file &#39;critical/pipeline_with_artifact_upload_download.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 0e4a14e2-8b7c-4150-bc9c-4619f09333f1&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;0e4a14e2-8b7c-4150-bc9c-4619f09333f1&#39; and name: &#39;e2e-test-1783234878561412128&#39;&#xA;Create a pipeline run for pipeline with id=0e4a14e2-8b7c-4150-bc9c-4619f09333f1 and versionId=b2a7c39d-f75a-4125-8b85-63e8d2f081a2&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=71aad0ed-365c-4131-8a3c-3ad10fb12361&#xA;Created Pipeline Run with id: 71aad0ed-365c-4131-8a3c-3ad10fb12361 for pipeline with id: 0e4a14e2-8b7c-4150-bc9c-4619f09333f1&#xA;Waiting for pipeline run with id=71aad0ed-365c-4131-8a3c-3ad10fb12361 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=71aad0ed-365c-4131-8a3c-3ad10fb12361&#xA;Pipeline run with id=71aad0ed-365c-4131-8a3c-3ad10fb12361 is in PENDING state, waiting...&#xA;Get a pipeline run with id=71aad0ed-365c-4131-8a3c-3ad10fb12361&#xA;Pipeline run with id=71aad0ed-365c-4131-8a3c-3ad10fb12361 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=71aad0ed-365c-4131-8a3c-3ad10fb12361&#xA;Pipeline run with id=71aad0ed-365c-4131-8a3c-3ad10fb12361 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=71aad0ed-365c-4131-8a3c-3ad10fb12361&#xA;Pipeline run with id=71aad0ed-365c-4131-8a3c-3ad10fb12361 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=71aad0ed-365c-4131-8a3c-3ad10fb12361&#xA;Pipeline run with id=71aad0ed-365c-4131-8a3c-3ad10fb12361 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=71aad0ed-365c-4131-8a3c-3ad10fb12361&#xA;Pipeline run with id=71aad0ed-365c-4131-8a3c-3ad10fb12361 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=71aad0ed-365c-4131-8a3c-3ad10fb12361&#xA;Pipeline run with id=71aad0ed-365c-4131-8a3c-3ad10fb12361 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=71aad0ed-365c-4131-8a3c-3ad10fb12361&#xA;Pipeline run with id=71aad0ed-365c-4131-8a3c-3ad10fb12361 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=71aad0ed-365c-4131-8a3c-3ad10fb12361&#xA;Pipeline run with id=71aad0ed-365c-4131-8a3c-3ad10fb12361 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=71aad0ed-365c-4131-8a3c-3ad10fb12361&#xA;Pipeline run with id=71aad0ed-365c-4131-8a3c-3ad10fb12361 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=71aad0ed-365c-4131-8a3c-3ad10fb12361&#xA;Pipeline run with id=71aad0ed-365c-4131-8a3c-3ad10fb12361 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=71aad0ed-365c-4131-8a3c-3ad10fb12361&#xA;Pipeline run with id=71aad0ed-365c-4131-8a3c-3ad10fb12361 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=71aad0ed-365c-4131-8a3c-3ad10fb12361&#xA;Pipeline run with id=71aad0ed-365c-4131-8a3c-3ad10fb12361 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=71aad0ed-365c-4131-8a3c-3ad10fb12361&#xA;Pipeline run with id=71aad0ed-365c-4131-8a3c-3ad10fb12361 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=71aad0ed-365c-4131-8a3c-3ad10fb12361&#xA;Pipeline run with id=71aad0ed-365c-4131-8a3c-3ad10fb12361 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=71aad0ed-365c-4131-8a3c-3ad10fb12361&#xA;Pipeline run with id=71aad0ed-365c-4131-8a3c-3ad10fb12361 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=71aad0ed-365c-4131-8a3c-3ad10fb12361&#xA;Pipeline run with id=71aad0ed-365c-4131-8a3c-3ad10fb12361 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=71aad0ed-365c-4131-8a3c-3ad10fb12361&#xA;Pipeline run with id=71aad0ed-365c-4131-8a3c-3ad10fb12361 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=71aad0ed-365c-4131-8a3c-3ad10fb12361&#xA;Pipeline run with id=71aad0ed-365c-4131-8a3c-3ad10fb12361 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=71aad0ed-365c-4131-8a3c-3ad10fb12361&#xA;Pipeline run with id=71aad0ed-365c-4131-8a3c-3ad10fb12361 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=71aad0ed-365c-4131-8a3c-3ad10fb12361&#xA;Pipeline run with id=71aad0ed-365c-4131-8a3c-3ad10fb12361 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=71aad0ed-365c-4131-8a3c-3ad10fb12361&#xA;Pipeline run with id=71aad0ed-365c-4131-8a3c-3ad10fb12361 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=71aad0ed-365c-4131-8a3c-3ad10fb12361&#xA;Pipeline run with id=71aad0ed-365c-4131-8a3c-3ad10fb12361 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=71aad0ed-365c-4131-8a3c-3ad10fb12361&#xA;Pipeline run with id=71aad0ed-365c-4131-8a3c-3ad10fb12361 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=71aad0ed-365c-4131-8a3c-3ad10fb12361&#xA;Pipeline run with id=71aad0ed-365c-4131-8a3c-3ad10fb12361 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=71aad0ed-365c-4131-8a3c-3ad10fb12361&#xA;Pipeline run with id=71aad0ed-365c-4131-8a3c-3ad10fb12361 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/pipeline_with_artifact_upload_download.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=71aad0ed-365c-4131-8a3c-3ad10fb12361&#xA;Get a pipeline run with id=71aad0ed-365c-4131-8a3c-3ad10fb12361&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/05/26 07:03:24.094 (2m5.498s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/05/26 07:03:24.094&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 71aad0ed-365c-4131-8a3c-3ad10fb12361&#xA;Failed to terminate run 71aad0ed-365c-4131-8a3c-3ad10fb12361&#xA;Terminate run 71aad0ed-365c-4131-8a3c-3ad10fb12361&#xA;Deleting run 71aad0ed-365c-4131-8a3c-3ad10fb12361&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=0e4a14e2-8b7c-4150-bc9c-4619f09333f1 (cascade=true)&#xA;Pipeline with id=0e4a14e2-8b7c-4150-bc9c-4619f09333f1, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/05/26 07:03:24.189 (96ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/05/26 07:03:24.19&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/05/26 07:03:24.19 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/05/26 07:03:24.19&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/05/26 07:03:24.19 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/flip_coin.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="150.976785837">
              <system-out>2026/07/05 07:03:49 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/05/26 07:01:18.256&#xA;Create an experiment with name E2EExperiment-1783234878256729333&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/05/26 07:01:18.563 (307ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/05/26 07:01:18.563&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x39ceefaa2380&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/05/26 07:01:18.609 (46ms)&#xA;&gt; Enter [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/05/26 07:01:18.609&#xA;Uploading pipeline file critical/flip_coin.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1783234878563610230, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml&#xA;Upload of pipeline file &#39;critical/flip_coin.yaml&#39; successful&#xA;Listing pipeline versions for pipeline dca22e68-bc64-4bd7-884c-ae50a8b9e2be&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;dca22e68-bc64-4bd7-884c-ae50a8b9e2be&#39; and name: &#39;e2e-test-1783234878563610230&#39;&#xA;Create a pipeline run for pipeline with id=dca22e68-bc64-4bd7-884c-ae50a8b9e2be and versionId=5ca8966d-dad6-4591-a39c-c9b6bda5db04&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=0a220b8d-7411-4f89-85eb-c08abdffdc43&#xA;Created Pipeline Run with id: 0a220b8d-7411-4f89-85eb-c08abdffdc43 for pipeline with id: dca22e68-bc64-4bd7-884c-ae50a8b9e2be&#xA;Waiting for pipeline run with id=0a220b8d-7411-4f89-85eb-c08abdffdc43 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=0a220b8d-7411-4f89-85eb-c08abdffdc43&#xA;Pipeline run with id=0a220b8d-7411-4f89-85eb-c08abdffdc43 is in PENDING state, waiting...&#xA;Get a pipeline run with id=0a220b8d-7411-4f89-85eb-c08abdffdc43&#xA;Pipeline run with id=0a220b8d-7411-4f89-85eb-c08abdffdc43 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0a220b8d-7411-4f89-85eb-c08abdffdc43&#xA;Pipeline run with id=0a220b8d-7411-4f89-85eb-c08abdffdc43 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0a220b8d-7411-4f89-85eb-c08abdffdc43&#xA;Pipeline run with id=0a220b8d-7411-4f89-85eb-c08abdffdc43 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0a220b8d-7411-4f89-85eb-c08abdffdc43&#xA;Pipeline run with id=0a220b8d-7411-4f89-85eb-c08abdffdc43 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0a220b8d-7411-4f89-85eb-c08abdffdc43&#xA;Pipeline run with id=0a220b8d-7411-4f89-85eb-c08abdffdc43 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0a220b8d-7411-4f89-85eb-c08abdffdc43&#xA;Pipeline run with id=0a220b8d-7411-4f89-85eb-c08abdffdc43 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0a220b8d-7411-4f89-85eb-c08abdffdc43&#xA;Pipeline run with id=0a220b8d-7411-4f89-85eb-c08abdffdc43 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0a220b8d-7411-4f89-85eb-c08abdffdc43&#xA;Pipeline run with id=0a220b8d-7411-4f89-85eb-c08abdffdc43 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0a220b8d-7411-4f89-85eb-c08abdffdc43&#xA;Pipeline run with id=0a220b8d-7411-4f89-85eb-c08abdffdc43 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0a220b8d-7411-4f89-85eb-c08abdffdc43&#xA;Pipeline run with id=0a220b8d-7411-4f89-85eb-c08abdffdc43 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0a220b8d-7411-4f89-85eb-c08abdffdc43&#xA;Pipeline run with id=0a220b8d-7411-4f89-85eb-c08abdffdc43 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0a220b8d-7411-4f89-85eb-c08abdffdc43&#xA;Pipeline run with id=0a220b8d-7411-4f89-85eb-c08abdffdc43 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0a220b8d-7411-4f89-85eb-c08abdffdc43&#xA;Pipeline run with id=0a220b8d-7411-4f89-85eb-c08abdffdc43 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0a220b8d-7411-4f89-85eb-c08abdffdc43&#xA;Pipeline run with id=0a220b8d-7411-4f89-85eb-c08abdffdc43 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0a220b8d-7411-4f89-85eb-c08abdffdc43&#xA;Pipeline run with id=0a220b8d-7411-4f89-85eb-c08abdffdc43 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0a220b8d-7411-4f89-85eb-c08abdffdc43&#xA;Pipeline run with id=0a220b8d-7411-4f89-85eb-c08abdffdc43 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0a220b8d-7411-4f89-85eb-c08abdffdc43&#xA;Pipeline run with id=0a220b8d-7411-4f89-85eb-c08abdffdc43 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0a220b8d-7411-4f89-85eb-c08abdffdc43&#xA;Pipeline run with id=0a220b8d-7411-4f89-85eb-c08abdffdc43 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0a220b8d-7411-4f89-85eb-c08abdffdc43&#xA;Pipeline run with id=0a220b8d-7411-4f89-85eb-c08abdffdc43 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0a220b8d-7411-4f89-85eb-c08abdffdc43&#xA;Pipeline run with id=0a220b8d-7411-4f89-85eb-c08abdffdc43 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0a220b8d-7411-4f89-85eb-c08abdffdc43&#xA;Pipeline run with id=0a220b8d-7411-4f89-85eb-c08abdffdc43 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0a220b8d-7411-4f89-85eb-c08abdffdc43&#xA;Pipeline run with id=0a220b8d-7411-4f89-85eb-c08abdffdc43 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0a220b8d-7411-4f89-85eb-c08abdffdc43&#xA;Pipeline run with id=0a220b8d-7411-4f89-85eb-c08abdffdc43 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0a220b8d-7411-4f89-85eb-c08abdffdc43&#xA;Pipeline run with id=0a220b8d-7411-4f89-85eb-c08abdffdc43 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0a220b8d-7411-4f89-85eb-c08abdffdc43&#xA;Pipeline run with id=0a220b8d-7411-4f89-85eb-c08abdffdc43 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0a220b8d-7411-4f89-85eb-c08abdffdc43&#xA;Pipeline run with id=0a220b8d-7411-4f89-85eb-c08abdffdc43 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0a220b8d-7411-4f89-85eb-c08abdffdc43&#xA;Pipeline run with id=0a220b8d-7411-4f89-85eb-c08abdffdc43 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0a220b8d-7411-4f89-85eb-c08abdffdc43&#xA;Pipeline run with id=0a220b8d-7411-4f89-85eb-c08abdffdc43 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0a220b8d-7411-4f89-85eb-c08abdffdc43&#xA;Pipeline run with id=0a220b8d-7411-4f89-85eb-c08abdffdc43 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0a220b8d-7411-4f89-85eb-c08abdffdc43&#xA;Pipeline run with id=0a220b8d-7411-4f89-85eb-c08abdffdc43 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/flip_coin.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=0a220b8d-7411-4f89-85eb-c08abdffdc43&#xA;Get a pipeline run with id=0a220b8d-7411-4f89-85eb-c08abdffdc43&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/05/26 07:03:49.128 (2m30.519s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/05/26 07:03:49.128&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 0a220b8d-7411-4f89-85eb-c08abdffdc43&#xA;Failed to terminate run 0a220b8d-7411-4f89-85eb-c08abdffdc43&#xA;Terminate run 0a220b8d-7411-4f89-85eb-c08abdffdc43&#xA;Deleting run 0a220b8d-7411-4f89-85eb-c08abdffdc43&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=dca22e68-bc64-4bd7-884c-ae50a8b9e2be (cascade=true)&#xA;Pipeline with id=dca22e68-bc64-4bd7-884c-ae50a8b9e2be, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/05/26 07:03:49.233 (105ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/05/26 07:03:49.233&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/05/26 07:03:49.233 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/05/26 07:03:49.234&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/05/26 07:03:49.234 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload essential/iris_pipeline_compiled.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="185.936941106">
              <system-out>2026/07/05 07:04:24 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/05/26 07:01:18.257&#xA;Create an experiment with name E2EExperiment-1783234878257240407&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/05/26 07:01:18.561 (304ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/05/26 07:01:18.561&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0xfbee9f8ed00&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/05/26 07:01:18.608 (47ms)&#xA;&gt; Enter [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/05/26 07:01:18.608&#xA;Uploading pipeline file essential/iris_pipeline_compiled.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1783234878561585953, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml&#xA;Upload of pipeline file &#39;essential/iris_pipeline_compiled.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 5a560137-670b-41eb-b670-8376a9dfe935&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;5a560137-670b-41eb-b670-8376a9dfe935&#39; and name: &#39;e2e-test-1783234878561585953&#39;&#xA;Create a pipeline run for pipeline with id=5a560137-670b-41eb-b670-8376a9dfe935 and versionId=c11012bd-b755-471e-93b7-540d28ad3a25&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=1ddc944c-7458-4bf9-b38a-46f456b6a7fe&#xA;Created Pipeline Run with id: 1ddc944c-7458-4bf9-b38a-46f456b6a7fe for pipeline with id: 5a560137-670b-41eb-b670-8376a9dfe935&#xA;Waiting for pipeline run with id=1ddc944c-7458-4bf9-b38a-46f456b6a7fe to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=1ddc944c-7458-4bf9-b38a-46f456b6a7fe&#xA;Pipeline run with id=1ddc944c-7458-4bf9-b38a-46f456b6a7fe is in PENDING state, waiting...&#xA;Get a pipeline run with id=1ddc944c-7458-4bf9-b38a-46f456b6a7fe&#xA;Pipeline run with id=1ddc944c-7458-4bf9-b38a-46f456b6a7fe is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ddc944c-7458-4bf9-b38a-46f456b6a7fe&#xA;Pipeline run with id=1ddc944c-7458-4bf9-b38a-46f456b6a7fe is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ddc944c-7458-4bf9-b38a-46f456b6a7fe&#xA;Pipeline run with id=1ddc944c-7458-4bf9-b38a-46f456b6a7fe is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ddc944c-7458-4bf9-b38a-46f456b6a7fe&#xA;Pipeline run with id=1ddc944c-7458-4bf9-b38a-46f456b6a7fe is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ddc944c-7458-4bf9-b38a-46f456b6a7fe&#xA;Pipeline run with id=1ddc944c-7458-4bf9-b38a-46f456b6a7fe is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ddc944c-7458-4bf9-b38a-46f456b6a7fe&#xA;Pipeline run with id=1ddc944c-7458-4bf9-b38a-46f456b6a7fe is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ddc944c-7458-4bf9-b38a-46f456b6a7fe&#xA;Pipeline run with id=1ddc944c-7458-4bf9-b38a-46f456b6a7fe is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ddc944c-7458-4bf9-b38a-46f456b6a7fe&#xA;Pipeline run with id=1ddc944c-7458-4bf9-b38a-46f456b6a7fe is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ddc944c-7458-4bf9-b38a-46f456b6a7fe&#xA;Pipeline run with id=1ddc944c-7458-4bf9-b38a-46f456b6a7fe is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ddc944c-7458-4bf9-b38a-46f456b6a7fe&#xA;Pipeline run with id=1ddc944c-7458-4bf9-b38a-46f456b6a7fe is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ddc944c-7458-4bf9-b38a-46f456b6a7fe&#xA;Pipeline run with id=1ddc944c-7458-4bf9-b38a-46f456b6a7fe is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ddc944c-7458-4bf9-b38a-46f456b6a7fe&#xA;Pipeline run with id=1ddc944c-7458-4bf9-b38a-46f456b6a7fe is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ddc944c-7458-4bf9-b38a-46f456b6a7fe&#xA;Pipeline run with id=1ddc944c-7458-4bf9-b38a-46f456b6a7fe is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ddc944c-7458-4bf9-b38a-46f456b6a7fe&#xA;Pipeline run with id=1ddc944c-7458-4bf9-b38a-46f456b6a7fe is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ddc944c-7458-4bf9-b38a-46f456b6a7fe&#xA;Pipeline run with id=1ddc944c-7458-4bf9-b38a-46f456b6a7fe is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ddc944c-7458-4bf9-b38a-46f456b6a7fe&#xA;Pipeline run with id=1ddc944c-7458-4bf9-b38a-46f456b6a7fe is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ddc944c-7458-4bf9-b38a-46f456b6a7fe&#xA;Pipeline run with id=1ddc944c-7458-4bf9-b38a-46f456b6a7fe is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ddc944c-7458-4bf9-b38a-46f456b6a7fe&#xA;Pipeline run with id=1ddc944c-7458-4bf9-b38a-46f456b6a7fe is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ddc944c-7458-4bf9-b38a-46f456b6a7fe&#xA;Pipeline run with id=1ddc944c-7458-4bf9-b38a-46f456b6a7fe is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ddc944c-7458-4bf9-b38a-46f456b6a7fe&#xA;Pipeline run with id=1ddc944c-7458-4bf9-b38a-46f456b6a7fe is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ddc944c-7458-4bf9-b38a-46f456b6a7fe&#xA;Pipeline run with id=1ddc944c-7458-4bf9-b38a-46f456b6a7fe is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ddc944c-7458-4bf9-b38a-46f456b6a7fe&#xA;Pipeline run with id=1ddc944c-7458-4bf9-b38a-46f456b6a7fe is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ddc944c-7458-4bf9-b38a-46f456b6a7fe&#xA;Pipeline run with id=1ddc944c-7458-4bf9-b38a-46f456b6a7fe is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ddc944c-7458-4bf9-b38a-46f456b6a7fe&#xA;Pipeline run with id=1ddc944c-7458-4bf9-b38a-46f456b6a7fe is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ddc944c-7458-4bf9-b38a-46f456b6a7fe&#xA;Pipeline run with id=1ddc944c-7458-4bf9-b38a-46f456b6a7fe is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ddc944c-7458-4bf9-b38a-46f456b6a7fe&#xA;Pipeline run with id=1ddc944c-7458-4bf9-b38a-46f456b6a7fe is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ddc944c-7458-4bf9-b38a-46f456b6a7fe&#xA;Pipeline run with id=1ddc944c-7458-4bf9-b38a-46f456b6a7fe is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ddc944c-7458-4bf9-b38a-46f456b6a7fe&#xA;Pipeline run with id=1ddc944c-7458-4bf9-b38a-46f456b6a7fe is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ddc944c-7458-4bf9-b38a-46f456b6a7fe&#xA;Pipeline run with id=1ddc944c-7458-4bf9-b38a-46f456b6a7fe is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ddc944c-7458-4bf9-b38a-46f456b6a7fe&#xA;Pipeline run with id=1ddc944c-7458-4bf9-b38a-46f456b6a7fe is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ddc944c-7458-4bf9-b38a-46f456b6a7fe&#xA;Pipeline run with id=1ddc944c-7458-4bf9-b38a-46f456b6a7fe is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ddc944c-7458-4bf9-b38a-46f456b6a7fe&#xA;Pipeline run with id=1ddc944c-7458-4bf9-b38a-46f456b6a7fe is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ddc944c-7458-4bf9-b38a-46f456b6a7fe&#xA;Pipeline run with id=1ddc944c-7458-4bf9-b38a-46f456b6a7fe is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ddc944c-7458-4bf9-b38a-46f456b6a7fe&#xA;Pipeline run with id=1ddc944c-7458-4bf9-b38a-46f456b6a7fe is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ddc944c-7458-4bf9-b38a-46f456b6a7fe&#xA;Pipeline run with id=1ddc944c-7458-4bf9-b38a-46f456b6a7fe is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ddc944c-7458-4bf9-b38a-46f456b6a7fe&#xA;Pipeline run with id=1ddc944c-7458-4bf9-b38a-46f456b6a7fe is in RUNNING state, waiting...&#xA;Get a pipeline run with id=1ddc944c-7458-4bf9-b38a-46f456b6a7fe&#xA;Pipeline run with id=1ddc944c-7458-4bf9-b38a-46f456b6a7fe reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;essential/iris_pipeline_compiled.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=1ddc944c-7458-4bf9-b38a-46f456b6a7fe&#xA;Get a pipeline run with id=1ddc944c-7458-4bf9-b38a-46f456b6a7fe&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/05/26 07:04:24.09 (3m5.482s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/05/26 07:04:24.09&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 1ddc944c-7458-4bf9-b38a-46f456b6a7fe&#xA;Failed to terminate run 1ddc944c-7458-4bf9-b38a-46f456b6a7fe&#xA;Terminate run 1ddc944c-7458-4bf9-b38a-46f456b6a7fe&#xA;Deleting run 1ddc944c-7458-4bf9-b38a-46f456b6a7fe&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=5a560137-670b-41eb-b670-8376a9dfe935 (cascade=true)&#xA;Pipeline with id=5a560137-670b-41eb-b670-8376a9dfe935, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/05/26 07:04:24.194 (103ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/05/26 07:04:24.194&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/05/26 07:04:24.194 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/05/26 07:04:24.194&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/05/26 07:04:24.194 (0s)&#xA;</system-err>
          </testcase>
      </testsuite>
  </testsuites>