<?xml version="1.0" encoding="UTF-8"?>
  <testsuites tests="5" disabled="0" errors="0" failures="0" time="156.13109758">
      <testsuite name="AIPipelinesE2ETests" package="/dspa/backend/test/end2end" tests="5" disabled="0" skipped="0" errors="0" failures="0" time="156.13109758" timestamp="2026-07-05T06:02:31">
          <properties>
              <property name="SuiteSucceeded" value="true"></property>
              <property name="SuiteHasProgrammaticFocus" value="false"></property>
              <property name="SpecialSuiteFailureReason" value=""></property>
              <property name="SuiteLabels" value="[]"></property>
              <property name="SuiteSemVerConstraints" value="[]"></property>
              <property name="RandomSeed" value="1783231189"></property>
              <property name="RandomizeAllSpecs" value="false"></property>
              <property name="LabelFilter" value="Smoke"></property>
              <property name="SemVerFilter" value=""></property>
              <property name="FocusStrings" value=""></property>
              <property name="SkipStrings" value=""></property>
              <property name="FocusFiles" value=""></property>
              <property name="SkipFiles" value=""></property>
              <property name="FailOnPending" value="false"></property>
              <property name="FailOnEmpty" value="false"></property>
              <property name="FailFast" value="false"></property>
              <property name="FlakeAttempts" value="0"></property>
              <property name="DryRun" value="false"></property>
              <property name="ParallelTotal" value="10"></property>
              <property name="OutputInterceptorMode" value=""></property>
          </properties>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload essential/component_with_pip_index_urls.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="45.781211909">
              <system-out>2026/07/05 06:03:17 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/05/26 06:02:31.467&#xA;Create an experiment with name E2EExperiment-1783231351467952866&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/05/26 06:02:31.624 (156ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/05/26 06:02:31.624&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x2e6d7a3ae680&#xA;test-secret-1 created&#xA;test-secret-2 created&#xA;test-secret-3 created&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/05/26 06:02:31.671 (47ms)&#xA;&gt; Enter [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/05/26 06:02:31.671&#xA;Uploading pipeline file essential/component_with_pip_index_urls.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1783231351624461736, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml&#xA;Upload of pipeline file &#39;essential/component_with_pip_index_urls.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 34f4d956-5855-4a4c-91e2-f0401d125251&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;34f4d956-5855-4a4c-91e2-f0401d125251&#39; and name: &#39;e2e-test-1783231351624461736&#39;&#xA;Create a pipeline run for pipeline with id=34f4d956-5855-4a4c-91e2-f0401d125251 and versionId=f256f4a5-d4d1-4597-8deb-750d3f3ee7b6&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=fdc1f4e0-cd18-4aa4-9afa-ecf82f98436d&#xA;Created Pipeline Run with id: fdc1f4e0-cd18-4aa4-9afa-ecf82f98436d for pipeline with id: 34f4d956-5855-4a4c-91e2-f0401d125251&#xA;Waiting for pipeline run with id=fdc1f4e0-cd18-4aa4-9afa-ecf82f98436d to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=fdc1f4e0-cd18-4aa4-9afa-ecf82f98436d&#xA;Pipeline run with id=fdc1f4e0-cd18-4aa4-9afa-ecf82f98436d is in PENDING state, waiting...&#xA;Get a pipeline run with id=fdc1f4e0-cd18-4aa4-9afa-ecf82f98436d&#xA;Pipeline run with id=fdc1f4e0-cd18-4aa4-9afa-ecf82f98436d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fdc1f4e0-cd18-4aa4-9afa-ecf82f98436d&#xA;Pipeline run with id=fdc1f4e0-cd18-4aa4-9afa-ecf82f98436d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fdc1f4e0-cd18-4aa4-9afa-ecf82f98436d&#xA;Pipeline run with id=fdc1f4e0-cd18-4aa4-9afa-ecf82f98436d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fdc1f4e0-cd18-4aa4-9afa-ecf82f98436d&#xA;Pipeline run with id=fdc1f4e0-cd18-4aa4-9afa-ecf82f98436d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fdc1f4e0-cd18-4aa4-9afa-ecf82f98436d&#xA;Pipeline run with id=fdc1f4e0-cd18-4aa4-9afa-ecf82f98436d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fdc1f4e0-cd18-4aa4-9afa-ecf82f98436d&#xA;Pipeline run with id=fdc1f4e0-cd18-4aa4-9afa-ecf82f98436d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fdc1f4e0-cd18-4aa4-9afa-ecf82f98436d&#xA;Pipeline run with id=fdc1f4e0-cd18-4aa4-9afa-ecf82f98436d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fdc1f4e0-cd18-4aa4-9afa-ecf82f98436d&#xA;Pipeline run with id=fdc1f4e0-cd18-4aa4-9afa-ecf82f98436d is in RUNNING state, waiting...&#xA;Get a pipeline run with id=fdc1f4e0-cd18-4aa4-9afa-ecf82f98436d&#xA;Pipeline run with id=fdc1f4e0-cd18-4aa4-9afa-ecf82f98436d reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;essential/component_with_pip_index_urls.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=fdc1f4e0-cd18-4aa4-9afa-ecf82f98436d&#xA;Get a pipeline run with id=fdc1f4e0-cd18-4aa4-9afa-ecf82f98436d&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/05/26 06:03:17.104 (45.432s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/05/26 06:03:17.104&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run fdc1f4e0-cd18-4aa4-9afa-ecf82f98436d&#xA;Failed to terminate run fdc1f4e0-cd18-4aa4-9afa-ecf82f98436d&#xA;Terminate run fdc1f4e0-cd18-4aa4-9afa-ecf82f98436d&#xA;Deleting run fdc1f4e0-cd18-4aa4-9afa-ecf82f98436d&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=34f4d956-5855-4a4c-91e2-f0401d125251 (cascade=true)&#xA;Pipeline with id=34f4d956-5855-4a4c-91e2-f0401d125251, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/05/26 06:03:17.249 (145ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/05/26 06:03:17.249&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/05/26 06:03:17.249 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/05/26 06:03:17.249&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/05/26 06:03:17.249 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/parallel_for_after_dependency.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="95.975595086">
              <system-out>2026/07/05 06:04:07 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/05/26 06:02:31.467&#xA;Create an experiment with name E2EExperiment-1783231351467873054&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/05/26 06:02:31.723 (256ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/05/26 06:02:31.723&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x304bcdcf6500&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/05/26 06:02:31.814 (90ms)&#xA;&gt; Enter [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/05/26 06:02:31.814&#xA;Uploading pipeline file critical/parallel_for_after_dependency.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1783231351724017974, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml&#xA;Upload of pipeline file &#39;critical/parallel_for_after_dependency.yaml&#39; successful&#xA;Listing pipeline versions for pipeline e17567cc-4819-4928-8eb8-bd19f452a488&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;e17567cc-4819-4928-8eb8-bd19f452a488&#39; and name: &#39;e2e-test-1783231351724017974&#39;&#xA;Create a pipeline run for pipeline with id=e17567cc-4819-4928-8eb8-bd19f452a488 and versionId=75b14d53-f66e-4567-84ea-d8974d5b24a4&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=e119df10-797c-4ced-9847-4b4487f10181&#xA;Created Pipeline Run with id: e119df10-797c-4ced-9847-4b4487f10181 for pipeline with id: e17567cc-4819-4928-8eb8-bd19f452a488&#xA;Waiting for pipeline run with id=e119df10-797c-4ced-9847-4b4487f10181 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=e119df10-797c-4ced-9847-4b4487f10181&#xA;Pipeline run with id=e119df10-797c-4ced-9847-4b4487f10181 is in PENDING state, waiting...&#xA;Get a pipeline run with id=e119df10-797c-4ced-9847-4b4487f10181&#xA;Pipeline run with id=e119df10-797c-4ced-9847-4b4487f10181 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e119df10-797c-4ced-9847-4b4487f10181&#xA;Pipeline run with id=e119df10-797c-4ced-9847-4b4487f10181 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e119df10-797c-4ced-9847-4b4487f10181&#xA;Pipeline run with id=e119df10-797c-4ced-9847-4b4487f10181 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e119df10-797c-4ced-9847-4b4487f10181&#xA;Pipeline run with id=e119df10-797c-4ced-9847-4b4487f10181 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e119df10-797c-4ced-9847-4b4487f10181&#xA;Pipeline run with id=e119df10-797c-4ced-9847-4b4487f10181 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e119df10-797c-4ced-9847-4b4487f10181&#xA;Pipeline run with id=e119df10-797c-4ced-9847-4b4487f10181 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e119df10-797c-4ced-9847-4b4487f10181&#xA;Pipeline run with id=e119df10-797c-4ced-9847-4b4487f10181 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e119df10-797c-4ced-9847-4b4487f10181&#xA;Pipeline run with id=e119df10-797c-4ced-9847-4b4487f10181 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e119df10-797c-4ced-9847-4b4487f10181&#xA;Pipeline run with id=e119df10-797c-4ced-9847-4b4487f10181 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e119df10-797c-4ced-9847-4b4487f10181&#xA;Pipeline run with id=e119df10-797c-4ced-9847-4b4487f10181 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e119df10-797c-4ced-9847-4b4487f10181&#xA;Pipeline run with id=e119df10-797c-4ced-9847-4b4487f10181 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e119df10-797c-4ced-9847-4b4487f10181&#xA;Pipeline run with id=e119df10-797c-4ced-9847-4b4487f10181 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e119df10-797c-4ced-9847-4b4487f10181&#xA;Pipeline run with id=e119df10-797c-4ced-9847-4b4487f10181 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e119df10-797c-4ced-9847-4b4487f10181&#xA;Pipeline run with id=e119df10-797c-4ced-9847-4b4487f10181 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e119df10-797c-4ced-9847-4b4487f10181&#xA;Pipeline run with id=e119df10-797c-4ced-9847-4b4487f10181 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e119df10-797c-4ced-9847-4b4487f10181&#xA;Pipeline run with id=e119df10-797c-4ced-9847-4b4487f10181 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e119df10-797c-4ced-9847-4b4487f10181&#xA;Pipeline run with id=e119df10-797c-4ced-9847-4b4487f10181 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e119df10-797c-4ced-9847-4b4487f10181&#xA;Pipeline run with id=e119df10-797c-4ced-9847-4b4487f10181 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e119df10-797c-4ced-9847-4b4487f10181&#xA;Pipeline run with id=e119df10-797c-4ced-9847-4b4487f10181 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/parallel_for_after_dependency.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=e119df10-797c-4ced-9847-4b4487f10181&#xA;Get a pipeline run with id=e119df10-797c-4ced-9847-4b4487f10181&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/05/26 06:04:07.289 (1m35.475s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/05/26 06:04:07.289&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run e119df10-797c-4ced-9847-4b4487f10181&#xA;Failed to terminate run e119df10-797c-4ced-9847-4b4487f10181&#xA;Terminate run e119df10-797c-4ced-9847-4b4487f10181&#xA;Deleting run e119df10-797c-4ced-9847-4b4487f10181&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=e17567cc-4819-4928-8eb8-bd19f452a488 (cascade=true)&#xA;Pipeline with id=e17567cc-4819-4928-8eb8-bd19f452a488, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/05/26 06:04:07.443 (153ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/05/26 06:04:07.443&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/05/26 06:04:07.443 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/05/26 06:04:07.443&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/05/26 06:04:07.443 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/pipeline_with_artifact_upload_download.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="100.997482014">
              <system-out>2026/07/05 06:04:12 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/05/26 06:02:31.468&#xA;Create an experiment with name E2EExperiment-1783231351468054829&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/05/26 06:02:31.723 (255ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/05/26 06:02:31.723&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x3713bbf34980&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/05/26 06:02:31.809 (87ms)&#xA;&gt; Enter [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/05/26 06:02:31.81&#xA;Uploading pipeline file critical/pipeline_with_artifact_upload_download.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1783231351723391745, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml&#xA;Upload of pipeline file &#39;critical/pipeline_with_artifact_upload_download.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 82b8a1cd-70a9-408c-b448-80b54b8f7fcd&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;82b8a1cd-70a9-408c-b448-80b54b8f7fcd&#39; and name: &#39;e2e-test-1783231351723391745&#39;&#xA;Create a pipeline run for pipeline with id=82b8a1cd-70a9-408c-b448-80b54b8f7fcd and versionId=8153c8c2-149c-4604-a588-936d7cb0620e&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=ceb1e3fd-039b-434c-8df2-2d138763d74f&#xA;Created Pipeline Run with id: ceb1e3fd-039b-434c-8df2-2d138763d74f for pipeline with id: 82b8a1cd-70a9-408c-b448-80b54b8f7fcd&#xA;Waiting for pipeline run with id=ceb1e3fd-039b-434c-8df2-2d138763d74f to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=ceb1e3fd-039b-434c-8df2-2d138763d74f&#xA;Pipeline run with id=ceb1e3fd-039b-434c-8df2-2d138763d74f is in PENDING state, waiting...&#xA;Get a pipeline run with id=ceb1e3fd-039b-434c-8df2-2d138763d74f&#xA;Pipeline run with id=ceb1e3fd-039b-434c-8df2-2d138763d74f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ceb1e3fd-039b-434c-8df2-2d138763d74f&#xA;Pipeline run with id=ceb1e3fd-039b-434c-8df2-2d138763d74f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ceb1e3fd-039b-434c-8df2-2d138763d74f&#xA;Pipeline run with id=ceb1e3fd-039b-434c-8df2-2d138763d74f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ceb1e3fd-039b-434c-8df2-2d138763d74f&#xA;Pipeline run with id=ceb1e3fd-039b-434c-8df2-2d138763d74f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ceb1e3fd-039b-434c-8df2-2d138763d74f&#xA;Pipeline run with id=ceb1e3fd-039b-434c-8df2-2d138763d74f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ceb1e3fd-039b-434c-8df2-2d138763d74f&#xA;Pipeline run with id=ceb1e3fd-039b-434c-8df2-2d138763d74f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ceb1e3fd-039b-434c-8df2-2d138763d74f&#xA;Pipeline run with id=ceb1e3fd-039b-434c-8df2-2d138763d74f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ceb1e3fd-039b-434c-8df2-2d138763d74f&#xA;Pipeline run with id=ceb1e3fd-039b-434c-8df2-2d138763d74f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ceb1e3fd-039b-434c-8df2-2d138763d74f&#xA;Pipeline run with id=ceb1e3fd-039b-434c-8df2-2d138763d74f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ceb1e3fd-039b-434c-8df2-2d138763d74f&#xA;Pipeline run with id=ceb1e3fd-039b-434c-8df2-2d138763d74f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ceb1e3fd-039b-434c-8df2-2d138763d74f&#xA;Pipeline run with id=ceb1e3fd-039b-434c-8df2-2d138763d74f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ceb1e3fd-039b-434c-8df2-2d138763d74f&#xA;Pipeline run with id=ceb1e3fd-039b-434c-8df2-2d138763d74f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ceb1e3fd-039b-434c-8df2-2d138763d74f&#xA;Pipeline run with id=ceb1e3fd-039b-434c-8df2-2d138763d74f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ceb1e3fd-039b-434c-8df2-2d138763d74f&#xA;Pipeline run with id=ceb1e3fd-039b-434c-8df2-2d138763d74f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ceb1e3fd-039b-434c-8df2-2d138763d74f&#xA;Pipeline run with id=ceb1e3fd-039b-434c-8df2-2d138763d74f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ceb1e3fd-039b-434c-8df2-2d138763d74f&#xA;Pipeline run with id=ceb1e3fd-039b-434c-8df2-2d138763d74f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ceb1e3fd-039b-434c-8df2-2d138763d74f&#xA;Pipeline run with id=ceb1e3fd-039b-434c-8df2-2d138763d74f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ceb1e3fd-039b-434c-8df2-2d138763d74f&#xA;Pipeline run with id=ceb1e3fd-039b-434c-8df2-2d138763d74f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ceb1e3fd-039b-434c-8df2-2d138763d74f&#xA;Pipeline run with id=ceb1e3fd-039b-434c-8df2-2d138763d74f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ceb1e3fd-039b-434c-8df2-2d138763d74f&#xA;Pipeline run with id=ceb1e3fd-039b-434c-8df2-2d138763d74f reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/pipeline_with_artifact_upload_download.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=ceb1e3fd-039b-434c-8df2-2d138763d74f&#xA;Get a pipeline run with id=ceb1e3fd-039b-434c-8df2-2d138763d74f&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/05/26 06:04:12.314 (1m40.504s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/05/26 06:04:12.314&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run ceb1e3fd-039b-434c-8df2-2d138763d74f&#xA;Failed to terminate run ceb1e3fd-039b-434c-8df2-2d138763d74f&#xA;Terminate run ceb1e3fd-039b-434c-8df2-2d138763d74f&#xA;Deleting run ceb1e3fd-039b-434c-8df2-2d138763d74f&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=82b8a1cd-70a9-408c-b448-80b54b8f7fcd (cascade=true)&#xA;Pipeline with id=82b8a1cd-70a9-408c-b448-80b54b8f7fcd, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/05/26 06:04:12.465 (151ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/05/26 06:04:12.465&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/05/26 06:04:12.465 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/05/26 06:04:12.466&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/05/26 06:04:12.466 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/flip_coin.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="131.20898427">
              <system-out>2026/07/05 06:04:42 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/05/26 06:02:31.468&#xA;Create an experiment with name E2EExperiment-1783231351468165112&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/05/26 06:02:31.722 (255ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/05/26 06:02:31.723&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x25d538b62580&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/05/26 06:02:31.816 (94ms)&#xA;&gt; Enter [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/05/26 06:02:31.817&#xA;Uploading pipeline file critical/flip_coin.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1783231351723114317, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml&#xA;Upload of pipeline file &#39;critical/flip_coin.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 54c9768b-da13-4543-890f-e7bb393c65e3&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;54c9768b-da13-4543-890f-e7bb393c65e3&#39; and name: &#39;e2e-test-1783231351723114317&#39;&#xA;Create a pipeline run for pipeline with id=54c9768b-da13-4543-890f-e7bb393c65e3 and versionId=cb99d35e-d43d-4989-8263-0e83c2424db3&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=3ab0f19f-9ef8-474b-98f3-ba2ee615923f&#xA;Created Pipeline Run with id: 3ab0f19f-9ef8-474b-98f3-ba2ee615923f for pipeline with id: 54c9768b-da13-4543-890f-e7bb393c65e3&#xA;Waiting for pipeline run with id=3ab0f19f-9ef8-474b-98f3-ba2ee615923f to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=3ab0f19f-9ef8-474b-98f3-ba2ee615923f&#xA;Pipeline run with id=3ab0f19f-9ef8-474b-98f3-ba2ee615923f is in PENDING state, waiting...&#xA;Get a pipeline run with id=3ab0f19f-9ef8-474b-98f3-ba2ee615923f&#xA;Pipeline run with id=3ab0f19f-9ef8-474b-98f3-ba2ee615923f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3ab0f19f-9ef8-474b-98f3-ba2ee615923f&#xA;Pipeline run with id=3ab0f19f-9ef8-474b-98f3-ba2ee615923f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3ab0f19f-9ef8-474b-98f3-ba2ee615923f&#xA;Pipeline run with id=3ab0f19f-9ef8-474b-98f3-ba2ee615923f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3ab0f19f-9ef8-474b-98f3-ba2ee615923f&#xA;Pipeline run with id=3ab0f19f-9ef8-474b-98f3-ba2ee615923f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3ab0f19f-9ef8-474b-98f3-ba2ee615923f&#xA;Pipeline run with id=3ab0f19f-9ef8-474b-98f3-ba2ee615923f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3ab0f19f-9ef8-474b-98f3-ba2ee615923f&#xA;Pipeline run with id=3ab0f19f-9ef8-474b-98f3-ba2ee615923f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3ab0f19f-9ef8-474b-98f3-ba2ee615923f&#xA;Pipeline run with id=3ab0f19f-9ef8-474b-98f3-ba2ee615923f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3ab0f19f-9ef8-474b-98f3-ba2ee615923f&#xA;Pipeline run with id=3ab0f19f-9ef8-474b-98f3-ba2ee615923f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3ab0f19f-9ef8-474b-98f3-ba2ee615923f&#xA;Pipeline run with id=3ab0f19f-9ef8-474b-98f3-ba2ee615923f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3ab0f19f-9ef8-474b-98f3-ba2ee615923f&#xA;Pipeline run with id=3ab0f19f-9ef8-474b-98f3-ba2ee615923f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3ab0f19f-9ef8-474b-98f3-ba2ee615923f&#xA;Pipeline run with id=3ab0f19f-9ef8-474b-98f3-ba2ee615923f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3ab0f19f-9ef8-474b-98f3-ba2ee615923f&#xA;Pipeline run with id=3ab0f19f-9ef8-474b-98f3-ba2ee615923f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3ab0f19f-9ef8-474b-98f3-ba2ee615923f&#xA;Pipeline run with id=3ab0f19f-9ef8-474b-98f3-ba2ee615923f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3ab0f19f-9ef8-474b-98f3-ba2ee615923f&#xA;Pipeline run with id=3ab0f19f-9ef8-474b-98f3-ba2ee615923f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3ab0f19f-9ef8-474b-98f3-ba2ee615923f&#xA;Pipeline run with id=3ab0f19f-9ef8-474b-98f3-ba2ee615923f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3ab0f19f-9ef8-474b-98f3-ba2ee615923f&#xA;Pipeline run with id=3ab0f19f-9ef8-474b-98f3-ba2ee615923f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3ab0f19f-9ef8-474b-98f3-ba2ee615923f&#xA;Pipeline run with id=3ab0f19f-9ef8-474b-98f3-ba2ee615923f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3ab0f19f-9ef8-474b-98f3-ba2ee615923f&#xA;Pipeline run with id=3ab0f19f-9ef8-474b-98f3-ba2ee615923f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3ab0f19f-9ef8-474b-98f3-ba2ee615923f&#xA;Pipeline run with id=3ab0f19f-9ef8-474b-98f3-ba2ee615923f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3ab0f19f-9ef8-474b-98f3-ba2ee615923f&#xA;Pipeline run with id=3ab0f19f-9ef8-474b-98f3-ba2ee615923f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3ab0f19f-9ef8-474b-98f3-ba2ee615923f&#xA;Pipeline run with id=3ab0f19f-9ef8-474b-98f3-ba2ee615923f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3ab0f19f-9ef8-474b-98f3-ba2ee615923f&#xA;Pipeline run with id=3ab0f19f-9ef8-474b-98f3-ba2ee615923f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3ab0f19f-9ef8-474b-98f3-ba2ee615923f&#xA;Pipeline run with id=3ab0f19f-9ef8-474b-98f3-ba2ee615923f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3ab0f19f-9ef8-474b-98f3-ba2ee615923f&#xA;Pipeline run with id=3ab0f19f-9ef8-474b-98f3-ba2ee615923f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3ab0f19f-9ef8-474b-98f3-ba2ee615923f&#xA;Pipeline run with id=3ab0f19f-9ef8-474b-98f3-ba2ee615923f is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3ab0f19f-9ef8-474b-98f3-ba2ee615923f&#xA;Pipeline run with id=3ab0f19f-9ef8-474b-98f3-ba2ee615923f reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/flip_coin.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=3ab0f19f-9ef8-474b-98f3-ba2ee615923f&#xA;Get a pipeline run with id=3ab0f19f-9ef8-474b-98f3-ba2ee615923f&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/05/26 06:04:42.436 (2m10.62s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/05/26 06:04:42.437&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 3ab0f19f-9ef8-474b-98f3-ba2ee615923f&#xA;Failed to terminate run 3ab0f19f-9ef8-474b-98f3-ba2ee615923f&#xA;Terminate run 3ab0f19f-9ef8-474b-98f3-ba2ee615923f&#xA;Deleting run 3ab0f19f-9ef8-474b-98f3-ba2ee615923f&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=54c9768b-da13-4543-890f-e7bb393c65e3 (cascade=true)&#xA;Pipeline with id=54c9768b-da13-4543-890f-e7bb393c65e3, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/05/26 06:04:42.676 (240ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/05/26 06:04:42.677&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/05/26 06:04:42.677 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/05/26 06:04:42.677&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/05/26 06:04:42.677 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload essential/iris_pipeline_compiled.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="156.001152619">
              <system-out>2026/07/05 06:05:07 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/05/26 06:02:31.468&#xA;Create an experiment with name E2EExperiment-1783231351468298176&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/05/26 06:02:31.724 (256ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/05/26 06:02:31.724&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x2d4a850d6c80&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/05/26 06:02:31.814 (91ms)&#xA;&gt; Enter [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/05/26 06:02:31.815&#xA;Uploading pipeline file essential/iris_pipeline_compiled.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1783231351724257941, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml&#xA;Upload of pipeline file &#39;essential/iris_pipeline_compiled.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 13afc8e6-d02d-4c28-8146-4653f98d97f5&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;13afc8e6-d02d-4c28-8146-4653f98d97f5&#39; and name: &#39;e2e-test-1783231351724257941&#39;&#xA;Create a pipeline run for pipeline with id=13afc8e6-d02d-4c28-8146-4653f98d97f5 and versionId=122f1b63-88dc-48b7-866b-99ffa3c2b815&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=ed96d3a2-b85f-4aed-b413-abfca7da9f0c&#xA;Created Pipeline Run with id: ed96d3a2-b85f-4aed-b413-abfca7da9f0c for pipeline with id: 13afc8e6-d02d-4c28-8146-4653f98d97f5&#xA;Waiting for pipeline run with id=ed96d3a2-b85f-4aed-b413-abfca7da9f0c to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=ed96d3a2-b85f-4aed-b413-abfca7da9f0c&#xA;Pipeline run with id=ed96d3a2-b85f-4aed-b413-abfca7da9f0c is in PENDING state, waiting...&#xA;Get a pipeline run with id=ed96d3a2-b85f-4aed-b413-abfca7da9f0c&#xA;Pipeline run with id=ed96d3a2-b85f-4aed-b413-abfca7da9f0c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ed96d3a2-b85f-4aed-b413-abfca7da9f0c&#xA;Pipeline run with id=ed96d3a2-b85f-4aed-b413-abfca7da9f0c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ed96d3a2-b85f-4aed-b413-abfca7da9f0c&#xA;Pipeline run with id=ed96d3a2-b85f-4aed-b413-abfca7da9f0c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ed96d3a2-b85f-4aed-b413-abfca7da9f0c&#xA;Pipeline run with id=ed96d3a2-b85f-4aed-b413-abfca7da9f0c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ed96d3a2-b85f-4aed-b413-abfca7da9f0c&#xA;Pipeline run with id=ed96d3a2-b85f-4aed-b413-abfca7da9f0c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ed96d3a2-b85f-4aed-b413-abfca7da9f0c&#xA;Pipeline run with id=ed96d3a2-b85f-4aed-b413-abfca7da9f0c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ed96d3a2-b85f-4aed-b413-abfca7da9f0c&#xA;Pipeline run with id=ed96d3a2-b85f-4aed-b413-abfca7da9f0c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ed96d3a2-b85f-4aed-b413-abfca7da9f0c&#xA;Pipeline run with id=ed96d3a2-b85f-4aed-b413-abfca7da9f0c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ed96d3a2-b85f-4aed-b413-abfca7da9f0c&#xA;Pipeline run with id=ed96d3a2-b85f-4aed-b413-abfca7da9f0c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ed96d3a2-b85f-4aed-b413-abfca7da9f0c&#xA;Pipeline run with id=ed96d3a2-b85f-4aed-b413-abfca7da9f0c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ed96d3a2-b85f-4aed-b413-abfca7da9f0c&#xA;Pipeline run with id=ed96d3a2-b85f-4aed-b413-abfca7da9f0c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ed96d3a2-b85f-4aed-b413-abfca7da9f0c&#xA;Pipeline run with id=ed96d3a2-b85f-4aed-b413-abfca7da9f0c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ed96d3a2-b85f-4aed-b413-abfca7da9f0c&#xA;Pipeline run with id=ed96d3a2-b85f-4aed-b413-abfca7da9f0c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ed96d3a2-b85f-4aed-b413-abfca7da9f0c&#xA;Pipeline run with id=ed96d3a2-b85f-4aed-b413-abfca7da9f0c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ed96d3a2-b85f-4aed-b413-abfca7da9f0c&#xA;Pipeline run with id=ed96d3a2-b85f-4aed-b413-abfca7da9f0c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ed96d3a2-b85f-4aed-b413-abfca7da9f0c&#xA;Pipeline run with id=ed96d3a2-b85f-4aed-b413-abfca7da9f0c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ed96d3a2-b85f-4aed-b413-abfca7da9f0c&#xA;Pipeline run with id=ed96d3a2-b85f-4aed-b413-abfca7da9f0c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ed96d3a2-b85f-4aed-b413-abfca7da9f0c&#xA;Pipeline run with id=ed96d3a2-b85f-4aed-b413-abfca7da9f0c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ed96d3a2-b85f-4aed-b413-abfca7da9f0c&#xA;Pipeline run with id=ed96d3a2-b85f-4aed-b413-abfca7da9f0c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ed96d3a2-b85f-4aed-b413-abfca7da9f0c&#xA;Pipeline run with id=ed96d3a2-b85f-4aed-b413-abfca7da9f0c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ed96d3a2-b85f-4aed-b413-abfca7da9f0c&#xA;Pipeline run with id=ed96d3a2-b85f-4aed-b413-abfca7da9f0c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ed96d3a2-b85f-4aed-b413-abfca7da9f0c&#xA;Pipeline run with id=ed96d3a2-b85f-4aed-b413-abfca7da9f0c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ed96d3a2-b85f-4aed-b413-abfca7da9f0c&#xA;Pipeline run with id=ed96d3a2-b85f-4aed-b413-abfca7da9f0c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ed96d3a2-b85f-4aed-b413-abfca7da9f0c&#xA;Pipeline run with id=ed96d3a2-b85f-4aed-b413-abfca7da9f0c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ed96d3a2-b85f-4aed-b413-abfca7da9f0c&#xA;Pipeline run with id=ed96d3a2-b85f-4aed-b413-abfca7da9f0c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ed96d3a2-b85f-4aed-b413-abfca7da9f0c&#xA;Pipeline run with id=ed96d3a2-b85f-4aed-b413-abfca7da9f0c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ed96d3a2-b85f-4aed-b413-abfca7da9f0c&#xA;Pipeline run with id=ed96d3a2-b85f-4aed-b413-abfca7da9f0c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ed96d3a2-b85f-4aed-b413-abfca7da9f0c&#xA;Pipeline run with id=ed96d3a2-b85f-4aed-b413-abfca7da9f0c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ed96d3a2-b85f-4aed-b413-abfca7da9f0c&#xA;Pipeline run with id=ed96d3a2-b85f-4aed-b413-abfca7da9f0c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ed96d3a2-b85f-4aed-b413-abfca7da9f0c&#xA;Pipeline run with id=ed96d3a2-b85f-4aed-b413-abfca7da9f0c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=ed96d3a2-b85f-4aed-b413-abfca7da9f0c&#xA;Pipeline run with id=ed96d3a2-b85f-4aed-b413-abfca7da9f0c reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;essential/iris_pipeline_compiled.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=ed96d3a2-b85f-4aed-b413-abfca7da9f0c&#xA;Get a pipeline run with id=ed96d3a2-b85f-4aed-b413-abfca7da9f0c&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/05/26 06:05:07.298 (2m35.483s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/05/26 06:05:07.298&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run ed96d3a2-b85f-4aed-b413-abfca7da9f0c&#xA;Failed to terminate run ed96d3a2-b85f-4aed-b413-abfca7da9f0c&#xA;Terminate run ed96d3a2-b85f-4aed-b413-abfca7da9f0c&#xA;Deleting run ed96d3a2-b85f-4aed-b413-abfca7da9f0c&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=13afc8e6-d02d-4c28-8146-4653f98d97f5 (cascade=true)&#xA;Pipeline with id=13afc8e6-d02d-4c28-8146-4653f98d97f5, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/05/26 06:05:07.469 (171ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/05/26 06:05:07.469&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/05/26 06:05:07.469 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/05/26 06:05:07.47&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/05/26 06:05:07.47 (0s)&#xA;</system-err>
          </testcase>
      </testsuite>
  </testsuites>