<?xml version="1.0" encoding="UTF-8"?>
  <testsuites tests="5" disabled="0" errors="0" failures="0" time="156.284347422">
      <testsuite name="AIPipelinesE2ETests" package="/dspa/backend/test/end2end" tests="5" disabled="0" skipped="0" errors="0" failures="0" time="156.284347422" timestamp="2026-07-06T13:41:25">
          <properties>
              <property name="SuiteSucceeded" value="true"></property>
              <property name="SuiteHasProgrammaticFocus" value="false"></property>
              <property name="SpecialSuiteFailureReason" value=""></property>
              <property name="SuiteLabels" value="[]"></property>
              <property name="SuiteSemVerConstraints" value="[]"></property>
              <property name="RandomSeed" value="1783345118"></property>
              <property name="RandomizeAllSpecs" value="false"></property>
              <property name="LabelFilter" value="Smoke"></property>
              <property name="SemVerFilter" value=""></property>
              <property name="FocusStrings" value=""></property>
              <property name="SkipStrings" value=""></property>
              <property name="FocusFiles" value=""></property>
              <property name="SkipFiles" value=""></property>
              <property name="FailOnPending" value="false"></property>
              <property name="FailOnEmpty" value="false"></property>
              <property name="FailFast" value="false"></property>
              <property name="FlakeAttempts" value="0"></property>
              <property name="DryRun" value="false"></property>
              <property name="ParallelTotal" value="10"></property>
              <property name="OutputInterceptorMode" value=""></property>
          </properties>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload essential/component_with_pip_index_urls.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="45.956664712">
              <system-out>2026/07/06 13:42:11 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/06/26 13:41:25.684&#xA;Create an experiment with name E2EExperiment-1783345285684453485&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/06/26 13:41:25.836 (152ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/06/26 13:41:25.836&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0xdf3277a7e00&#xA;test-secret-1 created&#xA;test-secret-2 created&#xA;test-secret-3 created&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/06/26 13:41:25.906 (70ms)&#xA;&gt; Enter [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/06/26 13:41:25.906&#xA;Uploading pipeline file essential/component_with_pip_index_urls.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1783345285836915155, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml&#xA;Upload of pipeline file &#39;essential/component_with_pip_index_urls.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 3fd9318b-f2f2-4799-a5af-5b96cdc6a4a2&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;3fd9318b-f2f2-4799-a5af-5b96cdc6a4a2&#39; and name: &#39;e2e-test-1783345285836915155&#39;&#xA;Create a pipeline run for pipeline with id=3fd9318b-f2f2-4799-a5af-5b96cdc6a4a2 and versionId=6acbdc70-49d6-4cfc-ab16-c5f867772ca8&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=52245a50-8536-4bb6-9384-4e47df2c197a&#xA;Created Pipeline Run with id: 52245a50-8536-4bb6-9384-4e47df2c197a for pipeline with id: 3fd9318b-f2f2-4799-a5af-5b96cdc6a4a2&#xA;Waiting for pipeline run with id=52245a50-8536-4bb6-9384-4e47df2c197a to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=52245a50-8536-4bb6-9384-4e47df2c197a&#xA;Pipeline run with id=52245a50-8536-4bb6-9384-4e47df2c197a is in PENDING state, waiting...&#xA;Get a pipeline run with id=52245a50-8536-4bb6-9384-4e47df2c197a&#xA;Pipeline run with id=52245a50-8536-4bb6-9384-4e47df2c197a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=52245a50-8536-4bb6-9384-4e47df2c197a&#xA;Pipeline run with id=52245a50-8536-4bb6-9384-4e47df2c197a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=52245a50-8536-4bb6-9384-4e47df2c197a&#xA;Pipeline run with id=52245a50-8536-4bb6-9384-4e47df2c197a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=52245a50-8536-4bb6-9384-4e47df2c197a&#xA;Pipeline run with id=52245a50-8536-4bb6-9384-4e47df2c197a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=52245a50-8536-4bb6-9384-4e47df2c197a&#xA;Pipeline run with id=52245a50-8536-4bb6-9384-4e47df2c197a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=52245a50-8536-4bb6-9384-4e47df2c197a&#xA;Pipeline run with id=52245a50-8536-4bb6-9384-4e47df2c197a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=52245a50-8536-4bb6-9384-4e47df2c197a&#xA;Pipeline run with id=52245a50-8536-4bb6-9384-4e47df2c197a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=52245a50-8536-4bb6-9384-4e47df2c197a&#xA;Pipeline run with id=52245a50-8536-4bb6-9384-4e47df2c197a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=52245a50-8536-4bb6-9384-4e47df2c197a&#xA;Pipeline run with id=52245a50-8536-4bb6-9384-4e47df2c197a reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;essential/component_with_pip_index_urls.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=52245a50-8536-4bb6-9384-4e47df2c197a&#xA;Get a pipeline run with id=52245a50-8536-4bb6-9384-4e47df2c197a&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/06/26 13:42:11.368 (45.462s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/06/26 13:42:11.369&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 52245a50-8536-4bb6-9384-4e47df2c197a&#xA;Failed to terminate run 52245a50-8536-4bb6-9384-4e47df2c197a&#xA;Terminate run 52245a50-8536-4bb6-9384-4e47df2c197a&#xA;Deleting run 52245a50-8536-4bb6-9384-4e47df2c197a&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=3fd9318b-f2f2-4799-a5af-5b96cdc6a4a2 (cascade=true)&#xA;Pipeline with id=3fd9318b-f2f2-4799-a5af-5b96cdc6a4a2, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/06/26 13:42:11.64 (272ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/06/26 13:42:11.641&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/06/26 13:42:11.641 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/06/26 13:42:11.641&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/06/26 13:42:11.641 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/pipeline_with_artifact_upload_download.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="96.051797202">
              <system-out>2026/07/06 13:43:01 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/06/26 13:41:25.683&#xA;Create an experiment with name E2EExperiment-1783345285683993174&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/06/26 13:41:25.84 (156ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/06/26 13:41:25.841&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x204f7e09a700&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/06/26 13:41:25.957 (117ms)&#xA;&gt; Enter [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/06/26 13:41:25.958&#xA;Uploading pipeline file critical/pipeline_with_artifact_upload_download.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1783345285841130937, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml&#xA;Upload of pipeline file &#39;critical/pipeline_with_artifact_upload_download.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 8a6c63c6-9f04-45da-b371-90b36ee28f1b&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;8a6c63c6-9f04-45da-b371-90b36ee28f1b&#39; and name: &#39;e2e-test-1783345285841130937&#39;&#xA;Create a pipeline run for pipeline with id=8a6c63c6-9f04-45da-b371-90b36ee28f1b and versionId=9f1792d5-f857-4c3f-abfa-3e4e2a9ca257&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=9efd352a-efb2-4984-bdd1-1eeb7cad8805&#xA;Created Pipeline Run with id: 9efd352a-efb2-4984-bdd1-1eeb7cad8805 for pipeline with id: 8a6c63c6-9f04-45da-b371-90b36ee28f1b&#xA;Waiting for pipeline run with id=9efd352a-efb2-4984-bdd1-1eeb7cad8805 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=9efd352a-efb2-4984-bdd1-1eeb7cad8805&#xA;Pipeline run with id=9efd352a-efb2-4984-bdd1-1eeb7cad8805 is in PENDING state, waiting...&#xA;Get a pipeline run with id=9efd352a-efb2-4984-bdd1-1eeb7cad8805&#xA;Pipeline run with id=9efd352a-efb2-4984-bdd1-1eeb7cad8805 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9efd352a-efb2-4984-bdd1-1eeb7cad8805&#xA;Pipeline run with id=9efd352a-efb2-4984-bdd1-1eeb7cad8805 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9efd352a-efb2-4984-bdd1-1eeb7cad8805&#xA;Pipeline run with id=9efd352a-efb2-4984-bdd1-1eeb7cad8805 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9efd352a-efb2-4984-bdd1-1eeb7cad8805&#xA;Pipeline run with id=9efd352a-efb2-4984-bdd1-1eeb7cad8805 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9efd352a-efb2-4984-bdd1-1eeb7cad8805&#xA;Pipeline run with id=9efd352a-efb2-4984-bdd1-1eeb7cad8805 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9efd352a-efb2-4984-bdd1-1eeb7cad8805&#xA;Pipeline run with id=9efd352a-efb2-4984-bdd1-1eeb7cad8805 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9efd352a-efb2-4984-bdd1-1eeb7cad8805&#xA;Pipeline run with id=9efd352a-efb2-4984-bdd1-1eeb7cad8805 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9efd352a-efb2-4984-bdd1-1eeb7cad8805&#xA;Pipeline run with id=9efd352a-efb2-4984-bdd1-1eeb7cad8805 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9efd352a-efb2-4984-bdd1-1eeb7cad8805&#xA;Pipeline run with id=9efd352a-efb2-4984-bdd1-1eeb7cad8805 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9efd352a-efb2-4984-bdd1-1eeb7cad8805&#xA;Pipeline run with id=9efd352a-efb2-4984-bdd1-1eeb7cad8805 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9efd352a-efb2-4984-bdd1-1eeb7cad8805&#xA;Pipeline run with id=9efd352a-efb2-4984-bdd1-1eeb7cad8805 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9efd352a-efb2-4984-bdd1-1eeb7cad8805&#xA;Pipeline run with id=9efd352a-efb2-4984-bdd1-1eeb7cad8805 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9efd352a-efb2-4984-bdd1-1eeb7cad8805&#xA;Pipeline run with id=9efd352a-efb2-4984-bdd1-1eeb7cad8805 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9efd352a-efb2-4984-bdd1-1eeb7cad8805&#xA;Pipeline run with id=9efd352a-efb2-4984-bdd1-1eeb7cad8805 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9efd352a-efb2-4984-bdd1-1eeb7cad8805&#xA;Pipeline run with id=9efd352a-efb2-4984-bdd1-1eeb7cad8805 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9efd352a-efb2-4984-bdd1-1eeb7cad8805&#xA;Pipeline run with id=9efd352a-efb2-4984-bdd1-1eeb7cad8805 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9efd352a-efb2-4984-bdd1-1eeb7cad8805&#xA;Pipeline run with id=9efd352a-efb2-4984-bdd1-1eeb7cad8805 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9efd352a-efb2-4984-bdd1-1eeb7cad8805&#xA;Pipeline run with id=9efd352a-efb2-4984-bdd1-1eeb7cad8805 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=9efd352a-efb2-4984-bdd1-1eeb7cad8805&#xA;Pipeline run with id=9efd352a-efb2-4984-bdd1-1eeb7cad8805 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/pipeline_with_artifact_upload_download.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=9efd352a-efb2-4984-bdd1-1eeb7cad8805&#xA;Get a pipeline run with id=9efd352a-efb2-4984-bdd1-1eeb7cad8805&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/06/26 13:43:01.476 (1m35.519s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/06/26 13:43:01.477&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 9efd352a-efb2-4984-bdd1-1eeb7cad8805&#xA;Failed to terminate run 9efd352a-efb2-4984-bdd1-1eeb7cad8805&#xA;Terminate run 9efd352a-efb2-4984-bdd1-1eeb7cad8805&#xA;Deleting run 9efd352a-efb2-4984-bdd1-1eeb7cad8805&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=8a6c63c6-9f04-45da-b371-90b36ee28f1b (cascade=true)&#xA;Pipeline with id=8a6c63c6-9f04-45da-b371-90b36ee28f1b, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/06/26 13:43:01.735 (259ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/06/26 13:43:01.736&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/06/26 13:43:01.736 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/06/26 13:43:01.736&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/06/26 13:43:01.736 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/parallel_for_after_dependency.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="101.207343202">
              <system-out>2026/07/06 13:43:06 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/06/26 13:41:25.683&#xA;Create an experiment with name E2EExperiment-1783345285683685204&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/06/26 13:41:25.898 (215ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/06/26 13:41:25.899&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x2c12b6882380&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/06/26 13:41:26.024 (125ms)&#xA;&gt; Enter [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/06/26 13:41:26.024&#xA;Uploading pipeline file critical/parallel_for_after_dependency.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1783345285899105679, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml&#xA;Upload of pipeline file &#39;critical/parallel_for_after_dependency.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 31492612-ac47-4548-b7f8-fc63760d6ed4&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;31492612-ac47-4548-b7f8-fc63760d6ed4&#39; and name: &#39;e2e-test-1783345285899105679&#39;&#xA;Create a pipeline run for pipeline with id=31492612-ac47-4548-b7f8-fc63760d6ed4 and versionId=1d7a8360-83e7-4dac-9156-e598833983b4&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=5fdd9031-1eef-4587-a8ee-ede4774ef15e&#xA;Created Pipeline Run with id: 5fdd9031-1eef-4587-a8ee-ede4774ef15e for pipeline with id: 31492612-ac47-4548-b7f8-fc63760d6ed4&#xA;Waiting for pipeline run with id=5fdd9031-1eef-4587-a8ee-ede4774ef15e to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=5fdd9031-1eef-4587-a8ee-ede4774ef15e&#xA;Pipeline run with id=5fdd9031-1eef-4587-a8ee-ede4774ef15e is in PENDING state, waiting...&#xA;Get a pipeline run with id=5fdd9031-1eef-4587-a8ee-ede4774ef15e&#xA;Pipeline run with id=5fdd9031-1eef-4587-a8ee-ede4774ef15e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=5fdd9031-1eef-4587-a8ee-ede4774ef15e&#xA;Pipeline run with id=5fdd9031-1eef-4587-a8ee-ede4774ef15e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=5fdd9031-1eef-4587-a8ee-ede4774ef15e&#xA;Pipeline run with id=5fdd9031-1eef-4587-a8ee-ede4774ef15e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=5fdd9031-1eef-4587-a8ee-ede4774ef15e&#xA;Pipeline run with id=5fdd9031-1eef-4587-a8ee-ede4774ef15e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=5fdd9031-1eef-4587-a8ee-ede4774ef15e&#xA;Pipeline run with id=5fdd9031-1eef-4587-a8ee-ede4774ef15e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=5fdd9031-1eef-4587-a8ee-ede4774ef15e&#xA;Pipeline run with id=5fdd9031-1eef-4587-a8ee-ede4774ef15e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=5fdd9031-1eef-4587-a8ee-ede4774ef15e&#xA;Pipeline run with id=5fdd9031-1eef-4587-a8ee-ede4774ef15e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=5fdd9031-1eef-4587-a8ee-ede4774ef15e&#xA;Pipeline run with id=5fdd9031-1eef-4587-a8ee-ede4774ef15e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=5fdd9031-1eef-4587-a8ee-ede4774ef15e&#xA;Pipeline run with id=5fdd9031-1eef-4587-a8ee-ede4774ef15e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=5fdd9031-1eef-4587-a8ee-ede4774ef15e&#xA;Pipeline run with id=5fdd9031-1eef-4587-a8ee-ede4774ef15e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=5fdd9031-1eef-4587-a8ee-ede4774ef15e&#xA;Pipeline run with id=5fdd9031-1eef-4587-a8ee-ede4774ef15e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=5fdd9031-1eef-4587-a8ee-ede4774ef15e&#xA;Pipeline run with id=5fdd9031-1eef-4587-a8ee-ede4774ef15e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=5fdd9031-1eef-4587-a8ee-ede4774ef15e&#xA;Pipeline run with id=5fdd9031-1eef-4587-a8ee-ede4774ef15e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=5fdd9031-1eef-4587-a8ee-ede4774ef15e&#xA;Pipeline run with id=5fdd9031-1eef-4587-a8ee-ede4774ef15e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=5fdd9031-1eef-4587-a8ee-ede4774ef15e&#xA;Pipeline run with id=5fdd9031-1eef-4587-a8ee-ede4774ef15e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=5fdd9031-1eef-4587-a8ee-ede4774ef15e&#xA;Pipeline run with id=5fdd9031-1eef-4587-a8ee-ede4774ef15e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=5fdd9031-1eef-4587-a8ee-ede4774ef15e&#xA;Pipeline run with id=5fdd9031-1eef-4587-a8ee-ede4774ef15e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=5fdd9031-1eef-4587-a8ee-ede4774ef15e&#xA;Pipeline run with id=5fdd9031-1eef-4587-a8ee-ede4774ef15e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=5fdd9031-1eef-4587-a8ee-ede4774ef15e&#xA;Pipeline run with id=5fdd9031-1eef-4587-a8ee-ede4774ef15e is in RUNNING state, waiting...&#xA;Get a pipeline run with id=5fdd9031-1eef-4587-a8ee-ede4774ef15e&#xA;Pipeline run with id=5fdd9031-1eef-4587-a8ee-ede4774ef15e reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/parallel_for_after_dependency.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=5fdd9031-1eef-4587-a8ee-ede4774ef15e&#xA;Get a pipeline run with id=5fdd9031-1eef-4587-a8ee-ede4774ef15e&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/06/26 13:43:06.581 (1m40.558s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/06/26 13:43:06.582&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 5fdd9031-1eef-4587-a8ee-ede4774ef15e&#xA;Failed to terminate run 5fdd9031-1eef-4587-a8ee-ede4774ef15e&#xA;Terminate run 5fdd9031-1eef-4587-a8ee-ede4774ef15e&#xA;Deleting run 5fdd9031-1eef-4587-a8ee-ede4774ef15e&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=31492612-ac47-4548-b7f8-fc63760d6ed4 (cascade=true)&#xA;Pipeline with id=31492612-ac47-4548-b7f8-fc63760d6ed4, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/06/26 13:43:06.89 (308ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/06/26 13:43:06.89&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/06/26 13:43:06.89 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/06/26 13:43:06.89&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/06/26 13:43:06.89 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/flip_coin.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="131.336802727">
              <system-out>2026/07/06 13:43:37 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/06/26 13:41:25.683&#xA;Create an experiment with name E2EExperiment-1783345285683793001&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/06/26 13:41:25.84 (156ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/06/26 13:41:25.841&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x14ef645ecc00&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/06/26 13:41:25.971 (130ms)&#xA;&gt; Enter [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/06/26 13:41:25.971&#xA;Uploading pipeline file critical/flip_coin.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1783345285841131187, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml&#xA;Upload of pipeline file &#39;critical/flip_coin.yaml&#39; successful&#xA;Listing pipeline versions for pipeline fc97f7e0-c838-42b5-a924-aefe831c2f85&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;fc97f7e0-c838-42b5-a924-aefe831c2f85&#39; and name: &#39;e2e-test-1783345285841131187&#39;&#xA;Create a pipeline run for pipeline with id=fc97f7e0-c838-42b5-a924-aefe831c2f85 and versionId=cedb0aca-6941-4a24-8f51-a14cfb7dbd74&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=2d2f1135-35ea-473a-80f5-bb4f9aa4935c&#xA;Created Pipeline Run with id: 2d2f1135-35ea-473a-80f5-bb4f9aa4935c for pipeline with id: fc97f7e0-c838-42b5-a924-aefe831c2f85&#xA;Waiting for pipeline run with id=2d2f1135-35ea-473a-80f5-bb4f9aa4935c to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=2d2f1135-35ea-473a-80f5-bb4f9aa4935c&#xA;Pipeline run with id=2d2f1135-35ea-473a-80f5-bb4f9aa4935c is in PENDING state, waiting...&#xA;Get a pipeline run with id=2d2f1135-35ea-473a-80f5-bb4f9aa4935c&#xA;Pipeline run with id=2d2f1135-35ea-473a-80f5-bb4f9aa4935c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=2d2f1135-35ea-473a-80f5-bb4f9aa4935c&#xA;Pipeline run with id=2d2f1135-35ea-473a-80f5-bb4f9aa4935c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=2d2f1135-35ea-473a-80f5-bb4f9aa4935c&#xA;Pipeline run with id=2d2f1135-35ea-473a-80f5-bb4f9aa4935c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=2d2f1135-35ea-473a-80f5-bb4f9aa4935c&#xA;Pipeline run with id=2d2f1135-35ea-473a-80f5-bb4f9aa4935c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=2d2f1135-35ea-473a-80f5-bb4f9aa4935c&#xA;Pipeline run with id=2d2f1135-35ea-473a-80f5-bb4f9aa4935c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=2d2f1135-35ea-473a-80f5-bb4f9aa4935c&#xA;Pipeline run with id=2d2f1135-35ea-473a-80f5-bb4f9aa4935c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=2d2f1135-35ea-473a-80f5-bb4f9aa4935c&#xA;Pipeline run with id=2d2f1135-35ea-473a-80f5-bb4f9aa4935c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=2d2f1135-35ea-473a-80f5-bb4f9aa4935c&#xA;Pipeline run with id=2d2f1135-35ea-473a-80f5-bb4f9aa4935c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=2d2f1135-35ea-473a-80f5-bb4f9aa4935c&#xA;Pipeline run with id=2d2f1135-35ea-473a-80f5-bb4f9aa4935c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=2d2f1135-35ea-473a-80f5-bb4f9aa4935c&#xA;Pipeline run with id=2d2f1135-35ea-473a-80f5-bb4f9aa4935c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=2d2f1135-35ea-473a-80f5-bb4f9aa4935c&#xA;Pipeline run with id=2d2f1135-35ea-473a-80f5-bb4f9aa4935c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=2d2f1135-35ea-473a-80f5-bb4f9aa4935c&#xA;Pipeline run with id=2d2f1135-35ea-473a-80f5-bb4f9aa4935c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=2d2f1135-35ea-473a-80f5-bb4f9aa4935c&#xA;Pipeline run with id=2d2f1135-35ea-473a-80f5-bb4f9aa4935c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=2d2f1135-35ea-473a-80f5-bb4f9aa4935c&#xA;Pipeline run with id=2d2f1135-35ea-473a-80f5-bb4f9aa4935c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=2d2f1135-35ea-473a-80f5-bb4f9aa4935c&#xA;Pipeline run with id=2d2f1135-35ea-473a-80f5-bb4f9aa4935c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=2d2f1135-35ea-473a-80f5-bb4f9aa4935c&#xA;Pipeline run with id=2d2f1135-35ea-473a-80f5-bb4f9aa4935c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=2d2f1135-35ea-473a-80f5-bb4f9aa4935c&#xA;Pipeline run with id=2d2f1135-35ea-473a-80f5-bb4f9aa4935c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=2d2f1135-35ea-473a-80f5-bb4f9aa4935c&#xA;Pipeline run with id=2d2f1135-35ea-473a-80f5-bb4f9aa4935c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=2d2f1135-35ea-473a-80f5-bb4f9aa4935c&#xA;Pipeline run with id=2d2f1135-35ea-473a-80f5-bb4f9aa4935c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=2d2f1135-35ea-473a-80f5-bb4f9aa4935c&#xA;Pipeline run with id=2d2f1135-35ea-473a-80f5-bb4f9aa4935c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=2d2f1135-35ea-473a-80f5-bb4f9aa4935c&#xA;Pipeline run with id=2d2f1135-35ea-473a-80f5-bb4f9aa4935c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=2d2f1135-35ea-473a-80f5-bb4f9aa4935c&#xA;Pipeline run with id=2d2f1135-35ea-473a-80f5-bb4f9aa4935c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=2d2f1135-35ea-473a-80f5-bb4f9aa4935c&#xA;Pipeline run with id=2d2f1135-35ea-473a-80f5-bb4f9aa4935c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=2d2f1135-35ea-473a-80f5-bb4f9aa4935c&#xA;Pipeline run with id=2d2f1135-35ea-473a-80f5-bb4f9aa4935c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=2d2f1135-35ea-473a-80f5-bb4f9aa4935c&#xA;Pipeline run with id=2d2f1135-35ea-473a-80f5-bb4f9aa4935c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=2d2f1135-35ea-473a-80f5-bb4f9aa4935c&#xA;Pipeline run with id=2d2f1135-35ea-473a-80f5-bb4f9aa4935c reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/flip_coin.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=2d2f1135-35ea-473a-80f5-bb4f9aa4935c&#xA;Get a pipeline run with id=2d2f1135-35ea-473a-80f5-bb4f9aa4935c&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/06/26 13:43:36.578 (2m10.607s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/06/26 13:43:36.578&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 2d2f1135-35ea-473a-80f5-bb4f9aa4935c&#xA;Failed to terminate run 2d2f1135-35ea-473a-80f5-bb4f9aa4935c&#xA;Terminate run 2d2f1135-35ea-473a-80f5-bb4f9aa4935c&#xA;Deleting run 2d2f1135-35ea-473a-80f5-bb4f9aa4935c&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=fc97f7e0-c838-42b5-a924-aefe831c2f85 (cascade=true)&#xA;Pipeline with id=fc97f7e0-c838-42b5-a924-aefe831c2f85, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/06/26 13:43:37.02 (441ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/06/26 13:43:37.02&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/06/26 13:43:37.02 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/06/26 13:43:37.02&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/06/26 13:43:37.02 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload essential/iris_pipeline_compiled.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="155.99788196">
              <system-out>2026/07/06 13:44:01 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/06/26 13:41:25.684&#xA;Create an experiment with name E2EExperiment-1783345285684352569&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/06/26 13:41:25.904 (220ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/06/26 13:41:25.904&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x5220ff24180&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/06/26 13:41:26.038 (134ms)&#xA;&gt; Enter [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/06/26 13:41:26.038&#xA;Uploading pipeline file essential/iris_pipeline_compiled.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1783345285904994473, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml&#xA;Upload of pipeline file &#39;essential/iris_pipeline_compiled.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 9eee98f8-1889-42c8-9159-09f4e5e9ea9d&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;9eee98f8-1889-42c8-9159-09f4e5e9ea9d&#39; and name: &#39;e2e-test-1783345285904994473&#39;&#xA;Create a pipeline run for pipeline with id=9eee98f8-1889-42c8-9159-09f4e5e9ea9d and versionId=3922c708-b787-4501-9c86-0079e469f990&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=3e4c3c28-7bd5-4af5-97ef-f6acde0d0f2b&#xA;Created Pipeline Run with id: 3e4c3c28-7bd5-4af5-97ef-f6acde0d0f2b for pipeline with id: 9eee98f8-1889-42c8-9159-09f4e5e9ea9d&#xA;Waiting for pipeline run with id=3e4c3c28-7bd5-4af5-97ef-f6acde0d0f2b to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=3e4c3c28-7bd5-4af5-97ef-f6acde0d0f2b&#xA;Pipeline run with id=3e4c3c28-7bd5-4af5-97ef-f6acde0d0f2b is in PENDING state, waiting...&#xA;Get a pipeline run with id=3e4c3c28-7bd5-4af5-97ef-f6acde0d0f2b&#xA;Pipeline run with id=3e4c3c28-7bd5-4af5-97ef-f6acde0d0f2b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3e4c3c28-7bd5-4af5-97ef-f6acde0d0f2b&#xA;Pipeline run with id=3e4c3c28-7bd5-4af5-97ef-f6acde0d0f2b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3e4c3c28-7bd5-4af5-97ef-f6acde0d0f2b&#xA;Pipeline run with id=3e4c3c28-7bd5-4af5-97ef-f6acde0d0f2b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3e4c3c28-7bd5-4af5-97ef-f6acde0d0f2b&#xA;Pipeline run with id=3e4c3c28-7bd5-4af5-97ef-f6acde0d0f2b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3e4c3c28-7bd5-4af5-97ef-f6acde0d0f2b&#xA;Pipeline run with id=3e4c3c28-7bd5-4af5-97ef-f6acde0d0f2b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3e4c3c28-7bd5-4af5-97ef-f6acde0d0f2b&#xA;Pipeline run with id=3e4c3c28-7bd5-4af5-97ef-f6acde0d0f2b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3e4c3c28-7bd5-4af5-97ef-f6acde0d0f2b&#xA;Pipeline run with id=3e4c3c28-7bd5-4af5-97ef-f6acde0d0f2b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3e4c3c28-7bd5-4af5-97ef-f6acde0d0f2b&#xA;Pipeline run with id=3e4c3c28-7bd5-4af5-97ef-f6acde0d0f2b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3e4c3c28-7bd5-4af5-97ef-f6acde0d0f2b&#xA;Pipeline run with id=3e4c3c28-7bd5-4af5-97ef-f6acde0d0f2b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3e4c3c28-7bd5-4af5-97ef-f6acde0d0f2b&#xA;Pipeline run with id=3e4c3c28-7bd5-4af5-97ef-f6acde0d0f2b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3e4c3c28-7bd5-4af5-97ef-f6acde0d0f2b&#xA;Pipeline run with id=3e4c3c28-7bd5-4af5-97ef-f6acde0d0f2b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3e4c3c28-7bd5-4af5-97ef-f6acde0d0f2b&#xA;Pipeline run with id=3e4c3c28-7bd5-4af5-97ef-f6acde0d0f2b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3e4c3c28-7bd5-4af5-97ef-f6acde0d0f2b&#xA;Pipeline run with id=3e4c3c28-7bd5-4af5-97ef-f6acde0d0f2b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3e4c3c28-7bd5-4af5-97ef-f6acde0d0f2b&#xA;Pipeline run with id=3e4c3c28-7bd5-4af5-97ef-f6acde0d0f2b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3e4c3c28-7bd5-4af5-97ef-f6acde0d0f2b&#xA;Pipeline run with id=3e4c3c28-7bd5-4af5-97ef-f6acde0d0f2b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3e4c3c28-7bd5-4af5-97ef-f6acde0d0f2b&#xA;Pipeline run with id=3e4c3c28-7bd5-4af5-97ef-f6acde0d0f2b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3e4c3c28-7bd5-4af5-97ef-f6acde0d0f2b&#xA;Pipeline run with id=3e4c3c28-7bd5-4af5-97ef-f6acde0d0f2b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3e4c3c28-7bd5-4af5-97ef-f6acde0d0f2b&#xA;Pipeline run with id=3e4c3c28-7bd5-4af5-97ef-f6acde0d0f2b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3e4c3c28-7bd5-4af5-97ef-f6acde0d0f2b&#xA;Pipeline run with id=3e4c3c28-7bd5-4af5-97ef-f6acde0d0f2b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3e4c3c28-7bd5-4af5-97ef-f6acde0d0f2b&#xA;Pipeline run with id=3e4c3c28-7bd5-4af5-97ef-f6acde0d0f2b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3e4c3c28-7bd5-4af5-97ef-f6acde0d0f2b&#xA;Pipeline run with id=3e4c3c28-7bd5-4af5-97ef-f6acde0d0f2b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3e4c3c28-7bd5-4af5-97ef-f6acde0d0f2b&#xA;Pipeline run with id=3e4c3c28-7bd5-4af5-97ef-f6acde0d0f2b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3e4c3c28-7bd5-4af5-97ef-f6acde0d0f2b&#xA;Pipeline run with id=3e4c3c28-7bd5-4af5-97ef-f6acde0d0f2b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3e4c3c28-7bd5-4af5-97ef-f6acde0d0f2b&#xA;Pipeline run with id=3e4c3c28-7bd5-4af5-97ef-f6acde0d0f2b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3e4c3c28-7bd5-4af5-97ef-f6acde0d0f2b&#xA;Pipeline run with id=3e4c3c28-7bd5-4af5-97ef-f6acde0d0f2b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3e4c3c28-7bd5-4af5-97ef-f6acde0d0f2b&#xA;Pipeline run with id=3e4c3c28-7bd5-4af5-97ef-f6acde0d0f2b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3e4c3c28-7bd5-4af5-97ef-f6acde0d0f2b&#xA;Pipeline run with id=3e4c3c28-7bd5-4af5-97ef-f6acde0d0f2b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3e4c3c28-7bd5-4af5-97ef-f6acde0d0f2b&#xA;Pipeline run with id=3e4c3c28-7bd5-4af5-97ef-f6acde0d0f2b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3e4c3c28-7bd5-4af5-97ef-f6acde0d0f2b&#xA;Pipeline run with id=3e4c3c28-7bd5-4af5-97ef-f6acde0d0f2b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3e4c3c28-7bd5-4af5-97ef-f6acde0d0f2b&#xA;Pipeline run with id=3e4c3c28-7bd5-4af5-97ef-f6acde0d0f2b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=3e4c3c28-7bd5-4af5-97ef-f6acde0d0f2b&#xA;Pipeline run with id=3e4c3c28-7bd5-4af5-97ef-f6acde0d0f2b reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;essential/iris_pipeline_compiled.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=3e4c3c28-7bd5-4af5-97ef-f6acde0d0f2b&#xA;Get a pipeline run with id=3e4c3c28-7bd5-4af5-97ef-f6acde0d0f2b&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/06/26 13:44:01.472 (2m35.434s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/06/26 13:44:01.472&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 3e4c3c28-7bd5-4af5-97ef-f6acde0d0f2b&#xA;Failed to terminate run 3e4c3c28-7bd5-4af5-97ef-f6acde0d0f2b&#xA;Terminate run 3e4c3c28-7bd5-4af5-97ef-f6acde0d0f2b&#xA;Deleting run 3e4c3c28-7bd5-4af5-97ef-f6acde0d0f2b&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=9eee98f8-1889-42c8-9159-09f4e5e9ea9d (cascade=true)&#xA;Pipeline with id=9eee98f8-1889-42c8-9159-09f4e5e9ea9d, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/06/26 13:44:01.681 (209ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/06/26 13:44:01.682&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/06/26 13:44:01.682 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/06/26 13:44:01.682&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/06/26 13:44:01.682 (0s)&#xA;</system-err>
          </testcase>
      </testsuite>
  </testsuites>