<?xml version="1.0" encoding="UTF-8"?>
  <testsuites tests="5" disabled="0" errors="0" failures="0" time="156.302298089">
      <testsuite name="AIPipelinesE2ETests" package="/dspa/backend/test/end2end" tests="5" disabled="0" skipped="0" errors="0" failures="0" time="156.302298089" timestamp="2026-07-02T20:43:22">
          <properties>
              <property name="SuiteSucceeded" value="true"></property>
              <property name="SuiteHasProgrammaticFocus" value="false"></property>
              <property name="SpecialSuiteFailureReason" value=""></property>
              <property name="SuiteLabels" value="[]"></property>
              <property name="SuiteSemVerConstraints" value="[]"></property>
              <property name="RandomSeed" value="1783024842"></property>
              <property name="RandomizeAllSpecs" value="false"></property>
              <property name="LabelFilter" value="Smoke"></property>
              <property name="SemVerFilter" value=""></property>
              <property name="FocusStrings" value=""></property>
              <property name="SkipStrings" value=""></property>
              <property name="FocusFiles" value=""></property>
              <property name="SkipFiles" value=""></property>
              <property name="FailOnPending" value="false"></property>
              <property name="FailOnEmpty" value="false"></property>
              <property name="FailFast" value="false"></property>
              <property name="FlakeAttempts" value="0"></property>
              <property name="DryRun" value="false"></property>
              <property name="ParallelTotal" value="10"></property>
              <property name="OutputInterceptorMode" value=""></property>
          </properties>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/pipeline_with_artifact_upload_download.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="101.11025585">
              <system-out>2026/07/02 20:45:04 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/02/26 20:43:23.135&#xA;Create an experiment with name E2EExperiment-1783025003135041226&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/02/26 20:43:23.355 (220ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/02/26 20:43:23.355&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x3a5970a8180&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/02/26 20:43:23.484 (129ms)&#xA;&gt; Enter [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/02/26 20:43:23.484&#xA;Uploading pipeline file critical/pipeline_with_artifact_upload_download.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1783025003355498516, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml&#xA;Upload of pipeline file &#39;critical/pipeline_with_artifact_upload_download.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 33053f30-deb3-473d-af9c-873eeef99af5&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;33053f30-deb3-473d-af9c-873eeef99af5&#39; and name: &#39;e2e-test-1783025003355498516&#39;&#xA;Create a pipeline run for pipeline with id=33053f30-deb3-473d-af9c-873eeef99af5 and versionId=99586a36-102d-4682-8e6a-cfbb91664b2b&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=b67ffdb3-9591-4f50-bd95-69fee30e2b43&#xA;Created Pipeline Run with id: b67ffdb3-9591-4f50-bd95-69fee30e2b43 for pipeline with id: 33053f30-deb3-473d-af9c-873eeef99af5&#xA;Waiting for pipeline run with id=b67ffdb3-9591-4f50-bd95-69fee30e2b43 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=b67ffdb3-9591-4f50-bd95-69fee30e2b43&#xA;Pipeline run with id=b67ffdb3-9591-4f50-bd95-69fee30e2b43 is in PENDING state, waiting...&#xA;Get a pipeline run with id=b67ffdb3-9591-4f50-bd95-69fee30e2b43&#xA;Pipeline run with id=b67ffdb3-9591-4f50-bd95-69fee30e2b43 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b67ffdb3-9591-4f50-bd95-69fee30e2b43&#xA;Pipeline run with id=b67ffdb3-9591-4f50-bd95-69fee30e2b43 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b67ffdb3-9591-4f50-bd95-69fee30e2b43&#xA;Pipeline run with id=b67ffdb3-9591-4f50-bd95-69fee30e2b43 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b67ffdb3-9591-4f50-bd95-69fee30e2b43&#xA;Pipeline run with id=b67ffdb3-9591-4f50-bd95-69fee30e2b43 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b67ffdb3-9591-4f50-bd95-69fee30e2b43&#xA;Pipeline run with id=b67ffdb3-9591-4f50-bd95-69fee30e2b43 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b67ffdb3-9591-4f50-bd95-69fee30e2b43&#xA;Pipeline run with id=b67ffdb3-9591-4f50-bd95-69fee30e2b43 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b67ffdb3-9591-4f50-bd95-69fee30e2b43&#xA;Pipeline run with id=b67ffdb3-9591-4f50-bd95-69fee30e2b43 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b67ffdb3-9591-4f50-bd95-69fee30e2b43&#xA;Pipeline run with id=b67ffdb3-9591-4f50-bd95-69fee30e2b43 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b67ffdb3-9591-4f50-bd95-69fee30e2b43&#xA;Pipeline run with id=b67ffdb3-9591-4f50-bd95-69fee30e2b43 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b67ffdb3-9591-4f50-bd95-69fee30e2b43&#xA;Pipeline run with id=b67ffdb3-9591-4f50-bd95-69fee30e2b43 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b67ffdb3-9591-4f50-bd95-69fee30e2b43&#xA;Pipeline run with id=b67ffdb3-9591-4f50-bd95-69fee30e2b43 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b67ffdb3-9591-4f50-bd95-69fee30e2b43&#xA;Pipeline run with id=b67ffdb3-9591-4f50-bd95-69fee30e2b43 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b67ffdb3-9591-4f50-bd95-69fee30e2b43&#xA;Pipeline run with id=b67ffdb3-9591-4f50-bd95-69fee30e2b43 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b67ffdb3-9591-4f50-bd95-69fee30e2b43&#xA;Pipeline run with id=b67ffdb3-9591-4f50-bd95-69fee30e2b43 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b67ffdb3-9591-4f50-bd95-69fee30e2b43&#xA;Pipeline run with id=b67ffdb3-9591-4f50-bd95-69fee30e2b43 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b67ffdb3-9591-4f50-bd95-69fee30e2b43&#xA;Pipeline run with id=b67ffdb3-9591-4f50-bd95-69fee30e2b43 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b67ffdb3-9591-4f50-bd95-69fee30e2b43&#xA;Pipeline run with id=b67ffdb3-9591-4f50-bd95-69fee30e2b43 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b67ffdb3-9591-4f50-bd95-69fee30e2b43&#xA;Pipeline run with id=b67ffdb3-9591-4f50-bd95-69fee30e2b43 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b67ffdb3-9591-4f50-bd95-69fee30e2b43&#xA;Pipeline run with id=b67ffdb3-9591-4f50-bd95-69fee30e2b43 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b67ffdb3-9591-4f50-bd95-69fee30e2b43&#xA;Pipeline run with id=b67ffdb3-9591-4f50-bd95-69fee30e2b43 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/pipeline_with_artifact_upload_download.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=b67ffdb3-9591-4f50-bd95-69fee30e2b43&#xA;Get a pipeline run with id=b67ffdb3-9591-4f50-bd95-69fee30e2b43&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/02/26 20:45:04.047 (1m40.563s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/02/26 20:45:04.047&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run b67ffdb3-9591-4f50-bd95-69fee30e2b43&#xA;Failed to terminate run b67ffdb3-9591-4f50-bd95-69fee30e2b43&#xA;Terminate run b67ffdb3-9591-4f50-bd95-69fee30e2b43&#xA;Deleting run b67ffdb3-9591-4f50-bd95-69fee30e2b43&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=33053f30-deb3-473d-af9c-873eeef99af5 (cascade=true)&#xA;Pipeline with id=33053f30-deb3-473d-af9c-873eeef99af5, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/02/26 20:45:04.245 (197ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/02/26 20:45:04.245&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/02/26 20:45:04.245 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/02/26 20:45:04.245&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/02/26 20:45:04.245 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload essential/component_with_pip_index_urls.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="45.814512306">
              <system-out>2026/07/02 20:44:08 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/02/26 20:43:23.135&#xA;Create an experiment with name E2EExperiment-1783025003135682473&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/02/26 20:43:23.264 (129ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/02/26 20:43:23.264&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x25df6959a980&#xA;test-secret-1 created&#xA;test-secret-2 created&#xA;test-secret-3 created&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/02/26 20:43:23.346 (82ms)&#xA;&gt; Enter [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/02/26 20:43:23.346&#xA;Uploading pipeline file essential/component_with_pip_index_urls.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1783025003264379466, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml&#xA;Upload of pipeline file &#39;essential/component_with_pip_index_urls.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 68e61883-487b-4409-a3e7-db78fc83b315&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;68e61883-487b-4409-a3e7-db78fc83b315&#39; and name: &#39;e2e-test-1783025003264379466&#39;&#xA;Create a pipeline run for pipeline with id=68e61883-487b-4409-a3e7-db78fc83b315 and versionId=72aeced7-f210-46a9-a3c9-dae94389937c&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=a4dbddba-51b0-4096-a597-66d18bd61a28&#xA;Created Pipeline Run with id: a4dbddba-51b0-4096-a597-66d18bd61a28 for pipeline with id: 68e61883-487b-4409-a3e7-db78fc83b315&#xA;Waiting for pipeline run with id=a4dbddba-51b0-4096-a597-66d18bd61a28 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=a4dbddba-51b0-4096-a597-66d18bd61a28&#xA;Pipeline run with id=a4dbddba-51b0-4096-a597-66d18bd61a28 is in PENDING state, waiting...&#xA;Get a pipeline run with id=a4dbddba-51b0-4096-a597-66d18bd61a28&#xA;Pipeline run with id=a4dbddba-51b0-4096-a597-66d18bd61a28 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=a4dbddba-51b0-4096-a597-66d18bd61a28&#xA;Pipeline run with id=a4dbddba-51b0-4096-a597-66d18bd61a28 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=a4dbddba-51b0-4096-a597-66d18bd61a28&#xA;Pipeline run with id=a4dbddba-51b0-4096-a597-66d18bd61a28 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=a4dbddba-51b0-4096-a597-66d18bd61a28&#xA;Pipeline run with id=a4dbddba-51b0-4096-a597-66d18bd61a28 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=a4dbddba-51b0-4096-a597-66d18bd61a28&#xA;Pipeline run with id=a4dbddba-51b0-4096-a597-66d18bd61a28 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=a4dbddba-51b0-4096-a597-66d18bd61a28&#xA;Pipeline run with id=a4dbddba-51b0-4096-a597-66d18bd61a28 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=a4dbddba-51b0-4096-a597-66d18bd61a28&#xA;Pipeline run with id=a4dbddba-51b0-4096-a597-66d18bd61a28 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=a4dbddba-51b0-4096-a597-66d18bd61a28&#xA;Pipeline run with id=a4dbddba-51b0-4096-a597-66d18bd61a28 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=a4dbddba-51b0-4096-a597-66d18bd61a28&#xA;Pipeline run with id=a4dbddba-51b0-4096-a597-66d18bd61a28 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;essential/component_with_pip_index_urls.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=a4dbddba-51b0-4096-a597-66d18bd61a28&#xA;Get a pipeline run with id=a4dbddba-51b0-4096-a597-66d18bd61a28&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/02/26 20:44:08.725 (45.379s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/02/26 20:44:08.725&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run a4dbddba-51b0-4096-a597-66d18bd61a28&#xA;Failed to terminate run a4dbddba-51b0-4096-a597-66d18bd61a28&#xA;Terminate run a4dbddba-51b0-4096-a597-66d18bd61a28&#xA;Deleting run a4dbddba-51b0-4096-a597-66d18bd61a28&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=68e61883-487b-4409-a3e7-db78fc83b315 (cascade=true)&#xA;Pipeline with id=68e61883-487b-4409-a3e7-db78fc83b315, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/02/26 20:44:08.949 (224ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/02/26 20:44:08.95&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/02/26 20:44:08.95 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/02/26 20:44:08.95&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/02/26 20:44:08.95 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/parallel_for_after_dependency.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="96.262683603">
              <system-out>2026/07/02 20:44:59 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/02/26 20:43:23.135&#xA;Create an experiment with name E2EExperiment-1783025003135229571&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/02/26 20:43:23.27 (135ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/02/26 20:43:23.27&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x25584532e400&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/02/26 20:43:23.393 (123ms)&#xA;&gt; Enter [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/02/26 20:43:23.393&#xA;Uploading pipeline file critical/parallel_for_after_dependency.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1783025003270593562, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml&#xA;Upload of pipeline file &#39;critical/parallel_for_after_dependency.yaml&#39; successful&#xA;Listing pipeline versions for pipeline a6be8408-9283-49d1-9262-6fc54603f65d&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;a6be8408-9283-49d1-9262-6fc54603f65d&#39; and name: &#39;e2e-test-1783025003270593562&#39;&#xA;Create a pipeline run for pipeline with id=a6be8408-9283-49d1-9262-6fc54603f65d and versionId=7338be7d-230c-4448-a5a1-f6ea802159b3&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=67e8689e-13c9-49a6-8522-8065bacecc33&#xA;Created Pipeline Run with id: 67e8689e-13c9-49a6-8522-8065bacecc33 for pipeline with id: a6be8408-9283-49d1-9262-6fc54603f65d&#xA;Waiting for pipeline run with id=67e8689e-13c9-49a6-8522-8065bacecc33 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=67e8689e-13c9-49a6-8522-8065bacecc33&#xA;Pipeline run with id=67e8689e-13c9-49a6-8522-8065bacecc33 is in PENDING state, waiting...&#xA;Get a pipeline run with id=67e8689e-13c9-49a6-8522-8065bacecc33&#xA;Pipeline run with id=67e8689e-13c9-49a6-8522-8065bacecc33 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=67e8689e-13c9-49a6-8522-8065bacecc33&#xA;Pipeline run with id=67e8689e-13c9-49a6-8522-8065bacecc33 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=67e8689e-13c9-49a6-8522-8065bacecc33&#xA;Pipeline run with id=67e8689e-13c9-49a6-8522-8065bacecc33 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=67e8689e-13c9-49a6-8522-8065bacecc33&#xA;Pipeline run with id=67e8689e-13c9-49a6-8522-8065bacecc33 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=67e8689e-13c9-49a6-8522-8065bacecc33&#xA;Pipeline run with id=67e8689e-13c9-49a6-8522-8065bacecc33 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=67e8689e-13c9-49a6-8522-8065bacecc33&#xA;Pipeline run with id=67e8689e-13c9-49a6-8522-8065bacecc33 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=67e8689e-13c9-49a6-8522-8065bacecc33&#xA;Pipeline run with id=67e8689e-13c9-49a6-8522-8065bacecc33 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=67e8689e-13c9-49a6-8522-8065bacecc33&#xA;Pipeline run with id=67e8689e-13c9-49a6-8522-8065bacecc33 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=67e8689e-13c9-49a6-8522-8065bacecc33&#xA;Pipeline run with id=67e8689e-13c9-49a6-8522-8065bacecc33 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=67e8689e-13c9-49a6-8522-8065bacecc33&#xA;Pipeline run with id=67e8689e-13c9-49a6-8522-8065bacecc33 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=67e8689e-13c9-49a6-8522-8065bacecc33&#xA;Pipeline run with id=67e8689e-13c9-49a6-8522-8065bacecc33 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=67e8689e-13c9-49a6-8522-8065bacecc33&#xA;Pipeline run with id=67e8689e-13c9-49a6-8522-8065bacecc33 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=67e8689e-13c9-49a6-8522-8065bacecc33&#xA;Pipeline run with id=67e8689e-13c9-49a6-8522-8065bacecc33 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=67e8689e-13c9-49a6-8522-8065bacecc33&#xA;Pipeline run with id=67e8689e-13c9-49a6-8522-8065bacecc33 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=67e8689e-13c9-49a6-8522-8065bacecc33&#xA;Pipeline run with id=67e8689e-13c9-49a6-8522-8065bacecc33 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=67e8689e-13c9-49a6-8522-8065bacecc33&#xA;Pipeline run with id=67e8689e-13c9-49a6-8522-8065bacecc33 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=67e8689e-13c9-49a6-8522-8065bacecc33&#xA;Pipeline run with id=67e8689e-13c9-49a6-8522-8065bacecc33 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=67e8689e-13c9-49a6-8522-8065bacecc33&#xA;Pipeline run with id=67e8689e-13c9-49a6-8522-8065bacecc33 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=67e8689e-13c9-49a6-8522-8065bacecc33&#xA;Pipeline run with id=67e8689e-13c9-49a6-8522-8065bacecc33 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/parallel_for_after_dependency.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=67e8689e-13c9-49a6-8522-8065bacecc33&#xA;Get a pipeline run with id=67e8689e-13c9-49a6-8522-8065bacecc33&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/02/26 20:44:58.847 (1m35.454s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/02/26 20:44:58.847&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 67e8689e-13c9-49a6-8522-8065bacecc33&#xA;Failed to terminate run 67e8689e-13c9-49a6-8522-8065bacecc33&#xA;Terminate run 67e8689e-13c9-49a6-8522-8065bacecc33&#xA;Deleting run 67e8689e-13c9-49a6-8522-8065bacecc33&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=a6be8408-9283-49d1-9262-6fc54603f65d (cascade=true)&#xA;Pipeline with id=a6be8408-9283-49d1-9262-6fc54603f65d, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/02/26 20:44:59.397 (550ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/02/26 20:44:59.397&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/02/26 20:44:59.397 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/02/26 20:44:59.398&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/02/26 20:44:59.398 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/flip_coin.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="131.293964469">
              <system-out>2026/07/02 20:45:34 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/02/26 20:43:23.134&#xA;Create an experiment with name E2EExperiment-1783025003134935453&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/02/26 20:43:23.268 (133ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/02/26 20:43:23.268&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x3891a5e3c300&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/02/26 20:43:23.405 (138ms)&#xA;&gt; Enter [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/02/26 20:43:23.406&#xA;Uploading pipeline file critical/flip_coin.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1783025003268429434, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml&#xA;Upload of pipeline file &#39;critical/flip_coin.yaml&#39; successful&#xA;Listing pipeline versions for pipeline caaddb91-d0df-4acd-9a94-933452c6e80b&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;caaddb91-d0df-4acd-9a94-933452c6e80b&#39; and name: &#39;e2e-test-1783025003268429434&#39;&#xA;Create a pipeline run for pipeline with id=caaddb91-d0df-4acd-9a94-933452c6e80b and versionId=628b8cca-0441-42dc-b74e-1ee3b5b416fc&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=b2cbb870-ab41-41f3-be20-4dca67a91ac2&#xA;Created Pipeline Run with id: b2cbb870-ab41-41f3-be20-4dca67a91ac2 for pipeline with id: caaddb91-d0df-4acd-9a94-933452c6e80b&#xA;Waiting for pipeline run with id=b2cbb870-ab41-41f3-be20-4dca67a91ac2 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=b2cbb870-ab41-41f3-be20-4dca67a91ac2&#xA;Pipeline run with id=b2cbb870-ab41-41f3-be20-4dca67a91ac2 is in PENDING state, waiting...&#xA;Get a pipeline run with id=b2cbb870-ab41-41f3-be20-4dca67a91ac2&#xA;Pipeline run with id=b2cbb870-ab41-41f3-be20-4dca67a91ac2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b2cbb870-ab41-41f3-be20-4dca67a91ac2&#xA;Pipeline run with id=b2cbb870-ab41-41f3-be20-4dca67a91ac2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b2cbb870-ab41-41f3-be20-4dca67a91ac2&#xA;Pipeline run with id=b2cbb870-ab41-41f3-be20-4dca67a91ac2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b2cbb870-ab41-41f3-be20-4dca67a91ac2&#xA;Pipeline run with id=b2cbb870-ab41-41f3-be20-4dca67a91ac2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b2cbb870-ab41-41f3-be20-4dca67a91ac2&#xA;Pipeline run with id=b2cbb870-ab41-41f3-be20-4dca67a91ac2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b2cbb870-ab41-41f3-be20-4dca67a91ac2&#xA;Pipeline run with id=b2cbb870-ab41-41f3-be20-4dca67a91ac2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b2cbb870-ab41-41f3-be20-4dca67a91ac2&#xA;Pipeline run with id=b2cbb870-ab41-41f3-be20-4dca67a91ac2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b2cbb870-ab41-41f3-be20-4dca67a91ac2&#xA;Pipeline run with id=b2cbb870-ab41-41f3-be20-4dca67a91ac2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b2cbb870-ab41-41f3-be20-4dca67a91ac2&#xA;Pipeline run with id=b2cbb870-ab41-41f3-be20-4dca67a91ac2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b2cbb870-ab41-41f3-be20-4dca67a91ac2&#xA;Pipeline run with id=b2cbb870-ab41-41f3-be20-4dca67a91ac2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b2cbb870-ab41-41f3-be20-4dca67a91ac2&#xA;Pipeline run with id=b2cbb870-ab41-41f3-be20-4dca67a91ac2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b2cbb870-ab41-41f3-be20-4dca67a91ac2&#xA;Pipeline run with id=b2cbb870-ab41-41f3-be20-4dca67a91ac2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b2cbb870-ab41-41f3-be20-4dca67a91ac2&#xA;Pipeline run with id=b2cbb870-ab41-41f3-be20-4dca67a91ac2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b2cbb870-ab41-41f3-be20-4dca67a91ac2&#xA;Pipeline run with id=b2cbb870-ab41-41f3-be20-4dca67a91ac2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b2cbb870-ab41-41f3-be20-4dca67a91ac2&#xA;Pipeline run with id=b2cbb870-ab41-41f3-be20-4dca67a91ac2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b2cbb870-ab41-41f3-be20-4dca67a91ac2&#xA;Pipeline run with id=b2cbb870-ab41-41f3-be20-4dca67a91ac2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b2cbb870-ab41-41f3-be20-4dca67a91ac2&#xA;Pipeline run with id=b2cbb870-ab41-41f3-be20-4dca67a91ac2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b2cbb870-ab41-41f3-be20-4dca67a91ac2&#xA;Pipeline run with id=b2cbb870-ab41-41f3-be20-4dca67a91ac2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b2cbb870-ab41-41f3-be20-4dca67a91ac2&#xA;Pipeline run with id=b2cbb870-ab41-41f3-be20-4dca67a91ac2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b2cbb870-ab41-41f3-be20-4dca67a91ac2&#xA;Pipeline run with id=b2cbb870-ab41-41f3-be20-4dca67a91ac2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b2cbb870-ab41-41f3-be20-4dca67a91ac2&#xA;Pipeline run with id=b2cbb870-ab41-41f3-be20-4dca67a91ac2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b2cbb870-ab41-41f3-be20-4dca67a91ac2&#xA;Pipeline run with id=b2cbb870-ab41-41f3-be20-4dca67a91ac2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b2cbb870-ab41-41f3-be20-4dca67a91ac2&#xA;Pipeline run with id=b2cbb870-ab41-41f3-be20-4dca67a91ac2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b2cbb870-ab41-41f3-be20-4dca67a91ac2&#xA;Pipeline run with id=b2cbb870-ab41-41f3-be20-4dca67a91ac2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b2cbb870-ab41-41f3-be20-4dca67a91ac2&#xA;Pipeline run with id=b2cbb870-ab41-41f3-be20-4dca67a91ac2 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=b2cbb870-ab41-41f3-be20-4dca67a91ac2&#xA;Pipeline run with id=b2cbb870-ab41-41f3-be20-4dca67a91ac2 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/flip_coin.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=b2cbb870-ab41-41f3-be20-4dca67a91ac2&#xA;Get a pipeline run with id=b2cbb870-ab41-41f3-be20-4dca67a91ac2&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/02/26 20:45:34.063 (2m10.657s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/02/26 20:45:34.063&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run b2cbb870-ab41-41f3-be20-4dca67a91ac2&#xA;Failed to terminate run b2cbb870-ab41-41f3-be20-4dca67a91ac2&#xA;Terminate run b2cbb870-ab41-41f3-be20-4dca67a91ac2&#xA;Deleting run b2cbb870-ab41-41f3-be20-4dca67a91ac2&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=caaddb91-d0df-4acd-9a94-933452c6e80b (cascade=true)&#xA;Pipeline with id=caaddb91-d0df-4acd-9a94-933452c6e80b, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/02/26 20:45:34.428 (365ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/02/26 20:45:34.428&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/02/26 20:45:34.428 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/02/26 20:45:34.428&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/02/26 20:45:34.428 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload essential/iris_pipeline_compiled.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="156.012336314">
              <system-out>2026/07/02 20:45:59 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/02/26 20:43:23.135&#xA;Create an experiment with name E2EExperiment-1783025003135762335&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/02/26 20:43:23.264 (129ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/02/26 20:43:23.264&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x2a297cb28b00&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/02/26 20:43:23.412 (148ms)&#xA;&gt; Enter [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/02/26 20:43:23.412&#xA;Uploading pipeline file essential/iris_pipeline_compiled.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1783025003264438798, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml&#xA;Upload of pipeline file &#39;essential/iris_pipeline_compiled.yaml&#39; successful&#xA;Listing pipeline versions for pipeline e9e644a9-6a25-4044-a619-67daaa1dcbee&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;e9e644a9-6a25-4044-a619-67daaa1dcbee&#39; and name: &#39;e2e-test-1783025003264438798&#39;&#xA;Create a pipeline run for pipeline with id=e9e644a9-6a25-4044-a619-67daaa1dcbee and versionId=7c21b58f-d0ed-4281-a721-dcf57f57a807&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=bb61cebb-aeb0-4b75-acad-317ea5036cdc&#xA;Created Pipeline Run with id: bb61cebb-aeb0-4b75-acad-317ea5036cdc for pipeline with id: e9e644a9-6a25-4044-a619-67daaa1dcbee&#xA;Waiting for pipeline run with id=bb61cebb-aeb0-4b75-acad-317ea5036cdc to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=bb61cebb-aeb0-4b75-acad-317ea5036cdc&#xA;Pipeline run with id=bb61cebb-aeb0-4b75-acad-317ea5036cdc is in PENDING state, waiting...&#xA;Get a pipeline run with id=bb61cebb-aeb0-4b75-acad-317ea5036cdc&#xA;Pipeline run with id=bb61cebb-aeb0-4b75-acad-317ea5036cdc is in RUNNING state, waiting...&#xA;Get a pipeline run with id=bb61cebb-aeb0-4b75-acad-317ea5036cdc&#xA;Pipeline run with id=bb61cebb-aeb0-4b75-acad-317ea5036cdc is in RUNNING state, waiting...&#xA;Get a pipeline run with id=bb61cebb-aeb0-4b75-acad-317ea5036cdc&#xA;Pipeline run with id=bb61cebb-aeb0-4b75-acad-317ea5036cdc is in RUNNING state, waiting...&#xA;Get a pipeline run with id=bb61cebb-aeb0-4b75-acad-317ea5036cdc&#xA;Pipeline run with id=bb61cebb-aeb0-4b75-acad-317ea5036cdc is in RUNNING state, waiting...&#xA;Get a pipeline run with id=bb61cebb-aeb0-4b75-acad-317ea5036cdc&#xA;Pipeline run with id=bb61cebb-aeb0-4b75-acad-317ea5036cdc is in RUNNING state, waiting...&#xA;Get a pipeline run with id=bb61cebb-aeb0-4b75-acad-317ea5036cdc&#xA;Pipeline run with id=bb61cebb-aeb0-4b75-acad-317ea5036cdc is in RUNNING state, waiting...&#xA;Get a pipeline run with id=bb61cebb-aeb0-4b75-acad-317ea5036cdc&#xA;Pipeline run with id=bb61cebb-aeb0-4b75-acad-317ea5036cdc is in RUNNING state, waiting...&#xA;Get a pipeline run with id=bb61cebb-aeb0-4b75-acad-317ea5036cdc&#xA;Pipeline run with id=bb61cebb-aeb0-4b75-acad-317ea5036cdc is in RUNNING state, waiting...&#xA;Get a pipeline run with id=bb61cebb-aeb0-4b75-acad-317ea5036cdc&#xA;Pipeline run with id=bb61cebb-aeb0-4b75-acad-317ea5036cdc is in RUNNING state, waiting...&#xA;Get a pipeline run with id=bb61cebb-aeb0-4b75-acad-317ea5036cdc&#xA;Pipeline run with id=bb61cebb-aeb0-4b75-acad-317ea5036cdc is in RUNNING state, waiting...&#xA;Get a pipeline run with id=bb61cebb-aeb0-4b75-acad-317ea5036cdc&#xA;Pipeline run with id=bb61cebb-aeb0-4b75-acad-317ea5036cdc is in RUNNING state, waiting...&#xA;Get a pipeline run with id=bb61cebb-aeb0-4b75-acad-317ea5036cdc&#xA;Pipeline run with id=bb61cebb-aeb0-4b75-acad-317ea5036cdc is in RUNNING state, waiting...&#xA;Get a pipeline run with id=bb61cebb-aeb0-4b75-acad-317ea5036cdc&#xA;Pipeline run with id=bb61cebb-aeb0-4b75-acad-317ea5036cdc is in RUNNING state, waiting...&#xA;Get a pipeline run with id=bb61cebb-aeb0-4b75-acad-317ea5036cdc&#xA;Pipeline run with id=bb61cebb-aeb0-4b75-acad-317ea5036cdc is in RUNNING state, waiting...&#xA;Get a pipeline run with id=bb61cebb-aeb0-4b75-acad-317ea5036cdc&#xA;Pipeline run with id=bb61cebb-aeb0-4b75-acad-317ea5036cdc is in RUNNING state, waiting...&#xA;Get a pipeline run with id=bb61cebb-aeb0-4b75-acad-317ea5036cdc&#xA;Pipeline run with id=bb61cebb-aeb0-4b75-acad-317ea5036cdc is in RUNNING state, waiting...&#xA;Get a pipeline run with id=bb61cebb-aeb0-4b75-acad-317ea5036cdc&#xA;Pipeline run with id=bb61cebb-aeb0-4b75-acad-317ea5036cdc is in RUNNING state, waiting...&#xA;Get a pipeline run with id=bb61cebb-aeb0-4b75-acad-317ea5036cdc&#xA;Pipeline run with id=bb61cebb-aeb0-4b75-acad-317ea5036cdc is in RUNNING state, waiting...&#xA;Get a pipeline run with id=bb61cebb-aeb0-4b75-acad-317ea5036cdc&#xA;Pipeline run with id=bb61cebb-aeb0-4b75-acad-317ea5036cdc is in RUNNING state, waiting...&#xA;Get a pipeline run with id=bb61cebb-aeb0-4b75-acad-317ea5036cdc&#xA;Pipeline run with id=bb61cebb-aeb0-4b75-acad-317ea5036cdc is in RUNNING state, waiting...&#xA;Get a pipeline run with id=bb61cebb-aeb0-4b75-acad-317ea5036cdc&#xA;Pipeline run with id=bb61cebb-aeb0-4b75-acad-317ea5036cdc is in RUNNING state, waiting...&#xA;Get a pipeline run with id=bb61cebb-aeb0-4b75-acad-317ea5036cdc&#xA;Pipeline run with id=bb61cebb-aeb0-4b75-acad-317ea5036cdc is in RUNNING state, waiting...&#xA;Get a pipeline run with id=bb61cebb-aeb0-4b75-acad-317ea5036cdc&#xA;Pipeline run with id=bb61cebb-aeb0-4b75-acad-317ea5036cdc is in RUNNING state, waiting...&#xA;Get a pipeline run with id=bb61cebb-aeb0-4b75-acad-317ea5036cdc&#xA;Pipeline run with id=bb61cebb-aeb0-4b75-acad-317ea5036cdc is in RUNNING state, waiting...&#xA;Get a pipeline run with id=bb61cebb-aeb0-4b75-acad-317ea5036cdc&#xA;Pipeline run with id=bb61cebb-aeb0-4b75-acad-317ea5036cdc is in RUNNING state, waiting...&#xA;Get a pipeline run with id=bb61cebb-aeb0-4b75-acad-317ea5036cdc&#xA;Pipeline run with id=bb61cebb-aeb0-4b75-acad-317ea5036cdc is in RUNNING state, waiting...&#xA;Get a pipeline run with id=bb61cebb-aeb0-4b75-acad-317ea5036cdc&#xA;Pipeline run with id=bb61cebb-aeb0-4b75-acad-317ea5036cdc is in RUNNING state, waiting...&#xA;Get a pipeline run with id=bb61cebb-aeb0-4b75-acad-317ea5036cdc&#xA;Pipeline run with id=bb61cebb-aeb0-4b75-acad-317ea5036cdc is in RUNNING state, waiting...&#xA;Get a pipeline run with id=bb61cebb-aeb0-4b75-acad-317ea5036cdc&#xA;Pipeline run with id=bb61cebb-aeb0-4b75-acad-317ea5036cdc is in RUNNING state, waiting...&#xA;Get a pipeline run with id=bb61cebb-aeb0-4b75-acad-317ea5036cdc&#xA;Pipeline run with id=bb61cebb-aeb0-4b75-acad-317ea5036cdc is in RUNNING state, waiting...&#xA;Get a pipeline run with id=bb61cebb-aeb0-4b75-acad-317ea5036cdc&#xA;Pipeline run with id=bb61cebb-aeb0-4b75-acad-317ea5036cdc reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;essential/iris_pipeline_compiled.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=bb61cebb-aeb0-4b75-acad-317ea5036cdc&#xA;Get a pipeline run with id=bb61cebb-aeb0-4b75-acad-317ea5036cdc&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/02/26 20:45:58.934 (2m35.522s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/02/26 20:45:58.934&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run bb61cebb-aeb0-4b75-acad-317ea5036cdc&#xA;Failed to terminate run bb61cebb-aeb0-4b75-acad-317ea5036cdc&#xA;Terminate run bb61cebb-aeb0-4b75-acad-317ea5036cdc&#xA;Deleting run bb61cebb-aeb0-4b75-acad-317ea5036cdc&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=e9e644a9-6a25-4044-a619-67daaa1dcbee (cascade=true)&#xA;Pipeline with id=e9e644a9-6a25-4044-a619-67daaa1dcbee, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/02/26 20:45:59.147 (213ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/02/26 20:45:59.148&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/02/26 20:45:59.148 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/02/26 20:45:59.148&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/02/26 20:45:59.148 (0s)&#xA;</system-err>
          </testcase>
      </testsuite>
  </testsuites>