<?xml version="1.0" encoding="UTF-8"?>
  <testsuites tests="5" disabled="0" errors="0" failures="0" time="180.938549725">
      <testsuite name="AIPipelinesE2ETests" package="/dspa/backend/test/end2end" tests="5" disabled="0" skipped="0" errors="0" failures="0" time="180.938549725" timestamp="2026-07-19T08:10:07">
          <properties>
              <property name="SuiteSucceeded" value="true"></property>
              <property name="SuiteHasProgrammaticFocus" value="false"></property>
              <property name="SpecialSuiteFailureReason" value=""></property>
              <property name="SuiteLabels" value="[]"></property>
              <property name="SuiteSemVerConstraints" value="[]"></property>
              <property name="RandomSeed" value="1784448416"></property>
              <property name="RandomizeAllSpecs" value="false"></property>
              <property name="LabelFilter" value="Smoke"></property>
              <property name="SemVerFilter" value=""></property>
              <property name="FocusStrings" value=""></property>
              <property name="SkipStrings" value=""></property>
              <property name="FocusFiles" value=""></property>
              <property name="SkipFiles" value=""></property>
              <property name="FailOnPending" value="false"></property>
              <property name="FailOnEmpty" value="false"></property>
              <property name="FailFast" value="false"></property>
              <property name="FlakeAttempts" value="0"></property>
              <property name="DryRun" value="false"></property>
              <property name="ParallelTotal" value="10"></property>
              <property name="OutputInterceptorMode" value=""></property>
          </properties>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/flip_coin.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="140.847476906">
              <system-out>2026/07/19 08:12:27 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/19/26 08:10:07.119&#xA;Create an experiment with name E2EExperiment-1784448607119817178&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/19/26 08:10:07.22 (101ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/19/26 08:10:07.22&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x37b56a0c8b80&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/19/26 08:10:07.258 (38ms)&#xA;&gt; Enter [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/19/26 08:10:07.258&#xA;Uploading pipeline file critical/flip_coin.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1784448607220514717, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml&#xA;Upload of pipeline file &#39;critical/flip_coin.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 02ccb78e-2d0f-4194-9ef0-dfa1d869942f&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/flip_coin.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;02ccb78e-2d0f-4194-9ef0-dfa1d869942f&#39; and name: &#39;e2e-test-1784448607220514717&#39;&#xA;Create a pipeline run for pipeline with id=02ccb78e-2d0f-4194-9ef0-dfa1d869942f and versionId=169a310e-c69a-4f83-aa7c-6accb1246ead&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=8df805d9-bc92-45ab-a16d-3f6d21c05c0c&#xA;Created Pipeline Run with id: 8df805d9-bc92-45ab-a16d-3f6d21c05c0c for pipeline with id: 02ccb78e-2d0f-4194-9ef0-dfa1d869942f&#xA;Waiting for pipeline run with id=8df805d9-bc92-45ab-a16d-3f6d21c05c0c to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=8df805d9-bc92-45ab-a16d-3f6d21c05c0c&#xA;Pipeline run with id=8df805d9-bc92-45ab-a16d-3f6d21c05c0c is in PENDING state, waiting...&#xA;Get a pipeline run with id=8df805d9-bc92-45ab-a16d-3f6d21c05c0c&#xA;Pipeline run with id=8df805d9-bc92-45ab-a16d-3f6d21c05c0c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8df805d9-bc92-45ab-a16d-3f6d21c05c0c&#xA;Pipeline run with id=8df805d9-bc92-45ab-a16d-3f6d21c05c0c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8df805d9-bc92-45ab-a16d-3f6d21c05c0c&#xA;Pipeline run with id=8df805d9-bc92-45ab-a16d-3f6d21c05c0c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8df805d9-bc92-45ab-a16d-3f6d21c05c0c&#xA;Pipeline run with id=8df805d9-bc92-45ab-a16d-3f6d21c05c0c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8df805d9-bc92-45ab-a16d-3f6d21c05c0c&#xA;Pipeline run with id=8df805d9-bc92-45ab-a16d-3f6d21c05c0c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8df805d9-bc92-45ab-a16d-3f6d21c05c0c&#xA;Pipeline run with id=8df805d9-bc92-45ab-a16d-3f6d21c05c0c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8df805d9-bc92-45ab-a16d-3f6d21c05c0c&#xA;Pipeline run with id=8df805d9-bc92-45ab-a16d-3f6d21c05c0c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8df805d9-bc92-45ab-a16d-3f6d21c05c0c&#xA;Pipeline run with id=8df805d9-bc92-45ab-a16d-3f6d21c05c0c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8df805d9-bc92-45ab-a16d-3f6d21c05c0c&#xA;Pipeline run with id=8df805d9-bc92-45ab-a16d-3f6d21c05c0c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8df805d9-bc92-45ab-a16d-3f6d21c05c0c&#xA;Pipeline run with id=8df805d9-bc92-45ab-a16d-3f6d21c05c0c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8df805d9-bc92-45ab-a16d-3f6d21c05c0c&#xA;Pipeline run with id=8df805d9-bc92-45ab-a16d-3f6d21c05c0c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8df805d9-bc92-45ab-a16d-3f6d21c05c0c&#xA;Pipeline run with id=8df805d9-bc92-45ab-a16d-3f6d21c05c0c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8df805d9-bc92-45ab-a16d-3f6d21c05c0c&#xA;Pipeline run with id=8df805d9-bc92-45ab-a16d-3f6d21c05c0c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8df805d9-bc92-45ab-a16d-3f6d21c05c0c&#xA;Pipeline run with id=8df805d9-bc92-45ab-a16d-3f6d21c05c0c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8df805d9-bc92-45ab-a16d-3f6d21c05c0c&#xA;Pipeline run with id=8df805d9-bc92-45ab-a16d-3f6d21c05c0c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8df805d9-bc92-45ab-a16d-3f6d21c05c0c&#xA;Pipeline run with id=8df805d9-bc92-45ab-a16d-3f6d21c05c0c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8df805d9-bc92-45ab-a16d-3f6d21c05c0c&#xA;Pipeline run with id=8df805d9-bc92-45ab-a16d-3f6d21c05c0c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8df805d9-bc92-45ab-a16d-3f6d21c05c0c&#xA;Pipeline run with id=8df805d9-bc92-45ab-a16d-3f6d21c05c0c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8df805d9-bc92-45ab-a16d-3f6d21c05c0c&#xA;Pipeline run with id=8df805d9-bc92-45ab-a16d-3f6d21c05c0c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8df805d9-bc92-45ab-a16d-3f6d21c05c0c&#xA;Pipeline run with id=8df805d9-bc92-45ab-a16d-3f6d21c05c0c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8df805d9-bc92-45ab-a16d-3f6d21c05c0c&#xA;Pipeline run with id=8df805d9-bc92-45ab-a16d-3f6d21c05c0c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8df805d9-bc92-45ab-a16d-3f6d21c05c0c&#xA;Pipeline run with id=8df805d9-bc92-45ab-a16d-3f6d21c05c0c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8df805d9-bc92-45ab-a16d-3f6d21c05c0c&#xA;Pipeline run with id=8df805d9-bc92-45ab-a16d-3f6d21c05c0c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8df805d9-bc92-45ab-a16d-3f6d21c05c0c&#xA;Pipeline run with id=8df805d9-bc92-45ab-a16d-3f6d21c05c0c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8df805d9-bc92-45ab-a16d-3f6d21c05c0c&#xA;Pipeline run with id=8df805d9-bc92-45ab-a16d-3f6d21c05c0c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8df805d9-bc92-45ab-a16d-3f6d21c05c0c&#xA;Pipeline run with id=8df805d9-bc92-45ab-a16d-3f6d21c05c0c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8df805d9-bc92-45ab-a16d-3f6d21c05c0c&#xA;Pipeline run with id=8df805d9-bc92-45ab-a16d-3f6d21c05c0c is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8df805d9-bc92-45ab-a16d-3f6d21c05c0c&#xA;Pipeline run with id=8df805d9-bc92-45ab-a16d-3f6d21c05c0c reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/flip_coin.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=8df805d9-bc92-45ab-a16d-3f6d21c05c0c&#xA;Get a pipeline run with id=8df805d9-bc92-45ab-a16d-3f6d21c05c0c&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/flip_coin.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/19/26 08:12:27.86 (2m20.602s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/19/26 08:12:27.86&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 8df805d9-bc92-45ab-a16d-3f6d21c05c0c&#xA;Failed to terminate run 8df805d9-bc92-45ab-a16d-3f6d21c05c0c&#xA;Terminate run 8df805d9-bc92-45ab-a16d-3f6d21c05c0c&#xA;Deleting run 8df805d9-bc92-45ab-a16d-3f6d21c05c0c&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=02ccb78e-2d0f-4194-9ef0-dfa1d869942f (cascade=true)&#xA;Pipeline with id=02ccb78e-2d0f-4194-9ef0-dfa1d869942f, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/19/26 08:12:27.967 (106ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/19/26 08:12:27.967&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/19/26 08:12:27.967 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/19/26 08:12:27.967&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/19/26 08:12:27.967 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload essential/component_with_pip_index_urls.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="75.866956935">
              <system-out>2026/07/19 08:11:22 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/19/26 08:10:07.12&#xA;Create an experiment with name E2EExperiment-1784448607120473209&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/19/26 08:10:07.221 (101ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/19/26 08:10:07.221&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x60cab7fa300&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/19/26 08:10:07.259 (37ms)&#xA;&gt; Enter [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/19/26 08:10:07.259&#xA;Uploading pipeline file essential/component_with_pip_index_urls.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1784448607221686367, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml&#xA;Upload of pipeline file &#39;essential/component_with_pip_index_urls.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 9871a0a5-00c0-4583-8d7a-2758e53fd6e5&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/component_with_pip_index_urls.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;9871a0a5-00c0-4583-8d7a-2758e53fd6e5&#39; and name: &#39;e2e-test-1784448607221686367&#39;&#xA;Create a pipeline run for pipeline with id=9871a0a5-00c0-4583-8d7a-2758e53fd6e5 and versionId=0d368e51-2050-4df8-8fdf-a1267bea8750&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=8db0a3c3-2716-40ed-9db6-4499a90c9156&#xA;Created Pipeline Run with id: 8db0a3c3-2716-40ed-9db6-4499a90c9156 for pipeline with id: 9871a0a5-00c0-4583-8d7a-2758e53fd6e5&#xA;Waiting for pipeline run with id=8db0a3c3-2716-40ed-9db6-4499a90c9156 to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=8db0a3c3-2716-40ed-9db6-4499a90c9156&#xA;Pipeline run with id=8db0a3c3-2716-40ed-9db6-4499a90c9156 is in PENDING state, waiting...&#xA;Get a pipeline run with id=8db0a3c3-2716-40ed-9db6-4499a90c9156&#xA;Pipeline run with id=8db0a3c3-2716-40ed-9db6-4499a90c9156 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8db0a3c3-2716-40ed-9db6-4499a90c9156&#xA;Pipeline run with id=8db0a3c3-2716-40ed-9db6-4499a90c9156 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8db0a3c3-2716-40ed-9db6-4499a90c9156&#xA;Pipeline run with id=8db0a3c3-2716-40ed-9db6-4499a90c9156 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8db0a3c3-2716-40ed-9db6-4499a90c9156&#xA;Pipeline run with id=8db0a3c3-2716-40ed-9db6-4499a90c9156 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8db0a3c3-2716-40ed-9db6-4499a90c9156&#xA;Pipeline run with id=8db0a3c3-2716-40ed-9db6-4499a90c9156 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8db0a3c3-2716-40ed-9db6-4499a90c9156&#xA;Pipeline run with id=8db0a3c3-2716-40ed-9db6-4499a90c9156 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8db0a3c3-2716-40ed-9db6-4499a90c9156&#xA;Pipeline run with id=8db0a3c3-2716-40ed-9db6-4499a90c9156 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8db0a3c3-2716-40ed-9db6-4499a90c9156&#xA;Pipeline run with id=8db0a3c3-2716-40ed-9db6-4499a90c9156 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8db0a3c3-2716-40ed-9db6-4499a90c9156&#xA;Pipeline run with id=8db0a3c3-2716-40ed-9db6-4499a90c9156 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8db0a3c3-2716-40ed-9db6-4499a90c9156&#xA;Pipeline run with id=8db0a3c3-2716-40ed-9db6-4499a90c9156 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8db0a3c3-2716-40ed-9db6-4499a90c9156&#xA;Pipeline run with id=8db0a3c3-2716-40ed-9db6-4499a90c9156 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8db0a3c3-2716-40ed-9db6-4499a90c9156&#xA;Pipeline run with id=8db0a3c3-2716-40ed-9db6-4499a90c9156 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8db0a3c3-2716-40ed-9db6-4499a90c9156&#xA;Pipeline run with id=8db0a3c3-2716-40ed-9db6-4499a90c9156 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8db0a3c3-2716-40ed-9db6-4499a90c9156&#xA;Pipeline run with id=8db0a3c3-2716-40ed-9db6-4499a90c9156 is in RUNNING state, waiting...&#xA;Get a pipeline run with id=8db0a3c3-2716-40ed-9db6-4499a90c9156&#xA;Pipeline run with id=8db0a3c3-2716-40ed-9db6-4499a90c9156 reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;essential/component_with_pip_index_urls.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=8db0a3c3-2716-40ed-9db6-4499a90c9156&#xA;Get a pipeline run with id=8db0a3c3-2716-40ed-9db6-4499a90c9156&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload essential/component_with_pip_index_urls.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/19/26 08:11:22.846 (1m15.587s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/19/26 08:11:22.846&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 8db0a3c3-2716-40ed-9db6-4499a90c9156&#xA;Failed to terminate run 8db0a3c3-2716-40ed-9db6-4499a90c9156&#xA;Terminate run 8db0a3c3-2716-40ed-9db6-4499a90c9156&#xA;Deleting run 8db0a3c3-2716-40ed-9db6-4499a90c9156&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=9871a0a5-00c0-4583-8d7a-2758e53fd6e5 (cascade=true)&#xA;Pipeline with id=9871a0a5-00c0-4583-8d7a-2758e53fd6e5, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/19/26 08:11:22.987 (141ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/19/26 08:11:22.987&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/19/26 08:11:22.987 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/19/26 08:11:22.988&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/19/26 08:11:22.988 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/pipeline_with_artifact_upload_download.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="125.807947977">
              <system-out>2026/07/19 08:12:12 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/19/26 08:10:07.119&#xA;Create an experiment with name E2EExperiment-1784448607119924900&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/19/26 08:10:07.218 (99ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/19/26 08:10:07.218&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x16cec70be100&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/19/26 08:10:07.256 (38ms)&#xA;&gt; Enter [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/19/26 08:10:07.256&#xA;Uploading pipeline file critical/pipeline_with_artifact_upload_download.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1784448607218705426, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml&#xA;Upload of pipeline file &#39;critical/pipeline_with_artifact_upload_download.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 52e12fce-77ca-480f-a4df-0da8eb53ff41&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/pipeline_with_artifact_upload_download.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;52e12fce-77ca-480f-a4df-0da8eb53ff41&#39; and name: &#39;e2e-test-1784448607218705426&#39;&#xA;Create a pipeline run for pipeline with id=52e12fce-77ca-480f-a4df-0da8eb53ff41 and versionId=62066342-e190-4089-aefe-195256804654&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=0c972745-695c-4570-a27f-c330a1aeef5b&#xA;Created Pipeline Run with id: 0c972745-695c-4570-a27f-c330a1aeef5b for pipeline with id: 52e12fce-77ca-480f-a4df-0da8eb53ff41&#xA;Waiting for pipeline run with id=0c972745-695c-4570-a27f-c330a1aeef5b to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=0c972745-695c-4570-a27f-c330a1aeef5b&#xA;Pipeline run with id=0c972745-695c-4570-a27f-c330a1aeef5b is in PENDING state, waiting...&#xA;Get a pipeline run with id=0c972745-695c-4570-a27f-c330a1aeef5b&#xA;Pipeline run with id=0c972745-695c-4570-a27f-c330a1aeef5b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0c972745-695c-4570-a27f-c330a1aeef5b&#xA;Pipeline run with id=0c972745-695c-4570-a27f-c330a1aeef5b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0c972745-695c-4570-a27f-c330a1aeef5b&#xA;Pipeline run with id=0c972745-695c-4570-a27f-c330a1aeef5b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0c972745-695c-4570-a27f-c330a1aeef5b&#xA;Pipeline run with id=0c972745-695c-4570-a27f-c330a1aeef5b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0c972745-695c-4570-a27f-c330a1aeef5b&#xA;Pipeline run with id=0c972745-695c-4570-a27f-c330a1aeef5b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0c972745-695c-4570-a27f-c330a1aeef5b&#xA;Pipeline run with id=0c972745-695c-4570-a27f-c330a1aeef5b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0c972745-695c-4570-a27f-c330a1aeef5b&#xA;Pipeline run with id=0c972745-695c-4570-a27f-c330a1aeef5b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0c972745-695c-4570-a27f-c330a1aeef5b&#xA;Pipeline run with id=0c972745-695c-4570-a27f-c330a1aeef5b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0c972745-695c-4570-a27f-c330a1aeef5b&#xA;Pipeline run with id=0c972745-695c-4570-a27f-c330a1aeef5b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0c972745-695c-4570-a27f-c330a1aeef5b&#xA;Pipeline run with id=0c972745-695c-4570-a27f-c330a1aeef5b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0c972745-695c-4570-a27f-c330a1aeef5b&#xA;Pipeline run with id=0c972745-695c-4570-a27f-c330a1aeef5b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0c972745-695c-4570-a27f-c330a1aeef5b&#xA;Pipeline run with id=0c972745-695c-4570-a27f-c330a1aeef5b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0c972745-695c-4570-a27f-c330a1aeef5b&#xA;Pipeline run with id=0c972745-695c-4570-a27f-c330a1aeef5b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0c972745-695c-4570-a27f-c330a1aeef5b&#xA;Pipeline run with id=0c972745-695c-4570-a27f-c330a1aeef5b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0c972745-695c-4570-a27f-c330a1aeef5b&#xA;Pipeline run with id=0c972745-695c-4570-a27f-c330a1aeef5b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0c972745-695c-4570-a27f-c330a1aeef5b&#xA;Pipeline run with id=0c972745-695c-4570-a27f-c330a1aeef5b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0c972745-695c-4570-a27f-c330a1aeef5b&#xA;Pipeline run with id=0c972745-695c-4570-a27f-c330a1aeef5b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0c972745-695c-4570-a27f-c330a1aeef5b&#xA;Pipeline run with id=0c972745-695c-4570-a27f-c330a1aeef5b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0c972745-695c-4570-a27f-c330a1aeef5b&#xA;Pipeline run with id=0c972745-695c-4570-a27f-c330a1aeef5b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0c972745-695c-4570-a27f-c330a1aeef5b&#xA;Pipeline run with id=0c972745-695c-4570-a27f-c330a1aeef5b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0c972745-695c-4570-a27f-c330a1aeef5b&#xA;Pipeline run with id=0c972745-695c-4570-a27f-c330a1aeef5b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0c972745-695c-4570-a27f-c330a1aeef5b&#xA;Pipeline run with id=0c972745-695c-4570-a27f-c330a1aeef5b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0c972745-695c-4570-a27f-c330a1aeef5b&#xA;Pipeline run with id=0c972745-695c-4570-a27f-c330a1aeef5b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0c972745-695c-4570-a27f-c330a1aeef5b&#xA;Pipeline run with id=0c972745-695c-4570-a27f-c330a1aeef5b is in RUNNING state, waiting...&#xA;Get a pipeline run with id=0c972745-695c-4570-a27f-c330a1aeef5b&#xA;Pipeline run with id=0c972745-695c-4570-a27f-c330a1aeef5b reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/pipeline_with_artifact_upload_download.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=0c972745-695c-4570-a27f-c330a1aeef5b&#xA;Get a pipeline run with id=0c972745-695c-4570-a27f-c330a1aeef5b&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/pipeline_with_artifact_upload_download.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/19/26 08:12:12.822 (2m5.566s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/19/26 08:12:12.822&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 0c972745-695c-4570-a27f-c330a1aeef5b&#xA;Failed to terminate run 0c972745-695c-4570-a27f-c330a1aeef5b&#xA;Terminate run 0c972745-695c-4570-a27f-c330a1aeef5b&#xA;Deleting run 0c972745-695c-4570-a27f-c330a1aeef5b&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=52e12fce-77ca-480f-a4df-0da8eb53ff41 (cascade=true)&#xA;Pipeline with id=52e12fce-77ca-480f-a4df-0da8eb53ff41, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/19/26 08:12:12.927 (105ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/19/26 08:12:12.928&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/19/26 08:12:12.928 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/19/26 08:12:12.928&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/19/26 08:12:12.928 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload critical/parallel_for_after_dependency.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="125.857327247">
              <system-out>2026/07/19 08:12:12 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/19/26 08:10:07.119&#xA;Create an experiment with name E2EExperiment-1784448607119792777&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/19/26 08:10:07.215 (96ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/19/26 08:10:07.215&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x3ebd2809a300&#xA;test-secret-1 created&#xA;test-secret-2 created&#xA;test-secret-3 created&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/19/26 08:10:07.244 (29ms)&#xA;&gt; Enter [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/19/26 08:10:07.244&#xA;Uploading pipeline file critical/parallel_for_after_dependency.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1784448607215943119, from file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml&#xA;Upload of pipeline file &#39;critical/parallel_for_after_dependency.yaml&#39; successful&#xA;Listing pipeline versions for pipeline bfe6af53-d846-4a4b-9324-4695d4a29517&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/critical/parallel_for_after_dependency.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;bfe6af53-d846-4a4b-9324-4695d4a29517&#39; and name: &#39;e2e-test-1784448607215943119&#39;&#xA;Create a pipeline run for pipeline with id=bfe6af53-d846-4a4b-9324-4695d4a29517 and versionId=7d5de253-d0f0-4778-aad6-0f05f7c432f4&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=e81e09a3-8977-4ef8-8112-42ebf50ca2fb&#xA;Created Pipeline Run with id: e81e09a3-8977-4ef8-8112-42ebf50ca2fb for pipeline with id: bfe6af53-d846-4a4b-9324-4695d4a29517&#xA;Waiting for pipeline run with id=e81e09a3-8977-4ef8-8112-42ebf50ca2fb to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=e81e09a3-8977-4ef8-8112-42ebf50ca2fb&#xA;Pipeline run with id=e81e09a3-8977-4ef8-8112-42ebf50ca2fb is in PENDING state, waiting...&#xA;Get a pipeline run with id=e81e09a3-8977-4ef8-8112-42ebf50ca2fb&#xA;Pipeline run with id=e81e09a3-8977-4ef8-8112-42ebf50ca2fb is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e81e09a3-8977-4ef8-8112-42ebf50ca2fb&#xA;Pipeline run with id=e81e09a3-8977-4ef8-8112-42ebf50ca2fb is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e81e09a3-8977-4ef8-8112-42ebf50ca2fb&#xA;Pipeline run with id=e81e09a3-8977-4ef8-8112-42ebf50ca2fb is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e81e09a3-8977-4ef8-8112-42ebf50ca2fb&#xA;Pipeline run with id=e81e09a3-8977-4ef8-8112-42ebf50ca2fb is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e81e09a3-8977-4ef8-8112-42ebf50ca2fb&#xA;Pipeline run with id=e81e09a3-8977-4ef8-8112-42ebf50ca2fb is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e81e09a3-8977-4ef8-8112-42ebf50ca2fb&#xA;Pipeline run with id=e81e09a3-8977-4ef8-8112-42ebf50ca2fb is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e81e09a3-8977-4ef8-8112-42ebf50ca2fb&#xA;Pipeline run with id=e81e09a3-8977-4ef8-8112-42ebf50ca2fb is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e81e09a3-8977-4ef8-8112-42ebf50ca2fb&#xA;Pipeline run with id=e81e09a3-8977-4ef8-8112-42ebf50ca2fb is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e81e09a3-8977-4ef8-8112-42ebf50ca2fb&#xA;Pipeline run with id=e81e09a3-8977-4ef8-8112-42ebf50ca2fb is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e81e09a3-8977-4ef8-8112-42ebf50ca2fb&#xA;Pipeline run with id=e81e09a3-8977-4ef8-8112-42ebf50ca2fb is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e81e09a3-8977-4ef8-8112-42ebf50ca2fb&#xA;Pipeline run with id=e81e09a3-8977-4ef8-8112-42ebf50ca2fb is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e81e09a3-8977-4ef8-8112-42ebf50ca2fb&#xA;Pipeline run with id=e81e09a3-8977-4ef8-8112-42ebf50ca2fb is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e81e09a3-8977-4ef8-8112-42ebf50ca2fb&#xA;Pipeline run with id=e81e09a3-8977-4ef8-8112-42ebf50ca2fb is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e81e09a3-8977-4ef8-8112-42ebf50ca2fb&#xA;Pipeline run with id=e81e09a3-8977-4ef8-8112-42ebf50ca2fb is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e81e09a3-8977-4ef8-8112-42ebf50ca2fb&#xA;Pipeline run with id=e81e09a3-8977-4ef8-8112-42ebf50ca2fb is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e81e09a3-8977-4ef8-8112-42ebf50ca2fb&#xA;Pipeline run with id=e81e09a3-8977-4ef8-8112-42ebf50ca2fb is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e81e09a3-8977-4ef8-8112-42ebf50ca2fb&#xA;Pipeline run with id=e81e09a3-8977-4ef8-8112-42ebf50ca2fb is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e81e09a3-8977-4ef8-8112-42ebf50ca2fb&#xA;Pipeline run with id=e81e09a3-8977-4ef8-8112-42ebf50ca2fb is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e81e09a3-8977-4ef8-8112-42ebf50ca2fb&#xA;Pipeline run with id=e81e09a3-8977-4ef8-8112-42ebf50ca2fb is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e81e09a3-8977-4ef8-8112-42ebf50ca2fb&#xA;Pipeline run with id=e81e09a3-8977-4ef8-8112-42ebf50ca2fb is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e81e09a3-8977-4ef8-8112-42ebf50ca2fb&#xA;Pipeline run with id=e81e09a3-8977-4ef8-8112-42ebf50ca2fb is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e81e09a3-8977-4ef8-8112-42ebf50ca2fb&#xA;Pipeline run with id=e81e09a3-8977-4ef8-8112-42ebf50ca2fb is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e81e09a3-8977-4ef8-8112-42ebf50ca2fb&#xA;Pipeline run with id=e81e09a3-8977-4ef8-8112-42ebf50ca2fb is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e81e09a3-8977-4ef8-8112-42ebf50ca2fb&#xA;Pipeline run with id=e81e09a3-8977-4ef8-8112-42ebf50ca2fb is in RUNNING state, waiting...&#xA;Get a pipeline run with id=e81e09a3-8977-4ef8-8112-42ebf50ca2fb&#xA;Pipeline run with id=e81e09a3-8977-4ef8-8112-42ebf50ca2fb reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;critical/parallel_for_after_dependency.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=e81e09a3-8977-4ef8-8112-42ebf50ca2fb&#xA;Get a pipeline run with id=e81e09a3-8977-4ef8-8112-42ebf50ca2fb&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload critical/parallel_for_after_dependency.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/19/26 08:12:12.846 (2m5.602s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/19/26 08:12:12.846&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run e81e09a3-8977-4ef8-8112-42ebf50ca2fb&#xA;Failed to terminate run e81e09a3-8977-4ef8-8112-42ebf50ca2fb&#xA;Terminate run e81e09a3-8977-4ef8-8112-42ebf50ca2fb&#xA;Deleting run e81e09a3-8977-4ef8-8112-42ebf50ca2fb&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=bfe6af53-d846-4a4b-9324-4695d4a29517 (cascade=true)&#xA;Pipeline with id=bfe6af53-d846-4a4b-9324-4695d4a29517, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/19/26 08:12:12.977 (130ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/19/26 08:12:12.977&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/19/26 08:12:12.977 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/19/26 08:12:12.977&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/19/26 08:12:12.977 (0s)&#xA;</system-err>
          </testcase>
          <testcase name="[It] Upload and Verify Pipeline Run &gt; Upload a pipeline file, run it and verify that pipeline run succeeds Smoke &gt; Upload essential/iris_pipeline_compiled.yaml pipeline [FullRegression, smoke]" classname="AIPipelinesE2ETests" status="passed" time="180.819476618">
              <system-out>2026/07/19 08:13:07 Test passed&#xA;</system-out>
              <system-err>&gt; Enter [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/19/26 08:10:07.12&#xA;Create an experiment with name E2EExperiment-1784448607120727383&#xA;&lt; Exit [BeforeEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:147 @ 07/19/26 08:10:07.221 (101ms)&#xA;&gt; Enter [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/19/26 08:10:07.221&#xA;################### Setup before each Pipeline Upload test #####################&#xA;################### Global Setup before each test #####################&#xA;Test Context: 0x33bfa828e880&#xA;Looks like test-secret-1 already exists, because creation failed due to secrets &#34;test-secret-1&#34; already exists&#xA;Looks like test-secret-2 already exists, because creation failed due to secrets &#34;test-secret-2&#34; already exists&#xA;Looks like test-secret-3 already exists, because creation failed due to secrets &#34;test-secret-3&#34; already exists&#xA;&lt; Exit [BeforeEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:49 @ 07/19/26 08:10:07.257 (36ms)&#xA;&gt; Enter [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/19/26 08:10:07.257&#xA;Uploading pipeline file essential/iris_pipeline_compiled.yaml&#xA;Creating temp pipeline file with overridden SDK Version&#xA;Uploading pipeline with name=e2e-test-1784448607221710218, from file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml&#xA;Upload of pipeline file &#39;essential/iris_pipeline_compiled.yaml&#39; successful&#xA;Listing pipeline versions for pipeline 03d8dd7f-d3c7-462a-b85e-74c06c186cd7&#xA;Get the pipeline run time inputs from pipeline spec file /dspa/test_data/sdk_compiled_pipelines/valid/essential/iris_pipeline_compiled.yaml&#xA;Returning pipeline run time inputs map[]&#xA;Create run for pipeline with id: &#39;03d8dd7f-d3c7-462a-b85e-74c06c186cd7&#39; and name: &#39;e2e-test-1784448607221710218&#39;&#xA;Create a pipeline run for pipeline with id=03d8dd7f-d3c7-462a-b85e-74c06c186cd7 and versionId=7b08a461-e052-4418-b0fc-56877827aa43&#xA;Create a pipeline run body&#xA;Created Pipeline Run successfully with runId=610e2637-7a9e-4e91-82dc-7a387cef946a&#xA;Created Pipeline Run with id: 610e2637-7a9e-4e91-82dc-7a387cef946a for pipeline with id: 03d8dd7f-d3c7-462a-b85e-74c06c186cd7&#xA;Waiting for pipeline run with id=610e2637-7a9e-4e91-82dc-7a387cef946a to be in one of &#39;[SUCCEEDED SKIPPED FAILED CANCELED]&#39;&#xA;Get a pipeline run with id=610e2637-7a9e-4e91-82dc-7a387cef946a&#xA;Pipeline run with id=610e2637-7a9e-4e91-82dc-7a387cef946a is in PENDING state, waiting...&#xA;Get a pipeline run with id=610e2637-7a9e-4e91-82dc-7a387cef946a&#xA;Pipeline run with id=610e2637-7a9e-4e91-82dc-7a387cef946a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=610e2637-7a9e-4e91-82dc-7a387cef946a&#xA;Pipeline run with id=610e2637-7a9e-4e91-82dc-7a387cef946a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=610e2637-7a9e-4e91-82dc-7a387cef946a&#xA;Pipeline run with id=610e2637-7a9e-4e91-82dc-7a387cef946a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=610e2637-7a9e-4e91-82dc-7a387cef946a&#xA;Pipeline run with id=610e2637-7a9e-4e91-82dc-7a387cef946a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=610e2637-7a9e-4e91-82dc-7a387cef946a&#xA;Pipeline run with id=610e2637-7a9e-4e91-82dc-7a387cef946a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=610e2637-7a9e-4e91-82dc-7a387cef946a&#xA;Pipeline run with id=610e2637-7a9e-4e91-82dc-7a387cef946a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=610e2637-7a9e-4e91-82dc-7a387cef946a&#xA;Pipeline run with id=610e2637-7a9e-4e91-82dc-7a387cef946a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=610e2637-7a9e-4e91-82dc-7a387cef946a&#xA;Pipeline run with id=610e2637-7a9e-4e91-82dc-7a387cef946a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=610e2637-7a9e-4e91-82dc-7a387cef946a&#xA;Pipeline run with id=610e2637-7a9e-4e91-82dc-7a387cef946a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=610e2637-7a9e-4e91-82dc-7a387cef946a&#xA;Pipeline run with id=610e2637-7a9e-4e91-82dc-7a387cef946a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=610e2637-7a9e-4e91-82dc-7a387cef946a&#xA;Pipeline run with id=610e2637-7a9e-4e91-82dc-7a387cef946a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=610e2637-7a9e-4e91-82dc-7a387cef946a&#xA;Pipeline run with id=610e2637-7a9e-4e91-82dc-7a387cef946a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=610e2637-7a9e-4e91-82dc-7a387cef946a&#xA;Pipeline run with id=610e2637-7a9e-4e91-82dc-7a387cef946a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=610e2637-7a9e-4e91-82dc-7a387cef946a&#xA;Pipeline run with id=610e2637-7a9e-4e91-82dc-7a387cef946a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=610e2637-7a9e-4e91-82dc-7a387cef946a&#xA;Pipeline run with id=610e2637-7a9e-4e91-82dc-7a387cef946a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=610e2637-7a9e-4e91-82dc-7a387cef946a&#xA;Pipeline run with id=610e2637-7a9e-4e91-82dc-7a387cef946a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=610e2637-7a9e-4e91-82dc-7a387cef946a&#xA;Pipeline run with id=610e2637-7a9e-4e91-82dc-7a387cef946a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=610e2637-7a9e-4e91-82dc-7a387cef946a&#xA;Pipeline run with id=610e2637-7a9e-4e91-82dc-7a387cef946a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=610e2637-7a9e-4e91-82dc-7a387cef946a&#xA;Pipeline run with id=610e2637-7a9e-4e91-82dc-7a387cef946a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=610e2637-7a9e-4e91-82dc-7a387cef946a&#xA;Pipeline run with id=610e2637-7a9e-4e91-82dc-7a387cef946a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=610e2637-7a9e-4e91-82dc-7a387cef946a&#xA;Pipeline run with id=610e2637-7a9e-4e91-82dc-7a387cef946a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=610e2637-7a9e-4e91-82dc-7a387cef946a&#xA;Pipeline run with id=610e2637-7a9e-4e91-82dc-7a387cef946a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=610e2637-7a9e-4e91-82dc-7a387cef946a&#xA;Pipeline run with id=610e2637-7a9e-4e91-82dc-7a387cef946a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=610e2637-7a9e-4e91-82dc-7a387cef946a&#xA;Pipeline run with id=610e2637-7a9e-4e91-82dc-7a387cef946a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=610e2637-7a9e-4e91-82dc-7a387cef946a&#xA;Pipeline run with id=610e2637-7a9e-4e91-82dc-7a387cef946a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=610e2637-7a9e-4e91-82dc-7a387cef946a&#xA;Pipeline run with id=610e2637-7a9e-4e91-82dc-7a387cef946a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=610e2637-7a9e-4e91-82dc-7a387cef946a&#xA;Pipeline run with id=610e2637-7a9e-4e91-82dc-7a387cef946a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=610e2637-7a9e-4e91-82dc-7a387cef946a&#xA;Pipeline run with id=610e2637-7a9e-4e91-82dc-7a387cef946a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=610e2637-7a9e-4e91-82dc-7a387cef946a&#xA;Pipeline run with id=610e2637-7a9e-4e91-82dc-7a387cef946a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=610e2637-7a9e-4e91-82dc-7a387cef946a&#xA;Pipeline run with id=610e2637-7a9e-4e91-82dc-7a387cef946a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=610e2637-7a9e-4e91-82dc-7a387cef946a&#xA;Pipeline run with id=610e2637-7a9e-4e91-82dc-7a387cef946a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=610e2637-7a9e-4e91-82dc-7a387cef946a&#xA;Pipeline run with id=610e2637-7a9e-4e91-82dc-7a387cef946a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=610e2637-7a9e-4e91-82dc-7a387cef946a&#xA;Pipeline run with id=610e2637-7a9e-4e91-82dc-7a387cef946a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=610e2637-7a9e-4e91-82dc-7a387cef946a&#xA;Pipeline run with id=610e2637-7a9e-4e91-82dc-7a387cef946a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=610e2637-7a9e-4e91-82dc-7a387cef946a&#xA;Pipeline run with id=610e2637-7a9e-4e91-82dc-7a387cef946a is in RUNNING state, waiting...&#xA;Get a pipeline run with id=610e2637-7a9e-4e91-82dc-7a387cef946a&#xA;Pipeline run with id=610e2637-7a9e-4e91-82dc-7a387cef946a reached expected state SUCCEEDED&#xA;Deserializing expected compiled workflow file &#39;essential/iris_pipeline_compiled.yaml&#39; for the pipeline&#xA;Unmarshalling Expected Workflow YAML&#xA;Unmarshalled Expected Workflow YAML&#xA;Fetching updated pipeline run details for run with id=610e2637-7a9e-4e91-82dc-7a387cef946a&#xA;Get a pipeline run with id=610e2637-7a9e-4e91-82dc-7a387cef946a&#xA;Updated pipeline run details&#xA;Pipeline run succeeded, checking if the number of tasks are what is expected&#xA;&lt; Exit [It] Upload essential/iris_pipeline_compiled.yaml pipeline - /dspa/backend/test/end2end/pipeline_e2e_test.go:152 @ 07/19/26 08:13:07.834 (3m0.576s)&#xA;&gt; Enter [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/19/26 08:13:07.834&#xA;################### Global Cleanup after each test #####################&#xA;Deleting 1 run(s)&#xA;Terminate run 610e2637-7a9e-4e91-82dc-7a387cef946a&#xA;Failed to terminate run 610e2637-7a9e-4e91-82dc-7a387cef946a&#xA;Terminate run 610e2637-7a9e-4e91-82dc-7a387cef946a&#xA;Deleting run 610e2637-7a9e-4e91-82dc-7a387cef946a&#xA;Deleting 0 experiment(s)&#xA;Deleting 1 pipeline(s)&#xA;Deleting pipeline with id=03d8dd7f-d3c7-462a-b85e-74c06c186cd7 (cascade=true)&#xA;Pipeline with id=03d8dd7f-d3c7-462a-b85e-74c06c186cd7, DELETED&#xA;&lt; Exit [DeferCleanup (Each)] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:96 @ 07/19/26 08:13:07.94 (106ms)&#xA;&gt; Enter [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/19/26 08:13:07.94&#xA;&lt; Exit [ReportAfterEach] Upload and Verify Pipeline Run &gt; - /dspa/backend/test/end2end/pipeline_e2e_test.go:99 @ 07/19/26 08:13:07.94 (0s)&#xA;&gt; Enter [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/19/26 08:13:07.94&#xA;&lt; Exit [ReportAfterEach] TOP-LEVEL - /dspa/backend/test/end2end/e2e_suite_test.go:155 @ 07/19/26 08:13:07.94 (0s)&#xA;</system-err>
          </testcase>
      </testsuite>
  </testsuites>