> Enter [BeforeSuite] TOP-LEVEL - /workspace/source/src_code/test/e2e/suite_test.go:42 @ 10/23/26 03:38:04.675 < Exit [BeforeSuite] TOP-LEVEL - /workspace/source/src_code/test/e2e/suite_test.go:42 @ 10/23/26 03:38:04.676 (1ms) [FAILED] Timed out after 600.001s. The function passed to Eventually failed at /workspace/source/src_code/test/e2e/e2e_test.go:84 with: Expected object to be comparable, diff:   []v1.Condition( -  nil, +  { +  { +  Type: "Complete", +  Status: "True", +  Reason: "AllJobsCompleted", +  Message: "jobset completed successfully", +  }, +  },   ) In [It] at: /workspace/source/src_code/test/e2e/e2e_test.go:102 @ 10/23/26 03:48:05.46 > Enter [BeforeEach] TrainJob e2e - /workspace/source/src_code/test/e2e/e2e_test.go:28 @ 10/23/26 03:38:04.676 < Exit [BeforeEach] TrainJob e2e - /workspace/source/src_code/test/e2e/e2e_test.go:28 @ 10/23/26 03:38:04.835 (159ms) > Enter [It] should create TrainJob with PyTorch runtime reference - /workspace/source/src_code/test/e2e/e2e_test.go:51 @ 10/23/26 03:38:04.835 STEP: Create a TrainJob with torch-distributed runtime reference - /workspace/source/src_code/test/e2e/e2e_test.go:57 @ 10/23/26 03:38:04.835 END STEP: Create a TrainJob with torch-distributed runtime reference - /workspace/source/src_code/test/e2e/e2e_test.go:57 @ 10/23/26 03:38:04.91 (75ms) STEP: Wait for TrainJob jobs to become active - /workspace/source/src_code/test/e2e/e2e_test.go:62 @ 10/23/26 03:38:04.91 END STEP: Wait for TrainJob jobs to become active - /workspace/source/src_code/test/e2e/e2e_test.go:62 @ 10/23/26 03:38:05.459 (549ms) STEP: Wait for TrainJob to be in Succeeded status with all jobs succeeded - /workspace/source/src_code/test/e2e/e2e_test.go:80 @ 10/23/26 03:38:05.459 END STEP: Wait for TrainJob to be in Succeeded status with all jobs succeeded - /workspace/source/src_code/test/e2e/e2e_test.go:80 @ 10/23/26 03:48:05.46 (10m0.001s) [FAILED] Timed out after 600.001s. The function passed to Eventually failed at /workspace/source/src_code/test/e2e/e2e_test.go:84 with: Expected object to be comparable, diff:   []v1.Condition( -  nil, +  { +  { +  Type: "Complete", +  Status: "True", +  Reason: "AllJobsCompleted", +  Message: "jobset completed successfully", +  }, +  },   ) In [It] at: /workspace/source/src_code/test/e2e/e2e_test.go:102 @ 10/23/26 03:48:05.46 < Exit [It] should create TrainJob with PyTorch runtime reference - /workspace/source/src_code/test/e2e/e2e_test.go:51 @ 10/23/26 03:48:05.461 (10m0.626s) > Enter [AfterEach] TrainJob e2e - /workspace/source/src_code/test/e2e/e2e_test.go:43 @ 10/23/26 03:48:05.461 < Exit [AfterEach] TrainJob e2e - /workspace/source/src_code/test/e2e/e2e_test.go:43 @ 10/23/26 03:48:05.479 (19ms) [FAILED] Timed out after 600.001s. The function passed to Eventually failed at /workspace/source/src_code/test/e2e/e2e_test.go:124 with: Expected object to be comparable, diff:   []v1alpha1.JobStatus(Inverse(cmpopts.SortSlices, []v1alpha1.JobStatus{    {    ... // 2 identical fields    Succeeded: &0,    Failed: &0, -  Active: &0, +  Active: &1,    Suspended: &0,    },    {    ... // 2 identical fields    Succeeded: &0,    Failed: &0, -  Active: &0, +  Active: &1,    Suspended: &0,    },   })) In [It] at: /workspace/source/src_code/test/e2e/e2e_test.go:142 @ 10/23/26 03:58:05.581 > Enter [BeforeEach] TrainJob e2e - /workspace/source/src_code/test/e2e/e2e_test.go:28 @ 10/23/26 03:48:05.48 < Exit [BeforeEach] TrainJob e2e - /workspace/source/src_code/test/e2e/e2e_test.go:28 @ 10/23/26 03:48:05.512 (32ms) > Enter [It] should create TrainJob with DeepSpeed runtime reference - /workspace/source/src_code/test/e2e/e2e_test.go:109 @ 10/23/26 03:48:05.512 STEP: Create a TrainJob with deepspeed-distributed runtime reference - /workspace/source/src_code/test/e2e/e2e_test.go:115 @ 10/23/26 03:48:05.512 END STEP: Create a TrainJob with deepspeed-distributed runtime reference - /workspace/source/src_code/test/e2e/e2e_test.go:115 @ 10/23/26 03:48:05.58 (68ms) STEP: Wait for TrainJob jobs to become active - /workspace/source/src_code/test/e2e/e2e_test.go:120 @ 10/23/26 03:48:05.58 END STEP: Wait for TrainJob jobs to become active - /workspace/source/src_code/test/e2e/e2e_test.go:120 @ 10/23/26 03:58:05.581 (10m0.001s) [FAILED] Timed out after 600.001s. The function passed to Eventually failed at /workspace/source/src_code/test/e2e/e2e_test.go:124 with: Expected object to be comparable, diff:   []v1alpha1.JobStatus(Inverse(cmpopts.SortSlices, []v1alpha1.JobStatus{    {    ... // 2 identical fields    Succeeded: &0,    Failed: &0, -  Active: &0, +  Active: &1,    Suspended: &0,    },    {    ... // 2 identical fields    Succeeded: &0,    Failed: &0, -  Active: &0, +  Active: &1,    Suspended: &0,    },   })) In [It] at: /workspace/source/src_code/test/e2e/e2e_test.go:142 @ 10/23/26 03:58:05.581 < Exit [It] should create TrainJob with DeepSpeed runtime reference - /workspace/source/src_code/test/e2e/e2e_test.go:109 @ 10/23/26 03:58:05.581 (10m0.07s) > Enter [AfterEach] TrainJob e2e - /workspace/source/src_code/test/e2e/e2e_test.go:43 @ 10/23/26 03:58:05.581 < Exit [AfterEach] TrainJob e2e - /workspace/source/src_code/test/e2e/e2e_test.go:43 @ 10/23/26 03:58:05.602 (21ms) === RUN TestKubeflowSdkKueueIntegration kueue_operator.go:110: SetupKueue: Setting kueue to Unmanaged managementState in DataScienceCluster... kueue_operator.go:112: Should be able to set DSC kueue to Unmanaged Unexpected error: <*errors.StatusError | 0x2f0e912f2140>: the server could not find the requested resource { ErrStatus: { TypeMeta: {Kind: "", APIVersion: ""}, ListMeta: { SelfLink: "", ResourceVersion: "", Continue: "", RemainingItemCount: nil, }, Status: "Failure", Message: "the server could not find the requested resource", Reason: "NotFound", Details: { Name: "", Group: "", Kind: "", UID: "", Causes: [ { Type: "UnexpectedServerResponse", Message: "404 page not found", Field: "", }, ], RetryAfterSeconds: 0, }, Code: 404, }, } occurred kueue_operator.go:100: Collecting Kueue diagnostics... test.go:145: Creating output directory in parent directory: /workspace/artifacts-dir test.go:160: Output directory has been created at: /workspace/artifacts-dir/TestKubeflowSdkKueueIntegration2791014606 kueue_operator.go:100: Stored Kueue CR state kueue_operator.go:100: Failed to get DSC for diagnostics: the server could not find the requested resource kueue_operator.go:100: Stored Kueue operator logs for kueue-controller-manager-6f485b4dd6-bkdtt/manager kueue_operator.go:100: Stored Kueue operator logs for kueue-controller-manager-6f485b4dd6-m5f7j/manager --- FAIL: TestKubeflowSdkKueueIntegration (0.15s) === RUN TestKueueWorkloadPreemptionSuspendsTrainJob kueue_operator.go:110: SetupKueue: Setting kueue to Unmanaged managementState in DataScienceCluster... kueue_operator.go:112: Should be able to set DSC kueue to Unmanaged Unexpected error: <*errors.StatusError | 0x2f0e9141a000>: the server could not find the requested resource { ErrStatus: { TypeMeta: {Kind: "", APIVersion: ""}, ListMeta: { SelfLink: "", ResourceVersion: "", Continue: "", RemainingItemCount: nil, }, Status: "Failure", Message: "the server could not find the requested resource", Reason: "NotFound", Details: { Name: "", Group: "", Kind: "", UID: "", Causes: [ { Type: "UnexpectedServerResponse", Message: "404 page not found", Field: "", }, ], RetryAfterSeconds: 0, }, Code: 404, }, } occurred kueue_operator.go:100: Collecting Kueue diagnostics... test.go:145: Creating output directory in parent directory: /workspace/artifacts-dir test.go:160: Output directory has been created at: /workspace/artifacts-dir/TestKueueWorkloadPreemptionSuspendsTrainJob3489310168 kueue_operator.go:100: Stored Kueue CR state kueue_operator.go:100: Failed to get DSC for diagnostics: the server could not find the requested resource kueue_operator.go:100: Stored Kueue operator logs for kueue-controller-manager-6f485b4dd6-bkdtt/manager kueue_operator.go:100: Stored Kueue operator logs for kueue-controller-manager-6f485b4dd6-m5f7j/manager --- FAIL: TestKueueWorkloadPreemptionSuspendsTrainJob (0.14s) === RUN TestKueueSchedulingReachesTrainJobPods kueue_operator.go:110: SetupKueue: Setting kueue to Unmanaged managementState in DataScienceCluster... kueue_operator.go:112: Should be able to set DSC kueue to Unmanaged Unexpected error: <*errors.StatusError | 0x2f0e90d7c280>: the server could not find the requested resource { ErrStatus: { TypeMeta: {Kind: "", APIVersion: ""}, ListMeta: { SelfLink: "", ResourceVersion: "", Continue: "", RemainingItemCount: nil, }, Status: "Failure", Message: "the server could not find the requested resource", Reason: "NotFound", Details: { Name: "", Group: "", Kind: "", UID: "", Causes: [ { Type: "UnexpectedServerResponse", Message: "404 page not found", Field: "", }, ], RetryAfterSeconds: 0, }, Code: 404, }, } occurred kueue_operator.go:100: Collecting Kueue diagnostics... test.go:145: Creating output directory in parent directory: /workspace/artifacts-dir test.go:160: Output directory has been created at: /workspace/artifacts-dir/TestKueueSchedulingReachesTrainJobPods1185202950 kueue_operator.go:100: Stored Kueue CR state kueue_operator.go:100: Failed to get DSC for diagnostics: the server could not find the requested resource kueue_operator.go:100: Stored Kueue operator logs for kueue-controller-manager-6f485b4dd6-bkdtt/manager kueue_operator.go:100: Stored Kueue operator logs for kueue-controller-manager-6f485b4dd6-m5f7j/manager --- FAIL: TestKueueSchedulingReachesTrainJobPods (0.14s)