LAST_SEEN | FIRST_SEEN | NAME | SUBOBJECT | TYPE | REASON | MESSAGE | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | dw-deployment-g5mv7-867b566cb5-dg58v.18e353dee296b384 | - | Normal | CreatedWorkload | Created Workload: test-ns-9bzxp/pod-dw-deployment-g5mv7-867b566cb5-dg58v-4ca1d | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | dw-deployment-g5mv7-867b566cb5-dg58v.18e353dee8abac58 | - | Normal | Scheduled | Successfully assigned test-ns-9bzxp/dw-deployment-g5mv7-867b566cb5-dg58v to ip-10-0-132-248.ec2.internal | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | dw-deployment-g5mv7-867b566cb5-dg58v.18e353dee8b81030 | - | Normal | Started | Admitted by clusterQueue cq-qg5tq | 2026-10-30 14:08:14 | 2026-10-30 14:08:14 | dw-deployment-g5mv7-867b566cb5-dg58v.18e353df1d3d6b9b | - | Normal | AddedInterface | Add eth0 [10.132.0.48/23] from ovn-kubernetes | 2026-10-30 14:08:14 | 2026-10-30 14:08:14 | dw-deployment-g5mv7-867b566cb5-dg58v.18e353df2048e190 | spec.containers{notebook} | Normal | Pulling | Pulling image "quay.io/rhoai/odh-th-torch-cpu-py312-rhel9:on-pr-1327" | 2026-10-30 14:08:14 | 2026-10-30 14:08:14 | dw-deployment-g5mv7-867b566cb5-dg58v.18e353df3589c6af | spec.containers{notebook} | Normal | Pulled | Successfully pulled image "quay.io/rhoai/odh-th-torch-cpu-py312-rhel9:on-pr-1327" in 356ms (356ms including waiting). Image size: 7740913465 bytes. | 2026-10-30 14:08:14 | 2026-10-30 14:08:14 | dw-deployment-g5mv7-867b566cb5-dg58v.18e353df3904f217 | spec.containers{notebook} | Normal | Created | Container created | 2026-10-30 14:08:14 | 2026-10-30 14:08:14 | dw-deployment-g5mv7-867b566cb5-dg58v.18e353df397fb501 | spec.containers{notebook} | Normal | Started | Container started | 2026-10-30 14:09:03 | 2026-10-30 14:09:03 | dw-deployment-g5mv7-867b566cb5-dg58v.18e353ea76ca272c | spec.containers{notebook} | Normal | Killing | Stopping container notebook | 2026-10-30 14:08:13 | 2026-10-30 14:08:13 | dw-deployment-g5mv7-867b566cb5.18e353ded411b23a | - | Normal | SuccessfulCreate | Created pod: dw-deployment-g5mv7-867b566cb5-dg58v | 2026-10-30 14:08:13 | 2026-10-30 14:08:13 | dw-deployment-g5mv7.18e353deccd802a2 | - | Normal | ScalingReplicaSet | Scaled up replica set dw-deployment-g5mv7-867b566cb5 from 0 to 1 | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | pod-dw-deployment-g5mv7-867b566cb5-dg58v-4ca1d.18e353dee6118399 | - | Normal | QuotaReserved | Quota reserved in ClusterQueue cq-qg5tq, wait time since queued was 0s | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | pod-dw-deployment-g5mv7-867b566cb5-dg58v-4ca1d.18e353dee61230aa | - | Normal | Admitted | Admitted by ClusterQueue cq-qg5tq, wait time since reservation was 0s | 2026-10-30 14:08:12 | 2026-10-30 14:08:12 | pvc-bz8wm.18e353dec332d61e | - | Normal | ExternalProvisioning | Waiting for a volume to be created either by the external provisioner 'example.com/nfs' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. | 2026-10-30 14:08:12 | 2026-10-30 14:08:12 | pvc-bz8wm.18e353dec47bb831 | - | Normal | Provisioning | External provisioner is provisioning volume for claim "test-ns-9bzxp/pvc-bz8wm" | 2026-10-30 14:08:12 | 2026-10-30 14:08:12 | pvc-bz8wm.18e353dec76f1ccd | - | Normal | ProvisioningSucceeded | Successfully provisioned volume pvc-63499e8f-d1fb-49ec-a970-48fb09e8b0be | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | trainjob-w6d3f6acdcd7-dd7d5.18e353e1a7cc16fb | - | Normal | QuotaReserved | Quota reserved in ClusterQueue cq-qg5tq, wait time since queued was 0s | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | trainjob-w6d3f6acdcd7-dd7d5.18e353e1a7cc8513 | - | Normal | Admitted | Admitted by ClusterQueue cq-qg5tq, wait time since reservation was 0s | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | w6d3f6acdcd7-node-0-0-9d8rb.18e353e1c4a8bee9 | - | Normal | Scheduled | Successfully assigned test-ns-9bzxp/w6d3f6acdcd7-node-0-0-9d8rb to ip-10-0-132-248.ec2.internal | 2026-10-30 14:08:26 | 2026-10-30 14:08:26 | w6d3f6acdcd7-node-0-0-9d8rb.18e353e1e77d264d | - | Normal | AddedInterface | Add eth0 [10.132.0.49/23] from ovn-kubernetes | 2026-10-30 14:08:26 | 2026-10-30 14:08:26 | w6d3f6acdcd7-node-0-0-9d8rb.18e353e1ebc0bbd4 | spec.containers{node} | Normal | Pulled | Container image "quay.io/rhoai/odh-th-torch-cpu-py312-rhel9:on-pr-1327" already present on machine and can be accessed by the pod | 2026-10-30 14:08:26 | 2026-10-30 14:08:26 | w6d3f6acdcd7-node-0-0-9d8rb.18e353e1ee6b9f71 | spec.containers{node} | Normal | Created | Container created | 2026-10-30 14:08:26 | 2026-10-30 14:08:26 | w6d3f6acdcd7-node-0-0-9d8rb.18e353e1eef386c8 | spec.containers{node} | Normal | Started | Container started | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | w6d3f6acdcd7-node-0-1-2zhfd.18e353e1c8675b25 | - | Normal | Scheduled | Successfully assigned test-ns-9bzxp/w6d3f6acdcd7-node-0-1-2zhfd to ip-10-0-132-248.ec2.internal | 2026-10-30 14:08:26 | 2026-10-30 14:08:26 | w6d3f6acdcd7-node-0-1-2zhfd.18e353e1fd675591 | - | Normal | AddedInterface | Add eth0 [10.132.0.50/23] from ovn-kubernetes | 2026-10-30 14:08:26 | 2026-10-30 14:08:26 | w6d3f6acdcd7-node-0-1-2zhfd.18e353e2013dcbd2 | spec.containers{node} | Normal | Pulled | Container image "quay.io/rhoai/odh-th-torch-cpu-py312-rhel9:on-pr-1327" already present on machine and can be accessed by the pod | 2026-10-30 14:08:26 | 2026-10-30 14:08:26 | w6d3f6acdcd7-node-0-1-2zhfd.18e353e2053f473a | spec.containers{node} | Normal | Created | Container created | 2026-10-30 14:08:26 | 2026-10-30 14:08:26 | w6d3f6acdcd7-node-0-1-2zhfd.18e353e206552757 | spec.containers{node} | Normal | Started | Container started | 2026-10-30 14:08:25 | 2026-10-30 14:08:25 | w6d3f6acdcd7-node-0.18e353e1a47a88b6 | - | Normal | Suspended | Job suspended | 2026-10-30 14:08:25 | 2026-10-30 14:08:25 | w6d3f6acdcd7-node-0.18e353e1c44342ac | - | Normal | SuccessfulCreate | Created pod: w6d3f6acdcd7-node-0-0-9d8rb | 2026-10-30 14:08:25 | 2026-10-30 14:08:25 | w6d3f6acdcd7-node-0.18e353e1c8031c3d | - | Normal | SuccessfulCreate | Created pod: w6d3f6acdcd7-node-0-1-2zhfd | 2026-10-30 14:08:25 | 2026-10-30 14:08:25 | w6d3f6acdcd7-node-0.18e353e1c8035f59 | - | Normal | Resumed | Job resumed | 2026-10-30 14:09:00 | 2026-10-30 14:09:00 | w6d3f6acdcd7-node-0.18e353e9c15cc33d | - | Normal | Completed | Job completed | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | w6d3f6acdcd7.18e353e1a55ccc91 | - | Normal | CreatedWorkload | Created Workload: test-ns-9bzxp/trainjob-w6d3f6acdcd7-dd7d5 | 2026-10-30 14:08:25 | 2026-10-30 14:08:25 | w6d3f6acdcd7.18e353e1a6e279bd | - | Normal | SuspendedJobs | jobset is suspended | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | w6d3f6acdcd7.18e353e1b0919667 | - | Normal | Started | Admitted by clusterQueue cq-qg5tq | 2026-10-30 14:08:25 | 2026-10-30 14:08:25 | w6d3f6acdcd7.18e353e1b633d6f0 | - | Normal | ResumeJobs | jobset is resumed | 2026-10-30 14:09:00 | 2026-10-30 14:09:00 | w6d3f6acdcd7.18e353e9c3204bb3 | - | Normal | AllJobsCompleted | jobset completed successfully | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | w6d3f6acdcd7.18e353e9ced873d1 | - | Normal | FinishedWorkload | Workload 'test-ns-9bzxp/trainjob-w6d3f6acdcd7-dd7d5' is declared finished |