LAST_SEEN | FIRST_SEEN | NAME | SUBOBJECT | TYPE | REASON | MESSAGE | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | dw-deployment-w2f8n-647c87c7d-fn4mz.18e10a336e56d968 | - | Normal | CreatedWorkload | Created Workload: test-ns-2br24/pod-dw-deployment-w2f8n-647c87c7d-fn4mz-3d7f4 | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | dw-deployment-w2f8n-647c87c7d-fn4mz.18e10a3373a92872 | - | Normal | Started | Admitted by clusterQueue cq-5wqt7 | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | dw-deployment-w2f8n-647c87c7d-fn4mz.18e10a3373c45866 | - | Normal | Scheduled | Successfully assigned test-ns-2br24/dw-deployment-w2f8n-647c87c7d-fn4mz to ip-10-0-140-14.ec2.internal | 2026-10-23 03:15:43 | 2026-10-23 03:15:43 | dw-deployment-w2f8n-647c87c7d-fn4mz.18e10a339610b9ec | - | Normal | AddedInterface | Add eth0 [10.134.0.40/23] from ovn-kubernetes | 2026-10-23 03:15:43 | 2026-10-23 03:15:43 | dw-deployment-w2f8n-647c87c7d-fn4mz.18e10a3398fca6e3 | spec.containers{notebook} | Normal | Pulling | Pulling image "quay.io/opendatahub/odh-th-torch-cpu-py312@sha256:0487ceeb4d180c0ec8de6367f7a72fb71b50835aba20ac3fb5b9db7248e9f369" | 2026-10-23 03:15:43 | 2026-10-23 03:15:43 | dw-deployment-w2f8n-647c87c7d-fn4mz.18e10a33b5155974 | spec.containers{notebook} | Normal | Pulled | Successfully pulled image "quay.io/opendatahub/odh-th-torch-cpu-py312@sha256:0487ceeb4d180c0ec8de6367f7a72fb71b50835aba20ac3fb5b9db7248e9f369" in 471ms (471ms including waiting). Image size: 7235411206 bytes. | 2026-10-23 03:15:43 | 2026-10-23 03:15:43 | dw-deployment-w2f8n-647c87c7d-fn4mz.18e10a33b8118ea4 | spec.containers{notebook} | Normal | Created | Container created | 2026-10-23 03:15:43 | 2026-10-23 03:15:43 | dw-deployment-w2f8n-647c87c7d-fn4mz.18e10a33b8782a21 | spec.containers{notebook} | Normal | Started | Container started | 2026-10-23 03:16:26 | 2026-10-23 03:16:26 | dw-deployment-w2f8n-647c87c7d-fn4mz.18e10a3dbb781696 | spec.containers{notebook} | Normal | Killing | Stopping container notebook | 2026-10-23 03:15:42 | 2026-10-23 03:15:42 | dw-deployment-w2f8n-647c87c7d.18e10a335ed6e8fe | - | Normal | SuccessfulCreate | Created pod: dw-deployment-w2f8n-647c87c7d-fn4mz | 2026-10-23 03:15:42 | 2026-10-23 03:15:42 | dw-deployment-w2f8n.18e10a3356d3507f | - | Normal | ScalingReplicaSet | Scaled up replica set dw-deployment-w2f8n-647c87c7d from 0 to 1 | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | hef45756506c-node-0-0-td68c.18e10a36ad364bf9 | - | Normal | Scheduled | Successfully assigned test-ns-2br24/hef45756506c-node-0-0-td68c to ip-10-0-140-146.ec2.internal | 2026-10-23 03:15:57 | 2026-10-23 03:15:57 | hef45756506c-node-0-0-td68c.18e10a36cfde17a1 | - | Normal | AddedInterface | Add eth0 [10.132.0.37/23] from ovn-kubernetes | 2026-10-23 03:15:57 | 2026-10-23 03:15:57 | hef45756506c-node-0-0-td68c.18e10a36d3f51f79 | spec.containers{node} | Normal | Pulled | Container image "quay.io/opendatahub/odh-th-torch-cpu-py312:odh-stable" already present on machine and can be accessed by the pod | 2026-10-23 03:15:57 | 2026-10-23 03:15:57 | hef45756506c-node-0-0-td68c.18e10a36d6ad3ac2 | spec.containers{node} | Normal | Created | Container created | 2026-10-23 03:15:57 | 2026-10-23 03:15:57 | hef45756506c-node-0-0-td68c.18e10a36d726047e | spec.containers{node} | Normal | Started | Container started | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | hef45756506c-node-0-1-wh2k6.18e10a36b0f9577a | - | Normal | Scheduled | Successfully assigned test-ns-2br24/hef45756506c-node-0-1-wh2k6 to ip-10-0-140-14.ec2.internal | 2026-10-23 03:15:57 | 2026-10-23 03:15:57 | hef45756506c-node-0-1-wh2k6.18e10a36d33cd570 | - | Normal | AddedInterface | Add eth0 [10.134.0.41/23] from ovn-kubernetes | 2026-10-23 03:15:57 | 2026-10-23 03:15:57 | hef45756506c-node-0-1-wh2k6.18e10a36d7695d73 | spec.containers{node} | Normal | Pulled | Container image "quay.io/opendatahub/odh-th-torch-cpu-py312:odh-stable" already present on machine and can be accessed by the pod | 2026-10-23 03:15:57 | 2026-10-23 03:15:57 | hef45756506c-node-0-1-wh2k6.18e10a36da473576 | spec.containers{node} | Normal | Created | Container created | 2026-10-23 03:15:57 | 2026-10-23 03:15:57 | hef45756506c-node-0-1-wh2k6.18e10a36daad6a16 | spec.containers{node} | Normal | Started | Container started | 2026-10-23 03:15:55 | 2026-10-23 03:15:55 | hef45756506c-node-0.18e10a3681ebd45f | - | Normal | Suspended | Job suspended | 2026-10-23 03:15:56 | 2026-10-23 03:15:56 | hef45756506c-node-0.18e10a36aca925c6 | - | Normal | SuccessfulCreate | Created pod: hef45756506c-node-0-0-td68c | 2026-10-23 03:15:56 | 2026-10-23 03:15:56 | hef45756506c-node-0.18e10a36b060e9e7 | - | Normal | SuccessfulCreate | Created pod: hef45756506c-node-0-1-wh2k6 | 2026-10-23 03:15:56 | 2026-10-23 03:15:56 | hef45756506c-node-0.18e10a36b061401f | - | Normal | Resumed | Job resumed | 2026-10-23 03:16:24 | 2026-10-23 03:16:24 | hef45756506c-node-0.18e10a3d2f711eeb | - | Normal | Completed | Job completed | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | hef45756506c.18e10a3680fccf85 | - | Normal | CreatedWorkload | Created Workload: test-ns-2br24/trainjob-hef45756506c-2630a | 2026-10-23 03:15:55 | 2026-10-23 03:15:55 | hef45756506c.18e10a36847f1a16 | - | Normal | SuspendedJobs | jobset is suspended | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | hef45756506c.18e10a3695ab0915 | - | Normal | Started | Admitted by clusterQueue cq-5wqt7 | 2026-10-23 03:15:56 | 2026-10-23 03:15:56 | hef45756506c.18e10a369ea516d9 | - | Normal | ResumeJobs | jobset is resumed | 2026-10-23 03:16:24 | 2026-10-23 03:16:24 | hef45756506c.18e10a3d3152b017 | - | Normal | AllJobsCompleted | jobset completed successfully | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | hef45756506c.18e10a3d38ec307a | - | Normal | FinishedWorkload | Workload 'test-ns-2br24/trainjob-hef45756506c-2630a' is declared finished | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | pod-dw-deployment-w2f8n-647c87c7d-fn4mz-3d7f4.18e10a3370f3fabf | - | Normal | QuotaReserved | Quota reserved in ClusterQueue cq-5wqt7, wait time since queued was 1s | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | pod-dw-deployment-w2f8n-647c87c7d-fn4mz-3d7f4.18e10a3370f4c7d3 | - | Normal | Admitted | Admitted by ClusterQueue cq-5wqt7, wait time since reservation was 1s | 2026-10-23 03:15:42 | 2026-10-23 03:15:42 | pvc-4t2bg.18e10a334c6d7bdd | - | Normal | ExternalProvisioning | Waiting for a volume to be created either by the external provisioner 'example.com/nfs' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. | 2026-10-23 03:15:42 | 2026-10-23 03:15:42 | pvc-4t2bg.18e10a334d9e6882 | - | Normal | Provisioning | External provisioner is provisioning volume for claim "test-ns-2br24/pvc-4t2bg" | 2026-10-23 03:15:42 | 2026-10-23 03:15:42 | pvc-4t2bg.18e10a3350bc83ce | - | Normal | ProvisioningSucceeded | Successfully provisioned volume pvc-a5005b67-f00a-4fc2-acee-0895d6d6e548 | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | trainjob-hef45756506c-2630a.18e10a368345bdfe | - | Normal | QuotaReserved | Quota reserved in ClusterQueue cq-5wqt7, wait time since queued was 1s | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | trainjob-hef45756506c-2630a.18e10a3683462ecb | - | Normal | Admitted | Admitted by ClusterQueue cq-5wqt7, wait time since reservation was 1s |