LAST_SEEN | FIRST_SEEN | NAME | SUBOBJECT | TYPE | REASON | MESSAGE | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | d240fbd6a54b-node-0-0-7brnf.18e48bd9358bb050 | - | Normal | Scheduled | Successfully assigned test-ns-56kxh/d240fbd6a54b-node-0-0-7brnf to ip-10-0-131-125.us-west-2.compute.internal | 2026-11-03 13:25:17 | 2026-11-03 13:25:17 | d240fbd6a54b-node-0-0-7brnf.18e48bd96b2d3b91 | - | Normal | AddedInterface | Add eth0 [10.134.0.43/23] from ovn-kubernetes | 2026-11-03 13:25:17 | 2026-11-03 13:25:17 | d240fbd6a54b-node-0-0-7brnf.18e48bd97ac75b9f | spec.containers{node} | Normal | Pulled | Container image "quay.io/opendatahub/odh-th-torch-cpu-py312:odh-stable" already present on machine and can be accessed by the pod | 2026-11-03 13:25:17 | 2026-11-03 13:25:17 | d240fbd6a54b-node-0-0-7brnf.18e48bd97d8a441f | spec.containers{node} | Normal | Created | Container created | 2026-11-03 13:25:17 | 2026-11-03 13:25:17 | d240fbd6a54b-node-0-0-7brnf.18e48bd97dfc2cc7 | spec.containers{node} | Normal | Started | Container started | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | d240fbd6a54b-node-0-1-x4m6n.18e48bd93fa46bd3 | - | Normal | Scheduled | Successfully assigned test-ns-56kxh/d240fbd6a54b-node-0-1-x4m6n to ip-10-0-131-125.us-west-2.compute.internal | 2026-11-03 13:25:17 | 2026-11-03 13:25:17 | d240fbd6a54b-node-0-1-x4m6n.18e48bd974e28878 | - | Normal | AddedInterface | Add eth0 [10.134.0.44/23] from ovn-kubernetes | 2026-11-03 13:25:17 | 2026-11-03 13:25:17 | d240fbd6a54b-node-0-1-x4m6n.18e48bd97ec827fe | spec.containers{node} | Normal | Pulled | Container image "quay.io/opendatahub/odh-th-torch-cpu-py312:odh-stable" already present on machine and can be accessed by the pod | 2026-11-03 13:25:17 | 2026-11-03 13:25:17 | d240fbd6a54b-node-0-1-x4m6n.18e48bd982778b14 | spec.containers{node} | Normal | Created | Container created | 2026-11-03 13:25:17 | 2026-11-03 13:25:17 | d240fbd6a54b-node-0-1-x4m6n.18e48bd982f82c6f | spec.containers{node} | Normal | Started | Container started | 2026-11-03 13:25:14 | 2026-11-03 13:25:14 | d240fbd6a54b-node-0.18e48bd8d278e3b0 | - | Normal | Suspended | Job suspended | 2026-11-03 13:25:16 | 2026-11-03 13:25:16 | d240fbd6a54b-node-0.18e48bd9351c9a77 | - | Normal | SuccessfulCreate | Created pod: d240fbd6a54b-node-0-0-7brnf | 2026-11-03 13:25:16 | 2026-11-03 13:25:16 | d240fbd6a54b-node-0.18e48bd93f374d1b | - | Normal | SuccessfulCreate | Created pod: d240fbd6a54b-node-0-1-x4m6n | 2026-11-03 13:25:16 | 2026-11-03 13:25:16 | d240fbd6a54b-node-0.18e48bd93f379cf9 | - | Normal | Resumed | Job resumed | 2026-11-03 13:25:49 | 2026-11-03 13:25:49 | d240fbd6a54b-node-0.18e48be0cf1b490f | - | Normal | Completed | Job completed | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | d240fbd6a54b.18e48bd8d26c3750 | - | Normal | CreatedWorkload | Created Workload: test-ns-56kxh/trainjob-d240fbd6a54b-429f8 | 2026-11-03 13:25:15 | 2026-11-03 13:25:15 | d240fbd6a54b.18e48bd8da0c490b | - | Normal | SuspendedJobs | jobset is suspended | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | d240fbd6a54b.18e48bd91233992d | - | Normal | Started | Admitted by clusterQueue cq-gh466 | 2026-11-03 13:25:16 | 2026-11-03 13:25:16 | d240fbd6a54b.18e48bd923d81844 | - | Normal | ResumeJobs | jobset is resumed | 2026-11-03 13:25:49 | 2026-11-03 13:25:49 | d240fbd6a54b.18e48be0d403e90c | - | Normal | AllJobsCompleted | jobset completed successfully | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | d240fbd6a54b.18e48be0efe39840 | - | Normal | FinishedWorkload | Workload 'test-ns-56kxh/trainjob-d240fbd6a54b-429f8' is declared finished | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | dw-deployment-8qgpj-cbfb688fc-n9sv6.18e48bd56483f264 | - | Normal | CreatedWorkload | Created Workload: test-ns-56kxh/pod-dw-deployment-8qgpj-cbfb688fc-n9sv6-0947e | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | dw-deployment-8qgpj-cbfb688fc-n9sv6.18e48bd571790a8d | - | Normal | Scheduled | Successfully assigned test-ns-56kxh/dw-deployment-8qgpj-cbfb688fc-n9sv6 to ip-10-0-139-209.us-west-2.compute.internal | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | dw-deployment-8qgpj-cbfb688fc-n9sv6.18e48bd572a63619 | - | Normal | Started | Admitted by clusterQueue cq-gh466 | 2026-11-03 13:25:01 | 2026-11-03 13:25:01 | dw-deployment-8qgpj-cbfb688fc-n9sv6.18e48bd5aa6a7cfc | - | Normal | AddedInterface | Add eth0 [10.132.0.46/23] from ovn-kubernetes | 2026-11-03 13:25:01 | 2026-11-03 13:25:01 | dw-deployment-8qgpj-cbfb688fc-n9sv6.18e48bd5b205fd63 | spec.containers{notebook} | Normal | Pulling | Pulling image "quay.io/rhoai/odh-th-torch-cpu-py312-rhel9:rhoai-3.6" | 2026-11-03 13:25:02 | 2026-11-03 13:25:02 | dw-deployment-8qgpj-cbfb688fc-n9sv6.18e48bd5e69c6747 | spec.containers{notebook} | Normal | Pulled | Successfully pulled image "quay.io/rhoai/odh-th-torch-cpu-py312-rhel9:rhoai-3.6" in 882ms (882ms including waiting). Image size: 8468893571 bytes. | 2026-11-03 13:25:02 | 2026-11-03 13:25:02 | dw-deployment-8qgpj-cbfb688fc-n9sv6.18e48bd5e9c3579a | spec.containers{notebook} | Normal | Created | Container created | 2026-11-03 13:25:02 | 2026-11-03 13:25:02 | dw-deployment-8qgpj-cbfb688fc-n9sv6.18e48bd5ea24b117 | spec.containers{notebook} | Normal | Started | Container started | 2026-11-03 13:25:53 | 2026-11-03 13:25:53 | dw-deployment-8qgpj-cbfb688fc-n9sv6.18e48be1d5642b55 | spec.containers{notebook} | Normal | Killing | Stopping container notebook | 2026-11-03 13:24:59 | 2026-11-03 13:24:59 | dw-deployment-8qgpj-cbfb688fc.18e48bd542491dd0 | - | Normal | SuccessfulCreate | Created pod: dw-deployment-8qgpj-cbfb688fc-n9sv6 | 2026-11-03 13:24:59 | 2026-11-03 13:24:59 | dw-deployment-8qgpj.18e48bd52d3169bc | - | Normal | ScalingReplicaSet | Scaled up replica set dw-deployment-8qgpj-cbfb688fc from 0 to 1 | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | pod-dw-deployment-8qgpj-cbfb688fc-n9sv6-0947e.18e48bd56b62356a | - | Normal | QuotaReserved | Quota reserved in ClusterQueue cq-gh466, wait time since queued was 1s | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | pod-dw-deployment-8qgpj-cbfb688fc-n9sv6-0947e.18e48bd56b62bd3b | - | Normal | Admitted | Admitted by ClusterQueue cq-gh466, wait time since reservation was 0s | 2026-11-03 13:24:58 | 2026-11-03 13:24:58 | pvc-hzdgr.18e48bd515a91887 | - | Normal | ExternalProvisioning | Waiting for a volume to be created either by the external provisioner 'example.com/nfs' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. | 2026-11-03 13:24:58 | 2026-11-03 13:24:58 | pvc-hzdgr.18e48bd51a1c874d | - | Normal | Provisioning | External provisioner is provisioning volume for claim "test-ns-56kxh/pvc-hzdgr" | 2026-11-03 13:24:59 | 2026-11-03 13:24:59 | pvc-hzdgr.18e48bd5239715eb | - | Normal | ProvisioningSucceeded | Successfully provisioned volume pvc-e38b6b86-a9c2-4f62-aa63-6fd7ef35055a | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | trainjob-d240fbd6a54b-429f8.18e48bd8d9118b4b | - | Normal | QuotaReserved | Quota reserved in ClusterQueue cq-gh466, wait time since queued was 1s | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | trainjob-d240fbd6a54b-429f8.18e48bd8d911ecc2 | - | Normal | Admitted | Admitted by ClusterQueue cq-gh466, wait time since reservation was 1s |