LAST_SEEN | FIRST_SEEN | NAME | SUBOBJECT | TYPE | REASON | MESSAGE | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | ca5eb88f4581-node-0-0-krz5j.18e33d705cc8e66a | - | Normal | Scheduled | Successfully assigned test-ns-cmp8t/ca5eb88f4581-node-0-0-krz5j to ip-10-0-137-95.ec2.internal | 2026-10-30 07:17:10 | 2026-10-30 07:17:10 | ca5eb88f4581-node-0-0-krz5j.18e33d707f64d1d8 | - | Normal | AddedInterface | Add eth0 [10.132.0.40/23] from ovn-kubernetes | 2026-10-30 07:17:10 | 2026-10-30 07:17:10 | ca5eb88f4581-node-0-0-krz5j.18e33d708427c3bb | spec.containers{node} | Normal | Pulled | Container image "quay.io/opendatahub/odh-th-torch-cpu-py312:odh-stable" already present on machine and can be accessed by the pod | 2026-10-30 07:17:10 | 2026-10-30 07:17:10 | ca5eb88f4581-node-0-0-krz5j.18e33d7086bf39fc | spec.containers{node} | Normal | Created | Container created | 2026-10-30 07:17:10 | 2026-10-30 07:17:10 | ca5eb88f4581-node-0-0-krz5j.18e33d7087a3346b | spec.containers{node} | Normal | Started | Container started | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | ca5eb88f4581-node-0-1-brsnt.18e33d706098fadb | - | Normal | Scheduled | Successfully assigned test-ns-cmp8t/ca5eb88f4581-node-0-1-brsnt to ip-10-0-137-95.ec2.internal | 2026-10-30 07:17:10 | 2026-10-30 07:17:10 | ca5eb88f4581-node-0-1-brsnt.18e33d7083425ee7 | - | Normal | AddedInterface | Add eth0 [10.132.0.41/23] from ovn-kubernetes | 2026-10-30 07:17:10 | 2026-10-30 07:17:10 | ca5eb88f4581-node-0-1-brsnt.18e33d7086b31baa | spec.containers{node} | Normal | Pulled | Container image "quay.io/opendatahub/odh-th-torch-cpu-py312:odh-stable" already present on machine and can be accessed by the pod | 2026-10-30 07:17:10 | 2026-10-30 07:17:10 | ca5eb88f4581-node-0-1-brsnt.18e33d7089d5afcb | spec.containers{node} | Normal | Created | Container created | 2026-10-30 07:17:10 | 2026-10-30 07:17:10 | ca5eb88f4581-node-0-1-brsnt.18e33d708a45ec7e | spec.containers{node} | Normal | Started | Container started | 2026-10-30 07:17:08 | 2026-10-30 07:17:08 | ca5eb88f4581-node-0.18e33d703115b314 | - | Normal | Suspended | Job suspended | 2026-10-30 07:17:09 | 2026-10-30 07:17:09 | ca5eb88f4581-node-0.18e33d705c5bece0 | - | Normal | SuccessfulCreate | Created pod: ca5eb88f4581-node-0-0-krz5j | 2026-10-30 07:17:09 | 2026-10-30 07:17:09 | ca5eb88f4581-node-0.18e33d706037f434 | - | Normal | SuccessfulCreate | Created pod: ca5eb88f4581-node-0-1-brsnt | 2026-10-30 07:17:09 | 2026-10-30 07:17:09 | ca5eb88f4581-node-0.18e33d706038621b | - | Normal | Resumed | Job resumed | 2026-10-30 07:17:41 | 2026-10-30 07:17:41 | ca5eb88f4581-node-0.18e33d77e2aa37bd | - | Normal | Completed | Job completed | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | ca5eb88f4581.18e33d702fb59827 | - | Normal | CreatedWorkload | Created Workload: test-ns-cmp8t/trainjob-ca5eb88f4581-cc9ea | 2026-10-30 07:17:08 | 2026-10-30 07:17:08 | ca5eb88f4581.18e33d7033e5f5cf | - | Normal | SuspendedJobs | jobset is suspended | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | ca5eb88f4581.18e33d7045dfa14e | - | Normal | Started | Admitted by clusterQueue cq-9rsdg | 2026-10-30 07:17:09 | 2026-10-30 07:17:09 | ca5eb88f4581.18e33d704ec50fa2 | - | Normal | ResumeJobs | jobset is resumed | 2026-10-30 07:17:41 | 2026-10-30 07:17:41 | ca5eb88f4581.18e33d77e4b5b724 | - | Normal | AllJobsCompleted | jobset completed successfully | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | ca5eb88f4581.18e33d77ec63b1dc | - | Normal | FinishedWorkload | Workload 'test-ns-cmp8t/trainjob-ca5eb88f4581-cc9ea' is declared finished | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | dw-deployment-bl9pg-5877f547dd-r8v69.18e33d6d5673427f | - | Normal | CreatedWorkload | Created Workload: test-ns-cmp8t/pod-dw-deployment-bl9pg-5877f547dd-r8v69-3a8c6 | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | dw-deployment-bl9pg-5877f547dd-r8v69.18e33d6d5b8c4564 | - | Normal | Started | Admitted by clusterQueue cq-9rsdg | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | dw-deployment-bl9pg-5877f547dd-r8v69.18e33d6d5ba11ea1 | - | Normal | Scheduled | Successfully assigned test-ns-cmp8t/dw-deployment-bl9pg-5877f547dd-r8v69 to ip-10-0-135-30.ec2.internal | 2026-10-30 07:16:57 | 2026-10-30 07:16:57 | dw-deployment-bl9pg-5877f547dd-r8v69.18e33d6d805c2424 | - | Normal | AddedInterface | Add eth0 [10.133.0.39/23] from ovn-kubernetes | 2026-10-30 07:16:57 | 2026-10-30 07:16:57 | dw-deployment-bl9pg-5877f547dd-r8v69.18e33d6d832b773a | spec.containers{notebook} | Normal | Pulling | Pulling image "quay.io/rhoai/odh-th-torch-cpu-py312-rhel9:rhoai-3.6" | 2026-10-30 07:16:57 | 2026-10-30 07:16:57 | dw-deployment-bl9pg-5877f547dd-r8v69.18e33d6db345c465 | spec.containers{notebook} | Normal | Pulled | Successfully pulled image "quay.io/rhoai/odh-th-torch-cpu-py312-rhel9:rhoai-3.6" in 806ms (807ms including waiting). Image size: 8468893571 bytes. | 2026-10-30 07:16:58 | 2026-10-30 07:16:58 | dw-deployment-bl9pg-5877f547dd-r8v69.18e33d6db835cce3 | spec.containers{notebook} | Normal | Created | Container created | 2026-10-30 07:16:58 | 2026-10-30 07:16:58 | dw-deployment-bl9pg-5877f547dd-r8v69.18e33d6db971cd64 | spec.containers{notebook} | Normal | Started | Container started | 2026-10-30 07:17:44 | 2026-10-30 07:17:44 | dw-deployment-bl9pg-5877f547dd-r8v69.18e33d787a61fbc2 | spec.containers{notebook} | Normal | Killing | Stopping container notebook | 2026-10-30 07:16:56 | 2026-10-30 07:16:56 | dw-deployment-bl9pg-5877f547dd.18e33d6d46e4a587 | - | Normal | SuccessfulCreate | Created pod: dw-deployment-bl9pg-5877f547dd-r8v69 | 2026-10-30 07:16:56 | 2026-10-30 07:16:56 | dw-deployment-bl9pg.18e33d6d3ec2c98b | - | Normal | ScalingReplicaSet | Scaled up replica set dw-deployment-bl9pg-5877f547dd from 0 to 1 | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | pod-dw-deployment-bl9pg-5877f547dd-r8v69-3a8c6.18e33d6d58f9e87d | - | Normal | QuotaReserved | Quota reserved in ClusterQueue cq-9rsdg, wait time since queued was 0s | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | pod-dw-deployment-bl9pg-5877f547dd-r8v69-3a8c6.18e33d6d58fb2ae1 | - | Normal | Admitted | Admitted by ClusterQueue cq-9rsdg, wait time since reservation was 0s | 2026-10-30 07:16:55 | 2026-10-30 07:16:55 | pvc-lrmrd.18e33d6d33218a21 | - | Normal | ExternalProvisioning | Waiting for a volume to be created either by the external provisioner 'example.com/nfs' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. | 2026-10-30 07:16:55 | 2026-10-30 07:16:55 | pvc-lrmrd.18e33d6d3471696a | - | Normal | Provisioning | External provisioner is provisioning volume for claim "test-ns-cmp8t/pvc-lrmrd" | 2026-10-30 07:16:55 | 2026-10-30 07:16:55 | pvc-lrmrd.18e33d6d3798181e | - | Normal | ProvisioningSucceeded | Successfully provisioned volume pvc-6145af9c-1f4f-4899-8ea9-cde5af4e65bf | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | trainjob-ca5eb88f4581-cc9ea.18e33d703229113e | - | Normal | QuotaReserved | Quota reserved in ClusterQueue cq-9rsdg, wait time since queued was 1s | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | trainjob-ca5eb88f4581-cc9ea.18e33d70322984c4 | - | Normal | Admitted | Admitted by ClusterQueue cq-9rsdg, wait time since reservation was 1s |