LAST_SEEN | FIRST_SEEN | NAME | SUBOBJECT | TYPE | REASON | MESSAGE | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | dw-deployment-fcxbb-754f947979-8frlm.18e39fda0e8b70bf | - | Normal | CreatedWorkload | Created Workload: test-ns-jqqjz/pod-dw-deployment-fcxbb-754f947979-8frlm-001fa | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | dw-deployment-fcxbb-754f947979-8frlm.18e39fda1be08db8 | - | Normal | Scheduled | Successfully assigned test-ns-jqqjz/dw-deployment-fcxbb-754f947979-8frlm to ip-10-0-141-225.us-west-1.compute.internal | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | dw-deployment-fcxbb-754f947979-8frlm.18e39fda1cc80bbc | - | Normal | Started | Admitted by clusterQueue cq-tf99l | 2026-10-31 13:20:36 | 2026-10-31 13:20:36 | dw-deployment-fcxbb-754f947979-8frlm.18e39fda516cf700 | - | Normal | AddedInterface | Add eth0 [10.134.0.45/23] from ovn-kubernetes | 2026-10-31 13:20:36 | 2026-10-31 13:20:36 | dw-deployment-fcxbb-754f947979-8frlm.18e39fda594f5828 | spec.containers{notebook} | Normal | Pulling | Pulling image "quay.io/rhoai/odh-th-torch-cpu-py312-rhel9:on-pr-1345" | 2026-10-31 13:20:37 | 2026-10-31 13:20:37 | dw-deployment-fcxbb-754f947979-8frlm.18e39fda89352dfb | spec.containers{notebook} | Normal | Pulled | Successfully pulled image "quay.io/rhoai/odh-th-torch-cpu-py312-rhel9:on-pr-1345" in 803ms (803ms including waiting). Image size: 7754827064 bytes. | 2026-10-31 13:20:37 | 2026-10-31 13:20:37 | dw-deployment-fcxbb-754f947979-8frlm.18e39fda8c526548 | spec.containers{notebook} | Normal | Created | Container created | 2026-10-31 13:20:37 | 2026-10-31 13:20:37 | dw-deployment-fcxbb-754f947979-8frlm.18e39fda8cd20178 | spec.containers{notebook} | Normal | Started | Container started | 2026-10-31 13:21:27 | 2026-10-31 13:21:27 | dw-deployment-fcxbb-754f947979-8frlm.18e39fe6459aa04f | spec.containers{notebook} | Normal | Killing | Stopping container notebook | 2026-10-31 13:20:34 | 2026-10-31 13:20:34 | dw-deployment-fcxbb-754f947979.18e39fd9eeb23f32 | - | Normal | SuccessfulCreate | Created pod: dw-deployment-fcxbb-754f947979-8frlm | 2026-10-31 13:20:34 | 2026-10-31 13:20:34 | dw-deployment-fcxbb.18e39fd9d8b08005 | - | Normal | ScalingReplicaSet | Scaled up replica set dw-deployment-fcxbb-754f947979 from 0 to 1 | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | pod-dw-deployment-fcxbb-754f947979-8frlm-001fa.18e39fda15a4e92c | - | Normal | QuotaReserved | Quota reserved in ClusterQueue cq-tf99l, wait time since queued was 1s | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | pod-dw-deployment-fcxbb-754f947979-8frlm-001fa.18e39fda15a58a19 | - | Normal | Admitted | Admitted by ClusterQueue cq-tf99l, wait time since reservation was 1s | 2026-10-31 13:20:34 | 2026-10-31 13:20:34 | pvc-2jv7r.18e39fd9c028efea | - | Normal | ExternalProvisioning | Waiting for a volume to be created either by the external provisioner 'example.com/nfs' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. | 2026-10-31 13:20:34 | 2026-10-31 13:20:34 | pvc-2jv7r.18e39fd9c50bab88 | - | Normal | Provisioning | External provisioner is provisioning volume for claim "test-ns-jqqjz/pvc-2jv7r" | 2026-10-31 13:20:34 | 2026-10-31 13:20:34 | pvc-2jv7r.18e39fd9cf2b26da | - | Normal | ProvisioningSucceeded | Successfully provisioned volume pvc-c686305a-4ddb-4a5c-aae3-48134b576012 | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | trainjob-z00c94b1fe60-f6df1.18e39fddaa3dbe92 | - | Normal | QuotaReserved | Quota reserved in ClusterQueue cq-tf99l, wait time since queued was 1s | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | trainjob-z00c94b1fe60-f6df1.18e39fddaa3e637f | - | Normal | Admitted | Admitted by ClusterQueue cq-tf99l, wait time since reservation was 1s | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | z00c94b1fe60-node-0-0-7q5gp.18e39fddf0d408ed | - | Normal | Scheduled | Successfully assigned test-ns-jqqjz/z00c94b1fe60-node-0-0-7q5gp to ip-10-0-141-225.us-west-1.compute.internal | 2026-10-31 13:20:53 | 2026-10-31 13:20:53 | z00c94b1fe60-node-0-0-7q5gp.18e39fde2656fe5f | - | Normal | AddedInterface | Add eth0 [10.134.0.46/23] from ovn-kubernetes | 2026-10-31 13:20:53 | 2026-10-31 13:20:53 | z00c94b1fe60-node-0-0-7q5gp.18e39fde35f49a9b | spec.containers{node} | Normal | Pulled | Container image "quay.io/rhoai/odh-th-torch-cpu-py312-rhel9:on-pr-1345" already present on machine and can be accessed by the pod | 2026-10-31 13:20:53 | 2026-10-31 13:20:53 | z00c94b1fe60-node-0-0-7q5gp.18e39fde390512a6 | spec.containers{node} | Normal | Created | Container created | 2026-10-31 13:20:53 | 2026-10-31 13:20:53 | z00c94b1fe60-node-0-0-7q5gp.18e39fde397d0f04 | spec.containers{node} | Normal | Started | Container started | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | z00c94b1fe60-node-0-1-wg724.18e39fddfb5f2dd5 | - | Normal | Scheduled | Successfully assigned test-ns-jqqjz/z00c94b1fe60-node-0-1-wg724 to ip-10-0-141-225.us-west-1.compute.internal | 2026-10-31 13:20:53 | 2026-10-31 13:20:53 | z00c94b1fe60-node-0-1-wg724.18e39fde30d788e3 | - | Normal | AddedInterface | Add eth0 [10.134.0.47/23] from ovn-kubernetes | 2026-10-31 13:20:53 | 2026-10-31 13:20:53 | z00c94b1fe60-node-0-1-wg724.18e39fde3a9ef3d2 | spec.containers{node} | Normal | Pulled | Container image "quay.io/rhoai/odh-th-torch-cpu-py312-rhel9:on-pr-1345" already present on machine and can be accessed by the pod | 2026-10-31 13:20:53 | 2026-10-31 13:20:53 | z00c94b1fe60-node-0-1-wg724.18e39fde3df19eb6 | spec.containers{node} | Normal | Created | Container created | 2026-10-31 13:20:53 | 2026-10-31 13:20:53 | z00c94b1fe60-node-0-1-wg724.18e39fde3e77f5e8 | spec.containers{node} | Normal | Started | Container started | 2026-10-31 13:20:50 | 2026-10-31 13:20:50 | z00c94b1fe60-node-0.18e39fdda02cf0ac | - | Normal | Suspended | Job suspended | 2026-10-31 13:20:52 | 2026-10-31 13:20:52 | z00c94b1fe60-node-0.18e39fddf05f864c | - | Normal | SuccessfulCreate | Created pod: z00c94b1fe60-node-0-0-7q5gp | 2026-10-31 13:20:52 | 2026-10-31 13:20:52 | z00c94b1fe60-node-0.18e39fddfaee98fa | - | Normal | SuccessfulCreate | Created pod: z00c94b1fe60-node-0-1-wg724 | 2026-10-31 13:20:52 | 2026-10-31 13:20:52 | z00c94b1fe60-node-0.18e39fddfaeef7a8 | - | Normal | Resumed | Job resumed | 2026-10-31 13:21:24 | 2026-10-31 13:21:24 | z00c94b1fe60-node-0.18e39fe57f7f0513 | - | Normal | Completed | Job completed | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | z00c94b1fe60.18e39fdda365a400 | - | Normal | CreatedWorkload | Created Workload: test-ns-jqqjz/trainjob-z00c94b1fe60-f6df1 | 2026-10-31 13:20:50 | 2026-10-31 13:20:50 | z00c94b1fe60.18e39fdda85ace42 | - | Normal | SuspendedJobs | jobset is suspended | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | z00c94b1fe60.18e39fddc4b5898f | - | Normal | Started | Admitted by clusterQueue cq-tf99l | 2026-10-31 13:20:51 | 2026-10-31 13:20:51 | z00c94b1fe60.18e39fdddeee357d | - | Normal | ResumeJobs | jobset is resumed | 2026-10-31 13:21:24 | 2026-10-31 13:21:24 | z00c94b1fe60.18e39fe584c73258 | - | Normal | AllJobsCompleted | jobset completed successfully | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | z00c94b1fe60.18e39fe5a14aa180 | - | Normal | FinishedWorkload | Workload 'test-ns-jqqjz/trainjob-z00c94b1fe60-f6df1' is declared finished |