LAST_SEEN | FIRST_SEEN | NAME | SUBOBJECT | TYPE | REASON | MESSAGE | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | dw-deployment-nvpnq-7c99cd8c4f-k27zm.18e45a02c401ef3f | - | Normal | CreatedWorkload | Created Workload: test-ns-x267j/pod-dw-deployment-nvpnq-7c99cd8c4f-k27zm-edce3 | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | dw-deployment-nvpnq-7c99cd8c4f-k27zm.18e45a02d4661139 | - | Normal | Scheduled | Successfully assigned test-ns-x267j/dw-deployment-nvpnq-7c99cd8c4f-k27zm to ip-10-0-139-142.us-west-1.compute.internal | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | dw-deployment-nvpnq-7c99cd8c4f-k27zm.18e45a02d578ec23 | - | Normal | Started | Admitted by clusterQueue cq-w68m7 | 2026-11-02 22:12:00 | 2026-11-02 22:12:00 | dw-deployment-nvpnq-7c99cd8c4f-k27zm.18e45a0309f47900 | - | Normal | AddedInterface | Add eth0 [10.134.0.37/23] from ovn-kubernetes | 2026-11-02 22:12:00 | 2026-11-02 22:12:00 | dw-deployment-nvpnq-7c99cd8c4f-k27zm.18e45a03131dfe42 | spec.containers{notebook} | Normal | Pulling | Pulling image "quay.io/rhoai/odh-th-torch-cpu-py312-rhel9:on-pr-1358" | 2026-11-02 22:12:01 | 2026-11-02 22:12:01 | dw-deployment-nvpnq-7c99cd8c4f-k27zm.18e45a0346f9f7d3 | spec.containers{notebook} | Normal | Pulled | Successfully pulled image "quay.io/rhoai/odh-th-torch-cpu-py312-rhel9:on-pr-1358" in 870ms (870ms including waiting). Image size: 7756736825 bytes. | 2026-11-02 22:12:01 | 2026-11-02 22:12:01 | dw-deployment-nvpnq-7c99cd8c4f-k27zm.18e45a034a325478 | spec.containers{notebook} | Normal | Created | Container created | 2026-11-02 22:12:01 | 2026-11-02 22:12:01 | dw-deployment-nvpnq-7c99cd8c4f-k27zm.18e45a034aa62784 | spec.containers{notebook} | Normal | Started | Container started | 2026-11-02 22:13:48 | 2026-11-02 22:13:48 | dw-deployment-nvpnq-7c99cd8c4f-k27zm.18e45a1c3d622831 | spec.containers{notebook} | Normal | Killing | Stopping container notebook | 2026-11-02 22:11:59 | 2026-11-02 22:11:59 | dw-deployment-nvpnq-7c99cd8c4f.18e45a02a5b921d8 | - | Normal | SuccessfulCreate | Created pod: dw-deployment-nvpnq-7c99cd8c4f-k27zm | 2026-11-02 22:11:58 | 2026-11-02 22:11:58 | dw-deployment-nvpnq.18e45a02919e23cf | - | Normal | ScalingReplicaSet | Scaled up replica set dw-deployment-nvpnq-7c99cd8c4f from 0 to 1 | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | h7c9ae6b04b1-node-0-0-6s985.18e45a06d05d094c | - | Normal | Scheduled | Successfully assigned test-ns-x267j/h7c9ae6b04b1-node-0-0-6s985 to ip-10-0-139-142.us-west-1.compute.internal | 2026-11-02 22:12:17 | 2026-11-02 22:12:17 | h7c9ae6b04b1-node-0-0-6s985.18e45a06f3ef23e8 | - | Normal | AddedInterface | Add eth0 [10.134.0.38/23] from ovn-kubernetes | 2026-11-02 22:12:17 | 2026-11-02 22:12:17 | h7c9ae6b04b1-node-0-0-6s985.18e45a06fde88d9f | spec.containers{node} | Normal | Pulled | Container image "quay.io/rhoai/odh-th-torch-cpu-py312-rhel9:on-pr-1358" already present on machine and can be accessed by the pod | 2026-11-02 22:12:17 | 2026-11-02 22:12:17 | h7c9ae6b04b1-node-0-0-6s985.18e45a0700db4684 | spec.containers{node} | Normal | Created | Container created | 2026-11-02 22:12:17 | 2026-11-02 22:12:17 | h7c9ae6b04b1-node-0-0-6s985.18e45a07014f67ba | spec.containers{node} | Normal | Started | Container started | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | h7c9ae6b04b1-node-0-1-pl5px.18e45a06da8e5744 | - | Normal | Scheduled | Successfully assigned test-ns-x267j/h7c9ae6b04b1-node-0-1-pl5px to ip-10-0-142-219.us-west-1.compute.internal | 2026-11-02 22:12:18 | 2026-11-02 22:12:18 | h7c9ae6b04b1-node-0-1-pl5px.18e45a0721982dce | - | Normal | AddedInterface | Add eth0 [10.133.0.34/23] from ovn-kubernetes | 2026-11-02 22:12:18 | 2026-11-02 22:12:18 | h7c9ae6b04b1-node-0-1-pl5px.18e45a072ef1ac2e | spec.containers{node} | Normal | Pulling | Pulling image "quay.io/rhoai/odh-th-torch-cpu-py312-rhel9:on-pr-1358" | 2026-11-02 22:13:14 | 2026-11-02 22:13:14 | h7c9ae6b04b1-node-0-1-pl5px.18e45a1456a4865b | spec.containers{node} | Normal | Pulled | Successfully pulled image "quay.io/rhoai/odh-th-torch-cpu-py312-rhel9:on-pr-1358" in 56.5s (56.5s including waiting). Image size: 7756736825 bytes. | 2026-11-02 22:13:15 | 2026-11-02 22:13:15 | h7c9ae6b04b1-node-0-1-pl5px.18e45a145a73550c | spec.containers{node} | Normal | Created | Container created | 2026-11-02 22:13:15 | 2026-11-02 22:13:15 | h7c9ae6b04b1-node-0-1-pl5px.18e45a145b29ee0e | spec.containers{node} | Normal | Started | Container started | 2026-11-02 22:12:15 | 2026-11-02 22:12:15 | h7c9ae6b04b1-node-0.18e45a066ca1bad2 | - | Normal | Suspended | Job suspended | 2026-11-02 22:12:16 | 2026-11-02 22:12:16 | h7c9ae6b04b1-node-0.18e45a06cff4471c | - | Normal | SuccessfulCreate | Created pod: h7c9ae6b04b1-node-0-0-6s985 | 2026-11-02 22:12:17 | 2026-11-02 22:12:17 | h7c9ae6b04b1-node-0.18e45a06da2e27c4 | - | Normal | SuccessfulCreate | Created pod: h7c9ae6b04b1-node-0-1-pl5px | 2026-11-02 22:12:17 | 2026-11-02 22:12:17 | h7c9ae6b04b1-node-0.18e45a06da2e9594 | - | Normal | Resumed | Job resumed | 2026-11-02 22:13:44 | 2026-11-02 22:13:44 | h7c9ae6b04b1-node-0.18e45a1b4253ce59 | - | Normal | Completed | Job completed | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | h7c9ae6b04b1.18e45a0670253188 | - | Normal | CreatedWorkload | Created Workload: test-ns-x267j/trainjob-h7c9ae6b04b1-15263 | 2026-11-02 22:12:15 | 2026-11-02 22:12:15 | h7c9ae6b04b1.18e45a0674910108 | - | Normal | SuspendedJobs | jobset is suspended | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | h7c9ae6b04b1.18e45a06a6727eb0 | - | Normal | Started | Admitted by clusterQueue cq-w68m7 | 2026-11-02 22:12:16 | 2026-11-02 22:12:16 | h7c9ae6b04b1.18e45a06c13f5b06 | - | Normal | ResumeJobs | jobset is resumed | 2026-11-02 22:13:44 | 2026-11-02 22:13:44 | h7c9ae6b04b1.18e45a1b474b1e11 | - | Normal | AllJobsCompleted | jobset completed successfully | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | h7c9ae6b04b1.18e45a1b62cdd6cd | - | Normal | FinishedWorkload | Workload 'test-ns-x267j/trainjob-h7c9ae6b04b1-15263' is declared finished | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | pod-dw-deployment-nvpnq-7c99cd8c4f-k27zm-edce3.18e45a02cdccb649 | - | Normal | QuotaReserved | Quota reserved in ClusterQueue cq-w68m7, wait time since queued was 1s | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | pod-dw-deployment-nvpnq-7c99cd8c4f-k27zm-edce3.18e45a02cdcd2aaf | - | Normal | Admitted | Admitted by ClusterQueue cq-w68m7, wait time since reservation was 1s | 2026-11-02 22:11:58 | 2026-11-02 22:11:58 | pvc-sv8rq.18e45a027b945433 | - | Normal | ExternalProvisioning | Waiting for a volume to be created either by the external provisioner 'example.com/nfs' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. | 2026-11-02 22:11:58 | 2026-11-02 22:11:58 | pvc-sv8rq.18e45a028024e8e8 | - | Normal | Provisioning | External provisioner is provisioning volume for claim "test-ns-x267j/pvc-sv8rq" | 2026-11-02 22:11:58 | 2026-11-02 22:11:58 | pvc-sv8rq.18e45a0289ac55ac | - | Normal | ProvisioningSucceeded | Successfully provisioned volume pvc-6f1da5d7-446a-4fc7-8f78-f5cfdcd8f38f | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | trainjob-h7c9ae6b04b1-15263.18e45a0676dac105 | - | Normal | QuotaReserved | Quota reserved in ClusterQueue cq-w68m7, wait time since queued was 0s | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | trainjob-h7c9ae6b04b1-15263.18e45a0676db63c8 | - | Normal | Admitted | Admitted by ClusterQueue cq-w68m7, wait time since reservation was 0s |