LAST_SEEN | FIRST_SEEN | NAME | SUBOBJECT | TYPE | REASON | MESSAGE | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | d60dcb77863b-node-0-0-trwxc.18e3749274e52e6b | - | Normal | Scheduled | Successfully assigned test-ns-cjgqr/d60dcb77863b-node-0-0-trwxc to ip-10-0-131-99.us-west-1.compute.internal | 2026-10-31 00:07:29 | 2026-10-31 00:07:29 | d60dcb77863b-node-0-0-trwxc.18e37492ab296518 | - | Normal | AddedInterface | Add eth0 [10.133.0.55/23] from ovn-kubernetes | 2026-10-31 00:07:30 | 2026-10-31 00:07:30 | d60dcb77863b-node-0-0-trwxc.18e37492b8214904 | spec.containers{node} | Normal | Pulled | Container image "quay.io/opendatahub/odh-th-torch-cpu-py312@sha256:cc0bfe88c9b57676613b61869fdfdd854bcd404546646c941231f7f84421eeee" already present on machine and can be accessed by the pod | 2026-10-31 00:07:30 | 2026-10-31 00:07:30 | d60dcb77863b-node-0-0-trwxc.18e37492bb240634 | spec.containers{node} | Normal | Created | Container created | 2026-10-31 00:07:30 | 2026-10-31 00:07:30 | d60dcb77863b-node-0-0-trwxc.18e37492bb9a0ed0 | spec.containers{node} | Normal | Started | Container started | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | d60dcb77863b-node-0-1-v2zxz.18e374927f197d66 | - | Normal | Scheduled | Successfully assigned test-ns-cjgqr/d60dcb77863b-node-0-1-v2zxz to ip-10-0-131-99.us-west-1.compute.internal | 2026-10-31 00:07:30 | 2026-10-31 00:07:30 | d60dcb77863b-node-0-1-v2zxz.18e37492b504e36a | - | Normal | AddedInterface | Add eth0 [10.133.0.56/23] from ovn-kubernetes | 2026-10-31 00:07:30 | 2026-10-31 00:07:30 | d60dcb77863b-node-0-1-v2zxz.18e37492bed1ec19 | spec.containers{node} | Normal | Pulled | Container image "quay.io/opendatahub/odh-th-torch-cpu-py312@sha256:cc0bfe88c9b57676613b61869fdfdd854bcd404546646c941231f7f84421eeee" already present on machine and can be accessed by the pod | 2026-10-31 00:07:30 | 2026-10-31 00:07:30 | d60dcb77863b-node-0-1-v2zxz.18e37492c244d934 | spec.containers{node} | Normal | Created | Container created | 2026-10-31 00:07:30 | 2026-10-31 00:07:30 | d60dcb77863b-node-0-1-v2zxz.18e37492c2c04c13 | spec.containers{node} | Normal | Started | Container started | 2026-10-31 00:07:27 | 2026-10-31 00:07:27 | d60dcb77863b-node-0.18e374921dad135e | - | Normal | Suspended | Job suspended | 2026-10-31 00:07:28 | 2026-10-31 00:07:28 | d60dcb77863b-node-0.18e37492747e7b0d | - | Normal | SuccessfulCreate | Created pod: d60dcb77863b-node-0-0-trwxc | 2026-10-31 00:07:29 | 2026-10-31 00:07:29 | d60dcb77863b-node-0.18e374927eb56b01 | - | Normal | SuccessfulCreate | Created pod: d60dcb77863b-node-0-1-v2zxz | 2026-10-31 00:07:29 | 2026-10-31 00:07:29 | d60dcb77863b-node-0.18e374927eb5d2c9 | - | Normal | Resumed | Job resumed | 2026-10-31 00:08:05 | 2026-10-31 00:08:05 | d60dcb77863b-node-0.18e3749affb89ddf | - | Normal | Completed | Job completed | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | d60dcb77863b.18e374921dd26baf | - | Normal | CreatedWorkload | Created Workload: test-ns-cjgqr/trainjob-d60dcb77863b-e902a | 2026-10-31 00:07:27 | 2026-10-31 00:07:27 | d60dcb77863b.18e3749225c09914 | - | Normal | SuspendedJobs | jobset is suspended | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | d60dcb77863b.18e374924f68aebc | - | Normal | Started | Admitted by clusterQueue cq-ttv4t | 2026-10-31 00:07:28 | 2026-10-31 00:07:28 | d60dcb77863b.18e37492662c43ff | - | Normal | ResumeJobs | jobset is resumed | 2026-10-31 00:08:05 | 2026-10-31 00:08:05 | d60dcb77863b.18e3749b04c987c5 | - | Normal | AllJobsCompleted | jobset completed successfully | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | d60dcb77863b.18e3749b20d4d8a1 | - | Normal | FinishedWorkload | Workload 'test-ns-cjgqr/trainjob-d60dcb77863b-e902a' is declared finished | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | dw-deployment-2sxqb-698d7dbcbf-9vkbl.18e3748ea37be4ab | - | Normal | CreatedWorkload | Created Workload: test-ns-cjgqr/pod-dw-deployment-2sxqb-698d7dbcbf-9vkbl-bf644 | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | dw-deployment-2sxqb-698d7dbcbf-9vkbl.18e3748eb3623a5b | - | Normal | Scheduled | Successfully assigned test-ns-cjgqr/dw-deployment-2sxqb-698d7dbcbf-9vkbl to ip-10-0-131-99.us-west-1.compute.internal | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | dw-deployment-2sxqb-698d7dbcbf-9vkbl.18e3748eb4758ed4 | - | Normal | Started | Admitted by clusterQueue cq-ttv4t | 2026-10-31 00:07:13 | 2026-10-31 00:07:13 | dw-deployment-2sxqb-698d7dbcbf-9vkbl.18e3748ee97917a4 | - | Normal | AddedInterface | Add eth0 [10.133.0.54/23] from ovn-kubernetes | 2026-10-31 00:07:13 | 2026-10-31 00:07:13 | dw-deployment-2sxqb-698d7dbcbf-9vkbl.18e3748ef090c741 | spec.containers{notebook} | Normal | Pulling | Pulling image "quay.io/opendatahub/odh-th-torch-cpu-py312@sha256:cc0bfe88c9b57676613b61869fdfdd854bcd404546646c941231f7f84421eeee" | 2026-10-31 00:07:14 | 2026-10-31 00:07:14 | dw-deployment-2sxqb-698d7dbcbf-9vkbl.18e3748f2339855e | spec.containers{notebook} | Normal | Pulled | Successfully pulled image "quay.io/opendatahub/odh-th-torch-cpu-py312@sha256:cc0bfe88c9b57676613b61869fdfdd854bcd404546646c941231f7f84421eeee" in 849ms (849ms including waiting). Image size: 7472783032 bytes. | 2026-10-31 00:07:14 | 2026-10-31 00:07:14 | dw-deployment-2sxqb-698d7dbcbf-9vkbl.18e3748f269ddd73 | spec.containers{notebook} | Normal | Created | Container created | 2026-10-31 00:07:14 | 2026-10-31 00:07:14 | dw-deployment-2sxqb-698d7dbcbf-9vkbl.18e3748f271ecdd4 | spec.containers{notebook} | Normal | Started | Container started | 2026-10-31 00:08:08 | 2026-10-31 00:08:08 | dw-deployment-2sxqb-698d7dbcbf-9vkbl.18e3749bb9531e25 | spec.containers{notebook} | Normal | Killing | Stopping container notebook | 2026-10-31 00:07:12 | 2026-10-31 00:07:12 | dw-deployment-2sxqb-698d7dbcbf.18e3748e84f976ab | - | Normal | SuccessfulCreate | Created pod: dw-deployment-2sxqb-698d7dbcbf-9vkbl | 2026-10-31 00:07:11 | 2026-10-31 00:07:11 | dw-deployment-2sxqb.18e3748e709d8667 | - | Normal | ScalingReplicaSet | Scaled up replica set dw-deployment-2sxqb-698d7dbcbf from 0 to 1 | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | pod-dw-deployment-2sxqb-698d7dbcbf-9vkbl-bf644.18e3748ead7f976c | - | Normal | QuotaReserved | Quota reserved in ClusterQueue cq-ttv4t, wait time since queued was 1s | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | pod-dw-deployment-2sxqb-698d7dbcbf-9vkbl-bf644.18e3748ead8021ef | - | Normal | Admitted | Admitted by ClusterQueue cq-ttv4t, wait time since reservation was 1s | 2026-10-31 00:07:11 | 2026-10-31 00:07:11 | pvc-p5xs6.18e3748e584fa0cd | - | Normal | ExternalProvisioning | Waiting for a volume to be created either by the external provisioner 'example.com/nfs' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. | 2026-10-31 00:07:11 | 2026-10-31 00:07:11 | pvc-p5xs6.18e3748e5cd9e45b | - | Normal | Provisioning | External provisioner is provisioning volume for claim "test-ns-cjgqr/pvc-p5xs6" | 2026-10-31 00:07:11 | 2026-10-31 00:07:11 | pvc-p5xs6.18e3748e665c7947 | - | Normal | ProvisioningSucceeded | Successfully provisioned volume pvc-6ad6c8ce-c859-4bbd-93f7-b33ca6a0e426 | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | trainjob-d60dcb77863b-e902a.18e37492249dfc12 | - | Normal | QuotaReserved | Quota reserved in ClusterQueue cq-ttv4t, wait time since queued was 1s | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | trainjob-d60dcb77863b-e902a.18e37492249e812a | - | Normal | Admitted | Admitted by ClusterQueue cq-ttv4t, wait time since reservation was 1s |