LAST_SEEN | FIRST_SEEN | NAME | SUBOBJECT | TYPE | REASON | MESSAGE | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | dw-deployment-flc5w-9596d6984-zb9cf.18e33cf74c26312c | - | Normal | CreatedWorkload | Created Workload: test-ns-bfvgm/pod-dw-deployment-flc5w-9596d6984-zb9cf-a612a | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | dw-deployment-flc5w-9596d6984-zb9cf.18e33cf75181dc14 | - | Normal | Started | Admitted by clusterQueue cq-4rnkk | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | dw-deployment-flc5w-9596d6984-zb9cf.18e33cf75188f1df | - | Normal | Scheduled | Successfully assigned test-ns-bfvgm/dw-deployment-flc5w-9596d6984-zb9cf to ip-10-0-137-1.ec2.internal | 2026-10-30 07:08:30 | 2026-10-30 07:08:30 | dw-deployment-flc5w-9596d6984-zb9cf.18e33cf773f69a2f | - | Normal | AddedInterface | Add eth0 [10.132.0.48/23] from ovn-kubernetes | 2026-10-30 07:08:30 | 2026-10-30 07:08:30 | dw-deployment-flc5w-9596d6984-zb9cf.18e33cf776ae8857 | spec.containers{notebook} | Normal | Pulling | Pulling image "quay.io/rhoai/odh-th-torch-cpu-py312-rhel9@sha256:8e3f9821cae060ad0c77776db829e93c999362caff3e1b0279c2ae386a59ba31" | 2026-10-30 07:08:30 | 2026-10-30 07:08:30 | dw-deployment-flc5w-9596d6984-zb9cf.18e33cf7859282f5 | spec.containers{notebook} | Normal | Pulled | Successfully pulled image "quay.io/rhoai/odh-th-torch-cpu-py312-rhel9@sha256:8e3f9821cae060ad0c77776db829e93c999362caff3e1b0279c2ae386a59ba31" in 249ms (249ms including waiting). Image size: 8468893571 bytes. | 2026-10-30 07:08:30 | 2026-10-30 07:08:30 | dw-deployment-flc5w-9596d6984-zb9cf.18e33cf7884e4c11 | spec.containers{notebook} | Normal | Created | Container created | 2026-10-30 07:08:30 | 2026-10-30 07:08:30 | dw-deployment-flc5w-9596d6984-zb9cf.18e33cf788b58989 | spec.containers{notebook} | Normal | Started | Container started | 2026-10-30 07:09:18 | 2026-10-30 07:09:18 | dw-deployment-flc5w-9596d6984-zb9cf.18e33d02a7df6fb1 | spec.containers{notebook} | Normal | Killing | Stopping container notebook | 2026-10-30 07:08:29 | 2026-10-30 07:08:29 | dw-deployment-flc5w-9596d6984.18e33cf73ca6cf81 | - | Normal | SuccessfulCreate | Created pod: dw-deployment-flc5w-9596d6984-zb9cf | 2026-10-30 07:08:29 | 2026-10-30 07:08:29 | dw-deployment-flc5w.18e33cf7345dad72 | - | Normal | ScalingReplicaSet | Scaled up replica set dw-deployment-flc5w-9596d6984 from 0 to 1 | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | n7fe88e97cd8-node-0-0-dbkjh.18e33cfa1a5ef5c1 | - | Normal | Scheduled | Successfully assigned test-ns-bfvgm/n7fe88e97cd8-node-0-0-dbkjh to ip-10-0-137-1.ec2.internal | 2026-10-30 07:08:42 | 2026-10-30 07:08:42 | n7fe88e97cd8-node-0-0-dbkjh.18e33cfa3d15b29e | - | Normal | AddedInterface | Add eth0 [10.132.0.49/23] from ovn-kubernetes | 2026-10-30 07:08:42 | 2026-10-30 07:08:42 | n7fe88e97cd8-node-0-0-dbkjh.18e33cfa40e2f41d | spec.containers{node} | Normal | Pulled | Container image "quay.io/rhoai/odh-th-torch-cpu-py312-rhel9@sha256:8e3f9821cae060ad0c77776db829e93c999362caff3e1b0279c2ae386a59ba31" already present on machine and can be accessed by the pod | 2026-10-30 07:08:42 | 2026-10-30 07:08:42 | n7fe88e97cd8-node-0-0-dbkjh.18e33cfa43b0710b | spec.containers{node} | Normal | Created | Container created | 2026-10-30 07:08:42 | 2026-10-30 07:08:42 | n7fe88e97cd8-node-0-0-dbkjh.18e33cfa4423fb8b | spec.containers{node} | Normal | Started | Container started | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | n7fe88e97cd8-node-0-1-9q4wk.18e33cfa1e59f47b | - | Normal | Scheduled | Successfully assigned test-ns-bfvgm/n7fe88e97cd8-node-0-1-9q4wk to ip-10-0-137-1.ec2.internal | 2026-10-30 07:08:42 | 2026-10-30 07:08:42 | n7fe88e97cd8-node-0-1-9q4wk.18e33cfa420cb3d8 | - | Normal | AddedInterface | Add eth0 [10.132.0.50/23] from ovn-kubernetes | 2026-10-30 07:08:42 | 2026-10-30 07:08:42 | n7fe88e97cd8-node-0-1-9q4wk.18e33cfa449fec25 | spec.containers{node} | Normal | Pulled | Container image "quay.io/rhoai/odh-th-torch-cpu-py312-rhel9@sha256:8e3f9821cae060ad0c77776db829e93c999362caff3e1b0279c2ae386a59ba31" already present on machine and can be accessed by the pod | 2026-10-30 07:08:42 | 2026-10-30 07:08:42 | n7fe88e97cd8-node-0-1-9q4wk.18e33cfa4879fc7c | spec.containers{node} | Normal | Created | Container created | 2026-10-30 07:08:42 | 2026-10-30 07:08:42 | n7fe88e97cd8-node-0-1-9q4wk.18e33cfa48f49e80 | spec.containers{node} | Normal | Started | Container started | 2026-10-30 07:08:40 | 2026-10-30 07:08:40 | n7fe88e97cd8-node-0.18e33cf9ee638573 | - | Normal | Suspended | Job suspended | 2026-10-30 07:08:41 | 2026-10-30 07:08:41 | n7fe88e97cd8-node-0.18e33cfa19f1918e | - | Normal | SuccessfulCreate | Created pod: n7fe88e97cd8-node-0-0-dbkjh | 2026-10-30 07:08:41 | 2026-10-30 07:08:41 | n7fe88e97cd8-node-0.18e33cfa1de2ed03 | - | Normal | SuccessfulCreate | Created pod: n7fe88e97cd8-node-0-1-9q4wk | 2026-10-30 07:08:41 | 2026-10-30 07:08:41 | n7fe88e97cd8-node-0.18e33cfa1de35090 | - | Normal | Resumed | Job resumed | 2026-10-30 07:09:15 | 2026-10-30 07:09:15 | n7fe88e97cd8-node-0.18e33d021cf65abe | - | Normal | Completed | Job completed | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | n7fe88e97cd8.18e33cf9ed91ff3f | - | Normal | CreatedWorkload | Created Workload: test-ns-bfvgm/trainjob-n7fe88e97cd8-63879 | 2026-10-30 07:08:40 | 2026-10-30 07:08:40 | n7fe88e97cd8.18e33cf9f0a6d4ba | - | Normal | SuspendedJobs | jobset is suspended | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | n7fe88e97cd8.18e33cfa03679cc4 | - | Normal | Started | Admitted by clusterQueue cq-4rnkk | 2026-10-30 07:08:41 | 2026-10-30 07:08:41 | n7fe88e97cd8.18e33cfa0bc7379a | - | Normal | ResumeJobs | jobset is resumed | 2026-10-30 07:09:15 | 2026-10-30 07:09:15 | n7fe88e97cd8.18e33d021e9f0906 | - | Normal | AllJobsCompleted | jobset completed successfully | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | n7fe88e97cd8.18e33d0226c72c67 | - | Normal | FinishedWorkload | Workload 'test-ns-bfvgm/trainjob-n7fe88e97cd8-63879' is declared finished | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | pod-dw-deployment-flc5w-9596d6984-zb9cf-a612a.18e33cf74ecad92b | - | Normal | QuotaReserved | Quota reserved in ClusterQueue cq-4rnkk, wait time since queued was 1s | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | pod-dw-deployment-flc5w-9596d6984-zb9cf-a612a.18e33cf74ecb670a | - | Normal | Admitted | Admitted by ClusterQueue cq-4rnkk, wait time since reservation was 1s | 2026-10-30 07:08:28 | 2026-10-30 07:08:28 | pvc-9jqb6.18e33cf728f72f19 | - | Normal | ExternalProvisioning | Waiting for a volume to be created either by the external provisioner 'example.com/nfs' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. | 2026-10-30 07:08:28 | 2026-10-30 07:08:28 | pvc-9jqb6.18e33cf72a8aa25c | - | Normal | Provisioning | External provisioner is provisioning volume for claim "test-ns-bfvgm/pvc-9jqb6" | 2026-10-30 07:08:28 | 2026-10-30 07:08:28 | pvc-9jqb6.18e33cf72e76ab0a | - | Normal | ProvisioningSucceeded | Successfully provisioned volume pvc-4ef736b2-86b5-494d-8584-4c026af9150e | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | trainjob-n7fe88e97cd8-63879.18e33cf9f03a3430 | - | Normal | QuotaReserved | Quota reserved in ClusterQueue cq-4rnkk, wait time since queued was 1s | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | trainjob-n7fe88e97cd8-63879.18e33cf9f03aa611 | - | Normal | Admitted | Admitted by ClusterQueue cq-4rnkk, wait time since reservation was 1s |