LAST_SEEN | FIRST_SEEN | NAME | SUBOBJECT | TYPE | REASON | MESSAGE | 2026-10-30 07:53:44 | 2026-10-30 07:53:44 | pvc-7t767.18e33f6f77872c42 | - | Normal | ExternalProvisioning | Waiting for a volume to be created either by the external provisioner 'example.com/nfs' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. | 2026-10-30 07:53:44 | 2026-10-30 07:53:44 | pvc-7t767.18e33f6f78f24f9c | - | Normal | Provisioning | External provisioner is provisioning volume for claim "test-ns-4hb9r/pvc-7t767" | 2026-10-30 07:53:44 | 2026-10-30 07:53:44 | pvc-7t767.18e33f6f7c503052 | - | Normal | ProvisioningSucceeded | Successfully provisioned volume pvc-427b8832-2e78-428c-b6c1-428c4927fab8 | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | test-fashion-mnist-trainjob-752kl-dataset-initializer-0-0-dh6l8.18e33f6fd71369e0 | - | Normal | Scheduled | Successfully assigned test-ns-4hb9r/test-fashion-mnist-trainjob-752kl-dataset-initializer-0-0-dh6l8 to ip-10-0-137-95.ec2.internal | 2026-10-30 07:53:46 | 2026-10-30 07:53:46 | test-fashion-mnist-trainjob-752kl-dataset-initializer-0-0-dh6l8.18e33f6ff95f90eb | - | Normal | AddedInterface | Add eth0 [10.132.0.43/23] from ovn-kubernetes | 2026-10-30 07:53:46 | 2026-10-30 07:53:46 | test-fashion-mnist-trainjob-752kl-dataset-initializer-0-0-dh6l8.18e33f6ffd2ee141 | spec.containers{dataset-initializer} | Normal | Pulled | Container image "quay.io/opendatahub/odh-th-torch-cpu-py312:odh-stable" already present on machine and can be accessed by the pod | 2026-10-30 07:53:46 | 2026-10-30 07:53:46 | test-fashion-mnist-trainjob-752kl-dataset-initializer-0-0-dh6l8.18e33f6fffd8eee8 | spec.containers{dataset-initializer} | Normal | Created | Container created | 2026-10-30 07:53:46 | 2026-10-30 07:53:46 | test-fashion-mnist-trainjob-752kl-dataset-initializer-0-0-dh6l8.18e33f70004c7239 | spec.containers{dataset-initializer} | Normal | Started | Container started | 2026-10-30 07:53:45 | 2026-10-30 07:53:45 | test-fashion-mnist-trainjob-752kl-dataset-initializer-0.18e33f6fab7876bb | - | Normal | Suspended | Job suspended | 2026-10-30 07:53:46 | 2026-10-30 07:53:46 | test-fashion-mnist-trainjob-752kl-dataset-initializer-0.18e33f6fd6a97df4 | - | Normal | SuccessfulCreate | Created pod: test-fashion-mnist-trainjob-752kl-dataset-initializer-0-0-dh6l8 | 2026-10-30 07:53:46 | 2026-10-30 07:53:46 | test-fashion-mnist-trainjob-752kl-dataset-initializer-0.18e33f6fd6a9ff5f | - | Normal | Resumed | Job resumed | 2026-10-30 07:54:08 | 2026-10-30 07:54:08 | test-fashion-mnist-trainjob-752kl-dataset-initializer-0.18e33f750b688740 | - | Normal | Completed | Job completed | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | test-fashion-mnist-trainjob-752kl-node-0-0-9vng2.18e33f75121471c2 | - | Normal | Scheduled | Successfully assigned test-ns-4hb9r/test-fashion-mnist-trainjob-752kl-node-0-0-9vng2 to ip-10-0-143-154.ec2.internal | 2026-10-30 07:54:09 | 2026-10-30 07:54:09 | test-fashion-mnist-trainjob-752kl-node-0-0-9vng2.18e33f7534a1860b | - | Normal | AddedInterface | Add eth0 [10.134.0.37/23] from ovn-kubernetes | 2026-10-30 07:54:09 | 2026-10-30 07:54:09 | test-fashion-mnist-trainjob-752kl-node-0-0-9vng2.18e33f753835acdb | spec.containers{node} | Normal | Pulled | Container image "quay.io/opendatahub/odh-th-torch-cpu-py312:odh-stable" already present on machine and can be accessed by the pod | 2026-10-30 07:54:09 | 2026-10-30 07:54:09 | test-fashion-mnist-trainjob-752kl-node-0-0-9vng2.18e33f753accabd3 | spec.containers{node} | Normal | Created | Container created | 2026-10-30 07:54:09 | 2026-10-30 07:54:09 | test-fashion-mnist-trainjob-752kl-node-0-0-9vng2.18e33f753b3fe115 | spec.containers{node} | Normal | Started | Container started | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | test-fashion-mnist-trainjob-752kl-node-0-1-z8bkt.18e33f751628679a | - | Normal | Scheduled | Successfully assigned test-ns-4hb9r/test-fashion-mnist-trainjob-752kl-node-0-1-z8bkt to ip-10-0-137-95.ec2.internal | 2026-10-30 07:54:09 | 2026-10-30 07:54:09 | test-fashion-mnist-trainjob-752kl-node-0-1-z8bkt.18e33f7538a83984 | - | Normal | AddedInterface | Add eth0 [10.132.0.44/23] from ovn-kubernetes | 2026-10-30 07:54:09 | 2026-10-30 07:54:09 | test-fashion-mnist-trainjob-752kl-node-0-1-z8bkt.18e33f753c7e3e10 | spec.containers{node} | Normal | Pulled | Container image "quay.io/opendatahub/odh-th-torch-cpu-py312:odh-stable" already present on machine and can be accessed by the pod | 2026-10-30 07:54:09 | 2026-10-30 07:54:09 | test-fashion-mnist-trainjob-752kl-node-0-1-z8bkt.18e33f753f49ef07 | spec.containers{node} | Normal | Created | Container created | 2026-10-30 07:54:09 | 2026-10-30 07:54:09 | test-fashion-mnist-trainjob-752kl-node-0-1-z8bkt.18e33f753fbd4ed4 | spec.containers{node} | Normal | Started | Container started | 2026-10-30 07:54:08 | 2026-10-30 07:54:08 | test-fashion-mnist-trainjob-752kl-node-0.18e33f75119ef8ad | - | Normal | SuccessfulCreate | Created pod: test-fashion-mnist-trainjob-752kl-node-0-0-9vng2 | 2026-10-30 07:54:08 | 2026-10-30 07:54:08 | test-fashion-mnist-trainjob-752kl-node-0.18e33f7515bd62ba | - | Normal | SuccessfulCreate | Created pod: test-fashion-mnist-trainjob-752kl-node-0-1-z8bkt | 2026-10-30 07:54:47 | 2026-10-30 07:54:47 | test-fashion-mnist-trainjob-752kl-node-0.18e33f7e2d71502b | - | Normal | Completed | Job completed | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | test-fashion-mnist-trainjob-752kl.18e33f6fa9aa8bc6 | - | Normal | CreatedWorkload | Created Workload: test-ns-4hb9r/trainjob-test-fashion-mnist-trainjob-752kl-fb3cd | 2026-10-30 07:53:45 | 2026-10-30 07:53:45 | test-fashion-mnist-trainjob-752kl.18e33f6fae757432 | - | Normal | SuspendedJobs | jobset is suspended | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | test-fashion-mnist-trainjob-752kl.18e33f6fc4e958b6 | - | Normal | Started | Admitted by clusterQueue cq-cxg6n | 2026-10-30 07:53:46 | 2026-10-30 07:53:46 | test-fashion-mnist-trainjob-752kl.18e33f6fcc811097 | - | Normal | ResumeJobs | jobset is resumed | 2026-10-30 07:54:47 | 2026-10-30 07:54:47 | test-fashion-mnist-trainjob-752kl.18e33f7e2fcc4355 | - | Normal | AllJobsCompleted | jobset completed successfully | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | test-fashion-mnist-trainjob-752kl.18e33f7e38b8a3d2 | - | Normal | FinishedWorkload | Workload 'test-ns-4hb9r/trainjob-test-fashion-mnist-trainjob-752kl-fb3cd' is declared finished | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | trainjob-test-fashion-mnist-trainjob-752kl-fb3cd.18e33f6facd52aa9 | - | Normal | QuotaReserved | Quota reserved in ClusterQueue cq-cxg6n, wait time since queued was 0s | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | trainjob-test-fashion-mnist-trainjob-752kl-fb3cd.18e33f6facd61765 | - | Normal | Admitted | Admitted by ClusterQueue cq-cxg6n, wait time since reservation was 0s |