LAST_SEEN | FIRST_SEEN | NAME | SUBOBJECT | TYPE | REASON | MESSAGE | 2026-11-03 21:24:17 | 2026-11-03 21:24:17 | pvc-9mh8c.18e4a5fd06008896 | - | Normal | ExternalProvisioning | Waiting for a volume to be created either by the external provisioner 'example.com/nfs' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. | 2026-11-03 21:24:17 | 2026-11-03 21:24:17 | pvc-9mh8c.18e4a5fd0aaeb313 | - | Normal | Provisioning | External provisioner is provisioning volume for claim "test-ns-bgp8v/pvc-9mh8c" | 2026-11-03 21:24:17 | 2026-11-03 21:24:17 | pvc-9mh8c.18e4a5fd14bb6035 | - | Normal | ProvisioningSucceeded | Successfully provisioned volume pvc-12dc9248-d7c4-4b2e-83ba-62508c328978 | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | test-fashion-mnist-trainjob-shpn9-dataset-initializer-0-0-v7jpt.18e4a5fe10a32d94 | - | Normal | Scheduled | Successfully assigned test-ns-bgp8v/test-fashion-mnist-trainjob-shpn9-dataset-initializer-0-0-v7jpt to ip-10-0-140-215.us-west-1.compute.internal | 2026-11-03 21:24:23 | 2026-11-03 21:24:23 | test-fashion-mnist-trainjob-shpn9-dataset-initializer-0-0-v7jpt.18e4a5fe45b6dcc4 | - | Normal | AddedInterface | Add eth0 [10.133.0.31/23] from ovn-kubernetes | 2026-11-03 21:24:23 | 2026-11-03 21:24:23 | test-fashion-mnist-trainjob-shpn9-dataset-initializer-0-0-v7jpt.18e4a5fe4fd244b8 | spec.containers{dataset-initializer} | Normal | Pulled | Container image "quay.io/opendatahub/odh-th-torch-cpu-py312:odh-stable" already present on machine and can be accessed by the pod | 2026-11-03 21:24:23 | 2026-11-03 21:24:23 | test-fashion-mnist-trainjob-shpn9-dataset-initializer-0-0-v7jpt.18e4a5fe5269ed59 | spec.containers{dataset-initializer} | Normal | Created | Container created | 2026-11-03 21:24:23 | 2026-11-03 21:24:23 | test-fashion-mnist-trainjob-shpn9-dataset-initializer-0-0-v7jpt.18e4a5fe52d36f21 | spec.containers{dataset-initializer} | Normal | Started | Container started | 2026-11-03 21:24:19 | 2026-11-03 21:24:19 | test-fashion-mnist-trainjob-shpn9-dataset-initializer-0.18e4a5fd8979ea6f | - | Normal | Suspended | Job suspended | 2026-11-03 21:24:22 | 2026-11-03 21:24:22 | test-fashion-mnist-trainjob-shpn9-dataset-initializer-0.18e4a5fe1026d80c | - | Normal | SuccessfulCreate | Created pod: test-fashion-mnist-trainjob-shpn9-dataset-initializer-0-0-v7jpt | 2026-11-03 21:24:22 | 2026-11-03 21:24:22 | test-fashion-mnist-trainjob-shpn9-dataset-initializer-0.18e4a5fe10272610 | - | Normal | Resumed | Job resumed | 2026-11-03 21:24:50 | 2026-11-03 21:24:50 | test-fashion-mnist-trainjob-shpn9-dataset-initializer-0.18e4a604affff7c7 | - | Normal | Completed | Job completed | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | test-fashion-mnist-trainjob-shpn9-node-0-0-tnlmx.18e4a604c2845a3d | - | Normal | Scheduled | Successfully assigned test-ns-bgp8v/test-fashion-mnist-trainjob-shpn9-node-0-0-tnlmx to ip-10-0-140-181.us-west-1.compute.internal | 2026-11-03 21:24:51 | 2026-11-03 21:24:51 | test-fashion-mnist-trainjob-shpn9-node-0-0-tnlmx.18e4a604f83ab053 | - | Normal | AddedInterface | Add eth0 [10.134.0.69/23] from ovn-kubernetes | 2026-11-03 21:24:52 | 2026-11-03 21:24:52 | test-fashion-mnist-trainjob-shpn9-node-0-0-tnlmx.18e4a605026fb45a | spec.containers{node} | Normal | Pulled | Container image "quay.io/opendatahub/odh-th-torch-cpu-py312:odh-stable" already present on machine and can be accessed by the pod | 2026-11-03 21:24:52 | 2026-11-03 21:24:52 | test-fashion-mnist-trainjob-shpn9-node-0-0-tnlmx.18e4a60505296b90 | spec.containers{node} | Normal | Created | Container created | 2026-11-03 21:24:52 | 2026-11-03 21:24:52 | test-fashion-mnist-trainjob-shpn9-node-0-0-tnlmx.18e4a60505a6727e | spec.containers{node} | Normal | Started | Container started | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | test-fashion-mnist-trainjob-shpn9-node-0-1-dcghp.18e4a604cd03e161 | - | Normal | Scheduled | Successfully assigned test-ns-bgp8v/test-fashion-mnist-trainjob-shpn9-node-0-1-dcghp to ip-10-0-140-215.us-west-1.compute.internal | 2026-11-03 21:24:52 | 2026-11-03 21:24:52 | test-fashion-mnist-trainjob-shpn9-node-0-1-dcghp.18e4a6050218a4ae | - | Normal | AddedInterface | Add eth0 [10.133.0.32/23] from ovn-kubernetes | 2026-11-03 21:24:52 | 2026-11-03 21:24:52 | test-fashion-mnist-trainjob-shpn9-node-0-1-dcghp.18e4a6050c427855 | spec.containers{node} | Normal | Pulled | Container image "quay.io/opendatahub/odh-th-torch-cpu-py312:odh-stable" already present on machine and can be accessed by the pod | 2026-11-03 21:24:52 | 2026-11-03 21:24:52 | test-fashion-mnist-trainjob-shpn9-node-0-1-dcghp.18e4a6050f3894f8 | spec.containers{node} | Normal | Created | Container created | 2026-11-03 21:24:52 | 2026-11-03 21:24:52 | test-fashion-mnist-trainjob-shpn9-node-0-1-dcghp.18e4a6050f9c8df9 | spec.containers{node} | Normal | Started | Container started | 2026-11-03 21:24:50 | 2026-11-03 21:24:50 | test-fashion-mnist-trainjob-shpn9-node-0.18e4a604c21a9c79 | - | Normal | SuccessfulCreate | Created pod: test-fashion-mnist-trainjob-shpn9-node-0-0-tnlmx | 2026-11-03 21:24:51 | 2026-11-03 21:24:51 | test-fashion-mnist-trainjob-shpn9-node-0.18e4a604cc9353e8 | - | Normal | SuccessfulCreate | Created pod: test-fashion-mnist-trainjob-shpn9-node-0-1-dcghp | 2026-11-03 21:25:37 | 2026-11-03 21:25:37 | test-fashion-mnist-trainjob-shpn9-node-0.18e4a60fa8c6b8e9 | - | Normal | Completed | Job completed | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | test-fashion-mnist-trainjob-shpn9.18e4a5fd82557a05 | - | Normal | CreatedWorkload | Created Workload: test-ns-bgp8v/trainjob-test-fashion-mnist-trainjob-shpn9-3782b | 2026-11-03 21:24:20 | 2026-11-03 21:24:20 | test-fashion-mnist-trainjob-shpn9.18e4a5fd91e5880c | - | Normal | SuspendedJobs | jobset is suspended | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | test-fashion-mnist-trainjob-shpn9.18e4a5fdd2c8b216 | - | Normal | Started | Admitted by clusterQueue cq-w25nd | 2026-11-03 21:24:21 | 2026-11-03 21:24:21 | test-fashion-mnist-trainjob-shpn9.18e4a5fde2cac573 | - | Normal | ResumeJobs | jobset is resumed | 2026-11-03 21:25:37 | 2026-11-03 21:25:37 | test-fashion-mnist-trainjob-shpn9.18e4a60fb08a20b6 | - | Normal | AllJobsCompleted | jobset completed successfully | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | test-fashion-mnist-trainjob-shpn9.18e4a60fce041fd7 | - | Normal | FinishedWorkload | Workload 'test-ns-bgp8v/trainjob-test-fashion-mnist-trainjob-shpn9-3782b' is declared finished | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | trainjob-test-fashion-mnist-trainjob-shpn9-3782b.18e4a5fd8a05033b | - | Normal | QuotaReserved | Quota reserved in ClusterQueue cq-w25nd, wait time since queued was 1s | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | trainjob-test-fashion-mnist-trainjob-shpn9-3782b.18e4a5fd8a05923e | - | Normal | Admitted | Admitted by ClusterQueue cq-w25nd, wait time since reservation was 1s |