LAST_SEEN | FIRST_SEEN | NAME | SUBOBJECT | TYPE | REASON | MESSAGE | 2026-11-04 05:24:17 | 2026-11-04 05:24:17 | pvc-wdx96.18e4c02e8afb9c16 | - | Normal | ExternalProvisioning | Waiting for a volume to be created either by the external provisioner 'example.com/nfs' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. | 2026-11-04 05:24:17 | 2026-11-04 05:24:17 | pvc-wdx96.18e4c02e8b4b78c5 | - | Normal | Provisioning | External provisioner is provisioning volume for claim "test-ns-2pvr8/pvc-wdx96" | 2026-11-04 05:24:17 | 2026-11-04 05:24:17 | pvc-wdx96.18e4c02e8c9cbeeb | - | Normal | ProvisioningSucceeded | Successfully provisioned volume pvc-b319bc41-0e58-426d-ad48-ac81de499e12 | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | test-fashion-mnist-trainjob-l4czk-dataset-initializer-0-0-hv4tv.18e4c02ecde5ed25 | - | Normal | Scheduled | Successfully assigned test-ns-2pvr8/test-fashion-mnist-trainjob-l4czk-dataset-initializer-0-0-hv4tv to ip-10-0-131-72.us-east-2.compute.internal | 2026-11-04 05:24:19 | 2026-11-04 05:24:19 | test-fashion-mnist-trainjob-l4czk-dataset-initializer-0-0-hv4tv.18e4c02eefeafcc9 | - | Normal | AddedInterface | Add eth0 [10.132.0.60/23] from ovn-kubernetes | 2026-11-04 05:24:19 | 2026-11-04 05:24:19 | test-fashion-mnist-trainjob-l4czk-dataset-initializer-0-0-hv4tv.18e4c02ef1ad9d77 | spec.containers{dataset-initializer} | Normal | Pulled | Container image "quay.io/opendatahub/odh-th-torch-cpu-py312:odh-stable" already present on machine and can be accessed by the pod | 2026-11-04 05:24:19 | 2026-11-04 05:24:19 | test-fashion-mnist-trainjob-l4czk-dataset-initializer-0-0-hv4tv.18e4c02ef4c2e9fa | spec.containers{dataset-initializer} | Normal | Created | Container created | 2026-11-04 05:24:19 | 2026-11-04 05:24:19 | test-fashion-mnist-trainjob-l4czk-dataset-initializer-0-0-hv4tv.18e4c02ef52a4af6 | spec.containers{dataset-initializer} | Normal | Started | Container started | 2026-11-04 05:24:18 | 2026-11-04 05:24:18 | test-fashion-mnist-trainjob-l4czk-dataset-initializer-0.18e4c02ea9e6cb96 | - | Normal | Suspended | Job suspended | 2026-11-04 05:24:18 | 2026-11-04 05:24:18 | test-fashion-mnist-trainjob-l4czk-dataset-initializer-0.18e4c02ecd5eae2d | - | Normal | SuccessfulCreate | Created pod: test-fashion-mnist-trainjob-l4czk-dataset-initializer-0-0-hv4tv | 2026-11-04 05:24:18 | 2026-11-04 05:24:18 | test-fashion-mnist-trainjob-l4czk-dataset-initializer-0.18e4c02ecd5f2af4 | - | Normal | Resumed | Job resumed | 2026-11-04 05:24:42 | 2026-11-04 05:24:42 | test-fashion-mnist-trainjob-l4czk-dataset-initializer-0.18e4c0343d94c070 | - | Normal | Completed | Job completed | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | test-fashion-mnist-trainjob-l4czk-node-0-0-g4b2g.18e4c03441e71ef2 | - | Normal | Scheduled | Successfully assigned test-ns-2pvr8/test-fashion-mnist-trainjob-l4czk-node-0-0-g4b2g to ip-10-0-131-72.us-east-2.compute.internal | 2026-11-04 05:24:42 | 2026-11-04 05:24:42 | test-fashion-mnist-trainjob-l4czk-node-0-0-g4b2g.18e4c0346498d6c2 | - | Normal | AddedInterface | Add eth0 [10.132.0.61/23] from ovn-kubernetes | 2026-11-04 05:24:42 | 2026-11-04 05:24:42 | test-fashion-mnist-trainjob-l4czk-node-0-0-g4b2g.18e4c03466749ac8 | spec.containers{node} | Normal | Pulled | Container image "quay.io/opendatahub/odh-th-torch-cpu-py312:odh-stable" already present on machine and can be accessed by the pod | 2026-11-04 05:24:42 | 2026-11-04 05:24:42 | test-fashion-mnist-trainjob-l4czk-node-0-0-g4b2g.18e4c0346995b318 | spec.containers{node} | Normal | Created | Container created | 2026-11-04 05:24:42 | 2026-11-04 05:24:42 | test-fashion-mnist-trainjob-l4czk-node-0-0-g4b2g.18e4c0346a19f854 | spec.containers{node} | Normal | Started | Container started | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | test-fashion-mnist-trainjob-l4czk-node-0-1-k2xjd.18e4c034444e7abf | - | Normal | Scheduled | Successfully assigned test-ns-2pvr8/test-fashion-mnist-trainjob-l4czk-node-0-1-k2xjd to ip-10-0-133-67.us-east-2.compute.internal | 2026-11-04 05:24:42 | 2026-11-04 05:24:42 | test-fashion-mnist-trainjob-l4czk-node-0-1-k2xjd.18e4c03466e0cb55 | - | Normal | AddedInterface | Add eth0 [10.133.0.52/23] from ovn-kubernetes | 2026-11-04 05:24:42 | 2026-11-04 05:24:42 | test-fashion-mnist-trainjob-l4czk-node-0-1-k2xjd.18e4c03468b68d9b | spec.containers{node} | Normal | Pulled | Container image "quay.io/opendatahub/odh-th-torch-cpu-py312:odh-stable" already present on machine and can be accessed by the pod | 2026-11-04 05:24:42 | 2026-11-04 05:24:42 | test-fashion-mnist-trainjob-l4czk-node-0-1-k2xjd.18e4c0346b2e0ae2 | spec.containers{node} | Normal | Created | Container created | 2026-11-04 05:24:42 | 2026-11-04 05:24:42 | test-fashion-mnist-trainjob-l4czk-node-0-1-k2xjd.18e4c0346ba719b9 | spec.containers{node} | Normal | Started | Container started | 2026-11-04 05:24:42 | 2026-11-04 05:24:42 | test-fashion-mnist-trainjob-l4czk-node-0.18e4c034416231cb | - | Normal | SuccessfulCreate | Created pod: test-fashion-mnist-trainjob-l4czk-node-0-0-g4b2g | 2026-11-04 05:24:42 | 2026-11-04 05:24:42 | test-fashion-mnist-trainjob-l4czk-node-0.18e4c03443b187e0 | - | Normal | SuccessfulCreate | Created pod: test-fashion-mnist-trainjob-l4czk-node-0-1-k2xjd | 2026-11-04 05:25:27 | 2026-11-04 05:25:27 | test-fashion-mnist-trainjob-l4czk-node-0.18e4c03ec6d79834 | - | Normal | Completed | Job completed | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | test-fashion-mnist-trainjob-l4czk.18e4c02ea82c9380 | - | Normal | CreatedWorkload | Created Workload: test-ns-2pvr8/trainjob-test-fashion-mnist-trainjob-l4czk-34b6a | 2026-11-04 05:24:18 | 2026-11-04 05:24:18 | test-fashion-mnist-trainjob-l4czk.18e4c02eab2f49ae | - | Normal | SuspendedJobs | jobset is suspended | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | test-fashion-mnist-trainjob-l4czk.18e4c02eb71a19ae | - | Normal | Started | Admitted by clusterQueue cq-dxzgd | 2026-11-04 05:24:18 | 2026-11-04 05:24:18 | test-fashion-mnist-trainjob-l4czk.18e4c02ebbe7a7b2 | - | Normal | ResumeJobs | jobset is resumed | 2026-11-04 05:25:27 | 2026-11-04 05:25:27 | test-fashion-mnist-trainjob-l4czk.18e4c03ec80a957f | - | Normal | AllJobsCompleted | jobset completed successfully | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | test-fashion-mnist-trainjob-l4czk.18e4c03eccaa3d84 | - | Normal | FinishedWorkload | Workload 'test-ns-2pvr8/trainjob-test-fashion-mnist-trainjob-l4czk-34b6a' is declared finished | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | trainjob-test-fashion-mnist-trainjob-l4czk-34b6a.18e4c02eaa1c031f | - | Normal | QuotaReserved | Quota reserved in ClusterQueue cq-dxzgd, wait time since queued was 0s | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | trainjob-test-fashion-mnist-trainjob-l4czk-34b6a.18e4c02eaa1ce8a0 | - | Normal | Admitted | Admitted by ClusterQueue cq-dxzgd, wait time since reservation was 0s |