LAST_SEEN | FIRST_SEEN | NAME | SUBOBJECT | TYPE | REASON | MESSAGE | 2026-10-30 21:24:23 | 2026-10-30 21:24:23 | pvc-rtmtx.18e36bac271b9ebc | - | Normal | ExternalProvisioning | Waiting for a volume to be created either by the external provisioner 'example.com/nfs' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. | 2026-10-30 21:24:23 | 2026-10-30 21:24:23 | pvc-rtmtx.18e36bac276bedc7 | - | Normal | Provisioning | External provisioner is provisioning volume for claim "test-ns-vjkv2/pvc-rtmtx" | 2026-10-30 21:24:23 | 2026-10-30 21:24:23 | pvc-rtmtx.18e36bac28b88a48 | - | Normal | ProvisioningSucceeded | Successfully provisioned volume pvc-f3aab072-9e4c-42aa-8dc5-0803e0b01a0b | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | test-fashion-mnist-trainjob-rpm27-dataset-initializer-0-0-8p828.18e36bac623a63e9 | - | Normal | Scheduled | Successfully assigned test-ns-vjkv2/test-fashion-mnist-trainjob-rpm27-dataset-initializer-0-0-8p828 to ip-10-0-140-145.us-east-2.compute.internal | 2026-10-30 21:24:25 | 2026-10-30 21:24:25 | test-fashion-mnist-trainjob-rpm27-dataset-initializer-0-0-8p828.18e36bac8522c031 | - | Normal | AddedInterface | Add eth0 [10.132.0.65/23] from ovn-kubernetes | 2026-10-30 21:24:25 | 2026-10-30 21:24:25 | test-fashion-mnist-trainjob-rpm27-dataset-initializer-0-0-8p828.18e36bac86b3e591 | spec.containers{dataset-initializer} | Normal | Pulled | Container image "quay.io/opendatahub/odh-th-torch-cpu-py312@sha256:91b542b2c091b29f41bd497e90faf92a981096b34b6d573e01122ac07e2689ae" already present on machine and can be accessed by the pod | 2026-10-30 21:24:25 | 2026-10-30 21:24:25 | test-fashion-mnist-trainjob-rpm27-dataset-initializer-0-0-8p828.18e36bac898113b0 | spec.containers{dataset-initializer} | Normal | Created | Container created | 2026-10-30 21:24:25 | 2026-10-30 21:24:25 | test-fashion-mnist-trainjob-rpm27-dataset-initializer-0-0-8p828.18e36bac8a07e270 | spec.containers{dataset-initializer} | Normal | Started | Container started | 2026-10-30 21:24:24 | 2026-10-30 21:24:24 | test-fashion-mnist-trainjob-rpm27-dataset-initializer-0.18e36bac4122cfef | - | Normal | Suspended | Job suspended | 2026-10-30 21:24:24 | 2026-10-30 21:24:24 | test-fashion-mnist-trainjob-rpm27-dataset-initializer-0.18e36bac5fc1ee94 | - | Normal | SuccessfulCreate | Created pod: test-fashion-mnist-trainjob-rpm27-dataset-initializer-0-0-8p828 | 2026-10-30 21:24:24 | 2026-10-30 21:24:24 | test-fashion-mnist-trainjob-rpm27-dataset-initializer-0.18e36bac5fc2525b | - | Normal | Resumed | Job resumed | 2026-10-30 21:24:49 | 2026-10-30 21:24:49 | test-fashion-mnist-trainjob-rpm27-dataset-initializer-0.18e36bb22ce02456 | - | Normal | Completed | Job completed | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | test-fashion-mnist-trainjob-rpm27-node-0-0-j8nch.18e36bb2306a6512 | - | Normal | Scheduled | Successfully assigned test-ns-vjkv2/test-fashion-mnist-trainjob-rpm27-node-0-0-j8nch to ip-10-0-140-145.us-east-2.compute.internal | 2026-10-30 21:24:50 | 2026-10-30 21:24:50 | test-fashion-mnist-trainjob-rpm27-node-0-0-j8nch.18e36bb252ed648a | - | Normal | AddedInterface | Add eth0 [10.132.0.66/23] from ovn-kubernetes | 2026-10-30 21:24:50 | 2026-10-30 21:24:50 | test-fashion-mnist-trainjob-rpm27-node-0-0-j8nch.18e36bb254716541 | spec.containers{node} | Normal | Pulled | Container image "quay.io/opendatahub/odh-th-torch-cpu-py312@sha256:91b542b2c091b29f41bd497e90faf92a981096b34b6d573e01122ac07e2689ae" already present on machine and can be accessed by the pod | 2026-10-30 21:24:50 | 2026-10-30 21:24:50 | test-fashion-mnist-trainjob-rpm27-node-0-0-j8nch.18e36bb2572c1b64 | spec.containers{node} | Normal | Created | Container created | 2026-10-30 21:24:50 | 2026-10-30 21:24:50 | test-fashion-mnist-trainjob-rpm27-node-0-0-j8nch.18e36bb257a5efbc | spec.containers{node} | Normal | Started | Container started | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | test-fashion-mnist-trainjob-rpm27-node-0-1-8grn8.18e36bb2326c095a | - | Normal | Scheduled | Successfully assigned test-ns-vjkv2/test-fashion-mnist-trainjob-rpm27-node-0-1-8grn8 to ip-10-0-135-81.us-east-2.compute.internal | 2026-10-30 21:24:50 | 2026-10-30 21:24:50 | test-fashion-mnist-trainjob-rpm27-node-0-1-8grn8.18e36bb25496f71a | - | Normal | AddedInterface | Add eth0 [10.133.0.32/23] from ovn-kubernetes | 2026-10-30 21:24:50 | 2026-10-30 21:24:50 | test-fashion-mnist-trainjob-rpm27-node-0-1-8grn8.18e36bb2562e2cd4 | spec.containers{node} | Normal | Pulled | Container image "quay.io/opendatahub/odh-th-torch-cpu-py312@sha256:91b542b2c091b29f41bd497e90faf92a981096b34b6d573e01122ac07e2689ae" already present on machine and can be accessed by the pod | 2026-10-30 21:24:50 | 2026-10-30 21:24:50 | test-fashion-mnist-trainjob-rpm27-node-0-1-8grn8.18e36bb25908a3d3 | spec.containers{node} | Normal | Created | Container created | 2026-10-30 21:24:50 | 2026-10-30 21:24:50 | test-fashion-mnist-trainjob-rpm27-node-0-1-8grn8.18e36bb259839997 | spec.containers{node} | Normal | Started | Container started | 2026-10-30 21:24:49 | 2026-10-30 21:24:49 | test-fashion-mnist-trainjob-rpm27-node-0.18e36bb22fe0bbe2 | - | Normal | SuccessfulCreate | Created pod: test-fashion-mnist-trainjob-rpm27-node-0-0-j8nch | 2026-10-30 21:24:49 | 2026-10-30 21:24:49 | test-fashion-mnist-trainjob-rpm27-node-0.18e36bb231b12dc7 | - | Normal | SuccessfulCreate | Created pod: test-fashion-mnist-trainjob-rpm27-node-0-1-8grn8 | 2026-10-30 21:25:28 | 2026-10-30 21:25:28 | test-fashion-mnist-trainjob-rpm27-node-0.18e36bbb49f2e20d | - | Normal | Completed | Job completed | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | test-fashion-mnist-trainjob-rpm27.18e36bac3f902fdc | - | Normal | CreatedWorkload | Created Workload: test-ns-vjkv2/trainjob-test-fashion-mnist-trainjob-rpm27-1aea3 | 2026-10-30 21:24:24 | 2026-10-30 21:24:24 | test-fashion-mnist-trainjob-rpm27.18e36bac42202661 | - | Normal | SuspendedJobs | jobset is suspended | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | test-fashion-mnist-trainjob-rpm27.18e36bac4a361e2a | - | Normal | Started | Admitted by clusterQueue cq-hpzmq | 2026-10-30 21:24:24 | 2026-10-30 21:24:24 | test-fashion-mnist-trainjob-rpm27.18e36bac4da556d0 | - | Normal | ResumeJobs | jobset is resumed | 2026-10-30 21:25:28 | 2026-10-30 21:25:28 | test-fashion-mnist-trainjob-rpm27.18e36bbb4af8162d | - | Normal | AllJobsCompleted | jobset completed successfully | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | test-fashion-mnist-trainjob-rpm27.18e36bbb4e9f3c32 | - | Normal | FinishedWorkload | Workload 'test-ns-vjkv2/trainjob-test-fashion-mnist-trainjob-rpm27-1aea3' is declared finished | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | trainjob-test-fashion-mnist-trainjob-rpm27-1aea3.18e36bac411097f7 | - | Normal | QuotaReserved | Quota reserved in ClusterQueue cq-hpzmq, wait time since queued was 0s | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | trainjob-test-fashion-mnist-trainjob-rpm27-1aea3.18e36bac411116b5 | - | Normal | Admitted | Admitted by ClusterQueue cq-hpzmq, wait time since reservation was 0s |