LAST_SEEN | FIRST_SEEN | NAME | SUBOBJECT | TYPE | REASON | MESSAGE | 2026-10-30 19:49:50 | 2026-10-30 19:49:50 | pvc-vxgwc.18e366832b6b2187 | - | Normal | ExternalProvisioning | Waiting for a volume to be created either by the external provisioner 'example.com/nfs' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. | 2026-10-30 19:49:50 | 2026-10-30 19:49:50 | pvc-vxgwc.18e366832ca86111 | - | Normal | Provisioning | External provisioner is provisioning volume for claim "test-ns-6z6tr/pvc-vxgwc" | 2026-10-30 19:49:50 | 2026-10-30 19:49:50 | pvc-vxgwc.18e36683303c4aa4 | - | Normal | ProvisioningSucceeded | Successfully provisioned volume pvc-3e78b0a1-d9fb-4b4a-9d8e-5e49c00d2929 | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | test-fashion-mnist-trainjob-n7bq5-dataset-initializer-0-0-8vkx6.18e366839020f5c0 | - | Normal | Scheduled | Successfully assigned test-ns-6z6tr/test-fashion-mnist-trainjob-n7bq5-dataset-initializer-0-0-8vkx6 to ip-10-0-139-153.ec2.internal | 2026-10-30 19:49:52 | 2026-10-30 19:49:52 | test-fashion-mnist-trainjob-n7bq5-dataset-initializer-0-0-8vkx6.18e36683b291389d | - | Normal | AddedInterface | Add eth0 [10.133.0.30/23] from ovn-kubernetes | 2026-10-30 19:49:52 | 2026-10-30 19:49:52 | test-fashion-mnist-trainjob-n7bq5-dataset-initializer-0-0-8vkx6.18e36683b5f14bda | spec.containers{dataset-initializer} | Normal | Pulled | Container image "quay.io/opendatahub/odh-th-torch-cpu-py312:odh-pr-d8eab1e44478edf743d16ef448a1f75ca1f49c92" already present on machine and can be accessed by the pod | 2026-10-30 19:49:52 | 2026-10-30 19:49:52 | test-fashion-mnist-trainjob-n7bq5-dataset-initializer-0-0-8vkx6.18e36683b8ac1973 | spec.containers{dataset-initializer} | Normal | Created | Container created | 2026-10-30 19:49:52 | 2026-10-30 19:49:52 | test-fashion-mnist-trainjob-n7bq5-dataset-initializer-0-0-8vkx6.18e36683b91b5bfc | spec.containers{dataset-initializer} | Normal | Started | Container started | 2026-10-30 19:49:51 | 2026-10-30 19:49:51 | test-fashion-mnist-trainjob-n7bq5-dataset-initializer-0.18e366835ef38728 | - | Normal | Suspended | Job suspended | 2026-10-30 19:49:51 | 2026-10-30 19:49:51 | test-fashion-mnist-trainjob-n7bq5-dataset-initializer-0.18e366838fe740f4 | - | Normal | SuccessfulCreate | Created pod: test-fashion-mnist-trainjob-n7bq5-dataset-initializer-0-0-8vkx6 | 2026-10-30 19:49:51 | 2026-10-30 19:49:51 | test-fashion-mnist-trainjob-n7bq5-dataset-initializer-0.18e366838fe799fd | - | Normal | Resumed | Job resumed | 2026-10-30 19:50:33 | 2026-10-30 19:50:33 | test-fashion-mnist-trainjob-n7bq5-dataset-initializer-0.18e3668d38fb5a9c | - | Normal | Completed | Job completed | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | test-fashion-mnist-trainjob-n7bq5-node-0-0-kctpm.18e3668d4089fdd0 | - | Normal | Scheduled | Successfully assigned test-ns-6z6tr/test-fashion-mnist-trainjob-n7bq5-node-0-0-kctpm to ip-10-0-143-51.ec2.internal | 2026-10-30 19:50:34 | 2026-10-30 19:50:34 | test-fashion-mnist-trainjob-n7bq5-node-0-0-kctpm.18e3668d62ffeb98 | - | Normal | AddedInterface | Add eth0 [10.134.0.38/23] from ovn-kubernetes | 2026-10-30 19:50:34 | 2026-10-30 19:50:34 | test-fashion-mnist-trainjob-n7bq5-node-0-0-kctpm.18e3668d66d91723 | spec.containers{node} | Normal | Pulled | Container image "quay.io/opendatahub/odh-th-torch-cpu-py312:odh-pr-d8eab1e44478edf743d16ef448a1f75ca1f49c92" already present on machine and can be accessed by the pod | 2026-10-30 19:50:34 | 2026-10-30 19:50:34 | test-fashion-mnist-trainjob-n7bq5-node-0-0-kctpm.18e3668d6a3e4293 | spec.containers{node} | Normal | Created | Container created | 2026-10-30 19:50:34 | 2026-10-30 19:50:34 | test-fashion-mnist-trainjob-n7bq5-node-0-0-kctpm.18e3668d6aa05df1 | spec.containers{node} | Normal | Started | Container started | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | test-fashion-mnist-trainjob-n7bq5-node-0-1-4mv2x.18e3668d4589aa2f | - | Normal | Scheduled | Successfully assigned test-ns-6z6tr/test-fashion-mnist-trainjob-n7bq5-node-0-1-4mv2x to ip-10-0-131-175.ec2.internal | 2026-10-30 19:50:34 | 2026-10-30 19:50:34 | test-fashion-mnist-trainjob-n7bq5-node-0-1-4mv2x.18e3668d7a570d1b | - | Normal | AddedInterface | Add eth0 [10.132.0.55/23] from ovn-kubernetes | 2026-10-30 19:50:34 | 2026-10-30 19:50:34 | test-fashion-mnist-trainjob-n7bq5-node-0-1-4mv2x.18e3668d7e52bd2d | spec.containers{node} | Normal | Pulled | Container image "quay.io/opendatahub/odh-th-torch-cpu-py312:odh-pr-d8eab1e44478edf743d16ef448a1f75ca1f49c92" already present on machine and can be accessed by the pod | 2026-10-30 19:50:34 | 2026-10-30 19:50:34 | test-fashion-mnist-trainjob-n7bq5-node-0-1-4mv2x.18e3668d817e10bf | spec.containers{node} | Normal | Created | Container created | 2026-10-30 19:50:34 | 2026-10-30 19:50:34 | test-fashion-mnist-trainjob-n7bq5-node-0-1-4mv2x.18e3668d81f6856e | spec.containers{node} | Normal | Started | Container started | 2026-10-30 19:50:33 | 2026-10-30 19:50:33 | test-fashion-mnist-trainjob-n7bq5-node-0.18e3668d3ffd77d6 | - | Normal | SuccessfulCreate | Created pod: test-fashion-mnist-trainjob-n7bq5-node-0-0-kctpm | 2026-10-30 19:50:33 | 2026-10-30 19:50:33 | test-fashion-mnist-trainjob-n7bq5-node-0.18e3668d44deabbf | - | Normal | SuccessfulCreate | Created pod: test-fashion-mnist-trainjob-n7bq5-node-0-1-4mv2x | 2026-10-30 19:51:12 | 2026-10-30 19:51:12 | test-fashion-mnist-trainjob-n7bq5-node-0.18e3669666e10e28 | - | Normal | Completed | Job completed | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | test-fashion-mnist-trainjob-n7bq5.18e366835c46ca56 | - | Normal | CreatedWorkload | Created Workload: test-ns-6z6tr/trainjob-test-fashion-mnist-trainjob-n7bq5-a4262 | 2026-10-30 19:49:51 | 2026-10-30 19:49:51 | test-fashion-mnist-trainjob-n7bq5.18e36683614d4eda | - | Normal | SuspendedJobs | jobset is suspended | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | test-fashion-mnist-trainjob-n7bq5.18e36683728d638f | - | Normal | Started | Admitted by clusterQueue cq-qsbtq | 2026-10-30 19:49:51 | 2026-10-30 19:49:51 | test-fashion-mnist-trainjob-n7bq5.18e3668379c9499b | - | Normal | ResumeJobs | jobset is resumed | 2026-10-30 19:51:12 | 2026-10-30 19:51:12 | test-fashion-mnist-trainjob-n7bq5.18e36696690b0127 | - | Normal | AllJobsCompleted | jobset completed successfully | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | test-fashion-mnist-trainjob-n7bq5.18e3669673cbd977 | - | Normal | FinishedWorkload | Workload 'test-ns-6z6tr/trainjob-test-fashion-mnist-trainjob-n7bq5-a4262' is declared finished | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | trainjob-test-fashion-mnist-trainjob-n7bq5-a4262.18e366835ee0412e | - | Normal | QuotaReserved | Quota reserved in ClusterQueue cq-qsbtq, wait time since queued was 1s | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | trainjob-test-fashion-mnist-trainjob-n7bq5-a4262.18e366835ee0d43e | - | Normal | Admitted | Admitted by ClusterQueue cq-qsbtq, wait time since reservation was 1s |