LAST_SEEN | FIRST_SEEN | NAME | SUBOBJECT | TYPE | REASON | MESSAGE | 2026-11-03 07:11:28 | 2026-11-03 07:11:28 | pvc-gdmpt.18e4777341fb4d97 | - | Normal | ExternalProvisioning | Waiting for a volume to be created either by the external provisioner 'example.com/nfs' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. | 2026-11-03 07:11:28 | 2026-11-03 07:11:28 | pvc-gdmpt.18e47773435115b6 | - | Normal | Provisioning | External provisioner is provisioning volume for claim "test-ns-nd8kn/pvc-gdmpt" | 2026-11-03 07:11:28 | 2026-11-03 07:11:28 | pvc-gdmpt.18e4777347032c07 | - | Normal | ProvisioningSucceeded | Successfully provisioned volume pvc-f9b3e833-9384-4262-a4c6-ccc42b0d9a37 | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | test-fashion-mnist-trainjob-2wbrb-dataset-initializer-0-0-hd2jt.18e4777398192e8b | - | Normal | Scheduled | Successfully assigned test-ns-nd8kn/test-fashion-mnist-trainjob-2wbrb-dataset-initializer-0-0-hd2jt to ip-10-0-136-164.ec2.internal | 2026-11-03 07:11:30 | 2026-11-03 07:11:30 | test-fashion-mnist-trainjob-2wbrb-dataset-initializer-0-0-hd2jt.18e47773ba658ad0 | - | Normal | AddedInterface | Add eth0 [10.133.0.46/23] from ovn-kubernetes | 2026-11-03 07:11:30 | 2026-11-03 07:11:30 | test-fashion-mnist-trainjob-2wbrb-dataset-initializer-0-0-hd2jt.18e47773bf1d9a40 | spec.containers{dataset-initializer} | Normal | Pulled | Container image "quay.io/opendatahub/odh-th-torch-cpu-py312:odh-stable" already present on machine and can be accessed by the pod | 2026-11-03 07:11:30 | 2026-11-03 07:11:30 | test-fashion-mnist-trainjob-2wbrb-dataset-initializer-0-0-hd2jt.18e47773c1cb009a | spec.containers{dataset-initializer} | Normal | Created | Container created | 2026-11-03 07:11:30 | 2026-11-03 07:11:30 | test-fashion-mnist-trainjob-2wbrb-dataset-initializer-0-0-hd2jt.18e47773c28c5f5d | spec.containers{dataset-initializer} | Normal | Started | Container started | 2026-11-03 07:11:29 | 2026-11-03 07:11:29 | test-fashion-mnist-trainjob-2wbrb-dataset-initializer-0.18e47773730930a6 | - | Normal | Suspended | Job suspended | 2026-11-03 07:11:29 | 2026-11-03 07:11:29 | test-fashion-mnist-trainjob-2wbrb-dataset-initializer-0.18e4777397a5b499 | - | Normal | SuccessfulCreate | Created pod: test-fashion-mnist-trainjob-2wbrb-dataset-initializer-0-0-hd2jt | 2026-11-03 07:11:29 | 2026-11-03 07:11:29 | test-fashion-mnist-trainjob-2wbrb-dataset-initializer-0.18e4777397a6327f | - | Normal | Resumed | Job resumed | 2026-11-03 07:11:54 | 2026-11-03 07:11:54 | test-fashion-mnist-trainjob-2wbrb-dataset-initializer-0.18e4777969df1be7 | - | Normal | Completed | Job completed | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | test-fashion-mnist-trainjob-2wbrb-node-0-0-59wk7.18e4777970119308 | - | Normal | Scheduled | Successfully assigned test-ns-nd8kn/test-fashion-mnist-trainjob-2wbrb-node-0-0-59wk7 to ip-10-0-134-19.ec2.internal | 2026-11-03 07:11:55 | 2026-11-03 07:11:55 | test-fashion-mnist-trainjob-2wbrb-node-0-0-59wk7.18e47779929afdaa | - | Normal | AddedInterface | Add eth0 [10.132.0.44/23] from ovn-kubernetes | 2026-11-03 07:11:55 | 2026-11-03 07:11:55 | test-fashion-mnist-trainjob-2wbrb-node-0-0-59wk7.18e47779961b8044 | spec.containers{node} | Normal | Pulled | Container image "quay.io/opendatahub/odh-th-torch-cpu-py312:odh-stable" already present on machine and can be accessed by the pod | 2026-11-03 07:11:55 | 2026-11-03 07:11:55 | test-fashion-mnist-trainjob-2wbrb-node-0-0-59wk7.18e47779989e6b83 | spec.containers{node} | Normal | Created | Container created | 2026-11-03 07:11:55 | 2026-11-03 07:11:55 | test-fashion-mnist-trainjob-2wbrb-node-0-0-59wk7.18e477799914a39b | spec.containers{node} | Normal | Started | Container started | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | test-fashion-mnist-trainjob-2wbrb-node-0-1-rh86f.18e47779738378da | - | Normal | Scheduled | Successfully assigned test-ns-nd8kn/test-fashion-mnist-trainjob-2wbrb-node-0-1-rh86f to ip-10-0-136-164.ec2.internal | 2026-11-03 07:11:55 | 2026-11-03 07:11:55 | test-fashion-mnist-trainjob-2wbrb-node-0-1-rh86f.18e4777996072d46 | - | Normal | AddedInterface | Add eth0 [10.133.0.47/23] from ovn-kubernetes | 2026-11-03 07:11:55 | 2026-11-03 07:11:55 | test-fashion-mnist-trainjob-2wbrb-node-0-1-rh86f.18e4777999d89f2c | spec.containers{node} | Normal | Pulled | Container image "quay.io/opendatahub/odh-th-torch-cpu-py312:odh-stable" already present on machine and can be accessed by the pod | 2026-11-03 07:11:55 | 2026-11-03 07:11:55 | test-fashion-mnist-trainjob-2wbrb-node-0-1-rh86f.18e477799c9248fc | spec.containers{node} | Normal | Created | Container created | 2026-11-03 07:11:55 | 2026-11-03 07:11:55 | test-fashion-mnist-trainjob-2wbrb-node-0-1-rh86f.18e477799d08b757 | spec.containers{node} | Normal | Started | Container started | 2026-11-03 07:11:55 | 2026-11-03 07:11:55 | test-fashion-mnist-trainjob-2wbrb-node-0.18e477796f978bf3 | - | Normal | SuccessfulCreate | Created pod: test-fashion-mnist-trainjob-2wbrb-node-0-0-59wk7 | 2026-11-03 07:11:55 | 2026-11-03 07:11:55 | test-fashion-mnist-trainjob-2wbrb-node-0.18e47779731523e8 | - | Normal | SuccessfulCreate | Created pod: test-fashion-mnist-trainjob-2wbrb-node-0-1-rh86f | 2026-11-03 07:12:33 | 2026-11-03 07:12:33 | test-fashion-mnist-trainjob-2wbrb-node-0.18e4778269ab3c00 | - | Normal | Completed | Job completed | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | test-fashion-mnist-trainjob-2wbrb.18e477736f83dce8 | - | Normal | CreatedWorkload | Created Workload: test-ns-nd8kn/trainjob-test-fashion-mnist-trainjob-2wbrb-d7e59 | 2026-11-03 07:11:29 | 2026-11-03 07:11:29 | test-fashion-mnist-trainjob-2wbrb.18e4777375afb7dc | - | Normal | SuspendedJobs | jobset is suspended | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | test-fashion-mnist-trainjob-2wbrb.18e4777386b50285 | - | Normal | Started | Admitted by clusterQueue cq-m59nk | 2026-11-03 07:11:29 | 2026-11-03 07:11:29 | test-fashion-mnist-trainjob-2wbrb.18e477738dca33dc | - | Normal | ResumeJobs | jobset is resumed | 2026-11-03 07:12:33 | 2026-11-03 07:12:33 | test-fashion-mnist-trainjob-2wbrb.18e477826bd8f0eb | - | Normal | AllJobsCompleted | jobset completed successfully | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | test-fashion-mnist-trainjob-2wbrb.18e47782758e0295 | - | Normal | FinishedWorkload | Workload 'test-ns-nd8kn/trainjob-test-fashion-mnist-trainjob-2wbrb-d7e59' is declared finished | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | trainjob-test-fashion-mnist-trainjob-2wbrb-d7e59.18e477737273b438 | - | Normal | QuotaReserved | Quota reserved in ClusterQueue cq-m59nk, wait time since queued was 0s | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | trainjob-test-fashion-mnist-trainjob-2wbrb-d7e59.18e4777372745a35 | - | Normal | Admitted | Admitted by ClusterQueue cq-m59nk, wait time since reservation was 0s |