LAST_SEEN | FIRST_SEEN | NAME | SUBOBJECT | TYPE | REASON | MESSAGE | 2026-10-30 16:12:32 | 2026-10-30 16:12:32 | pvc-hj7lw.18e35aa7a37b5617 | - | Normal | ExternalProvisioning | Waiting for a volume to be created either by the external provisioner 'example.com/nfs' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. | 2026-10-30 16:12:32 | 2026-10-30 16:12:32 | pvc-hj7lw.18e35aa7a4d3ca67 | - | Normal | Provisioning | External provisioner is provisioning volume for claim "test-ns-v8xpj/pvc-hj7lw" | 2026-10-30 16:12:32 | 2026-10-30 16:12:32 | pvc-hj7lw.18e35aa7a7ff97b1 | - | Normal | ProvisioningSucceeded | Successfully provisioned volume pvc-f3e29dc2-e8e0-42f9-b237-fee51b1789e5 | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | test-fashion-mnist-trainjob-nlxc5-dataset-initializer-0-0-vz68s.18e35aa7ffd5dab9 | - | Normal | Scheduled | Successfully assigned test-ns-v8xpj/test-fashion-mnist-trainjob-nlxc5-dataset-initializer-0-0-vz68s to ip-10-0-143-31.ec2.internal | 2026-10-30 16:12:34 | 2026-10-30 16:12:34 | test-fashion-mnist-trainjob-nlxc5-dataset-initializer-0-0-vz68s.18e35aa8223d288d | - | Normal | AddedInterface | Add eth0 [10.133.0.59/23] from ovn-kubernetes | 2026-10-30 16:12:34 | 2026-10-30 16:12:34 | test-fashion-mnist-trainjob-nlxc5-dataset-initializer-0-0-vz68s.18e35aa825a7d675 | spec.containers{dataset-initializer} | Normal | Pulled | Container image "quay.io/opendatahub/odh-th-torch-cpu-py312:odh-pr-75617726bb2532633cadfd86f0c09b2a3168f163" already present on machine and can be accessed by the pod | 2026-10-30 16:12:34 | 2026-10-30 16:12:34 | test-fashion-mnist-trainjob-nlxc5-dataset-initializer-0-0-vz68s.18e35aa82929a51b | spec.containers{dataset-initializer} | Normal | Created | Container created | 2026-10-30 16:12:34 | 2026-10-30 16:12:34 | test-fashion-mnist-trainjob-nlxc5-dataset-initializer-0-0-vz68s.18e35aa8299c8b68 | spec.containers{dataset-initializer} | Normal | Started | Container started | 2026-10-30 16:12:33 | 2026-10-30 16:12:33 | test-fashion-mnist-trainjob-nlxc5-dataset-initializer-0.18e35aa7d8e70eac | - | Normal | Suspended | Job suspended | 2026-10-30 16:12:34 | 2026-10-30 16:12:34 | test-fashion-mnist-trainjob-nlxc5-dataset-initializer-0.18e35aa7ff2476ad | - | Normal | SuccessfulCreate | Created pod: test-fashion-mnist-trainjob-nlxc5-dataset-initializer-0-0-vz68s | 2026-10-30 16:12:34 | 2026-10-30 16:12:34 | test-fashion-mnist-trainjob-nlxc5-dataset-initializer-0.18e35aa7ff24d453 | - | Normal | Resumed | Job resumed | 2026-10-30 16:13:00 | 2026-10-30 16:13:00 | test-fashion-mnist-trainjob-nlxc5-dataset-initializer-0.18e35aae1d0d8054 | - | Normal | Completed | Job completed | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | test-fashion-mnist-trainjob-nlxc5-node-0-0-kftqs.18e35aae239a6cc5 | - | Normal | Scheduled | Successfully assigned test-ns-v8xpj/test-fashion-mnist-trainjob-nlxc5-node-0-0-kftqs to ip-10-0-143-31.ec2.internal | 2026-10-30 16:13:01 | 2026-10-30 16:13:01 | test-fashion-mnist-trainjob-nlxc5-node-0-0-kftqs.18e35aae5827a83a | - | Normal | AddedInterface | Add eth0 [10.133.0.60/23] from ovn-kubernetes | 2026-10-30 16:13:01 | 2026-10-30 16:13:01 | test-fashion-mnist-trainjob-nlxc5-node-0-0-kftqs.18e35aae5ba20ce4 | spec.containers{node} | Normal | Pulled | Container image "quay.io/opendatahub/odh-th-torch-cpu-py312:odh-pr-75617726bb2532633cadfd86f0c09b2a3168f163" already present on machine and can be accessed by the pod | 2026-10-30 16:13:01 | 2026-10-30 16:13:01 | test-fashion-mnist-trainjob-nlxc5-node-0-0-kftqs.18e35aae5f455474 | spec.containers{node} | Normal | Created | Container created | 2026-10-30 16:13:01 | 2026-10-30 16:13:01 | test-fashion-mnist-trainjob-nlxc5-node-0-0-kftqs.18e35aae5fcccdb2 | spec.containers{node} | Normal | Started | Container started | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | test-fashion-mnist-trainjob-nlxc5-node-0-1-xmr59.18e35aae27e4ff3c | - | Normal | Scheduled | Successfully assigned test-ns-v8xpj/test-fashion-mnist-trainjob-nlxc5-node-0-1-xmr59 to ip-10-0-135-74.ec2.internal | 2026-10-30 16:13:01 | 2026-10-30 16:13:01 | test-fashion-mnist-trainjob-nlxc5-node-0-1-xmr59.18e35aae6df26b3b | - | Normal | AddedInterface | Add eth0 [10.132.0.35/23] from ovn-kubernetes | 2026-10-30 16:13:01 | 2026-10-30 16:13:01 | test-fashion-mnist-trainjob-nlxc5-node-0-1-xmr59.18e35aae7170a340 | spec.containers{node} | Normal | Pulling | Pulling image "quay.io/opendatahub/odh-th-torch-cpu-py312:odh-pr-75617726bb2532633cadfd86f0c09b2a3168f163" | 2026-10-30 16:14:00 | 2026-10-30 16:14:00 | test-fashion-mnist-trainjob-nlxc5-node-0-1-xmr59.18e35abc1de67a7d | spec.containers{node} | Normal | Pulled | Successfully pulled image "quay.io/opendatahub/odh-th-torch-cpu-py312:odh-pr-75617726bb2532633cadfd86f0c09b2a3168f163" in 58.727s (58.727s including waiting). Image size: 7318449257 bytes. | 2026-10-30 16:14:00 | 2026-10-30 16:14:00 | test-fashion-mnist-trainjob-nlxc5-node-0-1-xmr59.18e35abc21d741c7 | spec.containers{node} | Normal | Created | Container created | 2026-10-30 16:14:00 | 2026-10-30 16:14:00 | test-fashion-mnist-trainjob-nlxc5-node-0-1-xmr59.18e35abc22fbf151 | spec.containers{node} | Normal | Started | Container started | 2026-10-30 16:13:00 | 2026-10-30 16:13:00 | test-fashion-mnist-trainjob-nlxc5-node-0.18e35aae230fd7a3 | - | Normal | SuccessfulCreate | Created pod: test-fashion-mnist-trainjob-nlxc5-node-0-0-kftqs | 2026-10-30 16:13:00 | 2026-10-30 16:13:00 | test-fashion-mnist-trainjob-nlxc5-node-0.18e35aae276f4b3c | - | Normal | SuccessfulCreate | Created pod: test-fashion-mnist-trainjob-nlxc5-node-0-1-xmr59 | 2026-10-30 16:14:45 | 2026-10-30 16:14:45 | test-fashion-mnist-trainjob-nlxc5-node-0.18e35ac6a6cb3a1a | - | Normal | Completed | Job completed | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | test-fashion-mnist-trainjob-nlxc5.18e35aa7d5a0e9e2 | - | Normal | CreatedWorkload | Created Workload: test-ns-v8xpj/trainjob-test-fashion-mnist-trainjob-nlxc5-f7a68 | 2026-10-30 16:12:33 | 2026-10-30 16:12:33 | test-fashion-mnist-trainjob-nlxc5.18e35aa7db224c12 | - | Normal | SuspendedJobs | jobset is suspended | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | test-fashion-mnist-trainjob-nlxc5.18e35aa7ee36dfe9 | - | Normal | Started | Admitted by clusterQueue cq-m2757 | 2026-10-30 16:12:34 | 2026-10-30 16:12:34 | test-fashion-mnist-trainjob-nlxc5.18e35aa7f53406bd | - | Normal | ResumeJobs | jobset is resumed | 2026-10-30 16:14:45 | 2026-10-30 16:14:45 | test-fashion-mnist-trainjob-nlxc5.18e35ac6a8ef86c2 | - | Normal | AllJobsCompleted | jobset completed successfully | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | test-fashion-mnist-trainjob-nlxc5.18e35ac6b3e20a08 | - | Normal | FinishedWorkload | Workload 'test-ns-v8xpj/trainjob-test-fashion-mnist-trainjob-nlxc5-f7a68' is declared finished | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | trainjob-test-fashion-mnist-trainjob-nlxc5-f7a68.18e35aa7d833ae88 | - | Normal | QuotaReserved | Quota reserved in ClusterQueue cq-m2757, wait time since queued was 1s | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | trainjob-test-fashion-mnist-trainjob-nlxc5-f7a68.18e35aa7d83475f5 | - | Normal | Admitted | Admitted by ClusterQueue cq-m2757, wait time since reservation was 1s |