LAST_SEEN | FIRST_SEEN | NAME | SUBOBJECT | TYPE | REASON | MESSAGE | 2026-10-30 11:51:38 | 2026-10-30 11:51:38 | pvc-z4mxt.18e34c6aeda3d1a2 | - | Normal | ExternalProvisioning | Waiting for a volume to be created either by the external provisioner 'example.com/nfs' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. | 2026-10-30 11:51:38 | 2026-10-30 11:51:38 | pvc-z4mxt.18e34c6aeef526ab | - | Normal | Provisioning | External provisioner is provisioning volume for claim "test-ns-s4smk/pvc-z4mxt" | 2026-10-30 11:51:38 | 2026-10-30 11:51:38 | pvc-z4mxt.18e34c6af228bff0 | - | Normal | ProvisioningSucceeded | Successfully provisioned volume pvc-fb62470a-62e2-402e-b341-e113efe4a44b | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | test-fashion-mnist-trainjob-mfhd5-dataset-initializer-0-0-7z6lh.18e34c6b3b875aa7 | - | Normal | Scheduled | Successfully assigned test-ns-s4smk/test-fashion-mnist-trainjob-mfhd5-dataset-initializer-0-0-7z6lh to ip-10-0-133-0.ec2.internal | 2026-10-30 11:51:40 | 2026-10-30 11:51:40 | test-fashion-mnist-trainjob-mfhd5-dataset-initializer-0-0-7z6lh.18e34c6b5dd3ae8d | - | Normal | AddedInterface | Add eth0 [10.132.0.65/23] from ovn-kubernetes | 2026-10-30 11:51:40 | 2026-10-30 11:51:40 | test-fashion-mnist-trainjob-mfhd5-dataset-initializer-0-0-7z6lh.18e34c6b6136753a | spec.containers{dataset-initializer} | Normal | Pulled | Container image "quay.io/opendatahub/odh-th-torch-cpu-py312:odh-pr-aadbb1f7aa4c719b22de3a1fb7c866c7a536ec59" already present on machine and can be accessed by the pod | 2026-10-30 11:51:40 | 2026-10-30 11:51:40 | test-fashion-mnist-trainjob-mfhd5-dataset-initializer-0-0-7z6lh.18e34c6b6410804c | spec.containers{dataset-initializer} | Normal | Created | Container created | 2026-10-30 11:51:40 | 2026-10-30 11:51:40 | test-fashion-mnist-trainjob-mfhd5-dataset-initializer-0-0-7z6lh.18e34c6b64767370 | spec.containers{dataset-initializer} | Normal | Started | Container started | 2026-10-30 11:51:39 | 2026-10-30 11:51:39 | test-fashion-mnist-trainjob-mfhd5-dataset-initializer-0.18e34c6b191a0431 | - | Normal | Suspended | Job suspended | 2026-10-30 11:51:40 | 2026-10-30 11:51:40 | test-fashion-mnist-trainjob-mfhd5-dataset-initializer-0.18e34c6b3b1a7752 | - | Normal | SuccessfulCreate | Created pod: test-fashion-mnist-trainjob-mfhd5-dataset-initializer-0-0-7z6lh | 2026-10-30 11:51:40 | 2026-10-30 11:51:40 | test-fashion-mnist-trainjob-mfhd5-dataset-initializer-0.18e34c6b3b1ace2a | - | Normal | Resumed | Job resumed | 2026-10-30 11:52:01 | 2026-10-30 11:52:01 | test-fashion-mnist-trainjob-mfhd5-dataset-initializer-0.18e34c702a2b4670 | - | Normal | Completed | Job completed | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | test-fashion-mnist-trainjob-mfhd5-node-0-0-6hpz4.18e34c7030cd4675 | - | Normal | Scheduled | Successfully assigned test-ns-s4smk/test-fashion-mnist-trainjob-mfhd5-node-0-0-6hpz4 to ip-10-0-133-0.ec2.internal | 2026-10-30 11:52:01 | 2026-10-30 11:52:01 | test-fashion-mnist-trainjob-mfhd5-node-0-0-6hpz4.18e34c70534a50ea | - | Normal | AddedInterface | Add eth0 [10.132.0.66/23] from ovn-kubernetes | 2026-10-30 11:52:02 | 2026-10-30 11:52:02 | test-fashion-mnist-trainjob-mfhd5-node-0-0-6hpz4.18e34c7056e159d8 | spec.containers{node} | Normal | Pulled | Container image "quay.io/opendatahub/odh-th-torch-cpu-py312:odh-pr-aadbb1f7aa4c719b22de3a1fb7c866c7a536ec59" already present on machine and can be accessed by the pod | 2026-10-30 11:52:02 | 2026-10-30 11:52:02 | test-fashion-mnist-trainjob-mfhd5-node-0-0-6hpz4.18e34c70594dc515 | spec.containers{node} | Normal | Created | Container created | 2026-10-30 11:52:02 | 2026-10-30 11:52:02 | test-fashion-mnist-trainjob-mfhd5-node-0-0-6hpz4.18e34c7059bef87c | spec.containers{node} | Normal | Started | Container started | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | test-fashion-mnist-trainjob-mfhd5-node-0-1-bg8d2.18e34c7034d3971e | - | Normal | Scheduled | Successfully assigned test-ns-s4smk/test-fashion-mnist-trainjob-mfhd5-node-0-1-bg8d2 to ip-10-0-143-42.ec2.internal | 2026-10-30 11:52:02 | 2026-10-30 11:52:02 | test-fashion-mnist-trainjob-mfhd5-node-0-1-bg8d2.18e34c707b06796e | - | Normal | AddedInterface | Add eth0 [10.133.0.29/23] from ovn-kubernetes | 2026-10-30 11:52:02 | 2026-10-30 11:52:02 | test-fashion-mnist-trainjob-mfhd5-node-0-1-bg8d2.18e34c707e8051fb | spec.containers{node} | Normal | Pulling | Pulling image "quay.io/opendatahub/odh-th-torch-cpu-py312:odh-pr-aadbb1f7aa4c719b22de3a1fb7c866c7a536ec59" | 2026-10-30 11:52:58 | 2026-10-30 11:52:58 | test-fashion-mnist-trainjob-mfhd5-node-0-1-bg8d2.18e34c7d6c89c511 | spec.containers{node} | Normal | Pulled | Successfully pulled image "quay.io/opendatahub/odh-th-torch-cpu-py312:odh-pr-aadbb1f7aa4c719b22de3a1fb7c866c7a536ec59" in 55.533s (55.533s including waiting). Image size: 7318449267 bytes. | 2026-10-30 11:52:58 | 2026-10-30 11:52:58 | test-fashion-mnist-trainjob-mfhd5-node-0-1-bg8d2.18e34c7d70a1811d | spec.containers{node} | Normal | Created | Container created | 2026-10-30 11:52:58 | 2026-10-30 11:52:58 | test-fashion-mnist-trainjob-mfhd5-node-0-1-bg8d2.18e34c7d71b7cb91 | spec.containers{node} | Normal | Started | Container started | 2026-10-30 11:52:01 | 2026-10-30 11:52:01 | test-fashion-mnist-trainjob-mfhd5-node-0.18e34c703050cb41 | - | Normal | SuccessfulCreate | Created pod: test-fashion-mnist-trainjob-mfhd5-node-0-0-6hpz4 | 2026-10-30 11:52:01 | 2026-10-30 11:52:01 | test-fashion-mnist-trainjob-mfhd5-node-0.18e34c7034541955 | - | Normal | SuccessfulCreate | Created pod: test-fashion-mnist-trainjob-mfhd5-node-0-1-bg8d2 | 2026-10-30 11:53:36 | 2026-10-30 11:53:36 | test-fashion-mnist-trainjob-mfhd5-node-0.18e34c8663f8ba06 | - | Normal | Completed | Job completed | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | test-fashion-mnist-trainjob-mfhd5.18e34c6b16ff675b | - | Normal | CreatedWorkload | Created Workload: test-ns-s4smk/trainjob-test-fashion-mnist-trainjob-mfhd5-89e54 | 2026-10-30 11:51:39 | 2026-10-30 11:51:39 | test-fashion-mnist-trainjob-mfhd5.18e34c6b1b930319 | - | Normal | SuspendedJobs | jobset is suspended | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | test-fashion-mnist-trainjob-mfhd5.18e34c6b2aa7bf8e | - | Normal | Started | Admitted by clusterQueue cq-6sp2p | 2026-10-30 11:51:39 | 2026-10-30 11:51:39 | test-fashion-mnist-trainjob-mfhd5.18e34c6b3112bb0f | - | Normal | ResumeJobs | jobset is resumed | 2026-10-30 11:53:36 | 2026-10-30 11:53:36 | test-fashion-mnist-trainjob-mfhd5.18e34c8665d83abe | - | Normal | AllJobsCompleted | jobset completed successfully | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | test-fashion-mnist-trainjob-mfhd5.18e34c866dc5451d | - | Normal | FinishedWorkload | Workload 'test-ns-s4smk/trainjob-test-fashion-mnist-trainjob-mfhd5-89e54' is declared finished | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | trainjob-test-fashion-mnist-trainjob-mfhd5-89e54.18e34c6b19aa7c97 | - | Normal | QuotaReserved | Quota reserved in ClusterQueue cq-6sp2p, wait time since queued was 0s | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | trainjob-test-fashion-mnist-trainjob-mfhd5-89e54.18e34c6b19ab25a8 | - | Normal | Admitted | Admitted by ClusterQueue cq-6sp2p, wait time since reservation was 0s |