LAST_SEEN | FIRST_SEEN | NAME | SUBOBJECT | TYPE | REASON | MESSAGE | 2026-11-04 04:07:41 | 2026-11-04 04:07:41 | pvc-mmtbk.18e4bc004b629721 | - | Normal | ExternalProvisioning | Waiting for a volume to be created either by the external provisioner 'example.com/nfs' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. | 2026-11-04 04:07:41 | 2026-11-04 04:07:41 | pvc-mmtbk.18e4bc005068c0bc | - | Normal | Provisioning | External provisioner is provisioning volume for claim "test-ns-w7f4x/pvc-mmtbk" | 2026-11-04 04:07:41 | 2026-11-04 04:07:41 | pvc-mmtbk.18e4bc005b097bc8 | - | Normal | ProvisioningSucceeded | Successfully provisioned volume pvc-053b57a2-b2fc-4f35-8e87-0912efaf0b7e | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | test-fashion-mnist-trainjob-6p74s-dataset-initializer-0-0-9ls74.18e4bc0143285b96 | - | Normal | Scheduled | Successfully assigned test-ns-w7f4x/test-fashion-mnist-trainjob-6p74s-dataset-initializer-0-0-9ls74 to ip-10-0-130-151.us-west-2.compute.internal | 2026-11-04 04:07:46 | 2026-11-04 04:07:46 | test-fashion-mnist-trainjob-6p74s-dataset-initializer-0-0-9ls74.18e4bc017874052a | - | Normal | AddedInterface | Add eth0 [10.132.0.59/23] from ovn-kubernetes | 2026-11-04 04:07:46 | 2026-11-04 04:07:46 | test-fashion-mnist-trainjob-6p74s-dataset-initializer-0-0-9ls74.18e4bc018025a53a | spec.containers{dataset-initializer} | Normal | Pulled | Container image "quay.io/opendatahub/odh-th-torch-cpu-py312:odh-stable" already present on machine and can be accessed by the pod | 2026-11-04 04:07:46 | 2026-11-04 04:07:46 | test-fashion-mnist-trainjob-6p74s-dataset-initializer-0-0-9ls74.18e4bc01829b9e79 | spec.containers{dataset-initializer} | Normal | Created | Container created | 2026-11-04 04:07:46 | 2026-11-04 04:07:46 | test-fashion-mnist-trainjob-6p74s-dataset-initializer-0-0-9ls74.18e4bc018302b85a | spec.containers{dataset-initializer} | Normal | Started | Container started | 2026-11-04 04:07:43 | 2026-11-04 04:07:43 | test-fashion-mnist-trainjob-6p74s-dataset-initializer-0.18e4bc00cd808f04 | - | Normal | Suspended | Job suspended | 2026-11-04 04:07:45 | 2026-11-04 04:07:45 | test-fashion-mnist-trainjob-6p74s-dataset-initializer-0.18e4bc0142ba4f08 | - | Normal | SuccessfulCreate | Created pod: test-fashion-mnist-trainjob-6p74s-dataset-initializer-0-0-9ls74 | 2026-11-04 04:07:45 | 2026-11-04 04:07:45 | test-fashion-mnist-trainjob-6p74s-dataset-initializer-0.18e4bc0142bab9f4 | - | Normal | Resumed | Job resumed | 2026-11-04 04:08:11 | 2026-11-04 04:08:11 | test-fashion-mnist-trainjob-6p74s-dataset-initializer-0.18e4bc07665f3dfd | - | Normal | Completed | Job completed | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | test-fashion-mnist-trainjob-6p74s-node-0-0-2j946.18e4bc0777b82f04 | - | Normal | Scheduled | Successfully assigned test-ns-w7f4x/test-fashion-mnist-trainjob-6p74s-node-0-0-2j946 to ip-10-0-137-184.us-west-2.compute.internal | 2026-11-04 04:08:12 | 2026-11-04 04:08:12 | test-fashion-mnist-trainjob-6p74s-node-0-0-2j946.18e4bc07ad552fec | - | Normal | AddedInterface | Add eth0 [10.134.0.43/23] from ovn-kubernetes | 2026-11-04 04:08:12 | 2026-11-04 04:08:12 | test-fashion-mnist-trainjob-6p74s-node-0-0-2j946.18e4bc07b6fca000 | spec.containers{node} | Normal | Pulled | Container image "quay.io/opendatahub/odh-th-torch-cpu-py312:odh-stable" already present on machine and can be accessed by the pod | 2026-11-04 04:08:12 | 2026-11-04 04:08:12 | test-fashion-mnist-trainjob-6p74s-node-0-0-2j946.18e4bc07b99ad974 | spec.containers{node} | Normal | Created | Container created | 2026-11-04 04:08:12 | 2026-11-04 04:08:12 | test-fashion-mnist-trainjob-6p74s-node-0-0-2j946.18e4bc07ba16cc44 | spec.containers{node} | Normal | Started | Container started | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | test-fashion-mnist-trainjob-6p74s-node-0-1-84vlv.18e4bc078232a6ec | - | Normal | Scheduled | Successfully assigned test-ns-w7f4x/test-fashion-mnist-trainjob-6p74s-node-0-1-84vlv to ip-10-0-130-151.us-west-2.compute.internal | 2026-11-04 04:08:12 | 2026-11-04 04:08:12 | test-fashion-mnist-trainjob-6p74s-node-0-1-84vlv.18e4bc07b807504b | - | Normal | AddedInterface | Add eth0 [10.132.0.60/23] from ovn-kubernetes | 2026-11-04 04:08:13 | 2026-11-04 04:08:13 | test-fashion-mnist-trainjob-6p74s-node-0-1-84vlv.18e4bc07c25b755a | spec.containers{node} | Normal | Pulled | Container image "quay.io/opendatahub/odh-th-torch-cpu-py312:odh-stable" already present on machine and can be accessed by the pod | 2026-11-04 04:08:13 | 2026-11-04 04:08:13 | test-fashion-mnist-trainjob-6p74s-node-0-1-84vlv.18e4bc07c4e6fb3b | spec.containers{node} | Normal | Created | Container created | 2026-11-04 04:08:13 | 2026-11-04 04:08:13 | test-fashion-mnist-trainjob-6p74s-node-0-1-84vlv.18e4bc07c560520a | spec.containers{node} | Normal | Started | Container started | 2026-11-04 04:08:11 | 2026-11-04 04:08:11 | test-fashion-mnist-trainjob-6p74s-node-0.18e4bc077747d189 | - | Normal | SuccessfulCreate | Created pod: test-fashion-mnist-trainjob-6p74s-node-0-0-2j946 | 2026-11-04 04:08:12 | 2026-11-04 04:08:12 | test-fashion-mnist-trainjob-6p74s-node-0.18e4bc0781c4fb5f | - | Normal | SuccessfulCreate | Created pod: test-fashion-mnist-trainjob-6p74s-node-0-1-84vlv | 2026-11-04 04:08:52 | 2026-11-04 04:08:52 | test-fashion-mnist-trainjob-6p74s-node-0.18e4bc110287bb27 | - | Normal | Completed | Job completed | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | test-fashion-mnist-trainjob-6p74s.18e4bc00c78a4b26 | - | Normal | CreatedWorkload | Created Workload: test-ns-w7f4x/trainjob-test-fashion-mnist-trainjob-6p74s-42197 | 2026-11-04 04:07:43 | 2026-11-04 04:07:43 | test-fashion-mnist-trainjob-6p74s.18e4bc00d55d3a01 | - | Normal | SuspendedJobs | jobset is suspended | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | test-fashion-mnist-trainjob-6p74s.18e4bc0107454844 | - | Normal | Started | Admitted by clusterQueue cq-s5smc | 2026-11-04 04:07:44 | 2026-11-04 04:07:44 | test-fashion-mnist-trainjob-6p74s.18e4bc0115b5ff32 | - | Normal | ResumeJobs | jobset is resumed | 2026-11-04 04:08:52 | 2026-11-04 04:08:52 | test-fashion-mnist-trainjob-6p74s.18e4bc11093e0a0b | - | Normal | AllJobsCompleted | jobset completed successfully | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | test-fashion-mnist-trainjob-6p74s.18e4bc1129882ad9 | - | Normal | FinishedWorkload | Workload 'test-ns-w7f4x/trainjob-test-fashion-mnist-trainjob-6p74s-42197' is declared finished | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | trainjob-test-fashion-mnist-trainjob-6p74s-42197.18e4bc00ce7ef0d6 | - | Normal | QuotaReserved | Quota reserved in ClusterQueue cq-s5smc, wait time since queued was 0s | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | trainjob-test-fashion-mnist-trainjob-6p74s-42197.18e4bc00ce7f9050 | - | Normal | Admitted | Admitted by ClusterQueue cq-s5smc, wait time since reservation was 0s |