LAST_SEEN | FIRST_SEEN | NAME | SUBOBJECT | TYPE | REASON | MESSAGE | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | test-mpi-trainjob-hzgn6-launcher-0-0-lppft.18e4a40240a25614 | - | Normal | Scheduled | Successfully assigned test-ns-dlmm7/test-mpi-trainjob-hzgn6-launcher-0-0-lppft to ip-10-0-140-215.us-west-1.compute.internal | 2026-11-03 20:48:01 | 2026-11-03 20:48:01 | test-mpi-trainjob-hzgn6-launcher-0-0-lppft.18e4a402641b8025 | - | Normal | AddedInterface | Add eth0 [10.133.0.23/23] from ovn-kubernetes | 2026-11-03 20:48:01 | 2026-11-03 20:48:01 | test-mpi-trainjob-hzgn6-launcher-0-0-lppft.18e4a4026b66e955 | spec.containers{node} | Normal | Pulling | Pulling image "quay.io/opendatahub/odh-th-torch-cpu-py312:odh-stable" | 2026-11-03 20:48:57 | 2026-11-03 20:48:57 | test-mpi-trainjob-hzgn6-launcher-0-0-lppft.18e4a40f4474863f | spec.containers{node} | Normal | Pulled | Successfully pulled image "quay.io/opendatahub/odh-th-torch-cpu-py312:odh-stable" in 55.181s (55.181s including waiting). Image size: 7472783034 bytes. | 2026-11-03 20:48:57 | 2026-11-03 20:48:57 | test-mpi-trainjob-hzgn6-launcher-0-0-lppft.18e4a40f49ab758b | spec.containers{node} | Normal | Created | Container created | 2026-11-03 20:48:57 | 2026-11-03 20:48:57 | test-mpi-trainjob-hzgn6-launcher-0-0-lppft.18e4a40f4b00a7d1 | spec.containers{node} | Normal | Started | Container started | 2026-11-03 20:48:01 | 2026-11-03 20:48:01 | test-mpi-trainjob-hzgn6-launcher-0.18e4a4024032b31c | - | Normal | SuccessfulCreate | Created pod: test-mpi-trainjob-hzgn6-launcher-0-0-lppft | 2026-11-03 20:49:08 | 2026-11-03 20:49:08 | test-mpi-trainjob-hzgn6-launcher-0.18e4a411e791f3ac | - | Normal | Completed | Job completed | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | test-mpi-trainjob-hzgn6-node-0-0-2kh7b.18e4a3ff0ef117f2 | - | Normal | Scheduled | Successfully assigned test-ns-dlmm7/test-mpi-trainjob-hzgn6-node-0-0-2kh7b to ip-10-0-140-181.us-west-1.compute.internal | 2026-11-03 20:47:48 | 2026-11-03 20:47:48 | test-mpi-trainjob-hzgn6-node-0-0-2kh7b.18e4a3ff3328026d | - | Normal | AddedInterface | Add eth0 [10.134.0.63/23] from ovn-kubernetes | 2026-11-03 20:47:48 | 2026-11-03 20:47:48 | test-mpi-trainjob-hzgn6-node-0-0-2kh7b.18e4a3ff3c38f3a8 | spec.containers{node} | Normal | Pulled | Container image "quay.io/opendatahub/odh-th-torch-cpu-py312:odh-stable" already present on machine and can be accessed by the pod | 2026-11-03 20:47:48 | 2026-11-03 20:47:48 | test-mpi-trainjob-hzgn6-node-0-0-2kh7b.18e4a3ff3ea3217e | spec.containers{node} | Normal | Created | Container created | 2026-11-03 20:47:48 | 2026-11-03 20:47:48 | test-mpi-trainjob-hzgn6-node-0-0-2kh7b.18e4a3ff3f1c41f5 | spec.containers{node} | Normal | Started | Container started | 2026-11-03 20:49:08 | 2026-11-03 20:49:08 | test-mpi-trainjob-hzgn6-node-0-0-2kh7b.18e4a411fe587ecf | spec.containers{node} | Normal | Killing | Stopping container node | 2026-11-03 20:47:47 | 2026-11-03 20:47:47 | test-mpi-trainjob-hzgn6-node-0.18e4a3ff0e4da926 | - | Normal | SuccessfulCreate | Created pod: test-mpi-trainjob-hzgn6-node-0-0-2kh7b | 2026-11-03 20:49:08 | 2026-11-03 20:49:08 | test-mpi-trainjob-hzgn6.18e4a411f31c977b | - | Normal | AllJobsCompleted | jobset completed successfully |