LAST_SEEN            | FIRST_SEEN           | NAME                                                         | SUBOBJECT              | TYPE    | REASON            | MESSAGE                                                                                                                                                  | 
0001-01-01 00:00:00  | 0001-01-01 00:00:00  | test-mpi-trainjob-nkhhd-launcher-0-0-xqsk7.18e48be6e0e7dc96  | -                      | Normal  | Scheduled         | Successfully assigned test-ns-g5zfv/test-mpi-trainjob-nkhhd-launcher-0-0-xqsk7 to ip-10-0-137-218.us-west-2.compute.internal                             | 
2026-11-03 13:26:15  | 2026-11-03 13:26:15  | test-mpi-trainjob-nkhhd-launcher-0-0-xqsk7.18e48be7042ec8b3  | -                      | Normal  | AddedInterface    | Add eth0 [10.133.0.25/23] from ovn-kubernetes                                                                                                            | 
2026-11-03 13:26:16  | 2026-11-03 13:26:16  | test-mpi-trainjob-nkhhd-launcher-0-0-xqsk7.18e48be70be93164  | spec.containers{node}  | Normal  | Pulling           | Pulling image "quay.io/opendatahub/odh-th-torch-cpu-py312:odh-stable"                                                                                    | 
2026-11-03 13:27:10  | 2026-11-03 13:27:10  | test-mpi-trainjob-nkhhd-launcher-0-0-xqsk7.18e48bf3d2488f70  | spec.containers{node}  | Normal  | Pulled            | Successfully pulled image "quay.io/opendatahub/odh-th-torch-cpu-py312:odh-stable" in 54.867s (54.867s including waiting). Image size: 7472783034 bytes.  | 
2026-11-03 13:27:10  | 2026-11-03 13:27:10  | test-mpi-trainjob-nkhhd-launcher-0-0-xqsk7.18e48bf3d6602f3a  | spec.containers{node}  | Normal  | Created           | Container created                                                                                                                                        | 
2026-11-03 13:27:11  | 2026-11-03 13:27:11  | test-mpi-trainjob-nkhhd-launcher-0-0-xqsk7.18e48bf3d804b29b  | spec.containers{node}  | Normal  | Started           | Container started                                                                                                                                        | 
2026-11-03 13:26:15  | 2026-11-03 13:26:15  | test-mpi-trainjob-nkhhd-launcher-0.18e48be6e07a3914          | -                      | Normal  | SuccessfulCreate  | Created pod: test-mpi-trainjob-nkhhd-launcher-0-0-xqsk7                                                                                                  | 
2026-11-03 13:27:21  | 2026-11-03 13:27:21  | test-mpi-trainjob-nkhhd-launcher-0.18e48bf65632472e          | -                      | Normal  | Completed         | Job completed                                                                                                                                            | 
0001-01-01 00:00:00  | 0001-01-01 00:00:00  | test-mpi-trainjob-nkhhd-node-0-0-5hqm5.18e48be3c0576a91      | -                      | Normal  | Scheduled         | Successfully assigned test-ns-g5zfv/test-mpi-trainjob-nkhhd-node-0-0-5hqm5 to ip-10-0-131-125.us-west-2.compute.internal                                 | 
2026-11-03 13:26:02  | 2026-11-03 13:26:02  | test-mpi-trainjob-nkhhd-node-0-0-5hqm5.18e48be3e3fe961e      | -                      | Normal  | AddedInterface    | Add eth0 [10.134.0.45/23] from ovn-kubernetes                                                                                                            | 
2026-11-03 13:26:02  | 2026-11-03 13:26:02  | test-mpi-trainjob-nkhhd-node-0-0-5hqm5.18e48be3eb4f8431      | spec.containers{node}  | Normal  | Pulled            | Container image "quay.io/opendatahub/odh-th-torch-cpu-py312:odh-stable" already present on machine and can be accessed by the pod                        | 
2026-11-03 13:26:02  | 2026-11-03 13:26:02  | test-mpi-trainjob-nkhhd-node-0-0-5hqm5.18e48be3ee1fb9a1      | spec.containers{node}  | Normal  | Created           | Container created                                                                                                                                        | 
2026-11-03 13:26:02  | 2026-11-03 13:26:02  | test-mpi-trainjob-nkhhd-node-0-0-5hqm5.18e48be3eee280f0      | spec.containers{node}  | Normal  | Started           | Container started                                                                                                                                        | 
2026-11-03 13:27:22  | 2026-11-03 13:27:22  | test-mpi-trainjob-nkhhd-node-0-0-5hqm5.18e48bf66cf2d016      | spec.containers{node}  | Normal  | Killing           | Stopping container node                                                                                                                                  | 
2026-11-03 13:26:01  | 2026-11-03 13:26:01  | test-mpi-trainjob-nkhhd-node-0.18e48be3bfe80609              | -                      | Normal  | SuccessfulCreate  | Created pod: test-mpi-trainjob-nkhhd-node-0-0-5hqm5                                                                                                      | 
2026-11-03 13:27:21  | 2026-11-03 13:27:21  | test-mpi-trainjob-nkhhd.18e48bf662b12cbe                     | -                      | Normal  | AllJobsCompleted  | jobset completed successfully                                                                                                                            |