LAST_SEEN            | FIRST_SEEN           | NAME                                                            | SUBOBJECT              | TYPE    | REASON                   | MESSAGE                                                                                                                                                        | 
0001-01-01 00:00:00  | 0001-01-01 00:00:00  | test-preemption-trainjob-fnt6p-node-0-0-zg8gc.18e46d8a93ca5765  | -                      | Normal  | Scheduled                | Successfully assigned test-ns-289zf/test-preemption-trainjob-fnt6p-node-0-0-zg8gc to ip-10-0-128-146.us-west-2.compute.internal                                | 
2026-11-03 04:09:54  | 2026-11-03 04:09:54  | test-preemption-trainjob-fnt6p-node-0-0-zg8gc.18e46d8ab6fc5f1f  | -                      | Normal  | AddedInterface           | Add eth0 [10.133.0.29/23] from ovn-kubernetes                                                                                                                  | 
2026-11-03 04:09:54  | 2026-11-03 04:09:54  | test-preemption-trainjob-fnt6p-node-0-0-zg8gc.18e46d8abe5d374d  | spec.containers{node}  | Normal  | Pulling                  | Pulling image "quay.io/opendatahub/odh-th-torch-cuda-py312:odh-stable"                                                                                         | 
2026-11-03 04:15:07  | 2026-11-03 04:15:07  | test-preemption-trainjob-fnt6p-node-0-0-zg8gc.18e46dd3a9c97a6f  | spec.containers{node}  | Normal  | Pulled                   | Successfully pulled image "quay.io/opendatahub/odh-th-torch-cuda-py312:odh-stable" in 5m13.187s (5m13.187s including waiting). Image size: 24712531635 bytes.  | 
2026-11-03 04:15:07  | 2026-11-03 04:15:07  | test-preemption-trainjob-fnt6p-node-0-0-zg8gc.18e46dd3b07d43ef  | spec.containers{node}  | Normal  | Created                  | Container created                                                                                                                                              | 
2026-11-03 04:15:07  | 2026-11-03 04:15:07  | test-preemption-trainjob-fnt6p-node-0-0-zg8gc.18e46dd3b18c5775  | spec.containers{node}  | Normal  | Started                  | Container started                                                                                                                                              | 
2026-11-03 04:15:09  | 2026-11-03 04:15:09  | test-preemption-trainjob-fnt6p-node-0-0-zg8gc.18e46dd42ed16439  | spec.containers{node}  | Normal  | Killing                  | Stopping container node                                                                                                                                        | 
2026-11-03 04:15:09  | 2026-11-03 04:09:52  | test-preemption-trainjob-fnt6p-node-0.18e46d8a38d6c7c1          | -                      | Normal  | Suspended                | Job suspended                                                                                                                                                  | 
2026-11-03 04:09:53  | 2026-11-03 04:09:53  | test-preemption-trainjob-fnt6p-node-0.18e46d8a93376bec          | -                      | Normal  | SuccessfulCreate         | Created pod: test-preemption-trainjob-fnt6p-node-0-0-zg8gc                                                                                                     | 
2026-11-03 04:09:53  | 2026-11-03 04:09:53  | test-preemption-trainjob-fnt6p-node-0.18e46d8a9338c3d9          | -                      | Normal  | Resumed                  | Job resumed                                                                                                                                                    | 
2026-11-03 04:15:09  | 2026-11-03 04:15:09  | test-preemption-trainjob-fnt6p-node-0.18e46dd42497adb1          | -                      | Normal  | SuccessfulDelete         | Deleted pod: test-preemption-trainjob-fnt6p-node-0-0-zg8gc                                                                                                     | 
0001-01-01 00:00:00  | 0001-01-01 00:00:00  | test-preemption-trainjob-fnt6p.18e46d8a39036d49                 | -                      | Normal  | CreatedWorkload          | Created Workload: test-ns-289zf/trainjob-test-preemption-trainjob-fnt6p-dced9                                                                                  | 
2026-11-03 04:15:09  | 2026-11-03 04:09:52  | test-preemption-trainjob-fnt6p.18e46d8a4110d5d5                 | -                      | Normal  | SuspendedJobs            | jobset is suspended                                                                                                                                            | 
0001-01-01 00:00:00  | 0001-01-01 00:00:00  | test-preemption-trainjob-fnt6p.18e46d8a7fe5d331                 | -                      | Normal  | Started                  | Admitted by clusterQueue cq-s4rfg                                                                                                                              | 
2026-11-03 04:09:53  | 2026-11-03 04:09:53  | test-preemption-trainjob-fnt6p.18e46d8a90cf8ba3                 | -                      | Normal  | ResumeJobs               | jobset is resumed                                                                                                                                              | 
0001-01-01 00:00:00  | 0001-01-01 00:00:00  | test-preemption-trainjob-fnt6p.18e46dd4075f43d2                 | -                      | Normal  | Stopped                  | The workload is deactivated                                                                                                                                    | 
0001-01-01 00:00:00  | 0001-01-01 00:00:00  | trainjob-test-preemption-trainjob-fnt6p-dced9.18e46d8a3faf74a9  | -                      | Normal  | QuotaReserved            | Quota reserved in ClusterQueue cq-s4rfg, wait time since queued was 1s                                                                                         | 
0001-01-01 00:00:00  | 0001-01-01 00:00:00  | trainjob-test-preemption-trainjob-fnt6p-dced9.18e46d8a3fb04f45  | -                      | Normal  | Admitted                 | Admitted by ClusterQueue cq-s4rfg, wait time since reservation was 0s                                                                                          | 
0001-01-01 00:00:00  | 0001-01-01 00:00:00  | trainjob-test-preemption-trainjob-fnt6p-dced9.18e46dd3dbc04780  | -                      | Normal  | EvictedDueToDeactivated  | The workload is deactivated                                                                                                                                    |