LAST_SEEN | FIRST_SEEN | NAME | SUBOBJECT | TYPE | REASON | MESSAGE | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | dw-deployment-tsqnx-86676774b9-v92th.18e4752656c11cfc | - | Normal | CreatedWorkload | Created Workload: test-ns-j2nxj/pod-dw-deployment-tsqnx-86676774b9-v92th-eb9a2 | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | dw-deployment-tsqnx-86676774b9-v92th.18e475265cedf05a | - | Normal | Started | Admitted by clusterQueue cq-jgwdt | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | dw-deployment-tsqnx-86676774b9-v92th.18e475265cfeba75 | - | Normal | Scheduled | Successfully assigned test-ns-j2nxj/dw-deployment-tsqnx-86676774b9-v92th to ip-10-0-137-35.ec2.internal | 2026-11-03 06:29:19 | 2026-11-03 06:29:19 | dw-deployment-tsqnx-86676774b9-v92th.18e4752681c19b44 | - | Normal | AddedInterface | Add eth0 [10.134.0.30/23] from ovn-kubernetes | 2026-11-03 06:29:19 | 2026-11-03 06:29:19 | dw-deployment-tsqnx-86676774b9-v92th.18e4752684b7235d | spec.containers{notebook} | Normal | Pulling | Pulling image "quay.io/rhoai/odh-th-torch-cpu-py312-rhel9:rhoai-3.6" | 2026-11-03 06:30:29 | 2026-11-03 06:30:29 | dw-deployment-tsqnx-86676774b9-v92th.18e47536ab6f9f90 | spec.containers{notebook} | Normal | Pulled | Successfully pulled image "quay.io/rhoai/odh-th-torch-cpu-py312-rhel9:rhoai-3.6" in 1m9.369s (1m9.369s including waiting). Image size: 8468893571 bytes. | 2026-11-03 06:30:29 | 2026-11-03 06:30:29 | dw-deployment-tsqnx-86676774b9-v92th.18e47536b38a346a | spec.containers{notebook} | Normal | Created | Container created | 2026-11-03 06:30:29 | 2026-11-03 06:30:29 | dw-deployment-tsqnx-86676774b9-v92th.18e47536b46a4669 | spec.containers{notebook} | Normal | Started | Container started | 2026-11-03 06:31:10 | 2026-11-03 06:31:10 | dw-deployment-tsqnx-86676774b9-v92th.18e4754042991153 | spec.containers{notebook} | Normal | Killing | Stopping container notebook | 2026-11-03 06:29:18 | 2026-11-03 06:29:18 | dw-deployment-tsqnx-86676774b9.18e4752647da8b39 | - | Normal | SuccessfulCreate | Created pod: dw-deployment-tsqnx-86676774b9-v92th | 2026-11-03 06:29:18 | 2026-11-03 06:29:18 | dw-deployment-tsqnx.18e475263eae1eab | - | Normal | ScalingReplicaSet | Scaled up replica set dw-deployment-tsqnx-86676774b9 from 0 to 1 | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | pod-dw-deployment-tsqnx-86676774b9-v92th-eb9a2.18e475265a424362 | - | Normal | QuotaReserved | Quota reserved in ClusterQueue cq-jgwdt, wait time since queued was 0s | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | pod-dw-deployment-tsqnx-86676774b9-v92th-eb9a2.18e475265a43e918 | - | Normal | Admitted | Admitted by ClusterQueue cq-jgwdt, wait time since reservation was 0s | 2026-11-03 06:29:18 | 2026-11-03 06:29:18 | pvc-8d9k9.18e47526346d77a7 | - | Normal | ExternalProvisioning | Waiting for a volume to be created either by the external provisioner 'example.com/nfs' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. | 2026-11-03 06:29:18 | 2026-11-03 06:29:18 | pvc-8d9k9.18e4752635946c66 | - | Normal | Provisioning | External provisioner is provisioning volume for claim "test-ns-j2nxj/pvc-8d9k9" | 2026-11-03 06:29:18 | 2026-11-03 06:29:18 | pvc-8d9k9.18e4752638acfd02 | - | Normal | ProvisioningSucceeded | Successfully provisioned volume pvc-d220e27d-21ba-49c1-9014-f9e306dbe3f7 | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | trainjob-yee580ddb5f9-ca60e.18e4753928c5f059 | - | Normal | QuotaReserved | Quota reserved in ClusterQueue cq-jgwdt, wait time since queued was 1s | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | trainjob-yee580ddb5f9-ca60e.18e4753928c66461 | - | Normal | Admitted | Admitted by ClusterQueue cq-jgwdt, wait time since reservation was 1s | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | yee580ddb5f9-node-0-0-mn5xx.18e475395d2888ee | - | Normal | Scheduled | Successfully assigned test-ns-j2nxj/yee580ddb5f9-node-0-0-mn5xx to ip-10-0-134-19.ec2.internal | 2026-11-03 06:30:41 | 2026-11-03 06:30:41 | yee580ddb5f9-node-0-0-mn5xx.18e475397fd626af | - | Normal | AddedInterface | Add eth0 [10.132.0.35/23] from ovn-kubernetes | 2026-11-03 06:30:41 | 2026-11-03 06:30:41 | yee580ddb5f9-node-0-0-mn5xx.18e4753983a0e8f4 | spec.containers{node} | Normal | Pulled | Container image "quay.io/opendatahub/odh-th-torch-cpu-py312:odh-stable" already present on machine and can be accessed by the pod | 2026-11-03 06:30:41 | 2026-11-03 06:30:41 | yee580ddb5f9-node-0-0-mn5xx.18e475398782e1f5 | spec.containers{node} | Normal | Created | Container created | 2026-11-03 06:30:41 | 2026-11-03 06:30:41 | yee580ddb5f9-node-0-0-mn5xx.18e4753987fde7f9 | spec.containers{node} | Normal | Started | Container started | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | yee580ddb5f9-node-0-1-xxn89.18e475396101274b | - | Normal | Scheduled | Successfully assigned test-ns-j2nxj/yee580ddb5f9-node-0-1-xxn89 to ip-10-0-137-35.ec2.internal | 2026-11-03 06:30:42 | 2026-11-03 06:30:42 | yee580ddb5f9-node-0-1-xxn89.18e47539a8624370 | - | Normal | AddedInterface | Add eth0 [10.134.0.31/23] from ovn-kubernetes | 2026-11-03 06:30:42 | 2026-11-03 06:30:42 | yee580ddb5f9-node-0-1-xxn89.18e47539ac85c31b | spec.containers{node} | Normal | Pulled | Container image "quay.io/opendatahub/odh-th-torch-cpu-py312:odh-stable" already present on machine and can be accessed by the pod | 2026-11-03 06:30:42 | 2026-11-03 06:30:42 | yee580ddb5f9-node-0-1-xxn89.18e47539b11c670c | spec.containers{node} | Normal | Created | Container created | 2026-11-03 06:30:42 | 2026-11-03 06:30:42 | yee580ddb5f9-node-0-1-xxn89.18e47539b1c6c01e | spec.containers{node} | Normal | Started | Container started | 2026-11-03 06:30:40 | 2026-11-03 06:30:40 | yee580ddb5f9-node-0.18e475392c2cda10 | - | Normal | Suspended | Job suspended | 2026-11-03 06:30:40 | 2026-11-03 06:30:40 | yee580ddb5f9-node-0.18e475395cb5fbfc | - | Normal | SuccessfulCreate | Created pod: yee580ddb5f9-node-0-0-mn5xx | 2026-11-03 06:30:40 | 2026-11-03 06:30:40 | yee580ddb5f9-node-0.18e47539607bd671 | - | Normal | SuccessfulCreate | Created pod: yee580ddb5f9-node-0-1-xxn89 | 2026-11-03 06:30:40 | 2026-11-03 06:30:40 | yee580ddb5f9-node-0.18e47539607c17c4 | - | Normal | Resumed | Job resumed | 2026-11-03 06:31:08 | 2026-11-03 06:31:08 | yee580ddb5f9-node-0.18e4753fcaadbcdc | - | Normal | Completed | Job completed | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | yee580ddb5f9.18e47539265eeaf0 | - | Normal | CreatedWorkload | Created Workload: test-ns-j2nxj/trainjob-yee580ddb5f9-ca60e | 2026-11-03 06:30:40 | 2026-11-03 06:30:40 | yee580ddb5f9.18e475392eb2399a | - | Normal | SuspendedJobs | jobset is suspended | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | yee580ddb5f9.18e475394071aec5 | - | Normal | Started | Admitted by clusterQueue cq-jgwdt | 2026-11-03 06:30:40 | 2026-11-03 06:30:40 | yee580ddb5f9.18e475394a81256c | - | Normal | ResumeJobs | jobset is resumed | 2026-11-03 06:31:08 | 2026-11-03 06:31:08 | yee580ddb5f9.18e4753fcc814048 | - | Normal | AllJobsCompleted | jobset completed successfully | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | yee580ddb5f9.18e4753fd793c39a | - | Normal | FinishedWorkload | Workload 'test-ns-j2nxj/trainjob-yee580ddb5f9-ca60e' is declared finished |