LAST_SEEN | FIRST_SEEN | NAME | SUBOBJECT | TYPE | REASON | MESSAGE | 2026-10-22 17:28:29 | 2026-10-22 17:28:29 | pvc-766bk.18e0ea281ca9ef36 | - | Normal | WaitForFirstConsumer | waiting for first consumer to be created before binding | 2026-10-22 17:28:29 | 2026-10-22 17:28:29 | pvc-766bk.18e0ea282ed7070c | - | Normal | Provisioning | External provisioner is provisioning volume for claim "test-ns-7fqpz/pvc-766bk" | 2026-10-22 17:28:29 | 2026-10-22 17:28:29 | pvc-766bk.18e0ea282ed77468 | - | Normal | ExternalProvisioning | Waiting for a volume to be created either by the external provisioner 'ebs.csi.aws.com' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. | 2026-10-22 17:28:32 | 2026-10-22 17:28:32 | pvc-766bk.18e0ea28b569ac76 | - | Normal | ProvisioningSucceeded | Successfully provisioned volume pvc-6d24224e-9877-4daa-90cc-f6af44e28f26 | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | test-trainjob-xcb5k-dataset-initializer-0-0-78fvl.18e0ea28e1c5168b | - | Normal | Scheduled | Successfully assigned test-ns-7fqpz/test-trainjob-xcb5k-dataset-initializer-0-0-78fvl to ip-10-0-135-228.ec2.internal | 2026-10-22 17:28:35 | 2026-10-22 17:28:35 | test-trainjob-xcb5k-dataset-initializer-0-0-78fvl.18e0ea296c640091 | - | Normal | SuccessfulAttachVolume | AttachVolume.Attach succeeded for volume "pvc-6d24224e-9877-4daa-90cc-f6af44e28f26" | 2026-10-22 17:28:44 | 2026-10-22 17:28:44 | test-trainjob-xcb5k-dataset-initializer-0-0-78fvl.18e0ea2b75d8944d | - | Normal | AddedInterface | Add eth0 [10.133.0.25/23] from ovn-kubernetes | 2026-10-22 17:28:44 | 2026-10-22 17:28:44 | test-trainjob-xcb5k-dataset-initializer-0-0-78fvl.18e0ea2b78cb4c62 | spec.containers{dataset-initializer} | Normal | Pulling | Pulling image "quay.io/ksuta/alpaca-dataset@sha256:2e90f631180c7b2c916f9569b914b336b612e8ae86efad82546adc5c9fcbbb8d" | 2026-10-22 17:28:48 | 2026-10-22 17:28:48 | test-trainjob-xcb5k-dataset-initializer-0-0-78fvl.18e0ea2c60c62540 | spec.containers{dataset-initializer} | Normal | Pulled | Successfully pulled image "quay.io/ksuta/alpaca-dataset@sha256:2e90f631180c7b2c916f9569b914b336b612e8ae86efad82546adc5c9fcbbb8d" in 3.891s (3.891s including waiting). Image size: 266627809 bytes. | 2026-10-22 17:28:48 | 2026-10-22 17:28:48 | test-trainjob-xcb5k-dataset-initializer-0-0-78fvl.18e0ea2c63c03d38 | spec.containers{dataset-initializer} | Normal | Created | Container created | 2026-10-22 17:28:48 | 2026-10-22 17:28:48 | test-trainjob-xcb5k-dataset-initializer-0-0-78fvl.18e0ea2c642baee3 | spec.containers{dataset-initializer} | Normal | Started | Container started | 2026-10-22 17:28:29 | 2026-10-22 17:28:29 | test-trainjob-xcb5k-dataset-initializer-0.18e0ea282d8d60b4 | - | Normal | SuccessfulCreate | Created pod: test-trainjob-xcb5k-dataset-initializer-0-0-78fvl | 2026-10-22 17:28:55 | 2026-10-22 17:28:55 | test-trainjob-xcb5k-dataset-initializer-0.18e0ea2e1e6dbcea | - | Normal | Completed | Job completed | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | test-trainjob-xcb5k-model-initializer-0-0-fsl5w.18e0ea2e24076fe8 | - | Normal | Scheduled | Successfully assigned test-ns-7fqpz/test-trainjob-xcb5k-model-initializer-0-0-fsl5w to ip-10-0-135-228.ec2.internal | 2026-10-22 17:29:04 | 2026-10-22 17:29:04 | test-trainjob-xcb5k-model-initializer-0-0-fsl5w.18e0ea3029c3d502 | - | Normal | AddedInterface | Add eth0 [10.133.0.26/23] from ovn-kubernetes | 2026-10-22 17:29:04 | 2026-10-22 17:29:04 | test-trainjob-xcb5k-model-initializer-0-0-fsl5w.18e0ea302c9f8ebc | spec.containers{model-initializer} | Normal | Pulling | Pulling image "quay.io/ksuta/bloom-560m@sha256:f6db02bb7b5d09a8d698c04994d747bfb9e581bbb4c07d00290244d207623733" | 2026-10-22 17:29:58 | 2026-10-22 17:29:58 | test-trainjob-xcb5k-model-initializer-0-0-fsl5w.18e0ea3ccadba072 | spec.containers{model-initializer} | Normal | Pulled | Successfully pulled image "quay.io/ksuta/bloom-560m@sha256:f6db02bb7b5d09a8d698c04994d747bfb9e581bbb4c07d00290244d207623733" in 54.194s (54.194s including waiting). Image size: 3589759710 bytes. | 2026-10-22 17:29:58 | 2026-10-22 17:29:58 | test-trainjob-xcb5k-model-initializer-0-0-fsl5w.18e0ea3cd036eeaf | spec.containers{model-initializer} | Normal | Created | Container created | 2026-10-22 17:29:58 | 2026-10-22 17:29:58 | test-trainjob-xcb5k-model-initializer-0-0-fsl5w.18e0ea3cd18c0f19 | spec.containers{model-initializer} | Normal | Started | Container started | 2026-10-22 17:28:55 | 2026-10-22 17:28:55 | test-trainjob-xcb5k-model-initializer-0.18e0ea2e238b6aeb | - | Normal | SuccessfulCreate | Created pod: test-trainjob-xcb5k-model-initializer-0-0-fsl5w | 2026-10-22 17:30:11 | 2026-10-22 17:30:11 | test-trainjob-xcb5k-model-initializer-0.18e0ea3fe2c223ce | - | Normal | Completed | Job completed | 0001-01-01 00:00:00 | 0001-01-01 00:00:00 | test-trainjob-xcb5k-node-0-0-qdv4p.18e0ea3fe8c29ff1 | - | Normal | Scheduled | Successfully assigned test-ns-7fqpz/test-trainjob-xcb5k-node-0-0-qdv4p to ip-10-0-135-228.ec2.internal | 2026-10-22 17:30:16 | 2026-10-22 17:30:16 | test-trainjob-xcb5k-node-0-0-qdv4p.18e0ea41063159bb | - | Normal | AddedInterface | Add eth0 [10.133.0.27/23] from ovn-kubernetes | 2026-10-22 17:30:16 | 2026-10-22 17:30:16 | test-trainjob-xcb5k-node-0-0-qdv4p.18e0ea4108cb982f | spec.containers{node} | Normal | Pulling | Pulling image "quay.io/opendatahub/odh-th-torch-cpu-py312:odh-3.5" | 2026-10-22 17:31:22 | 2026-10-22 17:31:22 | test-trainjob-xcb5k-node-0-0-qdv4p.18e0ea50686341e4 | spec.containers{node} | Normal | Pulled | Successfully pulled image "quay.io/opendatahub/odh-th-torch-cpu-py312:odh-3.5" in 1m6.028s (1m6.028s including waiting). Image size: 8008253507 bytes. | 2026-10-22 17:31:22 | 2026-10-22 17:31:22 | test-trainjob-xcb5k-node-0-0-qdv4p.18e0ea506e37228a | spec.containers{node} | Normal | Created | Container created | 2026-10-22 17:31:22 | 2026-10-22 17:31:22 | test-trainjob-xcb5k-node-0-0-qdv4p.18e0ea506f7c333f | spec.containers{node} | Normal | Started | Container started | 2026-10-22 17:30:11 | 2026-10-22 17:30:11 | test-trainjob-xcb5k-node-0.18e0ea3fe837ba3f | - | Normal | SuccessfulCreate | Created pod: test-trainjob-xcb5k-node-0-0-qdv4p | 2026-10-22 17:31:25 | 2026-10-22 17:31:25 | test-trainjob-xcb5k-node-0.18e0ea5105c2d931 | - | Normal | Completed | Job completed | 2026-10-22 17:31:25 | 2026-10-22 17:31:25 | test-trainjob-xcb5k.18e0ea5109f7af15 | - | Normal | AllJobsCompleted | jobset completed successfully |