=== events in opendatahub (2026-10-30T14:06:51Z) === LAST SEEN TYPE REASON OBJECT MESSAGE 3m37s Normal Scheduled pod/llmisvc-controller-manager-6466c554d8-262ss Successfully assigned opendatahub/llmisvc-controller-manager-6466c554d8-262ss to ip-10-0-142-58.ec2.internal 4m21s Normal Scheduled pod/usage-logs-tenancy-proxy-9c5d49bcd-f4skk Successfully assigned opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-f4skk to ip-10-0-130-170.ec2.internal 4m27s Normal Scheduled pod/maas-controller-579cf7c6d-h6rwc Successfully assigned opendatahub/maas-controller-579cf7c6d-h6rwc to ip-10-0-142-58.ec2.internal 4m26s Normal Scheduled pod/maas-controller-797b999b7c-rw6fh Successfully assigned opendatahub/maas-controller-797b999b7c-rw6fh to ip-10-0-142-58.ec2.internal 4m43s Normal Scheduled pod/model-serving-api-75bd89fdfc-pmzsx Successfully assigned opendatahub/model-serving-api-75bd89fdfc-pmzsx to ip-10-0-130-170.ec2.internal 2m19s Normal Scheduled pod/ai-gateway-controller-6674db54f7-p5fsn Successfully assigned opendatahub/ai-gateway-controller-6674db54f7-p5fsn to ip-10-0-130-170.ec2.internal 4m43s Normal Scheduled pod/odh-model-controller-769875db56-pkspx Successfully assigned opendatahub/odh-model-controller-769875db56-pkspx to ip-10-0-130-170.ec2.internal 5m39s Normal Scheduled pod/kserve-module-controller-manager-7566cf5fc8-dtllc Successfully assigned opendatahub/kserve-module-controller-manager-7566cf5fc8-dtllc to ip-10-0-130-170.ec2.internal 4m43s Normal Scheduled pod/kserve-controller-manager-776cc66d47-rz9hd Successfully assigned opendatahub/kserve-controller-manager-776cc66d47-rz9hd to ip-10-0-130-170.ec2.internal 2m4s Normal Scheduled pod/ai-gateway-controller-f5bcf9b7b-bmnlj Successfully assigned opendatahub/ai-gateway-controller-f5bcf9b7b-bmnlj to ip-10-0-130-170.ec2.internal 4m43s Normal Scheduled pod/llmisvc-controller-manager-869d5dcc5d-q9qpn Successfully assigned opendatahub/llmisvc-controller-manager-869d5dcc5d-q9qpn to ip-10-0-142-58.ec2.internal 5m39s Normal SuccessfulCreate replicaset/kserve-module-controller-manager-7566cf5fc8 Created pod: kserve-module-controller-manager-7566cf5fc8-dtllc 5m39s Normal ScalingReplicaSet deployment/kserve-module-controller-manager Scaled up replica set kserve-module-controller-manager-7566cf5fc8 from 0 to 1 5m39s Normal AddedInterface pod/kserve-module-controller-manager-7566cf5fc8-dtllc Add eth0 [10.133.0.28/23] from ovn-kubernetes 5m39s Normal Pulling pod/kserve-module-controller-manager-7566cf5fc8-dtllc Pulling image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189" 5m37s Normal Started pod/kserve-module-controller-manager-7566cf5fc8-dtllc Container started 5m37s Normal Pulled pod/kserve-module-controller-manager-7566cf5fc8-dtllc Successfully pulled image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189" in 1.505s (1.505s including waiting). Image size: 195729000 bytes. 5m37s Normal Created pod/kserve-module-controller-manager-7566cf5fc8-dtllc Container created 5m21s Normal LeaderElection lease/kserve-module-controller-manager kserve-module-controller-manager-7566cf5fc8-dtllc_e1e2e23c-5d7d-4448-aa15-593c5d965844 became leader 4m44s Normal SuccessfulCreate replicaset/kserve-controller-manager-776cc66d47 Created pod: kserve-controller-manager-776cc66d47-rz9hd 4m44s Normal SuccessfulCreate replicaset/model-serving-api-75bd89fdfc Created pod: model-serving-api-75bd89fdfc-pmzsx 4m44s Normal ScalingReplicaSet deployment/llmisvc-controller-manager Scaled up replica set llmisvc-controller-manager-869d5dcc5d from 0 to 1 4m44s Normal AddedInterface pod/kserve-controller-manager-776cc66d47-rz9hd Add eth0 [10.133.0.31/23] from ovn-kubernetes 4m44s Normal Pulling pod/kserve-controller-manager-776cc66d47-rz9hd Pulling image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d" 4m44s Normal AddedInterface pod/model-serving-api-75bd89fdfc-pmzsx Add eth0 [10.133.0.32/23] from ovn-kubernetes 4m44s Normal Pulling pod/llmisvc-controller-manager-869d5dcc5d-q9qpn Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" 4m44s Normal ScalingReplicaSet deployment/odh-model-controller Scaled up replica set odh-model-controller-769875db56 from 0 to 1 4m44s Normal SuccessfulCreate replicaset/llmisvc-controller-manager-869d5dcc5d Created pod: llmisvc-controller-manager-869d5dcc5d-q9qpn 4m44s Normal AddedInterface pod/llmisvc-controller-manager-869d5dcc5d-q9qpn Add eth0 [10.132.0.42/23] from ovn-kubernetes 4m44s Normal ScalingReplicaSet deployment/kserve-controller-manager Scaled up replica set kserve-controller-manager-776cc66d47 from 0 to 1 4m44s Normal ScalingReplicaSet deployment/model-serving-api Scaled up replica set model-serving-api-75bd89fdfc from 0 to 1 4m44s Normal SuccessfulCreate replicaset/odh-model-controller-769875db56 Created pod: odh-model-controller-769875db56-pkspx 4m43s Normal Pulling pod/odh-model-controller-769875db56-pkspx Pulling image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775" 4m43s Normal AddedInterface pod/odh-model-controller-769875db56-pkspx Add eth0 [10.133.0.33/23] from ovn-kubernetes 4m43s Normal Pulling pod/model-serving-api-75bd89fdfc-pmzsx Pulling image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8" 4m41s Normal Started pod/model-serving-api-75bd89fdfc-pmzsx Container started 4m41s Normal Pulled pod/llmisvc-controller-manager-869d5dcc5d-q9qpn Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 2.437s (2.437s including waiting). Image size: 235100981 bytes. 4m41s Normal Created pod/llmisvc-controller-manager-869d5dcc5d-q9qpn Container created 4m41s Normal Pulled pod/kserve-controller-manager-776cc66d47-rz9hd Successfully pulled image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d" in 3.069s (3.069s including waiting). Image size: 247676581 bytes. 4m41s Normal Started pod/llmisvc-controller-manager-869d5dcc5d-q9qpn Container started 4m41s Normal Pulled pod/model-serving-api-75bd89fdfc-pmzsx Successfully pulled image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8" in 2.43s (2.43s including waiting). Image size: 184925761 bytes. 4m41s Normal Created pod/model-serving-api-75bd89fdfc-pmzsx Container created 4m40s Normal Created pod/kserve-controller-manager-776cc66d47-rz9hd Container created 4m40s Normal Started pod/kserve-controller-manager-776cc66d47-rz9hd Container started 4m40s Normal Created pod/odh-model-controller-769875db56-pkspx Container created 4m40s Normal Started pod/odh-model-controller-769875db56-pkspx Container started 4m40s Normal LeaderElection lease/odh-model-controller.opendatahub.io odh-model-controller-769875db56-pkspx_68c7ab35-759d-4f13-b98c-314b669e9570 became leader 4m40s Normal LeaderElection lease/kserve-controller-manager-leader-lock kserve-controller-manager-776cc66d47-rz9hd_c1c3de3e-96ff-46bd-a9d5-2f576a8936a3 became leader 4m40s Normal LeaderElection lease/llminferenceservice-kserve-controller-manager llmisvc-controller-manager-869d5dcc5d-q9qpn_1b6d93b6-8377-4966-9678-c0cfb14b7590 became leader 4m40s Normal Pulled pod/odh-model-controller-769875db56-pkspx Successfully pulled image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775" in 3.342s (3.342s including waiting). Image size: 236755567 bytes. 4m28s Normal ScalingReplicaSet deployment/maas-controller Scaled up replica set maas-controller-579cf7c6d from 0 to 1 4m28s Normal SuccessfulCreate replicaset/maas-controller-579cf7c6d Created pod: maas-controller-579cf7c6d-h6rwc 4m27s Normal SuccessfulCreate replicaset/maas-controller-797b999b7c Created pod: maas-controller-797b999b7c-rw6fh 4m27s Normal AddedInterface pod/maas-controller-579cf7c6d-h6rwc Add eth0 [10.132.0.43/23] from ovn-kubernetes 4m27s Normal Pulling pod/maas-controller-797b999b7c-rw6fh Pulling image "quay.io/opendatahub/maas-controller:7879675aa66d002425c7b32375d6d0156eaa0c56" 4m27s Normal AddedInterface pod/maas-controller-797b999b7c-rw6fh Add eth0 [10.132.0.44/23] from ovn-kubernetes 4m27s Normal ScalingReplicaSet deployment/maas-controller Scaled up replica set maas-controller-797b999b7c from 0 to 1 4m27s Normal Pulling pod/maas-controller-579cf7c6d-h6rwc Pulling image "quay.io/opendatahub/maas-controller:7879675aa66d002425c7b32375d6d0156eaa0c56" 4m24s Normal Created pod/maas-controller-797b999b7c-rw6fh Container created 4m24s Normal Started pod/maas-controller-579cf7c6d-h6rwc Container started 4m24s Normal Started pod/maas-controller-797b999b7c-rw6fh Container started 4m24s Normal Pulled pod/maas-controller-797b999b7c-rw6fh Successfully pulled image "quay.io/opendatahub/maas-controller:7879675aa66d002425c7b32375d6d0156eaa0c56" in 2.643s (2.643s including waiting). Image size: 200053271 bytes. 4m24s Normal Pulled pod/maas-controller-579cf7c6d-h6rwc Successfully pulled image "quay.io/opendatahub/maas-controller:7879675aa66d002425c7b32375d6d0156eaa0c56" in 2.698s (2.698s including waiting). Image size: 200053271 bytes. 4m24s Normal Created pod/maas-controller-579cf7c6d-h6rwc Container created 4m23s Normal LeaderElection lease/maas-controller.models-as-a-service.opendatahub.io maas-controller-579cf7c6d-h6rwc_7bb18e11-3a06-4c27-8436-2b3e63194484 became leader 4m22s Normal SuccessfulCreate replicaset/usage-logs-tenancy-proxy-9c5d49bcd Created pod: usage-logs-tenancy-proxy-9c5d49bcd-f4skk 4m22s Normal Pulling pod/usage-logs-tenancy-proxy-9c5d49bcd-f4skk Pulling image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172" 4m22s Normal AddedInterface pod/usage-logs-tenancy-proxy-9c5d49bcd-f4skk Add eth0 [10.133.0.34/23] from ovn-kubernetes 4m22s Normal ScalingReplicaSet deployment/usage-logs-tenancy-proxy Scaled up replica set usage-logs-tenancy-proxy-9c5d49bcd from 0 to 1 4m12s Normal SuccessfulDelete replicaset/maas-controller-579cf7c6d Deleted pod: maas-controller-579cf7c6d-h6rwc 4m12s Normal ScalingReplicaSet deployment/maas-controller Scaled down replica set maas-controller-579cf7c6d from 1 to 0 4m12s Normal Killing pod/maas-controller-579cf7c6d-h6rwc Stopping container manager 4m11s Normal Started pod/usage-logs-tenancy-proxy-9c5d49bcd-f4skk Container started 4m11s Normal Created pod/usage-logs-tenancy-proxy-9c5d49bcd-f4skk Container created 4m11s Normal Pulled pod/usage-logs-tenancy-proxy-9c5d49bcd-f4skk Successfully pulled image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172" in 10.463s (10.463s including waiting). Image size: 1089502687 bytes. 3m56s Normal LeaderElection lease/maas-controller.models-as-a-service.opendatahub.io maas-controller-797b999b7c-rw6fh_c6cb7689-239e-4c1e-8eb7-52eeda045b20 became leader 3m38s Normal Pulling pod/llmisvc-controller-manager-6466c554d8-262ss Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" 3m38s Normal ScalingReplicaSet deployment/llmisvc-controller-manager Scaled up replica set llmisvc-controller-manager-6466c554d8 from 0 to 1 3m38s Normal AddedInterface pod/llmisvc-controller-manager-6466c554d8-262ss Add eth0 [10.132.0.48/23] from ovn-kubernetes 3m38s Normal SuccessfulCreate replicaset/llmisvc-controller-manager-6466c554d8 Created pod: llmisvc-controller-manager-6466c554d8-262ss 3m37s Normal Started pod/llmisvc-controller-manager-6466c554d8-262ss Container started 3m37s Normal Created pod/llmisvc-controller-manager-6466c554d8-262ss Container created 3m37s Normal Pulled pod/llmisvc-controller-manager-6466c554d8-262ss Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 303ms (303ms including waiting). Image size: 235100981 bytes. 3m6s Normal ScalingReplicaSet deployment/llmisvc-controller-manager Scaled down replica set llmisvc-controller-manager-869d5dcc5d from 1 to 0 3m6s Normal Killing pod/llmisvc-controller-manager-869d5dcc5d-q9qpn Stopping container manager 3m6s Normal SuccessfulDelete replicaset/llmisvc-controller-manager-869d5dcc5d Deleted pod: llmisvc-controller-manager-869d5dcc5d-q9qpn 2m48s Normal LeaderElection lease/llminferenceservice-kserve-controller-manager llmisvc-controller-manager-6466c554d8-262ss_474e4b9d-9ba8-4638-a078-916eed151d7f became leader 2m20s Normal ScalingReplicaSet deployment/ai-gateway-controller Scaled up replica set ai-gateway-controller-6674db54f7 from 0 to 1 2m20s Normal SuccessfulCreate replicaset/ai-gateway-controller-6674db54f7 Created pod: ai-gateway-controller-6674db54f7-p5fsn 2m19s Normal Pulling pod/ai-gateway-controller-6674db54f7-p5fsn Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:odh-pr-199" 2m19s Normal AddedInterface pod/ai-gateway-controller-6674db54f7-p5fsn Add eth0 [10.133.0.40/23] from ovn-kubernetes 2m17s Normal Started pod/ai-gateway-controller-6674db54f7-p5fsn Container started 2m17s Normal Created pod/ai-gateway-controller-6674db54f7-p5fsn Container created 2m17s Normal Pulled pod/ai-gateway-controller-6674db54f7-p5fsn Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:odh-pr-199" in 2.435s (2.435s including waiting). Image size: 183888298 bytes. 2m15s Normal LeaderElection lease/ai-gateway-controller-leader.opendatahub.io ai-gateway-controller-6674db54f7-p5fsn_b37aaf86-3a73-479f-bdc1-934e5838b9a3 became leader 2m5s Normal SuccessfulCreate replicaset/ai-gateway-controller-f5bcf9b7b Created pod: ai-gateway-controller-f5bcf9b7b-bmnlj 2m5s Normal ScalingReplicaSet deployment/ai-gateway-controller Scaled up replica set ai-gateway-controller-f5bcf9b7b from 0 to 1 2m4s Normal Created pod/ai-gateway-controller-f5bcf9b7b-bmnlj Container created 2m4s Normal Started pod/ai-gateway-controller-f5bcf9b7b-bmnlj Container started 2m4s Normal Pulled pod/ai-gateway-controller-f5bcf9b7b-bmnlj Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:odh-pr-199" in 342ms (342ms including waiting). Image size: 183888298 bytes. 2m4s Normal AddedInterface pod/ai-gateway-controller-f5bcf9b7b-bmnlj Add eth0 [10.133.0.44/23] from ovn-kubernetes 2m4s Normal Pulling pod/ai-gateway-controller-f5bcf9b7b-bmnlj Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:odh-pr-199" 112s Normal Killing pod/ai-gateway-controller-6674db54f7-p5fsn Stopping container manager 112s Normal ScalingReplicaSet deployment/ai-gateway-controller Scaled down replica set ai-gateway-controller-6674db54f7 from 1 to 0 112s Normal SuccessfulDelete replicaset/ai-gateway-controller-6674db54f7 Deleted pod: ai-gateway-controller-6674db54f7-p5fsn 92s Normal LeaderElection lease/ai-gateway-controller-leader.opendatahub.io ai-gateway-controller-f5bcf9b7b-bmnlj_92dfe373-8459-4c85-bf87-1696e9fc73c7 became leader