=== events in opendatahub (2026-11-02T16:36:21Z) === LAST SEEN TYPE REASON OBJECT MESSAGE 5m24s Normal Scheduled pod/llmisvc-controller-manager-869d5dcc5d-4vfjr Successfully assigned opendatahub/llmisvc-controller-manager-869d5dcc5d-4vfjr to ip-10-0-139-28.us-west-2.compute.internal 6m Normal Scheduled pod/usage-logs-tenancy-proxy-9c5d49bcd-hn4v9 Successfully assigned opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-hn4v9 to ip-10-0-139-28.us-west-2.compute.internal 6m10s Normal Scheduled pod/maas-controller-6cccbf955f-9djx2 Successfully assigned opendatahub/maas-controller-6cccbf955f-9djx2 to ip-10-0-139-28.us-west-2.compute.internal 6m10s Normal Scheduled pod/maas-controller-579cf7c6d-fbm62 Successfully assigned opendatahub/maas-controller-579cf7c6d-fbm62 to ip-10-0-139-28.us-west-2.compute.internal 4m15s Normal Scheduled pod/llmisvc-controller-manager-6466c554d8-4xtgf Successfully assigned opendatahub/llmisvc-controller-manager-6466c554d8-4xtgf to ip-10-0-139-28.us-west-2.compute.internal 5m24s Normal Scheduled pod/kserve-controller-manager-776cc66d47-rnvrc Successfully assigned opendatahub/kserve-controller-manager-776cc66d47-rnvrc to ip-10-0-139-28.us-west-2.compute.internal 6m33s Normal Scheduled pod/kserve-module-controller-manager-7566cf5fc8-pc5rg Successfully assigned opendatahub/kserve-module-controller-manager-7566cf5fc8-pc5rg to ip-10-0-133-252.us-west-2.compute.internal 5m24s Normal Scheduled pod/model-serving-api-75bd89fdfc-rjm4l Successfully assigned opendatahub/model-serving-api-75bd89fdfc-rjm4l to ip-10-0-139-28.us-west-2.compute.internal 2m31s Normal Scheduled pod/ai-gateway-controller-55cd769764-v2dvb Successfully assigned opendatahub/ai-gateway-controller-55cd769764-v2dvb to ip-10-0-137-117.us-west-2.compute.internal 5m24s Normal Scheduled pod/odh-model-controller-769875db56-5z64z Successfully assigned opendatahub/odh-model-controller-769875db56-5z64z to ip-10-0-133-252.us-west-2.compute.internal 6m33s Normal ScalingReplicaSet deployment/kserve-module-controller-manager Scaled up replica set kserve-module-controller-manager-7566cf5fc8 from 0 to 1 6m33s Normal SuccessfulCreate replicaset/kserve-module-controller-manager-7566cf5fc8 Created pod: kserve-module-controller-manager-7566cf5fc8-pc5rg 6m32s Normal AddedInterface pod/kserve-module-controller-manager-7566cf5fc8-pc5rg Add eth0 [10.132.0.50/23] from ovn-kubernetes 6m32s Normal Pulling pod/kserve-module-controller-manager-7566cf5fc8-pc5rg Pulling image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189" 6m27s Normal Created pod/kserve-module-controller-manager-7566cf5fc8-pc5rg Container created 6m27s Normal Started pod/kserve-module-controller-manager-7566cf5fc8-pc5rg Container started 6m27s Normal Pulled pod/kserve-module-controller-manager-7566cf5fc8-pc5rg Successfully pulled image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189" in 5.443s (5.443s including waiting). Image size: 195729000 bytes. 6m11s Normal ScalingReplicaSet deployment/maas-controller Scaled up replica set maas-controller-579cf7c6d from 0 to 1 6m11s Normal SuccessfulCreate replicaset/maas-controller-579cf7c6d Created pod: maas-controller-579cf7c6d-fbm62 6m10s Normal Pulling pod/maas-controller-579cf7c6d-fbm62 Pulling image "quay.io/opendatahub/maas-controller:7879675aa66d002425c7b32375d6d0156eaa0c56" 6m10s Normal ScalingReplicaSet deployment/maas-controller Scaled up replica set maas-controller-6cccbf955f from 0 to 1 6m10s Normal AddedInterface pod/maas-controller-579cf7c6d-fbm62 Add eth0 [10.133.0.28/23] from ovn-kubernetes 6m10s Normal SuccessfulCreate replicaset/maas-controller-6cccbf955f Created pod: maas-controller-6cccbf955f-9djx2 6m9s Normal AddedInterface pod/maas-controller-6cccbf955f-9djx2 Add eth0 [10.133.0.29/23] from ovn-kubernetes 6m9s Normal LeaderElection lease/kserve-module-controller-manager kserve-module-controller-manager-7566cf5fc8-pc5rg_31865c83-68dc-4d0e-9303-bee571a2c604 became leader 6m9s Normal Pulling pod/maas-controller-6cccbf955f-9djx2 Pulling image "quay.io/opendatahub/maas-controller:7879675aa66d002425c7b32375d6d0156eaa0c56" 6m3s Normal Created pod/maas-controller-579cf7c6d-fbm62 Container created 6m3s Normal Started pod/maas-controller-579cf7c6d-fbm62 Container started 6m3s Normal Created pod/maas-controller-6cccbf955f-9djx2 Container created 6m3s Normal Pulled pod/maas-controller-6cccbf955f-9djx2 Successfully pulled image "quay.io/opendatahub/maas-controller:7879675aa66d002425c7b32375d6d0156eaa0c56" in 5.876s (5.876s including waiting). Image size: 200053271 bytes. 6m3s Normal Pulled pod/maas-controller-579cf7c6d-fbm62 Successfully pulled image "quay.io/opendatahub/maas-controller:7879675aa66d002425c7b32375d6d0156eaa0c56" in 6.29s (6.29s including waiting). Image size: 200053271 bytes. 6m3s Normal Started pod/maas-controller-6cccbf955f-9djx2 Container started 6m2s Normal LeaderElection lease/maas-controller.models-as-a-service.opendatahub.io maas-controller-6cccbf955f-9djx2_2063be11-d842-4f4e-8570-7a173dbe7890 became leader 6m Normal SuccessfulCreate replicaset/usage-logs-tenancy-proxy-9c5d49bcd Created pod: usage-logs-tenancy-proxy-9c5d49bcd-hn4v9 6m Normal ScalingReplicaSet deployment/usage-logs-tenancy-proxy Scaled up replica set usage-logs-tenancy-proxy-9c5d49bcd from 0 to 1 6m Warning FailedMount pod/usage-logs-tenancy-proxy-9c5d49bcd-hn4v9 MountVolume.SetUp failed for volume "proxy-source" : configmap "usage-tenancy-proxy-source" not found 5m59s Normal AddedInterface pod/usage-logs-tenancy-proxy-9c5d49bcd-hn4v9 Add eth0 [10.133.0.30/23] from ovn-kubernetes 5m59s Normal Pulling pod/usage-logs-tenancy-proxy-9c5d49bcd-hn4v9 Pulling image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172" 5m52s Normal Killing pod/maas-controller-579cf7c6d-fbm62 Stopping container manager 5m52s Normal ScalingReplicaSet deployment/maas-controller Scaled down replica set maas-controller-579cf7c6d from 1 to 0 5m52s Normal SuccessfulDelete replicaset/maas-controller-579cf7c6d Deleted pod: maas-controller-579cf7c6d-fbm62 5m36s Normal Pulled pod/usage-logs-tenancy-proxy-9c5d49bcd-hn4v9 Successfully pulled image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172" in 23.144s (23.144s including waiting). Image size: 1089502687 bytes. 5m36s Normal Created pod/usage-logs-tenancy-proxy-9c5d49bcd-hn4v9 Container created 5m36s Normal Started pod/usage-logs-tenancy-proxy-9c5d49bcd-hn4v9 Container started 5m25s Normal SuccessfulCreate replicaset/llmisvc-controller-manager-869d5dcc5d Created pod: llmisvc-controller-manager-869d5dcc5d-4vfjr 5m25s Normal ScalingReplicaSet deployment/kserve-controller-manager Scaled up replica set kserve-controller-manager-776cc66d47 from 0 to 1 5m25s Normal ScalingReplicaSet deployment/llmisvc-controller-manager Scaled up replica set llmisvc-controller-manager-869d5dcc5d from 0 to 1 5m25s Normal SuccessfulCreate replicaset/kserve-controller-manager-776cc66d47 Created pod: kserve-controller-manager-776cc66d47-rnvrc 5m24s Normal AddedInterface pod/model-serving-api-75bd89fdfc-rjm4l Add eth0 [10.133.0.34/23] from ovn-kubernetes 5m24s Normal Pulling pod/model-serving-api-75bd89fdfc-rjm4l Pulling image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8" 5m24s Normal AddedInterface pod/kserve-controller-manager-776cc66d47-rnvrc Add eth0 [10.133.0.32/23] from ovn-kubernetes 5m24s Normal ScalingReplicaSet deployment/odh-model-controller Scaled up replica set odh-model-controller-769875db56 from 0 to 1 5m24s Normal SuccessfulCreate replicaset/odh-model-controller-769875db56 Created pod: odh-model-controller-769875db56-5z64z 5m24s Normal Pulling pod/odh-model-controller-769875db56-5z64z Pulling image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775" 5m24s Normal AddedInterface pod/odh-model-controller-769875db56-5z64z Add eth0 [10.132.0.53/23] from ovn-kubernetes 5m24s Normal Pulling pod/kserve-controller-manager-776cc66d47-rnvrc Pulling image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d" 5m24s Normal Pulling pod/llmisvc-controller-manager-869d5dcc5d-4vfjr Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" 5m24s Normal AddedInterface pod/llmisvc-controller-manager-869d5dcc5d-4vfjr Add eth0 [10.133.0.33/23] from ovn-kubernetes 5m24s Normal ScalingReplicaSet deployment/model-serving-api Scaled up replica set model-serving-api-75bd89fdfc from 0 to 1 5m24s Normal SuccessfulCreate replicaset/model-serving-api-75bd89fdfc Created pod: model-serving-api-75bd89fdfc-rjm4l 5m20s Normal Pulled pod/model-serving-api-75bd89fdfc-rjm4l Successfully pulled image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8" in 3.233s (3.233s including waiting). Image size: 184925761 bytes. 5m20s Normal Created pod/model-serving-api-75bd89fdfc-rjm4l Container created 5m20s Normal Started pod/odh-model-controller-769875db56-5z64z Container started 5m20s Normal Created pod/odh-model-controller-769875db56-5z64z Container created 5m20s Normal Pulled pod/odh-model-controller-769875db56-5z64z Successfully pulled image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775" in 3.574s (3.574s including waiting). Image size: 236755567 bytes. 5m20s Normal Started pod/model-serving-api-75bd89fdfc-rjm4l Container started 5m19s Normal LeaderElection lease/odh-model-controller.opendatahub.io odh-model-controller-769875db56-5z64z_5326fbad-7faf-4e2c-935d-11e9caf78e7b became leader 5m19s Normal Started pod/llmisvc-controller-manager-869d5dcc5d-4vfjr Container started 5m19s Normal Created pod/llmisvc-controller-manager-869d5dcc5d-4vfjr Container created 5m19s Normal Pulled pod/llmisvc-controller-manager-869d5dcc5d-4vfjr Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 4.757s (4.757s including waiting). Image size: 235100981 bytes. 5m17s Normal LeaderElection lease/llminferenceservice-kserve-controller-manager llmisvc-controller-manager-869d5dcc5d-4vfjr_c7d40f68-908a-4fe5-894e-5af237628fde became leader 5m16s Normal Pulled pod/kserve-controller-manager-776cc66d47-rnvrc Successfully pulled image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d" in 7.57s (7.57s including waiting). Image size: 247676581 bytes. 5m16s Normal Created pod/kserve-controller-manager-776cc66d47-rnvrc Container created 5m16s Normal Started pod/kserve-controller-manager-776cc66d47-rnvrc Container started 5m15s Normal LeaderElection lease/kserve-controller-manager-leader-lock kserve-controller-manager-776cc66d47-rnvrc_9802b127-b7a4-4204-a10d-1a9e0cbf014c became leader 4m15s Normal SuccessfulCreate replicaset/llmisvc-controller-manager-6466c554d8 Created pod: llmisvc-controller-manager-6466c554d8-4xtgf 4m15s Normal ScalingReplicaSet deployment/llmisvc-controller-manager Scaled up replica set llmisvc-controller-manager-6466c554d8 from 0 to 1 4m15s Normal AddedInterface pod/llmisvc-controller-manager-6466c554d8-4xtgf Add eth0 [10.133.0.35/23] from ovn-kubernetes 4m14s Normal Pulling pod/llmisvc-controller-manager-6466c554d8-4xtgf Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" 4m14s Normal Created pod/llmisvc-controller-manager-6466c554d8-4xtgf Container created 4m14s Normal Started pod/llmisvc-controller-manager-6466c554d8-4xtgf Container started 4m14s Normal Pulled pod/llmisvc-controller-manager-6466c554d8-4xtgf Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 788ms (788ms including waiting). Image size: 235100981 bytes. 3m42s Normal Killing pod/llmisvc-controller-manager-869d5dcc5d-4vfjr Stopping container manager 3m42s Normal SuccessfulDelete replicaset/llmisvc-controller-manager-869d5dcc5d Deleted pod: llmisvc-controller-manager-869d5dcc5d-4vfjr 3m42s Normal ScalingReplicaSet deployment/llmisvc-controller-manager Scaled down replica set llmisvc-controller-manager-869d5dcc5d from 1 to 0 3m23s Normal LeaderElection lease/llminferenceservice-kserve-controller-manager llmisvc-controller-manager-6466c554d8-4xtgf_0e9d89b8-1211-4370-90d3-4e982319ac21 became leader 2m31s Normal ScalingReplicaSet deployment/ai-gateway-controller Scaled up replica set ai-gateway-controller-55cd769764 from 0 to 1 2m31s Normal SuccessfulCreate replicaset/ai-gateway-controller-55cd769764 Created pod: ai-gateway-controller-55cd769764-v2dvb 2m30s Normal Pulling pod/ai-gateway-controller-55cd769764-v2dvb Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:odh-pr-185" 2m30s Normal AddedInterface pod/ai-gateway-controller-55cd769764-v2dvb Add eth0 [10.134.0.32/23] from ovn-kubernetes 2m23s Normal LeaderElection lease/ai-gateway-controller-leader.opendatahub.io ai-gateway-controller-55cd769764-v2dvb_1762fa10-fc54-45c8-a62f-37f47ec05993 became leader 2m23s Normal Started pod/ai-gateway-controller-55cd769764-v2dvb Container started 2m23s Normal Created pod/ai-gateway-controller-55cd769764-v2dvb Container created 2m23s Normal Pulled pod/ai-gateway-controller-55cd769764-v2dvb Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:odh-pr-185" in 6.832s (6.832s including waiting). Image size: 183991737 bytes.