=== events in opendatahub (2026-10-31T00:56:17Z) === LAST SEEN TYPE REASON OBJECT MESSAGE 7m25s Normal Scheduled pod/usage-logs-tenancy-proxy-9c5d49bcd-kz9jh Successfully assigned opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-kz9jh to ip-10-0-134-13.us-west-1.compute.internal 8m13s Normal Scheduled pod/kserve-module-controller-manager-7566cf5fc8-mr9jj Successfully assigned opendatahub/kserve-module-controller-manager-7566cf5fc8-mr9jj to ip-10-0-134-13.us-west-1.compute.internal 5m56s Normal Scheduled pod/llmisvc-controller-manager-6466c554d8-6hhzn Successfully assigned opendatahub/llmisvc-controller-manager-6466c554d8-6hhzn to ip-10-0-129-193.us-west-1.compute.internal 7m32s Normal Scheduled pod/maas-controller-748b6794c7-vvvsz Successfully assigned opendatahub/maas-controller-748b6794c7-vvvsz to ip-10-0-134-13.us-west-1.compute.internal 7m32s Normal Scheduled pod/maas-controller-579cf7c6d-42jqf Successfully assigned opendatahub/maas-controller-579cf7c6d-42jqf to ip-10-0-134-13.us-west-1.compute.internal 7m4s Normal Scheduled pod/model-serving-api-75bd89fdfc-psrrv Successfully assigned opendatahub/model-serving-api-75bd89fdfc-psrrv to ip-10-0-143-42.us-west-1.compute.internal 7m4s Normal Scheduled pod/kserve-controller-manager-776cc66d47-2vz54 Successfully assigned opendatahub/kserve-controller-manager-776cc66d47-2vz54 to ip-10-0-134-13.us-west-1.compute.internal 7m4s Normal Scheduled pod/llmisvc-controller-manager-869d5dcc5d-92lmk Successfully assigned opendatahub/llmisvc-controller-manager-869d5dcc5d-92lmk to ip-10-0-129-193.us-west-1.compute.internal 7m4s Normal Scheduled pod/odh-model-controller-769875db56-nq6nr Successfully assigned opendatahub/odh-model-controller-769875db56-nq6nr to ip-10-0-134-13.us-west-1.compute.internal 3m45s Normal Scheduled pod/ai-gateway-controller-97797459f-9cvnw Successfully assigned opendatahub/ai-gateway-controller-97797459f-9cvnw to ip-10-0-143-42.us-west-1.compute.internal 4m4s Normal Scheduled pod/ai-gateway-controller-5f85cd9cfc-zf86v Successfully assigned opendatahub/ai-gateway-controller-5f85cd9cfc-zf86v to ip-10-0-134-13.us-west-1.compute.internal 8m13s Normal SuccessfulCreate replicaset/kserve-module-controller-manager-7566cf5fc8 Created pod: kserve-module-controller-manager-7566cf5fc8-mr9jj 8m13s Normal ScalingReplicaSet deployment/kserve-module-controller-manager Scaled up replica set kserve-module-controller-manager-7566cf5fc8 from 0 to 1 8m12s Normal AddedInterface pod/kserve-module-controller-manager-7566cf5fc8-mr9jj Add eth0 [10.133.0.25/23] from ovn-kubernetes 8m12s Normal Pulling pod/kserve-module-controller-manager-7566cf5fc8-mr9jj Pulling image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189" 8m10s Normal Created pod/kserve-module-controller-manager-7566cf5fc8-mr9jj Container created 8m10s Normal Started pod/kserve-module-controller-manager-7566cf5fc8-mr9jj Container started 8m10s Normal Pulled pod/kserve-module-controller-manager-7566cf5fc8-mr9jj Successfully pulled image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189" in 2.597s (2.597s including waiting). Image size: 195729000 bytes. 7m52s Normal LeaderElection lease/kserve-module-controller-manager kserve-module-controller-manager-7566cf5fc8-mr9jj_3aa377aa-7097-4de2-9a43-6fe793779a04 became leader 7m33s Normal SuccessfulCreate replicaset/maas-controller-579cf7c6d Created pod: maas-controller-579cf7c6d-42jqf 7m33s Normal ScalingReplicaSet deployment/maas-controller Scaled up replica set maas-controller-579cf7c6d from 0 to 1 7m32s Normal AddedInterface pod/maas-controller-748b6794c7-vvvsz Add eth0 [10.133.0.27/23] from ovn-kubernetes 7m32s Normal AddedInterface pod/maas-controller-579cf7c6d-42jqf Add eth0 [10.133.0.26/23] from ovn-kubernetes 7m32s Normal Pulling pod/maas-controller-579cf7c6d-42jqf Pulling image "quay.io/opendatahub/maas-controller:7879675aa66d002425c7b32375d6d0156eaa0c56" 7m32s Normal ScalingReplicaSet deployment/maas-controller Scaled up replica set maas-controller-748b6794c7 from 0 to 1 7m32s Normal SuccessfulCreate replicaset/maas-controller-748b6794c7 Created pod: maas-controller-748b6794c7-vvvsz 7m28s Normal Pulled pod/maas-controller-579cf7c6d-42jqf Successfully pulled image "quay.io/opendatahub/maas-controller:7879675aa66d002425c7b32375d6d0156eaa0c56" in 3.551s (3.551s including waiting). Image size: 200053271 bytes. 7m28s Normal Started pod/maas-controller-579cf7c6d-42jqf Container started 7m28s Normal Created pod/maas-controller-579cf7c6d-42jqf Container created 7m28s Normal Pulled pod/maas-controller-748b6794c7-vvvsz Successfully pulled image "quay.io/opendatahub/maas-controller:7879675aa66d002425c7b32375d6d0156eaa0c56" in 3.43s (3.43s including waiting). Image size: 200053271 bytes. 7m26s Normal LeaderElection lease/maas-controller.models-as-a-service.opendatahub.io maas-controller-579cf7c6d-42jqf_3ff26862-7ecf-4913-a682-27d85252cdb8 became leader 7m25s Warning FailedMount pod/usage-logs-tenancy-proxy-9c5d49bcd-kz9jh MountVolume.SetUp failed for volume "proxy-source" : configmap "usage-tenancy-proxy-source" not found 7m25s Warning FailedMount pod/usage-logs-tenancy-proxy-9c5d49bcd-kz9jh MountVolume.SetUp failed for volume "tls-cert" : secret "usage-logs-tenancy-proxy-tls" not found 7m25s Normal SuccessfulCreate replicaset/usage-logs-tenancy-proxy-9c5d49bcd Created pod: usage-logs-tenancy-proxy-9c5d49bcd-kz9jh 7m25s Normal ScalingReplicaSet deployment/usage-logs-tenancy-proxy Scaled up replica set usage-logs-tenancy-proxy-9c5d49bcd from 0 to 1 7m24s Normal AddedInterface pod/usage-logs-tenancy-proxy-9c5d49bcd-kz9jh Add eth0 [10.133.0.28/23] from ovn-kubernetes 7m24s Normal Pulling pod/usage-logs-tenancy-proxy-9c5d49bcd-kz9jh Pulling image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172" 7m16s Normal ScalingReplicaSet deployment/maas-controller Scaled down replica set maas-controller-579cf7c6d from 1 to 0 7m16s Normal SuccessfulDelete replicaset/maas-controller-579cf7c6d Deleted pod: maas-controller-579cf7c6d-42jqf 7m16s Normal Killing pod/maas-controller-579cf7c6d-42jqf Stopping container manager 7m10s Normal Pulled pod/usage-logs-tenancy-proxy-9c5d49bcd-kz9jh Successfully pulled image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172" in 13.338s (13.338s including waiting). Image size: 1089502687 bytes. 7m10s Normal Created pod/usage-logs-tenancy-proxy-9c5d49bcd-kz9jh Container created 7m10s Normal Started pod/usage-logs-tenancy-proxy-9c5d49bcd-kz9jh Container started 7m5s Normal SuccessfulCreate replicaset/kserve-controller-manager-776cc66d47 Created pod: kserve-controller-manager-776cc66d47-2vz54 7m5s Normal ScalingReplicaSet deployment/kserve-controller-manager Scaled up replica set kserve-controller-manager-776cc66d47 from 0 to 1 7m4s Normal Pulling pod/llmisvc-controller-manager-869d5dcc5d-92lmk Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" 7m4s Normal ScalingReplicaSet deployment/model-serving-api Scaled up replica set model-serving-api-75bd89fdfc from 0 to 1 7m4s Normal AddedInterface pod/model-serving-api-75bd89fdfc-psrrv Add eth0 [10.132.0.43/23] from ovn-kubernetes 7m4s Normal Pulling pod/model-serving-api-75bd89fdfc-psrrv Pulling image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8" 7m4s Normal AddedInterface pod/llmisvc-controller-manager-869d5dcc5d-92lmk Add eth0 [10.134.0.30/23] from ovn-kubernetes 7m4s Normal Pulling pod/kserve-controller-manager-776cc66d47-2vz54 Pulling image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d" 7m4s Normal SuccessfulCreate replicaset/model-serving-api-75bd89fdfc Created pod: model-serving-api-75bd89fdfc-psrrv 7m4s Normal AddedInterface pod/kserve-controller-manager-776cc66d47-2vz54 Add eth0 [10.133.0.30/23] from ovn-kubernetes 7m4s Normal AddedInterface pod/odh-model-controller-769875db56-nq6nr Add eth0 [10.133.0.31/23] from ovn-kubernetes 7m4s Normal ScalingReplicaSet deployment/odh-model-controller Scaled up replica set odh-model-controller-769875db56 from 0 to 1 7m4s Normal SuccessfulCreate replicaset/llmisvc-controller-manager-869d5dcc5d Created pod: llmisvc-controller-manager-869d5dcc5d-92lmk 7m4s Normal SuccessfulCreate replicaset/odh-model-controller-769875db56 Created pod: odh-model-controller-769875db56-nq6nr 7m4s Normal ScalingReplicaSet deployment/llmisvc-controller-manager Scaled up replica set llmisvc-controller-manager-869d5dcc5d from 0 to 1 7m3s Normal Pulling pod/odh-model-controller-769875db56-nq6nr Pulling image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775" 7m1s Normal Started pod/llmisvc-controller-manager-869d5dcc5d-92lmk Container started 7m1s Normal Pulled pod/model-serving-api-75bd89fdfc-psrrv Successfully pulled image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8" in 2.157s (2.157s including waiting). Image size: 184925761 bytes. 7m1s Normal Created pod/model-serving-api-75bd89fdfc-psrrv Container created 7m1s Normal Started pod/model-serving-api-75bd89fdfc-psrrv Container started 7m1s Normal Pulled pod/kserve-controller-manager-776cc66d47-2vz54 Successfully pulled image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d" in 3.061s (3.061s including waiting). Image size: 247676581 bytes. 7m1s Normal Created pod/llmisvc-controller-manager-869d5dcc5d-92lmk Container created 7m1s Normal Pulled pod/llmisvc-controller-manager-869d5dcc5d-92lmk Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 2.344s (2.344s including waiting). Image size: 235100981 bytes. 7m1s Normal Started pod/kserve-controller-manager-776cc66d47-2vz54 Container started 7m1s Normal Created pod/kserve-controller-manager-776cc66d47-2vz54 Container created 7m Normal Pulled pod/odh-model-controller-769875db56-nq6nr Successfully pulled image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775" in 3.754s (3.754s including waiting). Image size: 236755567 bytes. 7m Normal Created pod/odh-model-controller-769875db56-nq6nr Container created 7m Normal LeaderElection lease/kserve-controller-manager-leader-lock kserve-controller-manager-776cc66d47-2vz54_97944bb5-a3bc-4b2b-8670-dc2682083999 became leader 7m Normal LeaderElection lease/llminferenceservice-kserve-controller-manager llmisvc-controller-manager-869d5dcc5d-92lmk_17090468-4dd1-4d8f-9d19-85e1fa216e2b became leader 7m Normal Started pod/odh-model-controller-769875db56-nq6nr Container started 6m59s Normal LeaderElection lease/odh-model-controller.opendatahub.io odh-model-controller-769875db56-nq6nr_c463ba92-0e12-4e7d-8a2d-68f9c3fdd391 became leader 6m56s Normal LeaderElection lease/maas-controller.models-as-a-service.opendatahub.io maas-controller-748b6794c7-vvvsz_db386bec-b980-48ea-9411-39eee4a3a83b became leader 5m56s Normal SuccessfulCreate replicaset/llmisvc-controller-manager-6466c554d8 Created pod: llmisvc-controller-manager-6466c554d8-6hhzn 5m56s Normal AddedInterface pod/llmisvc-controller-manager-6466c554d8-6hhzn Add eth0 [10.134.0.34/23] from ovn-kubernetes 5m56s Normal Pulling pod/llmisvc-controller-manager-6466c554d8-6hhzn Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" 5m56s Normal ScalingReplicaSet deployment/llmisvc-controller-manager Scaled up replica set llmisvc-controller-manager-6466c554d8 from 0 to 1 5m55s Normal Pulled pod/llmisvc-controller-manager-6466c554d8-6hhzn Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 769ms (769ms including waiting). Image size: 235100981 bytes. 5m55s Normal Created pod/llmisvc-controller-manager-6466c554d8-6hhzn Container created 5m55s Normal Started pod/llmisvc-controller-manager-6466c554d8-6hhzn Container started 5m23s Normal ScalingReplicaSet deployment/llmisvc-controller-manager Scaled down replica set llmisvc-controller-manager-869d5dcc5d from 1 to 0 5m23s Normal Killing pod/llmisvc-controller-manager-869d5dcc5d-92lmk Stopping container manager 5m23s Normal SuccessfulDelete replicaset/llmisvc-controller-manager-869d5dcc5d Deleted pod: llmisvc-controller-manager-869d5dcc5d-92lmk 5m6s Normal LeaderElection lease/llminferenceservice-kserve-controller-manager llmisvc-controller-manager-6466c554d8-6hhzn_f060db2b-6f13-4f4f-88ad-b127dff57b61 became leader 4m56s Normal Pulling pod/maas-controller-748b6794c7-vvvsz Pulling image "quay.io/opendatahub/maas-controller:7879675aa66d002425c7b32375d6d0156eaa0c56" 4m55s Normal Created pod/maas-controller-748b6794c7-vvvsz Container created 4m55s Normal Pulled pod/maas-controller-748b6794c7-vvvsz Successfully pulled image "quay.io/opendatahub/maas-controller:7879675aa66d002425c7b32375d6d0156eaa0c56" in 936ms (936ms including waiting). Image size: 200053271 bytes. 4m55s Normal Started pod/maas-controller-748b6794c7-vvvsz Container started 4m36s Normal LeaderElection lease/maas-controller.models-as-a-service.opendatahub.io maas-controller-748b6794c7-vvvsz_e6bdfc5a-75c6-4831-ad65-2da5fb9f0fac became leader 4m5s Normal ScalingReplicaSet deployment/ai-gateway-controller Scaled up replica set ai-gateway-controller-5f85cd9cfc from 0 to 1 4m5s Normal SuccessfulCreate replicaset/ai-gateway-controller-5f85cd9cfc Created pod: ai-gateway-controller-5f85cd9cfc-zf86v 4m4s Normal Pulling pod/ai-gateway-controller-5f85cd9cfc-zf86v Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:odh-pr-177" 4m4s Normal AddedInterface pod/ai-gateway-controller-5f85cd9cfc-zf86v Add eth0 [10.133.0.39/23] from ovn-kubernetes 3m57s Normal LeaderElection lease/ai-gateway-controller-leader.opendatahub.io ai-gateway-controller-5f85cd9cfc-zf86v_57a1bba7-83b3-4699-8644-2b522ead5cd0 became leader 3m57s Normal Created pod/ai-gateway-controller-5f85cd9cfc-zf86v Container created 3m57s Normal Pulled pod/ai-gateway-controller-5f85cd9cfc-zf86v Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:odh-pr-177" in 6.529s (6.529s including waiting). Image size: 183987623 bytes. 3m57s Normal Started pod/ai-gateway-controller-5f85cd9cfc-zf86v Container started 3m45s Normal SuccessfulCreate replicaset/ai-gateway-controller-97797459f Created pod: ai-gateway-controller-97797459f-9cvnw 3m45s Normal ScalingReplicaSet deployment/ai-gateway-controller Scaled up replica set ai-gateway-controller-97797459f from 0 to 1 3m44s Normal Pulling pod/ai-gateway-controller-97797459f-9cvnw Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:odh-pr-177" 3m44s Normal AddedInterface pod/ai-gateway-controller-97797459f-9cvnw Add eth0 [10.132.0.50/23] from ovn-kubernetes 3m41s Normal Created pod/ai-gateway-controller-97797459f-9cvnw Container created 3m41s Normal Pulled pod/ai-gateway-controller-97797459f-9cvnw Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:odh-pr-177" in 2.846s (2.846s including waiting). Image size: 183987623 bytes. 3m41s Normal Started pod/ai-gateway-controller-97797459f-9cvnw Container started 3m30s Normal Killing pod/ai-gateway-controller-5f85cd9cfc-zf86v Stopping container manager 3m30s Normal SuccessfulDelete replicaset/ai-gateway-controller-5f85cd9cfc Deleted pod: ai-gateway-controller-5f85cd9cfc-zf86v 3m30s Normal ScalingReplicaSet deployment/ai-gateway-controller Scaled down replica set ai-gateway-controller-5f85cd9cfc from 1 to 0 3m13s Normal LeaderElection lease/ai-gateway-controller-leader.opendatahub.io ai-gateway-controller-97797459f-9cvnw_63fa5353-a30f-41d9-adef-2dbc47edc5a3 became leader