=== events in opendatahub (2026-10-31T00:41:13Z) === LAST SEEN TYPE REASON OBJECT MESSAGE 4m15s Normal Scheduled pod/maas-controller-6559d94fb4-rgmkg Successfully assigned opendatahub/maas-controller-6559d94fb4-rgmkg to ip-10-0-132-126.us-west-2.compute.internal 3m31s Normal Scheduled pod/llmisvc-controller-manager-869d5dcc5d-srlcp Successfully assigned opendatahub/llmisvc-controller-manager-869d5dcc5d-srlcp to ip-10-0-135-211.us-west-2.compute.internal 3m31s Normal Scheduled pod/odh-model-controller-769875db56-6nf96 Successfully assigned opendatahub/odh-model-controller-769875db56-6nf96 to ip-10-0-131-250.us-west-2.compute.internal 4m15s Normal Scheduled pod/maas-controller-579cf7c6d-m229h Successfully assigned opendatahub/maas-controller-579cf7c6d-m229h to ip-10-0-132-126.us-west-2.compute.internal 3m31s Normal Scheduled pod/kserve-controller-manager-776cc66d47-8ftd6 Successfully assigned opendatahub/kserve-controller-manager-776cc66d47-8ftd6 to ip-10-0-135-211.us-west-2.compute.internal 2m20s Normal Scheduled pod/llmisvc-controller-manager-6466c554d8-n95x5 Successfully assigned opendatahub/llmisvc-controller-manager-6466c554d8-n95x5 to ip-10-0-135-211.us-west-2.compute.internal 3m31s Normal Scheduled pod/model-serving-api-75bd89fdfc-f6t4w Successfully assigned opendatahub/model-serving-api-75bd89fdfc-f6t4w to ip-10-0-135-211.us-west-2.compute.internal 4m39s Normal Scheduled pod/kserve-module-controller-manager-7566cf5fc8-jh77s Successfully assigned opendatahub/kserve-module-controller-manager-7566cf5fc8-jh77s to ip-10-0-132-126.us-west-2.compute.internal 4m8s Normal Scheduled pod/usage-logs-tenancy-proxy-9c5d49bcd-nftlh Successfully assigned opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-nftlh to ip-10-0-132-126.us-west-2.compute.internal 4m40s Normal SuccessfulCreate replicaset/kserve-module-controller-manager-7566cf5fc8 Created pod: kserve-module-controller-manager-7566cf5fc8-jh77s 4m40s Normal ScalingReplicaSet deployment/kserve-module-controller-manager Scaled up replica set kserve-module-controller-manager-7566cf5fc8 from 0 to 1 4m39s Normal AddedInterface pod/kserve-module-controller-manager-7566cf5fc8-jh77s Add eth0 [10.133.0.26/23] from ovn-kubernetes 4m39s Normal Pulling pod/kserve-module-controller-manager-7566cf5fc8-jh77s Pulling image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189" 4m36s Normal Pulled pod/kserve-module-controller-manager-7566cf5fc8-jh77s Successfully pulled image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189" in 2.547s (2.547s including waiting). Image size: 195729000 bytes. 4m36s Normal Started pod/kserve-module-controller-manager-7566cf5fc8-jh77s Container started 4m36s Normal Created pod/kserve-module-controller-manager-7566cf5fc8-jh77s Container created 4m19s Normal LeaderElection lease/kserve-module-controller-manager kserve-module-controller-manager-7566cf5fc8-jh77s_a3654b2c-faaa-4445-8957-b3641b37d816 became leader 4m16s Normal SuccessfulCreate replicaset/maas-controller-579cf7c6d Created pod: maas-controller-579cf7c6d-m229h 4m16s Normal ScalingReplicaSet deployment/maas-controller Scaled up replica set maas-controller-579cf7c6d from 0 to 1 4m15s Normal Pulling pod/maas-controller-579cf7c6d-m229h Pulling image "quay.io/opendatahub/maas-controller:7879675aa66d002425c7b32375d6d0156eaa0c56" 4m15s Normal AddedInterface pod/maas-controller-579cf7c6d-m229h Add eth0 [10.133.0.27/23] from ovn-kubernetes 4m15s Normal AddedInterface pod/maas-controller-6559d94fb4-rgmkg Add eth0 [10.133.0.28/23] from ovn-kubernetes 4m15s Normal SuccessfulCreate replicaset/maas-controller-6559d94fb4 Created pod: maas-controller-6559d94fb4-rgmkg 4m15s Normal ScalingReplicaSet deployment/maas-controller Scaled up replica set maas-controller-6559d94fb4 from 0 to 1 4m11s Normal Started pod/maas-controller-579cf7c6d-m229h Container started 4m11s Normal Pulled pod/maas-controller-579cf7c6d-m229h Successfully pulled image "quay.io/opendatahub/maas-controller:7879675aa66d002425c7b32375d6d0156eaa0c56" in 3.672s (3.672s including waiting). Image size: 200053271 bytes. 4m11s Normal Pulled pod/maas-controller-6559d94fb4-rgmkg Successfully pulled image "quay.io/opendatahub/maas-controller:7879675aa66d002425c7b32375d6d0156eaa0c56" in 3.414s (3.414s including waiting). Image size: 200053271 bytes. 4m11s Normal Created pod/maas-controller-579cf7c6d-m229h Container created 4m9s Normal LeaderElection lease/maas-controller.models-as-a-service.opendatahub.io maas-controller-579cf7c6d-m229h_6b814c1d-69a7-4354-bcf1-3689e47a329e became leader 4m8s Normal SuccessfulCreate replicaset/usage-logs-tenancy-proxy-9c5d49bcd Created pod: usage-logs-tenancy-proxy-9c5d49bcd-nftlh 4m8s Warning FailedMount pod/usage-logs-tenancy-proxy-9c5d49bcd-nftlh MountVolume.SetUp failed for volume "tls-cert" : secret "usage-logs-tenancy-proxy-tls" not found 4m8s Normal ScalingReplicaSet deployment/usage-logs-tenancy-proxy Scaled up replica set usage-logs-tenancy-proxy-9c5d49bcd from 0 to 1 4m8s Warning FailedMount pod/usage-logs-tenancy-proxy-9c5d49bcd-nftlh MountVolume.SetUp failed for volume "proxy-source" : configmap "usage-tenancy-proxy-source" not found 4m7s Normal AddedInterface pod/usage-logs-tenancy-proxy-9c5d49bcd-nftlh Add eth0 [10.133.0.29/23] from ovn-kubernetes 4m7s Normal Pulling pod/usage-logs-tenancy-proxy-9c5d49bcd-nftlh Pulling image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172" 3m59s Normal SuccessfulDelete replicaset/maas-controller-579cf7c6d Deleted pod: maas-controller-579cf7c6d-m229h 3m59s Normal ScalingReplicaSet deployment/maas-controller Scaled down replica set maas-controller-579cf7c6d from 1 to 0 3m59s Normal Killing pod/maas-controller-579cf7c6d-m229h Stopping container manager 3m52s Normal Started pod/usage-logs-tenancy-proxy-9c5d49bcd-nftlh Container started 3m52s Normal Created pod/usage-logs-tenancy-proxy-9c5d49bcd-nftlh Container created 3m52s Normal Pulled pod/usage-logs-tenancy-proxy-9c5d49bcd-nftlh Successfully pulled image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172" in 14.298s (14.298s including waiting). Image size: 1089502687 bytes. 3m43s Normal LeaderElection lease/maas-controller.models-as-a-service.opendatahub.io maas-controller-6559d94fb4-rgmkg_101202df-5870-4821-a844-1556dfe3d51e became leader 3m32s Normal ScalingReplicaSet deployment/kserve-controller-manager Scaled up replica set kserve-controller-manager-776cc66d47 from 0 to 1 3m31s Normal AddedInterface pod/kserve-controller-manager-776cc66d47-8ftd6 Add eth0 [10.134.0.30/23] from ovn-kubernetes 3m31s Normal Pulling pod/kserve-controller-manager-776cc66d47-8ftd6 Pulling image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d" 3m31s Normal Pulling pod/llmisvc-controller-manager-869d5dcc5d-srlcp Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" 3m31s Normal SuccessfulCreate replicaset/llmisvc-controller-manager-869d5dcc5d Created pod: llmisvc-controller-manager-869d5dcc5d-srlcp 3m31s Normal ScalingReplicaSet deployment/llmisvc-controller-manager Scaled up replica set llmisvc-controller-manager-869d5dcc5d from 0 to 1 3m31s Normal SuccessfulCreate replicaset/odh-model-controller-769875db56 Created pod: odh-model-controller-769875db56-6nf96 3m31s Normal Pulling pod/model-serving-api-75bd89fdfc-f6t4w Pulling image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8" 3m31s Normal SuccessfulCreate replicaset/model-serving-api-75bd89fdfc Created pod: model-serving-api-75bd89fdfc-f6t4w 3m31s Normal ScalingReplicaSet deployment/model-serving-api Scaled up replica set model-serving-api-75bd89fdfc from 0 to 1 3m31s Normal ScalingReplicaSet deployment/odh-model-controller Scaled up replica set odh-model-controller-769875db56 from 0 to 1 3m31s Normal SuccessfulCreate replicaset/kserve-controller-manager-776cc66d47 Created pod: kserve-controller-manager-776cc66d47-8ftd6 3m31s Normal AddedInterface pod/model-serving-api-75bd89fdfc-f6t4w Add eth0 [10.134.0.32/23] from ovn-kubernetes 3m31s Normal AddedInterface pod/llmisvc-controller-manager-869d5dcc5d-srlcp Add eth0 [10.134.0.31/23] from ovn-kubernetes 3m30s Normal AddedInterface pod/odh-model-controller-769875db56-6nf96 Add eth0 [10.132.0.46/23] from ovn-kubernetes 3m30s Normal Pulling pod/odh-model-controller-769875db56-6nf96 Pulling image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775" 3m28s Normal Created pod/llmisvc-controller-manager-869d5dcc5d-srlcp Container created 3m28s Normal Pulled pod/llmisvc-controller-manager-869d5dcc5d-srlcp Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 2.833s (2.834s including waiting). Image size: 235100981 bytes. 3m28s Normal Started pod/llmisvc-controller-manager-869d5dcc5d-srlcp Container started 3m27s Normal Created pod/model-serving-api-75bd89fdfc-f6t4w Container created 3m27s Normal Pulled pod/kserve-controller-manager-776cc66d47-8ftd6 Successfully pulled image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d" in 3.251s (3.251s including waiting). Image size: 247676581 bytes. 3m27s Normal Created pod/kserve-controller-manager-776cc66d47-8ftd6 Container created 3m27s Normal Pulled pod/model-serving-api-75bd89fdfc-f6t4w Successfully pulled image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8" in 3.32s (3.32s including waiting). Image size: 184925761 bytes. 3m27s Normal Started pod/kserve-controller-manager-776cc66d47-8ftd6 Container started 3m27s Normal Started pod/model-serving-api-75bd89fdfc-f6t4w Container started 3m26s Normal Pulled pod/odh-model-controller-769875db56-6nf96 Successfully pulled image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775" in 3.99s (3.99s including waiting). Image size: 236755567 bytes. 3m26s Normal Started pod/odh-model-controller-769875db56-6nf96 Container started 3m26s Normal Created pod/odh-model-controller-769875db56-6nf96 Container created 3m25s Normal LeaderElection lease/kserve-controller-manager-leader-lock kserve-controller-manager-776cc66d47-8ftd6_6727c7f9-f7eb-4402-ba22-a0793e3cd369 became leader 3m25s Normal LeaderElection lease/odh-model-controller.opendatahub.io odh-model-controller-769875db56-6nf96_d9adb963-141d-49fb-8cfc-c9da99f7cb78 became leader 3m24s Normal LeaderElection lease/llminferenceservice-kserve-controller-manager llmisvc-controller-manager-869d5dcc5d-srlcp_f385288e-bf1d-465d-868c-b55ff951bbf1 became leader 2m20s Normal ScalingReplicaSet deployment/llmisvc-controller-manager Scaled up replica set llmisvc-controller-manager-6466c554d8 from 0 to 1 2m20s Normal SuccessfulCreate replicaset/llmisvc-controller-manager-6466c554d8 Created pod: llmisvc-controller-manager-6466c554d8-n95x5 2m19s Normal AddedInterface pod/llmisvc-controller-manager-6466c554d8-n95x5 Add eth0 [10.134.0.33/23] from ovn-kubernetes 2m19s Normal Pulling pod/llmisvc-controller-manager-6466c554d8-n95x5 Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" 2m18s Normal Pulled pod/llmisvc-controller-manager-6466c554d8-n95x5 Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 843ms (843ms including waiting). Image size: 235100981 bytes. 2m18s Normal Started pod/llmisvc-controller-manager-6466c554d8-n95x5 Container started 2m18s Normal Created pod/llmisvc-controller-manager-6466c554d8-n95x5 Container created 106s Normal Killing pod/llmisvc-controller-manager-869d5dcc5d-srlcp Stopping container manager 106s Normal SuccessfulDelete replicaset/llmisvc-controller-manager-869d5dcc5d Deleted pod: llmisvc-controller-manager-869d5dcc5d-srlcp 106s Normal ScalingReplicaSet deployment/llmisvc-controller-manager Scaled down replica set llmisvc-controller-manager-869d5dcc5d from 1 to 0 102s Normal Pulling pod/maas-controller-6559d94fb4-rgmkg Pulling image "quay.io/opendatahub/maas-controller:7879675aa66d002425c7b32375d6d0156eaa0c56" 101s Normal Created pod/maas-controller-6559d94fb4-rgmkg Container created 101s Normal Started pod/maas-controller-6559d94fb4-rgmkg Container started 101s Normal Pulled pod/maas-controller-6559d94fb4-rgmkg Successfully pulled image "quay.io/opendatahub/maas-controller:7879675aa66d002425c7b32375d6d0156eaa0c56" in 1.032s (1.032s including waiting). Image size: 200053271 bytes. 88s Normal LeaderElection lease/llminferenceservice-kserve-controller-manager llmisvc-controller-manager-6466c554d8-n95x5_f8c7d3ee-8602-493a-953b-2fb59721cb6b became leader 83s Normal LeaderElection lease/maas-controller.models-as-a-service.opendatahub.io maas-controller-6559d94fb4-rgmkg_a023631b-bec4-4f31-a0e0-07c284fc7c1d became leader