=== events in opendatahub (2026-11-04T05:49:14Z) === LAST SEEN TYPE REASON OBJECT MESSAGE 11m Normal Scheduled pod/ai-gateway-controller-57c96dfd77-nsdrn Successfully assigned opendatahub/ai-gateway-controller-57c96dfd77-nsdrn to ip-10-0-130-185.us-west-2.compute.internal 14m Normal Scheduled pod/llmisvc-controller-manager-6466c554d8-flnsj Successfully assigned opendatahub/llmisvc-controller-manager-6466c554d8-flnsj to ip-10-0-139-34.us-west-2.compute.internal 5m9s Normal Scheduled pod/test-curl-7212-743d88 Successfully assigned opendatahub/test-curl-7212-743d88 to ip-10-0-139-34.us-west-2.compute.internal 5m9s Normal Scheduled pod/test-curl-7200-090f0b Successfully assigned opendatahub/test-curl-7200-090f0b to ip-10-0-133-143.us-west-2.compute.internal 15m Normal Scheduled pod/odh-model-controller-769875db56-rv57b Successfully assigned opendatahub/odh-model-controller-769875db56-rv57b to ip-10-0-133-143.us-west-2.compute.internal 15m Normal Scheduled pod/model-serving-api-75bd89fdfc-w5msn Successfully assigned opendatahub/model-serving-api-75bd89fdfc-w5msn to ip-10-0-133-143.us-west-2.compute.internal 16m Normal Scheduled pod/kserve-module-controller-manager-7566cf5fc8-m8srk Successfully assigned opendatahub/kserve-module-controller-manager-7566cf5fc8-m8srk to ip-10-0-133-143.us-west-2.compute.internal 15m Normal Scheduled pod/llmisvc-controller-manager-869d5dcc5d-kmbhd Successfully assigned opendatahub/llmisvc-controller-manager-869d5dcc5d-kmbhd to ip-10-0-139-34.us-west-2.compute.internal 15m Normal Scheduled pod/maas-controller-7d77d66d96-nq9gq Successfully assigned opendatahub/maas-controller-7d77d66d96-nq9gq to ip-10-0-139-34.us-west-2.compute.internal 15m Normal Scheduled pod/maas-controller-8b95c9c66-4nj68 Successfully assigned opendatahub/maas-controller-8b95c9c66-4nj68 to ip-10-0-139-34.us-west-2.compute.internal 15m Normal Scheduled pod/usage-logs-tenancy-proxy-9c5d49bcd-cjkv4 Successfully assigned opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-cjkv4 to ip-10-0-133-143.us-west-2.compute.internal 15m Normal Scheduled pod/kserve-controller-manager-776cc66d47-tn2gh Successfully assigned opendatahub/kserve-controller-manager-776cc66d47-tn2gh to ip-10-0-139-34.us-west-2.compute.internal 12m Normal Scheduled pod/ai-gateway-controller-79567948bc-gln67 Successfully assigned opendatahub/ai-gateway-controller-79567948bc-gln67 to ip-10-0-133-143.us-west-2.compute.internal 16m Normal AddedInterface pod/kserve-module-controller-manager-7566cf5fc8-m8srk Add eth0 [10.132.0.29/23] from ovn-kubernetes 16m Normal ScalingReplicaSet deployment/kserve-module-controller-manager Scaled up replica set kserve-module-controller-manager-7566cf5fc8 from 0 to 1 16m Normal SuccessfulCreate replicaset/kserve-module-controller-manager-7566cf5fc8 Created pod: kserve-module-controller-manager-7566cf5fc8-m8srk 16m Normal Pulling pod/kserve-module-controller-manager-7566cf5fc8-m8srk Pulling image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189" 16m Normal Started pod/kserve-module-controller-manager-7566cf5fc8-m8srk Container started 16m Normal Created pod/kserve-module-controller-manager-7566cf5fc8-m8srk Container created 16m Normal Pulled pod/kserve-module-controller-manager-7566cf5fc8-m8srk Successfully pulled image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189" in 3.003s (3.003s including waiting). Image size: 195729000 bytes. 16m Normal LeaderElection lease/kserve-module-controller-manager kserve-module-controller-manager-7566cf5fc8-m8srk_376b10d3-8706-4ecf-869c-aebaba6bd42a became leader 15m Normal ScalingReplicaSet deployment/maas-controller Scaled up replica set maas-controller-8b95c9c66 from 0 to 1 15m Normal SuccessfulCreate replicaset/maas-controller-8b95c9c66 Created pod: maas-controller-8b95c9c66-4nj68 15m Normal AddedInterface pod/maas-controller-7d77d66d96-nq9gq Add eth0 [10.133.0.40/23] from ovn-kubernetes 15m Normal Pulling pod/maas-controller-8b95c9c66-4nj68 Pulling image "quay.io/opendatahub/maas-controller:08858542cd3bba18175e02ba9b8418547f22ade2" 15m Normal ScalingReplicaSet deployment/maas-controller Scaled up replica set maas-controller-7d77d66d96 from 0 to 1 15m Normal Pulling pod/maas-controller-7d77d66d96-nq9gq Pulling image "quay.io/opendatahub/maas-controller:08858542cd3bba18175e02ba9b8418547f22ade2" 15m Normal SuccessfulCreate replicaset/maas-controller-7d77d66d96 Created pod: maas-controller-7d77d66d96-nq9gq 15m Normal AddedInterface pod/maas-controller-8b95c9c66-4nj68 Add eth0 [10.133.0.39/23] from ovn-kubernetes 15m Normal Created pod/maas-controller-7d77d66d96-nq9gq Container created 15m Normal Pulled pod/maas-controller-8b95c9c66-4nj68 Successfully pulled image "quay.io/opendatahub/maas-controller:08858542cd3bba18175e02ba9b8418547f22ade2" in 3.597s (3.597s including waiting). Image size: 200103442 bytes. 15m Normal Created pod/maas-controller-8b95c9c66-4nj68 Container created 15m Normal Started pod/maas-controller-8b95c9c66-4nj68 Container started 15m Normal Started pod/maas-controller-7d77d66d96-nq9gq Container started 15m Normal Pulled pod/maas-controller-7d77d66d96-nq9gq Successfully pulled image "quay.io/opendatahub/maas-controller:08858542cd3bba18175e02ba9b8418547f22ade2" in 3.467s (3.467s including waiting). Image size: 200103442 bytes. 15m Normal LeaderElection lease/maas-controller.models-as-a-service.opendatahub.io maas-controller-7d77d66d96-nq9gq_deca6d8a-314a-4ff4-b1b6-d424f57d87ad became leader 15m Normal ScalingReplicaSet deployment/usage-logs-tenancy-proxy Scaled up replica set usage-logs-tenancy-proxy-9c5d49bcd from 0 to 1 15m Normal SuccessfulCreate replicaset/usage-logs-tenancy-proxy-9c5d49bcd Created pod: usage-logs-tenancy-proxy-9c5d49bcd-cjkv4 15m Warning FailedMount pod/usage-logs-tenancy-proxy-9c5d49bcd-cjkv4 MountVolume.SetUp failed for volume "proxy-source" : configmap "usage-tenancy-proxy-source" not found 15m Warning FailedMount pod/usage-logs-tenancy-proxy-9c5d49bcd-cjkv4 MountVolume.SetUp failed for volume "tls-cert" : secret "usage-logs-tenancy-proxy-tls" not found 15m Normal AddedInterface pod/usage-logs-tenancy-proxy-9c5d49bcd-cjkv4 Add eth0 [10.132.0.30/23] from ovn-kubernetes 15m Normal Pulling pod/usage-logs-tenancy-proxy-9c5d49bcd-cjkv4 Pulling image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172" 15m Normal Killing pod/maas-controller-8b95c9c66-4nj68 Stopping container manager 15m Normal SuccessfulDelete replicaset/maas-controller-8b95c9c66 Deleted pod: maas-controller-8b95c9c66-4nj68 15m Normal ScalingReplicaSet deployment/maas-controller Scaled down replica set maas-controller-8b95c9c66 from 1 to 0 15m Normal ScalingReplicaSet deployment/kserve-controller-manager Scaled up replica set kserve-controller-manager-776cc66d47 from 0 to 1 15m Normal SuccessfulCreate replicaset/kserve-controller-manager-776cc66d47 Created pod: kserve-controller-manager-776cc66d47-tn2gh 15m Normal ScalingReplicaSet deployment/model-serving-api Scaled up replica set model-serving-api-75bd89fdfc from 0 to 1 15m Normal Pulling pod/kserve-controller-manager-776cc66d47-tn2gh Pulling image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d" 15m Normal AddedInterface pod/llmisvc-controller-manager-869d5dcc5d-kmbhd Add eth0 [10.133.0.42/23] from ovn-kubernetes 15m Normal AddedInterface pod/kserve-controller-manager-776cc66d47-tn2gh Add eth0 [10.133.0.41/23] from ovn-kubernetes 15m Normal SuccessfulCreate replicaset/odh-model-controller-769875db56 Created pod: odh-model-controller-769875db56-rv57b 15m Normal ScalingReplicaSet deployment/odh-model-controller Scaled up replica set odh-model-controller-769875db56 from 0 to 1 15m Normal SuccessfulCreate replicaset/model-serving-api-75bd89fdfc Created pod: model-serving-api-75bd89fdfc-w5msn 15m Normal ScalingReplicaSet deployment/llmisvc-controller-manager Scaled up replica set llmisvc-controller-manager-869d5dcc5d from 0 to 1 15m Normal SuccessfulCreate replicaset/llmisvc-controller-manager-869d5dcc5d Created pod: llmisvc-controller-manager-869d5dcc5d-kmbhd 15m Normal Pulling pod/llmisvc-controller-manager-869d5dcc5d-kmbhd Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" 15m Normal Pulling pod/model-serving-api-75bd89fdfc-w5msn Pulling image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8" 15m Normal AddedInterface pod/model-serving-api-75bd89fdfc-w5msn Add eth0 [10.132.0.32/23] from ovn-kubernetes 15m Normal AddedInterface pod/odh-model-controller-769875db56-rv57b Add eth0 [10.132.0.33/23] from ovn-kubernetes 15m Normal Pulling pod/odh-model-controller-769875db56-rv57b Pulling image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775" 15m Normal Pulled pod/usage-logs-tenancy-proxy-9c5d49bcd-cjkv4 Successfully pulled image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172" in 21.153s (21.153s including waiting). Image size: 1089502687 bytes. 15m Normal Created pod/usage-logs-tenancy-proxy-9c5d49bcd-cjkv4 Container created 15m Normal Started pod/usage-logs-tenancy-proxy-9c5d49bcd-cjkv4 Container started 15m Normal Started pod/model-serving-api-75bd89fdfc-w5msn Container started 15m Normal Created pod/model-serving-api-75bd89fdfc-w5msn Container created 15m Normal Pulled pod/model-serving-api-75bd89fdfc-w5msn Successfully pulled image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8" in 3.252s (3.252s including waiting). Image size: 184925761 bytes. 15m Normal Created pod/llmisvc-controller-manager-869d5dcc5d-kmbhd Container created 15m Normal Pulled pod/llmisvc-controller-manager-869d5dcc5d-kmbhd Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 3.955s (3.955s including waiting). Image size: 235100981 bytes. 15m Normal Started pod/llmisvc-controller-manager-869d5dcc5d-kmbhd Container started 15m Normal Pulled pod/kserve-controller-manager-776cc66d47-tn2gh Successfully pulled image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d" in 4.066s (4.066s including waiting). Image size: 247676581 bytes. 15m Normal Started pod/kserve-controller-manager-776cc66d47-tn2gh Container started 15m Normal Created pod/kserve-controller-manager-776cc66d47-tn2gh Container created 15m Normal LeaderElection lease/kserve-controller-manager-leader-lock kserve-controller-manager-776cc66d47-tn2gh_0ad286e3-5c30-4b49-9061-2edac6621e96 became leader 15m Normal LeaderElection lease/llminferenceservice-kserve-controller-manager llmisvc-controller-manager-869d5dcc5d-kmbhd_a9c3375d-1883-451b-90b3-1cdb13b34daa became leader 15m Normal Pulled pod/odh-model-controller-769875db56-rv57b Successfully pulled image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775" in 6.49s (6.49s including waiting). Image size: 236755567 bytes. 15m Normal Created pod/odh-model-controller-769875db56-rv57b Container created 15m Normal Started pod/odh-model-controller-769875db56-rv57b Container started 15m Normal LeaderElection lease/odh-model-controller.opendatahub.io odh-model-controller-769875db56-rv57b_21efbd8a-32e3-430f-b449-1de794814cd0 became leader 14m Normal ScalingReplicaSet deployment/llmisvc-controller-manager Scaled up replica set llmisvc-controller-manager-6466c554d8 from 0 to 1 14m Normal AddedInterface pod/llmisvc-controller-manager-6466c554d8-flnsj Add eth0 [10.133.0.46/23] from ovn-kubernetes 14m Normal Pulling pod/llmisvc-controller-manager-6466c554d8-flnsj Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" 14m Normal SuccessfulCreate replicaset/llmisvc-controller-manager-6466c554d8 Created pod: llmisvc-controller-manager-6466c554d8-flnsj 14m Normal Created pod/llmisvc-controller-manager-6466c554d8-flnsj Container created 14m Normal Pulled pod/llmisvc-controller-manager-6466c554d8-flnsj Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 854ms (854ms including waiting). Image size: 235100981 bytes. 14m Normal Started pod/llmisvc-controller-manager-6466c554d8-flnsj Container started 13m Normal ScalingReplicaSet deployment/llmisvc-controller-manager Scaled down replica set llmisvc-controller-manager-869d5dcc5d from 1 to 0 13m Normal SuccessfulDelete replicaset/llmisvc-controller-manager-869d5dcc5d Deleted pod: llmisvc-controller-manager-869d5dcc5d-kmbhd 13m Normal Killing pod/llmisvc-controller-manager-869d5dcc5d-kmbhd Stopping container manager 13m Normal LeaderElection lease/llminferenceservice-kserve-controller-manager llmisvc-controller-manager-6466c554d8-flnsj_0cd80a14-9dda-457d-ab8e-304e0bc33f67 became leader 12m Normal SuccessfulCreate replicaset/ai-gateway-controller-79567948bc Created pod: ai-gateway-controller-79567948bc-gln67 12m Normal ScalingReplicaSet deployment/ai-gateway-controller Scaled up replica set ai-gateway-controller-79567948bc from 0 to 1 12m Normal Pulling pod/ai-gateway-controller-79567948bc-gln67 Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:odh-pr-193" 12m Normal AddedInterface pod/ai-gateway-controller-79567948bc-gln67 Add eth0 [10.132.0.43/23] from ovn-kubernetes 12m Normal Started pod/ai-gateway-controller-79567948bc-gln67 Container started 12m Normal Pulled pod/ai-gateway-controller-79567948bc-gln67 Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:odh-pr-193" in 6.372s (6.372s including waiting). Image size: 184136595 bytes. 12m Normal Created pod/ai-gateway-controller-79567948bc-gln67 Container created 12m Normal LeaderElection lease/ai-gateway-controller-leader.opendatahub.io ai-gateway-controller-79567948bc-gln67_60a557b6-0b67-49cc-8a38-d045542a8ceb became leader 11m Normal AddedInterface pod/ai-gateway-controller-57c96dfd77-nsdrn Add eth0 [10.134.0.37/23] from ovn-kubernetes 11m Normal Pulling pod/ai-gateway-controller-57c96dfd77-nsdrn Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:odh-pr-193" 11m Normal SuccessfulCreate replicaset/ai-gateway-controller-57c96dfd77 Created pod: ai-gateway-controller-57c96dfd77-nsdrn 11m Normal ScalingReplicaSet deployment/ai-gateway-controller Scaled up replica set ai-gateway-controller-57c96dfd77 from 0 to 1 11m Normal Started pod/ai-gateway-controller-57c96dfd77-nsdrn Container started 11m Normal Pulled pod/ai-gateway-controller-57c96dfd77-nsdrn Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:odh-pr-193" in 3.176s (3.177s including waiting). Image size: 184136595 bytes. 11m Normal Created pod/ai-gateway-controller-57c96dfd77-nsdrn Container created 11m Normal ScalingReplicaSet deployment/ai-gateway-controller Scaled down replica set ai-gateway-controller-79567948bc from 1 to 0 11m Normal SuccessfulDelete replicaset/ai-gateway-controller-79567948bc Deleted pod: ai-gateway-controller-79567948bc-gln67 11m Normal Killing pod/ai-gateway-controller-79567948bc-gln67 Stopping container manager 11m Normal LeaderElection lease/ai-gateway-controller-leader.opendatahub.io ai-gateway-controller-57c96dfd77-nsdrn_328430c2-e811-4a2d-a863-cdf2d00d5d8f became leader 5m9s Normal Pulling pod/test-curl-7200-090f0b Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" 5m9s Normal Pulling pod/test-curl-7212-743d88 Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" 5m9s Normal AddedInterface pod/test-curl-7212-743d88 Add eth0 [10.133.0.61/23] from ovn-kubernetes 5m9s Normal AddedInterface pod/test-curl-7200-090f0b Add eth0 [10.132.0.65/23] from ovn-kubernetes 5m8s Normal Pulled pod/test-curl-7200-090f0b Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 1.453s (1.453s including waiting). Image size: 106100986 bytes. 5m7s Normal Started pod/test-curl-7200-090f0b Container started 5m7s Normal Created pod/test-curl-7200-090f0b Container created 5m5s Normal Started pod/test-curl-7212-743d88 Container started 5m5s Normal Created pod/test-curl-7212-743d88 Container created 5m5s Normal Pulled pod/test-curl-7212-743d88 Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 3.598s (3.598s including waiting). Image size: 106100986 bytes. 5m5s Normal Killing pod/test-curl-7200-090f0b Stopping container test-curl-7200-090f0b 5m3s Normal Killing pod/test-curl-7212-743d88 Stopping container test-curl-7212-743d88