=== events in opendatahub (2026-11-04T05:05:20Z) === LAST SEEN TYPE REASON OBJECT MESSAGE 13m Normal Scheduled pod/kserve-controller-manager-776cc66d47-b9psb Successfully assigned opendatahub/kserve-controller-manager-776cc66d47-b9psb to ip-10-0-132-197.us-west-2.compute.internal 13m Normal Scheduled pod/usage-logs-tenancy-proxy-9c5d49bcd-kphlq Successfully assigned opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-kphlq to ip-10-0-132-197.us-west-2.compute.internal 4m25s Normal Scheduled pod/test-curl-7053-ecea19 Successfully assigned opendatahub/test-curl-7053-ecea19 to ip-10-0-134-224.us-west-2.compute.internal 4m25s Normal Scheduled pod/test-curl-7041-cccc51 Successfully assigned opendatahub/test-curl-7041-cccc51 to ip-10-0-134-224.us-west-2.compute.internal 13m Normal Scheduled pod/odh-model-controller-769875db56-5gpsn Successfully assigned opendatahub/odh-model-controller-769875db56-5gpsn to ip-10-0-134-224.us-west-2.compute.internal 13m Normal Scheduled pod/model-serving-api-75bd89fdfc-b6zvb Successfully assigned opendatahub/model-serving-api-75bd89fdfc-b6zvb to ip-10-0-132-197.us-west-2.compute.internal 13m Normal Scheduled pod/maas-controller-6c844db6b-c5mnw Successfully assigned opendatahub/maas-controller-6c844db6b-c5mnw to ip-10-0-134-224.us-west-2.compute.internal 14m Normal Scheduled pod/kserve-module-controller-manager-7566cf5fc8-mxvsk Successfully assigned opendatahub/kserve-module-controller-manager-7566cf5fc8-mxvsk to ip-10-0-140-242.us-west-2.compute.internal 12m Normal Scheduled pod/llmisvc-controller-manager-6466c554d8-8xwq5 Successfully assigned opendatahub/llmisvc-controller-manager-6466c554d8-8xwq5 to ip-10-0-132-197.us-west-2.compute.internal 10m Normal Scheduled pod/ai-gateway-controller-7c679bcc4f-wjccp Successfully assigned opendatahub/ai-gateway-controller-7c679bcc4f-wjccp to ip-10-0-140-242.us-west-2.compute.internal 13m Normal Scheduled pod/maas-controller-8b95c9c66-fzccr Successfully assigned opendatahub/maas-controller-8b95c9c66-fzccr to ip-10-0-132-197.us-west-2.compute.internal 13m Normal Scheduled pod/llmisvc-controller-manager-869d5dcc5d-9cxmr Successfully assigned opendatahub/llmisvc-controller-manager-869d5dcc5d-9cxmr to ip-10-0-134-224.us-west-2.compute.internal 10m Normal Scheduled pod/ai-gateway-controller-55cd769764-cpwbr Successfully assigned opendatahub/ai-gateway-controller-55cd769764-cpwbr to ip-10-0-140-242.us-west-2.compute.internal 14m Normal SuccessfulCreate replicaset/kserve-module-controller-manager-7566cf5fc8 Created pod: kserve-module-controller-manager-7566cf5fc8-mxvsk 14m Normal ScalingReplicaSet deployment/kserve-module-controller-manager Scaled up replica set kserve-module-controller-manager-7566cf5fc8 from 0 to 1 14m Normal Pulling pod/kserve-module-controller-manager-7566cf5fc8-mxvsk Pulling image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189" 14m Normal AddedInterface pod/kserve-module-controller-manager-7566cf5fc8-mxvsk Add eth0 [10.133.0.21/23] from ovn-kubernetes 14m Normal Started pod/kserve-module-controller-manager-7566cf5fc8-mxvsk Container started 14m Normal Created pod/kserve-module-controller-manager-7566cf5fc8-mxvsk Container created 14m Normal Pulled pod/kserve-module-controller-manager-7566cf5fc8-mxvsk Successfully pulled image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189" in 3.45s (3.45s including waiting). Image size: 195729000 bytes. 14m Normal LeaderElection lease/kserve-module-controller-manager kserve-module-controller-manager-7566cf5fc8-mxvsk_fc88ec27-4fc3-4353-94f9-add5989d2f9c became leader 13m Normal SuccessfulCreate replicaset/maas-controller-6c844db6b Created pod: maas-controller-6c844db6b-c5mnw 13m Normal SuccessfulCreate replicaset/maas-controller-8b95c9c66 Created pod: maas-controller-8b95c9c66-fzccr 13m Normal ScalingReplicaSet deployment/maas-controller Scaled up replica set maas-controller-8b95c9c66 from 0 to 1 13m Normal ScalingReplicaSet deployment/maas-controller Scaled up replica set maas-controller-6c844db6b from 0 to 1 13m Normal AddedInterface pod/maas-controller-6c844db6b-c5mnw Add eth0 [10.134.0.33/23] from ovn-kubernetes 13m Normal Pulling pod/maas-controller-6c844db6b-c5mnw Pulling image "quay.io/opendatahub/maas-controller:08858542cd3bba18175e02ba9b8418547f22ade2" 13m Normal Pulling pod/maas-controller-8b95c9c66-fzccr Pulling image "quay.io/opendatahub/maas-controller:08858542cd3bba18175e02ba9b8418547f22ade2" 13m Normal AddedInterface pod/maas-controller-8b95c9c66-fzccr Add eth0 [10.132.0.46/23] from ovn-kubernetes 13m Normal Started pod/maas-controller-8b95c9c66-fzccr Container started 13m Normal Created pod/maas-controller-8b95c9c66-fzccr Container created 13m Normal Pulled pod/maas-controller-8b95c9c66-fzccr Successfully pulled image "quay.io/opendatahub/maas-controller:08858542cd3bba18175e02ba9b8418547f22ade2" in 4.487s (4.487s including waiting). Image size: 200103442 bytes. 13m Normal Started pod/maas-controller-6c844db6b-c5mnw Container started 13m Normal Created pod/maas-controller-6c844db6b-c5mnw Container created 13m Normal Pulled pod/maas-controller-6c844db6b-c5mnw Successfully pulled image "quay.io/opendatahub/maas-controller:08858542cd3bba18175e02ba9b8418547f22ade2" in 3.681s (3.681s including waiting). Image size: 200103442 bytes. 13m Normal ScalingReplicaSet deployment/odh-model-controller Scaled up replica set odh-model-controller-769875db56 from 0 to 1 13m Normal SuccessfulCreate replicaset/kserve-controller-manager-776cc66d47 Created pod: kserve-controller-manager-776cc66d47-b9psb 13m Normal ScalingReplicaSet deployment/kserve-controller-manager Scaled up replica set kserve-controller-manager-776cc66d47 from 0 to 1 13m Normal AddedInterface pod/kserve-controller-manager-776cc66d47-b9psb Add eth0 [10.132.0.47/23] from ovn-kubernetes 13m Normal SuccessfulCreate replicaset/odh-model-controller-769875db56 Created pod: odh-model-controller-769875db56-5gpsn 13m Normal SuccessfulCreate replicaset/model-serving-api-75bd89fdfc Created pod: model-serving-api-75bd89fdfc-b6zvb 13m Normal SuccessfulCreate replicaset/llmisvc-controller-manager-869d5dcc5d Created pod: llmisvc-controller-manager-869d5dcc5d-9cxmr 13m Normal ScalingReplicaSet deployment/llmisvc-controller-manager Scaled up replica set llmisvc-controller-manager-869d5dcc5d from 0 to 1 13m Normal ScalingReplicaSet deployment/model-serving-api Scaled up replica set model-serving-api-75bd89fdfc from 0 to 1 13m Normal LeaderElection lease/maas-controller.models-as-a-service.opendatahub.io maas-controller-6c844db6b-c5mnw_7aed9382-a3b0-4361-8779-20842ce2df2d became leader 13m Normal Pulling pod/kserve-controller-manager-776cc66d47-b9psb Pulling image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d" 13m Normal AddedInterface pod/odh-model-controller-769875db56-5gpsn Add eth0 [10.134.0.35/23] from ovn-kubernetes 13m Normal Pulling pod/model-serving-api-75bd89fdfc-b6zvb Pulling image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8" 13m Normal Pulling pod/odh-model-controller-769875db56-5gpsn Pulling image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775" 13m Normal AddedInterface pod/llmisvc-controller-manager-869d5dcc5d-9cxmr Add eth0 [10.134.0.34/23] from ovn-kubernetes 13m Normal Pulling pod/llmisvc-controller-manager-869d5dcc5d-9cxmr Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" 13m Normal AddedInterface pod/model-serving-api-75bd89fdfc-b6zvb Add eth0 [10.132.0.48/23] from ovn-kubernetes 13m Normal ScalingReplicaSet deployment/usage-logs-tenancy-proxy Scaled up replica set usage-logs-tenancy-proxy-9c5d49bcd from 0 to 1 13m Normal SuccessfulCreate replicaset/usage-logs-tenancy-proxy-9c5d49bcd Created pod: usage-logs-tenancy-proxy-9c5d49bcd-kphlq 13m Warning FailedMount pod/usage-logs-tenancy-proxy-9c5d49bcd-kphlq MountVolume.SetUp failed for volume "proxy-source" : configmap "usage-tenancy-proxy-source" not found 13m Warning FailedMount pod/usage-logs-tenancy-proxy-9c5d49bcd-kphlq MountVolume.SetUp failed for volume "tls-cert" : secret "usage-logs-tenancy-proxy-tls" not found 13m Normal Pulling pod/usage-logs-tenancy-proxy-9c5d49bcd-kphlq Pulling image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172" 13m Normal AddedInterface pod/usage-logs-tenancy-proxy-9c5d49bcd-kphlq Add eth0 [10.132.0.49/23] from ovn-kubernetes 13m Normal Started pod/model-serving-api-75bd89fdfc-b6zvb Container started 13m Normal Created pod/model-serving-api-75bd89fdfc-b6zvb Container created 13m Normal Pulled pod/model-serving-api-75bd89fdfc-b6zvb Successfully pulled image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8" in 2.846s (2.846s including waiting). Image size: 184925761 bytes. 13m Normal Pulled pod/odh-model-controller-769875db56-5gpsn Successfully pulled image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775" in 4.221s (4.221s including waiting). Image size: 236755567 bytes. 13m Normal Started pod/llmisvc-controller-manager-869d5dcc5d-9cxmr Container started 13m Normal Created pod/llmisvc-controller-manager-869d5dcc5d-9cxmr Container created 13m Normal Started pod/odh-model-controller-769875db56-5gpsn Container started 13m Normal Created pod/odh-model-controller-769875db56-5gpsn Container created 13m Normal Pulled pod/llmisvc-controller-manager-869d5dcc5d-9cxmr Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 4.604s (4.604s including waiting). Image size: 235100981 bytes. 13m Normal LeaderElection lease/odh-model-controller.opendatahub.io odh-model-controller-769875db56-5gpsn_f28365ff-7761-4a6a-8873-4fc6a75cd9e5 became leader 13m Normal Started pod/kserve-controller-manager-776cc66d47-b9psb Container started 13m Normal Pulled pod/kserve-controller-manager-776cc66d47-b9psb Successfully pulled image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d" in 5.079s (5.079s including waiting). Image size: 247676581 bytes. 13m Normal Created pod/kserve-controller-manager-776cc66d47-b9psb Container created 13m Normal LeaderElection lease/kserve-controller-manager-leader-lock kserve-controller-manager-776cc66d47-b9psb_5706e117-a061-4107-ac52-528d058725c2 became leader 13m Normal LeaderElection lease/llminferenceservice-kserve-controller-manager llmisvc-controller-manager-869d5dcc5d-9cxmr_7bcc6cc6-f0c7-458b-976f-5a9f4d622a02 became leader 13m Normal ScalingReplicaSet deployment/maas-controller Scaled down replica set maas-controller-8b95c9c66 from 1 to 0 13m Normal Killing pod/maas-controller-8b95c9c66-fzccr Stopping container manager 13m Normal SuccessfulDelete replicaset/maas-controller-8b95c9c66 Deleted pod: maas-controller-8b95c9c66-fzccr 13m Normal Pulled pod/usage-logs-tenancy-proxy-9c5d49bcd-kphlq Successfully pulled image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172" in 15.768s (15.768s including waiting). Image size: 1089502687 bytes. 13m Normal Started pod/usage-logs-tenancy-proxy-9c5d49bcd-kphlq Container started 13m Normal Created pod/usage-logs-tenancy-proxy-9c5d49bcd-kphlq Container created 12m Normal Pulling pod/llmisvc-controller-manager-6466c554d8-8xwq5 Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" 12m Normal AddedInterface pod/llmisvc-controller-manager-6466c554d8-8xwq5 Add eth0 [10.132.0.53/23] from ovn-kubernetes 12m Normal SuccessfulCreate replicaset/llmisvc-controller-manager-6466c554d8 Created pod: llmisvc-controller-manager-6466c554d8-8xwq5 12m Normal ScalingReplicaSet deployment/llmisvc-controller-manager Scaled up replica set llmisvc-controller-manager-6466c554d8 from 0 to 1 12m Normal Created pod/llmisvc-controller-manager-6466c554d8-8xwq5 Container created 12m Normal Pulled pod/llmisvc-controller-manager-6466c554d8-8xwq5 Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 2.584s (2.584s including waiting). Image size: 235100981 bytes. 12m Normal Started pod/llmisvc-controller-manager-6466c554d8-8xwq5 Container started 11m Normal SuccessfulDelete replicaset/llmisvc-controller-manager-869d5dcc5d Deleted pod: llmisvc-controller-manager-869d5dcc5d-9cxmr 11m Normal Killing pod/llmisvc-controller-manager-869d5dcc5d-9cxmr Stopping container manager 11m Normal ScalingReplicaSet deployment/llmisvc-controller-manager Scaled down replica set llmisvc-controller-manager-869d5dcc5d from 1 to 0 11m Normal LeaderElection lease/llminferenceservice-kserve-controller-manager llmisvc-controller-manager-6466c554d8-8xwq5_692ef61e-3002-4b1b-ab5a-bcd3e65d0f03 became leader 10m Normal Pulling pod/ai-gateway-controller-55cd769764-cpwbr Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:odh-pr-185" 10m Normal SuccessfulCreate replicaset/ai-gateway-controller-55cd769764 Created pod: ai-gateway-controller-55cd769764-cpwbr 10m Normal ScalingReplicaSet deployment/ai-gateway-controller Scaled up replica set ai-gateway-controller-55cd769764 from 0 to 1 10m Normal AddedInterface pod/ai-gateway-controller-55cd769764-cpwbr Add eth0 [10.133.0.33/23] from ovn-kubernetes 10m Normal Created pod/ai-gateway-controller-55cd769764-cpwbr Container created 10m Normal Started pod/ai-gateway-controller-55cd769764-cpwbr Container started 10m Normal Pulled pod/ai-gateway-controller-55cd769764-cpwbr Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:odh-pr-185" in 6.65s (6.65s including waiting). Image size: 184144315 bytes. 10m Normal LeaderElection lease/ai-gateway-controller-leader.opendatahub.io ai-gateway-controller-55cd769764-cpwbr_7c62a92a-07ec-4f48-8665-c972566d584b became leader 10m Normal ScalingReplicaSet deployment/ai-gateway-controller Scaled up replica set ai-gateway-controller-7c679bcc4f from 0 to 1 10m Normal SuccessfulCreate replicaset/ai-gateway-controller-7c679bcc4f Created pod: ai-gateway-controller-7c679bcc4f-wjccp 10m Normal AddedInterface pod/ai-gateway-controller-7c679bcc4f-wjccp Add eth0 [10.133.0.36/23] from ovn-kubernetes 10m Normal Pulling pod/ai-gateway-controller-7c679bcc4f-wjccp Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:odh-pr-185" 10m Normal Pulled pod/ai-gateway-controller-7c679bcc4f-wjccp Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:odh-pr-185" in 1.073s (1.073s including waiting). Image size: 184144315 bytes. 10m Normal Started pod/ai-gateway-controller-7c679bcc4f-wjccp Container started 10m Normal Created pod/ai-gateway-controller-7c679bcc4f-wjccp Container created 10m Normal SuccessfulDelete replicaset/ai-gateway-controller-55cd769764 Deleted pod: ai-gateway-controller-55cd769764-cpwbr 10m Normal Killing pod/ai-gateway-controller-55cd769764-cpwbr Stopping container manager 10m Normal ScalingReplicaSet deployment/ai-gateway-controller Scaled down replica set ai-gateway-controller-55cd769764 from 1 to 0 9m47s Normal LeaderElection lease/ai-gateway-controller-leader.opendatahub.io ai-gateway-controller-7c679bcc4f-wjccp_ff9e629e-c87a-48dc-a2fc-f68825b87cf6 became leader 4m24s Normal AddedInterface pod/test-curl-7041-cccc51 Add eth0 [10.134.0.62/23] from ovn-kubernetes 4m24s Normal Pulling pod/test-curl-7053-ecea19 Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" 4m24s Normal AddedInterface pod/test-curl-7053-ecea19 Add eth0 [10.134.0.61/23] from ovn-kubernetes 4m24s Normal Pulling pod/test-curl-7041-cccc51 Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" 4m23s Normal Started pod/test-curl-7053-ecea19 Container started 4m23s Normal Created pod/test-curl-7053-ecea19 Container created 4m23s Normal Pulled pod/test-curl-7053-ecea19 Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 1.648s (1.648s including waiting). Image size: 106100986 bytes. 4m23s Normal Started pod/test-curl-7041-cccc51 Container started 4m23s Normal Created pod/test-curl-7041-cccc51 Container created 4m23s Normal Pulled pod/test-curl-7041-cccc51 Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 1.097s (1.097s including waiting). Image size: 106100986 bytes. 4m21s Normal Killing pod/test-curl-7041-cccc51 Stopping container test-curl-7041-cccc51 4m20s Normal Killing pod/test-curl-7053-ecea19 Stopping container test-curl-7053-ecea19