=== events in opendatahub (2026-10-30T23:02:36Z) === LAST SEEN TYPE REASON OBJECT MESSAGE 68m Normal Scheduled pod/model-serving-api-75bd89fdfc-xg5lh Successfully assigned opendatahub/model-serving-api-75bd89fdfc-xg5lh to ip-10-0-131-193.us-west-1.compute.internal 24m Normal Scheduled pod/maas-controller-7bb56545f7-hqm9d Successfully assigned opendatahub/maas-controller-7bb56545f7-hqm9d to ip-10-0-131-193.us-west-1.compute.internal 51m Normal Scheduled pod/test-curl-6963-9ffabf Successfully assigned opendatahub/test-curl-6963-9ffabf to ip-10-0-142-154.us-west-1.compute.internal 52m Normal Scheduled pod/test-curl-6954-bc401f Successfully assigned opendatahub/test-curl-6954-bc401f to ip-10-0-131-193.us-west-1.compute.internal 68m Normal Scheduled pod/odh-model-controller-769875db56-f89ml Successfully assigned opendatahub/odh-model-controller-769875db56-f89ml to ip-10-0-130-176.us-west-1.compute.internal 65m Normal Scheduled pod/ai-gateway-controller-66dd76bf94-z5wtt Successfully assigned opendatahub/ai-gateway-controller-66dd76bf94-z5wtt to ip-10-0-131-193.us-west-1.compute.internal 69m Normal Scheduled pod/kserve-module-controller-manager-7566cf5fc8-bgt9j Successfully assigned opendatahub/kserve-module-controller-manager-7566cf5fc8-bgt9j to ip-10-0-142-154.us-west-1.compute.internal 68m Normal Scheduled pod/kserve-controller-manager-776cc66d47-k6246 Successfully assigned opendatahub/kserve-controller-manager-776cc66d47-k6246 to ip-10-0-131-193.us-west-1.compute.internal 67m Normal Scheduled pod/llmisvc-controller-manager-6466c554d8-mp7g2 Successfully assigned opendatahub/llmisvc-controller-manager-6466c554d8-mp7g2 to ip-10-0-130-176.us-west-1.compute.internal 68m Normal Scheduled pod/maas-controller-7bb56545f7-h6p47 Successfully assigned opendatahub/maas-controller-7bb56545f7-h6p47 to ip-10-0-131-193.us-west-1.compute.internal 68m Normal Scheduled pod/usage-logs-tenancy-proxy-9c5d49bcd-9f8ld Successfully assigned opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-9f8ld to ip-10-0-130-176.us-west-1.compute.internal 65m Normal Scheduled pod/ai-gateway-controller-fc7c456c9-9z74t Successfully assigned opendatahub/ai-gateway-controller-fc7c456c9-9z74t to ip-10-0-131-193.us-west-1.compute.internal 24m Normal Scheduled pod/maas-controller-7bb56545f7-hrrcg Successfully assigned opendatahub/maas-controller-7bb56545f7-hrrcg to ip-10-0-131-193.us-west-1.compute.internal 68m Normal Scheduled pod/maas-controller-579cf7c6d-7m8xr Successfully assigned opendatahub/maas-controller-579cf7c6d-7m8xr to ip-10-0-131-193.us-west-1.compute.internal 68m Normal Scheduled pod/llmisvc-controller-manager-869d5dcc5d-s6rph Successfully assigned opendatahub/llmisvc-controller-manager-869d5dcc5d-s6rph to ip-10-0-130-176.us-west-1.compute.internal 69m Normal ScalingReplicaSet deployment/kserve-module-controller-manager Scaled up replica set kserve-module-controller-manager-7566cf5fc8 from 0 to 1 69m Normal SuccessfulCreate replicaset/kserve-module-controller-manager-7566cf5fc8 Created pod: kserve-module-controller-manager-7566cf5fc8-bgt9j 69m Normal AddedInterface pod/kserve-module-controller-manager-7566cf5fc8-bgt9j Add eth0 [10.132.0.29/23] from ovn-kubernetes 69m Normal Pulling pod/kserve-module-controller-manager-7566cf5fc8-bgt9j Pulling image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189" 69m Normal Pulled pod/kserve-module-controller-manager-7566cf5fc8-bgt9j Successfully pulled image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189" in 1.933s (1.933s including waiting). Image size: 195729000 bytes. 69m Normal Started pod/kserve-module-controller-manager-7566cf5fc8-bgt9j Container started 69m Normal Created pod/kserve-module-controller-manager-7566cf5fc8-bgt9j Container created 69m Normal LeaderElection lease/kserve-module-controller-manager kserve-module-controller-manager-7566cf5fc8-bgt9j_82c9a7cb-7b12-43cc-b131-0279dac89032 became leader 68m Normal ScalingReplicaSet deployment/maas-controller Scaled up replica set maas-controller-579cf7c6d from 0 to 1 68m Normal SuccessfulCreate replicaset/maas-controller-579cf7c6d Created pod: maas-controller-579cf7c6d-7m8xr 68m Normal AddedInterface pod/maas-controller-7bb56545f7-h6p47 Add eth0 [10.133.0.46/23] from ovn-kubernetes 68m Normal AddedInterface pod/maas-controller-579cf7c6d-7m8xr Add eth0 [10.133.0.45/23] from ovn-kubernetes 68m Normal Pulling pod/maas-controller-579cf7c6d-7m8xr Pulling image "quay.io/opendatahub/maas-controller:7879675aa66d002425c7b32375d6d0156eaa0c56" 68m Normal SuccessfulCreate replicaset/maas-controller-7bb56545f7 Created pod: maas-controller-7bb56545f7-h6p47 68m Normal Pulling pod/maas-controller-7bb56545f7-h6p47 Pulling image "quay.io/opendatahub/maas-controller:7879675aa66d002425c7b32375d6d0156eaa0c56" 68m Normal Created pod/maas-controller-579cf7c6d-7m8xr Container created 68m Normal Pulled pod/maas-controller-579cf7c6d-7m8xr Successfully pulled image "quay.io/opendatahub/maas-controller:7879675aa66d002425c7b32375d6d0156eaa0c56" in 3.219s (3.219s including waiting). Image size: 200053271 bytes. 68m Normal Started pod/maas-controller-579cf7c6d-7m8xr Container started 68m Normal Created pod/maas-controller-7bb56545f7-h6p47 Container created 68m Normal Pulled pod/maas-controller-7bb56545f7-h6p47 Successfully pulled image "quay.io/opendatahub/maas-controller:7879675aa66d002425c7b32375d6d0156eaa0c56" in 3.139s (3.139s including waiting). Image size: 200053271 bytes. 68m Normal Started pod/maas-controller-7bb56545f7-h6p47 Container started 68m Normal LeaderElection lease/maas-controller.models-as-a-service.opendatahub.io maas-controller-579cf7c6d-7m8xr_6b77b8dd-0c6b-4260-a682-34c8be7d42c2 became leader 68m Normal ScalingReplicaSet deployment/usage-logs-tenancy-proxy Scaled up replica set usage-logs-tenancy-proxy-9c5d49bcd from 0 to 1 68m Normal SuccessfulCreate replicaset/usage-logs-tenancy-proxy-9c5d49bcd Created pod: usage-logs-tenancy-proxy-9c5d49bcd-9f8ld 68m Warning FailedMount pod/usage-logs-tenancy-proxy-9c5d49bcd-9f8ld MountVolume.SetUp failed for volume "proxy-source" : configmap "usage-tenancy-proxy-source" not found 68m Normal AddedInterface pod/usage-logs-tenancy-proxy-9c5d49bcd-9f8ld Add eth0 [10.134.0.28/23] from ovn-kubernetes 68m Normal Pulling pod/usage-logs-tenancy-proxy-9c5d49bcd-9f8ld Pulling image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172" 68m Normal SuccessfulCreate replicaset/kserve-controller-manager-776cc66d47 Created pod: kserve-controller-manager-776cc66d47-k6246 68m Normal ScalingReplicaSet deployment/llmisvc-controller-manager Scaled up replica set llmisvc-controller-manager-869d5dcc5d from 0 to 1 68m Normal ScalingReplicaSet deployment/model-serving-api Scaled up replica set model-serving-api-75bd89fdfc from 0 to 1 68m Normal SuccessfulCreate replicaset/llmisvc-controller-manager-869d5dcc5d Created pod: llmisvc-controller-manager-869d5dcc5d-s6rph 68m Normal ScalingReplicaSet deployment/odh-model-controller Scaled up replica set odh-model-controller-769875db56 from 0 to 1 68m Normal ScalingReplicaSet deployment/kserve-controller-manager Scaled up replica set kserve-controller-manager-776cc66d47 from 0 to 1 68m Normal SuccessfulCreate replicaset/model-serving-api-75bd89fdfc Created pod: model-serving-api-75bd89fdfc-xg5lh 68m Normal AddedInterface pod/llmisvc-controller-manager-869d5dcc5d-s6rph Add eth0 [10.134.0.29/23] from ovn-kubernetes 68m Normal Pulling pod/llmisvc-controller-manager-869d5dcc5d-s6rph Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" 68m Normal AddedInterface pod/odh-model-controller-769875db56-f89ml Add eth0 [10.134.0.30/23] from ovn-kubernetes 68m Normal Pulling pod/odh-model-controller-769875db56-f89ml Pulling image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775" 68m Normal SuccessfulCreate replicaset/odh-model-controller-769875db56 Created pod: odh-model-controller-769875db56-f89ml 68m Normal AddedInterface pod/kserve-controller-manager-776cc66d47-k6246 Add eth0 [10.133.0.47/23] from ovn-kubernetes 68m Normal Pulling pod/kserve-controller-manager-776cc66d47-k6246 Pulling image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d" 68m Normal Pulling pod/model-serving-api-75bd89fdfc-xg5lh Pulling image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8" 68m Normal AddedInterface pod/model-serving-api-75bd89fdfc-xg5lh Add eth0 [10.133.0.48/23] from ovn-kubernetes 68m Normal Started pod/model-serving-api-75bd89fdfc-xg5lh Container started 68m Normal Started pod/kserve-controller-manager-776cc66d47-k6246 Container started 68m Normal Started pod/llmisvc-controller-manager-869d5dcc5d-s6rph Container started 68m Normal Created pod/llmisvc-controller-manager-869d5dcc5d-s6rph Container created 68m Normal Pulled pod/llmisvc-controller-manager-869d5dcc5d-s6rph Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 2.81s (2.81s including waiting). Image size: 235100981 bytes. 68m Normal Pulled pod/kserve-controller-manager-776cc66d47-k6246 Successfully pulled image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d" in 3.383s (3.383s including waiting). Image size: 247676581 bytes. 68m Normal Created pod/model-serving-api-75bd89fdfc-xg5lh Container created 68m Normal Pulled pod/model-serving-api-75bd89fdfc-xg5lh Successfully pulled image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8" in 2.4s (2.4s including waiting). Image size: 184925761 bytes. 68m Normal Created pod/kserve-controller-manager-776cc66d47-k6246 Container created 68m Normal LeaderElection lease/kserve-controller-manager-leader-lock kserve-controller-manager-776cc66d47-k6246_26a20257-246a-441c-b526-b559ea8f7a2f became leader 68m Normal Created pod/odh-model-controller-769875db56-f89ml Container created 68m Normal Pulled pod/odh-model-controller-769875db56-f89ml Successfully pulled image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775" in 4.687s (4.687s including waiting). Image size: 236755567 bytes. 68m Normal Started pod/odh-model-controller-769875db56-f89ml Container started 68m Normal Killing pod/maas-controller-579cf7c6d-7m8xr Stopping container manager 68m Normal SuccessfulDelete replicaset/maas-controller-579cf7c6d Deleted pod: maas-controller-579cf7c6d-7m8xr 68m Normal LeaderElection lease/llminferenceservice-kserve-controller-manager llmisvc-controller-manager-869d5dcc5d-s6rph_5eb58bd4-5e90-4bd6-a393-e5ca68702c71 became leader 68m Normal ScalingReplicaSet deployment/maas-controller Scaled down replica set maas-controller-579cf7c6d from 1 to 0 68m Normal LeaderElection lease/odh-model-controller.opendatahub.io odh-model-controller-769875db56-f89ml_edfa95e8-a474-4af3-a2c2-51c7ac9e5d33 became leader 68m Normal Started pod/usage-logs-tenancy-proxy-9c5d49bcd-9f8ld Container started 68m Normal Created pod/usage-logs-tenancy-proxy-9c5d49bcd-9f8ld Container created 68m Normal Pulled pod/usage-logs-tenancy-proxy-9c5d49bcd-9f8ld Successfully pulled image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172" in 14.477s (14.477s including waiting). Image size: 1089502687 bytes. 68m Normal LeaderElection lease/maas-controller.models-as-a-service.opendatahub.io maas-controller-7bb56545f7-h6p47_33c29cea-fe61-4bff-bfcc-cb06b61c2104 became leader 67m Normal ScalingReplicaSet deployment/llmisvc-controller-manager Scaled up replica set llmisvc-controller-manager-6466c554d8 from 0 to 1 67m Normal SuccessfulCreate replicaset/llmisvc-controller-manager-6466c554d8 Created pod: llmisvc-controller-manager-6466c554d8-mp7g2 67m Normal Pulling pod/llmisvc-controller-manager-6466c554d8-mp7g2 Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" 67m Normal AddedInterface pod/llmisvc-controller-manager-6466c554d8-mp7g2 Add eth0 [10.134.0.33/23] from ovn-kubernetes 67m Normal Created pod/llmisvc-controller-manager-6466c554d8-mp7g2 Container created 67m Normal Pulled pod/llmisvc-controller-manager-6466c554d8-mp7g2 Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 747ms (747ms including waiting). Image size: 235100981 bytes. 67m Normal Started pod/llmisvc-controller-manager-6466c554d8-mp7g2 Container started 67m Normal Killing pod/llmisvc-controller-manager-869d5dcc5d-s6rph Stopping container manager 67m Normal SuccessfulDelete replicaset/llmisvc-controller-manager-869d5dcc5d Deleted pod: llmisvc-controller-manager-869d5dcc5d-s6rph 67m Normal ScalingReplicaSet deployment/llmisvc-controller-manager Scaled down replica set llmisvc-controller-manager-869d5dcc5d from 1 to 0 66m Normal LeaderElection lease/llminferenceservice-kserve-controller-manager llmisvc-controller-manager-6466c554d8-mp7g2_0ce04a24-ef2d-4e7a-a992-badb23c7c9f5 became leader 65m Normal SuccessfulCreate replicaset/ai-gateway-controller-66dd76bf94 Created pod: ai-gateway-controller-66dd76bf94-z5wtt 65m Normal ScalingReplicaSet deployment/ai-gateway-controller Scaled up replica set ai-gateway-controller-66dd76bf94 from 0 to 1 65m Normal AddedInterface pod/ai-gateway-controller-66dd76bf94-z5wtt Add eth0 [10.133.0.54/23] from ovn-kubernetes 65m Normal Pulling pod/ai-gateway-controller-66dd76bf94-z5wtt Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:odh-pr-202" 65m Normal Pulled pod/ai-gateway-controller-66dd76bf94-z5wtt Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:odh-pr-202" in 2.157s (2.157s including waiting). Image size: 183995793 bytes. 65m Normal Started pod/ai-gateway-controller-66dd76bf94-z5wtt Container started 65m Normal Created pod/ai-gateway-controller-66dd76bf94-z5wtt Container created 65m Normal LeaderElection lease/ai-gateway-controller-leader.opendatahub.io ai-gateway-controller-66dd76bf94-z5wtt_f72f264e-aa9d-4797-aee5-cbf12ee54b46 became leader 65m Normal SuccessfulCreate replicaset/ai-gateway-controller-fc7c456c9 Created pod: ai-gateway-controller-fc7c456c9-9z74t 65m Normal ScalingReplicaSet deployment/ai-gateway-controller Scaled up replica set ai-gateway-controller-fc7c456c9 from 0 to 1 65m Normal Pulling pod/ai-gateway-controller-fc7c456c9-9z74t Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:odh-pr-202" 65m Normal AddedInterface pod/ai-gateway-controller-fc7c456c9-9z74t Add eth0 [10.133.0.57/23] from ovn-kubernetes 65m Normal Started pod/ai-gateway-controller-fc7c456c9-9z74t Container started 65m Normal Created pod/ai-gateway-controller-fc7c456c9-9z74t Container created 65m Normal Pulled pod/ai-gateway-controller-fc7c456c9-9z74t Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:odh-pr-202" in 803ms (803ms including waiting). Image size: 183995793 bytes. 65m Normal ScalingReplicaSet deployment/ai-gateway-controller Scaled down replica set ai-gateway-controller-66dd76bf94 from 1 to 0 65m Normal SuccessfulDelete replicaset/ai-gateway-controller-66dd76bf94 Deleted pod: ai-gateway-controller-66dd76bf94-z5wtt 65m Normal Killing pod/ai-gateway-controller-66dd76bf94-z5wtt Stopping container manager 64m Normal LeaderElection lease/ai-gateway-controller-leader.opendatahub.io ai-gateway-controller-fc7c456c9-9z74t_3527f8c1-cfe6-43fa-83c1-b154d092121a became leader 52m Normal Pulling pod/test-curl-6954-bc401f Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" 52m Normal AddedInterface pod/test-curl-6954-bc401f Add eth0 [10.133.0.154/23] from ovn-kubernetes 52m Normal Pulled pod/test-curl-6954-bc401f Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 11.973s (11.973s including waiting). Image size: 106100986 bytes. 52m Normal Created pod/test-curl-6954-bc401f Container created 52m Normal Started pod/test-curl-6954-bc401f Container started 52m Normal Killing pod/test-curl-6954-bc401f Stopping container test-curl-6954-bc401f 51m Normal AddedInterface pod/test-curl-6963-9ffabf Add eth0 [10.132.0.84/23] from ovn-kubernetes 51m Normal Pulling pod/test-curl-6963-9ffabf Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" 51m Normal Created pod/test-curl-6963-9ffabf Container created 51m Normal Pulled pod/test-curl-6963-9ffabf Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 11.112s (11.112s including waiting). Image size: 106100986 bytes. 51m Normal Started pod/test-curl-6963-9ffabf Container started 51m Normal Killing pod/test-curl-6963-9ffabf Stopping container test-curl-6963-9ffabf 24m Normal SuccessfulDelete replicaset/maas-controller-7bb56545f7 Deleted pod: maas-controller-7bb56545f7-h6p47 24m Normal Killing pod/maas-controller-7bb56545f7-h6p47 Stopping container manager 24m Normal SuccessfulCreate replicaset/maas-controller-7bb56545f7 Created pod: maas-controller-7bb56545f7-hqm9d 24m Normal Pulling pod/maas-controller-7bb56545f7-hqm9d Pulling image "quay.io/opendatahub/maas-controller:7879675aa66d002425c7b32375d6d0156eaa0c56" 24m Normal AddedInterface pod/maas-controller-7bb56545f7-hqm9d Add eth0 [10.133.1.16/23] from ovn-kubernetes 24m Normal Started pod/maas-controller-7bb56545f7-hqm9d Container started 24m Normal Created pod/maas-controller-7bb56545f7-hqm9d Container created 24m Normal Pulled pod/maas-controller-7bb56545f7-hqm9d Successfully pulled image "quay.io/opendatahub/maas-controller:7879675aa66d002425c7b32375d6d0156eaa0c56" in 939ms (939ms including waiting). Image size: 200053271 bytes. 24m Normal LeaderElection lease/maas-controller.models-as-a-service.opendatahub.io maas-controller-7bb56545f7-hqm9d_7b550eb4-2802-48ed-8a14-8c00a699fd75 became leader 24m Normal Killing pod/maas-controller-7bb56545f7-hqm9d Stopping container manager 24m Normal ScalingReplicaSet deployment/maas-controller Scaled down replica set maas-controller-7bb56545f7 from 1 to 0 24m Normal SuccessfulDelete replicaset/maas-controller-7bb56545f7 Deleted pod: maas-controller-7bb56545f7-hqm9d 24m Normal ScalingReplicaSet deployment/maas-controller Scaled up replica set maas-controller-7bb56545f7 from 0 to 1 24m Normal SuccessfulCreate replicaset/maas-controller-7bb56545f7 Created pod: maas-controller-7bb56545f7-hrrcg 24m Normal Pulling pod/maas-controller-7bb56545f7-hrrcg Pulling image "quay.io/opendatahub/maas-controller:7879675aa66d002425c7b32375d6d0156eaa0c56" 24m Normal AddedInterface pod/maas-controller-7bb56545f7-hrrcg Add eth0 [10.133.1.19/23] from ovn-kubernetes 23m Normal Started pod/maas-controller-7bb56545f7-hrrcg Container started 23m Normal Pulled pod/maas-controller-7bb56545f7-hrrcg Successfully pulled image "quay.io/opendatahub/maas-controller:7879675aa66d002425c7b32375d6d0156eaa0c56" in 841ms (841ms including waiting). Image size: 200053271 bytes. 23m Normal Created pod/maas-controller-7bb56545f7-hrrcg Container created 23m Normal LeaderElection lease/maas-controller.models-as-a-service.opendatahub.io maas-controller-7bb56545f7-hrrcg_ccaed546-c84d-45cc-86b7-c15b8db2a734 became leader