=== events in opendatahub (2026-10-30T03:46:51Z) === LAST SEEN TYPE REASON OBJECT MESSAGE 27m Normal Scheduled pod/test-curl-8800-326068 Successfully assigned opendatahub/test-curl-8800-326068 to ip-10-0-136-171.ec2.internal 60m Normal Scheduled pod/odh-observability-584f99c788-95rk5 Successfully assigned opendatahub/odh-observability-584f99c788-95rk5 to ip-10-0-128-214.ec2.internal 56m Normal Scheduled pod/usage-logs-tenancy-proxy-7d94f55f4b-gtpxx Successfully assigned opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-gtpxx to ip-10-0-136-171.ec2.internal 38m Normal Scheduled pod/test-curl-8809-dfdaee Successfully assigned opendatahub/test-curl-8809-dfdaee to ip-10-0-128-214.ec2.internal 56m Normal Scheduled pod/maas-controller-577f596567-x685j Successfully assigned opendatahub/maas-controller-577f596567-x685j to ip-10-0-136-171.ec2.internal 33m Normal Scheduled pod/test-curl-8809-a1fcaf Successfully assigned opendatahub/test-curl-8809-a1fcaf to ip-10-0-136-171.ec2.internal 47m Normal Scheduled pod/test-curl-8803-cfc2ad Successfully assigned opendatahub/test-curl-8803-cfc2ad to ip-10-0-136-171.ec2.internal 47m Normal Scheduled pod/test-curl-8803-386aeb Successfully assigned opendatahub/test-curl-8803-386aeb to ip-10-0-136-171.ec2.internal 42m Normal Scheduled pod/test-curl-8800-fcc8cb Successfully assigned opendatahub/test-curl-8800-fcc8cb to ip-10-0-128-214.ec2.internal 27m Normal Scheduled pod/test-curl-8800-e6ff78 Successfully assigned opendatahub/test-curl-8800-e6ff78 to ip-10-0-136-171.ec2.internal 54m Normal Scheduled pod/ai-gateway-controller-74685b6749-zmk6j Successfully assigned opendatahub/ai-gateway-controller-74685b6749-zmk6j to ip-10-0-136-171.ec2.internal 42m Normal Scheduled pod/test-curl-8800-dd8d02 Successfully assigned opendatahub/test-curl-8800-dd8d02 to ip-10-0-128-214.ec2.internal 54m Normal Scheduled pod/ai-gateway-controller-55b4c89cbd-7np9b Successfully assigned opendatahub/ai-gateway-controller-55b4c89cbd-7np9b to ip-10-0-136-171.ec2.internal 42m Normal Scheduled pod/test-curl-8800-51f168 Successfully assigned opendatahub/test-curl-8800-51f168 to ip-10-0-128-214.ec2.internal 41m Normal Scheduled pod/test-curl-8809-b1c465 Successfully assigned opendatahub/test-curl-8809-b1c465 to ip-10-0-136-171.ec2.internal 55m Normal Scheduled pod/llmisvc-controller-manager-6466c554d8-474bl Successfully assigned opendatahub/llmisvc-controller-manager-6466c554d8-474bl to ip-10-0-128-214.ec2.internal 60m Normal Scheduled pod/opendatahub-operator-controller-manager-75bcb9cf-b7ftg Successfully assigned opendatahub/opendatahub-operator-controller-manager-75bcb9cf-b7ftg to ip-10-0-128-214.ec2.internal 59m Normal Scheduled pod/llmisvc-controller-manager-869d5dcc5d-z54fn Successfully assigned opendatahub/llmisvc-controller-manager-869d5dcc5d-z54fn to ip-10-0-128-214.ec2.internal 13m Normal Scheduled pod/maas-controller-6658f68bfc-vq9nc Successfully assigned opendatahub/maas-controller-6658f68bfc-vq9nc to ip-10-0-136-171.ec2.internal 56m Normal Scheduled pod/maas-controller-6658f68bfc-xts57 Successfully assigned opendatahub/maas-controller-6658f68bfc-xts57 to ip-10-0-136-171.ec2.internal 13m Normal Scheduled pod/maas-controller-6658f68bfc-lz8dz Successfully assigned opendatahub/maas-controller-6658f68bfc-lz8dz to ip-10-0-136-171.ec2.internal 60m Normal Scheduled pod/opendatahub-operator-controller-manager-75bcb9cf-b8rpz Successfully assigned opendatahub/opendatahub-operator-controller-manager-75bcb9cf-b8rpz to ip-10-0-136-171.ec2.internal 59m Normal Scheduled pod/kserve-controller-manager-776cc66d47-rbqcv Successfully assigned opendatahub/kserve-controller-manager-776cc66d47-rbqcv to ip-10-0-128-214.ec2.internal 42m Normal Scheduled pod/test-curl-8800-46789a Successfully assigned opendatahub/test-curl-8800-46789a to ip-10-0-128-214.ec2.internal 59m Normal Scheduled pod/odh-model-controller-f87fcf56c-7qqcm Successfully assigned opendatahub/odh-model-controller-f87fcf56c-7qqcm to ip-10-0-128-214.ec2.internal 59m Normal Scheduled pod/model-serving-api-75bd89fdfc-hhdnz Successfully assigned opendatahub/model-serving-api-75bd89fdfc-hhdnz to ip-10-0-128-214.ec2.internal 60m Normal Scheduled pod/opendatahub-operator-controller-manager-75bcb9cf-5hfrf Successfully assigned opendatahub/opendatahub-operator-controller-manager-75bcb9cf-5hfrf to ip-10-0-136-238.ec2.internal 60m Normal Scheduled pod/kserve-module-controller-manager-5cfb77bf8c-4zg7h Successfully assigned opendatahub/kserve-module-controller-manager-5cfb77bf8c-4zg7h to ip-10-0-136-171.ec2.internal 61m Normal RequirementsUnknown clusterserviceversion/opendatahub-operator.v3.6.0-ea.2 requirements not yet checked 61m Normal RequirementsNotMet clusterserviceversion/opendatahub-operator.v3.6.0-ea.2 one or more requirements couldn't be found 61m Normal AllRequirementsMet clusterserviceversion/opendatahub-operator.v3.6.0-ea.2 all requirements found, attempting install 61m Normal ScalingReplicaSet deployment/opendatahub-operator-controller-manager Scaled up replica set opendatahub-operator-controller-manager-75bcb9cf from 0 to 3 61m Normal SuccessfulCreate replicaset/opendatahub-operator-controller-manager-75bcb9cf Created pod: opendatahub-operator-controller-manager-75bcb9cf-b8rpz 61m Normal InstallSucceeded clusterserviceversion/opendatahub-operator.v3.6.0-ea.2 waiting for install components to report healthy 61m Normal SuccessfulCreate replicaset/opendatahub-operator-controller-manager-75bcb9cf Created pod: opendatahub-operator-controller-manager-75bcb9cf-5hfrf 61m Normal InstallWaiting clusterserviceversion/opendatahub-operator.v3.6.0-ea.2 installing: waiting for deployment opendatahub-operator-controller-manager to become ready: deployment "opendatahub-operator-controller-manager" not available: Deployment does not have minimum availability. 61m Normal SuccessfulCreate replicaset/opendatahub-operator-controller-manager-75bcb9cf Created pod: opendatahub-operator-controller-manager-75bcb9cf-b7ftg 60m Normal AddedInterface pod/opendatahub-operator-controller-manager-75bcb9cf-5hfrf Add eth0 [10.132.0.30/23] from ovn-kubernetes 60m Normal Pulling pod/opendatahub-operator-controller-manager-75bcb9cf-b8rpz Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" 60m Normal Pulling pod/opendatahub-operator-controller-manager-75bcb9cf-5hfrf Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" 60m Normal AddedInterface pod/opendatahub-operator-controller-manager-75bcb9cf-b7ftg Add eth0 [10.134.0.22/23] from ovn-kubernetes 60m Normal Pulling pod/opendatahub-operator-controller-manager-75bcb9cf-b7ftg Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" 60m Normal AddedInterface pod/opendatahub-operator-controller-manager-75bcb9cf-b8rpz Add eth0 [10.133.0.22/23] from ovn-kubernetes 60m Normal Started pod/opendatahub-operator-controller-manager-75bcb9cf-5hfrf Container started 60m Normal Created pod/opendatahub-operator-controller-manager-75bcb9cf-b7ftg Container created 60m Normal Pulled pod/opendatahub-operator-controller-manager-75bcb9cf-5hfrf Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 2.871s (2.871s including waiting). Image size: 273709574 bytes. 60m Normal Created pod/opendatahub-operator-controller-manager-75bcb9cf-5hfrf Container created 60m Normal Pulled pod/opendatahub-operator-controller-manager-75bcb9cf-b8rpz Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 2.835s (2.835s including waiting). Image size: 273709574 bytes. 60m Normal Created pod/opendatahub-operator-controller-manager-75bcb9cf-b8rpz Container created 60m Normal Started pod/opendatahub-operator-controller-manager-75bcb9cf-b8rpz Container started 60m Normal Started pod/opendatahub-operator-controller-manager-75bcb9cf-b7ftg Container started 60m Normal Pulled pod/opendatahub-operator-controller-manager-75bcb9cf-b7ftg Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 2.868s (2.868s including waiting). Image size: 273709574 bytes. 60m Normal Created pod/opendatahub-operator-controller-manager-75bcb9cf-5hfrf Container created 60m Normal Pulled pod/opendatahub-operator-controller-manager-75bcb9cf-b8rpz Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 315ms (315ms including waiting). Image size: 273709574 bytes. 60m Normal Pulling pod/opendatahub-operator-controller-manager-75bcb9cf-b7ftg Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" 60m Normal Started pod/opendatahub-operator-controller-manager-75bcb9cf-5hfrf Container started 60m Normal Pulled pod/opendatahub-operator-controller-manager-75bcb9cf-b7ftg Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 328ms (329ms including waiting). Image size: 273709574 bytes. 60m Normal Pulling pod/opendatahub-operator-controller-manager-75bcb9cf-b8rpz Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" 60m Normal Pulling pod/opendatahub-operator-controller-manager-75bcb9cf-5hfrf Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" 60m Normal Pulled pod/opendatahub-operator-controller-manager-75bcb9cf-5hfrf Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 347ms (347ms including waiting). Image size: 273709574 bytes. 60m Normal Created pod/opendatahub-operator-controller-manager-75bcb9cf-b8rpz Container created 60m Normal Started pod/opendatahub-operator-controller-manager-75bcb9cf-b8rpz Container started 60m Normal Created pod/opendatahub-operator-controller-manager-75bcb9cf-b7ftg Container created 60m Normal Started pod/opendatahub-operator-controller-manager-75bcb9cf-b7ftg Container started 60m Normal LeaderElection lease/07ed84f7.opendatahub.io opendatahub-operator-controller-manager-75bcb9cf-5hfrf_e90e5779-df2d-4ef4-aae8-842c9e2ec317 became leader 60m Normal InstallSucceeded clusterserviceversion/opendatahub-operator.v3.6.0-ea.2 install strategy completed with no errors 60m Normal Issuing certificate/odh-observability-webhook-cert Issuing certificate as Secret does not exist 60m Warning BadConfig certificaterequest/odh-observability-webhook-cert-1 Certificate will be issued with an empty Issuer DN, which contravenes RFC 5280 and could break some strict clients 60m Normal WaitingForApproval certificaterequest/odh-observability-webhook-cert-1 Not signing CertificateRequest until it is Approved 60m Normal WaitingForApproval certificaterequest/odh-observability-webhook-cert-1 Not signing CertificateRequest until it is Approved 60m Normal WaitingForApproval certificaterequest/odh-observability-webhook-cert-1 Not signing CertificateRequest until it is Approved 60m Normal WaitingForApproval certificaterequest/odh-observability-webhook-cert-1 Not signing CertificateRequest until it is Approved 60m Normal WaitingForApproval certificaterequest/odh-observability-webhook-cert-1 Not signing CertificateRequest until it is Approved 60m Normal SuccessfulCreate replicaset/odh-observability-584f99c788 Created pod: odh-observability-584f99c788-95rk5 60m Normal Issuing certificate/odh-observability-webhook-cert The certificate has been successfully issued 60m Normal Requested certificate/odh-observability-webhook-cert Created new CertificateRequest resource "odh-observability-webhook-cert-1" 60m Normal Generated certificate/odh-observability-webhook-cert Stored new private key in temporary Secret resource "odh-observability-webhook-cert-96l55" 60m Normal cert-manager.io certificaterequest/odh-observability-webhook-cert-1 Certificate request has been approved by cert-manager.io 60m Normal CertificateIssued certificaterequest/odh-observability-webhook-cert-1 Certificate fetched from issuer successfully 60m Normal ScalingReplicaSet deployment/odh-observability Scaled up replica set odh-observability-584f99c788 from 0 to 1 60m Warning FailedMount pod/odh-observability-584f99c788-95rk5 MountVolume.SetUp failed for volume "webhook-certs" : secret "odh-observability-webhook-cert" not found 60m Normal AddedInterface pod/odh-observability-584f99c788-95rk5 Add eth0 [10.134.0.24/23] from ovn-kubernetes 60m Normal Pulling pod/odh-observability-584f99c788-95rk5 Pulling image "quay.io/opendatahub/odh-observability@sha256:03689e71fb8879ea696366b83d2a4727eb76e696baf8c2be2b18121c0534db4e" 60m Normal Pulled pod/odh-observability-584f99c788-95rk5 Successfully pulled image "quay.io/opendatahub/odh-observability@sha256:03689e71fb8879ea696366b83d2a4727eb76e696baf8c2be2b18121c0534db4e" in 2.272s (2.272s including waiting). Image size: 154660917 bytes. 60m Normal Created pod/odh-observability-584f99c788-95rk5 Container created 60m Normal Started pod/odh-observability-584f99c788-95rk5 Container started 60m Normal SuccessfulCreate replicaset/kserve-module-controller-manager-5cfb77bf8c Created pod: kserve-module-controller-manager-5cfb77bf8c-4zg7h 60m Normal ScalingReplicaSet deployment/kserve-module-controller-manager Scaled up replica set kserve-module-controller-manager-5cfb77bf8c from 0 to 1 60m Normal Pulling pod/kserve-module-controller-manager-5cfb77bf8c-4zg7h Pulling image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189" 60m Normal AddedInterface pod/kserve-module-controller-manager-5cfb77bf8c-4zg7h Add eth0 [10.133.0.25/23] from ovn-kubernetes 60m Normal Pulled pod/kserve-module-controller-manager-5cfb77bf8c-4zg7h Successfully pulled image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189" in 1.745s (1.745s including waiting). Image size: 195729000 bytes. 60m Normal Created pod/kserve-module-controller-manager-5cfb77bf8c-4zg7h Container created 60m Normal Started pod/kserve-module-controller-manager-5cfb77bf8c-4zg7h Container started 60m Normal LeaderElection lease/kserve-module-controller-manager kserve-module-controller-manager-5cfb77bf8c-4zg7h_c3bbca81-e0d7-427d-96bc-a250943cd72f became leader 59m Normal SuccessfulCreate replicaset/kserve-controller-manager-776cc66d47 Created pod: kserve-controller-manager-776cc66d47-rbqcv 59m Normal ScalingReplicaSet deployment/model-serving-api Scaled up replica set model-serving-api-75bd89fdfc from 0 to 1 59m Normal ScalingReplicaSet deployment/llmisvc-controller-manager Scaled up replica set llmisvc-controller-manager-869d5dcc5d from 0 to 1 59m Normal ScalingReplicaSet deployment/kserve-controller-manager Scaled up replica set kserve-controller-manager-776cc66d47 from 0 to 1 59m Normal SuccessfulCreate replicaset/llmisvc-controller-manager-869d5dcc5d Created pod: llmisvc-controller-manager-869d5dcc5d-z54fn 59m Normal ScalingReplicaSet deployment/odh-model-controller Scaled up replica set odh-model-controller-f87fcf56c from 0 to 1 59m Normal SuccessfulCreate replicaset/odh-model-controller-f87fcf56c Created pod: odh-model-controller-f87fcf56c-7qqcm 59m Normal SuccessfulCreate replicaset/model-serving-api-75bd89fdfc Created pod: model-serving-api-75bd89fdfc-hhdnz 59m Normal Pulling pod/model-serving-api-75bd89fdfc-hhdnz Pulling image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8" 59m Normal Pulling pod/llmisvc-controller-manager-869d5dcc5d-z54fn Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" 59m Normal AddedInterface pod/llmisvc-controller-manager-869d5dcc5d-z54fn Add eth0 [10.134.0.27/23] from ovn-kubernetes 59m Normal AddedInterface pod/odh-model-controller-f87fcf56c-7qqcm Add eth0 [10.134.0.29/23] from ovn-kubernetes 59m Normal AddedInterface pod/kserve-controller-manager-776cc66d47-rbqcv Add eth0 [10.134.0.26/23] from ovn-kubernetes 59m Normal AddedInterface pod/model-serving-api-75bd89fdfc-hhdnz Add eth0 [10.134.0.28/23] from ovn-kubernetes 59m Normal Pulling pod/kserve-controller-manager-776cc66d47-rbqcv Pulling image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d" 59m Normal Pulling pod/odh-model-controller-f87fcf56c-7qqcm Pulling image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775" 59m Normal Started pod/model-serving-api-75bd89fdfc-hhdnz Container started 59m Normal Pulled pod/model-serving-api-75bd89fdfc-hhdnz Successfully pulled image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8" in 3.135s (3.136s including waiting). Image size: 184925761 bytes. 59m Normal Created pod/model-serving-api-75bd89fdfc-hhdnz Container created 59m Normal Started pod/kserve-controller-manager-776cc66d47-rbqcv Container started 59m Normal Pulled pod/kserve-controller-manager-776cc66d47-rbqcv Successfully pulled image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d" in 4.398s (4.398s including waiting). Image size: 247676581 bytes. 59m Normal Started pod/odh-model-controller-f87fcf56c-7qqcm Container started 59m Normal Pulled pod/odh-model-controller-f87fcf56c-7qqcm Successfully pulled image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775" in 4.21s (4.21s including waiting). Image size: 236755567 bytes. 59m Normal Started pod/llmisvc-controller-manager-869d5dcc5d-z54fn Container started 59m Normal Created pod/llmisvc-controller-manager-869d5dcc5d-z54fn Container created 59m Normal Pulled pod/llmisvc-controller-manager-869d5dcc5d-z54fn Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 4.217s (4.217s including waiting). Image size: 235100981 bytes. 59m Normal Created pod/kserve-controller-manager-776cc66d47-rbqcv Container created 59m Normal Created pod/odh-model-controller-f87fcf56c-7qqcm Container created 59m Normal LeaderElection lease/odh-model-controller.opendatahub.io odh-model-controller-f87fcf56c-7qqcm_8d366e68-fa71-4c05-ac0c-1680bccfcba1 became leader 59m Normal LeaderElection lease/kserve-controller-manager-leader-lock kserve-controller-manager-776cc66d47-rbqcv_705827e9-a605-482c-88d4-18576d8cd98c became leader 59m Normal LeaderElection lease/llminferenceservice-kserve-controller-manager llmisvc-controller-manager-869d5dcc5d-z54fn_9dd2762e-2cd0-43f6-9b5f-b14f26690661 became leader 56m Normal SuccessfulCreate replicaset/maas-controller-6658f68bfc Created pod: maas-controller-6658f68bfc-xts57 56m Normal ScalingReplicaSet deployment/maas-controller Scaled up replica set maas-controller-577f596567 from 0 to 1 56m Normal SuccessfulCreate replicaset/maas-controller-577f596567 Created pod: maas-controller-577f596567-x685j 56m Normal Pulling pod/maas-controller-577f596567-x685j Pulling image "quay.io/opendatahub/maas-controller:ccce7752af146eb3de9e99df107c26f414878726" 56m Normal AddedInterface pod/maas-controller-6658f68bfc-xts57 Add eth0 [10.133.0.41/23] from ovn-kubernetes 56m Normal Pulling pod/maas-controller-6658f68bfc-xts57 Pulling image "quay.io/opendatahub/maas-controller:ccce7752af146eb3de9e99df107c26f414878726" 56m Normal AddedInterface pod/maas-controller-577f596567-x685j Add eth0 [10.133.0.40/23] from ovn-kubernetes 56m Normal Pulled pod/maas-controller-577f596567-x685j Successfully pulled image "quay.io/opendatahub/maas-controller:ccce7752af146eb3de9e99df107c26f414878726" in 2.934s (2.934s including waiting). Image size: 199691795 bytes. 56m Normal Created pod/maas-controller-577f596567-x685j Container created 56m Normal Started pod/maas-controller-577f596567-x685j Container started 56m Normal Pulled pod/maas-controller-6658f68bfc-xts57 Successfully pulled image "quay.io/opendatahub/maas-controller:ccce7752af146eb3de9e99df107c26f414878726" in 2.675s (2.675s including waiting). Image size: 199691795 bytes. 56m Normal Created pod/maas-controller-6658f68bfc-xts57 Container created 56m Normal Started pod/maas-controller-6658f68bfc-xts57 Container started 56m Normal LeaderElection lease/maas-controller.models-as-a-service.opendatahub.io maas-controller-6658f68bfc-xts57_b4d4b4fb-8cc8-4440-9ac1-064e73b80e65 became leader 56m Normal ScalingReplicaSet deployment/usage-logs-tenancy-proxy Scaled up replica set usage-logs-tenancy-proxy-7d94f55f4b from 0 to 1 56m Normal SuccessfulCreate replicaset/usage-logs-tenancy-proxy-7d94f55f4b Created pod: usage-logs-tenancy-proxy-7d94f55f4b-gtpxx 56m Normal Pulling pod/usage-logs-tenancy-proxy-7d94f55f4b-gtpxx Pulling image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172" 56m Normal AddedInterface pod/usage-logs-tenancy-proxy-7d94f55f4b-gtpxx Add eth0 [10.133.0.42/23] from ovn-kubernetes 56m Normal SuccessfulDelete replicaset/maas-controller-577f596567 Deleted pod: maas-controller-577f596567-x685j 56m Normal ScalingReplicaSet deployment/maas-controller Scaled down replica set maas-controller-577f596567 from 1 to 0 56m Normal Killing pod/maas-controller-577f596567-x685j Stopping container manager 56m Normal Pulled pod/usage-logs-tenancy-proxy-7d94f55f4b-gtpxx Successfully pulled image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172" in 10.151s (10.151s including waiting). Image size: 1089502687 bytes. 56m Normal Created pod/usage-logs-tenancy-proxy-7d94f55f4b-gtpxx Container created 56m Normal Started pod/usage-logs-tenancy-proxy-7d94f55f4b-gtpxx Container started 55m Normal SuccessfulCreate replicaset/llmisvc-controller-manager-6466c554d8 Created pod: llmisvc-controller-manager-6466c554d8-474bl 55m Normal ScalingReplicaSet deployment/llmisvc-controller-manager Scaled up replica set llmisvc-controller-manager-6466c554d8 from 0 to 1 55m Normal AddedInterface pod/llmisvc-controller-manager-6466c554d8-474bl Add eth0 [10.134.0.35/23] from ovn-kubernetes 55m Normal Pulling pod/llmisvc-controller-manager-6466c554d8-474bl Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" 55m Normal Pulled pod/llmisvc-controller-manager-6466c554d8-474bl Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 361ms (361ms including waiting). Image size: 235100981 bytes. 55m Normal Created pod/llmisvc-controller-manager-6466c554d8-474bl Container created 55m Normal Started pod/llmisvc-controller-manager-6466c554d8-474bl Container started 55m Normal SuccessfulDelete replicaset/llmisvc-controller-manager-869d5dcc5d Deleted pod: llmisvc-controller-manager-869d5dcc5d-z54fn 55m Normal ScalingReplicaSet deployment/llmisvc-controller-manager Scaled down replica set llmisvc-controller-manager-869d5dcc5d from 1 to 0 55m Normal Killing pod/llmisvc-controller-manager-869d5dcc5d-z54fn Stopping container manager 55m Normal LeaderElection lease/llminferenceservice-kserve-controller-manager llmisvc-controller-manager-6466c554d8-474bl_c9afe51a-07eb-4dfe-8dfb-3ceb148d939b became leader 54m Normal ScalingReplicaSet deployment/ai-gateway-controller Scaled up replica set ai-gateway-controller-55b4c89cbd from 0 to 1 54m Normal SuccessfulCreate replicaset/ai-gateway-controller-55b4c89cbd Created pod: ai-gateway-controller-55b4c89cbd-7np9b 54m Normal Pulling pod/ai-gateway-controller-55b4c89cbd-7np9b Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:odh-pr-190" 54m Normal AddedInterface pod/ai-gateway-controller-55b4c89cbd-7np9b Add eth0 [10.133.0.47/23] from ovn-kubernetes 54m Normal Pulled pod/ai-gateway-controller-55b4c89cbd-7np9b Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:odh-pr-190" in 2.468s (2.468s including waiting). Image size: 183926180 bytes. 54m Normal LeaderElection lease/ai-gateway-controller-leader.opendatahub.io ai-gateway-controller-55b4c89cbd-7np9b_0d294583-97f6-4947-934e-9946e2af6720 became leader 54m Normal Started pod/ai-gateway-controller-55b4c89cbd-7np9b Container started 54m Normal Created pod/ai-gateway-controller-55b4c89cbd-7np9b Container created 54m Normal AddedInterface pod/ai-gateway-controller-74685b6749-zmk6j Add eth0 [10.133.0.50/23] from ovn-kubernetes 54m Normal Pulling pod/ai-gateway-controller-74685b6749-zmk6j Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:odh-pr-190" 54m Normal ScalingReplicaSet deployment/ai-gateway-controller Scaled up replica set ai-gateway-controller-74685b6749 from 0 to 1 54m Normal SuccessfulCreate replicaset/ai-gateway-controller-74685b6749 Created pod: ai-gateway-controller-74685b6749-zmk6j 54m Normal Created pod/ai-gateway-controller-74685b6749-zmk6j Container created 54m Normal Started pod/ai-gateway-controller-74685b6749-zmk6j Container started 54m Normal Pulled pod/ai-gateway-controller-74685b6749-zmk6j Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:odh-pr-190" in 324ms (324ms including waiting). Image size: 183926180 bytes. 54m Normal SuccessfulDelete replicaset/ai-gateway-controller-55b4c89cbd Deleted pod: ai-gateway-controller-55b4c89cbd-7np9b 54m Normal Killing pod/ai-gateway-controller-55b4c89cbd-7np9b Stopping container manager 54m Normal ScalingReplicaSet deployment/ai-gateway-controller Scaled down replica set ai-gateway-controller-55b4c89cbd from 1 to 0 53m Normal LeaderElection lease/ai-gateway-controller-leader.opendatahub.io ai-gateway-controller-74685b6749-zmk6j_1c03db4a-3d89-4fa8-a805-a71d7d68653d became leader 47m Normal AddedInterface pod/test-curl-8803-cfc2ad Add eth0 [10.133.0.119/23] from ovn-kubernetes 47m Normal Pulling pod/test-curl-8803-cfc2ad Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" 47m Normal Pulled pod/test-curl-8803-cfc2ad Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 14.385s (14.385s including waiting). Image size: 106100986 bytes. 47m Normal Started pod/test-curl-8803-cfc2ad Container started 47m Normal Created pod/test-curl-8803-cfc2ad Container created 47m Normal Created pod/test-curl-8803-386aeb Container created 47m Normal Killing pod/test-curl-8803-cfc2ad Stopping container test-curl-8803-cfc2ad 47m Normal Started pod/test-curl-8803-386aeb Container started 47m Normal Pulled pod/test-curl-8803-386aeb Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod 47m Normal AddedInterface pod/test-curl-8803-386aeb Add eth0 [10.133.0.123/23] from ovn-kubernetes 47m Normal Killing pod/test-curl-8803-386aeb Stopping container test-curl-8803-386aeb 42m Normal Started pod/test-curl-8800-51f168 Container started 42m Normal AddedInterface pod/test-curl-8800-51f168 Add eth0 [10.134.0.119/23] from ovn-kubernetes 42m Normal Pulling pod/test-curl-8800-51f168 Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" 42m Normal Pulled pod/test-curl-8800-51f168 Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 587ms (587ms including waiting). Image size: 106100986 bytes. 42m Normal Created pod/test-curl-8800-51f168 Container created 42m Normal Pulled pod/test-curl-8800-dd8d02 Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod 42m Normal AddedInterface pod/test-curl-8800-dd8d02 Add eth0 [10.134.0.120/23] from ovn-kubernetes 42m Normal Killing pod/test-curl-8800-51f168 Stopping container test-curl-8800-51f168 42m Normal Created pod/test-curl-8800-dd8d02 Container created 42m Normal Started pod/test-curl-8800-dd8d02 Container started 42m Normal AddedInterface pod/test-curl-8800-46789a Add eth0 [10.134.0.121/23] from ovn-kubernetes 42m Normal Started pod/test-curl-8800-46789a Container started 42m Normal Created pod/test-curl-8800-46789a Container created 42m Normal Pulled pod/test-curl-8800-46789a Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod 42m Normal Killing pod/test-curl-8800-dd8d02 Stopping container test-curl-8800-dd8d02 42m Normal Pulled pod/test-curl-8800-fcc8cb Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod 42m Normal Started pod/test-curl-8800-fcc8cb Container started 42m Normal Created pod/test-curl-8800-fcc8cb Container created 42m Normal AddedInterface pod/test-curl-8800-fcc8cb Add eth0 [10.134.0.122/23] from ovn-kubernetes 42m Normal Killing pod/test-curl-8800-46789a Stopping container test-curl-8800-46789a 42m Normal Killing pod/test-curl-8800-fcc8cb Stopping container test-curl-8800-fcc8cb 41m Normal AddedInterface pod/test-curl-8809-b1c465 Add eth0 [10.133.0.167/23] from ovn-kubernetes 41m Normal Pulled pod/test-curl-8809-b1c465 Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod 41m Normal Started pod/test-curl-8809-b1c465 Container started 41m Normal Created pod/test-curl-8809-b1c465 Container created 41m Normal Killing pod/test-curl-8809-b1c465 Stopping container test-curl-8809-b1c465 38m Normal Started pod/test-curl-8809-dfdaee Container started 38m Normal Created pod/test-curl-8809-dfdaee Container created 38m Normal Pulled pod/test-curl-8809-dfdaee Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod 38m Normal AddedInterface pod/test-curl-8809-dfdaee Add eth0 [10.134.0.136/23] from ovn-kubernetes 38m Normal Killing pod/test-curl-8809-dfdaee Stopping container test-curl-8809-dfdaee 33m Normal AddedInterface pod/test-curl-8809-a1fcaf Add eth0 [10.133.0.229/23] from ovn-kubernetes 33m Normal Pulled pod/test-curl-8809-a1fcaf Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod 33m Normal Started pod/test-curl-8809-a1fcaf Container started 33m Normal Created pod/test-curl-8809-a1fcaf Container created 33m Normal Killing pod/test-curl-8809-a1fcaf Stopping container test-curl-8809-a1fcaf 27m Normal Started pod/test-curl-8800-326068 Container started 27m Normal Created pod/test-curl-8800-326068 Container created 27m Normal Pulled pod/test-curl-8800-326068 Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod 27m Normal AddedInterface pod/test-curl-8800-326068 Add eth0 [10.133.0.253/23] from ovn-kubernetes 27m Normal AddedInterface pod/test-curl-8800-e6ff78 Add eth0 [10.133.0.254/23] from ovn-kubernetes 27m Normal Killing pod/test-curl-8800-326068 Stopping container test-curl-8800-326068 27m Normal Pulled pod/test-curl-8800-e6ff78 Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod 27m Normal Created pod/test-curl-8800-e6ff78 Container created 27m Normal Started pod/test-curl-8800-e6ff78 Container started 27m Normal Killing pod/test-curl-8800-e6ff78 Stopping container test-curl-8800-e6ff78 13m Normal Killing pod/maas-controller-6658f68bfc-xts57 Stopping container manager 13m Normal SuccessfulDelete replicaset/maas-controller-6658f68bfc Deleted pod: maas-controller-6658f68bfc-xts57 13m Normal SuccessfulCreate replicaset/maas-controller-6658f68bfc Created pod: maas-controller-6658f68bfc-vq9nc 13m Normal AddedInterface pod/maas-controller-6658f68bfc-vq9nc Add eth0 [10.133.1.44/23] from ovn-kubernetes 13m Normal Pulling pod/maas-controller-6658f68bfc-vq9nc Pulling image "quay.io/opendatahub/maas-controller:ccce7752af146eb3de9e99df107c26f414878726" 13m Normal Started pod/maas-controller-6658f68bfc-vq9nc Container started 13m Normal Pulled pod/maas-controller-6658f68bfc-vq9nc Successfully pulled image "quay.io/opendatahub/maas-controller:ccce7752af146eb3de9e99df107c26f414878726" in 580ms (580ms including waiting). Image size: 199691795 bytes. 13m Normal Created pod/maas-controller-6658f68bfc-vq9nc Container created 13m Normal LeaderElection lease/maas-controller.models-as-a-service.opendatahub.io maas-controller-6658f68bfc-vq9nc_4e8f76da-fc02-4cee-ba4f-81204ec87932 became leader 13m Normal Killing pod/maas-controller-6658f68bfc-vq9nc Stopping container manager 13m Normal SuccessfulDelete replicaset/maas-controller-6658f68bfc Deleted pod: maas-controller-6658f68bfc-vq9nc 13m Normal ScalingReplicaSet deployment/maas-controller Scaled down replica set maas-controller-6658f68bfc from 1 to 0 13m Normal SuccessfulCreate replicaset/maas-controller-6658f68bfc Created pod: maas-controller-6658f68bfc-lz8dz 13m Normal ScalingReplicaSet deployment/maas-controller Scaled up replica set maas-controller-6658f68bfc from 0 to 1 13m Normal Pulling pod/maas-controller-6658f68bfc-lz8dz Pulling image "quay.io/opendatahub/maas-controller:ccce7752af146eb3de9e99df107c26f414878726" 13m Normal AddedInterface pod/maas-controller-6658f68bfc-lz8dz Add eth0 [10.133.1.46/23] from ovn-kubernetes 13m Normal Started pod/maas-controller-6658f68bfc-lz8dz Container started 13m Normal Created pod/maas-controller-6658f68bfc-lz8dz Container created 13m Normal Pulled pod/maas-controller-6658f68bfc-lz8dz Successfully pulled image "quay.io/opendatahub/maas-controller:ccce7752af146eb3de9e99df107c26f414878726" in 293ms (293ms including waiting). Image size: 199691795 bytes. 12m Normal LeaderElection lease/maas-controller.models-as-a-service.opendatahub.io maas-controller-6658f68bfc-lz8dz_4c4eac70-4e0e-40c8-bd94-62f41cd88c81 became leader