=== events in opendatahub (2026-10-30T01:40:38Z) === LAST SEEN TYPE REASON OBJECT MESSAGE 48m Normal Scheduled pod/test-curl-8976-22de64 Successfully assigned opendatahub/test-curl-8976-22de64 to ip-10-0-132-84.ec2.internal 61m Normal Scheduled pod/odh-observability-584f99c788-t54b4 Successfully assigned opendatahub/odh-observability-584f99c788-t54b4 to ip-10-0-132-84.ec2.internal 57m Normal Scheduled pod/usage-logs-tenancy-proxy-7d94f55f4b-wx4nc Successfully assigned opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-wx4nc to ip-10-0-139-66.ec2.internal 45m Normal Scheduled pod/test-curl-8991-dc316e Successfully assigned opendatahub/test-curl-8991-dc316e to ip-10-0-132-84.ec2.internal 57m Normal Scheduled pod/maas-controller-577f596567-8ht5j Successfully assigned opendatahub/maas-controller-577f596567-8ht5j to ip-10-0-139-66.ec2.internal 45m Normal Scheduled pod/test-curl-8991-73f55f Successfully assigned opendatahub/test-curl-8991-73f55f to ip-10-0-132-84.ec2.internal 27m Normal Scheduled pod/test-curl-8991-400514 Successfully assigned opendatahub/test-curl-8991-400514 to ip-10-0-132-84.ec2.internal 45m Normal Scheduled pod/test-curl-8991-3c1955 Successfully assigned opendatahub/test-curl-8991-3c1955 to ip-10-0-132-84.ec2.internal 55m Normal Scheduled pod/ai-gateway-controller-d8c8ccb-5r5q2 Successfully assigned opendatahub/ai-gateway-controller-d8c8ccb-5r5q2 to ip-10-0-130-245.ec2.internal 45m Normal Scheduled pod/test-curl-8991-1ed87b Successfully assigned opendatahub/test-curl-8991-1ed87b to ip-10-0-132-84.ec2.internal 26m Normal Scheduled pod/test-curl-8985-f57532 Successfully assigned opendatahub/test-curl-8985-f57532 to ip-10-0-132-84.ec2.internal 48m Normal Scheduled pod/test-curl-8982-207bf0 Successfully assigned opendatahub/test-curl-8982-207bf0 to ip-10-0-139-66.ec2.internal 55m Normal Scheduled pod/ai-gateway-controller-84479857d9-2xt9z Successfully assigned opendatahub/ai-gateway-controller-84479857d9-2xt9z to ip-10-0-130-245.ec2.internal 43m Normal Scheduled pod/test-curl-8979-c98f1b Successfully assigned opendatahub/test-curl-8979-c98f1b to ip-10-0-139-66.ec2.internal 27m Normal Scheduled pod/test-curl-8991-740c4c Successfully assigned opendatahub/test-curl-8991-740c4c to ip-10-0-132-84.ec2.internal 57m Normal Scheduled pod/llmisvc-controller-manager-6466c554d8-2g96n Successfully assigned opendatahub/llmisvc-controller-manager-6466c554d8-2g96n to ip-10-0-132-84.ec2.internal 62m Normal Scheduled pod/opendatahub-operator-controller-manager-6f85c8f7c-k29rq Successfully assigned opendatahub/opendatahub-operator-controller-manager-6f85c8f7c-k29rq to ip-10-0-130-245.ec2.internal 13m Normal Scheduled pod/maas-controller-f6db8855d-m4z7t Successfully assigned opendatahub/maas-controller-f6db8855d-m4z7t to ip-10-0-139-66.ec2.internal 60m Normal Scheduled pod/llmisvc-controller-manager-869d5dcc5d-gsgxj Successfully assigned opendatahub/llmisvc-controller-manager-869d5dcc5d-gsgxj to ip-10-0-132-84.ec2.internal 57m Normal Scheduled pod/maas-controller-f6db8855d-hlvbv Successfully assigned opendatahub/maas-controller-f6db8855d-hlvbv to ip-10-0-139-66.ec2.internal 13m Normal Scheduled pod/maas-controller-f6db8855d-587kv Successfully assigned opendatahub/maas-controller-f6db8855d-587kv to ip-10-0-139-66.ec2.internal 62m Normal Scheduled pod/opendatahub-operator-controller-manager-6f85c8f7c-rmwfm Successfully assigned opendatahub/opendatahub-operator-controller-manager-6f85c8f7c-rmwfm to ip-10-0-139-66.ec2.internal 60m Normal Scheduled pod/kserve-controller-manager-776cc66d47-5xnrn Successfully assigned opendatahub/kserve-controller-manager-776cc66d47-5xnrn to ip-10-0-132-84.ec2.internal 41m Normal Scheduled pod/test-curl-8979-1ce4d1 Successfully assigned opendatahub/test-curl-8979-1ce4d1 to ip-10-0-139-66.ec2.internal 60m Normal Scheduled pod/odh-model-controller-f87fcf56c-lbcfw Successfully assigned opendatahub/odh-model-controller-f87fcf56c-lbcfw to ip-10-0-130-245.ec2.internal 60m Normal Scheduled pod/model-serving-api-75bd89fdfc-4rx7v Successfully assigned opendatahub/model-serving-api-75bd89fdfc-4rx7v to ip-10-0-132-84.ec2.internal 62m Normal Scheduled pod/opendatahub-operator-controller-manager-6f85c8f7c-cscsr Successfully assigned opendatahub/opendatahub-operator-controller-manager-6f85c8f7c-cscsr to ip-10-0-132-84.ec2.internal 61m Normal Scheduled pod/kserve-module-controller-manager-5cfb77bf8c-4r98t Successfully assigned opendatahub/kserve-module-controller-manager-5cfb77bf8c-4r98t to ip-10-0-139-66.ec2.internal 62m Normal RequirementsUnknown clusterserviceversion/opendatahub-operator.v3.6.0-ea.2 requirements not yet checked 62m Normal RequirementsNotMet clusterserviceversion/opendatahub-operator.v3.6.0-ea.2 one or more requirements couldn't be found 62m Normal AllRequirementsMet clusterserviceversion/opendatahub-operator.v3.6.0-ea.2 all requirements found, attempting install 62m Normal ScalingReplicaSet deployment/opendatahub-operator-controller-manager Scaled up replica set opendatahub-operator-controller-manager-6f85c8f7c from 0 to 3 62m Normal SuccessfulCreate replicaset/opendatahub-operator-controller-manager-6f85c8f7c Created pod: opendatahub-operator-controller-manager-6f85c8f7c-k29rq 62m Normal AddedInterface pod/opendatahub-operator-controller-manager-6f85c8f7c-cscsr Add eth0 [10.133.0.21/23] from ovn-kubernetes 62m Normal Pulling pod/opendatahub-operator-controller-manager-6f85c8f7c-rmwfm Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" 62m Normal SuccessfulCreate replicaset/opendatahub-operator-controller-manager-6f85c8f7c Created pod: opendatahub-operator-controller-manager-6f85c8f7c-rmwfm 62m Normal AddedInterface pod/opendatahub-operator-controller-manager-6f85c8f7c-k29rq Add eth0 [10.134.0.23/23] from ovn-kubernetes 62m Normal Pulling pod/opendatahub-operator-controller-manager-6f85c8f7c-k29rq Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" 62m Normal SuccessfulCreate replicaset/opendatahub-operator-controller-manager-6f85c8f7c Created pod: opendatahub-operator-controller-manager-6f85c8f7c-cscsr 62m Normal AddedInterface pod/opendatahub-operator-controller-manager-6f85c8f7c-rmwfm Add eth0 [10.132.0.30/23] from ovn-kubernetes 62m Normal Pulling pod/opendatahub-operator-controller-manager-6f85c8f7c-cscsr Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" 62m Normal InstallSucceeded clusterserviceversion/opendatahub-operator.v3.6.0-ea.2 waiting for install components to report healthy 62m Normal InstallWaiting clusterserviceversion/opendatahub-operator.v3.6.0-ea.2 installing: waiting for deployment opendatahub-operator-controller-manager to become ready: deployment "opendatahub-operator-controller-manager" not available: Deployment does not have minimum availability. 62m Normal Started pod/opendatahub-operator-controller-manager-6f85c8f7c-cscsr Container started 62m Normal Started pod/opendatahub-operator-controller-manager-6f85c8f7c-k29rq Container started 62m Normal Pulled pod/opendatahub-operator-controller-manager-6f85c8f7c-cscsr Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 2.783s (2.783s including waiting). Image size: 273709574 bytes. 62m Normal Created pod/opendatahub-operator-controller-manager-6f85c8f7c-cscsr Container created 62m Normal Pulled pod/opendatahub-operator-controller-manager-6f85c8f7c-rmwfm Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 2.925s (2.925s including waiting). Image size: 273709574 bytes. 62m Normal Created pod/opendatahub-operator-controller-manager-6f85c8f7c-rmwfm Container created 62m Normal Started pod/opendatahub-operator-controller-manager-6f85c8f7c-rmwfm Container started 62m Normal Pulled pod/opendatahub-operator-controller-manager-6f85c8f7c-k29rq Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 2.908s (2.908s including waiting). Image size: 273709574 bytes. 62m Normal Created pod/opendatahub-operator-controller-manager-6f85c8f7c-k29rq Container created 62m Normal Pulling pod/opendatahub-operator-controller-manager-6f85c8f7c-rmwfm Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" 62m Normal Created pod/opendatahub-operator-controller-manager-6f85c8f7c-cscsr Container created 62m Normal Pulling pod/opendatahub-operator-controller-manager-6f85c8f7c-k29rq Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" 62m Normal Pulled pod/opendatahub-operator-controller-manager-6f85c8f7c-cscsr Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 345ms (345ms including waiting). Image size: 273709574 bytes. 62m Normal Pulled pod/opendatahub-operator-controller-manager-6f85c8f7c-k29rq Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 364ms (364ms including waiting). Image size: 273709574 bytes. 62m Normal Started pod/opendatahub-operator-controller-manager-6f85c8f7c-cscsr Container started 62m Normal Pulling pod/opendatahub-operator-controller-manager-6f85c8f7c-cscsr Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" 62m Normal Pulled pod/opendatahub-operator-controller-manager-6f85c8f7c-rmwfm Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 366ms (366ms including waiting). Image size: 273709574 bytes. 62m Normal Created pod/opendatahub-operator-controller-manager-6f85c8f7c-rmwfm Container created 62m Normal Started pod/opendatahub-operator-controller-manager-6f85c8f7c-rmwfm Container started 62m Normal Created pod/opendatahub-operator-controller-manager-6f85c8f7c-k29rq Container created 62m Normal Started pod/opendatahub-operator-controller-manager-6f85c8f7c-k29rq Container started 62m Normal LeaderElection lease/07ed84f7.opendatahub.io opendatahub-operator-controller-manager-6f85c8f7c-rmwfm_3e04552e-2a23-40ab-ab08-0ee09216f43f became leader 61m Normal InstallSucceeded clusterserviceversion/opendatahub-operator.v3.6.0-ea.2 install strategy completed with no errors 61m Normal Issuing certificate/odh-observability-webhook-cert Issuing certificate as Secret does not exist 61m Warning FailedMount pod/odh-observability-584f99c788-t54b4 MountVolume.SetUp failed for volume "webhook-certs" : secret "odh-observability-webhook-cert" not found 61m Normal WaitingForApproval certificaterequest/odh-observability-webhook-cert-1 Not signing CertificateRequest until it is Approved 61m Normal WaitingForApproval certificaterequest/odh-observability-webhook-cert-1 Not signing CertificateRequest until it is Approved 61m Normal WaitingForApproval certificaterequest/odh-observability-webhook-cert-1 Not signing CertificateRequest until it is Approved 61m Normal WaitingForApproval certificaterequest/odh-observability-webhook-cert-1 Not signing CertificateRequest until it is Approved 61m Normal WaitingForApproval certificaterequest/odh-observability-webhook-cert-1 Not signing CertificateRequest until it is Approved 61m Normal SuccessfulCreate replicaset/odh-observability-584f99c788 Created pod: odh-observability-584f99c788-t54b4 61m Normal Issuing certificate/odh-observability-webhook-cert The certificate has been successfully issued 61m Normal Requested certificate/odh-observability-webhook-cert Created new CertificateRequest resource "odh-observability-webhook-cert-1" 61m Normal Generated certificate/odh-observability-webhook-cert Stored new private key in temporary Secret resource "odh-observability-webhook-cert-xh42q" 61m Normal cert-manager.io certificaterequest/odh-observability-webhook-cert-1 Certificate request has been approved by cert-manager.io 61m Normal CertificateIssued certificaterequest/odh-observability-webhook-cert-1 Certificate fetched from issuer successfully 61m Normal ScalingReplicaSet deployment/odh-observability Scaled up replica set odh-observability-584f99c788 from 0 to 1 61m Warning BadConfig certificaterequest/odh-observability-webhook-cert-1 Certificate will be issued with an empty Issuer DN, which contravenes RFC 5280 and could break some strict clients 61m Normal AddedInterface pod/odh-observability-584f99c788-t54b4 Add eth0 [10.133.0.22/23] from ovn-kubernetes 61m Normal Pulling pod/odh-observability-584f99c788-t54b4 Pulling image "quay.io/opendatahub/odh-observability@sha256:03689e71fb8879ea696366b83d2a4727eb76e696baf8c2be2b18121c0534db4e" 61m Normal Pulled pod/odh-observability-584f99c788-t54b4 Successfully pulled image "quay.io/opendatahub/odh-observability@sha256:03689e71fb8879ea696366b83d2a4727eb76e696baf8c2be2b18121c0534db4e" in 2.261s (2.261s including waiting). Image size: 154660917 bytes. 61m Normal Created pod/odh-observability-584f99c788-t54b4 Container created 61m Normal Started pod/odh-observability-584f99c788-t54b4 Container started 61m Normal ScalingReplicaSet deployment/kserve-module-controller-manager Scaled up replica set kserve-module-controller-manager-5cfb77bf8c from 0 to 1 61m Normal SuccessfulCreate replicaset/kserve-module-controller-manager-5cfb77bf8c Created pod: kserve-module-controller-manager-5cfb77bf8c-4r98t 61m Normal Pulling pod/kserve-module-controller-manager-5cfb77bf8c-4r98t Pulling image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189" 61m Normal AddedInterface pod/kserve-module-controller-manager-5cfb77bf8c-4r98t Add eth0 [10.132.0.34/23] from ovn-kubernetes 61m Normal Pulled pod/kserve-module-controller-manager-5cfb77bf8c-4r98t Successfully pulled image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189" in 1.539s (1.539s including waiting). Image size: 195729000 bytes. 61m Normal Started pod/kserve-module-controller-manager-5cfb77bf8c-4r98t Container started 61m Normal Created pod/kserve-module-controller-manager-5cfb77bf8c-4r98t Container created 61m Normal LeaderElection lease/kserve-module-controller-manager kserve-module-controller-manager-5cfb77bf8c-4r98t_58968066-15e0-478f-a722-9671989e1392 became leader 60m Normal ScalingReplicaSet deployment/odh-model-controller Scaled up replica set odh-model-controller-f87fcf56c from 0 to 1 60m Normal ScalingReplicaSet deployment/llmisvc-controller-manager Scaled up replica set llmisvc-controller-manager-869d5dcc5d from 0 to 1 60m Normal SuccessfulCreate replicaset/kserve-controller-manager-776cc66d47 Created pod: kserve-controller-manager-776cc66d47-5xnrn 60m Normal SuccessfulCreate replicaset/llmisvc-controller-manager-869d5dcc5d Created pod: llmisvc-controller-manager-869d5dcc5d-gsgxj 60m Normal ScalingReplicaSet deployment/model-serving-api Scaled up replica set model-serving-api-75bd89fdfc from 0 to 1 60m Normal SuccessfulCreate replicaset/model-serving-api-75bd89fdfc Created pod: model-serving-api-75bd89fdfc-4rx7v 60m Normal ScalingReplicaSet deployment/kserve-controller-manager Scaled up replica set kserve-controller-manager-776cc66d47 from 0 to 1 60m Normal SuccessfulCreate replicaset/odh-model-controller-f87fcf56c Created pod: odh-model-controller-f87fcf56c-lbcfw 60m Normal AddedInterface pod/kserve-controller-manager-776cc66d47-5xnrn Add eth0 [10.133.0.23/23] from ovn-kubernetes 60m Normal AddedInterface pod/model-serving-api-75bd89fdfc-4rx7v Add eth0 [10.133.0.25/23] from ovn-kubernetes 60m Normal Pulling pod/model-serving-api-75bd89fdfc-4rx7v Pulling image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8" 60m Normal Pulling pod/kserve-controller-manager-776cc66d47-5xnrn Pulling image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d" 60m Normal Pulling pod/odh-model-controller-f87fcf56c-lbcfw Pulling image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775" 60m Normal AddedInterface pod/odh-model-controller-f87fcf56c-lbcfw Add eth0 [10.134.0.25/23] from ovn-kubernetes 60m Normal AddedInterface pod/llmisvc-controller-manager-869d5dcc5d-gsgxj Add eth0 [10.133.0.24/23] from ovn-kubernetes 60m Normal Pulling pod/llmisvc-controller-manager-869d5dcc5d-gsgxj Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" 60m Normal Pulled pod/kserve-controller-manager-776cc66d47-5xnrn Successfully pulled image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d" in 3.499s (3.499s including waiting). Image size: 247676581 bytes. 60m Normal Created pod/llmisvc-controller-manager-869d5dcc5d-gsgxj Container created 60m Normal Created pod/model-serving-api-75bd89fdfc-4rx7v Container created 60m Normal Pulled pod/odh-model-controller-f87fcf56c-lbcfw Successfully pulled image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775" in 2.474s (2.474s including waiting). Image size: 236755567 bytes. 60m Normal Created pod/odh-model-controller-f87fcf56c-lbcfw Container created 60m Normal Started pod/odh-model-controller-f87fcf56c-lbcfw Container started 60m Normal Pulled pod/model-serving-api-75bd89fdfc-4rx7v Successfully pulled image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8" in 2.477s (2.477s including waiting). Image size: 184925761 bytes. 60m Normal Started pod/llmisvc-controller-manager-869d5dcc5d-gsgxj Container started 60m Normal Started pod/model-serving-api-75bd89fdfc-4rx7v Container started 60m Normal Pulled pod/llmisvc-controller-manager-869d5dcc5d-gsgxj Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 3.379s (3.379s including waiting). Image size: 235100981 bytes. 60m Normal LeaderElection lease/odh-model-controller.opendatahub.io odh-model-controller-f87fcf56c-lbcfw_ba6dc981-affc-4161-a415-e9a0ca181c21 became leader 60m Normal Started pod/kserve-controller-manager-776cc66d47-5xnrn Container started 60m Normal Created pod/kserve-controller-manager-776cc66d47-5xnrn Container created 60m Normal LeaderElection lease/kserve-controller-manager-leader-lock kserve-controller-manager-776cc66d47-5xnrn_49b54500-f2e1-48f4-8671-584cbd5e4e6a became leader 60m Normal LeaderElection lease/llminferenceservice-kserve-controller-manager llmisvc-controller-manager-869d5dcc5d-gsgxj_a6181dcc-4483-4410-8bac-6984617a28d8 became leader 57m Normal SuccessfulCreate replicaset/maas-controller-f6db8855d Created pod: maas-controller-f6db8855d-hlvbv 57m Normal ScalingReplicaSet deployment/maas-controller Scaled up replica set maas-controller-577f596567 from 0 to 1 57m Normal SuccessfulCreate replicaset/maas-controller-577f596567 Created pod: maas-controller-577f596567-8ht5j 57m Normal Pulling pod/maas-controller-f6db8855d-hlvbv Pulling image "quay.io/opendatahub/maas-controller:ccce7752af146eb3de9e99df107c26f414878726" 57m Normal AddedInterface pod/maas-controller-f6db8855d-hlvbv Add eth0 [10.132.0.50/23] from ovn-kubernetes 57m Normal Pulling pod/maas-controller-577f596567-8ht5j Pulling image "quay.io/opendatahub/maas-controller:ccce7752af146eb3de9e99df107c26f414878726" 57m Normal AddedInterface pod/maas-controller-577f596567-8ht5j Add eth0 [10.132.0.49/23] from ovn-kubernetes 57m Normal Pulled pod/maas-controller-577f596567-8ht5j Successfully pulled image "quay.io/opendatahub/maas-controller:ccce7752af146eb3de9e99df107c26f414878726" in 2.666s (2.666s including waiting). Image size: 199691795 bytes. 57m Normal Started pod/maas-controller-577f596567-8ht5j Container started 57m Normal Created pod/maas-controller-577f596567-8ht5j Container created 57m Normal Pulled pod/maas-controller-f6db8855d-hlvbv Successfully pulled image "quay.io/opendatahub/maas-controller:ccce7752af146eb3de9e99df107c26f414878726" in 2.621s (2.621s including waiting). Image size: 199691795 bytes. 57m Normal Created pod/maas-controller-f6db8855d-hlvbv Container created 57m Normal Started pod/maas-controller-f6db8855d-hlvbv Container started 57m Normal LeaderElection lease/maas-controller.models-as-a-service.opendatahub.io maas-controller-f6db8855d-hlvbv_acc0ae8a-0e24-4c97-bc6b-25fd62176306 became leader 57m Normal ScalingReplicaSet deployment/usage-logs-tenancy-proxy Scaled up replica set usage-logs-tenancy-proxy-7d94f55f4b from 0 to 1 57m Normal SuccessfulCreate replicaset/usage-logs-tenancy-proxy-7d94f55f4b Created pod: usage-logs-tenancy-proxy-7d94f55f4b-wx4nc 57m Normal Pulling pod/usage-logs-tenancy-proxy-7d94f55f4b-wx4nc Pulling image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172" 57m Normal AddedInterface pod/usage-logs-tenancy-proxy-7d94f55f4b-wx4nc Add eth0 [10.132.0.51/23] from ovn-kubernetes 57m Normal Killing pod/maas-controller-577f596567-8ht5j Stopping container manager 57m Normal SuccessfulDelete replicaset/maas-controller-577f596567 Deleted pod: maas-controller-577f596567-8ht5j 57m Normal ScalingReplicaSet deployment/maas-controller Scaled down replica set maas-controller-577f596567 from 1 to 0 57m Normal Pulled pod/usage-logs-tenancy-proxy-7d94f55f4b-wx4nc Successfully pulled image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172" in 10.497s (10.497s including waiting). Image size: 1089502687 bytes. 57m Normal Created pod/usage-logs-tenancy-proxy-7d94f55f4b-wx4nc Container created 57m Normal Started pod/usage-logs-tenancy-proxy-7d94f55f4b-wx4nc Container started 57m Normal SuccessfulCreate replicaset/llmisvc-controller-manager-6466c554d8 Created pod: llmisvc-controller-manager-6466c554d8-2g96n 57m Normal ScalingReplicaSet deployment/llmisvc-controller-manager Scaled up replica set llmisvc-controller-manager-6466c554d8 from 0 to 1 57m Normal AddedInterface pod/llmisvc-controller-manager-6466c554d8-2g96n Add eth0 [10.133.0.30/23] from ovn-kubernetes 57m Normal Pulled pod/llmisvc-controller-manager-6466c554d8-2g96n Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 399ms (400ms including waiting). Image size: 235100981 bytes. 57m Normal Pulling pod/llmisvc-controller-manager-6466c554d8-2g96n Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" 57m Normal Started pod/llmisvc-controller-manager-6466c554d8-2g96n Container started 57m Normal Created pod/llmisvc-controller-manager-6466c554d8-2g96n Container created 56m Normal ScalingReplicaSet deployment/llmisvc-controller-manager Scaled down replica set llmisvc-controller-manager-869d5dcc5d from 1 to 0 56m Normal SuccessfulDelete replicaset/llmisvc-controller-manager-869d5dcc5d Deleted pod: llmisvc-controller-manager-869d5dcc5d-gsgxj 56m Normal Killing pod/llmisvc-controller-manager-869d5dcc5d-gsgxj Stopping container manager 56m Normal LeaderElection lease/llminferenceservice-kserve-controller-manager llmisvc-controller-manager-6466c554d8-2g96n_8ffe61f9-1e72-4ecd-9fcc-3fe5d64fc7d7 became leader 55m Normal ScalingReplicaSet deployment/ai-gateway-controller Scaled up replica set ai-gateway-controller-d8c8ccb from 0 to 1 55m Normal SuccessfulCreate replicaset/ai-gateway-controller-d8c8ccb Created pod: ai-gateway-controller-d8c8ccb-5r5q2 55m Normal AddedInterface pod/ai-gateway-controller-d8c8ccb-5r5q2 Add eth0 [10.134.0.38/23] from ovn-kubernetes 55m Normal Pulling pod/ai-gateway-controller-d8c8ccb-5r5q2 Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:odh-pr-196" 55m Normal Created pod/ai-gateway-controller-d8c8ccb-5r5q2 Container created 55m Normal Pulled pod/ai-gateway-controller-d8c8ccb-5r5q2 Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:odh-pr-196" in 2.958s (2.958s including waiting). Image size: 183892393 bytes. 55m Normal Started pod/ai-gateway-controller-d8c8ccb-5r5q2 Container started 55m Normal LeaderElection lease/ai-gateway-controller-leader.opendatahub.io ai-gateway-controller-d8c8ccb-5r5q2_274a046b-8458-4d0b-9ad5-f883b2a512d3 became leader 55m Normal Pulling pod/ai-gateway-controller-84479857d9-2xt9z Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:odh-pr-196" 55m Normal SuccessfulCreate replicaset/ai-gateway-controller-84479857d9 Created pod: ai-gateway-controller-84479857d9-2xt9z 55m Normal ScalingReplicaSet deployment/ai-gateway-controller Scaled up replica set ai-gateway-controller-84479857d9 from 0 to 1 55m Normal AddedInterface pod/ai-gateway-controller-84479857d9-2xt9z Add eth0 [10.134.0.41/23] from ovn-kubernetes 55m Normal Started pod/ai-gateway-controller-84479857d9-2xt9z Container started 55m Normal Created pod/ai-gateway-controller-84479857d9-2xt9z Container created 55m Normal Pulled pod/ai-gateway-controller-84479857d9-2xt9z Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:odh-pr-196" in 347ms (347ms including waiting). Image size: 183892393 bytes. 55m Normal Killing pod/ai-gateway-controller-d8c8ccb-5r5q2 Stopping container manager 55m Normal ScalingReplicaSet deployment/ai-gateway-controller Scaled down replica set ai-gateway-controller-d8c8ccb from 1 to 0 55m Normal SuccessfulDelete replicaset/ai-gateway-controller-d8c8ccb Deleted pod: ai-gateway-controller-d8c8ccb-5r5q2 54m Normal LeaderElection lease/ai-gateway-controller-leader.opendatahub.io ai-gateway-controller-84479857d9-2xt9z_22d27323-5d93-43d2-90d8-87b576ace602 became leader 48m Normal AddedInterface pod/test-curl-8976-22de64 Add eth0 [10.133.0.74/23] from ovn-kubernetes 48m Normal Pulling pod/test-curl-8976-22de64 Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" 48m Normal AddedInterface pod/test-curl-8982-207bf0 Add eth0 [10.132.0.102/23] from ovn-kubernetes 48m Normal Pulling pod/test-curl-8982-207bf0 Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" 48m Normal Pulled pod/test-curl-8976-22de64 Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 2.603s (2.603s including waiting). Image size: 106100986 bytes. 48m Normal Created pod/test-curl-8976-22de64 Container created 48m Normal Started pod/test-curl-8976-22de64 Container started 48m Normal Pulled pod/test-curl-8982-207bf0 Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 4.779s (4.779s including waiting). Image size: 106100986 bytes. 48m Normal Killing pod/test-curl-8976-22de64 Stopping container test-curl-8976-22de64 48m Normal Started pod/test-curl-8982-207bf0 Container started 48m Normal Created pod/test-curl-8982-207bf0 Container created 48m Normal Killing pod/test-curl-8982-207bf0 Stopping container test-curl-8982-207bf0 45m Normal Pulled pod/test-curl-8991-73f55f Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod 45m Normal AddedInterface pod/test-curl-8991-73f55f Add eth0 [10.133.0.88/23] from ovn-kubernetes 45m Normal Created pod/test-curl-8991-73f55f Container created 45m Normal Started pod/test-curl-8991-73f55f Container started 45m Normal Pulled pod/test-curl-8991-1ed87b Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod 45m Normal AddedInterface pod/test-curl-8991-1ed87b Add eth0 [10.133.0.89/23] from ovn-kubernetes 45m Normal Started pod/test-curl-8991-1ed87b Container started 45m Normal Created pod/test-curl-8991-1ed87b Container created 45m Normal Killing pod/test-curl-8991-73f55f Stopping container test-curl-8991-73f55f 45m Normal Started pod/test-curl-8991-3c1955 Container started 45m Normal Killing pod/test-curl-8991-1ed87b Stopping container test-curl-8991-1ed87b 45m Normal AddedInterface pod/test-curl-8991-3c1955 Add eth0 [10.133.0.90/23] from ovn-kubernetes 45m Normal Pulled pod/test-curl-8991-3c1955 Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod 45m Normal Created pod/test-curl-8991-3c1955 Container created 45m Normal Pulled pod/test-curl-8991-dc316e Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod 45m Normal Killing pod/test-curl-8991-3c1955 Stopping container test-curl-8991-3c1955 45m Normal AddedInterface pod/test-curl-8991-dc316e Add eth0 [10.133.0.91/23] from ovn-kubernetes 45m Normal Started pod/test-curl-8991-dc316e Container started 45m Normal Created pod/test-curl-8991-dc316e Container created 45m Normal Killing pod/test-curl-8991-dc316e Stopping container test-curl-8991-dc316e 43m Normal AddedInterface pod/test-curl-8979-c98f1b Add eth0 [10.132.0.131/23] from ovn-kubernetes 43m Normal Pulled pod/test-curl-8979-c98f1b Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod 43m Normal Created pod/test-curl-8979-c98f1b Container created 43m Normal Started pod/test-curl-8979-c98f1b Container started 43m Normal Killing pod/test-curl-8979-c98f1b Stopping container test-curl-8979-c98f1b 41m Normal AddedInterface pod/test-curl-8979-1ce4d1 Add eth0 [10.132.0.140/23] from ovn-kubernetes 41m Normal Pulled pod/test-curl-8979-1ce4d1 Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod 41m Normal Created pod/test-curl-8979-1ce4d1 Container created 41m Normal Started pod/test-curl-8979-1ce4d1 Container started 41m Normal Killing pod/test-curl-8979-1ce4d1 Stopping container test-curl-8979-1ce4d1 27m Normal Started pod/test-curl-8991-740c4c Container started 27m Normal AddedInterface pod/test-curl-8991-740c4c Add eth0 [10.133.0.167/23] from ovn-kubernetes 27m Normal Created pod/test-curl-8991-740c4c Container created 27m Normal Pulled pod/test-curl-8991-740c4c Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod 27m Normal AddedInterface pod/test-curl-8991-400514 Add eth0 [10.133.0.168/23] from ovn-kubernetes 27m Normal Killing pod/test-curl-8991-740c4c Stopping container test-curl-8991-740c4c 27m Normal Pulled pod/test-curl-8991-400514 Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod 27m Normal Created pod/test-curl-8991-400514 Container created 27m Normal Started pod/test-curl-8991-400514 Container started 27m Normal Killing pod/test-curl-8991-400514 Stopping container test-curl-8991-400514 26m Normal Pulled pod/test-curl-8985-f57532 Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod 26m Normal AddedInterface pod/test-curl-8985-f57532 Add eth0 [10.133.0.175/23] from ovn-kubernetes 26m Normal Created pod/test-curl-8985-f57532 Container created 26m Normal Started pod/test-curl-8985-f57532 Container started 26m Normal Killing pod/test-curl-8985-f57532 Stopping container test-curl-8985-f57532 14m Normal Killing pod/maas-controller-f6db8855d-hlvbv Stopping container manager 14m Normal SuccessfulDelete replicaset/maas-controller-f6db8855d Deleted pod: maas-controller-f6db8855d-hlvbv 13m Normal SuccessfulCreate replicaset/maas-controller-f6db8855d Created pod: maas-controller-f6db8855d-m4z7t 13m Normal AddedInterface pod/maas-controller-f6db8855d-m4z7t Add eth0 [10.132.0.225/23] from ovn-kubernetes 13m Normal Created pod/maas-controller-f6db8855d-m4z7t Container created 13m Normal Started pod/maas-controller-f6db8855d-m4z7t Container started 13m Normal Pulling pod/maas-controller-f6db8855d-m4z7t Pulling image "quay.io/opendatahub/maas-controller:ccce7752af146eb3de9e99df107c26f414878726" 13m Normal Pulled pod/maas-controller-f6db8855d-m4z7t Successfully pulled image "quay.io/opendatahub/maas-controller:ccce7752af146eb3de9e99df107c26f414878726" in 415ms (415ms including waiting). Image size: 199691795 bytes. 13m Normal LeaderElection lease/maas-controller.models-as-a-service.opendatahub.io maas-controller-f6db8855d-m4z7t_90cb672c-acbb-400a-9f8c-cacb13bf9cb2 became leader 13m Normal SuccessfulDelete replicaset/maas-controller-f6db8855d Deleted pod: maas-controller-f6db8855d-m4z7t 13m Normal Killing pod/maas-controller-f6db8855d-m4z7t Stopping container manager 13m Normal ScalingReplicaSet deployment/maas-controller Scaled down replica set maas-controller-f6db8855d from 1 to 0 13m Normal SuccessfulCreate replicaset/maas-controller-f6db8855d Created pod: maas-controller-f6db8855d-587kv 13m Normal ScalingReplicaSet deployment/maas-controller Scaled up replica set maas-controller-f6db8855d from 0 to 1 13m Normal Started pod/maas-controller-f6db8855d-587kv Container started 13m Normal Created pod/maas-controller-f6db8855d-587kv Container created 13m Normal Pulling pod/maas-controller-f6db8855d-587kv Pulling image "quay.io/opendatahub/maas-controller:ccce7752af146eb3de9e99df107c26f414878726" 13m Normal Pulled pod/maas-controller-f6db8855d-587kv Successfully pulled image "quay.io/opendatahub/maas-controller:ccce7752af146eb3de9e99df107c26f414878726" in 371ms (371ms including waiting). Image size: 199691795 bytes. 13m Normal AddedInterface pod/maas-controller-f6db8855d-587kv Add eth0 [10.132.0.228/23] from ovn-kubernetes 13m Normal LeaderElection lease/maas-controller.models-as-a-service.opendatahub.io maas-controller-f6db8855d-587kv_e70c4bb5-3e6b-47ea-85d5-0a38066e68f8 became leader