=== events in opendatahub (2026-10-30T06:41:25Z) === LAST SEEN TYPE REASON OBJECT MESSAGE 45m Normal Scheduled pod/test-curl-9201-1a6e9d Successfully assigned opendatahub/test-curl-9201-1a6e9d to ip-10-0-136-35.ec2.internal 63m Normal Scheduled pod/odh-observability-584f99c788-7nfbb Successfully assigned opendatahub/odh-observability-584f99c788-7nfbb to ip-10-0-136-35.ec2.internal 59m Normal Scheduled pod/usage-logs-tenancy-proxy-7d94f55f4b-nlrqh Successfully assigned opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-nlrqh to ip-10-0-136-173.ec2.internal 50m Normal Scheduled pod/test-curl-9213-1ea43b Successfully assigned opendatahub/test-curl-9213-1ea43b to ip-10-0-136-173.ec2.internal 59m Normal Scheduled pod/maas-controller-577f596567-7mzv2 Successfully assigned opendatahub/maas-controller-577f596567-7mzv2 to ip-10-0-136-173.ec2.internal 27m Normal Scheduled pod/test-curl-9210-73c70f Successfully assigned opendatahub/test-curl-9210-73c70f to ip-10-0-136-173.ec2.internal 27m Normal Scheduled pod/test-curl-9210-4e5884 Successfully assigned opendatahub/test-curl-9210-4e5884 to ip-10-0-136-173.ec2.internal 47m Normal Scheduled pod/test-curl-9207-cc6f8d Successfully assigned opendatahub/test-curl-9207-cc6f8d to ip-10-0-136-35.ec2.internal 57m Normal Scheduled pod/ai-gateway-controller-84dff4756b-zmrk4 Successfully assigned opendatahub/ai-gateway-controller-84dff4756b-zmrk4 to ip-10-0-136-35.ec2.internal 47m Normal Scheduled pod/test-curl-9207-a42866 Successfully assigned opendatahub/test-curl-9207-a42866 to ip-10-0-136-35.ec2.internal 47m Normal Scheduled pod/test-curl-9207-a414a3 Successfully assigned opendatahub/test-curl-9207-a414a3 to ip-10-0-136-35.ec2.internal 47m Normal Scheduled pod/test-curl-9207-3d5e36 Successfully assigned opendatahub/test-curl-9207-3d5e36 to ip-10-0-136-35.ec2.internal 57m Normal Scheduled pod/ai-gateway-controller-654df4bd7-95hcs Successfully assigned opendatahub/ai-gateway-controller-654df4bd7-95hcs to ip-10-0-136-35.ec2.internal 20m Normal Scheduled pod/test-curl-9204-d5ade7 Successfully assigned opendatahub/test-curl-9204-d5ade7 to ip-10-0-138-15.ec2.internal 50m Normal Scheduled pod/test-curl-9213-183013 Successfully assigned opendatahub/test-curl-9213-183013 to ip-10-0-136-173.ec2.internal 58m Normal Scheduled pod/llmisvc-controller-manager-6466c554d8-hbjqb Successfully assigned opendatahub/llmisvc-controller-manager-6466c554d8-hbjqb to ip-10-0-136-173.ec2.internal 64m Normal Scheduled pod/opendatahub-operator-controller-manager-f7d897f7-g8rjp Successfully assigned opendatahub/opendatahub-operator-controller-manager-f7d897f7-g8rjp to ip-10-0-138-15.ec2.internal 14m Normal Scheduled pod/maas-controller-5974d5d96-srwds Successfully assigned opendatahub/maas-controller-5974d5d96-srwds to ip-10-0-136-35.ec2.internal 62m Normal Scheduled pod/llmisvc-controller-manager-869d5dcc5d-sb5xm Successfully assigned opendatahub/llmisvc-controller-manager-869d5dcc5d-sb5xm to ip-10-0-136-173.ec2.internal 13m Normal Scheduled pod/maas-controller-5974d5d96-jrgzk Successfully assigned opendatahub/maas-controller-5974d5d96-jrgzk to ip-10-0-136-35.ec2.internal 59m Normal Scheduled pod/maas-controller-5974d5d96-flgp2 Successfully assigned opendatahub/maas-controller-5974d5d96-flgp2 to ip-10-0-136-173.ec2.internal 64m Normal Scheduled pod/opendatahub-operator-controller-manager-f7d897f7-z5lzv Successfully assigned opendatahub/opendatahub-operator-controller-manager-f7d897f7-z5lzv to ip-10-0-136-35.ec2.internal 62m Normal Scheduled pod/kserve-controller-manager-776cc66d47-mz8np Successfully assigned opendatahub/kserve-controller-manager-776cc66d47-mz8np to ip-10-0-136-173.ec2.internal 42m Normal Scheduled pod/test-curl-9201-d4e88d Successfully assigned opendatahub/test-curl-9201-d4e88d to ip-10-0-136-35.ec2.internal 62m Normal Scheduled pod/odh-model-controller-f87fcf56c-nbt6q Successfully assigned opendatahub/odh-model-controller-f87fcf56c-nbt6q to ip-10-0-136-173.ec2.internal 62m Normal Scheduled pod/model-serving-api-75bd89fdfc-ltdvw Successfully assigned opendatahub/model-serving-api-75bd89fdfc-ltdvw to ip-10-0-136-173.ec2.internal 64m Normal Scheduled pod/opendatahub-operator-controller-manager-f7d897f7-4c5zt Successfully assigned opendatahub/opendatahub-operator-controller-manager-f7d897f7-4c5zt to ip-10-0-136-173.ec2.internal 63m Normal Scheduled pod/kserve-module-controller-manager-5cfb77bf8c-vghzm Successfully assigned opendatahub/kserve-module-controller-manager-5cfb77bf8c-vghzm to ip-10-0-136-35.ec2.internal 64m Normal RequirementsUnknown clusterserviceversion/opendatahub-operator.v3.6.0-ea.2 requirements not yet checked 64m Normal RequirementsNotMet clusterserviceversion/opendatahub-operator.v3.6.0-ea.2 one or more requirements couldn't be found 64m Normal AllRequirementsMet clusterserviceversion/opendatahub-operator.v3.6.0-ea.2 all requirements found, attempting install 64m Normal ScalingReplicaSet deployment/opendatahub-operator-controller-manager Scaled up replica set opendatahub-operator-controller-manager-f7d897f7 from 0 to 3 64m Normal SuccessfulCreate replicaset/opendatahub-operator-controller-manager-f7d897f7 Created pod: opendatahub-operator-controller-manager-f7d897f7-4c5zt 64m Normal SuccessfulCreate replicaset/opendatahub-operator-controller-manager-f7d897f7 Created pod: opendatahub-operator-controller-manager-f7d897f7-z5lzv 64m Normal SuccessfulCreate replicaset/opendatahub-operator-controller-manager-f7d897f7 Created pod: opendatahub-operator-controller-manager-f7d897f7-g8rjp 64m Normal AddedInterface pod/opendatahub-operator-controller-manager-f7d897f7-4c5zt Add eth0 [10.132.0.38/23] from ovn-kubernetes 64m Normal Pulling pod/opendatahub-operator-controller-manager-f7d897f7-z5lzv Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" 64m Normal Pulling pod/opendatahub-operator-controller-manager-f7d897f7-4c5zt Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" 64m Normal InstallSucceeded clusterserviceversion/opendatahub-operator.v3.6.0-ea.2 waiting for install components to report healthy 64m Normal AddedInterface pod/opendatahub-operator-controller-manager-f7d897f7-g8rjp Add eth0 [10.134.0.15/23] from ovn-kubernetes 64m Normal Pulling pod/opendatahub-operator-controller-manager-f7d897f7-g8rjp Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" 64m Normal AddedInterface pod/opendatahub-operator-controller-manager-f7d897f7-z5lzv Add eth0 [10.133.0.21/23] from ovn-kubernetes 64m Normal InstallWaiting clusterserviceversion/opendatahub-operator.v3.6.0-ea.2 installing: waiting for deployment opendatahub-operator-controller-manager to become ready: deployment "opendatahub-operator-controller-manager" not available: Deployment does not have minimum availability. 64m Normal Started pod/opendatahub-operator-controller-manager-f7d897f7-4c5zt Container started 64m Normal Created pod/opendatahub-operator-controller-manager-f7d897f7-g8rjp Container created 64m Normal Pulled pod/opendatahub-operator-controller-manager-f7d897f7-4c5zt Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 2.726s (2.726s including waiting). Image size: 273709574 bytes. 64m Normal Created pod/opendatahub-operator-controller-manager-f7d897f7-4c5zt Container created 64m Normal Pulled pod/opendatahub-operator-controller-manager-f7d897f7-z5lzv Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 2.612s (2.612s including waiting). Image size: 273709574 bytes. 64m Normal Created pod/opendatahub-operator-controller-manager-f7d897f7-z5lzv Container created 64m Normal Started pod/opendatahub-operator-controller-manager-f7d897f7-z5lzv Container started 64m Normal Pulled pod/opendatahub-operator-controller-manager-f7d897f7-g8rjp Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 2.775s (2.775s including waiting). Image size: 273709574 bytes. 64m Normal Started pod/opendatahub-operator-controller-manager-f7d897f7-g8rjp Container started 64m Normal Created pod/opendatahub-operator-controller-manager-f7d897f7-4c5zt Container created 64m Normal Created pod/opendatahub-operator-controller-manager-f7d897f7-g8rjp Container created 64m Normal Pulling pod/opendatahub-operator-controller-manager-f7d897f7-g8rjp Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" 64m Normal Started pod/opendatahub-operator-controller-manager-f7d897f7-4c5zt Container started 64m Normal Pulled pod/opendatahub-operator-controller-manager-f7d897f7-g8rjp Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 298ms (298ms including waiting). Image size: 273709574 bytes. 64m Normal Pulling pod/opendatahub-operator-controller-manager-f7d897f7-z5lzv Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" 64m Normal Pulling pod/opendatahub-operator-controller-manager-f7d897f7-4c5zt Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" 64m Normal LeaderElection lease/07ed84f7.opendatahub.io opendatahub-operator-controller-manager-f7d897f7-g8rjp_a62deff1-bcb5-4a72-89df-c3302dd9ae57 became leader 64m Normal Started pod/opendatahub-operator-controller-manager-f7d897f7-g8rjp Container started 64m Normal Pulled pod/opendatahub-operator-controller-manager-f7d897f7-4c5zt Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 265ms (265ms including waiting). Image size: 273709574 bytes. 64m Normal Started pod/opendatahub-operator-controller-manager-f7d897f7-z5lzv Container started 64m Normal Created pod/opendatahub-operator-controller-manager-f7d897f7-z5lzv Container created 64m Normal Pulled pod/opendatahub-operator-controller-manager-f7d897f7-z5lzv Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 297ms (297ms including waiting). Image size: 273709574 bytes. 63m Normal InstallSucceeded clusterserviceversion/opendatahub-operator.v3.6.0-ea.2 install strategy completed with no errors 63m Normal Issuing certificate/odh-observability-webhook-cert Issuing certificate as Secret does not exist 63m Normal Requested certificate/odh-observability-webhook-cert Created new CertificateRequest resource "odh-observability-webhook-cert-1" 63m Normal WaitingForApproval certificaterequest/odh-observability-webhook-cert-1 Not signing CertificateRequest until it is Approved 63m Normal WaitingForApproval certificaterequest/odh-observability-webhook-cert-1 Not signing CertificateRequest until it is Approved 63m Normal WaitingForApproval certificaterequest/odh-observability-webhook-cert-1 Not signing CertificateRequest until it is Approved 63m Normal WaitingForApproval certificaterequest/odh-observability-webhook-cert-1 Not signing CertificateRequest until it is Approved 63m Normal SuccessfulCreate replicaset/odh-observability-584f99c788 Created pod: odh-observability-584f99c788-7nfbb 63m Warning BadConfig certificaterequest/odh-observability-webhook-cert-1 Certificate will be issued with an empty Issuer DN, which contravenes RFC 5280 and could break some strict clients 63m Normal Generated certificate/odh-observability-webhook-cert Stored new private key in temporary Secret resource "odh-observability-webhook-cert-pk56t" 63m Normal WaitingForApproval certificaterequest/odh-observability-webhook-cert-1 Not signing CertificateRequest until it is Approved 63m Normal CertificateIssued certificaterequest/odh-observability-webhook-cert-1 Certificate fetched from issuer successfully 63m Normal ScalingReplicaSet deployment/odh-observability Scaled up replica set odh-observability-584f99c788 from 0 to 1 63m Warning FailedMount pod/odh-observability-584f99c788-7nfbb MountVolume.SetUp failed for volume "webhook-certs" : secret "odh-observability-webhook-cert" not found 63m Normal cert-manager.io certificaterequest/odh-observability-webhook-cert-1 Certificate request has been approved by cert-manager.io 63m Normal AddedInterface pod/odh-observability-584f99c788-7nfbb Add eth0 [10.133.0.24/23] from ovn-kubernetes 63m Normal Pulling pod/odh-observability-584f99c788-7nfbb Pulling image "quay.io/opendatahub/odh-observability@sha256:03689e71fb8879ea696366b83d2a4727eb76e696baf8c2be2b18121c0534db4e" 63m Normal Issuing certificate/odh-observability-webhook-cert The certificate has been successfully issued 63m Normal Pulled pod/odh-observability-584f99c788-7nfbb Successfully pulled image "quay.io/opendatahub/odh-observability@sha256:03689e71fb8879ea696366b83d2a4727eb76e696baf8c2be2b18121c0534db4e" in 2.106s (2.106s including waiting). Image size: 154660917 bytes. 63m Normal Created pod/odh-observability-584f99c788-7nfbb Container created 63m Normal Started pod/odh-observability-584f99c788-7nfbb Container started 63m Normal ScalingReplicaSet deployment/kserve-module-controller-manager Scaled up replica set kserve-module-controller-manager-5cfb77bf8c from 0 to 1 63m Normal SuccessfulCreate replicaset/kserve-module-controller-manager-5cfb77bf8c Created pod: kserve-module-controller-manager-5cfb77bf8c-vghzm 63m Normal Pulling pod/kserve-module-controller-manager-5cfb77bf8c-vghzm Pulling image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189" 63m Normal AddedInterface pod/kserve-module-controller-manager-5cfb77bf8c-vghzm Add eth0 [10.133.0.25/23] from ovn-kubernetes 63m Normal Started pod/kserve-module-controller-manager-5cfb77bf8c-vghzm Container started 63m Normal Pulled pod/kserve-module-controller-manager-5cfb77bf8c-vghzm Successfully pulled image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189" in 1.39s (1.39s including waiting). Image size: 195729000 bytes. 63m Normal Created pod/kserve-module-controller-manager-5cfb77bf8c-vghzm Container created 63m Normal LeaderElection lease/kserve-module-controller-manager kserve-module-controller-manager-5cfb77bf8c-vghzm_1748cbd1-fb49-479b-ad6b-a3b319971392 became leader 62m Normal Pulling pod/kserve-controller-manager-776cc66d47-mz8np Pulling image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d" 62m Normal Pulling pod/odh-model-controller-f87fcf56c-nbt6q Pulling image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775" 62m Normal ScalingReplicaSet deployment/llmisvc-controller-manager Scaled up replica set llmisvc-controller-manager-869d5dcc5d from 0 to 1 62m Normal ScalingReplicaSet deployment/kserve-controller-manager Scaled up replica set kserve-controller-manager-776cc66d47 from 0 to 1 62m Normal SuccessfulCreate replicaset/llmisvc-controller-manager-869d5dcc5d Created pod: llmisvc-controller-manager-869d5dcc5d-sb5xm 62m Normal Pulling pod/llmisvc-controller-manager-869d5dcc5d-sb5xm Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" 62m Normal AddedInterface pod/llmisvc-controller-manager-869d5dcc5d-sb5xm Add eth0 [10.132.0.42/23] from ovn-kubernetes 62m Normal AddedInterface pod/kserve-controller-manager-776cc66d47-mz8np Add eth0 [10.132.0.41/23] from ovn-kubernetes 62m Normal ScalingReplicaSet deployment/odh-model-controller Scaled up replica set odh-model-controller-f87fcf56c from 0 to 1 62m Normal SuccessfulCreate replicaset/odh-model-controller-f87fcf56c Created pod: odh-model-controller-f87fcf56c-nbt6q 62m Normal AddedInterface pod/model-serving-api-75bd89fdfc-ltdvw Add eth0 [10.132.0.43/23] from ovn-kubernetes 62m Normal Pulling pod/model-serving-api-75bd89fdfc-ltdvw Pulling image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8" 62m Normal AddedInterface pod/odh-model-controller-f87fcf56c-nbt6q Add eth0 [10.132.0.44/23] from ovn-kubernetes 62m Normal SuccessfulCreate replicaset/kserve-controller-manager-776cc66d47 Created pod: kserve-controller-manager-776cc66d47-mz8np 62m Normal ScalingReplicaSet deployment/model-serving-api Scaled up replica set model-serving-api-75bd89fdfc from 0 to 1 62m Normal SuccessfulCreate replicaset/model-serving-api-75bd89fdfc Created pod: model-serving-api-75bd89fdfc-ltdvw 62m Normal Pulled pod/model-serving-api-75bd89fdfc-ltdvw Successfully pulled image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8" in 3.078s (3.078s including waiting). Image size: 184925761 bytes. 62m Normal Created pod/model-serving-api-75bd89fdfc-ltdvw Container created 62m Normal Pulled pod/odh-model-controller-f87fcf56c-nbt6q Successfully pulled image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775" in 4.032s (4.032s including waiting). Image size: 236755567 bytes. 62m Normal Started pod/odh-model-controller-f87fcf56c-nbt6q Container started 62m Normal Pulled pod/kserve-controller-manager-776cc66d47-mz8np Successfully pulled image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d" in 4.149s (4.149s including waiting). Image size: 247676581 bytes. 62m Normal Created pod/odh-model-controller-f87fcf56c-nbt6q Container created 62m Normal Started pod/llmisvc-controller-manager-869d5dcc5d-sb5xm Container started 62m Normal Started pod/kserve-controller-manager-776cc66d47-mz8np Container started 62m Normal Created pod/llmisvc-controller-manager-869d5dcc5d-sb5xm Container created 62m Normal Started pod/model-serving-api-75bd89fdfc-ltdvw Container started 62m Normal Pulled pod/llmisvc-controller-manager-869d5dcc5d-sb5xm Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 4.126s (4.126s including waiting). Image size: 235100981 bytes. 62m Normal Created pod/kserve-controller-manager-776cc66d47-mz8np Container created 62m Normal LeaderElection lease/odh-model-controller.opendatahub.io odh-model-controller-f87fcf56c-nbt6q_fe0c6a32-5fb4-4bc7-82d9-00b4aeb7fda8 became leader 62m Normal LeaderElection lease/kserve-controller-manager-leader-lock kserve-controller-manager-776cc66d47-mz8np_a0d21b8d-b5b4-4c9f-813f-7927931df110 became leader 62m Normal LeaderElection lease/llminferenceservice-kserve-controller-manager llmisvc-controller-manager-869d5dcc5d-sb5xm_7a83b63f-23ff-41f0-bdb5-09fe23f6d94f became leader 59m Normal ScalingReplicaSet deployment/maas-controller Scaled up replica set maas-controller-577f596567 from 0 to 1 59m Normal SuccessfulCreate replicaset/maas-controller-577f596567 Created pod: maas-controller-577f596567-7mzv2 59m Normal Pulling pod/maas-controller-577f596567-7mzv2 Pulling image "quay.io/opendatahub/maas-controller:ccce7752af146eb3de9e99df107c26f414878726" 59m Normal SuccessfulCreate replicaset/maas-controller-5974d5d96 Created pod: maas-controller-5974d5d96-flgp2 59m Normal Pulling pod/maas-controller-5974d5d96-flgp2 Pulling image "quay.io/opendatahub/maas-controller:ccce7752af146eb3de9e99df107c26f414878726" 59m Normal AddedInterface pod/maas-controller-5974d5d96-flgp2 Add eth0 [10.132.0.51/23] from ovn-kubernetes 59m Normal AddedInterface pod/maas-controller-577f596567-7mzv2 Add eth0 [10.132.0.50/23] from ovn-kubernetes 59m Normal Pulled pod/maas-controller-577f596567-7mzv2 Successfully pulled image "quay.io/opendatahub/maas-controller:ccce7752af146eb3de9e99df107c26f414878726" in 2.587s (2.587s including waiting). Image size: 199691795 bytes. 59m Normal Started pod/maas-controller-577f596567-7mzv2 Container started 59m Normal Created pod/maas-controller-5974d5d96-flgp2 Container created 59m Normal Created pod/maas-controller-577f596567-7mzv2 Container created 59m Normal Started pod/maas-controller-5974d5d96-flgp2 Container started 59m Normal Pulled pod/maas-controller-5974d5d96-flgp2 Successfully pulled image "quay.io/opendatahub/maas-controller:ccce7752af146eb3de9e99df107c26f414878726" in 2.498s (2.498s including waiting). Image size: 199691795 bytes. 59m Normal LeaderElection lease/maas-controller.models-as-a-service.opendatahub.io maas-controller-577f596567-7mzv2_d6d5c999-bcdf-4c16-b37b-ea5d4a731fe8 became leader 59m Normal SuccessfulCreate replicaset/usage-logs-tenancy-proxy-7d94f55f4b Created pod: usage-logs-tenancy-proxy-7d94f55f4b-nlrqh 59m Normal ScalingReplicaSet deployment/usage-logs-tenancy-proxy Scaled up replica set usage-logs-tenancy-proxy-7d94f55f4b from 0 to 1 59m Normal Pulling pod/usage-logs-tenancy-proxy-7d94f55f4b-nlrqh Pulling image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172" 59m Normal AddedInterface pod/usage-logs-tenancy-proxy-7d94f55f4b-nlrqh Add eth0 [10.132.0.52/23] from ovn-kubernetes 59m Normal ScalingReplicaSet deployment/maas-controller Scaled down replica set maas-controller-577f596567 from 1 to 0 59m Normal Killing pod/maas-controller-577f596567-7mzv2 Stopping container manager 59m Normal SuccessfulDelete replicaset/maas-controller-577f596567 Deleted pod: maas-controller-577f596567-7mzv2 59m Normal Pulled pod/usage-logs-tenancy-proxy-7d94f55f4b-nlrqh Successfully pulled image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172" in 10.122s (10.122s including waiting). Image size: 1089502687 bytes. 59m Normal Created pod/usage-logs-tenancy-proxy-7d94f55f4b-nlrqh Container created 59m Normal Started pod/usage-logs-tenancy-proxy-7d94f55f4b-nlrqh Container started 58m Normal LeaderElection lease/maas-controller.models-as-a-service.opendatahub.io maas-controller-5974d5d96-flgp2_c019d843-bbb0-48fa-9008-a01a75306eca became leader 58m Normal SuccessfulCreate replicaset/llmisvc-controller-manager-6466c554d8 Created pod: llmisvc-controller-manager-6466c554d8-hbjqb 58m Normal ScalingReplicaSet deployment/llmisvc-controller-manager Scaled up replica set llmisvc-controller-manager-6466c554d8 from 0 to 1 58m Normal AddedInterface pod/llmisvc-controller-manager-6466c554d8-hbjqb Add eth0 [10.132.0.53/23] from ovn-kubernetes 58m Normal Pulled pod/llmisvc-controller-manager-6466c554d8-hbjqb Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 444ms (444ms including waiting). Image size: 235100981 bytes. 58m Normal Pulling pod/llmisvc-controller-manager-6466c554d8-hbjqb Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" 58m Normal Created pod/llmisvc-controller-manager-6466c554d8-hbjqb Container created 58m Normal Started pod/llmisvc-controller-manager-6466c554d8-hbjqb Container started 58m Normal Killing pod/llmisvc-controller-manager-869d5dcc5d-sb5xm Stopping container manager 58m Normal SuccessfulDelete replicaset/llmisvc-controller-manager-869d5dcc5d Deleted pod: llmisvc-controller-manager-869d5dcc5d-sb5xm 58m Normal ScalingReplicaSet deployment/llmisvc-controller-manager Scaled down replica set llmisvc-controller-manager-869d5dcc5d from 1 to 0 57m Normal LeaderElection lease/llminferenceservice-kserve-controller-manager llmisvc-controller-manager-6466c554d8-hbjqb_e963fed1-2e78-40fb-a48b-381310e97fbd became leader 57m Normal ScalingReplicaSet deployment/ai-gateway-controller Scaled up replica set ai-gateway-controller-84dff4756b from 0 to 1 57m Normal SuccessfulCreate replicaset/ai-gateway-controller-84dff4756b Created pod: ai-gateway-controller-84dff4756b-zmrk4 57m Normal AddedInterface pod/ai-gateway-controller-84dff4756b-zmrk4 Add eth0 [10.133.0.40/23] from ovn-kubernetes 57m Normal Pulling pod/ai-gateway-controller-84dff4756b-zmrk4 Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:odh-pr-192" 57m Normal Created pod/ai-gateway-controller-84dff4756b-zmrk4 Container created 57m Normal Pulled pod/ai-gateway-controller-84dff4756b-zmrk4 Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:odh-pr-192" in 2.225s (2.225s including waiting). Image size: 183941565 bytes. 57m Normal Started pod/ai-gateway-controller-84dff4756b-zmrk4 Container started 57m Normal LeaderElection lease/ai-gateway-controller-leader.opendatahub.io ai-gateway-controller-84dff4756b-zmrk4_9ceba47d-26a5-44bc-8f9d-f3f0635fce6a became leader 57m Normal Pulling pod/ai-gateway-controller-654df4bd7-95hcs Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:odh-pr-192" 57m Normal SuccessfulCreate replicaset/ai-gateway-controller-654df4bd7 Created pod: ai-gateway-controller-654df4bd7-95hcs 57m Normal AddedInterface pod/ai-gateway-controller-654df4bd7-95hcs Add eth0 [10.133.0.43/23] from ovn-kubernetes 57m Normal ScalingReplicaSet deployment/ai-gateway-controller Scaled up replica set ai-gateway-controller-654df4bd7 from 0 to 1 57m Normal Pulled pod/ai-gateway-controller-654df4bd7-95hcs Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:odh-pr-192" in 393ms (393ms including waiting). Image size: 183941565 bytes. 57m Normal Started pod/ai-gateway-controller-654df4bd7-95hcs Container started 57m Normal Created pod/ai-gateway-controller-654df4bd7-95hcs Container created 56m Normal SuccessfulDelete replicaset/ai-gateway-controller-84dff4756b Deleted pod: ai-gateway-controller-84dff4756b-zmrk4 56m Normal Killing pod/ai-gateway-controller-84dff4756b-zmrk4 Stopping container manager 56m Normal ScalingReplicaSet deployment/ai-gateway-controller Scaled down replica set ai-gateway-controller-84dff4756b from 1 to 0 56m Normal LeaderElection lease/ai-gateway-controller-leader.opendatahub.io ai-gateway-controller-654df4bd7-95hcs_008c2017-5779-48a1-b355-4a09fa857896 became leader 50m Normal Started pod/test-curl-9213-183013 Container started 50m Normal Pulling pod/test-curl-9213-183013 Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" 50m Normal AddedInterface pod/test-curl-9213-183013 Add eth0 [10.132.0.91/23] from ovn-kubernetes 50m Normal Created pod/test-curl-9213-183013 Container created 50m Normal Pulled pod/test-curl-9213-183013 Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 591ms (591ms including waiting). Image size: 106100986 bytes. 50m Normal AddedInterface pod/test-curl-9213-1ea43b Add eth0 [10.132.0.92/23] from ovn-kubernetes 50m Normal Started pod/test-curl-9213-1ea43b Container started 50m Normal Created pod/test-curl-9213-1ea43b Container created 50m Normal Pulled pod/test-curl-9213-1ea43b Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod 50m Normal Killing pod/test-curl-9213-183013 Stopping container test-curl-9213-183013 50m Normal Killing pod/test-curl-9213-1ea43b Stopping container test-curl-9213-1ea43b 47m Normal AddedInterface pod/test-curl-9207-cc6f8d Add eth0 [10.133.0.167/23] from ovn-kubernetes 47m Normal Pulling pod/test-curl-9207-cc6f8d Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" 47m Normal Pulled pod/test-curl-9207-cc6f8d Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 3.652s (3.652s including waiting). Image size: 106100986 bytes. 47m Normal Created pod/test-curl-9207-cc6f8d Container created 47m Normal Started pod/test-curl-9207-cc6f8d Container started 47m Normal Killing pod/test-curl-9207-cc6f8d Stopping container test-curl-9207-cc6f8d 47m Normal AddedInterface pod/test-curl-9207-a414a3 Add eth0 [10.133.0.171/23] from ovn-kubernetes 47m Normal Pulled pod/test-curl-9207-a414a3 Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod 47m Normal Started pod/test-curl-9207-a414a3 Container started 47m Normal Created pod/test-curl-9207-a414a3 Container created 47m Normal Pulled pod/test-curl-9207-3d5e36 Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod 47m Normal AddedInterface pod/test-curl-9207-3d5e36 Add eth0 [10.133.0.172/23] from ovn-kubernetes 47m Normal Created pod/test-curl-9207-3d5e36 Container created 47m Normal Started pod/test-curl-9207-3d5e36 Container started 47m Normal Killing pod/test-curl-9207-a414a3 Stopping container test-curl-9207-a414a3 47m Normal Created pod/test-curl-9207-a42866 Container created 47m Normal Killing pod/test-curl-9207-3d5e36 Stopping container test-curl-9207-3d5e36 47m Normal AddedInterface pod/test-curl-9207-a42866 Add eth0 [10.133.0.173/23] from ovn-kubernetes 47m Normal Pulled pod/test-curl-9207-a42866 Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod 47m Normal Started pod/test-curl-9207-a42866 Container started 47m Normal Killing pod/test-curl-9207-a42866 Stopping container test-curl-9207-a42866 45m Normal Pulled pod/test-curl-9201-1a6e9d Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod 45m Normal AddedInterface pod/test-curl-9201-1a6e9d Add eth0 [10.133.0.188/23] from ovn-kubernetes 45m Normal Created pod/test-curl-9201-1a6e9d Container created 45m Normal Started pod/test-curl-9201-1a6e9d Container started 45m Normal Killing pod/test-curl-9201-1a6e9d Stopping container test-curl-9201-1a6e9d 42m Normal Created pod/test-curl-9201-d4e88d Container created 42m Normal Started pod/test-curl-9201-d4e88d Container started 42m Normal Pulled pod/test-curl-9201-d4e88d Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod 42m Normal AddedInterface pod/test-curl-9201-d4e88d Add eth0 [10.133.0.208/23] from ovn-kubernetes 42m Normal Killing pod/test-curl-9201-d4e88d Stopping container test-curl-9201-d4e88d 27m Normal AddedInterface pod/test-curl-9210-73c70f Add eth0 [10.132.0.154/23] from ovn-kubernetes 27m Normal Pulled pod/test-curl-9210-73c70f Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod 27m Normal Started pod/test-curl-9210-73c70f Container started 27m Normal Created pod/test-curl-9210-73c70f Container created 27m Normal AddedInterface pod/test-curl-9210-4e5884 Add eth0 [10.132.0.155/23] from ovn-kubernetes 27m Normal Created pod/test-curl-9210-4e5884 Container created 27m Normal Started pod/test-curl-9210-4e5884 Container started 27m Normal Pulled pod/test-curl-9210-4e5884 Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod 27m Normal Killing pod/test-curl-9210-73c70f Stopping container test-curl-9210-73c70f 27m Normal Killing pod/test-curl-9210-4e5884 Stopping container test-curl-9210-4e5884 20m Normal AddedInterface pod/test-curl-9204-d5ade7 Add eth0 [10.134.0.188/23] from ovn-kubernetes 20m Normal Pulling pod/test-curl-9204-d5ade7 Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" 20m Normal Started pod/test-curl-9204-d5ade7 Container started 20m Normal Created pod/test-curl-9204-d5ade7 Container created 20m Normal Pulled pod/test-curl-9204-d5ade7 Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 13.55s (13.55s including waiting). Image size: 106100986 bytes. 20m Normal Killing pod/test-curl-9204-d5ade7 Stopping container test-curl-9204-d5ade7 14m Normal Killing pod/maas-controller-5974d5d96-flgp2 Stopping container manager 14m Normal SuccessfulDelete replicaset/maas-controller-5974d5d96 Deleted pod: maas-controller-5974d5d96-flgp2 14m Normal SuccessfulCreate replicaset/maas-controller-5974d5d96 Created pod: maas-controller-5974d5d96-srwds 14m Normal AddedInterface pod/maas-controller-5974d5d96-srwds Add eth0 [10.133.1.188/23] from ovn-kubernetes 14m Normal Pulling pod/maas-controller-5974d5d96-srwds Pulling image "quay.io/opendatahub/maas-controller:ccce7752af146eb3de9e99df107c26f414878726" 14m Normal Created pod/maas-controller-5974d5d96-srwds Container created 14m Normal Pulled pod/maas-controller-5974d5d96-srwds Successfully pulled image "quay.io/opendatahub/maas-controller:ccce7752af146eb3de9e99df107c26f414878726" in 1.6s (1.6s including waiting). Image size: 199691795 bytes. 14m Normal Started pod/maas-controller-5974d5d96-srwds Container started 13m Normal LeaderElection lease/maas-controller.models-as-a-service.opendatahub.io maas-controller-5974d5d96-srwds_ccb5b731-2ebb-4bf5-bc51-7b0379483dc0 became leader 13m Normal Killing pod/maas-controller-5974d5d96-srwds Stopping container manager 13m Normal SuccessfulDelete replicaset/maas-controller-5974d5d96 Deleted pod: maas-controller-5974d5d96-srwds 13m Normal ScalingReplicaSet deployment/maas-controller Scaled down replica set maas-controller-5974d5d96 from 1 to 0 13m Normal Pulling pod/maas-controller-5974d5d96-jrgzk Pulling image "quay.io/opendatahub/maas-controller:ccce7752af146eb3de9e99df107c26f414878726" 13m Normal AddedInterface pod/maas-controller-5974d5d96-jrgzk Add eth0 [10.133.1.191/23] from ovn-kubernetes 13m Normal SuccessfulCreate replicaset/maas-controller-5974d5d96 Created pod: maas-controller-5974d5d96-jrgzk 13m Normal ScalingReplicaSet deployment/maas-controller Scaled up replica set maas-controller-5974d5d96 from 0 to 1 13m Normal Pulled pod/maas-controller-5974d5d96-jrgzk Successfully pulled image "quay.io/opendatahub/maas-controller:ccce7752af146eb3de9e99df107c26f414878726" in 358ms (358ms including waiting). Image size: 199691795 bytes. 13m Normal Started pod/maas-controller-5974d5d96-jrgzk Container started 13m Normal Created pod/maas-controller-5974d5d96-jrgzk Container created 13m Normal LeaderElection lease/maas-controller.models-as-a-service.opendatahub.io maas-controller-5974d5d96-jrgzk_19bed8a2-ec2a-4ab8-9436-8fb773f49304 became leader