=== events in openshift-ingress (2026-11-02T18:19:50Z) === LAST SEEN TYPE REASON OBJECT MESSAGE 12m Normal Scheduled pod/kube-auth-proxy-5c6896d4d6-9fvmd Successfully assigned openshift-ingress/kube-auth-proxy-5c6896d4d6-9fvmd to ip-10-0-133-81.us-east-2.compute.internal 12m Normal Scheduled pod/data-science-gateway-data-science-gateway-class-6455b4886fc628r Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-6455b4886fc628r to ip-10-0-129-58.us-east-2.compute.internal 19m Normal Scheduled pod/router-default-75984cc6df-kjfs6 Successfully assigned openshift-ingress/router-default-75984cc6df-kjfs6 to ip-10-0-129-58.us-east-2.compute.internal 19m Warning FailedScheduling pod/router-default-75984cc6df-kjfs6 no nodes available to schedule pods 13m Normal Scheduled pod/maas-default-gateway-openshift-default-5bc884dd87-5nps4 Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5bc884dd87-5nps4 to ip-10-0-129-58.us-east-2.compute.internal 22m Warning FailedScheduling pod/router-default-75984cc6df-kjfs6 no nodes available to schedule pods 12m Normal Scheduled pod/kube-auth-proxy-5c6896d4d6-5h427 Successfully assigned openshift-ingress/kube-auth-proxy-5c6896d4d6-5h427 to ip-10-0-134-10.us-east-2.compute.internal 11m Normal Scheduled pod/istiod-openshift-gateway-7ddd9cfdc8-84g48 Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-84g48 to ip-10-0-134-10.us-east-2.compute.internal 13m Normal Scheduled pod/istiod-openshift-gateway-7876bfcb74-nwgq5 Successfully assigned openshift-ingress/istiod-openshift-gateway-7876bfcb74-nwgq5 to ip-10-0-134-10.us-east-2.compute.internal 13m Normal Scheduled pod/openshift-ai-inference-openshift-ai-inference-64695b4bc9-ph249 Successfully assigned openshift-ingress/openshift-ai-inference-openshift-ai-inference-64695b4bc9-ph249 to ip-10-0-129-58.us-east-2.compute.internal 22m Normal ScalingReplicaSet deployment/router-default Scaled up replica set router-default-75984cc6df from 0 to 1 22m Normal SuccessfulCreate replicaset/router-default-75984cc6df Created pod: router-default-75984cc6df-kjfs6 21m Warning UnAvailableLoadBalancer service/router-default There are no available nodes for LoadBalancer 21m Normal EnsuringLoadBalancer service/router-default Ensuring load balancer 21m Normal EnsuredLoadBalancer service/router-default Ensured load balancer 19m Normal UpdatedLoadBalancer service/router-default Updated load balancer with new hosts 19m Warning FailedMount pod/router-default-75984cc6df-kjfs6 MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found 19m Warning FailedMount pod/router-default-75984cc6df-kjfs6 MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt 19m Warning FailedMount pod/router-default-75984cc6df-kjfs6 MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found 18m Warning FailedMount pod/router-default-75984cc6df-kjfs6 MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt 18m Normal AddedInterface pod/router-default-75984cc6df-kjfs6 Add eth0 [10.132.0.10/23] from ovn-kubernetes 18m Normal Pulled pod/router-default-75984cc6df-kjfs6 Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3a679d80eb36ca7db888d4fbd1fdf16b0997a7c7a107936396b7a57d8b199f4e" already present on machine and can be accessed by the pod 18m Normal Started pod/router-default-75984cc6df-kjfs6 Container started 18m Normal Created pod/router-default-75984cc6df-kjfs6 Container created 13m Normal AddedLabel gateway/maas-default-gateway Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway 13m Normal Pulling pod/istiod-openshift-gateway-7876bfcb74-nwgq5 Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" 13m Normal ScalingReplicaSet deployment/istiod-openshift-gateway Scaled up replica set istiod-openshift-gateway-7876bfcb74 from 0 to 1 13m Normal SuccessfulCreate replicaset/istiod-openshift-gateway-7876bfcb74 Created pod: istiod-openshift-gateway-7876bfcb74-nwgq5 13m Normal AddedInterface pod/istiod-openshift-gateway-7876bfcb74-nwgq5 Add eth0 [10.134.0.17/23] from ovn-kubernetes 13m Normal Pulled pod/istiod-openshift-gateway-7876bfcb74-nwgq5 Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 2.959s (2.959s including waiting). Image size: 185476477 bytes. 13m Normal Created pod/istiod-openshift-gateway-7876bfcb74-nwgq5 Container created 13m Normal Started pod/istiod-openshift-gateway-7876bfcb74-nwgq5 Container started 13m Warning ProbeError pod/istiod-openshift-gateway-7876bfcb74-nwgq5 Readiness probe error: HTTP probe failed with statuscode: 503... 13m Warning Unhealthy pod/istiod-openshift-gateway-7876bfcb74-nwgq5 Readiness probe failed: HTTP probe failed with statuscode: 503 13m Normal Pulling pod/maas-default-gateway-openshift-default-5bc884dd87-5nps4 Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" 13m Normal AddedInterface pod/openshift-ai-inference-openshift-ai-inference-64695b4bc9-ph249 Add eth0 [10.132.0.30/23] from ovn-kubernetes 13m Normal Pulling pod/openshift-ai-inference-openshift-ai-inference-64695b4bc9-ph249 Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" 13m Normal ScalingReplicaSet deployment/maas-default-gateway-openshift-default Scaled up replica set maas-default-gateway-openshift-default-5bc884dd87 from 0 to 1 13m Normal SuccessfulCreate replicaset/maas-default-gateway-openshift-default-5bc884dd87 Created pod: maas-default-gateway-openshift-default-5bc884dd87-5nps4 13m Normal SuccessfulCreate replicaset/openshift-ai-inference-openshift-ai-inference-64695b4bc9 Created pod: openshift-ai-inference-openshift-ai-inference-64695b4bc9-ph249 13m Normal AddedInterface pod/maas-default-gateway-openshift-default-5bc884dd87-5nps4 Add eth0 [10.132.0.29/23] from ovn-kubernetes 13m Normal ScalingReplicaSet deployment/openshift-ai-inference-openshift-ai-inference Scaled up replica set openshift-ai-inference-openshift-ai-inference-64695b4bc9 from 0 to 1 13m Normal EnsuringLoadBalancer service/openshift-ai-inference-openshift-ai-inference Ensuring load balancer 13m Normal EnsuredLoadBalancer service/openshift-ai-inference-openshift-ai-inference Ensured load balancer 13m Normal Pulled pod/openshift-ai-inference-openshift-ai-inference-64695b4bc9-ph249 Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 9.242s (9.242s including waiting). Image size: 183555333 bytes. 13m Normal Started pod/openshift-ai-inference-openshift-ai-inference-64695b4bc9-ph249 Container started 13m Normal Created pod/openshift-ai-inference-openshift-ai-inference-64695b4bc9-ph249 Container created 13m Normal Created pod/maas-default-gateway-openshift-default-5bc884dd87-5nps4 Container created 13m Normal Pulled pod/maas-default-gateway-openshift-default-5bc884dd87-5nps4 Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 11.894s (11.894s including waiting). Image size: 183555333 bytes. 13m Normal Started pod/maas-default-gateway-openshift-default-5bc884dd87-5nps4 Container started 13m Warning FailedGetResourceMetric horizontalpodautoscaler/maas-default-gateway-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 13m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/maas-default-gateway-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 12m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/openshift-ai-inference-openshift-ai-inference invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 12m Warning FailedGetResourceMetric horizontalpodautoscaler/openshift-ai-inference-openshift-ai-inference failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 12m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/maas-default-gateway-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 12m Warning FailedGetResourceMetric horizontalpodautoscaler/maas-default-gateway-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 12m Normal Pulling pod/kube-auth-proxy-5c6896d4d6-5h427 Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" 12m Normal SuccessfulCreate replicaset/data-science-gateway-data-science-gateway-class-6455b4886f Created pod: data-science-gateway-data-science-gateway-class-6455b4886fc628r 12m Normal ScalingReplicaSet deployment/kube-auth-proxy Scaled up replica set kube-auth-proxy-5c6896d4d6 from 0 to 2 12m Normal SuccessfulCreate replicaset/kube-auth-proxy-5c6896d4d6 Created pod: kube-auth-proxy-5c6896d4d6-9fvmd 12m Normal ScalingReplicaSet deployment/data-science-gateway-data-science-gateway-class Scaled up replica set data-science-gateway-data-science-gateway-class-6455b4886f from 0 to 1 12m Normal SuccessfulCreate replicaset/kube-auth-proxy-5c6896d4d6 Created pod: kube-auth-proxy-5c6896d4d6-5h427 12m Normal AddedInterface pod/kube-auth-proxy-5c6896d4d6-9fvmd Add eth0 [10.133.0.29/23] from ovn-kubernetes 12m Normal AddedInterface pod/kube-auth-proxy-5c6896d4d6-5h427 Add eth0 [10.134.0.19/23] from ovn-kubernetes 12m Normal Started pod/data-science-gateway-data-science-gateway-class-6455b4886fc628r Container started 12m Normal Pulling pod/kube-auth-proxy-5c6896d4d6-9fvmd Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" 12m Normal Created pod/data-science-gateway-data-science-gateway-class-6455b4886fc628r Container created 12m Normal Pulled pod/data-science-gateway-data-science-gateway-class-6455b4886fc628r Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 12m Normal AddedInterface pod/data-science-gateway-data-science-gateway-class-6455b4886fc628r Add eth0 [10.132.0.42/23] from ovn-kubernetes 12m Normal Pulled pod/kube-auth-proxy-5c6896d4d6-5h427 Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.54s (2.54s including waiting). Image size: 188904677 bytes. 12m Normal Created pod/kube-auth-proxy-5c6896d4d6-5h427 Container created 12m Normal Started pod/kube-auth-proxy-5c6896d4d6-5h427 Container started 12m Normal Started pod/kube-auth-proxy-5c6896d4d6-9fvmd Container started 12m Normal Created pod/kube-auth-proxy-5c6896d4d6-9fvmd Container created 12m Normal Pulled pod/kube-auth-proxy-5c6896d4d6-9fvmd Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.461s (2.461s including waiting). Image size: 188904677 bytes. 12m Warning FailedGetResourceMetric horizontalpodautoscaler/kube-auth-proxy failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 12m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/kube-auth-proxy invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 11m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/kube-auth-proxy invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 11m Warning FailedGetResourceMetric horizontalpodautoscaler/kube-auth-proxy failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 11m Warning FailedGetResourceMetric horizontalpodautoscaler/data-science-gateway-data-science-gateway-class failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 11m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/data-science-gateway-data-science-gateway-class invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 11m Normal Started pod/istiod-openshift-gateway-7ddd9cfdc8-84g48 Container started 11m Normal SuccessfulCreate replicaset/istiod-openshift-gateway-7ddd9cfdc8 Created pod: istiod-openshift-gateway-7ddd9cfdc8-84g48 11m Normal Created pod/istiod-openshift-gateway-7ddd9cfdc8-84g48 Container created 11m Normal Pulled pod/istiod-openshift-gateway-7ddd9cfdc8-84g48 Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" already present on machine and can be accessed by the pod 11m Normal AddedInterface pod/istiod-openshift-gateway-7ddd9cfdc8-84g48 Add eth0 [10.134.0.23/23] from ovn-kubernetes 11m Normal ScalingReplicaSet deployment/istiod-openshift-gateway Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 0 to 1 11m Normal SuccessfulDelete replicaset/istiod-openshift-gateway-7876bfcb74 Deleted pod: istiod-openshift-gateway-7876bfcb74-nwgq5 11m Normal Killing pod/istiod-openshift-gateway-7876bfcb74-nwgq5 Stopping container discovery 11m Normal ScalingReplicaSet deployment/istiod-openshift-gateway Scaled down replica set istiod-openshift-gateway-7876bfcb74 from 1 to 0 10m Warning FailedGetResourceMetric horizontalpodautoscaler/istiod-openshift-gateway failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 10m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/istiod-openshift-gateway invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API