=== events in openshift-ingress (2026-11-03T12:37:42Z) === LAST SEEN TYPE REASON OBJECT MESSAGE 5m53s Normal Scheduled pod/istiod-openshift-gateway-7ddd9cfdc8-vx6f5 Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-vx6f5 to ip-10-0-141-194.us-west-2.compute.internal 7m6s Normal Scheduled pod/data-science-gateway-data-science-gateway-class-576b8db9c7f6vkr Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-576b8db9c7f6vkr to ip-10-0-141-60.us-west-2.compute.internal 7m6s Normal Scheduled pod/kube-auth-proxy-8c75fb59b-v8jjv Successfully assigned openshift-ingress/kube-auth-proxy-8c75fb59b-v8jjv to ip-10-0-141-194.us-west-2.compute.internal 8m17s Normal Scheduled pod/maas-default-gateway-openshift-default-74854d8ccf-44v49 Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-44v49 to ip-10-0-139-41.us-west-2.compute.internal 8m16s Normal Scheduled pod/openshift-ai-inference-openshift-ai-inference-fc457bc99-jp24l Successfully assigned openshift-ingress/openshift-ai-inference-openshift-ai-inference-fc457bc99-jp24l to ip-10-0-141-60.us-west-2.compute.internal 7m6s Normal Scheduled pod/kube-auth-proxy-8c75fb59b-rnnqc Successfully assigned openshift-ingress/kube-auth-proxy-8c75fb59b-rnnqc to ip-10-0-139-41.us-west-2.compute.internal 19m Warning FailedScheduling pod/router-default-8678bff75f-ptbtw no nodes available to schedule pods 12m Warning FailedScheduling pod/router-default-8678bff75f-ptbtw no nodes available to schedule pods 12m Normal Scheduled pod/router-default-8678bff75f-ptbtw Successfully assigned openshift-ingress/router-default-8678bff75f-ptbtw to ip-10-0-141-60.us-west-2.compute.internal 8m24s Normal Scheduled pod/istiod-openshift-gateway-7876bfcb74-gqdn6 Successfully assigned openshift-ingress/istiod-openshift-gateway-7876bfcb74-gqdn6 to ip-10-0-141-194.us-west-2.compute.internal 19m Normal ScalingReplicaSet deployment/router-default Scaled up replica set router-default-8678bff75f from 0 to 1 19m Warning UnAvailableLoadBalancer service/router-default There are no available nodes for LoadBalancer 19m Normal EnsuringLoadBalancer service/router-default Ensuring load balancer 19m Normal SuccessfulCreate replicaset/router-default-8678bff75f Created pod: router-default-8678bff75f-ptbtw 19m Normal EnsuredLoadBalancer service/router-default Ensured load balancer 12m Normal UpdatedLoadBalancer service/router-default Updated load balancer with new hosts 12m Warning FailedMount pod/router-default-8678bff75f-ptbtw MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found 12m Warning FailedMount pod/router-default-8678bff75f-ptbtw MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt 12m Warning FailedMount pod/router-default-8678bff75f-ptbtw MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt 11m Warning FailedMount pod/router-default-8678bff75f-ptbtw MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found 11m Normal Created pod/router-default-8678bff75f-ptbtw Container created 11m Normal Started pod/router-default-8678bff75f-ptbtw Container started 11m Normal AddedInterface pod/router-default-8678bff75f-ptbtw Add eth0 [10.132.0.12/23] from ovn-kubernetes 11m Normal Pulled pod/router-default-8678bff75f-ptbtw Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3a679d80eb36ca7db888d4fbd1fdf16b0997a7c7a107936396b7a57d8b199f4e" already present on machine and can be accessed by the pod 8m25s Normal AddedLabel gateway/maas-default-gateway Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway 8m24s Normal SuccessfulCreate replicaset/istiod-openshift-gateway-7876bfcb74 Created pod: istiod-openshift-gateway-7876bfcb74-gqdn6 8m24s Normal ScalingReplicaSet deployment/istiod-openshift-gateway Scaled up replica set istiod-openshift-gateway-7876bfcb74 from 0 to 1 8m23s Normal Pulling pod/istiod-openshift-gateway-7876bfcb74-gqdn6 Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" 8m23s Normal AddedInterface pod/istiod-openshift-gateway-7876bfcb74-gqdn6 Add eth0 [10.134.0.20/23] from ovn-kubernetes 8m19s Normal Started pod/istiod-openshift-gateway-7876bfcb74-gqdn6 Container started 8m19s Normal Pulled pod/istiod-openshift-gateway-7876bfcb74-gqdn6 Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 4.399s (4.399s including waiting). Image size: 185476477 bytes. 8m19s Normal Created pod/istiod-openshift-gateway-7876bfcb74-gqdn6 Container created 8m17s Warning Unhealthy pod/istiod-openshift-gateway-7876bfcb74-gqdn6 Readiness probe failed: HTTP probe failed with statuscode: 503 8m17s Normal ScalingReplicaSet deployment/maas-default-gateway-openshift-default Scaled up replica set maas-default-gateway-openshift-default-74854d8ccf from 0 to 1 8m17s Normal SuccessfulCreate replicaset/maas-default-gateway-openshift-default-74854d8ccf Created pod: maas-default-gateway-openshift-default-74854d8ccf-44v49 8m17s Warning ProbeError pod/istiod-openshift-gateway-7876bfcb74-gqdn6 Readiness probe error: HTTP probe failed with statuscode: 503... 8m17s Normal SuccessfulCreate replicaset/openshift-ai-inference-openshift-ai-inference-fc457bc99 Created pod: openshift-ai-inference-openshift-ai-inference-fc457bc99-jp24l 8m17s Normal ScalingReplicaSet deployment/openshift-ai-inference-openshift-ai-inference Scaled up replica set openshift-ai-inference-openshift-ai-inference-fc457bc99 from 0 to 1 8m17s Normal EnsuringLoadBalancer service/openshift-ai-inference-openshift-ai-inference Ensuring load balancer 8m16s Normal Pulling pod/maas-default-gateway-openshift-default-74854d8ccf-44v49 Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" 8m16s Normal AddedInterface pod/maas-default-gateway-openshift-default-74854d8ccf-44v49 Add eth0 [10.133.0.22/23] from ovn-kubernetes 8m16s Normal AddedInterface pod/openshift-ai-inference-openshift-ai-inference-fc457bc99-jp24l Add eth0 [10.132.0.31/23] from ovn-kubernetes 8m16s Normal Pulling pod/openshift-ai-inference-openshift-ai-inference-fc457bc99-jp24l Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" 8m13s Normal EnsuredLoadBalancer service/openshift-ai-inference-openshift-ai-inference Ensured load balancer 8m11s Normal Started pod/openshift-ai-inference-openshift-ai-inference-fc457bc99-jp24l Container started 8m11s Normal Pulled pod/openshift-ai-inference-openshift-ai-inference-fc457bc99-jp24l Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 4.263s (4.263s including waiting). Image size: 183555333 bytes. 8m11s Normal Created pod/openshift-ai-inference-openshift-ai-inference-fc457bc99-jp24l Container created 8m7s Normal Started pod/maas-default-gateway-openshift-default-74854d8ccf-44v49 Container started 8m7s Normal Created pod/maas-default-gateway-openshift-default-74854d8ccf-44v49 Container created 8m7s Normal Pulled pod/maas-default-gateway-openshift-default-74854d8ccf-44v49 Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 8.879s (8.879s including waiting). Image size: 183555333 bytes. 7m47s Warning FailedComputeMetricsReplicas horizontalpodautoscaler/maas-default-gateway-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 7m47s Warning FailedGetResourceMetric horizontalpodautoscaler/maas-default-gateway-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 7m31s Warning FailedGetResourceMetric horizontalpodautoscaler/openshift-ai-inference-openshift-ai-inference failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 7m31s Warning FailedComputeMetricsReplicas horizontalpodautoscaler/maas-default-gateway-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 7m31s Warning FailedGetResourceMetric horizontalpodautoscaler/maas-default-gateway-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 7m31s Warning FailedComputeMetricsReplicas horizontalpodautoscaler/openshift-ai-inference-openshift-ai-inference invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 7m6s Normal AddedInterface pod/kube-auth-proxy-8c75fb59b-rnnqc Add eth0 [10.133.0.28/23] from ovn-kubernetes 7m6s Normal SuccessfulCreate replicaset/data-science-gateway-data-science-gateway-class-576b8db9c7 Created pod: data-science-gateway-data-science-gateway-class-576b8db9c7f6vkr 7m6s Normal AddedInterface pod/kube-auth-proxy-8c75fb59b-v8jjv Add eth0 [10.134.0.24/23] from ovn-kubernetes 7m6s Normal SuccessfulCreate replicaset/kube-auth-proxy-8c75fb59b Created pod: kube-auth-proxy-8c75fb59b-rnnqc 7m6s Normal ScalingReplicaSet deployment/data-science-gateway-data-science-gateway-class Scaled up replica set data-science-gateway-data-science-gateway-class-576b8db9c7 from 0 to 1 7m6s Normal ScalingReplicaSet deployment/kube-auth-proxy Scaled up replica set kube-auth-proxy-8c75fb59b from 0 to 2 7m6s Normal SuccessfulCreate replicaset/kube-auth-proxy-8c75fb59b Created pod: kube-auth-proxy-8c75fb59b-v8jjv 7m5s Normal Pulling pod/kube-auth-proxy-8c75fb59b-v8jjv Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" 7m5s Normal Pulling pod/kube-auth-proxy-8c75fb59b-rnnqc Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" 7m5s Normal Started pod/data-science-gateway-data-science-gateway-class-576b8db9c7f6vkr Container started 7m5s Normal Created pod/data-science-gateway-data-science-gateway-class-576b8db9c7f6vkr Container created 7m5s Normal Pulled pod/data-science-gateway-data-science-gateway-class-576b8db9c7f6vkr Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 7m5s Normal AddedInterface pod/data-science-gateway-data-science-gateway-class-576b8db9c7f6vkr Add eth0 [10.132.0.36/23] from ovn-kubernetes 7m2s Normal Created pod/kube-auth-proxy-8c75fb59b-rnnqc Container created 7m2s Normal Pulled pod/kube-auth-proxy-8c75fb59b-rnnqc Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 3.054s (3.054s including waiting). Image size: 188904677 bytes. 7m2s Normal Started pod/kube-auth-proxy-8c75fb59b-rnnqc Container started 7m1s Normal Created pod/kube-auth-proxy-8c75fb59b-v8jjv Container created 7m1s Normal Started pod/kube-auth-proxy-8c75fb59b-v8jjv Container started 7m1s Normal Pulled pod/kube-auth-proxy-8c75fb59b-v8jjv Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 3.965s (3.965s including waiting). Image size: 188904677 bytes. 6m51s Warning FailedComputeMetricsReplicas horizontalpodautoscaler/kube-auth-proxy invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 6m51s Warning FailedGetResourceMetric horizontalpodautoscaler/kube-auth-proxy failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 6m49s Warning FailedGetResourceMetric horizontalpodautoscaler/data-science-gateway-data-science-gateway-class failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 6m49s Warning FailedComputeMetricsReplicas horizontalpodautoscaler/data-science-gateway-data-science-gateway-class invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 6m36s Warning FailedComputeMetricsReplicas horizontalpodautoscaler/kube-auth-proxy invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 6m36s Warning FailedGetResourceMetric horizontalpodautoscaler/kube-auth-proxy failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 6m34s Warning FailedGetResourceMetric horizontalpodautoscaler/data-science-gateway-data-science-gateway-class failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 6m34s Warning FailedComputeMetricsReplicas horizontalpodautoscaler/data-science-gateway-data-science-gateway-class invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 5m53s Normal AddedInterface pod/istiod-openshift-gateway-7ddd9cfdc8-vx6f5 Add eth0 [10.134.0.29/23] from ovn-kubernetes 5m53s Normal SuccessfulCreate replicaset/istiod-openshift-gateway-7ddd9cfdc8 Created pod: istiod-openshift-gateway-7ddd9cfdc8-vx6f5 5m53s Normal ScalingReplicaSet deployment/istiod-openshift-gateway Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 0 to 1 5m52s Normal Created pod/istiod-openshift-gateway-7ddd9cfdc8-vx6f5 Container created 5m52s Normal Pulled pod/istiod-openshift-gateway-7ddd9cfdc8-vx6f5 Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" already present on machine and can be accessed by the pod 5m52s Normal Started pod/istiod-openshift-gateway-7ddd9cfdc8-vx6f5 Container started 5m51s Warning ProbeError pod/istiod-openshift-gateway-7ddd9cfdc8-vx6f5 Readiness probe error: HTTP probe failed with statuscode: 503... 5m51s Warning Unhealthy pod/istiod-openshift-gateway-7ddd9cfdc8-vx6f5 Readiness probe failed: HTTP probe failed with statuscode: 503 5m50s Normal SuccessfulDelete replicaset/istiod-openshift-gateway-7876bfcb74 Deleted pod: istiod-openshift-gateway-7876bfcb74-gqdn6 5m50s Normal Killing pod/istiod-openshift-gateway-7876bfcb74-gqdn6 Stopping container discovery 5m50s Normal ScalingReplicaSet deployment/istiod-openshift-gateway Scaled down replica set istiod-openshift-gateway-7876bfcb74 from 1 to 0 5m38s Warning FailedGetResourceMetric horizontalpodautoscaler/istiod-openshift-gateway failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 5m38s Warning FailedComputeMetricsReplicas horizontalpodautoscaler/istiod-openshift-gateway invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 5m23s Warning FailedGetResourceMetric horizontalpodautoscaler/istiod-openshift-gateway failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 5m23s Warning FailedComputeMetricsReplicas horizontalpodautoscaler/istiod-openshift-gateway invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)