=== events in openshift-ingress (2026-11-03T18:20:57Z) === LAST SEEN TYPE REASON OBJECT MESSAGE 7m39s Normal Scheduled pod/openshift-ai-inference-openshift-ai-inference-858975f7b7-nj4pc Successfully assigned openshift-ingress/openshift-ai-inference-openshift-ai-inference-858975f7b7-nj4pc to ip-10-0-131-212.us-west-1.compute.internal 7m39s Normal Scheduled pod/maas-default-gateway-openshift-default-6f77ddbcb7-wcgjw Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-wcgjw to ip-10-0-131-212.us-west-1.compute.internal 5m58s Normal Scheduled pod/data-science-gateway-data-science-gateway-class-67df64d57-zsjps Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-67df64d57-zsjps to ip-10-0-131-212.us-west-1.compute.internal 5m58s Normal Scheduled pod/kube-auth-proxy-7c6c56ddfd-rp2z5 Successfully assigned openshift-ingress/kube-auth-proxy-7c6c56ddfd-rp2z5 to ip-10-0-143-129.us-west-1.compute.internal 13m Warning FailedScheduling pod/router-default-c55b4798f-4dsdw no nodes available to schedule pods 13m Normal Scheduled pod/router-default-c55b4798f-4dsdw Successfully assigned openshift-ingress/router-default-c55b4798f-4dsdw to ip-10-0-129-127.us-west-1.compute.internal 4m31s Normal Scheduled pod/istiod-openshift-gateway-7ddd9cfdc8-wljmq Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-wljmq to ip-10-0-131-212.us-west-1.compute.internal 5m58s Normal Scheduled pod/kube-auth-proxy-7c6c56ddfd-kf6w4 Successfully assigned openshift-ingress/kube-auth-proxy-7c6c56ddfd-kf6w4 to ip-10-0-129-127.us-west-1.compute.internal 7m46s Normal Scheduled pod/istiod-openshift-gateway-7876bfcb74-h2hm9 Successfully assigned openshift-ingress/istiod-openshift-gateway-7876bfcb74-h2hm9 to ip-10-0-129-127.us-west-1.compute.internal 20m Warning FailedScheduling pod/router-default-c55b4798f-4dsdw no nodes available to schedule pods 20m Normal ScalingReplicaSet deployment/router-default Scaled up replica set router-default-c55b4798f from 0 to 1 20m Normal EnsuringLoadBalancer service/router-default Ensuring load balancer 20m Warning UnAvailableLoadBalancer service/router-default There are no available nodes for LoadBalancer 20m Normal SuccessfulCreate replicaset/router-default-c55b4798f Created pod: router-default-c55b4798f-4dsdw 20m Normal EnsuredLoadBalancer service/router-default Ensured load balancer 13m Normal UpdatedLoadBalancer service/router-default Updated load balancer with new hosts 13m Warning FailedMount pod/router-default-c55b4798f-4dsdw MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt 13m Warning FailedMount pod/router-default-c55b4798f-4dsdw MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found 13m Warning FailedMount pod/router-default-c55b4798f-4dsdw MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt 13m Warning FailedMount pod/router-default-c55b4798f-4dsdw MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found 12m Warning Unhealthy pod/router-default-c55b4798f-4dsdw Startup probe failed: HTTP probe failed with statuscode: 500 12m Normal Pulled pod/router-default-c55b4798f-4dsdw Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3a679d80eb36ca7db888d4fbd1fdf16b0997a7c7a107936396b7a57d8b199f4e" already present on machine and can be accessed by the pod 12m Normal AddedInterface pod/router-default-c55b4798f-4dsdw Add eth0 [10.133.0.14/23] from ovn-kubernetes 12m Normal Created pod/router-default-c55b4798f-4dsdw Container created 12m Normal Started pod/router-default-c55b4798f-4dsdw Container started 12m Warning ProbeError pod/router-default-c55b4798f-4dsdw Startup probe error: HTTP probe failed with statuscode: 500... 7m49s Normal AddedLabel gateway/maas-default-gateway Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway 7m47s Normal SuccessfulCreate replicaset/istiod-openshift-gateway-7876bfcb74 Created pod: istiod-openshift-gateway-7876bfcb74-h2hm9 7m47s Normal Pulling pod/istiod-openshift-gateway-7876bfcb74-h2hm9 Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" 7m47s Normal AddedInterface pod/istiod-openshift-gateway-7876bfcb74-h2hm9 Add eth0 [10.133.0.24/23] from ovn-kubernetes 7m47s Normal ScalingReplicaSet deployment/istiod-openshift-gateway Scaled up replica set istiod-openshift-gateway-7876bfcb74 from 0 to 1 7m43s Normal Started pod/istiod-openshift-gateway-7876bfcb74-h2hm9 Container started 7m43s Normal Pulled pod/istiod-openshift-gateway-7876bfcb74-h2hm9 Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 3.608s (3.608s including waiting). Image size: 185476477 bytes. 7m43s Normal Created pod/istiod-openshift-gateway-7876bfcb74-h2hm9 Container created 7m42s Warning ProbeError pod/istiod-openshift-gateway-7876bfcb74-h2hm9 Readiness probe error: HTTP probe failed with statuscode: 503... 7m42s Warning Unhealthy pod/istiod-openshift-gateway-7876bfcb74-h2hm9 Readiness probe failed: HTTP probe failed with statuscode: 503 7m40s Normal SuccessfulCreate replicaset/maas-default-gateway-openshift-default-6f77ddbcb7 Created pod: maas-default-gateway-openshift-default-6f77ddbcb7-wcgjw 7m40s Normal AddedInterface pod/maas-default-gateway-openshift-default-6f77ddbcb7-wcgjw Add eth0 [10.132.0.32/23] from ovn-kubernetes 7m40s Normal EnsuringLoadBalancer service/openshift-ai-inference-openshift-ai-inference Ensuring load balancer 7m40s Normal ScalingReplicaSet deployment/openshift-ai-inference-openshift-ai-inference Scaled up replica set openshift-ai-inference-openshift-ai-inference-858975f7b7 from 0 to 1 7m40s Normal SuccessfulCreate replicaset/openshift-ai-inference-openshift-ai-inference-858975f7b7 Created pod: openshift-ai-inference-openshift-ai-inference-858975f7b7-nj4pc 7m40s Normal ScalingReplicaSet deployment/maas-default-gateway-openshift-default Scaled up replica set maas-default-gateway-openshift-default-6f77ddbcb7 from 0 to 1 7m39s Normal Pulling pod/openshift-ai-inference-openshift-ai-inference-858975f7b7-nj4pc Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" 7m39s Normal AddedInterface pod/openshift-ai-inference-openshift-ai-inference-858975f7b7-nj4pc Add eth0 [10.132.0.33/23] from ovn-kubernetes 7m39s Normal Pulling pod/maas-default-gateway-openshift-default-6f77ddbcb7-wcgjw Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" 7m36s Normal EnsuredLoadBalancer service/openshift-ai-inference-openshift-ai-inference Ensured load balancer 7m27s Normal Pulled pod/maas-default-gateway-openshift-default-6f77ddbcb7-wcgjw Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 12.75s (12.75s including waiting). Image size: 183555333 bytes. 7m27s Normal Pulled pod/openshift-ai-inference-openshift-ai-inference-858975f7b7-nj4pc Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 12.499s (12.499s including waiting). Image size: 183555333 bytes. 7m26s Normal Created pod/openshift-ai-inference-openshift-ai-inference-858975f7b7-nj4pc Container created 7m26s Normal Started pod/openshift-ai-inference-openshift-ai-inference-858975f7b7-nj4pc Container started 7m26s Normal Started pod/maas-default-gateway-openshift-default-6f77ddbcb7-wcgjw Container started 7m26s Normal Created pod/maas-default-gateway-openshift-default-6f77ddbcb7-wcgjw Container created 7m10s Warning FailedComputeMetricsReplicas horizontalpodautoscaler/openshift-ai-inference-openshift-ai-inference invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 7m10s Warning FailedGetResourceMetric horizontalpodautoscaler/openshift-ai-inference-openshift-ai-inference failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 6m55s Warning FailedComputeMetricsReplicas horizontalpodautoscaler/maas-default-gateway-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 6m55s Warning FailedComputeMetricsReplicas horizontalpodautoscaler/openshift-ai-inference-openshift-ai-inference invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 6m55s Warning FailedGetResourceMetric horizontalpodautoscaler/maas-default-gateway-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 6m55s Warning FailedGetResourceMetric horizontalpodautoscaler/openshift-ai-inference-openshift-ai-inference failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 5m59s Normal SuccessfulCreate replicaset/kube-auth-proxy-7c6c56ddfd Created pod: kube-auth-proxy-7c6c56ddfd-rp2z5 5m59s Normal ScalingReplicaSet deployment/data-science-gateway-data-science-gateway-class Scaled up replica set data-science-gateway-data-science-gateway-class-67df64d57 from 0 to 1 5m59s Normal ScalingReplicaSet deployment/kube-auth-proxy Scaled up replica set kube-auth-proxy-7c6c56ddfd from 0 to 2 5m59s Normal SuccessfulCreate replicaset/kube-auth-proxy-7c6c56ddfd Created pod: kube-auth-proxy-7c6c56ddfd-kf6w4 5m59s Normal SuccessfulCreate replicaset/data-science-gateway-data-science-gateway-class-67df64d57 Created pod: data-science-gateway-data-science-gateway-class-67df64d57-zsjps 5m58s Normal Pulling pod/kube-auth-proxy-7c6c56ddfd-kf6w4 Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" 5m58s Normal Started pod/data-science-gateway-data-science-gateway-class-67df64d57-zsjps Container started 5m58s Normal Created pod/data-science-gateway-data-science-gateway-class-67df64d57-zsjps Container created 5m58s Normal Pulling pod/kube-auth-proxy-7c6c56ddfd-rp2z5 Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" 5m58s Normal AddedInterface pod/kube-auth-proxy-7c6c56ddfd-rp2z5 Add eth0 [10.134.0.21/23] from ovn-kubernetes 5m58s Normal Pulled pod/data-science-gateway-data-science-gateway-class-67df64d57-zsjps Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 5m58s Normal AddedInterface pod/data-science-gateway-data-science-gateway-class-67df64d57-zsjps Add eth0 [10.132.0.45/23] from ovn-kubernetes 5m58s Normal AddedInterface pod/kube-auth-proxy-7c6c56ddfd-kf6w4 Add eth0 [10.133.0.26/23] from ovn-kubernetes 5m55s Normal Created pod/kube-auth-proxy-7c6c56ddfd-rp2z5 Container created 5m55s Normal Pulled pod/kube-auth-proxy-7c6c56ddfd-kf6w4 Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 3.617s (3.617s including waiting). Image size: 188904677 bytes. 5m55s Normal Created pod/kube-auth-proxy-7c6c56ddfd-kf6w4 Container created 5m55s Normal Started pod/kube-auth-proxy-7c6c56ddfd-kf6w4 Container started 5m55s Normal Pulled pod/kube-auth-proxy-7c6c56ddfd-rp2z5 Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.999s (2.999s including waiting). Image size: 188904677 bytes. 5m55s Normal Started pod/kube-auth-proxy-7c6c56ddfd-rp2z5 Container started 5m44s Warning FailedComputeMetricsReplicas horizontalpodautoscaler/kube-auth-proxy invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 5m44s Warning FailedGetResourceMetric horizontalpodautoscaler/kube-auth-proxy failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 5m11s Warning FailedComputeMetricsReplicas horizontalpodautoscaler/data-science-gateway-data-science-gateway-class invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 5m11s Warning FailedGetResourceMetric horizontalpodautoscaler/data-science-gateway-data-science-gateway-class failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 4m32s Normal SuccessfulCreate replicaset/istiod-openshift-gateway-7ddd9cfdc8 Created pod: istiod-openshift-gateway-7ddd9cfdc8-wljmq 4m32s Normal ScalingReplicaSet deployment/istiod-openshift-gateway Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 0 to 1 4m31s Normal Pulling pod/istiod-openshift-gateway-7ddd9cfdc8-wljmq Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" 4m31s Normal AddedInterface pod/istiod-openshift-gateway-7ddd9cfdc8-wljmq Add eth0 [10.132.0.52/23] from ovn-kubernetes 4m26s Normal Pulled pod/istiod-openshift-gateway-7ddd9cfdc8-wljmq Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 5.027s (5.027s including waiting). Image size: 185476477 bytes. 4m26s Normal Created pod/istiod-openshift-gateway-7ddd9cfdc8-wljmq Container created 4m26s Normal Started pod/istiod-openshift-gateway-7ddd9cfdc8-wljmq Container started 4m25s Warning Unhealthy pod/istiod-openshift-gateway-7ddd9cfdc8-wljmq Readiness probe failed: HTTP probe failed with statuscode: 503 4m25s Warning ProbeError pod/istiod-openshift-gateway-7ddd9cfdc8-wljmq Readiness probe error: HTTP probe failed with statuscode: 503... 4m24s Normal SuccessfulDelete replicaset/istiod-openshift-gateway-7876bfcb74 Deleted pod: istiod-openshift-gateway-7876bfcb74-h2hm9 4m24s Normal Killing pod/istiod-openshift-gateway-7876bfcb74-h2hm9 Stopping container discovery 4m24s Normal ScalingReplicaSet deployment/istiod-openshift-gateway Scaled down replica set istiod-openshift-gateway-7876bfcb74 from 1 to 0 4m1s Warning FailedGetResourceMetric horizontalpodautoscaler/istiod-openshift-gateway failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 4m1s Warning FailedComputeMetricsReplicas horizontalpodautoscaler/istiod-openshift-gateway invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API