=== events in openshift-ingress (2026-11-03T19:48:20Z) === LAST SEEN TYPE REASON OBJECT MESSAGE 16m Normal Scheduled pod/openshift-ai-inference-openshift-ai-inference-858975f7b7-v94sr Successfully assigned openshift-ingress/openshift-ai-inference-openshift-ai-inference-858975f7b7-v94sr to ip-10-0-130-177.us-east-2.compute.internal 16m Normal Scheduled pod/maas-default-gateway-openshift-default-6f77ddbcb7-czdgs Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-czdgs to ip-10-0-130-177.us-east-2.compute.internal 14m Normal Scheduled pod/kube-auth-proxy-658bcd57f8-cnjtv Successfully assigned openshift-ingress/kube-auth-proxy-658bcd57f8-cnjtv to ip-10-0-141-132.us-east-2.compute.internal 13m Normal Scheduled pod/istiod-openshift-gateway-7ddd9cfdc8-2k7q8 Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2k7q8 to ip-10-0-141-132.us-east-2.compute.internal 14m Normal Scheduled pod/data-science-gateway-data-science-gateway-class-67df64d57-cw8vz Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-67df64d57-cw8vz to ip-10-0-130-177.us-east-2.compute.internal 27m Warning FailedScheduling pod/router-default-6654cb844f-nx8jh no nodes available to schedule pods 21m Warning FailedScheduling pod/router-default-6654cb844f-nx8jh no nodes available to schedule pods 14m Normal Scheduled pod/kube-auth-proxy-658bcd57f8-4457q Successfully assigned openshift-ingress/kube-auth-proxy-658bcd57f8-4457q to ip-10-0-133-127.us-east-2.compute.internal 16m Normal Scheduled pod/istiod-openshift-gateway-7876bfcb74-5gjlz Successfully assigned openshift-ingress/istiod-openshift-gateway-7876bfcb74-5gjlz to ip-10-0-141-132.us-east-2.compute.internal 21m Normal Scheduled pod/router-default-6654cb844f-nx8jh Successfully assigned openshift-ingress/router-default-6654cb844f-nx8jh to ip-10-0-130-177.us-east-2.compute.internal 27m Normal ScalingReplicaSet deployment/router-default Scaled up replica set router-default-6654cb844f from 0 to 1 27m Normal EnsuringLoadBalancer service/router-default Ensuring load balancer 27m Warning UnAvailableLoadBalancer service/router-default There are no available nodes for LoadBalancer 27m Normal EnsuredLoadBalancer service/router-default Ensured load balancer 27m Normal SuccessfulCreate replicaset/router-default-6654cb844f Created pod: router-default-6654cb844f-nx8jh 21m Normal UpdatedLoadBalancer service/router-default Updated load balancer with new hosts 21m Warning FailedMount pod/router-default-6654cb844f-nx8jh MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found 21m Warning FailedMount pod/router-default-6654cb844f-nx8jh MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt 21m Warning FailedMount pod/router-default-6654cb844f-nx8jh MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt 21m Warning FailedMount pod/router-default-6654cb844f-nx8jh MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found 21m Normal Started pod/router-default-6654cb844f-nx8jh Container started 21m Normal AddedInterface pod/router-default-6654cb844f-nx8jh Add eth0 [10.132.0.12/23] from ovn-kubernetes 21m Normal Pulled pod/router-default-6654cb844f-nx8jh Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3a679d80eb36ca7db888d4fbd1fdf16b0997a7c7a107936396b7a57d8b199f4e" already present on machine and can be accessed by the pod 21m Normal Created pod/router-default-6654cb844f-nx8jh Container created 16m Normal AddedLabel gateway/maas-default-gateway Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway 16m Normal SuccessfulCreate replicaset/istiod-openshift-gateway-7876bfcb74 Created pod: istiod-openshift-gateway-7876bfcb74-5gjlz 16m Normal ScalingReplicaSet deployment/istiod-openshift-gateway Scaled up replica set istiod-openshift-gateway-7876bfcb74 from 0 to 1 16m Normal Pulling pod/istiod-openshift-gateway-7876bfcb74-5gjlz Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" 16m Normal AddedInterface pod/istiod-openshift-gateway-7876bfcb74-5gjlz Add eth0 [10.133.0.21/23] from ovn-kubernetes 16m Normal Started pod/istiod-openshift-gateway-7876bfcb74-5gjlz Container started 16m Normal Pulled pod/istiod-openshift-gateway-7876bfcb74-5gjlz Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 3.742s (3.742s including waiting). Image size: 185476477 bytes. 16m Normal Created pod/istiod-openshift-gateway-7876bfcb74-5gjlz Container created 16m Warning Unhealthy pod/istiod-openshift-gateway-7876bfcb74-5gjlz Readiness probe failed: HTTP probe failed with statuscode: 503 16m Normal SuccessfulCreate replicaset/maas-default-gateway-openshift-default-6f77ddbcb7 Created pod: maas-default-gateway-openshift-default-6f77ddbcb7-czdgs 16m Normal ScalingReplicaSet deployment/maas-default-gateway-openshift-default Scaled up replica set maas-default-gateway-openshift-default-6f77ddbcb7 from 0 to 1 16m Normal EnsuringLoadBalancer service/openshift-ai-inference-openshift-ai-inference Ensuring load balancer 16m Normal ScalingReplicaSet deployment/openshift-ai-inference-openshift-ai-inference Scaled up replica set openshift-ai-inference-openshift-ai-inference-858975f7b7 from 0 to 1 16m Normal SuccessfulCreate replicaset/openshift-ai-inference-openshift-ai-inference-858975f7b7 Created pod: openshift-ai-inference-openshift-ai-inference-858975f7b7-v94sr 16m Warning ProbeError pod/istiod-openshift-gateway-7876bfcb74-5gjlz Readiness probe error: HTTP probe failed with statuscode: 503... 16m Normal Pulling pod/openshift-ai-inference-openshift-ai-inference-858975f7b7-v94sr Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" 16m Normal AddedInterface pod/openshift-ai-inference-openshift-ai-inference-858975f7b7-v94sr Add eth0 [10.132.0.34/23] from ovn-kubernetes 16m Normal Pulling pod/maas-default-gateway-openshift-default-6f77ddbcb7-czdgs Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" 16m Normal AddedInterface pod/maas-default-gateway-openshift-default-6f77ddbcb7-czdgs Add eth0 [10.132.0.33/23] from ovn-kubernetes 16m Normal EnsuredLoadBalancer service/openshift-ai-inference-openshift-ai-inference Ensured load balancer 15m Normal Pulled pod/openshift-ai-inference-openshift-ai-inference-858975f7b7-v94sr Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 11.026s (11.026s including waiting). Image size: 183555333 bytes. 15m Normal Started pod/openshift-ai-inference-openshift-ai-inference-858975f7b7-v94sr Container started 15m Normal Created pod/openshift-ai-inference-openshift-ai-inference-858975f7b7-v94sr Container created 15m Normal Started pod/maas-default-gateway-openshift-default-6f77ddbcb7-czdgs Container started 15m Normal Pulled pod/maas-default-gateway-openshift-default-6f77ddbcb7-czdgs Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 12.022s (12.022s including waiting). Image size: 183555333 bytes. 15m Normal Created pod/maas-default-gateway-openshift-default-6f77ddbcb7-czdgs Container created 15m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/openshift-ai-inference-openshift-ai-inference invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 15m Warning FailedGetResourceMetric horizontalpodautoscaler/openshift-ai-inference-openshift-ai-inference failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 15m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/openshift-ai-inference-openshift-ai-inference invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 15m Warning FailedGetResourceMetric horizontalpodautoscaler/openshift-ai-inference-openshift-ai-inference failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 15m Warning FailedGetResourceMetric horizontalpodautoscaler/maas-default-gateway-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 15m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/maas-default-gateway-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 14m Normal SuccessfulCreate replicaset/kube-auth-proxy-658bcd57f8 Created pod: kube-auth-proxy-658bcd57f8-cnjtv 14m Normal ScalingReplicaSet deployment/kube-auth-proxy Scaled up replica set kube-auth-proxy-658bcd57f8 from 0 to 2 14m Normal SuccessfulCreate replicaset/kube-auth-proxy-658bcd57f8 Created pod: kube-auth-proxy-658bcd57f8-4457q 14m Normal Started pod/data-science-gateway-data-science-gateway-class-67df64d57-cw8vz Container started 14m Normal ScalingReplicaSet deployment/data-science-gateway-data-science-gateway-class Scaled up replica set data-science-gateway-data-science-gateway-class-67df64d57 from 0 to 1 14m Normal Pulling pod/kube-auth-proxy-658bcd57f8-4457q Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" 14m Normal Created pod/data-science-gateway-data-science-gateway-class-67df64d57-cw8vz Container created 14m Normal AddedInterface pod/data-science-gateway-data-science-gateway-class-67df64d57-cw8vz Add eth0 [10.132.0.44/23] from ovn-kubernetes 14m Normal AddedInterface pod/kube-auth-proxy-658bcd57f8-4457q Add eth0 [10.134.0.25/23] from ovn-kubernetes 14m Normal SuccessfulCreate replicaset/data-science-gateway-data-science-gateway-class-67df64d57 Created pod: data-science-gateway-data-science-gateway-class-67df64d57-cw8vz 14m Normal Pulling pod/kube-auth-proxy-658bcd57f8-cnjtv Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" 14m Normal AddedInterface pod/kube-auth-proxy-658bcd57f8-cnjtv Add eth0 [10.133.0.23/23] from ovn-kubernetes 14m Normal Pulled pod/data-science-gateway-data-science-gateway-class-67df64d57-cw8vz Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 14m Normal Created pod/kube-auth-proxy-658bcd57f8-cnjtv Container created 14m Normal Pulled pod/kube-auth-proxy-658bcd57f8-4457q Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.334s (2.334s including waiting). Image size: 188904677 bytes. 14m Normal Started pod/kube-auth-proxy-658bcd57f8-cnjtv Container started 14m Normal Pulled pod/kube-auth-proxy-658bcd57f8-cnjtv Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.204s (2.204s including waiting). Image size: 188904677 bytes. 14m Normal Created pod/kube-auth-proxy-658bcd57f8-4457q Container created 14m Normal Started pod/kube-auth-proxy-658bcd57f8-4457q Container started 14m Warning FailedGetResourceMetric horizontalpodautoscaler/kube-auth-proxy failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 14m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/kube-auth-proxy invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 14m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/kube-auth-proxy invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 14m Warning FailedGetResourceMetric horizontalpodautoscaler/kube-auth-proxy failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 14m Warning FailedGetResourceMetric horizontalpodautoscaler/data-science-gateway-data-science-gateway-class failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 14m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/data-science-gateway-data-science-gateway-class invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 13m Normal Started pod/istiod-openshift-gateway-7ddd9cfdc8-2k7q8 Container started 13m Normal Created pod/istiod-openshift-gateway-7ddd9cfdc8-2k7q8 Container created 13m Normal SuccessfulCreate replicaset/istiod-openshift-gateway-7ddd9cfdc8 Created pod: istiod-openshift-gateway-7ddd9cfdc8-2k7q8 13m Normal AddedInterface pod/istiod-openshift-gateway-7ddd9cfdc8-2k7q8 Add eth0 [10.133.0.24/23] from ovn-kubernetes 13m Normal ScalingReplicaSet deployment/istiod-openshift-gateway Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 0 to 1 13m Normal Pulled pod/istiod-openshift-gateway-7ddd9cfdc8-2k7q8 Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" already present on machine and can be accessed by the pod 13m Normal ScalingReplicaSet deployment/istiod-openshift-gateway Scaled down replica set istiod-openshift-gateway-7876bfcb74 from 1 to 0 13m Normal Killing pod/istiod-openshift-gateway-7876bfcb74-5gjlz Stopping container discovery 13m Normal SuccessfulDelete replicaset/istiod-openshift-gateway-7876bfcb74 Deleted pod: istiod-openshift-gateway-7876bfcb74-5gjlz 13m Warning FailedGetResourceMetric horizontalpodautoscaler/istiod-openshift-gateway failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 13m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/istiod-openshift-gateway invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 13m Warning FailedGetResourceMetric horizontalpodautoscaler/istiod-openshift-gateway failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 13m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/istiod-openshift-gateway invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)