=== events in openshift-ingress (2026-11-02T16:36:22Z) === LAST SEEN TYPE REASON OBJECT MESSAGE 114s Normal Scheduled pod/maas-default-gateway-openshift-default-64d4cc998c-87wl5 Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-87wl5 to ip-10-0-137-117.us-west-2.compute.internal 8m19s Normal Scheduled pod/istiod-openshift-gateway-7876bfcb74-tmzw4 Successfully assigned openshift-ingress/istiod-openshift-gateway-7876bfcb74-tmzw4 to ip-10-0-137-117.us-west-2.compute.internal 8m12s Normal Scheduled pod/maas-default-gateway-openshift-default-64d4cc998c-rmvmh Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-rmvmh to ip-10-0-139-28.us-west-2.compute.internal 15m Normal Scheduled pod/router-default-6888d4f95f-lhzj4 Successfully assigned openshift-ingress/router-default-6888d4f95f-lhzj4 to ip-10-0-133-252.us-west-2.compute.internal 15m Warning FailedScheduling pod/router-default-6888d4f95f-lhzj4 no nodes available to schedule pods 2m54s Normal Scheduled pod/maas-default-gateway-openshift-default-64d4cc998c-ksvnm Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-ksvnm to ip-10-0-137-117.us-west-2.compute.internal 2m39s Normal Scheduled pod/maas-default-gateway-openshift-default-64d4cc998c-l8br6 Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-l8br6 to ip-10-0-137-117.us-west-2.compute.internal 21m Warning FailedScheduling pod/router-default-6888d4f95f-lhzj4 no nodes available to schedule pods 2m39s Normal Scheduled pod/maas-default-gateway-openshift-default-64d4cc998c-pjr4r Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-pjr4r to ip-10-0-133-252.us-west-2.compute.internal 114s Normal Scheduled pod/maas-default-gateway-openshift-default-64d4cc998c-86xbn Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-86xbn to ip-10-0-139-28.us-west-2.compute.internal 7m Normal Scheduled pod/kube-auth-proxy-744c86bbc8-zrkcz Successfully assigned openshift-ingress/kube-auth-proxy-744c86bbc8-zrkcz to ip-10-0-133-252.us-west-2.compute.internal 5m30s Normal Scheduled pod/istiod-openshift-gateway-7ddd9cfdc8-887j4 Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-887j4 to ip-10-0-137-117.us-west-2.compute.internal 7m Normal Scheduled pod/kube-auth-proxy-744c86bbc8-4tfz9 Successfully assigned openshift-ingress/kube-auth-proxy-744c86bbc8-4tfz9 to ip-10-0-137-117.us-west-2.compute.internal 2m21s Normal Scheduled pod/payload-pre-processing-7b98bb678c-sspzj Successfully assigned openshift-ingress/payload-pre-processing-7b98bb678c-sspzj to ip-10-0-137-117.us-west-2.compute.internal 114s Normal Scheduled pod/maas-default-gateway-openshift-default-64d4cc998c-2frxn Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-2frxn to ip-10-0-133-252.us-west-2.compute.internal 2m21s Normal Scheduled pod/payload-processing-55fbbbf9dc-n4nh2 Successfully assigned openshift-ingress/payload-processing-55fbbbf9dc-n4nh2 to ip-10-0-137-117.us-west-2.compute.internal 8m12s Normal Scheduled pod/openshift-ai-inference-openshift-ai-inference-6478fc546c-wnplv Successfully assigned openshift-ingress/openshift-ai-inference-openshift-ai-inference-6478fc546c-wnplv to ip-10-0-139-28.us-west-2.compute.internal 114s Normal Scheduled pod/maas-default-gateway-openshift-default-64d4cc998c-zbswg Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-zbswg to ip-10-0-139-28.us-west-2.compute.internal 6m59s Normal Scheduled pod/data-science-gateway-data-science-gateway-class-6bc88ffd5-4vptj Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-6bc88ffd5-4vptj to ip-10-0-139-28.us-west-2.compute.internal 22m Normal ScalingReplicaSet deployment/router-default Scaled up replica set router-default-6888d4f95f from 0 to 1 21m Normal EnsuringLoadBalancer service/router-default Ensuring load balancer 21m Warning UnAvailableLoadBalancer service/router-default There are no available nodes for LoadBalancer 21m Warning FailedCreate replicaset/router-default-6888d4f95f Error creating: pods "router-default-6888d4f95f-" is forbidden: error fetching namespace "openshift-ingress": unable to find annotation openshift.io/sa.scc.uid-range 21m Normal EnsuredLoadBalancer service/router-default Ensured load balancer 21m Normal SuccessfulCreate replicaset/router-default-6888d4f95f Created pod: router-default-6888d4f95f-lhzj4 15m Warning FailedMount pod/router-default-6888d4f95f-lhzj4 MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt 15m Warning FailedMount pod/router-default-6888d4f95f-lhzj4 MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found 15m Normal Pulled pod/router-default-6888d4f95f-lhzj4 Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3a679d80eb36ca7db888d4fbd1fdf16b0997a7c7a107936396b7a57d8b199f4e" already present on machine and can be accessed by the pod 15m Normal AddedInterface pod/router-default-6888d4f95f-lhzj4 Add eth0 [10.132.0.13/23] from ovn-kubernetes 15m Normal Created pod/router-default-6888d4f95f-lhzj4 Container created 15m Normal Started pod/router-default-6888d4f95f-lhzj4 Container started 15m Warning Unhealthy pod/router-default-6888d4f95f-lhzj4 Startup probe failed: HTTP probe failed with statuscode: 500 15m Warning ProbeError pod/router-default-6888d4f95f-lhzj4 Startup probe error: HTTP probe failed with statuscode: 500... 14m Normal UpdatedLoadBalancer service/router-default Updated load balancer with new hosts 8m21s Normal AddedLabel gateway/maas-default-gateway Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway 8m20s Normal ScalingReplicaSet deployment/istiod-openshift-gateway Scaled up replica set istiod-openshift-gateway-7876bfcb74 from 0 to 1 8m20s Normal SuccessfulCreate replicaset/istiod-openshift-gateway-7876bfcb74 Created pod: istiod-openshift-gateway-7876bfcb74-tmzw4 8m19s Normal Pulling pod/istiod-openshift-gateway-7876bfcb74-tmzw4 Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" 8m19s Normal AddedInterface pod/istiod-openshift-gateway-7876bfcb74-tmzw4 Add eth0 [10.134.0.13/23] from ovn-kubernetes 8m14s Normal Pulled pod/istiod-openshift-gateway-7876bfcb74-tmzw4 Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 4.673s (4.673s including waiting). Image size: 185476477 bytes. 8m14s Normal Started pod/istiod-openshift-gateway-7876bfcb74-tmzw4 Container started 8m14s Normal Created pod/istiod-openshift-gateway-7876bfcb74-tmzw4 Container created 8m13s Warning ProbeError pod/istiod-openshift-gateway-7876bfcb74-tmzw4 Readiness probe error: HTTP probe failed with statuscode: 503... 8m13s Normal SuccessfulCreate replicaset/maas-default-gateway-openshift-default-64d4cc998c Created pod: maas-default-gateway-openshift-default-64d4cc998c-rmvmh 8m13s Normal ScalingReplicaSet deployment/maas-default-gateway-openshift-default Scaled up replica set maas-default-gateway-openshift-default-64d4cc998c from 0 to 1 8m13s Warning Unhealthy pod/istiod-openshift-gateway-7876bfcb74-tmzw4 Readiness probe failed: HTTP probe failed with statuscode: 503 8m12s Normal AddedInterface pod/maas-default-gateway-openshift-default-64d4cc998c-rmvmh Add eth0 [10.133.0.17/23] from ovn-kubernetes 8m12s Normal EnsuringLoadBalancer service/openshift-ai-inference-openshift-ai-inference Ensuring load balancer 8m12s Normal AddedInterface pod/openshift-ai-inference-openshift-ai-inference-6478fc546c-wnplv Add eth0 [10.133.0.18/23] from ovn-kubernetes 8m12s Normal Pulling pod/maas-default-gateway-openshift-default-64d4cc998c-rmvmh Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" 8m12s Normal SuccessfulCreate replicaset/openshift-ai-inference-openshift-ai-inference-6478fc546c Created pod: openshift-ai-inference-openshift-ai-inference-6478fc546c-wnplv 8m12s Normal ScalingReplicaSet deployment/openshift-ai-inference-openshift-ai-inference Scaled up replica set openshift-ai-inference-openshift-ai-inference-6478fc546c from 0 to 1 8m11s Normal Pulling pod/openshift-ai-inference-openshift-ai-inference-6478fc546c-wnplv Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" 8m9s Normal EnsuredLoadBalancer service/openshift-ai-inference-openshift-ai-inference Ensured load balancer 8m2s Normal Pulled pod/openshift-ai-inference-openshift-ai-inference-6478fc546c-wnplv Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 9.435s (9.435s including waiting). Image size: 183555333 bytes. 8m2s Normal Pulled pod/maas-default-gateway-openshift-default-64d4cc998c-rmvmh Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 9.813s (9.813s including waiting). Image size: 183555333 bytes. 8m2s Normal Created pod/openshift-ai-inference-openshift-ai-inference-6478fc546c-wnplv Container created 8m2s Normal Started pod/openshift-ai-inference-openshift-ai-inference-6478fc546c-wnplv Container started 7m50s Warning FailedGetResourceMetric horizontalpodautoscaler/istiod-openshift-gateway failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 7m50s Warning FailedComputeMetricsReplicas horizontalpodautoscaler/istiod-openshift-gateway invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 7m27s Warning FailedGetResourceMetric horizontalpodautoscaler/openshift-ai-inference-openshift-ai-inference failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 7m27s Warning FailedComputeMetricsReplicas horizontalpodautoscaler/openshift-ai-inference-openshift-ai-inference invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 7m Normal ScalingReplicaSet deployment/kube-auth-proxy Scaled up replica set kube-auth-proxy-744c86bbc8 from 0 to 2 7m Normal SuccessfulCreate replicaset/kube-auth-proxy-744c86bbc8 Created pod: kube-auth-proxy-744c86bbc8-zrkcz 7m Normal SuccessfulCreate replicaset/kube-auth-proxy-744c86bbc8 Created pod: kube-auth-proxy-744c86bbc8-4tfz9 7m Normal AddedInterface pod/kube-auth-proxy-744c86bbc8-zrkcz Add eth0 [10.132.0.48/23] from ovn-kubernetes 7m Normal ScalingReplicaSet deployment/data-science-gateway-data-science-gateway-class Scaled up replica set data-science-gateway-data-science-gateway-class-6bc88ffd5 from 0 to 1 7m Normal SuccessfulCreate replicaset/data-science-gateway-data-science-gateway-class-6bc88ffd5 Created pod: data-science-gateway-data-science-gateway-class-6bc88ffd5-4vptj 6m59s Normal Pulling pod/kube-auth-proxy-744c86bbc8-zrkcz Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" 6m59s Normal AddedInterface pod/kube-auth-proxy-744c86bbc8-4tfz9 Add eth0 [10.134.0.17/23] from ovn-kubernetes 6m59s Normal AddedInterface pod/data-science-gateway-data-science-gateway-class-6bc88ffd5-4vptj Add eth0 [10.133.0.25/23] from ovn-kubernetes 6m59s Normal Pulled pod/data-science-gateway-data-science-gateway-class-6bc88ffd5-4vptj Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 6m59s Normal Created pod/data-science-gateway-data-science-gateway-class-6bc88ffd5-4vptj Container created 6m59s Normal Started pod/data-science-gateway-data-science-gateway-class-6bc88ffd5-4vptj Container started 6m59s Normal Pulling pod/kube-auth-proxy-744c86bbc8-4tfz9 Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" 6m56s Normal Created pod/kube-auth-proxy-744c86bbc8-zrkcz Container created 6m56s Normal Pulled pod/kube-auth-proxy-744c86bbc8-zrkcz Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 3.678s (3.678s including waiting). Image size: 188904677 bytes. 6m56s Normal Started pod/kube-auth-proxy-744c86bbc8-4tfz9 Container started 6m56s Normal Created pod/kube-auth-proxy-744c86bbc8-4tfz9 Container created 6m56s Normal Pulled pod/kube-auth-proxy-744c86bbc8-4tfz9 Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 3.452s (3.452s including waiting). Image size: 188904677 bytes. 6m56s Normal Started pod/kube-auth-proxy-744c86bbc8-zrkcz Container started 6m45s Warning FailedGetResourceMetric horizontalpodautoscaler/kube-auth-proxy failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 6m45s Warning FailedComputeMetricsReplicas horizontalpodautoscaler/kube-auth-proxy invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 6m42s Warning FailedGetResourceMetric horizontalpodautoscaler/data-science-gateway-data-science-gateway-class failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 6m42s Warning FailedComputeMetricsReplicas horizontalpodautoscaler/data-science-gateway-data-science-gateway-class invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 6m30s Warning FailedGetResourceMetric horizontalpodautoscaler/kube-auth-proxy failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 6m30s Warning FailedComputeMetricsReplicas horizontalpodautoscaler/kube-auth-proxy invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 6m27s Warning FailedComputeMetricsReplicas horizontalpodautoscaler/data-science-gateway-data-science-gateway-class invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 6m27s Warning FailedGetResourceMetric horizontalpodautoscaler/data-science-gateway-data-science-gateway-class failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 5m31s Normal ScalingReplicaSet deployment/istiod-openshift-gateway Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 0 to 1 5m31s Normal SuccessfulCreate replicaset/istiod-openshift-gateway-7ddd9cfdc8 Created pod: istiod-openshift-gateway-7ddd9cfdc8-887j4 5m30s Normal AddedInterface pod/istiod-openshift-gateway-7ddd9cfdc8-887j4 Add eth0 [10.134.0.20/23] from ovn-kubernetes 5m30s Normal Created pod/istiod-openshift-gateway-7ddd9cfdc8-887j4 Container created 5m30s Normal Started pod/istiod-openshift-gateway-7ddd9cfdc8-887j4 Container started 5m30s Normal Pulled pod/istiod-openshift-gateway-7ddd9cfdc8-887j4 Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" already present on machine and can be accessed by the pod 5m29s Warning Unhealthy pod/istiod-openshift-gateway-7ddd9cfdc8-887j4 Readiness probe failed: HTTP probe failed with statuscode: 503 5m29s Warning ProbeError pod/istiod-openshift-gateway-7ddd9cfdc8-887j4 Readiness probe error: HTTP probe failed with statuscode: 503... 5m25s Normal ScalingReplicaSet deployment/istiod-openshift-gateway Scaled down replica set istiod-openshift-gateway-7876bfcb74 from 1 to 0 5m25s Normal SuccessfulDelete replicaset/istiod-openshift-gateway-7876bfcb74 Deleted pod: istiod-openshift-gateway-7876bfcb74-tmzw4 5m25s Warning Unhealthy pod/istiod-openshift-gateway-7876bfcb74-tmzw4 Readiness probe failed: Get "http://10.134.0.13:8080/ready": dial tcp 10.134.0.13:8080: connect: connection refused 5m25s Warning ProbeError pod/istiod-openshift-gateway-7876bfcb74-tmzw4 Readiness probe error: Get "http://10.134.0.13:8080/ready": dial tcp 10.134.0.13:8080: connect: connection refused... 5m25s Normal Killing pod/istiod-openshift-gateway-7876bfcb74-tmzw4 Stopping container discovery 5m15s Warning Unhealthy pod/maas-default-gateway-openshift-default-64d4cc998c-rmvmh Readiness probe failed: Get "http://10.133.0.17:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 5m15s Warning ProbeError pod/maas-default-gateway-openshift-default-64d4cc998c-rmvmh Readiness probe error: Get "http://10.133.0.17:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 5m13s Normal Started pod/maas-default-gateway-openshift-default-64d4cc998c-rmvmh Container started 5m13s Normal Created pod/maas-default-gateway-openshift-default-64d4cc998c-rmvmh Container created 5m13s Normal Pulled pod/maas-default-gateway-openshift-default-64d4cc998c-rmvmh Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 5m11s Warning FailedGetResourceMetric horizontalpodautoscaler/maas-default-gateway-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 5m11s Warning FailedComputeMetricsReplicas horizontalpodautoscaler/maas-default-gateway-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 5m7s Warning ProbeError pod/maas-default-gateway-openshift-default-64d4cc998c-rmvmh Startup probe error: Get "http://10.133.0.17:15021/healthz/ready": dial tcp 10.133.0.17:15021: connect: connection refused... 5m7s Warning Unhealthy pod/maas-default-gateway-openshift-default-64d4cc998c-rmvmh Startup probe failed: Get "http://10.133.0.17:15021/healthz/ready": dial tcp 10.133.0.17:15021: connect: connection refused 5m3s Warning FailedComputeMetricsReplicas horizontalpodautoscaler/istiod-openshift-gateway invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 5m3s Warning FailedGetResourceMetric horizontalpodautoscaler/istiod-openshift-gateway failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 4m41s Warning FailedGetResourceMetric horizontalpodautoscaler/maas-default-gateway-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 4m41s Warning FailedComputeMetricsReplicas horizontalpodautoscaler/maas-default-gateway-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 2m55s Normal ScalingReplicaSet deployment/maas-default-gateway-openshift-default Scaled up replica set maas-default-gateway-openshift-default-64d4cc998c from 1 to 2 2m55s Normal SuccessfulCreate replicaset/maas-default-gateway-openshift-default-64d4cc998c Created pod: maas-default-gateway-openshift-default-64d4cc998c-ksvnm 2m55s Normal SuccessfulRescale horizontalpodautoscaler/maas-default-gateway-openshift-default New size: 2; reason: cpu resource utilization (percentage of request) above target 2m54s Normal AddedInterface pod/maas-default-gateway-openshift-default-64d4cc998c-ksvnm Add eth0 [10.134.0.30/23] from ovn-kubernetes 2m54s Normal Pulling pod/maas-default-gateway-openshift-default-64d4cc998c-ksvnm Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" 2m49s Normal Pulled pod/maas-default-gateway-openshift-default-64d4cc998c-ksvnm Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 5.12s (5.12s including waiting). Image size: 183555333 bytes. 2m49s Normal Created pod/maas-default-gateway-openshift-default-64d4cc998c-ksvnm Container created 2m49s Normal Started pod/maas-default-gateway-openshift-default-64d4cc998c-ksvnm Container started 2m42s Warning ProbeError pod/maas-default-gateway-openshift-default-64d4cc998c-ksvnm Startup probe error: Get "http://10.134.0.30:15021/healthz/ready": dial tcp 10.134.0.30:15021: connect: connection refused... 2m42s Warning Unhealthy pod/maas-default-gateway-openshift-default-64d4cc998c-ksvnm Startup probe failed: Get "http://10.134.0.30:15021/healthz/ready": dial tcp 10.134.0.30:15021: connect: connection refused 2m40s Normal ScalingReplicaSet deployment/maas-default-gateway-openshift-default Scaled up replica set maas-default-gateway-openshift-default-64d4cc998c from 2 to 4 2m40s Normal SuccessfulRescale horizontalpodautoscaler/maas-default-gateway-openshift-default New size: 4; reason: cpu resource utilization (percentage of request) above target 2m40s Normal SuccessfulCreate replicaset/maas-default-gateway-openshift-default-64d4cc998c Created pod: maas-default-gateway-openshift-default-64d4cc998c-l8br6 2m40s Normal SuccessfulCreate replicaset/maas-default-gateway-openshift-default-64d4cc998c Created pod: maas-default-gateway-openshift-default-64d4cc998c-pjr4r 2m39s Normal AddedInterface pod/maas-default-gateway-openshift-default-64d4cc998c-pjr4r Add eth0 [10.132.0.57/23] from ovn-kubernetes 2m39s Normal Pulling pod/maas-default-gateway-openshift-default-64d4cc998c-pjr4r Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" 2m39s Normal AddedInterface pod/maas-default-gateway-openshift-default-64d4cc998c-l8br6 Add eth0 [10.134.0.31/23] from ovn-kubernetes 2m39s Normal Pulled pod/maas-default-gateway-openshift-default-64d4cc998c-l8br6 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 2m39s Normal Created pod/maas-default-gateway-openshift-default-64d4cc998c-l8br6 Container created 2m39s Normal Started pod/maas-default-gateway-openshift-default-64d4cc998c-l8br6 Container started 2m33s Warning Unhealthy pod/maas-default-gateway-openshift-default-64d4cc998c-l8br6 Startup probe failed: Get "http://10.134.0.31:15021/healthz/ready": dial tcp 10.134.0.31:15021: connect: connection refused 2m33s Warning ProbeError pod/maas-default-gateway-openshift-default-64d4cc998c-l8br6 Startup probe error: Get "http://10.134.0.31:15021/healthz/ready": dial tcp 10.134.0.31:15021: connect: connection refused... 2m31s Normal Started pod/maas-default-gateway-openshift-default-64d4cc998c-pjr4r Container started 2m31s Normal Pulled pod/maas-default-gateway-openshift-default-64d4cc998c-pjr4r Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 8.071s (8.071s including waiting). Image size: 183555333 bytes. 2m31s Normal Created pod/maas-default-gateway-openshift-default-64d4cc998c-pjr4r Container created 2m25s Warning Unhealthy pod/maas-default-gateway-openshift-default-64d4cc998c-pjr4r Startup probe failed: Get "http://10.132.0.57:15021/healthz/ready": dial tcp 10.132.0.57:15021: connect: connection refused 2m25s Warning ProbeError pod/maas-default-gateway-openshift-default-64d4cc998c-pjr4r Startup probe error: Get "http://10.132.0.57:15021/healthz/ready": dial tcp 10.132.0.57:15021: connect: connection refused... 2m22s Normal ScalingReplicaSet deployment/payload-processing Scaled up replica set payload-processing-55fbbbf9dc from 0 to 1 2m22s Normal ScalingReplicaSet deployment/payload-pre-processing Scaled up replica set payload-pre-processing-7b98bb678c from 0 to 1 2m21s Normal SuccessfulCreate replicaset/payload-pre-processing-7b98bb678c Created pod: payload-pre-processing-7b98bb678c-sspzj 2m21s Warning FailedCreate replicaset/payload-pre-processing-7b98bb678c Error creating: pods "payload-pre-processing-7b98bb678c-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found 2m21s Normal AddedInterface pod/payload-pre-processing-7b98bb678c-sspzj Add eth0 [10.134.0.33/23] from ovn-kubernetes 2m21s Normal AddedInterface pod/payload-processing-55fbbbf9dc-n4nh2 Add eth0 [10.134.0.34/23] from ovn-kubernetes 2m21s Warning FailedCreate replicaset/payload-processing-55fbbbf9dc Error creating: pods "payload-processing-55fbbbf9dc-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found 2m21s Normal SuccessfulCreate replicaset/payload-processing-55fbbbf9dc Created pod: payload-processing-55fbbbf9dc-n4nh2 2m21s Normal Pulling pod/payload-pre-processing-7b98bb678c-sspzj Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" 2m20s Normal Pulling pod/payload-processing-55fbbbf9dc-n4nh2 Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" 2m17s Normal Created pod/payload-pre-processing-7b98bb678c-sspzj Container created 2m17s Normal Pulled pod/payload-pre-processing-7b98bb678c-sspzj Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 3.263s (3.263s including waiting). Image size: 125353963 bytes. 2m17s Normal Started pod/payload-pre-processing-7b98bb678c-sspzj Container started 2m17s Normal Started pod/payload-processing-55fbbbf9dc-n4nh2 Container started 2m17s Normal Created pod/payload-processing-55fbbbf9dc-n4nh2 Container created 2m17s Normal Pulled pod/payload-processing-55fbbbf9dc-n4nh2 Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 3.241s (3.241s including waiting). Image size: 125353963 bytes. 115s Normal SuccessfulCreate replicaset/maas-default-gateway-openshift-default-64d4cc998c Created pod: maas-default-gateway-openshift-default-64d4cc998c-zbswg 115s Normal SuccessfulRescale horizontalpodautoscaler/maas-default-gateway-openshift-default New size: 8; reason: cpu resource utilization (percentage of request) above target 115s Normal ScalingReplicaSet deployment/maas-default-gateway-openshift-default Scaled up replica set maas-default-gateway-openshift-default-64d4cc998c from 4 to 8 114s Normal Pulled pod/maas-default-gateway-openshift-default-64d4cc998c-zbswg Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 114s Normal Started pod/maas-default-gateway-openshift-default-64d4cc998c-2frxn Container started 114s Normal Created pod/maas-default-gateway-openshift-default-64d4cc998c-86xbn Container created 114s Normal SuccessfulCreate replicaset/maas-default-gateway-openshift-default-64d4cc998c Created pod: maas-default-gateway-openshift-default-64d4cc998c-2frxn 114s Normal SuccessfulCreate replicaset/maas-default-gateway-openshift-default-64d4cc998c Created pod: maas-default-gateway-openshift-default-64d4cc998c-87wl5 114s Normal SuccessfulCreate replicaset/maas-default-gateway-openshift-default-64d4cc998c Created pod: maas-default-gateway-openshift-default-64d4cc998c-86xbn 114s Normal Started pod/maas-default-gateway-openshift-default-64d4cc998c-zbswg Container started 114s Normal Created pod/maas-default-gateway-openshift-default-64d4cc998c-zbswg Container created 114s Normal Started pod/maas-default-gateway-openshift-default-64d4cc998c-86xbn Container started 114s Normal AddedInterface pod/maas-default-gateway-openshift-default-64d4cc998c-zbswg Add eth0 [10.133.0.37/23] from ovn-kubernetes 114s Normal AddedInterface pod/maas-default-gateway-openshift-default-64d4cc998c-2frxn Add eth0 [10.132.0.58/23] from ovn-kubernetes 114s Normal Pulled pod/maas-default-gateway-openshift-default-64d4cc998c-2frxn Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 114s Normal Created pod/maas-default-gateway-openshift-default-64d4cc998c-2frxn Container created 114s Normal AddedInterface pod/maas-default-gateway-openshift-default-64d4cc998c-87wl5 Add eth0 [10.134.0.35/23] from ovn-kubernetes 114s Normal Pulled pod/maas-default-gateway-openshift-default-64d4cc998c-87wl5 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 114s Normal Created pod/maas-default-gateway-openshift-default-64d4cc998c-87wl5 Container created 114s Normal AddedInterface pod/maas-default-gateway-openshift-default-64d4cc998c-86xbn Add eth0 [10.133.0.38/23] from ovn-kubernetes 114s Normal Pulled pod/maas-default-gateway-openshift-default-64d4cc998c-86xbn Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 114s Normal Started pod/maas-default-gateway-openshift-default-64d4cc998c-87wl5 Container started 107s Warning ProbeError pod/maas-default-gateway-openshift-default-64d4cc998c-87wl5 Startup probe error: Get "http://10.134.0.35:15021/healthz/ready": dial tcp 10.134.0.35:15021: connect: connection refused... 107s Warning Unhealthy pod/maas-default-gateway-openshift-default-64d4cc998c-87wl5 Startup probe failed: Get "http://10.134.0.35:15021/healthz/ready": dial tcp 10.134.0.35:15021: connect: connection refused 107s Warning Unhealthy pod/maas-default-gateway-openshift-default-64d4cc998c-2frxn Startup probe failed: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused 107s Warning ProbeError pod/maas-default-gateway-openshift-default-64d4cc998c-2frxn Startup probe error: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused... 107s Warning Unhealthy pod/maas-default-gateway-openshift-default-64d4cc998c-zbswg Startup probe failed: Get "http://10.133.0.37:15021/healthz/ready": dial tcp 10.133.0.37:15021: connect: connection refused 107s Warning ProbeError pod/maas-default-gateway-openshift-default-64d4cc998c-zbswg Startup probe error: Get "http://10.133.0.37:15021/healthz/ready": dial tcp 10.133.0.37:15021: connect: connection refused... 107s Warning Unhealthy pod/maas-default-gateway-openshift-default-64d4cc998c-86xbn Startup probe failed: Get "http://10.133.0.38:15021/healthz/ready": dial tcp 10.133.0.38:15021: connect: connection refused 107s Warning ProbeError pod/maas-default-gateway-openshift-default-64d4cc998c-86xbn Startup probe error: Get "http://10.133.0.38:15021/healthz/ready": dial tcp 10.133.0.38:15021: connect: connection refused...