Events

Time	Namespace	Component	RelatedObject	Reason	Message
17:09:19	openshift-ingress		openshift-ai-inference-openshift-default-58c5cd85c9-9jj7c	Scheduled	Successfully assigned openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-9jj7c to ip-10-0-143-86.ec2.internal
17:09:10	openshift-ingress		istiod-openshift-gateway-5677ccb49b-hkbqw	Scheduled	Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-hkbqw to ip-10-0-132-194.ec2.internal
17:02:18	openshift-ingress		router-default-57898f8749-pb7sc	Scheduled	Successfully assigned openshift-ingress/router-default-57898f8749-pb7sc to ip-10-0-132-194.ec2.internal
16:56:04	openshift-ingress	deployment-controller	router-default	ScalingReplicaSet	Scaled up replica set router-default-57898f8749 from 0 to 1
16:56:25 (x13)	openshift-ingress	replicaset-controller	router-default-57898f8749	FailedCreate	Error creating: pods "router-default-57898f8749-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
16:56:34	openshift-ingress	service-controller	router-default	EnsuringLoadBalancer	Ensuring load balancer
16:56:34	openshift-ingress	service-controller	router-default	UnAvailableLoadBalancer	There are no available nodes for LoadBalancer
16:56:38	openshift-ingress	service-controller	router-default	EnsuredLoadBalancer	Ensured load balancer
16:59:34 (x16)	openshift-ingress	replicaset-controller	router-default-57898f8749	FailedCreate	Error creating: pods "router-default-57898f8749-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
17:01:33 (x3)	openshift-ingress	service-controller	router-default	UpdatedLoadBalancer	Updated load balancer with new hosts
17:02:18	openshift-ingress	replicaset-controller	router-default-57898f8749	SuccessfulCreate	Created pod: router-default-57898f8749-pb7sc
17:02:34 (x6)	openshift-ingress	kubelet	router-default-57898f8749-pb7sc	FailedMount	MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
17:02:34 (x6)	openshift-ingress	kubelet	router-default-57898f8749-pb7sc	FailedMount	MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
17:02:50	openshift-ingress	kubelet	router-default-57898f8749-pb7sc	Created	Created container: router
17:02:50	openshift-ingress	multus	router-default-57898f8749-pb7sc	AddedInterface	Add eth0 [10.134.0.10/23] from ovn-kubernetes
17:02:50	openshift-ingress	kubelet	router-default-57898f8749-pb7sc	Started	Started container router
17:02:50	openshift-ingress	kubelet	router-default-57898f8749-pb7sc	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559" already present on machine
17:09:10	openshift-ingress	deployment-controller	istiod-openshift-gateway	ScalingReplicaSet	Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1
17:09:10	openshift-ingress	replicaset-controller	istiod-openshift-gateway-5677ccb49b	SuccessfulCreate	Created pod: istiod-openshift-gateway-5677ccb49b-hkbqw
17:09:10	openshift-ingress	multus	istiod-openshift-gateway-5677ccb49b-hkbqw	AddedInterface	Add eth0 [10.134.0.21/23] from ovn-kubernetes
17:09:10	openshift-ingress	kubelet	istiod-openshift-gateway-5677ccb49b-hkbqw	Pulling	Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"
17:09:14	openshift-ingress	kubelet	istiod-openshift-gateway-5677ccb49b-hkbqw	Started	Started container discovery
17:09:14	openshift-ingress	kubelet	istiod-openshift-gateway-5677ccb49b-hkbqw	Created	Created container: discovery
17:09:14	openshift-ingress	kubelet	istiod-openshift-gateway-5677ccb49b-hkbqw	Pulled	Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.612s (3.612s including waiting). Image size: 181126104 bytes.
17:09:15	openshift-ingress	kubelet	istiod-openshift-gateway-5677ccb49b-hkbqw	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
17:09:15	openshift-ingress	kubelet	istiod-openshift-gateway-5677ccb49b-hkbqw	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
17:09:18	openshift-ingress	gateway_labeler_controller	openshift-ai-inference	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway openshift-ai-inference
17:09:18	openshift-ingress	deployment-controller	openshift-ai-inference-openshift-default	ScalingReplicaSet	Scaled up replica set openshift-ai-inference-openshift-default-58c5cd85c9 from 0 to 1
17:09:18	openshift-ingress	replicaset-controller	openshift-ai-inference-openshift-default-58c5cd85c9	SuccessfulCreate	Created pod: openshift-ai-inference-openshift-default-58c5cd85c9-9jj7c
17:09:19	openshift-ingress	service-controller	openshift-ai-inference-openshift-default	EnsuringLoadBalancer	Ensuring load balancer
17:09:19	openshift-ingress	kubelet	openshift-ai-inference-openshift-default-58c5cd85c9-9jj7c	Pulling	Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"
17:09:19	openshift-ingress	multus	openshift-ai-inference-openshift-default-58c5cd85c9-9jj7c	AddedInterface	Add eth0 [10.132.0.32/23] from ovn-kubernetes
17:09:22	openshift-ingress	service-controller	openshift-ai-inference-openshift-default	EnsuredLoadBalancer	Ensured load balancer
17:09:22	openshift-ingress	kubelet	openshift-ai-inference-openshift-default-58c5cd85c9-9jj7c	Pulled	Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.691s (2.691s including waiting). Image size: 181318953 bytes.
17:09:55 (x3)	openshift-ingress	horizontal-pod-autoscaler	istiod-openshift-gateway	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
17:09:55 (x3)	openshift-ingress	horizontal-pod-autoscaler	istiod-openshift-gateway	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
17:14:03	openshift-ingress	kubelet	openshift-ai-inference-openshift-default-58c5cd85c9-9jj7c	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
17:14:03 (x2)	openshift-ingress	kubelet	openshift-ai-inference-openshift-default-58c5cd85c9-9jj7c	Started	Started container istio-proxy
17:14:03 (x2)	openshift-ingress	kubelet	openshift-ai-inference-openshift-default-58c5cd85c9-9jj7c	Created	Created container: istio-proxy
17:14:08 (x5)	openshift-ingress	kubelet	openshift-ai-inference-openshift-default-58c5cd85c9-9jj7c	Unhealthy	Startup probe failed: Get "http://10.132.0.32:15021/healthz/ready": dial tcp 10.132.0.32:15021: connect: connection refused
17:14:08 (x5)	openshift-ingress	kubelet	openshift-ai-inference-openshift-default-58c5cd85c9-9jj7c	ProbeError	Startup probe error: Get "http://10.132.0.32:15021/healthz/ready": dial tcp 10.132.0.32:15021: connect: connection refused body:
18:12:10	openshift-ingress	horizontal-pod-autoscaler	istiod-openshift-gateway	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: unable to fetch metrics from resource metrics API: an error on the server ("Internal Server Error: \"/apis/metrics.k8s.io/v1beta1/namespaces/openshift-ingress/pods?labelSelector=app%3Distiod%2Cistio.io%2Frev%3Dopenshift-gateway\": Post \"https://172.31.0.1:443/apis/authorization.k8s.io/v1/subjectaccessreviews?timeout=10s\": context deadline exceeded") has prevented the request from succeeding (get pods.metrics.k8s.io)
18:12:10	openshift-ingress	horizontal-pod-autoscaler	istiod-openshift-gateway	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: unable to fetch metrics from resource metrics API: an error on the server ("Internal Server Error: \"/apis/metrics.k8s.io/v1beta1/namespaces/openshift-ingress/pods?labelSelector=app%3Distiod%2Cistio.io%2Frev%3Dopenshift-gateway\": Post \"https://172.31.0.1:443/apis/authorization.k8s.io/v1/subjectaccessreviews?timeout=10s\": context deadline exceeded") has prevented the request from succeeding (get pods.metrics.k8s.io)
18:12:27	openshift-ingress	horizontal-pod-autoscaler	istiod-openshift-gateway	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: unable to fetch metrics from resource metrics API: an error on the server ("Internal Server Error: \"/apis/metrics.k8s.io/v1beta1/namespaces/openshift-ingress/pods?labelSelector=app%3Distiod%2Cistio.io%2Frev%3Dopenshift-gateway\": Post \"https://172.31.0.1:443/apis/authorization.k8s.io/v1/subjectaccessreviews?timeout=10s\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)") has prevented the request from succeeding (get pods.metrics.k8s.io)
18:12:27	openshift-ingress	horizontal-pod-autoscaler	istiod-openshift-gateway	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: unable to fetch metrics from resource metrics API: an error on the server ("Internal Server Error: \"/apis/metrics.k8s.io/v1beta1/namespaces/openshift-ingress/pods?labelSelector=app%3Distiod%2Cistio.io%2Frev%3Dopenshift-gateway\": Post \"https://172.31.0.1:443/apis/authorization.k8s.io/v1/subjectaccessreviews?timeout=10s\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)") has prevented the request from succeeding (get pods.metrics.k8s.io)