Events

Time	Namespace	Component	RelatedObject	Reason	Message
18:10:24	openshift-ingress		e2e-ait-5b603d23-openshift-default-566758c5c-nzmb8	Scheduled	Successfully assigned openshift-ingress/e2e-ait-5b603d23-openshift-default-566758c5c-nzmb8 to ip-10-0-140-115.ec2.internal
17:49:54	openshift-ingress		data-science-gateway-data-science-gateway-class-6576859cf4b8v7m	Scheduled	Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4b8v7m to ip-10-0-140-115.ec2.internal
18:16:21	openshift-ingress		e2e-inf-b-c34ce0-openshift-default-789cd44c7f-pfxh6	Scheduled	Successfully assigned openshift-ingress/e2e-inf-b-c34ce0-openshift-default-789cd44c7f-pfxh6 to ip-10-0-140-115.ec2.internal
18:18:51	openshift-ingress		e2e-shared-a-91cb9f-openshift-default-7c8b85779f-9k7jd	Scheduled	Successfully assigned openshift-ingress/e2e-shared-a-91cb9f-openshift-default-7c8b85779f-9k7jd to ip-10-0-140-115.ec2.internal
17:53:50	openshift-ingress		payload-pre-processing-7964457696-zr75s	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-7964457696-zr75s to ip-10-0-133-236.ec2.internal
18:18:13	openshift-ingress		e2e-api-a-aa698f-openshift-default-577757df4f-t7x4s	Scheduled	Successfully assigned openshift-ingress/e2e-api-a-aa698f-openshift-default-577757df4f-t7x4s to ip-10-0-140-115.ec2.internal
17:49:56	openshift-ingress		istiod-openshift-gateway-94bb8fbfd-nhx92	Scheduled	Successfully assigned openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nhx92 to ip-10-0-140-115.ec2.internal
17:49:54	openshift-ingress		data-science-gateway-data-science-gateway-class-84cc848bd-6dlwj	Scheduled	Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-6dlwj to ip-10-0-140-115.ec2.internal
17:44:29	openshift-ingress		router-default-7d6575475f-sg844	Scheduled	Successfully assigned openshift-ingress/router-default-7d6575475f-sg844 to ip-10-0-140-115.ec2.internal
17:52:31	openshift-ingress		maas-default-gateway-openshift-default-56654dcf7-cksjz	Scheduled	Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cksjz to ip-10-0-140-115.ec2.internal
17:49:47	openshift-ingress		kube-auth-proxy-98dc6956-bzjw6	Scheduled	Successfully assigned openshift-ingress/kube-auth-proxy-98dc6956-bzjw6 to ip-10-0-133-100.ec2.internal
18:16:13	openshift-ingress		e2e-inf-a-205c4c-openshift-default-5bc6d775d7-5rgbh	Scheduled	Successfully assigned openshift-ingress/e2e-inf-a-205c4c-openshift-default-5bc6d775d7-5rgbh to ip-10-0-140-115.ec2.internal
18:13:25	openshift-ingress		e2e-mt-14d0a8da-openshift-default-6d7df4b87-ckh8q	Scheduled	Successfully assigned openshift-ingress/e2e-mt-14d0a8da-openshift-default-6d7df4b87-ckh8q to ip-10-0-140-115.ec2.internal
17:53:50	openshift-ingress		payload-processing-58f86c7798-skm4k	Scheduled	Successfully assigned openshift-ingress/payload-processing-58f86c7798-skm4k to ip-10-0-133-236.ec2.internal
17:49:49	openshift-ingress		istiod-openshift-gateway-7574459656-8j67b	Scheduled	Successfully assigned openshift-ingress/istiod-openshift-gateway-7574459656-8j67b to ip-10-0-133-236.ec2.internal
17:49:47	openshift-ingress		kube-auth-proxy-98dc6956-pmkj5	Scheduled	Successfully assigned openshift-ingress/kube-auth-proxy-98dc6956-pmkj5 to ip-10-0-133-236.ec2.internal
18:18:22	openshift-ingress		e2e-api-b-77c307-openshift-default-6866dc8d7f-7b5l5	Scheduled	Successfully assigned openshift-ingress/e2e-api-b-77c307-openshift-default-6866dc8d7f-7b5l5 to ip-10-0-140-115.ec2.internal
18:10:11	openshift-ingress		e2e-ait-12b475ae-openshift-default-595458d449-t6gxk	Scheduled	Successfully assigned openshift-ingress/e2e-ait-12b475ae-openshift-default-595458d449-t6gxk to ip-10-0-140-115.ec2.internal
18:12:43	openshift-ingress		e2e-mt-86957ffb-openshift-default-749c59f9b7-xkq5g	Scheduled	Successfully assigned openshift-ingress/e2e-mt-86957ffb-openshift-default-749c59f9b7-xkq5g to ip-10-0-140-115.ec2.internal
18:18:59	openshift-ingress		e2e-shared-b-2861c1-openshift-default-67d8fcbc-lbv5v	Scheduled	Successfully assigned openshift-ingress/e2e-shared-b-2861c1-openshift-default-67d8fcbc-lbv5v to ip-10-0-140-115.ec2.internal
17:34:23	openshift-ingress	service-controller	router-default	EnsuringLoadBalancer	Ensuring load balancer
17:34:23	openshift-ingress	service-controller	router-default	UnAvailableLoadBalancer	There are no available nodes for LoadBalancer
17:34:27	openshift-ingress	service-controller	router-default	EnsuredLoadBalancer	Ensured load balancer
17:34:29	openshift-ingress	deployment-controller	router-default	ScalingReplicaSet	Scaled up replica set router-default-7d6575475f from 0 to 1
17:39:57 (x17)	openshift-ingress	replicaset-controller	router-default-7d6575475f	FailedCreate	Error creating: pods "router-default-7d6575475f-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
17:40:34 (x3)	openshift-ingress	service-controller	router-default	UpdatedLoadBalancer	Updated load balancer with new hosts
17:44:29	openshift-ingress	replicaset-controller	router-default-7d6575475f	SuccessfulCreate	Created pod: router-default-7d6575475f-sg844
17:44:37 (x5)	openshift-ingress	kubelet	router-default-7d6575475f-sg844	FailedMount	MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
17:44:45 (x6)	openshift-ingress	kubelet	router-default-7d6575475f-sg844	FailedMount	MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
17:45:01	openshift-ingress	kubelet	router-default-7d6575475f-sg844	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:32d6df0cb6282bc5ba571a8de322fe598afdf22e817f5a7dc92db3274dbdb9a1" already present on machine
17:45:01	openshift-ingress	multus	router-default-7d6575475f-sg844	AddedInterface	Add eth0 [10.134.0.9/23] from ovn-kubernetes
17:45:01	openshift-ingress	kubelet	router-default-7d6575475f-sg844	Created	Created container: router
17:45:01	openshift-ingress	kubelet	router-default-7d6575475f-sg844	Started	Started container router
17:49:47	openshift-ingress	deployment-controller	kube-auth-proxy	ScalingReplicaSet	Scaled up replica set kube-auth-proxy-98dc6956 from 0 to 2
17:49:47	openshift-ingress	replicaset-controller	kube-auth-proxy-98dc6956	SuccessfulCreate	Created pod: kube-auth-proxy-98dc6956-pmkj5
17:49:47	openshift-ingress	replicaset-controller	kube-auth-proxy-98dc6956	SuccessfulCreate	Created pod: kube-auth-proxy-98dc6956-bzjw6
17:49:47 (x5)	openshift-ingress	replicaset-controller	kube-auth-proxy-98dc6956	FailedCreate	Error creating: pods "kube-auth-proxy-98dc6956-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found
17:49:48	openshift-ingress	kubelet	kube-auth-proxy-98dc6956-pmkj5	Pulling	Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"
17:49:48	openshift-ingress	multus	kube-auth-proxy-98dc6956-bzjw6	AddedInterface	Add eth0 [10.133.0.34/23] from ovn-kubernetes
17:49:48	openshift-ingress	kubelet	kube-auth-proxy-98dc6956-bzjw6	Pulling	Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"
17:49:48	openshift-ingress	multus	kube-auth-proxy-98dc6956-pmkj5	AddedInterface	Add eth0 [10.132.0.17/23] from ovn-kubernetes
17:49:49	openshift-ingress	multus	istiod-openshift-gateway-7574459656-8j67b	AddedInterface	Add eth0 [10.132.0.19/23] from ovn-kubernetes
17:49:49	openshift-ingress	deployment-controller	istiod-openshift-gateway	ScalingReplicaSet	Scaled up replica set istiod-openshift-gateway-7574459656 from 0 to 1
17:49:49	openshift-ingress	kubelet	istiod-openshift-gateway-7574459656-8j67b	Pulling	Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:0850242436e88f7d82f0f2126de064c7e0f09844f31d8ff0f53dc8d3908075d9"
17:49:49	openshift-ingress	replicaset-controller	istiod-openshift-gateway-7574459656	SuccessfulCreate	Created pod: istiod-openshift-gateway-7574459656-8j67b
17:49:52	openshift-ingress	kubelet	kube-auth-proxy-98dc6956-bzjw6	Started	Started container kube-auth-proxy
17:49:52	openshift-ingress	kubelet	kube-auth-proxy-98dc6956-bzjw6	Created	Created container: kube-auth-proxy
17:49:52	openshift-ingress	kubelet	kube-auth-proxy-98dc6956-bzjw6	Pulled	Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 3.992s (3.992s including waiting). Image size: 265120132 bytes.
17:49:53	openshift-ingress	kubelet	istiod-openshift-gateway-7574459656-8j67b	Pulled	Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:0850242436e88f7d82f0f2126de064c7e0f09844f31d8ff0f53dc8d3908075d9" in 3.893s (3.893s including waiting). Image size: 181034515 bytes.
17:49:53	openshift-ingress	kubelet	istiod-openshift-gateway-7574459656-8j67b	Started	Started container discovery
17:49:53	openshift-ingress	kubelet	istiod-openshift-gateway-7574459656-8j67b	Created	Created container: discovery
17:49:53	openshift-ingress	kubelet	kube-auth-proxy-98dc6956-pmkj5	Pulled	Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 5.021s (5.021s including waiting). Image size: 265120132 bytes.
17:49:53	openshift-ingress	kubelet	kube-auth-proxy-98dc6956-pmkj5	Created	Created container: kube-auth-proxy
17:49:53	openshift-ingress	kubelet	kube-auth-proxy-98dc6956-pmkj5	Started	Started container kube-auth-proxy
17:49:54	openshift-ingress	multus	data-science-gateway-data-science-gateway-class-84cc848bd-6dlwj	AddedInterface	Add eth0 [10.134.0.23/23] from ovn-kubernetes
17:49:54	openshift-ingress	replicaset-controller	data-science-gateway-data-science-gateway-class-84cc848bd	SuccessfulCreate	Created pod: data-science-gateway-data-science-gateway-class-84cc848bd-6dlwj
17:49:54	openshift-ingress	deployment-controller	data-science-gateway-data-science-gateway-class	ScalingReplicaSet	Scaled up replica set data-science-gateway-data-science-gateway-class-6576859cf4 from 0 to 1
17:49:54	openshift-ingress	deployment-controller	data-science-gateway-data-science-gateway-class	ScalingReplicaSet	Scaled up replica set data-science-gateway-data-science-gateway-class-84cc848bd from 0 to 1
17:49:54	openshift-ingress	replicaset-controller	data-science-gateway-data-science-gateway-class-6576859cf4	SuccessfulCreate	Created pod: data-science-gateway-data-science-gateway-class-6576859cf4b8v7m
17:49:55	openshift-ingress	kubelet	data-science-gateway-data-science-gateway-class-84cc848bd-6dlwj	Pulling	Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8"
17:49:55	openshift-ingress	kubelet	data-science-gateway-data-science-gateway-class-6576859cf4b8v7m	Pulling	Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8"
17:49:55	openshift-ingress	multus	data-science-gateway-data-science-gateway-class-6576859cf4b8v7m	AddedInterface	Add eth0 [10.134.0.24/23] from ovn-kubernetes
17:49:56	openshift-ingress	deployment-controller	istiod-openshift-gateway	ScalingReplicaSet	Scaled up replica set istiod-openshift-gateway-94bb8fbfd from 0 to 1
17:49:56	openshift-ingress	replicaset-controller	istiod-openshift-gateway-94bb8fbfd	SuccessfulCreate	Created pod: istiod-openshift-gateway-94bb8fbfd-nhx92
17:49:57	openshift-ingress	multus	istiod-openshift-gateway-94bb8fbfd-nhx92	AddedInterface	Add eth0 [10.134.0.25/23] from ovn-kubernetes
17:49:58	openshift-ingress	kubelet	data-science-gateway-data-science-gateway-class-6576859cf4b8v7m	Started	Started container istio-proxy
17:49:58	openshift-ingress	kubelet	data-science-gateway-data-science-gateway-class-84cc848bd-6dlwj	Created	Created container: istio-proxy
17:49:58	openshift-ingress	kubelet	data-science-gateway-data-science-gateway-class-84cc848bd-6dlwj	Pulled	Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" in 3.199s (3.199s including waiting). Image size: 181251556 bytes.
17:49:58	openshift-ingress	kubelet	istiod-openshift-gateway-94bb8fbfd-nhx92	Pulling	Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:0850242436e88f7d82f0f2126de064c7e0f09844f31d8ff0f53dc8d3908075d9"
17:49:58	openshift-ingress	kubelet	data-science-gateway-data-science-gateway-class-6576859cf4b8v7m	Created	Created container: istio-proxy
17:49:58	openshift-ingress	kubelet	data-science-gateway-data-science-gateway-class-6576859cf4b8v7m	Pulled	Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" in 3.146s (3.146s including waiting). Image size: 181251556 bytes.
17:49:58	openshift-ingress	kubelet	data-science-gateway-data-science-gateway-class-84cc848bd-6dlwj	Started	Started container istio-proxy
17:50:00	openshift-ingress	kubelet	istiod-openshift-gateway-94bb8fbfd-nhx92	Pulled	Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:0850242436e88f7d82f0f2126de064c7e0f09844f31d8ff0f53dc8d3908075d9" in 2.338s (2.338s including waiting). Image size: 181034515 bytes.
17:50:00	openshift-ingress	kubelet	istiod-openshift-gateway-94bb8fbfd-nhx92	Started	Started container discovery
17:50:00	openshift-ingress	replicaset-controller	data-science-gateway-data-science-gateway-class-84cc848bd	SuccessfulDelete	Deleted pod: data-science-gateway-data-science-gateway-class-84cc848bd-6dlwj
17:50:00	openshift-ingress	deployment-controller	data-science-gateway-data-science-gateway-class	ScalingReplicaSet	Scaled down replica set data-science-gateway-data-science-gateway-class-84cc848bd from 1 to 0
17:50:00	openshift-ingress	kubelet	istiod-openshift-gateway-94bb8fbfd-nhx92	Created	Created container: discovery
17:50:01 (x3)	openshift-ingress	kubelet	data-science-gateway-data-science-gateway-class-84cc848bd-6dlwj	Unhealthy	Startup probe failed: Get "http://10.134.0.23:15021/healthz/ready": dial tcp 10.134.0.23:15021: connect: connection refused
17:50:01 (x3)	openshift-ingress	kubelet	data-science-gateway-data-science-gateway-class-84cc848bd-6dlwj	ProbeError	Startup probe error: Get "http://10.134.0.23:15021/healthz/ready": dial tcp 10.134.0.23:15021: connect: connection refused body:
17:50:01	openshift-ingress	kubelet	istiod-openshift-gateway-94bb8fbfd-nhx92	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
17:50:01	openshift-ingress	kubelet	istiod-openshift-gateway-94bb8fbfd-nhx92	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
17:50:02	openshift-ingress	horizontal-pod-autoscaler	kube-auth-proxy	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
17:50:02	openshift-ingress	kubelet	data-science-gateway-data-science-gateway-class-84cc848bd-6dlwj	Killing	Stopping container istio-proxy
17:50:02	openshift-ingress	kubelet	istiod-openshift-gateway-7574459656-8j67b	Killing	Stopping container discovery
17:50:02	openshift-ingress	deployment-controller	istiod-openshift-gateway	ScalingReplicaSet	Scaled down replica set istiod-openshift-gateway-7574459656 from 1 to 0
17:50:02	openshift-ingress	replicaset-controller	istiod-openshift-gateway-7574459656	SuccessfulDelete	Deleted pod: istiod-openshift-gateway-7574459656-8j67b
17:50:02	openshift-ingress	horizontal-pod-autoscaler	kube-auth-proxy	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
17:50:04	openshift-ingress	horizontal-pod-autoscaler	istiod-openshift-gateway	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
17:50:04	openshift-ingress	horizontal-pod-autoscaler	istiod-openshift-gateway	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
17:50:17	openshift-ingress	horizontal-pod-autoscaler	kube-auth-proxy	FailedGetResourceMetric	failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
17:50:17	openshift-ingress	horizontal-pod-autoscaler	kube-auth-proxy	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
17:50:19	openshift-ingress	horizontal-pod-autoscaler	istiod-openshift-gateway	FailedGetResourceMetric	failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
17:50:19	openshift-ingress	horizontal-pod-autoscaler	istiod-openshift-gateway	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
17:52:31	openshift-ingress	deployment-controller	maas-default-gateway-openshift-default	ScalingReplicaSet	Scaled up replica set maas-default-gateway-openshift-default-56654dcf7 from 0 to 1
17:52:31	openshift-ingress	replicaset-controller	maas-default-gateway-openshift-default-56654dcf7	SuccessfulCreate	Created pod: maas-default-gateway-openshift-default-56654dcf7-cksjz
17:52:31	openshift-ingress	gateway_labeler_controller	maas-default-gateway	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway
17:52:31	openshift-ingress	multus	maas-default-gateway-openshift-default-56654dcf7-cksjz	AddedInterface	Add eth0 [10.134.0.27/23] from ovn-kubernetes
17:53:50	openshift-ingress	replicaset-controller	payload-pre-processing-7964457696	SuccessfulCreate	Created pod: payload-pre-processing-7964457696-zr75s
17:53:50 (x4)	openshift-ingress	replicaset-controller	payload-pre-processing-7964457696	FailedCreate	Error creating: pods "payload-pre-processing-7964457696-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found
17:53:50	openshift-ingress	deployment-controller	payload-processing	ScalingReplicaSet	Scaled up replica set payload-processing-58f86c7798 from 0 to 1
17:53:50	openshift-ingress	replicaset-controller	payload-processing-58f86c7798	SuccessfulCreate	Created pod: payload-processing-58f86c7798-skm4k
17:53:50 (x5)	openshift-ingress	replicaset-controller	payload-processing-58f86c7798	FailedCreate	Error creating: pods "payload-processing-58f86c7798-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found
17:53:50	openshift-ingress	deployment-controller	payload-pre-processing	ScalingReplicaSet	Scaled up replica set payload-pre-processing-7964457696 from 0 to 1
17:53:51	openshift-ingress	kubelet	payload-processing-58f86c7798-skm4k	Pulling	Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:dc31b949d8c5ea8610b5c10ef53e2a199e00f0e0"
17:53:51	openshift-ingress	multus	payload-processing-58f86c7798-skm4k	AddedInterface	Add eth0 [10.132.0.41/23] from ovn-kubernetes
17:53:51	openshift-ingress	multus	payload-pre-processing-7964457696-zr75s	AddedInterface	Add eth0 [10.132.0.40/23] from ovn-kubernetes
17:53:51	openshift-ingress	kubelet	payload-pre-processing-7964457696-zr75s	Pulling	Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:dc31b949d8c5ea8610b5c10ef53e2a199e00f0e0"
17:53:52	openshift-ingress	kubelet	payload-pre-processing-7964457696-zr75s	Created	Created container: payload-pre-processing
17:53:52	openshift-ingress	kubelet	payload-pre-processing-7964457696-zr75s	Started	Started container payload-pre-processing
17:53:52	openshift-ingress	kubelet	payload-pre-processing-7964457696-zr75s	Pulled	Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:dc31b949d8c5ea8610b5c10ef53e2a199e00f0e0" in 1.616s (1.616s including waiting). Image size: 165432098 bytes.
17:53:52	openshift-ingress	kubelet	payload-processing-58f86c7798-skm4k	Pulled	Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:dc31b949d8c5ea8610b5c10ef53e2a199e00f0e0" in 1.573s (1.573s including waiting). Image size: 165432098 bytes.
17:53:52	openshift-ingress	kubelet	payload-processing-58f86c7798-skm4k	Created	Created container: payload-processing
17:53:52	openshift-ingress	kubelet	payload-processing-58f86c7798-skm4k	Started	Started container payload-processing
17:53:58 (x2)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-56654dcf7-cksjz	Created	Created container: istio-proxy
17:53:58 (x2)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-56654dcf7-cksjz	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine
17:53:58 (x2)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-56654dcf7-cksjz	Started	Started container istio-proxy
17:54:02 (x4)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-56654dcf7-cksjz	Unhealthy	Startup probe failed: Get "http://10.134.0.27:15021/healthz/ready": dial tcp 10.134.0.27:15021: connect: connection refused
17:54:02 (x4)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-56654dcf7-cksjz	ProbeError	Startup probe error: Get "http://10.134.0.27:15021/healthz/ready": dial tcp 10.134.0.27:15021: connect: connection refused body:
18:07:30	openshift-ingress	horizontal-pod-autoscaler	istiod-openshift-gateway	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: unable to fetch metrics from resource metrics API: an error on the server ("Internal Server Error: \"/apis/metrics.k8s.io/v1beta1/namespaces/openshift-ingress/pods?labelSelector=app%3Distiod%2Cistio.io%2Frev%3Dopenshift-gateway\": Post \"https://172.31.0.1:443/apis/authorization.k8s.io/v1/subjectaccessreviews?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)") has prevented the request from succeeding (get pods.metrics.k8s.io)
18:07:30	openshift-ingress	horizontal-pod-autoscaler	istiod-openshift-gateway	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: unable to fetch metrics from resource metrics API: an error on the server ("Internal Server Error: \"/apis/metrics.k8s.io/v1beta1/namespaces/openshift-ingress/pods?labelSelector=app%3Distiod%2Cistio.io%2Frev%3Dopenshift-gateway\": Post \"https://172.31.0.1:443/apis/authorization.k8s.io/v1/subjectaccessreviews?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)") has prevented the request from succeeding (get pods.metrics.k8s.io)
18:07:50 (x2)	openshift-ingress	horizontal-pod-autoscaler	kube-auth-proxy	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: unable to fetch metrics from resource metrics API: an error on the server ("Internal Server Error: \"/apis/metrics.k8s.io/v1beta1/namespaces/openshift-ingress/pods?labelSelector=app%3Dkube-auth-proxy\": Post \"https://172.31.0.1:443/apis/authorization.k8s.io/v1/subjectaccessreviews?timeout=10s\": context deadline exceeded") has prevented the request from succeeding (get pods.metrics.k8s.io)
18:07:50 (x2)	openshift-ingress	horizontal-pod-autoscaler	kube-auth-proxy	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: unable to fetch metrics from resource metrics API: an error on the server ("Internal Server Error: \"/apis/metrics.k8s.io/v1beta1/namespaces/openshift-ingress/pods?labelSelector=app%3Dkube-auth-proxy\": Post \"https://172.31.0.1:443/apis/authorization.k8s.io/v1/subjectaccessreviews?timeout=10s\": context deadline exceeded") has prevented the request from succeeding (get pods.metrics.k8s.io)
18:07:50	openshift-ingress	horizontal-pod-autoscaler	istiod-openshift-gateway	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: unable to fetch metrics from resource metrics API: an error on the server ("Internal Server Error: \"/apis/metrics.k8s.io/v1beta1/namespaces/openshift-ingress/pods?labelSelector=app%3Distiod%2Cistio.io%2Frev%3Dopenshift-gateway\": Post \"https://172.31.0.1:443/apis/authorization.k8s.io/v1/subjectaccessreviews?timeout=10s\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)") has prevented the request from succeeding (get pods.metrics.k8s.io)
18:07:50	openshift-ingress	horizontal-pod-autoscaler	istiod-openshift-gateway	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: unable to fetch metrics from resource metrics API: an error on the server ("Internal Server Error: \"/apis/metrics.k8s.io/v1beta1/namespaces/openshift-ingress/pods?labelSelector=app%3Distiod%2Cistio.io%2Frev%3Dopenshift-gateway\": Post \"https://172.31.0.1:443/apis/authorization.k8s.io/v1/subjectaccessreviews?timeout=10s\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)") has prevented the request from succeeding (get pods.metrics.k8s.io)
18:10:11	openshift-ingress	gateway_labeler_controller	e2e-ait-12b475ae	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-ait-12b475ae
18:10:11	openshift-ingress	service-controller	e2e-ait-12b475ae-openshift-default	EnsuringLoadBalancer	Ensuring load balancer
18:10:11	openshift-ingress	deployment-controller	e2e-ait-12b475ae-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-ait-12b475ae-openshift-default-595458d449 from 0 to 1
18:10:11	openshift-ingress	replicaset-controller	e2e-ait-12b475ae-openshift-default-595458d449	SuccessfulCreate	Created pod: e2e-ait-12b475ae-openshift-default-595458d449-t6gxk
18:10:12	openshift-ingress	kubelet	e2e-ait-12b475ae-openshift-default-595458d449-t6gxk	Created	Created container: istio-proxy
18:10:12	openshift-ingress	kubelet	e2e-ait-12b475ae-openshift-default-595458d449-t6gxk	Started	Started container istio-proxy
18:10:12	openshift-ingress	multus	e2e-ait-12b475ae-openshift-default-595458d449-t6gxk	AddedInterface	Add eth0 [10.134.0.30/23] from ovn-kubernetes
18:10:12	openshift-ingress	kubelet	e2e-ait-12b475ae-openshift-default-595458d449-t6gxk	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine
18:10:13	openshift-ingress	kubelet	e2e-ait-12b475ae-openshift-default-595458d449-t6gxk	Unhealthy	Startup probe failed: Get "http://10.134.0.30:15021/healthz/ready": dial tcp 10.134.0.30:15021: connect: connection refused
18:10:13	openshift-ingress	kubelet	e2e-ait-12b475ae-openshift-default-595458d449-t6gxk	ProbeError	Startup probe error: Get "http://10.134.0.30:15021/healthz/ready": dial tcp 10.134.0.30:15021: connect: connection refused body:
18:10:16	openshift-ingress	service-controller	e2e-ait-12b475ae-openshift-default	EnsuredLoadBalancer	Ensured load balancer
18:10:18	openshift-ingress	kubelet	e2e-ait-12b475ae-openshift-default-595458d449-t6gxk	Killing	Stopping container istio-proxy
18:10:18	openshift-ingress	service-controller	e2e-ait-12b475ae-openshift-default	DeletingLoadBalancer	Deleting load balancer
18:10:20	openshift-ingress	service-controller	e2e-ait-12b475ae-openshift-default	DeletedLoadBalancer	Deleted load balancer
18:10:24	openshift-ingress	kubelet	e2e-ait-5b603d23-openshift-default-566758c5c-nzmb8	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine
18:10:24	openshift-ingress	replicaset-controller	e2e-ait-5b603d23-openshift-default-566758c5c	SuccessfulCreate	Created pod: e2e-ait-5b603d23-openshift-default-566758c5c-nzmb8
18:10:24	openshift-ingress	gateway_labeler_controller	e2e-ait-5b603d23	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-ait-5b603d23
18:10:24	openshift-ingress	kubelet	e2e-ait-5b603d23-openshift-default-566758c5c-nzmb8	Started	Started container istio-proxy
18:10:24	openshift-ingress	kubelet	e2e-ait-5b603d23-openshift-default-566758c5c-nzmb8	Created	Created container: istio-proxy
18:10:24	openshift-ingress	service-controller	e2e-ait-5b603d23-openshift-default	EnsuringLoadBalancer	Ensuring load balancer
18:10:24	openshift-ingress	multus	e2e-ait-5b603d23-openshift-default-566758c5c-nzmb8	AddedInterface	Add eth0 [10.134.0.31/23] from ovn-kubernetes
18:10:24	openshift-ingress	deployment-controller	e2e-ait-5b603d23-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-ait-5b603d23-openshift-default-566758c5c from 0 to 1
18:10:27	openshift-ingress	service-controller	e2e-ait-5b603d23-openshift-default	EnsuredLoadBalancer	Ensured load balancer
18:10:37 (x12)	openshift-ingress	kubelet	e2e-ait-5b603d23-openshift-default-566758c5c-nzmb8	Unhealthy	Startup probe failed: Get "http://10.134.0.31:15021/healthz/ready": dial tcp 10.134.0.31:15021: connect: connection refused
18:10:38 (x13)	openshift-ingress	kubelet	e2e-ait-5b603d23-openshift-default-566758c5c-nzmb8	ProbeError	Startup probe error: Get "http://10.134.0.31:15021/healthz/ready": dial tcp 10.134.0.31:15021: connect: connection refused body:
18:10:41	openshift-ingress	kubelet	e2e-ait-5b603d23-openshift-default-566758c5c-nzmb8	Killing	Stopping container istio-proxy
18:10:41	openshift-ingress	service-controller	e2e-ait-5b603d23-openshift-default	DeletingLoadBalancer	Deleting load balancer
18:10:43	openshift-ingress	service-controller	e2e-ait-5b603d23-openshift-default	DeletedLoadBalancer	Deleted load balancer
18:10:57	openshift-ingress	gateway_labeler_controller	e2e-derive-34249437	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-derive-34249437
18:12:43	openshift-ingress	gateway_labeler_controller	e2e-mt-86957ffb	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-mt-86957ffb
18:12:43	openshift-ingress	replicaset-controller	e2e-mt-86957ffb-openshift-default-749c59f9b7	SuccessfulCreate	Created pod: e2e-mt-86957ffb-openshift-default-749c59f9b7-xkq5g
18:12:43	openshift-ingress	deployment-controller	e2e-mt-86957ffb-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-mt-86957ffb-openshift-default-749c59f9b7 from 0 to 1
18:12:44	openshift-ingress	multus	e2e-mt-86957ffb-openshift-default-749c59f9b7-xkq5g	AddedInterface	Add eth0 [10.134.0.32/23] from ovn-kubernetes
18:13:02	openshift-ingress	kubelet	e2e-mt-86957ffb-openshift-default-749c59f9b7-xkq5g	ProbeError	Readiness probe error: Get "http://10.134.0.32:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
18:13:02	openshift-ingress	kubelet	e2e-mt-86957ffb-openshift-default-749c59f9b7-xkq5g	Unhealthy	Readiness probe failed: Get "http://10.134.0.32:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
18:13:03 (x2)	openshift-ingress	kubelet	e2e-mt-86957ffb-openshift-default-749c59f9b7-xkq5g	Created	Created container: istio-proxy
18:13:03 (x2)	openshift-ingress	kubelet	e2e-mt-86957ffb-openshift-default-749c59f9b7-xkq5g	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine
18:13:03 (x2)	openshift-ingress	kubelet	e2e-mt-86957ffb-openshift-default-749c59f9b7-xkq5g	Started	Started container istio-proxy
18:13:05	openshift-ingress	kubelet	e2e-mt-86957ffb-openshift-default-749c59f9b7-xkq5g	FailedToRetrieveImagePullSecret	Unable to retrieve some image pull secrets (e2e-mt-86957ffb-openshift-default-dockercfg-z5brj); attempting to pull the image may not succeed.
18:13:06	openshift-ingress	kubelet	e2e-mt-86957ffb-openshift-default-749c59f9b7-xkq5g	Killing	Stopping container istio-proxy
18:13:25	openshift-ingress	deployment-controller	e2e-mt-14d0a8da-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-mt-14d0a8da-openshift-default-6d7df4b87 from 0 to 1
18:13:25	openshift-ingress	gateway_labeler_controller	e2e-mt-14d0a8da	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-mt-14d0a8da
18:13:25	openshift-ingress	replicaset-controller	e2e-mt-14d0a8da-openshift-default-6d7df4b87	SuccessfulCreate	Created pod: e2e-mt-14d0a8da-openshift-default-6d7df4b87-ckh8q
18:13:25	openshift-ingress	GatewayAuthBootstrap	e2e-mt-14d0a8da	ReconcileError	Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-mt-14d0a8da-authn-ssl: envoyfilters.networking.istio.io "e2e-mt-14d0a8da-authn-ssl" already exists
18:13:25	openshift-ingress	multus	e2e-mt-14d0a8da-openshift-default-6d7df4b87-ckh8q	AddedInterface	Add eth0 [10.134.0.33/23] from ovn-kubernetes
18:13:42	openshift-ingress	kubelet	e2e-mt-14d0a8da-openshift-default-6d7df4b87-ckh8q	ProbeError	Readiness probe error: Get "http://10.134.0.33:15021/healthz/ready": dial tcp 10.134.0.33:15021: connect: connection refused body:
18:13:42	openshift-ingress	kubelet	e2e-mt-14d0a8da-openshift-default-6d7df4b87-ckh8q	Unhealthy	Readiness probe failed: Get "http://10.134.0.33:15021/healthz/ready": dial tcp 10.134.0.33:15021: connect: connection refused
18:13:42 (x2)	openshift-ingress	kubelet	e2e-mt-14d0a8da-openshift-default-6d7df4b87-ckh8q	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine
18:13:42 (x2)	openshift-ingress	kubelet	e2e-mt-14d0a8da-openshift-default-6d7df4b87-ckh8q	Created	Created container: istio-proxy
18:13:42 (x2)	openshift-ingress	kubelet	e2e-mt-14d0a8da-openshift-default-6d7df4b87-ckh8q	Started	Started container istio-proxy
18:13:46 (x3)	openshift-ingress	kubelet	e2e-mt-14d0a8da-openshift-default-6d7df4b87-ckh8q	Unhealthy	Startup probe failed: Get "http://10.134.0.33:15021/healthz/ready": dial tcp 10.134.0.33:15021: connect: connection refused
18:13:46 (x3)	openshift-ingress	kubelet	e2e-mt-14d0a8da-openshift-default-6d7df4b87-ckh8q	ProbeError	Startup probe error: Get "http://10.134.0.33:15021/healthz/ready": dial tcp 10.134.0.33:15021: connect: connection refused body:
18:15:06	openshift-ingress	kubelet	e2e-mt-14d0a8da-openshift-default-6d7df4b87-ckh8q	Killing	Stopping container istio-proxy
18:16:13	openshift-ingress	multus	e2e-inf-a-205c4c-openshift-default-5bc6d775d7-5rgbh	AddedInterface	Add eth0 [10.134.0.34/23] from ovn-kubernetes
18:16:13	openshift-ingress	deployment-controller	e2e-inf-a-205c4c-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-inf-a-205c4c-openshift-default-5bc6d775d7 from 0 to 1
18:16:13	openshift-ingress	gateway_labeler_controller	e2e-inf-a-205c4c	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-205c4c
18:16:13	openshift-ingress	replicaset-controller	e2e-inf-a-205c4c-openshift-default-5bc6d775d7	SuccessfulCreate	Created pod: e2e-inf-a-205c4c-openshift-default-5bc6d775d7-5rgbh
18:16:21	openshift-ingress	multus	e2e-inf-b-c34ce0-openshift-default-789cd44c7f-pfxh6	AddedInterface	Add eth0 [10.134.0.35/23] from ovn-kubernetes
18:16:21	openshift-ingress	replicaset-controller	e2e-inf-b-c34ce0-openshift-default-789cd44c7f	SuccessfulCreate	Created pod: e2e-inf-b-c34ce0-openshift-default-789cd44c7f-pfxh6
18:16:21	openshift-ingress	deployment-controller	e2e-inf-b-c34ce0-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-inf-b-c34ce0-openshift-default-789cd44c7f from 0 to 1
18:16:21	openshift-ingress	gateway_labeler_controller	e2e-inf-b-c34ce0	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-c34ce0
18:16:31	openshift-ingress	kubelet	e2e-inf-a-205c4c-openshift-default-5bc6d775d7-5rgbh	ProbeError	Readiness probe error: Get "http://10.134.0.34:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
18:16:31	openshift-ingress	kubelet	e2e-inf-a-205c4c-openshift-default-5bc6d775d7-5rgbh	Unhealthy	Readiness probe failed: Get "http://10.134.0.34:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
18:16:32 (x2)	openshift-ingress	kubelet	e2e-inf-a-205c4c-openshift-default-5bc6d775d7-5rgbh	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine
18:16:32 (x2)	openshift-ingress	kubelet	e2e-inf-a-205c4c-openshift-default-5bc6d775d7-5rgbh	Created	Created container: istio-proxy
18:16:32 (x2)	openshift-ingress	kubelet	e2e-inf-a-205c4c-openshift-default-5bc6d775d7-5rgbh	Started	Started container istio-proxy
18:16:36 (x3)	openshift-ingress	kubelet	e2e-inf-a-205c4c-openshift-default-5bc6d775d7-5rgbh	Unhealthy	Startup probe failed: Get "http://10.134.0.34:15021/healthz/ready": dial tcp 10.134.0.34:15021: connect: connection refused
18:16:36 (x3)	openshift-ingress	kubelet	e2e-inf-a-205c4c-openshift-default-5bc6d775d7-5rgbh	ProbeError	Startup probe error: Get "http://10.134.0.34:15021/healthz/ready": dial tcp 10.134.0.34:15021: connect: connection refused body:
18:16:38	openshift-ingress	kubelet	e2e-inf-b-c34ce0-openshift-default-789cd44c7f-pfxh6	ProbeError	Readiness probe error: Get "http://10.134.0.35:15021/healthz/ready": read tcp 10.134.0.2:60664->10.134.0.35:15021: read: connection reset by peer body:
18:16:38	openshift-ingress	kubelet	e2e-inf-b-c34ce0-openshift-default-789cd44c7f-pfxh6	Unhealthy	Readiness probe failed: Get "http://10.134.0.35:15021/healthz/ready": read tcp 10.134.0.2:60664->10.134.0.35:15021: read: connection reset by peer
18:16:39 (x2)	openshift-ingress	kubelet	e2e-inf-b-c34ce0-openshift-default-789cd44c7f-pfxh6	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine
18:16:39 (x2)	openshift-ingress	kubelet	e2e-inf-b-c34ce0-openshift-default-789cd44c7f-pfxh6	Started	Started container istio-proxy
18:16:39 (x2)	openshift-ingress	kubelet	e2e-inf-b-c34ce0-openshift-default-789cd44c7f-pfxh6	Created	Created container: istio-proxy
18:16:43 (x4)	openshift-ingress	kubelet	e2e-inf-b-c34ce0-openshift-default-789cd44c7f-pfxh6	Unhealthy	Startup probe failed: Get "http://10.134.0.35:15021/healthz/ready": dial tcp 10.134.0.35:15021: connect: connection refused
18:16:43 (x4)	openshift-ingress	kubelet	e2e-inf-b-c34ce0-openshift-default-789cd44c7f-pfxh6	ProbeError	Startup probe error: Get "http://10.134.0.35:15021/healthz/ready": dial tcp 10.134.0.35:15021: connect: connection refused body:
18:18:06	openshift-ingress	kubelet	e2e-inf-a-205c4c-openshift-default-5bc6d775d7-5rgbh	Killing	Stopping container istio-proxy
18:18:07	openshift-ingress	kubelet	e2e-inf-a-205c4c-openshift-default-5bc6d775d7-5rgbh	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
18:18:07	openshift-ingress	kubelet	e2e-inf-a-205c4c-openshift-default-5bc6d775d7-5rgbh	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
18:18:12	openshift-ingress	kubelet	e2e-inf-b-c34ce0-openshift-default-789cd44c7f-pfxh6	Killing	Stopping container istio-proxy
18:18:13	openshift-ingress	gateway_labeler_controller	e2e-api-a-aa698f	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-aa698f
18:18:13	openshift-ingress	deployment-controller	e2e-api-a-aa698f-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-api-a-aa698f-openshift-default-577757df4f from 0 to 1
18:18:13	openshift-ingress	replicaset-controller	e2e-api-a-aa698f-openshift-default-577757df4f	SuccessfulCreate	Created pod: e2e-api-a-aa698f-openshift-default-577757df4f-t7x4s
18:18:14	openshift-ingress	kubelet	e2e-inf-b-c34ce0-openshift-default-789cd44c7f-pfxh6	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
18:18:14	openshift-ingress	multus	e2e-api-a-aa698f-openshift-default-577757df4f-t7x4s	AddedInterface	Add eth0 [10.134.0.36/23] from ovn-kubernetes
18:18:14	openshift-ingress	kubelet	e2e-inf-b-c34ce0-openshift-default-789cd44c7f-pfxh6	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
18:18:22	openshift-ingress	multus	e2e-api-b-77c307-openshift-default-6866dc8d7f-7b5l5	AddedInterface	Add eth0 [10.134.0.37/23] from ovn-kubernetes
18:18:22	openshift-ingress	deployment-controller	e2e-api-b-77c307-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-api-b-77c307-openshift-default-6866dc8d7f from 0 to 1
18:18:22	openshift-ingress	replicaset-controller	e2e-api-b-77c307-openshift-default-6866dc8d7f	SuccessfulCreate	Created pod: e2e-api-b-77c307-openshift-default-6866dc8d7f-7b5l5
18:18:22	openshift-ingress	gateway_labeler_controller	e2e-api-b-77c307	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-77c307
18:18:32	openshift-ingress	kubelet	e2e-api-a-aa698f-openshift-default-577757df4f-t7x4s	ProbeError	Readiness probe error: Get "http://10.134.0.36:15021/healthz/ready": read tcp 10.134.0.2:40006->10.134.0.36:15021: read: connection reset by peer body:
18:18:32 (x2)	openshift-ingress	kubelet	e2e-api-a-aa698f-openshift-default-577757df4f-t7x4s	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine
18:18:32	openshift-ingress	kubelet	e2e-api-a-aa698f-openshift-default-577757df4f-t7x4s	Unhealthy	Readiness probe failed: Get "http://10.134.0.36:15021/healthz/ready": read tcp 10.134.0.2:40006->10.134.0.36:15021: read: connection reset by peer
18:18:32 (x2)	openshift-ingress	kubelet	e2e-api-a-aa698f-openshift-default-577757df4f-t7x4s	Created	Created container: istio-proxy
18:18:32 (x2)	openshift-ingress	kubelet	e2e-api-a-aa698f-openshift-default-577757df4f-t7x4s	Started	Started container istio-proxy
18:18:35 (x3)	openshift-ingress	kubelet	e2e-api-a-aa698f-openshift-default-577757df4f-t7x4s	ProbeError	Startup probe error: Get "http://10.134.0.36:15021/healthz/ready": dial tcp 10.134.0.36:15021: connect: connection refused body:
18:18:35 (x3)	openshift-ingress	kubelet	e2e-api-a-aa698f-openshift-default-577757df4f-t7x4s	Unhealthy	Startup probe failed: Get "http://10.134.0.36:15021/healthz/ready": dial tcp 10.134.0.36:15021: connect: connection refused
18:18:40	openshift-ingress	kubelet	e2e-api-b-77c307-openshift-default-6866dc8d7f-7b5l5	Unhealthy	Readiness probe failed: Get "http://10.134.0.37:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
18:18:40	openshift-ingress	kubelet	e2e-api-b-77c307-openshift-default-6866dc8d7f-7b5l5	ProbeError	Readiness probe error: Get "http://10.134.0.37:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
18:18:41 (x2)	openshift-ingress	kubelet	e2e-api-b-77c307-openshift-default-6866dc8d7f-7b5l5	Started	Started container istio-proxy
18:18:41 (x2)	openshift-ingress	kubelet	e2e-api-b-77c307-openshift-default-6866dc8d7f-7b5l5	Created	Created container: istio-proxy
18:18:41 (x2)	openshift-ingress	kubelet	e2e-api-b-77c307-openshift-default-6866dc8d7f-7b5l5	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine
18:18:43	openshift-ingress	kubelet	e2e-api-a-aa698f-openshift-default-577757df4f-t7x4s	Killing	Stopping container istio-proxy
18:18:45 (x4)	openshift-ingress	kubelet	e2e-api-b-77c307-openshift-default-6866dc8d7f-7b5l5	ProbeError	Startup probe error: Get "http://10.134.0.37:15021/healthz/ready": dial tcp 10.134.0.37:15021: connect: connection refused body:
18:18:45 (x4)	openshift-ingress	kubelet	e2e-api-b-77c307-openshift-default-6866dc8d7f-7b5l5	Unhealthy	Startup probe failed: Get "http://10.134.0.37:15021/healthz/ready": dial tcp 10.134.0.37:15021: connect: connection refused
18:18:50	openshift-ingress	kubelet	e2e-api-b-77c307-openshift-default-6866dc8d7f-7b5l5	Killing	Stopping container istio-proxy
18:18:51	openshift-ingress	deployment-controller	e2e-shared-a-91cb9f-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-shared-a-91cb9f-openshift-default-7c8b85779f from 0 to 1
18:18:51	openshift-ingress	multus	e2e-shared-a-91cb9f-openshift-default-7c8b85779f-9k7jd	AddedInterface	Add eth0 [10.134.0.38/23] from ovn-kubernetes
18:18:51	openshift-ingress	replicaset-controller	e2e-shared-a-91cb9f-openshift-default-7c8b85779f	SuccessfulCreate	Created pod: e2e-shared-a-91cb9f-openshift-default-7c8b85779f-9k7jd
18:18:51	openshift-ingress	gateway_labeler_controller	e2e-shared-a-91cb9f	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-91cb9f
18:18:59	openshift-ingress	multus	e2e-shared-b-2861c1-openshift-default-67d8fcbc-lbv5v	AddedInterface	Add eth0 [10.134.0.39/23] from ovn-kubernetes
18:18:59	openshift-ingress	deployment-controller	e2e-shared-b-2861c1-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-shared-b-2861c1-openshift-default-67d8fcbc from 0 to 1
18:18:59	openshift-ingress	gateway_labeler_controller	e2e-shared-b-2861c1	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-2861c1
18:18:59	openshift-ingress	replicaset-controller	e2e-shared-b-2861c1-openshift-default-67d8fcbc	SuccessfulCreate	Created pod: e2e-shared-b-2861c1-openshift-default-67d8fcbc-lbv5v
18:19:09	openshift-ingress	kubelet	e2e-shared-a-91cb9f-openshift-default-7c8b85779f-9k7jd	Unhealthy	Readiness probe failed: Get "http://10.134.0.38:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
18:19:09	openshift-ingress	kubelet	e2e-shared-a-91cb9f-openshift-default-7c8b85779f-9k7jd	ProbeError	Readiness probe error: Get "http://10.134.0.38:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
18:19:10 (x2)	openshift-ingress	kubelet	e2e-shared-a-91cb9f-openshift-default-7c8b85779f-9k7jd	Started	Started container istio-proxy
18:19:10 (x2)	openshift-ingress	kubelet	e2e-shared-a-91cb9f-openshift-default-7c8b85779f-9k7jd	Created	Created container: istio-proxy
18:19:10 (x2)	openshift-ingress	kubelet	e2e-shared-a-91cb9f-openshift-default-7c8b85779f-9k7jd	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine
18:19:14 (x4)	openshift-ingress	kubelet	e2e-shared-a-91cb9f-openshift-default-7c8b85779f-9k7jd	Unhealthy	Startup probe failed: Get "http://10.134.0.38:15021/healthz/ready": dial tcp 10.134.0.38:15021: connect: connection refused
18:19:14 (x4)	openshift-ingress	kubelet	e2e-shared-a-91cb9f-openshift-default-7c8b85779f-9k7jd	ProbeError	Startup probe error: Get "http://10.134.0.38:15021/healthz/ready": dial tcp 10.134.0.38:15021: connect: connection refused body:
18:19:16	openshift-ingress	kubelet	e2e-shared-b-2861c1-openshift-default-67d8fcbc-lbv5v	ProbeError	Readiness probe error: Get "http://10.134.0.39:15021/healthz/ready": read tcp 10.134.0.2:41136->10.134.0.39:15021: read: connection reset by peer body:
18:19:16	openshift-ingress	kubelet	e2e-shared-b-2861c1-openshift-default-67d8fcbc-lbv5v	Unhealthy	Readiness probe failed: Get "http://10.134.0.39:15021/healthz/ready": read tcp 10.134.0.2:41136->10.134.0.39:15021: read: connection reset by peer
18:19:17 (x2)	openshift-ingress	kubelet	e2e-shared-b-2861c1-openshift-default-67d8fcbc-lbv5v	Started	Started container istio-proxy
18:19:17 (x2)	openshift-ingress	kubelet	e2e-shared-b-2861c1-openshift-default-67d8fcbc-lbv5v	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine
18:19:17 (x2)	openshift-ingress	kubelet	e2e-shared-b-2861c1-openshift-default-67d8fcbc-lbv5v	Created	Created container: istio-proxy
18:19:22 (x5)	openshift-ingress	kubelet	e2e-shared-b-2861c1-openshift-default-67d8fcbc-lbv5v	ProbeError	Startup probe error: Get "http://10.134.0.39:15021/healthz/ready": dial tcp 10.134.0.39:15021: connect: connection refused body:
18:19:22 (x5)	openshift-ingress	kubelet	e2e-shared-b-2861c1-openshift-default-67d8fcbc-lbv5v	Unhealthy	Startup probe failed: Get "http://10.134.0.39:15021/healthz/ready": dial tcp 10.134.0.39:15021: connect: connection refused
18:25:01	openshift-ingress	kubelet	e2e-shared-a-91cb9f-openshift-default-7c8b85779f-9k7jd	Killing	Stopping container istio-proxy
18:25:07	openshift-ingress	kubelet	e2e-shared-b-2861c1-openshift-default-67d8fcbc-lbv5v	Killing	Stopping container istio-proxy
18:25:08	openshift-ingress	kubelet	e2e-shared-b-2861c1-openshift-default-67d8fcbc-lbv5v	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
18:25:08	openshift-ingress	kubelet	e2e-shared-b-2861c1-openshift-default-67d8fcbc-lbv5v	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body: