Events

Time	Namespace	Component	RelatedObject	Reason	Message
15:23:47	openshift-ingress		router-default-6f55fdf65b-nwzqz	FailedScheduling	0/1 nodes are available: 1 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.
15:24:09	openshift-ingress		router-default-6f55fdf65b-nwzqz	Scheduled	Successfully assigned openshift-ingress/router-default-6f55fdf65b-nwzqz to ip-10-0-137-93.ec2.internal
15:59:35	openshift-ingress		e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth	Scheduled	Successfully assigned openshift-ingress/e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth to ip-10-0-137-93.ec2.internal
15:59:42	openshift-ingress		e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2	Scheduled	Successfully assigned openshift-ingress/e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2 to ip-10-0-139-109.ec2.internal
16:03:01	openshift-ingress		e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm	Scheduled	Successfully assigned openshift-ingress/e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm to ip-10-0-139-109.ec2.internal
15:32:53	openshift-ingress		payload-pre-processing-74584bb9f8-v44pf	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-74584bb9f8-v44pf to ip-10-0-137-93.ec2.internal
15:28:53	openshift-ingress		kube-auth-proxy-6f57b96f59-q68cf	Scheduled	Successfully assigned openshift-ingress/kube-auth-proxy-6f57b96f59-q68cf to ip-10-0-140-255.ec2.internal
15:32:53	openshift-ingress		payload-processing-f9b8d9b9b-vgnll	Scheduled	Successfully assigned openshift-ingress/payload-processing-f9b8d9b9b-vgnll to ip-10-0-137-93.ec2.internal
15:49:36	openshift-ingress		e2e-ait-70631383-openshift-default-674fdf57f7-67bd8	Scheduled	Successfully assigned openshift-ingress/e2e-ait-70631383-openshift-default-674fdf57f7-67bd8 to ip-10-0-137-93.ec2.internal
15:28:54	openshift-ingress		istiod-openshift-gateway-7574459656-4z8rn	Scheduled	Successfully assigned openshift-ingress/istiod-openshift-gateway-7574459656-4z8rn to ip-10-0-140-255.ec2.internal
16:09:10	openshift-ingress		test-curl-7712-139938564456496	Scheduled	Successfully assigned openshift-ingress/test-curl-7712-139938564456496 to ip-10-0-140-255.ec2.internal
15:50:08	openshift-ingress		e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h	Scheduled	Successfully assigned openshift-ingress/e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h to ip-10-0-139-109.ec2.internal
15:52:43	openshift-ingress		e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96	Scheduled	Successfully assigned openshift-ingress/e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96 to ip-10-0-137-93.ec2.internal
15:56:42	openshift-ingress		e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9	Scheduled	Successfully assigned openshift-ingress/e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9 to ip-10-0-137-93.ec2.internal
16:02:53	openshift-ingress		e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm	Scheduled	Successfully assigned openshift-ingress/e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm to ip-10-0-137-93.ec2.internal
15:28:53	openshift-ingress		kube-auth-proxy-6f57b96f59-fqcqz	Scheduled	Successfully assigned openshift-ingress/kube-auth-proxy-6f57b96f59-fqcqz to ip-10-0-139-109.ec2.internal
15:29:00	openshift-ingress		data-science-gateway-data-science-gateway-class-6576859cf4xg5v4	Scheduled	Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xg5v4 to ip-10-0-139-109.ec2.internal
16:09:03	openshift-ingress		test-curl-7712-139938564999600	Scheduled	Successfully assigned openshift-ingress/test-curl-7712-139938564999600 to ip-10-0-137-93.ec2.internal
15:31:21	openshift-ingress		maas-default-gateway-openshift-default-56654dcf7-b5pfm	Scheduled	Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b5pfm to ip-10-0-137-93.ec2.internal
16:01:37	openshift-ingress		e2e-api-a-714794-openshift-default-5c66995599-9m75s	Scheduled	Successfully assigned openshift-ingress/e2e-api-a-714794-openshift-default-5c66995599-9m75s to ip-10-0-137-93.ec2.internal
16:09:00	openshift-ingress		test-curl-7712-139938562132784	Scheduled	Successfully assigned openshift-ingress/test-curl-7712-139938562132784 to ip-10-0-137-93.ec2.internal
15:29:01	openshift-ingress		istiod-openshift-gateway-94bb8fbfd-hmv2f	Scheduled	Successfully assigned openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hmv2f to ip-10-0-139-109.ec2.internal
16:01:45	openshift-ingress		e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw	Scheduled	Successfully assigned openshift-ingress/e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw to ip-10-0-139-109.ec2.internal
16:09:13	openshift-ingress		test-curl-7712-139938564457504	Scheduled	Successfully assigned openshift-ingress/test-curl-7712-139938564457504 to ip-10-0-137-93.ec2.internal
16:09:15	openshift-ingress		test-curl-7712-139938564457504	Scheduled	Successfully assigned openshift-ingress/test-curl-7712-139938564457504 to ip-10-0-140-255.ec2.internal
15:51:21	openshift-ingress		e2e-ait-f762c5e1-openshift-default-6676979c8f-6jjrv	Scheduled	Successfully assigned openshift-ingress/e2e-ait-f762c5e1-openshift-default-6676979c8f-6jjrv to ip-10-0-137-93.ec2.internal
16:09:06	openshift-ingress		test-curl-7712-139938564456496	Scheduled	Successfully assigned openshift-ingress/test-curl-7712-139938564456496 to ip-10-0-140-255.ec2.internal
15:55:41	openshift-ingress		e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl	Scheduled	Successfully assigned openshift-ingress/e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl to ip-10-0-137-93.ec2.internal
15:17:51	openshift-ingress	deployment-controller	router-default	ScalingReplicaSet	Scaled up replica set router-default-6f55fdf65b from 0 to 1
15:17:57 (x11)	openshift-ingress	replicaset-controller	router-default-6f55fdf65b	FailedCreate	Error creating: pods "router-default-6f55fdf65b-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
15:18:41	openshift-ingress	service-controller	router-default	UnAvailableLoadBalancer	There are no available nodes for LoadBalancer
15:18:41	openshift-ingress	service-controller	router-default	EnsuringLoadBalancer	Ensuring load balancer
15:18:45	openshift-ingress	service-controller	router-default	EnsuredLoadBalancer	Ensured load balancer
15:21:03 (x16)	openshift-ingress	replicaset-controller	router-default-6f55fdf65b	FailedCreate	Error creating: pods "router-default-6f55fdf65b-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
15:23:46	openshift-ingress	replicaset-controller	router-default-6f55fdf65b	SuccessfulCreate	Created pod: router-default-6f55fdf65b-nwzqz
15:24:08 (x3)	openshift-ingress	service-controller	router-default	UpdatedLoadBalancer	Updated load balancer with new hosts
15:24:24 (x6)	openshift-ingress	kubelet	router-default-6f55fdf65b-nwzqz	FailedMount	MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
15:24:24 (x6)	openshift-ingress	kubelet	router-default-6f55fdf65b-nwzqz	FailedMount	MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
15:24:41	openshift-ingress	kubelet	router-default-6f55fdf65b-nwzqz	Started	Started container router
15:24:41	openshift-ingress	kubelet	router-default-6f55fdf65b-nwzqz	Created	Created container: router
15:24:41	openshift-ingress	kubelet	router-default-6f55fdf65b-nwzqz	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0595b1d6de8e08ddb61ce581075357331193db6206d341c15cf213514ef0f693" already present on machine
15:24:41	openshift-ingress	multus	router-default-6f55fdf65b-nwzqz	AddedInterface	Add eth0 [10.132.0.11/23] from ovn-kubernetes
15:28:53	openshift-ingress	kubelet	kube-auth-proxy-6f57b96f59-fqcqz	Pulling	Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"
15:28:53	openshift-ingress	multus	kube-auth-proxy-6f57b96f59-q68cf	AddedInterface	Add eth0 [10.133.0.25/23] from ovn-kubernetes
15:28:53	openshift-ingress	deployment-controller	kube-auth-proxy	ScalingReplicaSet	Scaled up replica set kube-auth-proxy-6f57b96f59 from 0 to 2
15:28:53	openshift-ingress	replicaset-controller	kube-auth-proxy-6f57b96f59	SuccessfulCreate	Created pod: kube-auth-proxy-6f57b96f59-fqcqz
15:28:53	openshift-ingress	replicaset-controller	kube-auth-proxy-6f57b96f59	SuccessfulCreate	Created pod: kube-auth-proxy-6f57b96f59-q68cf
15:28:53	openshift-ingress	multus	kube-auth-proxy-6f57b96f59-fqcqz	AddedInterface	Add eth0 [10.134.0.21/23] from ovn-kubernetes
15:28:53 (x5)	openshift-ingress	replicaset-controller	kube-auth-proxy-6f57b96f59	FailedCreate	Error creating: pods "kube-auth-proxy-6f57b96f59-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found
15:28:53	openshift-ingress	kubelet	kube-auth-proxy-6f57b96f59-q68cf	Pulling	Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"
15:28:54	openshift-ingress	replicaset-controller	istiod-openshift-gateway-7574459656	SuccessfulCreate	Created pod: istiod-openshift-gateway-7574459656-4z8rn
15:28:54	openshift-ingress	deployment-controller	istiod-openshift-gateway	ScalingReplicaSet	Scaled up replica set istiod-openshift-gateway-7574459656 from 0 to 1
15:28:55	openshift-ingress	kubelet	istiod-openshift-gateway-7574459656-4z8rn	Pulling	Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:0850242436e88f7d82f0f2126de064c7e0f09844f31d8ff0f53dc8d3908075d9"
15:28:55	openshift-ingress	multus	istiod-openshift-gateway-7574459656-4z8rn	AddedInterface	Add eth0 [10.133.0.28/23] from ovn-kubernetes
15:28:57	openshift-ingress	kubelet	kube-auth-proxy-6f57b96f59-fqcqz	Pulled	Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 3.143s (3.143s including waiting). Image size: 265120132 bytes.
15:28:57	openshift-ingress	kubelet	kube-auth-proxy-6f57b96f59-fqcqz	Created	Created container: kube-auth-proxy
15:28:57	openshift-ingress	kubelet	kube-auth-proxy-6f57b96f59-fqcqz	Started	Started container kube-auth-proxy
15:28:59	openshift-ingress	kubelet	kube-auth-proxy-6f57b96f59-q68cf	Created	Created container: kube-auth-proxy
15:28:59	openshift-ingress	kubelet	istiod-openshift-gateway-7574459656-4z8rn	Started	Started container discovery
15:28:59	openshift-ingress	kubelet	kube-auth-proxy-6f57b96f59-q68cf	Started	Started container kube-auth-proxy
15:28:59	openshift-ingress	kubelet	istiod-openshift-gateway-7574459656-4z8rn	Pulled	Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:0850242436e88f7d82f0f2126de064c7e0f09844f31d8ff0f53dc8d3908075d9" in 4.326s (4.326s including waiting). Image size: 181034515 bytes.
15:28:59	openshift-ingress	kubelet	istiod-openshift-gateway-7574459656-4z8rn	Created	Created container: discovery
15:28:59	openshift-ingress	kubelet	kube-auth-proxy-6f57b96f59-q68cf	Pulled	Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 5.871s (5.871s including waiting). Image size: 265120132 bytes.
15:29:00	openshift-ingress	replicaset-controller	data-science-gateway-data-science-gateway-class-6576859cf4	SuccessfulCreate	Created pod: data-science-gateway-data-science-gateway-class-6576859cf4xg5v4
15:29:00	openshift-ingress	kubelet	istiod-openshift-gateway-7574459656-4z8rn	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
15:29:00	openshift-ingress	kubelet	istiod-openshift-gateway-7574459656-4z8rn	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
15:29:00	openshift-ingress	deployment-controller	data-science-gateway-data-science-gateway-class	ScalingReplicaSet	Scaled up replica set data-science-gateway-data-science-gateway-class-6576859cf4 from 0 to 1
15:29:01	openshift-ingress	replicaset-controller	istiod-openshift-gateway-94bb8fbfd	SuccessfulCreate	Created pod: istiod-openshift-gateway-94bb8fbfd-hmv2f
15:29:01	openshift-ingress	multus	data-science-gateway-data-science-gateway-class-6576859cf4xg5v4	AddedInterface	Add eth0 [10.134.0.22/23] from ovn-kubernetes
15:29:01	openshift-ingress	kubelet	data-science-gateway-data-science-gateway-class-6576859cf4xg5v4	Pulling	Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8"
15:29:01	openshift-ingress	deployment-controller	istiod-openshift-gateway	ScalingReplicaSet	Scaled up replica set istiod-openshift-gateway-94bb8fbfd from 0 to 1
15:29:02	openshift-ingress	multus	istiod-openshift-gateway-94bb8fbfd-hmv2f	AddedInterface	Add eth0 [10.134.0.23/23] from ovn-kubernetes
15:29:02	openshift-ingress	kubelet	istiod-openshift-gateway-94bb8fbfd-hmv2f	Pulling	Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:0850242436e88f7d82f0f2126de064c7e0f09844f31d8ff0f53dc8d3908075d9"
15:29:04	openshift-ingress	kubelet	istiod-openshift-gateway-94bb8fbfd-hmv2f	Pulled	Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:0850242436e88f7d82f0f2126de064c7e0f09844f31d8ff0f53dc8d3908075d9" in 2.39s (2.39s including waiting). Image size: 181034515 bytes.
15:29:04	openshift-ingress	kubelet	istiod-openshift-gateway-94bb8fbfd-hmv2f	Created	Created container: discovery
15:29:04	openshift-ingress	kubelet	istiod-openshift-gateway-94bb8fbfd-hmv2f	Started	Started container discovery
15:29:05	openshift-ingress	kubelet	istiod-openshift-gateway-94bb8fbfd-hmv2f	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
15:29:05	openshift-ingress	kubelet	istiod-openshift-gateway-94bb8fbfd-hmv2f	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
15:29:06	openshift-ingress	kubelet	data-science-gateway-data-science-gateway-class-6576859cf4xg5v4	Pulled	Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" in 5.299s (5.299s including waiting). Image size: 181251556 bytes.
15:29:06	openshift-ingress	deployment-controller	istiod-openshift-gateway	ScalingReplicaSet	Scaled down replica set istiod-openshift-gateway-7574459656 from 1 to 0
15:29:06	openshift-ingress	kubelet	data-science-gateway-data-science-gateway-class-6576859cf4xg5v4	Created	Created container: istio-proxy
15:29:06	openshift-ingress	kubelet	data-science-gateway-data-science-gateway-class-6576859cf4xg5v4	Started	Started container istio-proxy
15:29:06	openshift-ingress	replicaset-controller	istiod-openshift-gateway-7574459656	SuccessfulDelete	Deleted pod: istiod-openshift-gateway-7574459656-4z8rn
15:29:06	openshift-ingress	kubelet	istiod-openshift-gateway-7574459656-4z8rn	Killing	Stopping container discovery
15:29:09	openshift-ingress	horizontal-pod-autoscaler	istiod-openshift-gateway	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
15:29:09	openshift-ingress	horizontal-pod-autoscaler	istiod-openshift-gateway	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
15:29:23 (x2)	openshift-ingress	horizontal-pod-autoscaler	kube-auth-proxy	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
15:29:23 (x2)	openshift-ingress	horizontal-pod-autoscaler	kube-auth-proxy	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
15:29:24	openshift-ingress	horizontal-pod-autoscaler	istiod-openshift-gateway	FailedGetResourceMetric	failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
15:29:24	openshift-ingress	horizontal-pod-autoscaler	istiod-openshift-gateway	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
15:29:38	openshift-ingress	horizontal-pod-autoscaler	kube-auth-proxy	FailedGetResourceMetric	failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
15:29:38	openshift-ingress	horizontal-pod-autoscaler	kube-auth-proxy	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
15:31:21	openshift-ingress	deployment-controller	maas-default-gateway-openshift-default	ScalingReplicaSet	Scaled up replica set maas-default-gateway-openshift-default-56654dcf7 from 0 to 1
15:31:21	openshift-ingress	replicaset-controller	maas-default-gateway-openshift-default-56654dcf7	SuccessfulCreate	Created pod: maas-default-gateway-openshift-default-56654dcf7-b5pfm
15:31:21	openshift-ingress	gateway_labeler_controller	maas-default-gateway	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway
15:31:22	openshift-ingress	kubelet	maas-default-gateway-openshift-default-56654dcf7-b5pfm	Pulling	Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8"
15:31:22	openshift-ingress	multus	maas-default-gateway-openshift-default-56654dcf7-b5pfm	AddedInterface	Add eth0 [10.132.0.32/23] from ovn-kubernetes
15:31:25	openshift-ingress	kubelet	maas-default-gateway-openshift-default-56654dcf7-b5pfm	Pulled	Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" in 3.001s (3.001s including waiting). Image size: 181251556 bytes.
15:32:53 (x5)	openshift-ingress	replicaset-controller	payload-processing-f9b8d9b9b	FailedCreate	Error creating: pods "payload-processing-f9b8d9b9b-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found
15:32:53	openshift-ingress	deployment-controller	payload-processing	ScalingReplicaSet	Scaled up replica set payload-processing-f9b8d9b9b from 0 to 1
15:32:53	openshift-ingress	replicaset-controller	payload-processing-f9b8d9b9b	SuccessfulCreate	Created pod: payload-processing-f9b8d9b9b-vgnll
15:32:53 (x4)	openshift-ingress	replicaset-controller	payload-pre-processing-74584bb9f8	FailedCreate	Error creating: pods "payload-pre-processing-74584bb9f8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found
15:32:53	openshift-ingress	deployment-controller	payload-pre-processing	ScalingReplicaSet	Scaled up replica set payload-pre-processing-74584bb9f8 from 0 to 1
15:32:53	openshift-ingress	replicaset-controller	payload-pre-processing-74584bb9f8	SuccessfulCreate	Created pod: payload-pre-processing-74584bb9f8-v44pf
15:32:54	openshift-ingress	kubelet	payload-processing-f9b8d9b9b-vgnll	Pulling	Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:dc31b949d8c5ea8610b5c10ef53e2a199e00f0e0"
15:32:54	openshift-ingress	multus	payload-processing-f9b8d9b9b-vgnll	AddedInterface	Add eth0 [10.132.0.42/23] from ovn-kubernetes
15:32:54	openshift-ingress	multus	payload-pre-processing-74584bb9f8-v44pf	AddedInterface	Add eth0 [10.132.0.41/23] from ovn-kubernetes
15:32:54	openshift-ingress	kubelet	payload-pre-processing-74584bb9f8-v44pf	Pulling	Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:dc31b949d8c5ea8610b5c10ef53e2a199e00f0e0"
15:32:56	openshift-ingress	kubelet	payload-pre-processing-74584bb9f8-v44pf	Pulled	Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:dc31b949d8c5ea8610b5c10ef53e2a199e00f0e0" in 1.905s (1.905s including waiting). Image size: 165432098 bytes.
15:32:56	openshift-ingress	kubelet	payload-pre-processing-74584bb9f8-v44pf	Started	Started container payload-pre-processing
15:32:56	openshift-ingress	kubelet	payload-pre-processing-74584bb9f8-v44pf	Created	Created container: payload-pre-processing
15:32:56	openshift-ingress	kubelet	payload-processing-f9b8d9b9b-vgnll	Pulled	Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:dc31b949d8c5ea8610b5c10ef53e2a199e00f0e0" in 1.852s (1.852s including waiting). Image size: 165432098 bytes.
15:32:56	openshift-ingress	kubelet	payload-processing-f9b8d9b9b-vgnll	Started	Started container payload-processing
15:32:56	openshift-ingress	kubelet	payload-processing-f9b8d9b9b-vgnll	Created	Created container: payload-processing
15:33:01	openshift-ingress	kubelet	maas-default-gateway-openshift-default-56654dcf7-b5pfm	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine
15:33:02 (x2)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-56654dcf7-b5pfm	Started	Started container istio-proxy
15:33:02 (x2)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-56654dcf7-b5pfm	Created	Created container: istio-proxy
15:33:06 (x4)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-56654dcf7-b5pfm	Unhealthy	Startup probe failed: Get "http://10.132.0.32:15021/healthz/ready": dial tcp 10.132.0.32:15021: connect: connection refused
15:33:06 (x4)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-56654dcf7-b5pfm	ProbeError	Startup probe error: Get "http://10.132.0.32:15021/healthz/ready": dial tcp 10.132.0.32:15021: connect: connection refused body:
15:49:36	openshift-ingress	multus	e2e-ait-70631383-openshift-default-674fdf57f7-67bd8	AddedInterface	Add eth0 [10.132.0.47/23] from ovn-kubernetes
15:49:36	openshift-ingress	deployment-controller	e2e-ait-70631383-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-ait-70631383-openshift-default-674fdf57f7 from 0 to 1
15:49:36	openshift-ingress	gateway_labeler_controller	e2e-ait-70631383	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-ait-70631383
15:49:36	openshift-ingress	service-controller	e2e-ait-70631383-openshift-default	EnsuringLoadBalancer	Ensuring load balancer
15:49:36	openshift-ingress	replicaset-controller	e2e-ait-70631383-openshift-default-674fdf57f7	SuccessfulCreate	Created pod: e2e-ait-70631383-openshift-default-674fdf57f7-67bd8
15:49:40	openshift-ingress	service-controller	e2e-ait-70631383-openshift-default	EnsuredLoadBalancer	Ensured load balancer
15:49:49 (x2)	openshift-ingress	kubelet	e2e-ait-70631383-openshift-default-674fdf57f7-67bd8	Created	Created container: istio-proxy
15:49:49 (x2)	openshift-ingress	kubelet	e2e-ait-70631383-openshift-default-674fdf57f7-67bd8	Started	Started container istio-proxy
15:49:49 (x2)	openshift-ingress	kubelet	e2e-ait-70631383-openshift-default-674fdf57f7-67bd8	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine
15:49:53 (x3)	openshift-ingress	kubelet	e2e-ait-70631383-openshift-default-674fdf57f7-67bd8	ProbeError	Startup probe error: Get "http://10.132.0.47:15021/healthz/ready": dial tcp 10.132.0.47:15021: connect: connection refused body:
15:49:53 (x3)	openshift-ingress	kubelet	e2e-ait-70631383-openshift-default-674fdf57f7-67bd8	Unhealthy	Startup probe failed: Get "http://10.132.0.47:15021/healthz/ready": dial tcp 10.132.0.47:15021: connect: connection refused
15:50:08	openshift-ingress	deployment-controller	e2e-migrate-e90cca64-gw-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc from 0 to 1
15:50:08	openshift-ingress	replicaset-controller	e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc	SuccessfulCreate	Created pod: e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h
15:50:08	openshift-ingress	gateway_labeler_controller	e2e-migrate-e90cca64-gw	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-e90cca64-gw
15:50:08	openshift-ingress	kubelet	e2e-ait-70631383-openshift-default-674fdf57f7-67bd8	Killing	Stopping container istio-proxy
15:50:08	openshift-ingress	service-controller	e2e-ait-70631383-openshift-default	DeletingLoadBalancer	Deleting load balancer
15:50:09	openshift-ingress	kubelet	e2e-ait-70631383-openshift-default-674fdf57f7-67bd8	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
15:50:09	openshift-ingress	kubelet	e2e-ait-70631383-openshift-default-674fdf57f7-67bd8	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
15:50:09	openshift-ingress	multus	e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h	AddedInterface	Add eth0 [10.134.0.36/23] from ovn-kubernetes
15:50:14	openshift-ingress	service-controller	e2e-migrate-e90cca64-gw-openshift-default	EnsuringLoadBalancer	Ensuring load balancer
15:50:14	openshift-ingress	service-controller	e2e-ait-70631383-openshift-default	DeletedLoadBalancer	Deleted load balancer
15:50:17	openshift-ingress	service-controller	e2e-migrate-e90cca64-gw-openshift-default	EnsuredLoadBalancer	Ensured load balancer
15:50:26	openshift-ingress	kubelet	e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h	ProbeError	Readiness probe error: Get "http://10.134.0.36:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
15:50:26	openshift-ingress	kubelet	e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h	Unhealthy	Readiness probe failed: Get "http://10.134.0.36:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
15:50:27 (x2)	openshift-ingress	kubelet	e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine
15:50:27 (x2)	openshift-ingress	kubelet	e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h	Created	Created container: istio-proxy
15:50:27 (x2)	openshift-ingress	kubelet	e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h	Started	Started container istio-proxy
15:50:32 (x4)	openshift-ingress	kubelet	e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h	ProbeError	Startup probe error: Get "http://10.134.0.36:15021/healthz/ready": dial tcp 10.134.0.36:15021: connect: connection refused body:
15:50:32 (x4)	openshift-ingress	kubelet	e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h	Unhealthy	Startup probe failed: Get "http://10.134.0.36:15021/healthz/ready": dial tcp 10.134.0.36:15021: connect: connection refused
15:51:14	openshift-ingress	kubelet	e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h	Killing	Stopping container istio-proxy
15:51:14	openshift-ingress	service-controller	e2e-migrate-e90cca64-gw-openshift-default	DeletingLoadBalancer	Deleting load balancer
15:51:18	openshift-ingress	kubelet	e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
15:51:18	openshift-ingress	kubelet	e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
15:51:20	openshift-ingress	gateway_labeler_controller	e2e-ait-f762c5e1	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-ait-f762c5e1
15:51:21	openshift-ingress	service-controller	e2e-migrate-e90cca64-gw-openshift-default	DeletedLoadBalancer	Deleted load balancer
15:51:21	openshift-ingress	service-controller	e2e-ait-f762c5e1-openshift-default	EnsuringLoadBalancer	Ensuring load balancer
15:51:21	openshift-ingress	multus	e2e-ait-f762c5e1-openshift-default-6676979c8f-6jjrv	AddedInterface	Add eth0 [10.132.0.52/23] from ovn-kubernetes
15:51:21	openshift-ingress	replicaset-controller	e2e-ait-f762c5e1-openshift-default-6676979c8f	SuccessfulCreate	Created pod: e2e-ait-f762c5e1-openshift-default-6676979c8f-6jjrv
15:51:21	openshift-ingress	deployment-controller	e2e-ait-f762c5e1-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-ait-f762c5e1-openshift-default-6676979c8f from 0 to 1
15:51:24	openshift-ingress	service-controller	e2e-ait-f762c5e1-openshift-default	EnsuredLoadBalancer	Ensured load balancer
15:51:34 (x2)	openshift-ingress	kubelet	e2e-ait-f762c5e1-openshift-default-6676979c8f-6jjrv	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine
15:51:34 (x2)	openshift-ingress	kubelet	e2e-ait-f762c5e1-openshift-default-6676979c8f-6jjrv	Created	Created container: istio-proxy
15:51:34 (x2)	openshift-ingress	kubelet	e2e-ait-f762c5e1-openshift-default-6676979c8f-6jjrv	Started	Started container istio-proxy
15:51:38 (x4)	openshift-ingress	kubelet	e2e-ait-f762c5e1-openshift-default-6676979c8f-6jjrv	ProbeError	Startup probe error: Get "http://10.132.0.52:15021/healthz/ready": dial tcp 10.132.0.52:15021: connect: connection refused body:
15:51:38 (x4)	openshift-ingress	kubelet	e2e-ait-f762c5e1-openshift-default-6676979c8f-6jjrv	Unhealthy	Startup probe failed: Get "http://10.132.0.52:15021/healthz/ready": dial tcp 10.132.0.52:15021: connect: connection refused
15:52:43	openshift-ingress	deployment-controller	e2e-derive-d997b9d6-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-derive-d997b9d6-openshift-default-55db9598bc from 0 to 1
15:52:43	openshift-ingress	replicaset-controller	e2e-derive-d997b9d6-openshift-default-55db9598bc	SuccessfulCreate	Created pod: e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96
15:52:43	openshift-ingress	kubelet	e2e-ait-f762c5e1-openshift-default-6676979c8f-6jjrv	Killing	Stopping container istio-proxy
15:52:43	openshift-ingress	service-controller	e2e-ait-f762c5e1-openshift-default	DeletingLoadBalancer	Deleting load balancer
15:52:43	openshift-ingress	gateway_labeler_controller	e2e-derive-d997b9d6	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-derive-d997b9d6
15:52:44	openshift-ingress	multus	e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96	AddedInterface	Add eth0 [10.132.0.54/23] from ovn-kubernetes
15:52:50	openshift-ingress	service-controller	e2e-ait-f762c5e1-openshift-default	DeletedLoadBalancer	Deleted load balancer
15:52:50	openshift-ingress	service-controller	e2e-derive-d997b9d6-openshift-default	EnsuringLoadBalancer	Ensuring load balancer
15:52:53	openshift-ingress	service-controller	e2e-derive-d997b9d6-openshift-default	EnsuredLoadBalancer	Ensured load balancer
15:53:01 (x2)	openshift-ingress	kubelet	e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine
15:53:01	openshift-ingress	kubelet	e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96	Unhealthy	Readiness probe failed: Get "http://10.132.0.54:15021/healthz/ready": read tcp 10.132.0.2:39336->10.132.0.54:15021: read: connection reset by peer
15:53:01	openshift-ingress	kubelet	e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96	ProbeError	Readiness probe error: Get "http://10.132.0.54:15021/healthz/ready": read tcp 10.132.0.2:39336->10.132.0.54:15021: read: connection reset by peer body:
15:53:01 (x2)	openshift-ingress	kubelet	e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96	Started	Started container istio-proxy
15:53:01 (x2)	openshift-ingress	kubelet	e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96	Created	Created container: istio-proxy
15:53:06 (x4)	openshift-ingress	kubelet	e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96	ProbeError	Startup probe error: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused body:
15:53:06 (x4)	openshift-ingress	kubelet	e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96	Unhealthy	Startup probe failed: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused
15:54:04	openshift-ingress	kubelet	e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96	Killing	Stopping container istio-proxy
15:54:04	openshift-ingress	service-controller	e2e-derive-d997b9d6-openshift-default	DeletingLoadBalancer	Deleting load balancer
15:54:07	openshift-ingress	kubelet	e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
15:54:07	openshift-ingress	kubelet	e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
15:54:11	openshift-ingress	service-controller	e2e-derive-d997b9d6-openshift-default	DeletedLoadBalancer	Deleted load balancer
15:55:41	openshift-ingress	deployment-controller	e2e-mt-6270d141-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-mt-6270d141-openshift-default-6d49f8fd59 from 0 to 1
15:55:41	openshift-ingress	multus	e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl	AddedInterface	Add eth0 [10.132.0.56/23] from ovn-kubernetes
15:55:41	openshift-ingress	gateway_labeler_controller	e2e-mt-6270d141	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-mt-6270d141
15:55:41	openshift-ingress	replicaset-controller	e2e-mt-6270d141-openshift-default-6d49f8fd59	SuccessfulCreate	Created pod: e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl
15:55:58 (x2)	openshift-ingress	kubelet	e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine
15:55:58 (x2)	openshift-ingress	kubelet	e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl	Created	Created container: istio-proxy
15:55:58 (x2)	openshift-ingress	kubelet	e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl	Started	Started container istio-proxy
15:55:58	openshift-ingress	kubelet	e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl	ProbeError	Readiness probe error: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused body:
15:55:58	openshift-ingress	kubelet	e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl	Unhealthy	Readiness probe failed: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused
15:56:02 (x4)	openshift-ingress	kubelet	e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl	ProbeError	Startup probe error: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused body:
15:56:02 (x4)	openshift-ingress	kubelet	e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl	Unhealthy	Startup probe failed: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused
15:56:22	openshift-ingress	kubelet	e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl	Killing	Stopping container istio-proxy
15:56:42	openshift-ingress	multus	e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9	AddedInterface	Add eth0 [10.132.0.58/23] from ovn-kubernetes
15:56:42	openshift-ingress	gateway_labeler_controller	e2e-mt-5461ffdf	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-mt-5461ffdf
15:56:42	openshift-ingress	deployment-controller	e2e-mt-5461ffdf-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-mt-5461ffdf-openshift-default-68f5555b47 from 0 to 1
15:56:42	openshift-ingress	replicaset-controller	e2e-mt-5461ffdf-openshift-default-68f5555b47	SuccessfulCreate	Created pod: e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9
15:56:59	openshift-ingress	kubelet	e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9	Unhealthy	Readiness probe failed: Get "http://10.132.0.58:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
15:56:59	openshift-ingress	kubelet	e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9	ProbeError	Readiness probe error: Get "http://10.132.0.58:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
15:57:00 (x2)	openshift-ingress	kubelet	e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine
15:57:00 (x2)	openshift-ingress	kubelet	e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9	Created	Created container: istio-proxy
15:57:00 (x2)	openshift-ingress	kubelet	e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9	Started	Started container istio-proxy
15:57:05 (x4)	openshift-ingress	kubelet	e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9	Unhealthy	Startup probe failed: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused
15:57:05 (x4)	openshift-ingress	kubelet	e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9	ProbeError	Startup probe error: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused body:
15:58:39	openshift-ingress	kubelet	e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9	Killing	Stopping container istio-proxy
15:59:34	openshift-ingress	gateway_labeler_controller	e2e-inf-a-47280f	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-47280f
15:59:35	openshift-ingress	multus	e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth	AddedInterface	Add eth0 [10.132.0.60/23] from ovn-kubernetes
15:59:35	openshift-ingress	replicaset-controller	e2e-inf-a-47280f-openshift-default-64bb5f6c6c	SuccessfulCreate	Created pod: e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth
15:59:35	openshift-ingress	deployment-controller	e2e-inf-a-47280f-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-inf-a-47280f-openshift-default-64bb5f6c6c from 0 to 1
15:59:42	openshift-ingress	gateway_labeler_controller	e2e-inf-b-ef5b3f	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-ef5b3f
15:59:42	openshift-ingress	deployment-controller	e2e-inf-b-ef5b3f-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-inf-b-ef5b3f-openshift-default-f89b988f from 0 to 1
15:59:42	openshift-ingress	replicaset-controller	e2e-inf-b-ef5b3f-openshift-default-f89b988f	SuccessfulCreate	Created pod: e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2
15:59:43	openshift-ingress	multus	e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2	AddedInterface	Add eth0 [10.134.0.43/23] from ovn-kubernetes
15:59:52	openshift-ingress	kubelet	e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth	ProbeError	Readiness probe error: Get "http://10.132.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
15:59:52	openshift-ingress	kubelet	e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth	Unhealthy	Readiness probe failed: Get "http://10.132.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
15:59:53 (x2)	openshift-ingress	kubelet	e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth	Created	Created container: istio-proxy
15:59:53 (x2)	openshift-ingress	kubelet	e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine
15:59:53 (x2)	openshift-ingress	kubelet	e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth	Started	Started container istio-proxy
15:59:58 (x4)	openshift-ingress	kubelet	e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth	ProbeError	Startup probe error: Get "http://10.132.0.60:15021/healthz/ready": dial tcp 10.132.0.60:15021: connect: connection refused body:
15:59:58 (x4)	openshift-ingress	kubelet	e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth	Unhealthy	Startup probe failed: Get "http://10.132.0.60:15021/healthz/ready": dial tcp 10.132.0.60:15021: connect: connection refused
15:59:59 (x2)	openshift-ingress	kubelet	e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2	Started	Started container istio-proxy
15:59:59 (x2)	openshift-ingress	kubelet	e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine
15:59:59 (x2)	openshift-ingress	kubelet	e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2	Created	Created container: istio-proxy
15:59:59	openshift-ingress	kubelet	e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2	ProbeError	Readiness probe error: Get "http://10.134.0.43:15021/healthz/ready": dial tcp 10.134.0.43:15021: connect: connection refused body:
15:59:59	openshift-ingress	kubelet	e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2	Unhealthy	Readiness probe failed: Get "http://10.134.0.43:15021/healthz/ready": dial tcp 10.134.0.43:15021: connect: connection refused
16:00:04 (x4)	openshift-ingress	kubelet	e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2	Unhealthy	Startup probe failed: Get "http://10.134.0.43:15021/healthz/ready": dial tcp 10.134.0.43:15021: connect: connection refused
16:00:04 (x4)	openshift-ingress	kubelet	e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2	ProbeError	Startup probe error: Get "http://10.134.0.43:15021/healthz/ready": dial tcp 10.134.0.43:15021: connect: connection refused body:
16:01:10	openshift-ingress	kubelet	e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth	Killing	Stopping container istio-proxy
16:01:14	openshift-ingress	kubelet	e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
16:01:14	openshift-ingress	kubelet	e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
16:01:36	openshift-ingress	kubelet	e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2	Killing	Stopping container istio-proxy
16:01:37	openshift-ingress	deployment-controller	e2e-api-a-714794-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-api-a-714794-openshift-default-5c66995599 from 0 to 1
16:01:37	openshift-ingress	multus	e2e-api-a-714794-openshift-default-5c66995599-9m75s	AddedInterface	Add eth0 [10.132.0.63/23] from ovn-kubernetes
16:01:37	openshift-ingress	replicaset-controller	e2e-api-a-714794-openshift-default-5c66995599	SuccessfulCreate	Created pod: e2e-api-a-714794-openshift-default-5c66995599-9m75s
16:01:37	openshift-ingress	gateway_labeler_controller	e2e-api-a-714794	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-714794
16:01:45	openshift-ingress	deployment-controller	e2e-api-b-68976d-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-api-b-68976d-openshift-default-6d65cfdf7 from 0 to 1
16:01:45	openshift-ingress	replicaset-controller	e2e-api-b-68976d-openshift-default-6d65cfdf7	SuccessfulCreate	Created pod: e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw
16:01:45	openshift-ingress	multus	e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw	AddedInterface	Add eth0 [10.134.0.49/23] from ovn-kubernetes
16:01:45	openshift-ingress	gateway_labeler_controller	e2e-api-b-68976d	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-68976d
16:01:54	openshift-ingress	kubelet	e2e-api-a-714794-openshift-default-5c66995599-9m75s	Unhealthy	Readiness probe failed: Get "http://10.132.0.63:15021/healthz/ready": dial tcp 10.132.0.63:15021: connect: connection refused
16:01:54	openshift-ingress	kubelet	e2e-api-a-714794-openshift-default-5c66995599-9m75s	ProbeError	Readiness probe error: Get "http://10.132.0.63:15021/healthz/ready": dial tcp 10.132.0.63:15021: connect: connection refused body:
16:01:54 (x2)	openshift-ingress	kubelet	e2e-api-a-714794-openshift-default-5c66995599-9m75s	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine
16:01:54 (x2)	openshift-ingress	kubelet	e2e-api-a-714794-openshift-default-5c66995599-9m75s	Started	Started container istio-proxy
16:01:54 (x2)	openshift-ingress	kubelet	e2e-api-a-714794-openshift-default-5c66995599-9m75s	Created	Created container: istio-proxy
16:01:58 (x4)	openshift-ingress	kubelet	e2e-api-a-714794-openshift-default-5c66995599-9m75s	ProbeError	Startup probe error: Get "http://10.132.0.63:15021/healthz/ready": dial tcp 10.132.0.63:15021: connect: connection refused body:
16:01:58 (x4)	openshift-ingress	kubelet	e2e-api-a-714794-openshift-default-5c66995599-9m75s	Unhealthy	Startup probe failed: Get "http://10.132.0.63:15021/healthz/ready": dial tcp 10.132.0.63:15021: connect: connection refused
16:02:00 (x2)	openshift-ingress	kubelet	e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw	Created	Created container: istio-proxy
16:02:00 (x2)	openshift-ingress	kubelet	e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine
16:02:00 (x2)	openshift-ingress	kubelet	e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw	Started	Started container istio-proxy
16:02:04 (x5)	openshift-ingress	kubelet	e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw	ProbeError	Startup probe error: Get "http://10.134.0.49:15021/healthz/ready": dial tcp 10.134.0.49:15021: connect: connection refused body:
16:02:04 (x5)	openshift-ingress	kubelet	e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw	Unhealthy	Startup probe failed: Get "http://10.134.0.49:15021/healthz/ready": dial tcp 10.134.0.49:15021: connect: connection refused
16:02:26	openshift-ingress	kubelet	e2e-api-a-714794-openshift-default-5c66995599-9m75s	Killing	Stopping container istio-proxy
16:02:29	openshift-ingress	kubelet	e2e-api-a-714794-openshift-default-5c66995599-9m75s	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
16:02:29	openshift-ingress	kubelet	e2e-api-a-714794-openshift-default-5c66995599-9m75s	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
16:02:52	openshift-ingress	kubelet	e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw	Killing	Stopping container istio-proxy
16:02:53	openshift-ingress	gateway_labeler_controller	e2e-shared-a-a1c3e5	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-a1c3e5
16:02:53	openshift-ingress	deployment-controller	e2e-shared-a-a1c3e5-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-shared-a-a1c3e5-openshift-default-55d449ddc5 from 0 to 1
16:02:53	openshift-ingress	multus	e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm	AddedInterface	Add eth0 [10.132.0.66/23] from ovn-kubernetes
16:02:53	openshift-ingress	replicaset-controller	e2e-shared-a-a1c3e5-openshift-default-55d449ddc5	SuccessfulCreate	Created pod: e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm
16:03:01	openshift-ingress	replicaset-controller	e2e-shared-b-4293a7-openshift-default-95b59745f	SuccessfulCreate	Created pod: e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm
16:03:01	openshift-ingress	deployment-controller	e2e-shared-b-4293a7-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-shared-b-4293a7-openshift-default-95b59745f from 0 to 1
16:03:01	openshift-ingress	gateway_labeler_controller	e2e-shared-b-4293a7	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-4293a7
16:03:02	openshift-ingress	multus	e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm	AddedInterface	Add eth0 [10.134.0.52/23] from ovn-kubernetes
16:03:09 (x2)	openshift-ingress	kubelet	e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine
16:03:09 (x2)	openshift-ingress	kubelet	e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm	Started	Started container istio-proxy
16:03:09 (x2)	openshift-ingress	kubelet	e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm	Created	Created container: istio-proxy
16:03:14 (x4)	openshift-ingress	kubelet	e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm	Unhealthy	Startup probe failed: Get "http://10.132.0.66:15021/healthz/ready": dial tcp 10.132.0.66:15021: connect: connection refused
16:03:14 (x4)	openshift-ingress	kubelet	e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm	ProbeError	Startup probe error: Get "http://10.132.0.66:15021/healthz/ready": dial tcp 10.132.0.66:15021: connect: connection refused body:
16:03:19	openshift-ingress	kubelet	e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm	Unhealthy	Readiness probe failed: Get "http://10.134.0.52:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
16:03:19	openshift-ingress	kubelet	e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm	ProbeError	Readiness probe error: Get "http://10.134.0.52:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
16:03:20 (x2)	openshift-ingress	kubelet	e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine
16:03:20 (x2)	openshift-ingress	kubelet	e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm	Created	Created container: istio-proxy
16:03:20 (x2)	openshift-ingress	kubelet	e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm	Started	Started container istio-proxy
16:03:25 (x4)	openshift-ingress	kubelet	e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm	ProbeError	Startup probe error: Get "http://10.134.0.52:15021/healthz/ready": dial tcp 10.134.0.52:15021: connect: connection refused body:
16:03:25 (x4)	openshift-ingress	kubelet	e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm	Unhealthy	Startup probe failed: Get "http://10.134.0.52:15021/healthz/ready": dial tcp 10.134.0.52:15021: connect: connection refused
16:09:01	openshift-ingress	kubelet	test-curl-7712-139938562132784	Started	Started container test-curl-7712-139938562132784
16:09:01	openshift-ingress	multus	test-curl-7712-139938562132784	AddedInterface	Add eth0 [10.132.0.69/23] from ovn-kubernetes
16:09:01	openshift-ingress	kubelet	test-curl-7712-139938562132784	Pulling	Pulling image "curlimages/curl:latest"
16:09:01	openshift-ingress	kubelet	test-curl-7712-139938562132784	Pulled	Successfully pulled image "curlimages/curl:latest" in 721ms (721ms including waiting). Image size: 24157632 bytes.
16:09:01	openshift-ingress	kubelet	test-curl-7712-139938562132784	Created	Created container: test-curl-7712-139938562132784
16:09:04	openshift-ingress	kubelet	test-curl-7712-139938564999600	Started	Started container test-curl-7712-139938564999600
16:09:04	openshift-ingress	kubelet	test-curl-7712-139938564999600	Pulling	Pulling image "curlimages/curl:latest"
16:09:04	openshift-ingress	kubelet	test-curl-7712-139938564999600	Pulled	Successfully pulled image "curlimages/curl:latest" in 298ms (298ms including waiting). Image size: 24157632 bytes.
16:09:04	openshift-ingress	multus	test-curl-7712-139938564999600	AddedInterface	Add eth0 [10.132.0.70/23] from ovn-kubernetes
16:09:04	openshift-ingress	kubelet	test-curl-7712-139938564999600	Created	Created container: test-curl-7712-139938564999600
16:09:07	openshift-ingress	multus	test-curl-7712-139938564456496	AddedInterface	Add eth0 [10.133.0.51/23] from ovn-kubernetes
16:09:07	openshift-ingress	kubelet	test-curl-7712-139938564456496	Pulling	Pulling image "curlimages/curl:latest"
16:09:08	openshift-ingress	kubelet	test-curl-7712-139938564456496	Pulled	Successfully pulled image "curlimages/curl:latest" in 696ms (696ms including waiting). Image size: 24157632 bytes.
16:09:08	openshift-ingress	kubelet	test-curl-7712-139938564456496	Started	Started container test-curl-7712-139938564456496
16:09:08	openshift-ingress	kubelet	test-curl-7712-139938564456496	Created	Created container: test-curl-7712-139938564456496
16:09:10	openshift-ingress	multus	test-curl-7712-139938564456496	AddedInterface	Add eth0 [10.133.0.52/23] from ovn-kubernetes
16:09:10	openshift-ingress	kubelet	test-curl-7712-139938564456496	Pulling	Pulling image "curlimages/curl:latest"
16:09:11	openshift-ingress	kubelet	test-curl-7712-139938564456496	Pulled	Successfully pulled image "curlimages/curl:latest" in 315ms (315ms including waiting). Image size: 24157632 bytes.
16:09:11	openshift-ingress	kubelet	test-curl-7712-139938564456496	Created	Created container: test-curl-7712-139938564456496
16:09:11	openshift-ingress	kubelet	test-curl-7712-139938564456496	Started	Started container test-curl-7712-139938564456496
16:09:13	openshift-ingress	multus	test-curl-7712-139938564457504	AddedInterface	Add eth0 [10.132.0.71/23] from ovn-kubernetes
16:09:13	openshift-ingress	kubelet	test-curl-7712-139938564457504	Pulling	Pulling image "curlimages/curl:latest"
16:09:14	openshift-ingress	kubelet	test-curl-7712-139938564457504	Started	Started container test-curl-7712-139938564457504
16:09:14	openshift-ingress	kubelet	test-curl-7712-139938564457504	Created	Created container: test-curl-7712-139938564457504
16:09:14	openshift-ingress	kubelet	test-curl-7712-139938564457504	Pulled	Successfully pulled image "curlimages/curl:latest" in 332ms (332ms including waiting). Image size: 24157632 bytes.
16:09:16	openshift-ingress	kubelet	test-curl-7712-139938564457504	Started	Started container test-curl-7712-139938564457504
16:09:16	openshift-ingress	kubelet	test-curl-7712-139938564457504	Pulling	Pulling image "curlimages/curl:latest"
16:09:16	openshift-ingress	kubelet	test-curl-7712-139938564457504	Pulled	Successfully pulled image "curlimages/curl:latest" in 318ms (318ms including waiting). Image size: 24157632 bytes.
16:09:16	openshift-ingress	kubelet	test-curl-7712-139938564457504	Created	Created container: test-curl-7712-139938564457504
16:09:16	openshift-ingress	multus	test-curl-7712-139938564457504	AddedInterface	Add eth0 [10.133.0.53/23] from ovn-kubernetes
16:09:44	openshift-ingress	kubelet	e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm	Killing	Stopping container istio-proxy
16:09:45	openshift-ingress	kubelet	e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
16:09:45	openshift-ingress	kubelet	e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
16:10:10	openshift-ingress	kubelet	e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm	Killing	Stopping container istio-proxy
16:10:11	openshift-ingress	kubelet	e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
16:10:11	openshift-ingress	kubelet	e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body: