Events

Time	Namespace	Component	RelatedObject	Reason	Message
04:40:11	openshift-ingress		router-default-7b679c4ddd-d64dk	Scheduled	Successfully assigned openshift-ingress/router-default-7b679c4ddd-d64dk to ip-10-0-140-3.ec2.internal
04:47:20	openshift-ingress		maas-default-gateway-openshift-default-56654dcf7-llv9g	Scheduled	Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-llv9g to ip-10-0-132-245.ec2.internal
05:07:09	openshift-ingress		e2e-mt-ae2b190a-openshift-default-6d958d8455-b8lpl	Scheduled	Successfully assigned openshift-ingress/e2e-mt-ae2b190a-openshift-default-6d958d8455-b8lpl to ip-10-0-132-245.ec2.internal
04:44:51	openshift-ingress		kube-auth-proxy-68764b5749-dcxmr	Scheduled	Successfully assigned openshift-ingress/kube-auth-proxy-68764b5749-dcxmr to ip-10-0-137-187.ec2.internal
05:11:57	openshift-ingress		e2e-shared-a-a01a82-openshift-default-5d9c54f75f-rvh89	Scheduled	Successfully assigned openshift-ingress/e2e-shared-a-a01a82-openshift-default-5d9c54f75f-rvh89 to ip-10-0-132-245.ec2.internal
05:04:58	openshift-ingress		e2e-migrate-f6882454-gw-openshift-default-654dfdb567-nptzr	Scheduled	Successfully assigned openshift-ingress/e2e-migrate-f6882454-gw-openshift-default-654dfdb567-nptzr to ip-10-0-132-245.ec2.internal
04:44:51	openshift-ingress		kube-auth-proxy-68764b5749-fddrb	Scheduled	Successfully assigned openshift-ingress/kube-auth-proxy-68764b5749-fddrb to ip-10-0-132-245.ec2.internal
05:09:00	openshift-ingress		e2e-inf-b-05c504-openshift-default-94dcc5b65-d7t4r	Scheduled	Successfully assigned openshift-ingress/e2e-inf-b-05c504-openshift-default-94dcc5b65-d7t4r to ip-10-0-132-245.ec2.internal
05:04:40	openshift-ingress		e2e-ait-9f78d938-openshift-default-78bddcd99f-6rbbw	Scheduled	Successfully assigned openshift-ingress/e2e-ait-9f78d938-openshift-default-78bddcd99f-6rbbw to ip-10-0-132-245.ec2.internal
04:45:00	openshift-ingress		istiod-openshift-gateway-94bb8fbfd-fwk28	Scheduled	Successfully assigned openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fwk28 to ip-10-0-140-3.ec2.internal
04:44:54	openshift-ingress		istiod-openshift-gateway-7574459656-7dh8j	Scheduled	Successfully assigned openshift-ingress/istiod-openshift-gateway-7574459656-7dh8j to ip-10-0-132-245.ec2.internal
04:48:38	openshift-ingress		payload-pre-processing-74584bb9f8-frht7	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-74584bb9f8-frht7 to ip-10-0-137-187.ec2.internal
05:12:05	openshift-ingress		e2e-shared-b-12efc5-openshift-default-d64bfcdc-26498	Scheduled	Successfully assigned openshift-ingress/e2e-shared-b-12efc5-openshift-default-d64bfcdc-26498 to ip-10-0-132-245.ec2.internal
05:08:52	openshift-ingress		e2e-inf-a-82a682-openshift-default-55d5f644c-cp5r2	Scheduled	Successfully assigned openshift-ingress/e2e-inf-a-82a682-openshift-default-55d5f644c-cp5r2 to ip-10-0-132-245.ec2.internal
04:48:38	openshift-ingress		payload-processing-f9b8d9b9b-6cqdj	Scheduled	Successfully assigned openshift-ingress/payload-processing-f9b8d9b9b-6cqdj to ip-10-0-132-245.ec2.internal
05:05:16	openshift-ingress		e2e-derive-9116b405-openshift-default-8fbdcb99f-6cm98	Scheduled	Successfully assigned openshift-ingress/e2e-derive-9116b405-openshift-default-8fbdcb99f-6cm98 to ip-10-0-132-245.ec2.internal
04:45:01	openshift-ingress		data-science-gateway-data-science-gateway-class-6576859cf4nhbqk	Scheduled	Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nhbqk to ip-10-0-132-245.ec2.internal
05:11:13	openshift-ingress		e2e-api-b-bd340d-openshift-default-55ff75d979-dqkhw	Scheduled	Successfully assigned openshift-ingress/e2e-api-b-bd340d-openshift-default-55ff75d979-dqkhw to ip-10-0-132-245.ec2.internal
05:11:05	openshift-ingress		e2e-api-a-e9b55e-openshift-default-966679697-7l69g	Scheduled	Successfully assigned openshift-ingress/e2e-api-a-e9b55e-openshift-default-966679697-7l69g to ip-10-0-132-245.ec2.internal
04:33:21	openshift-ingress	deployment-controller	router-default	ScalingReplicaSet	Scaled up replica set router-default-7b679c4ddd from 0 to 1
04:33:52	openshift-ingress	service-controller	router-default	EnsuringLoadBalancer	Ensuring load balancer
04:33:52	openshift-ingress	service-controller	router-default	UnAvailableLoadBalancer	There are no available nodes for LoadBalancer
04:33:57	openshift-ingress	service-controller	router-default	EnsuredLoadBalancer	Ensured load balancer
04:34:02 (x14)	openshift-ingress	replicaset-controller	router-default-7b679c4ddd	FailedCreate	Error creating: pods "router-default-7b679c4ddd-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
04:37:27 (x16)	openshift-ingress	replicaset-controller	router-default-7b679c4ddd	FailedCreate	Error creating: pods "router-default-7b679c4ddd-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
04:39:13 (x3)	openshift-ingress	service-controller	router-default	UpdatedLoadBalancer	Updated load balancer with new hosts
04:40:11	openshift-ingress	replicaset-controller	router-default-7b679c4ddd	SuccessfulCreate	Created pod: router-default-7b679c4ddd-d64dk
04:40:19 (x5)	openshift-ingress	kubelet	router-default-7b679c4ddd-d64dk	FailedMount	MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
04:40:27 (x6)	openshift-ingress	kubelet	router-default-7b679c4ddd-d64dk	FailedMount	MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
04:40:43	openshift-ingress	multus	router-default-7b679c4ddd-d64dk	AddedInterface	Add eth0 [10.134.0.10/23] from ovn-kubernetes
04:40:43	openshift-ingress	kubelet	router-default-7b679c4ddd-d64dk	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0595b1d6de8e08ddb61ce581075357331193db6206d341c15cf213514ef0f693" already present on machine
04:40:44	openshift-ingress	kubelet	router-default-7b679c4ddd-d64dk	Started	Started container router
04:40:44	openshift-ingress	kubelet	router-default-7b679c4ddd-d64dk	Created	Created container: router
04:44:51 (x4)	openshift-ingress	replicaset-controller	kube-auth-proxy-68764b5749	FailedCreate	Error creating: pods "kube-auth-proxy-68764b5749-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found
04:44:51	openshift-ingress	replicaset-controller	kube-auth-proxy-68764b5749	SuccessfulCreate	Created pod: kube-auth-proxy-68764b5749-fddrb
04:44:51	openshift-ingress	multus	kube-auth-proxy-68764b5749-fddrb	AddedInterface	Add eth0 [10.133.0.19/23] from ovn-kubernetes
04:44:51	openshift-ingress	deployment-controller	kube-auth-proxy	ScalingReplicaSet	Scaled up replica set kube-auth-proxy-68764b5749 from 0 to 2
04:44:51	openshift-ingress	replicaset-controller	kube-auth-proxy-68764b5749	SuccessfulCreate	Created pod: kube-auth-proxy-68764b5749-dcxmr
04:44:52	openshift-ingress	kubelet	kube-auth-proxy-68764b5749-fddrb	Pulling	Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"
04:44:52	openshift-ingress	kubelet	kube-auth-proxy-68764b5749-dcxmr	Pulling	Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"
04:44:52	openshift-ingress	multus	kube-auth-proxy-68764b5749-dcxmr	AddedInterface	Add eth0 [10.132.0.33/23] from ovn-kubernetes
04:44:53	openshift-ingress	replicaset-controller	istiod-openshift-gateway-7574459656	SuccessfulCreate	Created pod: istiod-openshift-gateway-7574459656-7dh8j
04:44:53	openshift-ingress	deployment-controller	istiod-openshift-gateway	ScalingReplicaSet	Scaled up replica set istiod-openshift-gateway-7574459656 from 0 to 1
04:44:54	openshift-ingress	kubelet	kube-auth-proxy-68764b5749-dcxmr	Started	Started container kube-auth-proxy
04:44:54	openshift-ingress	kubelet	kube-auth-proxy-68764b5749-dcxmr	Created	Created container: kube-auth-proxy
04:44:54	openshift-ingress	kubelet	kube-auth-proxy-68764b5749-dcxmr	Pulled	Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.746s (2.746s including waiting). Image size: 265120132 bytes.
04:44:56	openshift-ingress	kubelet	kube-auth-proxy-68764b5749-fddrb	Started	Started container kube-auth-proxy
04:44:56	openshift-ingress	kubelet	kube-auth-proxy-68764b5749-fddrb	Created	Created container: kube-auth-proxy
04:44:56	openshift-ingress	kubelet	kube-auth-proxy-68764b5749-fddrb	Pulled	Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 4.189s (4.189s including waiting). Image size: 265120132 bytes.
04:44:56	openshift-ingress	multus	istiod-openshift-gateway-7574459656-7dh8j	AddedInterface	Add eth0 [10.133.0.22/23] from ovn-kubernetes
04:44:56	openshift-ingress	kubelet	istiod-openshift-gateway-7574459656-7dh8j	Pulling	Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:0850242436e88f7d82f0f2126de064c7e0f09844f31d8ff0f53dc8d3908075d9"
04:44:59	openshift-ingress	kubelet	istiod-openshift-gateway-7574459656-7dh8j	Started	Started container discovery
04:44:59	openshift-ingress	kubelet	istiod-openshift-gateway-7574459656-7dh8j	Created	Created container: discovery
04:44:59	openshift-ingress	kubelet	istiod-openshift-gateway-7574459656-7dh8j	Pulled	Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:0850242436e88f7d82f0f2126de064c7e0f09844f31d8ff0f53dc8d3908075d9" in 2.756s (2.756s including waiting). Image size: 181034515 bytes.
04:45:00	openshift-ingress	deployment-controller	istiod-openshift-gateway	ScalingReplicaSet	Scaled up replica set istiod-openshift-gateway-94bb8fbfd from 0 to 1
04:45:00	openshift-ingress	kubelet	istiod-openshift-gateway-7574459656-7dh8j	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
04:45:00	openshift-ingress	kubelet	istiod-openshift-gateway-7574459656-7dh8j	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
04:45:00	openshift-ingress	replicaset-controller	istiod-openshift-gateway-94bb8fbfd	SuccessfulCreate	Created pod: istiod-openshift-gateway-94bb8fbfd-fwk28
04:45:01	openshift-ingress	deployment-controller	data-science-gateway-data-science-gateway-class	ScalingReplicaSet	Scaled up replica set data-science-gateway-data-science-gateway-class-6576859cf4 from 0 to 1
04:45:01	openshift-ingress	multus	data-science-gateway-data-science-gateway-class-6576859cf4nhbqk	AddedInterface	Add eth0 [10.133.0.23/23] from ovn-kubernetes
04:45:01	openshift-ingress	kubelet	istiod-openshift-gateway-94bb8fbfd-fwk28	Pulling	Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:0850242436e88f7d82f0f2126de064c7e0f09844f31d8ff0f53dc8d3908075d9"
04:45:01	openshift-ingress	replicaset-controller	data-science-gateway-data-science-gateway-class-6576859cf4	SuccessfulCreate	Created pod: data-science-gateway-data-science-gateway-class-6576859cf4nhbqk
04:45:01	openshift-ingress	kubelet	data-science-gateway-data-science-gateway-class-6576859cf4nhbqk	Pulling	Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8"
04:45:01	openshift-ingress	multus	istiod-openshift-gateway-94bb8fbfd-fwk28	AddedInterface	Add eth0 [10.134.0.23/23] from ovn-kubernetes
04:45:04	openshift-ingress	kubelet	istiod-openshift-gateway-94bb8fbfd-fwk28	Created	Created container: discovery
04:45:04	openshift-ingress	kubelet	istiod-openshift-gateway-94bb8fbfd-fwk28	Pulled	Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:0850242436e88f7d82f0f2126de064c7e0f09844f31d8ff0f53dc8d3908075d9" in 3.082s (3.082s including waiting). Image size: 181034515 bytes.
04:45:04	openshift-ingress	kubelet	istiod-openshift-gateway-94bb8fbfd-fwk28	Started	Started container discovery
04:45:05	openshift-ingress	kubelet	istiod-openshift-gateway-7574459656-7dh8j	Killing	Stopping container discovery
04:45:05	openshift-ingress	kubelet	data-science-gateway-data-science-gateway-class-6576859cf4nhbqk	Created	Created container: istio-proxy
04:45:05	openshift-ingress	kubelet	data-science-gateway-data-science-gateway-class-6576859cf4nhbqk	Pulled	Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" in 3.381s (3.381s including waiting). Image size: 181251556 bytes.
04:45:05	openshift-ingress	kubelet	data-science-gateway-data-science-gateway-class-6576859cf4nhbqk	Started	Started container istio-proxy
04:45:05	openshift-ingress	deployment-controller	istiod-openshift-gateway	ScalingReplicaSet	Scaled down replica set istiod-openshift-gateway-7574459656 from 1 to 0
04:45:05	openshift-ingress	replicaset-controller	istiod-openshift-gateway-7574459656	SuccessfulDelete	Deleted pod: istiod-openshift-gateway-7574459656-7dh8j
04:45:21 (x2)	openshift-ingress	horizontal-pod-autoscaler	kube-auth-proxy	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
04:45:21 (x2)	openshift-ingress	horizontal-pod-autoscaler	kube-auth-proxy	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
04:45:39 (x3)	openshift-ingress	horizontal-pod-autoscaler	istiod-openshift-gateway	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
04:45:39 (x3)	openshift-ingress	horizontal-pod-autoscaler	istiod-openshift-gateway	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
04:47:20	openshift-ingress	replicaset-controller	maas-default-gateway-openshift-default-56654dcf7	SuccessfulCreate	Created pod: maas-default-gateway-openshift-default-56654dcf7-llv9g
04:47:20	openshift-ingress	multus	maas-default-gateway-openshift-default-56654dcf7-llv9g	AddedInterface	Add eth0 [10.133.0.35/23] from ovn-kubernetes
04:47:20	openshift-ingress	deployment-controller	maas-default-gateway-openshift-default	ScalingReplicaSet	Scaled up replica set maas-default-gateway-openshift-default-56654dcf7 from 0 to 1
04:47:20	openshift-ingress	gateway_labeler_controller	maas-default-gateway	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway
04:48:38 (x5)	openshift-ingress	replicaset-controller	payload-pre-processing-74584bb9f8	FailedCreate	Error creating: pods "payload-pre-processing-74584bb9f8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found
04:48:38	openshift-ingress	replicaset-controller	payload-pre-processing-74584bb9f8	SuccessfulCreate	Created pod: payload-pre-processing-74584bb9f8-frht7
04:48:38	openshift-ingress	deployment-controller	payload-processing	ScalingReplicaSet	Scaled up replica set payload-processing-f9b8d9b9b from 0 to 1
04:48:38	openshift-ingress	replicaset-controller	payload-processing-f9b8d9b9b	SuccessfulCreate	Created pod: payload-processing-f9b8d9b9b-6cqdj
04:48:38 (x5)	openshift-ingress	replicaset-controller	payload-processing-f9b8d9b9b	FailedCreate	Error creating: pods "payload-processing-f9b8d9b9b-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found
04:48:38	openshift-ingress	deployment-controller	payload-pre-processing	ScalingReplicaSet	Scaled up replica set payload-pre-processing-74584bb9f8 from 0 to 1
04:48:39	openshift-ingress	kubelet	payload-pre-processing-74584bb9f8-frht7	Pulling	Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:dc31b949d8c5ea8610b5c10ef53e2a199e00f0e0"
04:48:39	openshift-ingress	multus	payload-processing-f9b8d9b9b-6cqdj	AddedInterface	Add eth0 [10.133.0.43/23] from ovn-kubernetes
04:48:39	openshift-ingress	kubelet	payload-processing-f9b8d9b9b-6cqdj	Pulling	Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:dc31b949d8c5ea8610b5c10ef53e2a199e00f0e0"
04:48:39	openshift-ingress	multus	payload-pre-processing-74584bb9f8-frht7	AddedInterface	Add eth0 [10.132.0.44/23] from ovn-kubernetes
04:48:40	openshift-ingress	kubelet	payload-pre-processing-74584bb9f8-frht7	Created	Created container: payload-pre-processing
04:48:40	openshift-ingress	kubelet	payload-pre-processing-74584bb9f8-frht7	Started	Started container payload-pre-processing
04:48:40	openshift-ingress	kubelet	payload-pre-processing-74584bb9f8-frht7	Pulled	Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:dc31b949d8c5ea8610b5c10ef53e2a199e00f0e0" in 1.417s (1.417s including waiting). Image size: 165432098 bytes.
04:48:41	openshift-ingress	kubelet	payload-processing-f9b8d9b9b-6cqdj	Pulled	Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:dc31b949d8c5ea8610b5c10ef53e2a199e00f0e0" in 1.703s (1.703s including waiting). Image size: 165432098 bytes.
04:48:41	openshift-ingress	kubelet	payload-processing-f9b8d9b9b-6cqdj	Created	Created container: payload-processing
04:48:41	openshift-ingress	kubelet	payload-processing-f9b8d9b9b-6cqdj	Started	Started container payload-processing
04:48:46 (x2)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-56654dcf7-llv9g	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine
04:48:46 (x2)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-56654dcf7-llv9g	Started	Started container istio-proxy
04:48:46 (x2)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-56654dcf7-llv9g	Created	Created container: istio-proxy
04:48:50 (x3)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-56654dcf7-llv9g	Unhealthy	Startup probe failed: Get "http://10.133.0.35:15021/healthz/ready": dial tcp 10.133.0.35:15021: connect: connection refused
04:48:50 (x3)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-56654dcf7-llv9g	ProbeError	Startup probe error: Get "http://10.133.0.35:15021/healthz/ready": dial tcp 10.133.0.35:15021: connect: connection refused body:
05:04:40	openshift-ingress	deployment-controller	e2e-ait-9f78d938-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-ait-9f78d938-openshift-default-78bddcd99f from 0 to 1
05:04:40	openshift-ingress	gateway_labeler_controller	e2e-ait-9f78d938	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-ait-9f78d938
05:04:40	openshift-ingress	kubelet	e2e-ait-9f78d938-openshift-default-78bddcd99f-6rbbw	Started	Started container istio-proxy
05:04:40	openshift-ingress	replicaset-controller	e2e-ait-9f78d938-openshift-default-78bddcd99f	SuccessfulCreate	Created pod: e2e-ait-9f78d938-openshift-default-78bddcd99f-6rbbw
05:04:40	openshift-ingress	kubelet	e2e-ait-9f78d938-openshift-default-78bddcd99f-6rbbw	Created	Created container: istio-proxy
05:04:40	openshift-ingress	service-controller	e2e-ait-9f78d938-openshift-default	EnsuringLoadBalancer	Ensuring load balancer
05:04:40	openshift-ingress	multus	e2e-ait-9f78d938-openshift-default-78bddcd99f-6rbbw	AddedInterface	Add eth0 [10.133.0.48/23] from ovn-kubernetes
05:04:40	openshift-ingress	kubelet	e2e-ait-9f78d938-openshift-default-78bddcd99f-6rbbw	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine
05:04:44	openshift-ingress	service-controller	e2e-ait-9f78d938-openshift-default	EnsuredLoadBalancer	Ensured load balancer
05:04:46	openshift-ingress	kubelet	e2e-ait-9f78d938-openshift-default-78bddcd99f-6rbbw	Killing	Stopping container istio-proxy
05:04:46	openshift-ingress	service-controller	e2e-ait-9f78d938-openshift-default	DeletingLoadBalancer	Deleting load balancer
05:04:48	openshift-ingress	service-controller	e2e-ait-9f78d938-openshift-default	DeletedLoadBalancer	Deleted load balancer
05:04:58	openshift-ingress	multus	e2e-migrate-f6882454-gw-openshift-default-654dfdb567-nptzr	AddedInterface	Add eth0 [10.133.0.50/23] from ovn-kubernetes
05:04:58	openshift-ingress	replicaset-controller	e2e-migrate-f6882454-gw-openshift-default-654dfdb567	SuccessfulCreate	Created pod: e2e-migrate-f6882454-gw-openshift-default-654dfdb567-nptzr
05:04:58	openshift-ingress	deployment-controller	e2e-migrate-f6882454-gw-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-migrate-f6882454-gw-openshift-default-654dfdb567 from 0 to 1
05:04:58	openshift-ingress	gateway_labeler_controller	e2e-migrate-f6882454-gw	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-f6882454-gw
05:04:58	openshift-ingress	service-controller	e2e-migrate-f6882454-gw-openshift-default	EnsuringLoadBalancer	Ensuring load balancer
05:04:58	openshift-ingress	kubelet	e2e-migrate-f6882454-gw-openshift-default-654dfdb567-nptzr	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine
05:04:59	openshift-ingress	kubelet	e2e-migrate-f6882454-gw-openshift-default-654dfdb567-nptzr	Created	Created container: istio-proxy
05:04:59	openshift-ingress	kubelet	e2e-migrate-f6882454-gw-openshift-default-654dfdb567-nptzr	Started	Started container istio-proxy
05:05:02	openshift-ingress	service-controller	e2e-migrate-f6882454-gw-openshift-default	EnsuredLoadBalancer	Ensured load balancer
05:05:04	openshift-ingress	kubelet	e2e-migrate-f6882454-gw-openshift-default-654dfdb567-nptzr	Killing	Stopping container istio-proxy
05:05:04	openshift-ingress	service-controller	e2e-migrate-f6882454-gw-openshift-default	DeletingLoadBalancer	Deleting load balancer
05:05:06	openshift-ingress	service-controller	e2e-migrate-f6882454-gw-openshift-default	DeletedLoadBalancer	Deleted load balancer
05:05:16	openshift-ingress	gateway_labeler_controller	e2e-derive-9116b405	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-derive-9116b405
05:05:16	openshift-ingress	service-controller	e2e-derive-9116b405-openshift-default	EnsuringLoadBalancer	Ensuring load balancer
05:05:16	openshift-ingress	multus	e2e-derive-9116b405-openshift-default-8fbdcb99f-6cm98	AddedInterface	Add eth0 [10.133.0.51/23] from ovn-kubernetes
05:05:16	openshift-ingress	kubelet	e2e-derive-9116b405-openshift-default-8fbdcb99f-6cm98	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine
05:05:16	openshift-ingress	kubelet	e2e-derive-9116b405-openshift-default-8fbdcb99f-6cm98	Created	Created container: istio-proxy
05:05:16	openshift-ingress	kubelet	e2e-derive-9116b405-openshift-default-8fbdcb99f-6cm98	Started	Started container istio-proxy
05:05:16	openshift-ingress	replicaset-controller	e2e-derive-9116b405-openshift-default-8fbdcb99f	SuccessfulCreate	Created pod: e2e-derive-9116b405-openshift-default-8fbdcb99f-6cm98
05:05:16	openshift-ingress	deployment-controller	e2e-derive-9116b405-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-derive-9116b405-openshift-default-8fbdcb99f from 0 to 1
05:05:19	openshift-ingress	service-controller	e2e-derive-9116b405-openshift-default	EnsuredLoadBalancer	Ensured load balancer
05:05:22	openshift-ingress	service-controller	e2e-derive-9116b405-openshift-default	DeletingLoadBalancer	Deleting load balancer
05:05:22	openshift-ingress	kubelet	e2e-derive-9116b405-openshift-default-8fbdcb99f-6cm98	Killing	Stopping container istio-proxy
05:05:25	openshift-ingress	service-controller	e2e-derive-9116b405-openshift-default	DeletedLoadBalancer	Deleted load balancer
05:07:09	openshift-ingress	deployment-controller	e2e-mt-ae2b190a-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-mt-ae2b190a-openshift-default-6d958d8455 from 0 to 1
05:07:09	openshift-ingress	gateway_labeler_controller	e2e-mt-ae2b190a	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-mt-ae2b190a
05:07:09	openshift-ingress	replicaset-controller	e2e-mt-ae2b190a-openshift-default-6d958d8455	SuccessfulCreate	Created pod: e2e-mt-ae2b190a-openshift-default-6d958d8455-b8lpl
05:07:10	openshift-ingress	multus	e2e-mt-ae2b190a-openshift-default-6d958d8455-b8lpl	AddedInterface	Add eth0 [10.133.0.52/23] from ovn-kubernetes
05:07:26 (x2)	openshift-ingress	kubelet	e2e-mt-ae2b190a-openshift-default-6d958d8455-b8lpl	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine
05:07:26 (x2)	openshift-ingress	kubelet	e2e-mt-ae2b190a-openshift-default-6d958d8455-b8lpl	Created	Created container: istio-proxy
05:07:26 (x2)	openshift-ingress	kubelet	e2e-mt-ae2b190a-openshift-default-6d958d8455-b8lpl	Started	Started container istio-proxy
05:07:30 (x4)	openshift-ingress	kubelet	e2e-mt-ae2b190a-openshift-default-6d958d8455-b8lpl	ProbeError	Startup probe error: Get "http://10.133.0.52:15021/healthz/ready": dial tcp 10.133.0.52:15021: connect: connection refused body:
05:07:30 (x4)	openshift-ingress	kubelet	e2e-mt-ae2b190a-openshift-default-6d958d8455-b8lpl	Unhealthy	Startup probe failed: Get "http://10.133.0.52:15021/healthz/ready": dial tcp 10.133.0.52:15021: connect: connection refused
05:07:37	openshift-ingress	kubelet	e2e-mt-ae2b190a-openshift-default-6d958d8455-b8lpl	Killing	Stopping container istio-proxy
05:08:52	openshift-ingress	replicaset-controller	e2e-inf-a-82a682-openshift-default-55d5f644c	SuccessfulCreate	Created pod: e2e-inf-a-82a682-openshift-default-55d5f644c-cp5r2
05:08:52	openshift-ingress	GatewayAuthBootstrap	e2e-inf-a-82a682	ReconcileError	Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-inf-a-82a682-authn-ssl: envoyfilters.networking.istio.io "e2e-inf-a-82a682-authn-ssl" already exists
05:08:52	openshift-ingress	gateway_labeler_controller	e2e-inf-a-82a682	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-82a682
05:08:52	openshift-ingress	deployment-controller	e2e-inf-a-82a682-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-inf-a-82a682-openshift-default-55d5f644c from 0 to 1
05:08:53	openshift-ingress	multus	e2e-inf-a-82a682-openshift-default-55d5f644c-cp5r2	AddedInterface	Add eth0 [10.133.0.53/23] from ovn-kubernetes
05:09:00	openshift-ingress	deployment-controller	e2e-inf-b-05c504-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-inf-b-05c504-openshift-default-94dcc5b65 from 0 to 1
05:09:00	openshift-ingress	gateway_labeler_controller	e2e-inf-b-05c504	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-05c504
05:09:00	openshift-ingress	replicaset-controller	e2e-inf-b-05c504-openshift-default-94dcc5b65	SuccessfulCreate	Created pod: e2e-inf-b-05c504-openshift-default-94dcc5b65-d7t4r
05:09:01	openshift-ingress	multus	e2e-inf-b-05c504-openshift-default-94dcc5b65-d7t4r	AddedInterface	Add eth0 [10.133.0.54/23] from ovn-kubernetes
05:09:04 (x2)	openshift-ingress	kubelet	e2e-inf-a-82a682-openshift-default-55d5f644c-cp5r2	Started	Started container istio-proxy
05:09:04 (x2)	openshift-ingress	kubelet	e2e-inf-a-82a682-openshift-default-55d5f644c-cp5r2	Created	Created container: istio-proxy
05:09:04 (x2)	openshift-ingress	kubelet	e2e-inf-a-82a682-openshift-default-55d5f644c-cp5r2	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine
05:09:09 (x4)	openshift-ingress	kubelet	e2e-inf-a-82a682-openshift-default-55d5f644c-cp5r2	Unhealthy	Startup probe failed: Get "http://10.133.0.53:15021/healthz/ready": dial tcp 10.133.0.53:15021: connect: connection refused
05:09:09 (x4)	openshift-ingress	kubelet	e2e-inf-a-82a682-openshift-default-55d5f644c-cp5r2	ProbeError	Startup probe error: Get "http://10.133.0.53:15021/healthz/ready": dial tcp 10.133.0.53:15021: connect: connection refused body:
05:09:18 (x2)	openshift-ingress	kubelet	e2e-inf-b-05c504-openshift-default-94dcc5b65-d7t4r	Started	Started container istio-proxy
05:09:18	openshift-ingress	kubelet	e2e-inf-b-05c504-openshift-default-94dcc5b65-d7t4r	Unhealthy	Readiness probe failed: Get "http://10.133.0.54:15021/healthz/ready": read tcp 10.133.0.2:42398->10.133.0.54:15021: read: connection reset by peer
05:09:18 (x2)	openshift-ingress	kubelet	e2e-inf-b-05c504-openshift-default-94dcc5b65-d7t4r	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine
05:09:18 (x2)	openshift-ingress	kubelet	e2e-inf-b-05c504-openshift-default-94dcc5b65-d7t4r	Created	Created container: istio-proxy
05:09:18	openshift-ingress	kubelet	e2e-inf-b-05c504-openshift-default-94dcc5b65-d7t4r	ProbeError	Readiness probe error: Get "http://10.133.0.54:15021/healthz/ready": read tcp 10.133.0.2:42398->10.133.0.54:15021: read: connection reset by peer body:
05:09:23 (x4)	openshift-ingress	kubelet	e2e-inf-b-05c504-openshift-default-94dcc5b65-d7t4r	Unhealthy	Startup probe failed: Get "http://10.133.0.54:15021/healthz/ready": dial tcp 10.133.0.54:15021: connect: connection refused
05:09:23 (x4)	openshift-ingress	kubelet	e2e-inf-b-05c504-openshift-default-94dcc5b65-d7t4r	ProbeError	Startup probe error: Get "http://10.133.0.54:15021/healthz/ready": dial tcp 10.133.0.54:15021: connect: connection refused body:
05:10:51	openshift-ingress	kubelet	e2e-inf-a-82a682-openshift-default-55d5f644c-cp5r2	Killing	Stopping container istio-proxy
05:10:55	openshift-ingress	kubelet	e2e-inf-a-82a682-openshift-default-55d5f644c-cp5r2	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
05:10:55	openshift-ingress	kubelet	e2e-inf-a-82a682-openshift-default-55d5f644c-cp5r2	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
05:11:04	openshift-ingress	kubelet	e2e-inf-b-05c504-openshift-default-94dcc5b65-d7t4r	Killing	Stopping container istio-proxy
05:11:05	openshift-ingress	replicaset-controller	e2e-api-a-e9b55e-openshift-default-966679697	SuccessfulCreate	Created pod: e2e-api-a-e9b55e-openshift-default-966679697-7l69g
05:11:05	openshift-ingress	deployment-controller	e2e-api-a-e9b55e-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-api-a-e9b55e-openshift-default-966679697 from 0 to 1
05:11:05	openshift-ingress	gateway_labeler_controller	e2e-api-a-e9b55e	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-e9b55e
05:11:06	openshift-ingress	multus	e2e-api-a-e9b55e-openshift-default-966679697-7l69g	AddedInterface	Add eth0 [10.133.0.55/23] from ovn-kubernetes
05:11:09	openshift-ingress	kubelet	e2e-inf-b-05c504-openshift-default-94dcc5b65-d7t4r	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
05:11:09	openshift-ingress	kubelet	e2e-inf-b-05c504-openshift-default-94dcc5b65-d7t4r	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
05:11:13	openshift-ingress	replicaset-controller	e2e-api-b-bd340d-openshift-default-55ff75d979	SuccessfulCreate	Created pod: e2e-api-b-bd340d-openshift-default-55ff75d979-dqkhw
05:11:13	openshift-ingress	deployment-controller	e2e-api-b-bd340d-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-api-b-bd340d-openshift-default-55ff75d979 from 0 to 1
05:11:13	openshift-ingress	gateway_labeler_controller	e2e-api-b-bd340d	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-bd340d
05:11:14	openshift-ingress	multus	e2e-api-b-bd340d-openshift-default-55ff75d979-dqkhw	AddedInterface	Add eth0 [10.133.0.56/23] from ovn-kubernetes
05:11:22 (x2)	openshift-ingress	kubelet	e2e-api-a-e9b55e-openshift-default-966679697-7l69g	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine
05:11:22 (x2)	openshift-ingress	kubelet	e2e-api-a-e9b55e-openshift-default-966679697-7l69g	Created	Created container: istio-proxy
05:11:22 (x2)	openshift-ingress	kubelet	e2e-api-a-e9b55e-openshift-default-966679697-7l69g	Started	Started container istio-proxy
05:11:26 (x4)	openshift-ingress	kubelet	e2e-api-a-e9b55e-openshift-default-966679697-7l69g	ProbeError	Startup probe error: Get "http://10.133.0.55:15021/healthz/ready": dial tcp 10.133.0.55:15021: connect: connection refused body:
05:11:26 (x4)	openshift-ingress	kubelet	e2e-api-a-e9b55e-openshift-default-966679697-7l69g	Unhealthy	Startup probe failed: Get "http://10.133.0.55:15021/healthz/ready": dial tcp 10.133.0.55:15021: connect: connection refused
05:11:28 (x2)	openshift-ingress	kubelet	e2e-api-b-bd340d-openshift-default-55ff75d979-dqkhw	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine
05:11:28 (x2)	openshift-ingress	kubelet	e2e-api-b-bd340d-openshift-default-55ff75d979-dqkhw	Started	Started container istio-proxy
05:11:28 (x2)	openshift-ingress	kubelet	e2e-api-b-bd340d-openshift-default-55ff75d979-dqkhw	Created	Created container: istio-proxy
05:11:33 (x5)	openshift-ingress	kubelet	e2e-api-b-bd340d-openshift-default-55ff75d979-dqkhw	Unhealthy	Startup probe failed: Get "http://10.133.0.56:15021/healthz/ready": dial tcp 10.133.0.56:15021: connect: connection refused
05:11:33 (x5)	openshift-ingress	kubelet	e2e-api-b-bd340d-openshift-default-55ff75d979-dqkhw	ProbeError	Startup probe error: Get "http://10.133.0.56:15021/healthz/ready": dial tcp 10.133.0.56:15021: connect: connection refused body:
05:11:43	openshift-ingress	kubelet	e2e-api-a-e9b55e-openshift-default-966679697-7l69g	Killing	Stopping container istio-proxy
05:11:55	openshift-ingress	kubelet	e2e-api-b-bd340d-openshift-default-55ff75d979-dqkhw	Killing	Stopping container istio-proxy
05:11:57	openshift-ingress	deployment-controller	e2e-shared-a-a01a82-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-shared-a-a01a82-openshift-default-5d9c54f75f from 0 to 1
05:11:57	openshift-ingress	replicaset-controller	e2e-shared-a-a01a82-openshift-default-5d9c54f75f	SuccessfulCreate	Created pod: e2e-shared-a-a01a82-openshift-default-5d9c54f75f-rvh89
05:11:57	openshift-ingress	multus	e2e-shared-a-a01a82-openshift-default-5d9c54f75f-rvh89	AddedInterface	Add eth0 [10.133.0.57/23] from ovn-kubernetes
05:11:57	openshift-ingress	gateway_labeler_controller	e2e-shared-a-a01a82	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-a01a82
05:12:05	openshift-ingress	replicaset-controller	e2e-shared-b-12efc5-openshift-default-d64bfcdc	SuccessfulCreate	Created pod: e2e-shared-b-12efc5-openshift-default-d64bfcdc-26498
05:12:05	openshift-ingress	deployment-controller	e2e-shared-b-12efc5-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-shared-b-12efc5-openshift-default-d64bfcdc from 0 to 1
05:12:05	openshift-ingress	gateway_labeler_controller	e2e-shared-b-12efc5	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-12efc5
05:12:06	openshift-ingress	multus	e2e-shared-b-12efc5-openshift-default-d64bfcdc-26498	AddedInterface	Add eth0 [10.133.0.58/23] from ovn-kubernetes
05:12:11 (x2)	openshift-ingress	kubelet	e2e-shared-a-a01a82-openshift-default-5d9c54f75f-rvh89	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine
05:12:11 (x2)	openshift-ingress	kubelet	e2e-shared-a-a01a82-openshift-default-5d9c54f75f-rvh89	Created	Created container: istio-proxy
05:12:11 (x2)	openshift-ingress	kubelet	e2e-shared-a-a01a82-openshift-default-5d9c54f75f-rvh89	Started	Started container istio-proxy
05:12:16 (x4)	openshift-ingress	kubelet	e2e-shared-a-a01a82-openshift-default-5d9c54f75f-rvh89	ProbeError	Startup probe error: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused body:
05:12:16 (x4)	openshift-ingress	kubelet	e2e-shared-a-a01a82-openshift-default-5d9c54f75f-rvh89	Unhealthy	Startup probe failed: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused
05:12:23	openshift-ingress	kubelet	e2e-shared-b-12efc5-openshift-default-d64bfcdc-26498	Unhealthy	Readiness probe failed: Get "http://10.133.0.58:15021/healthz/ready": read tcp 10.133.0.2:44538->10.133.0.58:15021: read: connection reset by peer
05:12:23	openshift-ingress	kubelet	e2e-shared-b-12efc5-openshift-default-d64bfcdc-26498	ProbeError	Readiness probe error: Get "http://10.133.0.58:15021/healthz/ready": read tcp 10.133.0.2:44538->10.133.0.58:15021: read: connection reset by peer body:
05:12:23 (x2)	openshift-ingress	kubelet	e2e-shared-b-12efc5-openshift-default-d64bfcdc-26498	Started	Started container istio-proxy
05:12:23 (x2)	openshift-ingress	kubelet	e2e-shared-b-12efc5-openshift-default-d64bfcdc-26498	Created	Created container: istio-proxy
05:12:23 (x2)	openshift-ingress	kubelet	e2e-shared-b-12efc5-openshift-default-d64bfcdc-26498	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine
05:12:28 (x4)	openshift-ingress	kubelet	e2e-shared-b-12efc5-openshift-default-d64bfcdc-26498	ProbeError	Startup probe error: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused body:
05:12:28 (x4)	openshift-ingress	kubelet	e2e-shared-b-12efc5-openshift-default-d64bfcdc-26498	Unhealthy	Startup probe failed: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused
05:17:57	openshift-ingress	kubelet	e2e-shared-a-a01a82-openshift-default-5d9c54f75f-rvh89	Killing	Stopping container istio-proxy
05:18:02	openshift-ingress	kubelet	e2e-shared-a-a01a82-openshift-default-5d9c54f75f-rvh89	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
05:18:02	openshift-ingress	kubelet	e2e-shared-a-a01a82-openshift-default-5d9c54f75f-rvh89	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
05:18:10	openshift-ingress	kubelet	e2e-shared-b-12efc5-openshift-default-d64bfcdc-26498	Killing	Stopping container istio-proxy
05:18:14	openshift-ingress	kubelet	e2e-shared-b-12efc5-openshift-default-d64bfcdc-26498	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
05:18:14	openshift-ingress	kubelet	e2e-shared-b-12efc5-openshift-default-d64bfcdc-26498	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body: