Events

Time	Namespace	Component	RelatedObject	Reason	Message
08:55:46	openshift-ingress		router-default-84d56f759d-97tbg	Scheduled	Successfully assigned openshift-ingress/router-default-84d56f759d-97tbg to ip-10-0-135-178.ec2.internal
09:05:54	openshift-ingress		payload-processing-f9b8d9b9b-7v7p7	Scheduled	Successfully assigned openshift-ingress/payload-processing-f9b8d9b9b-7v7p7 to ip-10-0-135-178.ec2.internal
09:26:05	openshift-ingress		e2e-inf-a-00d870-openshift-default-f465b6c5f-5dpkb	Scheduled	Successfully assigned openshift-ingress/e2e-inf-a-00d870-openshift-default-f465b6c5f-5dpkb to ip-10-0-128-59.ec2.internal
09:22:23	openshift-ingress		e2e-derive-ed97d282-openshift-default-5fffff79ff-x6zvk	Scheduled	Successfully assigned openshift-ingress/e2e-derive-ed97d282-openshift-default-5fffff79ff-x6zvk to ip-10-0-128-59.ec2.internal
09:05:54	openshift-ingress		payload-pre-processing-74584bb9f8-hsnxz	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-74584bb9f8-hsnxz to ip-10-0-140-31.ec2.internal
09:01:50	openshift-ingress		istiod-openshift-gateway-7574459656-jp2np	Scheduled	Successfully assigned openshift-ingress/istiod-openshift-gateway-7574459656-jp2np to ip-10-0-135-178.ec2.internal
09:26:13	openshift-ingress		e2e-inf-b-cfc611-openshift-default-c9f686459-qsj26	Scheduled	Successfully assigned openshift-ingress/e2e-inf-b-cfc611-openshift-default-c9f686459-qsj26 to ip-10-0-135-178.ec2.internal
09:29:45	openshift-ingress		e2e-shared-b-800be8-openshift-default-55ff497447-r6gg2	Scheduled	Successfully assigned openshift-ingress/e2e-shared-b-800be8-openshift-default-55ff497447-r6gg2 to ip-10-0-128-59.ec2.internal
09:21:45	openshift-ingress		e2e-ait-5f4d028a-openshift-default-84977f447f-5pnf6	Scheduled	Successfully assigned openshift-ingress/e2e-ait-5f4d028a-openshift-default-84977f447f-5pnf6 to ip-10-0-128-59.ec2.internal
09:01:49	openshift-ingress		kube-auth-proxy-856d68f954-94qtz	Scheduled	Successfully assigned openshift-ingress/kube-auth-proxy-856d68f954-94qtz to ip-10-0-128-59.ec2.internal
09:04:27	openshift-ingress		maas-default-gateway-openshift-default-56654dcf7-kjqvh	Scheduled	Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kjqvh to ip-10-0-135-178.ec2.internal
09:22:04	openshift-ingress		e2e-migrate-2d7d58ac-gw-openshift-default-676d86cc59-wxb4w	Scheduled	Successfully assigned openshift-ingress/e2e-migrate-2d7d58ac-gw-openshift-default-676d86cc59-wxb4w to ip-10-0-128-59.ec2.internal
09:24:22	openshift-ingress		e2e-mt-8e4c8858-openshift-default-85d8b74979-wfmxd	Scheduled	Successfully assigned openshift-ingress/e2e-mt-8e4c8858-openshift-default-85d8b74979-wfmxd to ip-10-0-128-59.ec2.internal
09:01:49	openshift-ingress		kube-auth-proxy-856d68f954-nvhqr	Scheduled	Successfully assigned openshift-ingress/kube-auth-proxy-856d68f954-nvhqr to ip-10-0-135-178.ec2.internal
09:01:58	openshift-ingress		data-science-gateway-data-science-gateway-class-6576859cf4f9phv	Scheduled	Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f9phv to ip-10-0-128-59.ec2.internal
09:28:46	openshift-ingress		e2e-api-a-6b0aee-openshift-default-865d44c4d9-lqs7q	Scheduled	Successfully assigned openshift-ingress/e2e-api-a-6b0aee-openshift-default-865d44c4d9-lqs7q to ip-10-0-128-59.ec2.internal
09:28:54	openshift-ingress		e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p	Scheduled	Successfully assigned openshift-ingress/e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p to ip-10-0-135-178.ec2.internal
09:29:37	openshift-ingress		e2e-shared-a-923c3a-openshift-default-5477845cdc-pr9fj	Scheduled	Successfully assigned openshift-ingress/e2e-shared-a-923c3a-openshift-default-5477845cdc-pr9fj to ip-10-0-128-59.ec2.internal
09:01:56	openshift-ingress		istiod-openshift-gateway-94bb8fbfd-tldtf	Scheduled	Successfully assigned openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tldtf to ip-10-0-140-31.ec2.internal
08:49:23	openshift-ingress	deployment-controller	router-default	ScalingReplicaSet	Scaled up replica set router-default-84d56f759d from 0 to 1
08:49:27	openshift-ingress	service-controller	router-default	UnAvailableLoadBalancer	There are no available nodes for LoadBalancer
08:49:27	openshift-ingress	service-controller	router-default	EnsuringLoadBalancer	Ensuring load balancer
08:49:31	openshift-ingress	service-controller	router-default	EnsuredLoadBalancer	Ensured load balancer
08:49:44 (x13)	openshift-ingress	replicaset-controller	router-default-84d56f759d	FailedCreate	Error creating: pods "router-default-84d56f759d-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
08:53:02 (x16)	openshift-ingress	replicaset-controller	router-default-84d56f759d	FailedCreate	Error creating: pods "router-default-84d56f759d-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
08:55:05 (x3)	openshift-ingress	service-controller	router-default	UpdatedLoadBalancer	Updated load balancer with new hosts
08:55:46	openshift-ingress	replicaset-controller	router-default-84d56f759d	SuccessfulCreate	Created pod: router-default-84d56f759d-97tbg
08:56:02 (x6)	openshift-ingress	kubelet	router-default-84d56f759d-97tbg	FailedMount	MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
08:56:02 (x6)	openshift-ingress	kubelet	router-default-84d56f759d-97tbg	FailedMount	MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
08:56:19	openshift-ingress	kubelet	router-default-84d56f759d-97tbg	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0595b1d6de8e08ddb61ce581075357331193db6206d341c15cf213514ef0f693" already present on machine
08:56:19	openshift-ingress	multus	router-default-84d56f759d-97tbg	AddedInterface	Add eth0 [10.134.0.10/23] from ovn-kubernetes
08:56:19	openshift-ingress	kubelet	router-default-84d56f759d-97tbg	Created	Created container: router
08:56:19	openshift-ingress	kubelet	router-default-84d56f759d-97tbg	Started	Started container router
09:01:49	openshift-ingress	replicaset-controller	kube-auth-proxy-856d68f954	SuccessfulCreate	Created pod: kube-auth-proxy-856d68f954-94qtz
09:01:49	openshift-ingress	deployment-controller	kube-auth-proxy	ScalingReplicaSet	Scaled up replica set kube-auth-proxy-856d68f954 from 0 to 2
09:01:49	openshift-ingress	kubelet	kube-auth-proxy-856d68f954-94qtz	FailedMount	MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found
09:01:49 (x5)	openshift-ingress	replicaset-controller	kube-auth-proxy-856d68f954	FailedCreate	Error creating: pods "kube-auth-proxy-856d68f954-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found
09:01:49	openshift-ingress	kubelet	kube-auth-proxy-856d68f954-nvhqr	FailedMount	MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found
09:01:49	openshift-ingress	replicaset-controller	kube-auth-proxy-856d68f954	SuccessfulCreate	Created pod: kube-auth-proxy-856d68f954-nvhqr
09:01:50	openshift-ingress	kubelet	kube-auth-proxy-856d68f954-94qtz	Pulling	Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"
09:01:50	openshift-ingress	multus	kube-auth-proxy-856d68f954-nvhqr	AddedInterface	Add eth0 [10.134.0.23/23] from ovn-kubernetes
09:01:50	openshift-ingress	multus	kube-auth-proxy-856d68f954-94qtz	AddedInterface	Add eth0 [10.133.0.20/23] from ovn-kubernetes
09:01:50	openshift-ingress	kubelet	kube-auth-proxy-856d68f954-nvhqr	Pulling	Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"
09:01:50	openshift-ingress	deployment-controller	istiod-openshift-gateway	ScalingReplicaSet	Scaled up replica set istiod-openshift-gateway-7574459656 from 0 to 1
09:01:50	openshift-ingress	multus	istiod-openshift-gateway-7574459656-jp2np	AddedInterface	Add eth0 [10.134.0.24/23] from ovn-kubernetes
09:01:50	openshift-ingress	replicaset-controller	istiod-openshift-gateway-7574459656	SuccessfulCreate	Created pod: istiod-openshift-gateway-7574459656-jp2np
09:01:51	openshift-ingress	kubelet	istiod-openshift-gateway-7574459656-jp2np	Pulling	Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:0850242436e88f7d82f0f2126de064c7e0f09844f31d8ff0f53dc8d3908075d9"
09:01:55	openshift-ingress	kubelet	kube-auth-proxy-856d68f954-nvhqr	Created	Created container: kube-auth-proxy
09:01:55	openshift-ingress	kubelet	kube-auth-proxy-856d68f954-94qtz	Created	Created container: kube-auth-proxy
09:01:55	openshift-ingress	kubelet	kube-auth-proxy-856d68f954-94qtz	Started	Started container kube-auth-proxy
09:01:55	openshift-ingress	kubelet	kube-auth-proxy-856d68f954-nvhqr	Started	Started container kube-auth-proxy
09:01:55	openshift-ingress	kubelet	kube-auth-proxy-856d68f954-nvhqr	Pulled	Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 5.011s (5.011s including waiting). Image size: 265120132 bytes.
09:01:55	openshift-ingress	kubelet	kube-auth-proxy-856d68f954-94qtz	Pulled	Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 4.384s (4.384s including waiting). Image size: 265120132 bytes.
09:01:56	openshift-ingress	deployment-controller	istiod-openshift-gateway	ScalingReplicaSet	Scaled up replica set istiod-openshift-gateway-94bb8fbfd from 0 to 1
09:01:56	openshift-ingress	replicaset-controller	istiod-openshift-gateway-94bb8fbfd	SuccessfulCreate	Created pod: istiod-openshift-gateway-94bb8fbfd-tldtf
09:01:57	openshift-ingress	kubelet	istiod-openshift-gateway-7574459656-jp2np	Pulled	Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:0850242436e88f7d82f0f2126de064c7e0f09844f31d8ff0f53dc8d3908075d9" in 6.074s (6.074s including waiting). Image size: 181034515 bytes.
09:01:57	openshift-ingress	kubelet	istiod-openshift-gateway-94bb8fbfd-tldtf	Pulling	Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:0850242436e88f7d82f0f2126de064c7e0f09844f31d8ff0f53dc8d3908075d9"
09:01:57	openshift-ingress	kubelet	istiod-openshift-gateway-7574459656-jp2np	Created	Created container: discovery
09:01:57	openshift-ingress	kubelet	istiod-openshift-gateway-7574459656-jp2np	Started	Started container discovery
09:01:57	openshift-ingress	multus	istiod-openshift-gateway-94bb8fbfd-tldtf	AddedInterface	Add eth0 [10.132.0.32/23] from ovn-kubernetes
09:01:58	openshift-ingress	replicaset-controller	data-science-gateway-data-science-gateway-class-6576859cf4	SuccessfulCreate	Created pod: data-science-gateway-data-science-gateway-class-6576859cf4f9phv
09:01:58	openshift-ingress	deployment-controller	data-science-gateway-data-science-gateway-class	ScalingReplicaSet	Scaled up replica set data-science-gateway-data-science-gateway-class-6576859cf4 from 0 to 1
09:01:59	openshift-ingress	kubelet	data-science-gateway-data-science-gateway-class-6576859cf4f9phv	Pulling	Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8"
09:01:59	openshift-ingress	kubelet	istiod-openshift-gateway-94bb8fbfd-tldtf	Pulled	Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:0850242436e88f7d82f0f2126de064c7e0f09844f31d8ff0f53dc8d3908075d9" in 2.435s (2.435s including waiting). Image size: 181034515 bytes.
09:01:59	openshift-ingress	kubelet	istiod-openshift-gateway-94bb8fbfd-tldtf	Created	Created container: discovery
09:01:59	openshift-ingress	kubelet	istiod-openshift-gateway-94bb8fbfd-tldtf	Started	Started container discovery
09:01:59	openshift-ingress	multus	data-science-gateway-data-science-gateway-class-6576859cf4f9phv	AddedInterface	Add eth0 [10.133.0.21/23] from ovn-kubernetes
09:02:00	openshift-ingress	kubelet	istiod-openshift-gateway-94bb8fbfd-tldtf	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
09:02:00	openshift-ingress	kubelet	istiod-openshift-gateway-94bb8fbfd-tldtf	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
09:02:01	openshift-ingress	deployment-controller	istiod-openshift-gateway	ScalingReplicaSet	Scaled down replica set istiod-openshift-gateway-7574459656 from 1 to 0
09:02:01	openshift-ingress	replicaset-controller	istiod-openshift-gateway-7574459656	SuccessfulDelete	Deleted pod: istiod-openshift-gateway-7574459656-jp2np
09:02:01	openshift-ingress	kubelet	istiod-openshift-gateway-7574459656-jp2np	Killing	Stopping container discovery
09:02:03	openshift-ingress	kubelet	data-science-gateway-data-science-gateway-class-6576859cf4f9phv	Pulled	Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" in 4.264s (4.264s including waiting). Image size: 181251556 bytes.
09:02:03	openshift-ingress	kubelet	data-science-gateway-data-science-gateway-class-6576859cf4f9phv	Created	Created container: istio-proxy
09:02:03	openshift-ingress	kubelet	data-science-gateway-data-science-gateway-class-6576859cf4f9phv	Started	Started container istio-proxy
09:02:04	openshift-ingress	horizontal-pod-autoscaler	kube-auth-proxy	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
09:02:04	openshift-ingress	horizontal-pod-autoscaler	kube-auth-proxy	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
09:02:19	openshift-ingress	horizontal-pod-autoscaler	kube-auth-proxy	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
09:02:19	openshift-ingress	horizontal-pod-autoscaler	kube-auth-proxy	FailedGetResourceMetric	failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
09:02:35 (x3)	openshift-ingress	horizontal-pod-autoscaler	istiod-openshift-gateway	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
09:02:35 (x3)	openshift-ingress	horizontal-pod-autoscaler	istiod-openshift-gateway	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
09:04:27	openshift-ingress	multus	maas-default-gateway-openshift-default-56654dcf7-kjqvh	AddedInterface	Add eth0 [10.134.0.38/23] from ovn-kubernetes
09:04:27	openshift-ingress	replicaset-controller	maas-default-gateway-openshift-default-56654dcf7	SuccessfulCreate	Created pod: maas-default-gateway-openshift-default-56654dcf7-kjqvh
09:04:27	openshift-ingress	gateway_labeler_controller	maas-default-gateway	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway
09:04:27	openshift-ingress	kubelet	maas-default-gateway-openshift-default-56654dcf7-kjqvh	Pulling	Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8"
09:04:27	openshift-ingress	deployment-controller	maas-default-gateway-openshift-default	ScalingReplicaSet	Scaled up replica set maas-default-gateway-openshift-default-56654dcf7 from 0 to 1
09:04:30	openshift-ingress	kubelet	maas-default-gateway-openshift-default-56654dcf7-kjqvh	Pulled	Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" in 3.037s (3.037s including waiting). Image size: 181251556 bytes.
09:05:54 (x4)	openshift-ingress	replicaset-controller	payload-pre-processing-74584bb9f8	FailedCreate	Error creating: pods "payload-pre-processing-74584bb9f8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found
09:05:54	openshift-ingress	multus	payload-pre-processing-74584bb9f8-hsnxz	AddedInterface	Add eth0 [10.132.0.40/23] from ovn-kubernetes
09:05:54	openshift-ingress	deployment-controller	payload-processing	ScalingReplicaSet	Scaled up replica set payload-processing-f9b8d9b9b from 0 to 1
09:05:54	openshift-ingress	replicaset-controller	payload-processing-f9b8d9b9b	SuccessfulCreate	Created pod: payload-processing-f9b8d9b9b-7v7p7
09:05:54	openshift-ingress	kubelet	payload-pre-processing-74584bb9f8-hsnxz	Pulling	Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:dc31b949d8c5ea8610b5c10ef53e2a199e00f0e0"
09:05:54	openshift-ingress	replicaset-controller	payload-pre-processing-74584bb9f8	SuccessfulCreate	Created pod: payload-pre-processing-74584bb9f8-hsnxz
09:05:54	openshift-ingress	deployment-controller	payload-pre-processing	ScalingReplicaSet	Scaled up replica set payload-pre-processing-74584bb9f8 from 0 to 1
09:05:54	openshift-ingress	multus	payload-processing-f9b8d9b9b-7v7p7	AddedInterface	Add eth0 [10.134.0.49/23] from ovn-kubernetes
09:05:54 (x5)	openshift-ingress	replicaset-controller	payload-processing-f9b8d9b9b	FailedCreate	Error creating: pods "payload-processing-f9b8d9b9b-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found
09:05:54	openshift-ingress	kubelet	payload-processing-f9b8d9b9b-7v7p7	Pulling	Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:dc31b949d8c5ea8610b5c10ef53e2a199e00f0e0"
09:05:56	openshift-ingress	kubelet	payload-pre-processing-74584bb9f8-hsnxz	Created	Created container: payload-pre-processing
09:05:56	openshift-ingress	kubelet	payload-processing-f9b8d9b9b-7v7p7	Pulled	Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:dc31b949d8c5ea8610b5c10ef53e2a199e00f0e0" in 1.824s (1.824s including waiting). Image size: 165432098 bytes.
09:05:56	openshift-ingress	kubelet	payload-pre-processing-74584bb9f8-hsnxz	Pulled	Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:dc31b949d8c5ea8610b5c10ef53e2a199e00f0e0" in 1.557s (1.557s including waiting). Image size: 165432098 bytes.
09:05:56	openshift-ingress	kubelet	payload-processing-f9b8d9b9b-7v7p7	Started	Started container payload-processing
09:05:56	openshift-ingress	kubelet	payload-pre-processing-74584bb9f8-hsnxz	Started	Started container payload-pre-processing
09:05:56	openshift-ingress	kubelet	payload-processing-f9b8d9b9b-7v7p7	Created	Created container: payload-processing
09:06:01	openshift-ingress	kubelet	maas-default-gateway-openshift-default-56654dcf7-kjqvh	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine
09:06:02 (x2)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-56654dcf7-kjqvh	Created	Created container: istio-proxy
09:06:02 (x2)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-56654dcf7-kjqvh	Started	Started container istio-proxy
09:06:06 (x4)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-56654dcf7-kjqvh	Unhealthy	Startup probe failed: Get "http://10.134.0.38:15021/healthz/ready": dial tcp 10.134.0.38:15021: connect: connection refused
09:06:06 (x4)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-56654dcf7-kjqvh	ProbeError	Startup probe error: Get "http://10.134.0.38:15021/healthz/ready": dial tcp 10.134.0.38:15021: connect: connection refused body:
09:21:45	openshift-ingress	gateway_labeler_controller	e2e-ait-5f4d028a	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-ait-5f4d028a
09:21:45	openshift-ingress	replicaset-controller	e2e-ait-5f4d028a-openshift-default-84977f447f	SuccessfulCreate	Created pod: e2e-ait-5f4d028a-openshift-default-84977f447f-5pnf6
09:21:45	openshift-ingress	deployment-controller	e2e-ait-5f4d028a-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-ait-5f4d028a-openshift-default-84977f447f from 0 to 1
09:21:45	openshift-ingress	service-controller	e2e-ait-5f4d028a-openshift-default	EnsuringLoadBalancer	Ensuring load balancer
09:21:46	openshift-ingress	kubelet	e2e-ait-5f4d028a-openshift-default-84977f447f-5pnf6	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine
09:21:46	openshift-ingress	kubelet	e2e-ait-5f4d028a-openshift-default-84977f447f-5pnf6	Started	Started container istio-proxy
09:21:46	openshift-ingress	kubelet	e2e-ait-5f4d028a-openshift-default-84977f447f-5pnf6	Created	Created container: istio-proxy
09:21:46	openshift-ingress	multus	e2e-ait-5f4d028a-openshift-default-84977f447f-5pnf6	AddedInterface	Add eth0 [10.133.0.25/23] from ovn-kubernetes
09:21:49	openshift-ingress	service-controller	e2e-ait-5f4d028a-openshift-default	EnsuredLoadBalancer	Ensured load balancer
09:21:52	openshift-ingress	kubelet	e2e-ait-5f4d028a-openshift-default-84977f447f-5pnf6	Killing	Stopping container istio-proxy
09:21:52	openshift-ingress	service-controller	e2e-ait-5f4d028a-openshift-default	DeletingLoadBalancer	Deleting load balancer
09:21:55	openshift-ingress	service-controller	e2e-ait-5f4d028a-openshift-default	DeletedLoadBalancer	Deleted load balancer
09:22:04	openshift-ingress	replicaset-controller	e2e-migrate-2d7d58ac-gw-openshift-default-676d86cc59	SuccessfulCreate	Created pod: e2e-migrate-2d7d58ac-gw-openshift-default-676d86cc59-wxb4w
09:22:04	openshift-ingress	service-controller	e2e-migrate-2d7d58ac-gw-openshift-default	EnsuringLoadBalancer	Ensuring load balancer
09:22:04	openshift-ingress	gateway_labeler_controller	e2e-migrate-2d7d58ac-gw	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-2d7d58ac-gw
09:22:04	openshift-ingress	deployment-controller	e2e-migrate-2d7d58ac-gw-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-migrate-2d7d58ac-gw-openshift-default-676d86cc59 from 0 to 1
09:22:05	openshift-ingress	kubelet	e2e-migrate-2d7d58ac-gw-openshift-default-676d86cc59-wxb4w	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine
09:22:05	openshift-ingress	multus	e2e-migrate-2d7d58ac-gw-openshift-default-676d86cc59-wxb4w	AddedInterface	Add eth0 [10.133.0.26/23] from ovn-kubernetes
09:22:05	openshift-ingress	kubelet	e2e-migrate-2d7d58ac-gw-openshift-default-676d86cc59-wxb4w	Started	Started container istio-proxy
09:22:05	openshift-ingress	kubelet	e2e-migrate-2d7d58ac-gw-openshift-default-676d86cc59-wxb4w	Created	Created container: istio-proxy
09:22:07	openshift-ingress	service-controller	e2e-migrate-2d7d58ac-gw-openshift-default	EnsuredLoadBalancer	Ensured load balancer
09:22:10	openshift-ingress	service-controller	e2e-migrate-2d7d58ac-gw-openshift-default	DeletingLoadBalancer	Deleting load balancer
09:22:10	openshift-ingress	kubelet	e2e-migrate-2d7d58ac-gw-openshift-default-676d86cc59-wxb4w	Killing	Stopping container istio-proxy
09:22:12	openshift-ingress	service-controller	e2e-migrate-2d7d58ac-gw-openshift-default	DeletedLoadBalancer	Deleted load balancer
09:22:23	openshift-ingress	service-controller	e2e-derive-ed97d282-openshift-default	EnsuringLoadBalancer	Ensuring load balancer
09:22:23	openshift-ingress	gateway_labeler_controller	e2e-derive-ed97d282	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-derive-ed97d282
09:22:23	openshift-ingress	deployment-controller	e2e-derive-ed97d282-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-derive-ed97d282-openshift-default-5fffff79ff from 0 to 1
09:22:23	openshift-ingress	replicaset-controller	e2e-derive-ed97d282-openshift-default-5fffff79ff	SuccessfulCreate	Created pod: e2e-derive-ed97d282-openshift-default-5fffff79ff-x6zvk
09:22:24	openshift-ingress	multus	e2e-derive-ed97d282-openshift-default-5fffff79ff-x6zvk	AddedInterface	Add eth0 [10.133.0.27/23] from ovn-kubernetes
09:22:24	openshift-ingress	kubelet	e2e-derive-ed97d282-openshift-default-5fffff79ff-x6zvk	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine
09:22:24	openshift-ingress	kubelet	e2e-derive-ed97d282-openshift-default-5fffff79ff-x6zvk	Created	Created container: istio-proxy
09:22:24	openshift-ingress	kubelet	e2e-derive-ed97d282-openshift-default-5fffff79ff-x6zvk	Started	Started container istio-proxy
09:22:27	openshift-ingress	service-controller	e2e-derive-ed97d282-openshift-default	EnsuredLoadBalancer	Ensured load balancer
09:22:29	openshift-ingress	service-controller	e2e-derive-ed97d282-openshift-default	DeletingLoadBalancer	Deleting load balancer
09:22:29	openshift-ingress	kubelet	e2e-derive-ed97d282-openshift-default-5fffff79ff-x6zvk	Killing	Stopping container istio-proxy
09:22:31	openshift-ingress	service-controller	e2e-derive-ed97d282-openshift-default	DeletedLoadBalancer	Deleted load balancer
09:24:22	openshift-ingress	deployment-controller	e2e-mt-8e4c8858-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-mt-8e4c8858-openshift-default-85d8b74979 from 0 to 1
09:24:22	openshift-ingress	replicaset-controller	e2e-mt-8e4c8858-openshift-default-85d8b74979	SuccessfulCreate	Created pod: e2e-mt-8e4c8858-openshift-default-85d8b74979-wfmxd
09:24:22	openshift-ingress	gateway_labeler_controller	e2e-mt-8e4c8858	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-mt-8e4c8858
09:24:22	openshift-ingress	multus	e2e-mt-8e4c8858-openshift-default-85d8b74979-wfmxd	AddedInterface	Add eth0 [10.133.0.28/23] from ovn-kubernetes
09:24:40 (x2)	openshift-ingress	kubelet	e2e-mt-8e4c8858-openshift-default-85d8b74979-wfmxd	Started	Started container istio-proxy
09:24:40 (x2)	openshift-ingress	kubelet	e2e-mt-8e4c8858-openshift-default-85d8b74979-wfmxd	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine
09:24:40 (x2)	openshift-ingress	kubelet	e2e-mt-8e4c8858-openshift-default-85d8b74979-wfmxd	Created	Created container: istio-proxy
09:24:40	openshift-ingress	kubelet	e2e-mt-8e4c8858-openshift-default-85d8b74979-wfmxd	ProbeError	Readiness probe error: Get "http://10.133.0.28:15021/healthz/ready": dial tcp 10.133.0.28:15021: connect: connection refused body:
09:24:40	openshift-ingress	kubelet	e2e-mt-8e4c8858-openshift-default-85d8b74979-wfmxd	Unhealthy	Readiness probe failed: Get "http://10.133.0.28:15021/healthz/ready": dial tcp 10.133.0.28:15021: connect: connection refused
09:24:44 (x4)	openshift-ingress	kubelet	e2e-mt-8e4c8858-openshift-default-85d8b74979-wfmxd	Unhealthy	Startup probe failed: Get "http://10.133.0.28:15021/healthz/ready": dial tcp 10.133.0.28:15021: connect: connection refused
09:24:44 (x4)	openshift-ingress	kubelet	e2e-mt-8e4c8858-openshift-default-85d8b74979-wfmxd	ProbeError	Startup probe error: Get "http://10.133.0.28:15021/healthz/ready": dial tcp 10.133.0.28:15021: connect: connection refused body:
09:24:50	openshift-ingress	kubelet	e2e-mt-8e4c8858-openshift-default-85d8b74979-wfmxd	Killing	Stopping container istio-proxy
09:26:05	openshift-ingress	replicaset-controller	e2e-inf-a-00d870-openshift-default-f465b6c5f	SuccessfulCreate	Created pod: e2e-inf-a-00d870-openshift-default-f465b6c5f-5dpkb
09:26:05	openshift-ingress	deployment-controller	e2e-inf-a-00d870-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-inf-a-00d870-openshift-default-f465b6c5f from 0 to 1
09:26:05	openshift-ingress	gateway_labeler_controller	e2e-inf-a-00d870	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-00d870
09:26:06	openshift-ingress	multus	e2e-inf-a-00d870-openshift-default-f465b6c5f-5dpkb	AddedInterface	Add eth0 [10.133.0.29/23] from ovn-kubernetes
09:26:13	openshift-ingress	gateway_labeler_controller	e2e-inf-b-cfc611	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-cfc611
09:26:13	openshift-ingress	deployment-controller	e2e-inf-b-cfc611-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-inf-b-cfc611-openshift-default-c9f686459 from 0 to 1
09:26:13	openshift-ingress	replicaset-controller	e2e-inf-b-cfc611-openshift-default-c9f686459	SuccessfulCreate	Created pod: e2e-inf-b-cfc611-openshift-default-c9f686459-qsj26
09:26:14	openshift-ingress	multus	e2e-inf-b-cfc611-openshift-default-c9f686459-qsj26	AddedInterface	Add eth0 [10.134.0.60/23] from ovn-kubernetes
09:26:23 (x2)	openshift-ingress	kubelet	e2e-inf-a-00d870-openshift-default-f465b6c5f-5dpkb	Started	Started container istio-proxy
09:26:23	openshift-ingress	kubelet	e2e-inf-a-00d870-openshift-default-f465b6c5f-5dpkb	Unhealthy	Readiness probe failed: Get "http://10.133.0.29:15021/healthz/ready": read tcp 10.133.0.2:50700->10.133.0.29:15021: read: connection reset by peer
09:26:23 (x2)	openshift-ingress	kubelet	e2e-inf-a-00d870-openshift-default-f465b6c5f-5dpkb	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine
09:26:23 (x2)	openshift-ingress	kubelet	e2e-inf-a-00d870-openshift-default-f465b6c5f-5dpkb	Created	Created container: istio-proxy
09:26:23	openshift-ingress	kubelet	e2e-inf-a-00d870-openshift-default-f465b6c5f-5dpkb	ProbeError	Readiness probe error: Get "http://10.133.0.29:15021/healthz/ready": read tcp 10.133.0.2:50700->10.133.0.29:15021: read: connection reset by peer body:
09:26:28 (x4)	openshift-ingress	kubelet	e2e-inf-a-00d870-openshift-default-f465b6c5f-5dpkb	ProbeError	Startup probe error: Get "http://10.133.0.29:15021/healthz/ready": dial tcp 10.133.0.29:15021: connect: connection refused body:
09:26:28 (x4)	openshift-ingress	kubelet	e2e-inf-a-00d870-openshift-default-f465b6c5f-5dpkb	Unhealthy	Startup probe failed: Get "http://10.133.0.29:15021/healthz/ready": dial tcp 10.133.0.29:15021: connect: connection refused
09:26:30 (x2)	openshift-ingress	kubelet	e2e-inf-b-cfc611-openshift-default-c9f686459-qsj26	Created	Created container: istio-proxy
09:26:30 (x2)	openshift-ingress	kubelet	e2e-inf-b-cfc611-openshift-default-c9f686459-qsj26	Started	Started container istio-proxy
09:26:30 (x2)	openshift-ingress	kubelet	e2e-inf-b-cfc611-openshift-default-c9f686459-qsj26	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine
09:26:35 (x4)	openshift-ingress	kubelet	e2e-inf-b-cfc611-openshift-default-c9f686459-qsj26	Unhealthy	Startup probe failed: Get "http://10.134.0.60:15021/healthz/ready": dial tcp 10.134.0.60:15021: connect: connection refused
09:26:35 (x4)	openshift-ingress	kubelet	e2e-inf-b-cfc611-openshift-default-c9f686459-qsj26	ProbeError	Startup probe error: Get "http://10.134.0.60:15021/healthz/ready": dial tcp 10.134.0.60:15021: connect: connection refused body:
09:28:31	openshift-ingress	kubelet	e2e-inf-a-00d870-openshift-default-f465b6c5f-5dpkb	Killing	Stopping container istio-proxy
09:28:45	openshift-ingress	kubelet	e2e-inf-b-cfc611-openshift-default-c9f686459-qsj26	Killing	Stopping container istio-proxy
09:28:46	openshift-ingress	gateway_labeler_controller	e2e-api-a-6b0aee	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-6b0aee
09:28:46	openshift-ingress	deployment-controller	e2e-api-a-6b0aee-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-api-a-6b0aee-openshift-default-865d44c4d9 from 0 to 1
09:28:46	openshift-ingress	replicaset-controller	e2e-api-a-6b0aee-openshift-default-865d44c4d9	SuccessfulCreate	Created pod: e2e-api-a-6b0aee-openshift-default-865d44c4d9-lqs7q
09:28:46	openshift-ingress	multus	e2e-api-a-6b0aee-openshift-default-865d44c4d9-lqs7q	AddedInterface	Add eth0 [10.133.0.32/23] from ovn-kubernetes
09:28:54	openshift-ingress	replicaset-controller	e2e-api-b-357950-openshift-default-6f6c596fbc	SuccessfulCreate	Created pod: e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p
09:28:54	openshift-ingress	gateway_labeler_controller	e2e-api-b-357950	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-357950
09:28:54	openshift-ingress	deployment-controller	e2e-api-b-357950-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-api-b-357950-openshift-default-6f6c596fbc from 0 to 1
09:28:55	openshift-ingress	multus	e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p	AddedInterface	Add eth0 [10.134.0.63/23] from ovn-kubernetes
09:29:00 (x2)	openshift-ingress	kubelet	e2e-api-a-6b0aee-openshift-default-865d44c4d9-lqs7q	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine
09:29:00 (x2)	openshift-ingress	kubelet	e2e-api-a-6b0aee-openshift-default-865d44c4d9-lqs7q	Created	Created container: istio-proxy
09:29:00 (x2)	openshift-ingress	kubelet	e2e-api-a-6b0aee-openshift-default-865d44c4d9-lqs7q	Started	Started container istio-proxy
09:29:04 (x4)	openshift-ingress	kubelet	e2e-api-a-6b0aee-openshift-default-865d44c4d9-lqs7q	ProbeError	Startup probe error: Get "http://10.133.0.32:15021/healthz/ready": dial tcp 10.133.0.32:15021: connect: connection refused body:
09:29:04 (x4)	openshift-ingress	kubelet	e2e-api-a-6b0aee-openshift-default-865d44c4d9-lqs7q	Unhealthy	Startup probe failed: Get "http://10.133.0.32:15021/healthz/ready": dial tcp 10.133.0.32:15021: connect: connection refused
09:29:13	openshift-ingress	kubelet	e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p	ProbeError	Readiness probe error: Get "http://10.134.0.63:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
09:29:13	openshift-ingress	kubelet	e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p	Unhealthy	Readiness probe failed: Get "http://10.134.0.63:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
09:29:15 (x2)	openshift-ingress	kubelet	e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine
09:29:15 (x2)	openshift-ingress	kubelet	e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p	Created	Created container: istio-proxy
09:29:15 (x2)	openshift-ingress	kubelet	e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p	Started	Started container istio-proxy
09:29:20 (x4)	openshift-ingress	kubelet	e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p	Unhealthy	Startup probe failed: Get "http://10.134.0.63:15021/healthz/ready": dial tcp 10.134.0.63:15021: connect: connection refused
09:29:20 (x4)	openshift-ingress	kubelet	e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p	ProbeError	Startup probe error: Get "http://10.134.0.63:15021/healthz/ready": dial tcp 10.134.0.63:15021: connect: connection refused body:
09:29:23	openshift-ingress	kubelet	e2e-api-a-6b0aee-openshift-default-865d44c4d9-lqs7q	Killing	Stopping container istio-proxy
09:29:36	openshift-ingress	kubelet	e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p	Killing	Stopping container istio-proxy
09:29:37	openshift-ingress	multus	e2e-shared-a-923c3a-openshift-default-5477845cdc-pr9fj	AddedInterface	Add eth0 [10.133.0.33/23] from ovn-kubernetes
09:29:37	openshift-ingress	gateway_labeler_controller	e2e-shared-a-923c3a	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-923c3a
09:29:37	openshift-ingress	deployment-controller	e2e-shared-a-923c3a-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-shared-a-923c3a-openshift-default-5477845cdc from 0 to 1
09:29:37	openshift-ingress	replicaset-controller	e2e-shared-a-923c3a-openshift-default-5477845cdc	SuccessfulCreate	Created pod: e2e-shared-a-923c3a-openshift-default-5477845cdc-pr9fj
09:29:45	openshift-ingress	gateway_labeler_controller	e2e-shared-b-800be8	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-800be8
09:29:45	openshift-ingress	deployment-controller	e2e-shared-b-800be8-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-shared-b-800be8-openshift-default-55ff497447 from 0 to 1
09:29:45	openshift-ingress	replicaset-controller	e2e-shared-b-800be8-openshift-default-55ff497447	SuccessfulCreate	Created pod: e2e-shared-b-800be8-openshift-default-55ff497447-r6gg2
09:29:46	openshift-ingress	multus	e2e-shared-b-800be8-openshift-default-55ff497447-r6gg2	AddedInterface	Add eth0 [10.133.0.34/23] from ovn-kubernetes
09:29:50 (x2)	openshift-ingress	kubelet	e2e-shared-a-923c3a-openshift-default-5477845cdc-pr9fj	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine
09:29:50 (x2)	openshift-ingress	kubelet	e2e-shared-a-923c3a-openshift-default-5477845cdc-pr9fj	Started	Started container istio-proxy
09:29:50 (x2)	openshift-ingress	kubelet	e2e-shared-a-923c3a-openshift-default-5477845cdc-pr9fj	Created	Created container: istio-proxy
09:29:54 (x4)	openshift-ingress	kubelet	e2e-shared-a-923c3a-openshift-default-5477845cdc-pr9fj	ProbeError	Startup probe error: Get "http://10.133.0.33:15021/healthz/ready": dial tcp 10.133.0.33:15021: connect: connection refused body:
09:29:54 (x4)	openshift-ingress	kubelet	e2e-shared-a-923c3a-openshift-default-5477845cdc-pr9fj	Unhealthy	Startup probe failed: Get "http://10.133.0.33:15021/healthz/ready": dial tcp 10.133.0.33:15021: connect: connection refused
09:29:58 (x2)	openshift-ingress	kubelet	e2e-shared-b-800be8-openshift-default-55ff497447-r6gg2	Created	Created container: istio-proxy
09:29:58 (x2)	openshift-ingress	kubelet	e2e-shared-b-800be8-openshift-default-55ff497447-r6gg2	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine
09:29:58 (x2)	openshift-ingress	kubelet	e2e-shared-b-800be8-openshift-default-55ff497447-r6gg2	Started	Started container istio-proxy
09:30:03 (x4)	openshift-ingress	kubelet	e2e-shared-b-800be8-openshift-default-55ff497447-r6gg2	ProbeError	Startup probe error: Get "http://10.133.0.34:15021/healthz/ready": dial tcp 10.133.0.34:15021: connect: connection refused body:
09:30:03 (x4)	openshift-ingress	kubelet	e2e-shared-b-800be8-openshift-default-55ff497447-r6gg2	Unhealthy	Startup probe failed: Get "http://10.133.0.34:15021/healthz/ready": dial tcp 10.133.0.34:15021: connect: connection refused
09:36:01	openshift-ingress	kubelet	e2e-shared-a-923c3a-openshift-default-5477845cdc-pr9fj	Killing	Stopping container istio-proxy
09:36:14	openshift-ingress	kubelet	e2e-shared-b-800be8-openshift-default-55ff497447-r6gg2	Killing	Stopping container istio-proxy
09:36:19	openshift-ingress	kubelet	e2e-shared-b-800be8-openshift-default-55ff497447-r6gg2	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
09:36:19	openshift-ingress	kubelet	e2e-shared-b-800be8-openshift-default-55ff497447-r6gg2	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body: