Events

Time	Namespace	Component	RelatedObject	Reason	Message
00:59:40	openshift-ingress		data-science-gateway-data-science-gateway-class-548557588-6bnl4	Scheduled	Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-6bnl4 to ip-10-0-133-31.ec2.internal
01:34:38	openshift-ingress		test-curl-7700-140124472305536	Scheduled	Successfully assigned openshift-ingress/test-curl-7700-140124472305536 to ip-10-0-134-227.ec2.internal
00:55:27	openshift-ingress		router-default-59b7486ffc-xdjvw	Scheduled	Successfully assigned openshift-ingress/router-default-59b7486ffc-xdjvw to ip-10-0-133-31.ec2.internal
00:55:25	openshift-ingress		router-default-59b7486ffc-xdjvw	FailedScheduling	0/2 nodes are available: 2 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/2 nodes are available: 2 Preemption is not helpful for scheduling.
01:22:36	openshift-ingress		e2e-mt-e0f06239-openshift-default-66bdb889f5-2vgl6	Scheduled	Successfully assigned openshift-ingress/e2e-mt-e0f06239-openshift-default-66bdb889f5-2vgl6 to ip-10-0-133-31.ec2.internal
01:03:47	openshift-ingress		payload-processing-58f86c7798-4cndj	Scheduled	Successfully assigned openshift-ingress/payload-processing-58f86c7798-4cndj to ip-10-0-134-227.ec2.internal
01:21:56	openshift-ingress		e2e-mt-6b5edbb9-openshift-default-74dcd66d75-stdrb	Scheduled	Successfully assigned openshift-ingress/e2e-mt-6b5edbb9-openshift-default-74dcd66d75-stdrb to ip-10-0-133-31.ec2.internal
01:28:26	openshift-ingress		e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j	Scheduled	Successfully assigned openshift-ingress/e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j to ip-10-0-133-31.ec2.internal
01:28:13	openshift-ingress		e2e-shared-a-88a238-openshift-default-6f5f9c75d7-98f5h	Scheduled	Successfully assigned openshift-ingress/e2e-shared-a-88a238-openshift-default-6f5f9c75d7-98f5h to ip-10-0-134-128.ec2.internal
01:25:33	openshift-ingress		e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz	Scheduled	Successfully assigned openshift-ingress/e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz to ip-10-0-133-31.ec2.internal
00:59:33	openshift-ingress		istiod-openshift-gateway-7574459656-49v8q	Scheduled	Successfully assigned openshift-ingress/istiod-openshift-gateway-7574459656-49v8q to ip-10-0-134-227.ec2.internal
01:25:24	openshift-ingress		e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc	Scheduled	Successfully assigned openshift-ingress/e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc to ip-10-0-133-31.ec2.internal
00:59:40	openshift-ingress		data-science-gateway-data-science-gateway-class-7f964fb678fwkbp	Scheduled	Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678fwkbp to ip-10-0-133-31.ec2.internal
00:59:39	openshift-ingress		istiod-openshift-gateway-94bb8fbfd-w7jdz	Scheduled	Successfully assigned openshift-ingress/istiod-openshift-gateway-94bb8fbfd-w7jdz to ip-10-0-134-128.ec2.internal
01:27:35	openshift-ingress		e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd	Scheduled	Successfully assigned openshift-ingress/e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd to ip-10-0-133-31.ec2.internal
01:20:10	openshift-ingress		e2e-derive-488986e9-openshift-default-56bdc775d7-2tzkh	Scheduled	Successfully assigned openshift-ingress/e2e-derive-488986e9-openshift-default-56bdc775d7-2tzkh to ip-10-0-133-31.ec2.internal
01:03:47	openshift-ingress		payload-pre-processing-7964457696-v9n8r	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-7964457696-v9n8r to ip-10-0-134-227.ec2.internal
00:59:32	openshift-ingress		kube-auth-proxy-7556c75c9b-848b5	Scheduled	Successfully assigned openshift-ingress/kube-auth-proxy-7556c75c9b-848b5 to ip-10-0-134-227.ec2.internal
01:34:35	openshift-ingress		test-curl-7700-140124472305536	Scheduled	Successfully assigned openshift-ingress/test-curl-7700-140124472305536 to ip-10-0-134-227.ec2.internal
01:34:44	openshift-ingress		test-curl-7700-140124470191856	Scheduled	Successfully assigned openshift-ingress/test-curl-7700-140124470191856 to ip-10-0-134-227.ec2.internal
01:34:41	openshift-ingress		test-curl-7700-140124470191856	Scheduled	Successfully assigned openshift-ingress/test-curl-7700-140124470191856 to ip-10-0-134-227.ec2.internal
01:19:39	openshift-ingress		e2e-ait-a486953c-openshift-default-dfcc6bbbf-fsmbq	Scheduled	Successfully assigned openshift-ingress/e2e-ait-a486953c-openshift-default-dfcc6bbbf-fsmbq to ip-10-0-133-31.ec2.internal
01:34:29	openshift-ingress		test-curl-7700-140124469915056	Scheduled	Successfully assigned openshift-ingress/test-curl-7700-140124469915056 to ip-10-0-134-227.ec2.internal
01:34:32	openshift-ingress		test-curl-7700-140124469915696	Scheduled	Successfully assigned openshift-ingress/test-curl-7700-140124469915696 to ip-10-0-134-227.ec2.internal
01:19:52	openshift-ingress		e2e-ait-e6bc8ba4-openshift-default-6dbc9d78c7-hpmxj	Scheduled	Successfully assigned openshift-ingress/e2e-ait-e6bc8ba4-openshift-default-6dbc9d78c7-hpmxj to ip-10-0-133-31.ec2.internal
01:02:19	openshift-ingress		maas-default-gateway-openshift-default-5896d4dd49-5mpgg	Scheduled	Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-5mpgg to ip-10-0-134-227.ec2.internal
00:59:32	openshift-ingress		kube-auth-proxy-7556c75c9b-7tw9t	Scheduled	Successfully assigned openshift-ingress/kube-auth-proxy-7556c75c9b-7tw9t to ip-10-0-134-128.ec2.internal
01:27:44	openshift-ingress		e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh	Scheduled	Successfully assigned openshift-ingress/e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh to ip-10-0-133-31.ec2.internal
00:49:01	openshift-ingress	deployment-controller	router-default	ScalingReplicaSet	Scaled up replica set router-default-59b7486ffc from 0 to 1
00:49:22 (x13)	openshift-ingress	replicaset-controller	router-default-59b7486ffc	FailedCreate	Error creating: pods "router-default-59b7486ffc-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
00:49:42	openshift-ingress	service-controller	router-default	UnAvailableLoadBalancer	There are no available nodes for LoadBalancer
00:49:42	openshift-ingress	service-controller	router-default	EnsuringLoadBalancer	Ensuring load balancer
00:49:46	openshift-ingress	service-controller	router-default	EnsuredLoadBalancer	Ensured load balancer
00:52:41 (x16)	openshift-ingress	replicaset-controller	router-default-59b7486ffc	FailedCreate	Error creating: pods "router-default-59b7486ffc-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
00:55:25	openshift-ingress	replicaset-controller	router-default-59b7486ffc	SuccessfulCreate	Created pod: router-default-59b7486ffc-xdjvw
00:55:37 (x3)	openshift-ingress	service-controller	router-default	UpdatedLoadBalancer	Updated load balancer with new hosts
00:55:43 (x6)	openshift-ingress	kubelet	router-default-59b7486ffc-xdjvw	FailedMount	MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
00:55:43 (x6)	openshift-ingress	kubelet	router-default-59b7486ffc-xdjvw	FailedMount	MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
00:56:00	openshift-ingress	kubelet	router-default-59b7486ffc-xdjvw	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:32d6df0cb6282bc5ba571a8de322fe598afdf22e817f5a7dc92db3274dbdb9a1" already present on machine
00:56:00	openshift-ingress	multus	router-default-59b7486ffc-xdjvw	AddedInterface	Add eth0 [10.132.0.13/23] from ovn-kubernetes
00:56:01	openshift-ingress	kubelet	router-default-59b7486ffc-xdjvw	Started	Started container router
00:56:01	openshift-ingress	kubelet	router-default-59b7486ffc-xdjvw	Created	Created container: router
00:59:32	openshift-ingress	replicaset-controller	kube-auth-proxy-7556c75c9b	SuccessfulCreate	Created pod: kube-auth-proxy-7556c75c9b-848b5
00:59:32	openshift-ingress	deployment-controller	kube-auth-proxy	ScalingReplicaSet	Scaled up replica set kube-auth-proxy-7556c75c9b from 0 to 2
00:59:32	openshift-ingress	replicaset-controller	kube-auth-proxy-7556c75c9b	SuccessfulCreate	Created pod: kube-auth-proxy-7556c75c9b-7tw9t
00:59:32 (x5)	openshift-ingress	replicaset-controller	kube-auth-proxy-7556c75c9b	FailedCreate	Error creating: pods "kube-auth-proxy-7556c75c9b-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found
00:59:33	openshift-ingress	kubelet	kube-auth-proxy-7556c75c9b-7tw9t	Pulling	Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"
00:59:33	openshift-ingress	multus	kube-auth-proxy-7556c75c9b-7tw9t	AddedInterface	Add eth0 [10.134.0.21/23] from ovn-kubernetes
00:59:33	openshift-ingress	deployment-controller	istiod-openshift-gateway	ScalingReplicaSet	Scaled up replica set istiod-openshift-gateway-7574459656 from 0 to 1
00:59:33	openshift-ingress	multus	kube-auth-proxy-7556c75c9b-848b5	AddedInterface	Add eth0 [10.133.0.27/23] from ovn-kubernetes
00:59:33	openshift-ingress	kubelet	kube-auth-proxy-7556c75c9b-848b5	Pulling	Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"
00:59:33	openshift-ingress	replicaset-controller	istiod-openshift-gateway-7574459656	SuccessfulCreate	Created pod: istiod-openshift-gateway-7574459656-49v8q
00:59:34	openshift-ingress	multus	istiod-openshift-gateway-7574459656-49v8q	AddedInterface	Add eth0 [10.133.0.29/23] from ovn-kubernetes
00:59:34	openshift-ingress	kubelet	istiod-openshift-gateway-7574459656-49v8q	Pulling	Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:0850242436e88f7d82f0f2126de064c7e0f09844f31d8ff0f53dc8d3908075d9"
00:59:36	openshift-ingress	kubelet	kube-auth-proxy-7556c75c9b-7tw9t	Created	Created container: kube-auth-proxy
00:59:36	openshift-ingress	kubelet	kube-auth-proxy-7556c75c9b-7tw9t	Pulled	Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.998s (2.998s including waiting). Image size: 265120132 bytes.
00:59:36	openshift-ingress	kubelet	kube-auth-proxy-7556c75c9b-7tw9t	Started	Started container kube-auth-proxy
00:59:38	openshift-ingress	kubelet	kube-auth-proxy-7556c75c9b-848b5	Started	Started container kube-auth-proxy
00:59:38	openshift-ingress	kubelet	kube-auth-proxy-7556c75c9b-848b5	Created	Created container: kube-auth-proxy
00:59:38	openshift-ingress	kubelet	istiod-openshift-gateway-7574459656-49v8q	Created	Created container: discovery
00:59:38	openshift-ingress	kubelet	istiod-openshift-gateway-7574459656-49v8q	Started	Started container discovery
00:59:38	openshift-ingress	kubelet	kube-auth-proxy-7556c75c9b-848b5	Pulled	Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 5.663s (5.663s including waiting). Image size: 265120132 bytes.
00:59:38	openshift-ingress	kubelet	istiod-openshift-gateway-7574459656-49v8q	Pulled	Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:0850242436e88f7d82f0f2126de064c7e0f09844f31d8ff0f53dc8d3908075d9" in 4.601s (4.601s including waiting). Image size: 181034515 bytes.
00:59:39	openshift-ingress	deployment-controller	istiod-openshift-gateway	ScalingReplicaSet	Scaled up replica set istiod-openshift-gateway-94bb8fbfd from 0 to 1
00:59:39	openshift-ingress	kubelet	istiod-openshift-gateway-7574459656-49v8q	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
00:59:39	openshift-ingress	kubelet	istiod-openshift-gateway-7574459656-49v8q	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
00:59:39	openshift-ingress	multus	istiod-openshift-gateway-94bb8fbfd-w7jdz	AddedInterface	Add eth0 [10.134.0.22/23] from ovn-kubernetes
00:59:39	openshift-ingress	kubelet	istiod-openshift-gateway-94bb8fbfd-w7jdz	Pulling	Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:0850242436e88f7d82f0f2126de064c7e0f09844f31d8ff0f53dc8d3908075d9"
00:59:39	openshift-ingress	replicaset-controller	istiod-openshift-gateway-94bb8fbfd	SuccessfulCreate	Created pod: istiod-openshift-gateway-94bb8fbfd-w7jdz
00:59:40	openshift-ingress	deployment-controller	data-science-gateway-data-science-gateway-class	ScalingReplicaSet	Scaled up replica set data-science-gateway-data-science-gateway-class-548557588 from 0 to 1
00:59:40	openshift-ingress	deployment-controller	data-science-gateway-data-science-gateway-class	ScalingReplicaSet	Scaled up replica set data-science-gateway-data-science-gateway-class-7f964fb678 from 0 to 1
00:59:40	openshift-ingress	replicaset-controller	data-science-gateway-data-science-gateway-class-548557588	SuccessfulCreate	Created pod: data-science-gateway-data-science-gateway-class-548557588-6bnl4
00:59:40	openshift-ingress	multus	data-science-gateway-data-science-gateway-class-548557588-6bnl4	AddedInterface	Add eth0 [10.132.0.26/23] from ovn-kubernetes
00:59:40	openshift-ingress	replicaset-controller	data-science-gateway-data-science-gateway-class-7f964fb678	SuccessfulCreate	Created pod: data-science-gateway-data-science-gateway-class-7f964fb678fwkbp
00:59:40	openshift-ingress	kubelet	data-science-gateway-data-science-gateway-class-548557588-6bnl4	Pulling	Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8"
00:59:41	openshift-ingress	multus	data-science-gateway-data-science-gateway-class-7f964fb678fwkbp	AddedInterface	Add eth0 [10.132.0.27/23] from ovn-kubernetes
00:59:41	openshift-ingress	kubelet	data-science-gateway-data-science-gateway-class-7f964fb678fwkbp	Pulling	Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8"
00:59:41	openshift-ingress	kubelet	istiod-openshift-gateway-94bb8fbfd-w7jdz	Pulled	Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:0850242436e88f7d82f0f2126de064c7e0f09844f31d8ff0f53dc8d3908075d9" in 2.22s (2.22s including waiting). Image size: 181034515 bytes.
00:59:42	openshift-ingress	kubelet	istiod-openshift-gateway-94bb8fbfd-w7jdz	Started	Started container discovery
00:59:42	openshift-ingress	kubelet	istiod-openshift-gateway-94bb8fbfd-w7jdz	Created	Created container: discovery
00:59:43	openshift-ingress	kubelet	istiod-openshift-gateway-94bb8fbfd-w7jdz	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
00:59:43	openshift-ingress	kubelet	istiod-openshift-gateway-94bb8fbfd-w7jdz	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
00:59:44	openshift-ingress	kubelet	data-science-gateway-data-science-gateway-class-548557588-6bnl4	Started	Started container istio-proxy
00:59:44	openshift-ingress	kubelet	data-science-gateway-data-science-gateway-class-548557588-6bnl4	Created	Created container: istio-proxy
00:59:44	openshift-ingress	kubelet	data-science-gateway-data-science-gateway-class-7f964fb678fwkbp	Pulled	Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" in 3.084s (3.084s including waiting). Image size: 181251556 bytes.
00:59:44	openshift-ingress	kubelet	data-science-gateway-data-science-gateway-class-548557588-6bnl4	Pulled	Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" in 3.432s (3.432s including waiting). Image size: 181251556 bytes.
00:59:44	openshift-ingress	kubelet	data-science-gateway-data-science-gateway-class-7f964fb678fwkbp	Created	Created container: istio-proxy
00:59:44	openshift-ingress	kubelet	data-science-gateway-data-science-gateway-class-7f964fb678fwkbp	Started	Started container istio-proxy
00:59:45	openshift-ingress	deployment-controller	data-science-gateway-data-science-gateway-class	ScalingReplicaSet	Scaled down replica set data-science-gateway-data-science-gateway-class-548557588 from 1 to 0
00:59:45	openshift-ingress	replicaset-controller	data-science-gateway-data-science-gateway-class-548557588	SuccessfulDelete	Deleted pod: data-science-gateway-data-science-gateway-class-548557588-6bnl4
00:59:46 (x2)	openshift-ingress	kubelet	data-science-gateway-data-science-gateway-class-548557588-6bnl4	ProbeError	Startup probe error: Get "http://10.132.0.26:15021/healthz/ready": dial tcp 10.132.0.26:15021: connect: connection refused body:
00:59:46	openshift-ingress	deployment-controller	istiod-openshift-gateway	ScalingReplicaSet	Scaled down replica set istiod-openshift-gateway-7574459656 from 1 to 0
00:59:46	openshift-ingress	kubelet	istiod-openshift-gateway-7574459656-49v8q	Killing	Stopping container discovery
00:59:46	openshift-ingress	replicaset-controller	istiod-openshift-gateway-7574459656	SuccessfulDelete	Deleted pod: istiod-openshift-gateway-7574459656-49v8q
00:59:46 (x2)	openshift-ingress	kubelet	data-science-gateway-data-science-gateway-class-548557588-6bnl4	Unhealthy	Startup probe failed: Get "http://10.132.0.26:15021/healthz/ready": dial tcp 10.132.0.26:15021: connect: connection refused
00:59:47	openshift-ingress	horizontal-pod-autoscaler	kube-auth-proxy	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
00:59:47	openshift-ingress	horizontal-pod-autoscaler	kube-auth-proxy	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
00:59:47	openshift-ingress	kubelet	data-science-gateway-data-science-gateway-class-548557588-6bnl4	Killing	Stopping container istio-proxy
00:59:48	openshift-ingress	horizontal-pod-autoscaler	istiod-openshift-gateway	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
00:59:48	openshift-ingress	horizontal-pod-autoscaler	istiod-openshift-gateway	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
01:00:02	openshift-ingress	horizontal-pod-autoscaler	kube-auth-proxy	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
01:00:02	openshift-ingress	horizontal-pod-autoscaler	kube-auth-proxy	FailedGetResourceMetric	failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
01:00:03	openshift-ingress	horizontal-pod-autoscaler	istiod-openshift-gateway	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
01:00:03	openshift-ingress	horizontal-pod-autoscaler	istiod-openshift-gateway	FailedGetResourceMetric	failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
01:02:19	openshift-ingress	replicaset-controller	maas-default-gateway-openshift-default-5896d4dd49	SuccessfulCreate	Created pod: maas-default-gateway-openshift-default-5896d4dd49-5mpgg
01:02:19	openshift-ingress	deployment-controller	maas-default-gateway-openshift-default	ScalingReplicaSet	Scaled up replica set maas-default-gateway-openshift-default-5896d4dd49 from 0 to 1
01:02:19	openshift-ingress	gateway_labeler_controller	maas-default-gateway	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway
01:02:19	openshift-ingress	multus	maas-default-gateway-openshift-default-5896d4dd49-5mpgg	AddedInterface	Add eth0 [10.133.0.47/23] from ovn-kubernetes
01:02:19	openshift-ingress	kubelet	maas-default-gateway-openshift-default-5896d4dd49-5mpgg	Pulling	Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8"
01:02:22	openshift-ingress	kubelet	maas-default-gateway-openshift-default-5896d4dd49-5mpgg	Pulled	Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" in 3.051s (3.051s including waiting). Image size: 181251556 bytes.
01:03:47	openshift-ingress	replicaset-controller	payload-pre-processing-7964457696	SuccessfulCreate	Created pod: payload-pre-processing-7964457696-v9n8r
01:03:47	openshift-ingress	deployment-controller	payload-processing	ScalingReplicaSet	Scaled up replica set payload-processing-58f86c7798 from 0 to 1
01:03:47	openshift-ingress	replicaset-controller	payload-processing-58f86c7798	SuccessfulCreate	Created pod: payload-processing-58f86c7798-4cndj
01:03:47 (x5)	openshift-ingress	replicaset-controller	payload-processing-58f86c7798	FailedCreate	Error creating: pods "payload-processing-58f86c7798-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found
01:03:47	openshift-ingress	deployment-controller	payload-pre-processing	ScalingReplicaSet	Scaled up replica set payload-pre-processing-7964457696 from 0 to 1
01:03:47 (x4)	openshift-ingress	replicaset-controller	payload-pre-processing-7964457696	FailedCreate	Error creating: pods "payload-pre-processing-7964457696-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found
01:03:48	openshift-ingress	multus	payload-pre-processing-7964457696-v9n8r	AddedInterface	Add eth0 [10.133.0.57/23] from ovn-kubernetes
01:03:48	openshift-ingress	kubelet	payload-pre-processing-7964457696-v9n8r	Pulling	Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:dc31b949d8c5ea8610b5c10ef53e2a199e00f0e0"
01:03:48	openshift-ingress	kubelet	payload-processing-58f86c7798-4cndj	Pulling	Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:dc31b949d8c5ea8610b5c10ef53e2a199e00f0e0"
01:03:48	openshift-ingress	multus	payload-processing-58f86c7798-4cndj	AddedInterface	Add eth0 [10.133.0.58/23] from ovn-kubernetes
01:03:50	openshift-ingress	kubelet	payload-processing-58f86c7798-4cndj	Pulled	Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:dc31b949d8c5ea8610b5c10ef53e2a199e00f0e0" in 2.098s (2.098s including waiting). Image size: 165432098 bytes.
01:03:50	openshift-ingress	kubelet	payload-processing-58f86c7798-4cndj	Created	Created container: payload-processing
01:03:50	openshift-ingress	kubelet	payload-processing-58f86c7798-4cndj	Started	Started container payload-processing
01:03:50	openshift-ingress	kubelet	payload-pre-processing-7964457696-v9n8r	Created	Created container: payload-pre-processing
01:03:50	openshift-ingress	kubelet	payload-pre-processing-7964457696-v9n8r	Pulled	Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:dc31b949d8c5ea8610b5c10ef53e2a199e00f0e0" in 2.113s (2.113s including waiting). Image size: 165432098 bytes.
01:03:50	openshift-ingress	kubelet	payload-pre-processing-7964457696-v9n8r	Started	Started container payload-pre-processing
01:03:55	openshift-ingress	kubelet	maas-default-gateway-openshift-default-5896d4dd49-5mpgg	Unhealthy	Readiness probe failed: Get "http://10.133.0.47:15021/healthz/ready": read tcp 10.133.0.2:44566->10.133.0.47:15021: read: connection reset by peer
01:03:55	openshift-ingress	kubelet	maas-default-gateway-openshift-default-5896d4dd49-5mpgg	ProbeError	Readiness probe error: Get "http://10.133.0.47:15021/healthz/ready": read tcp 10.133.0.2:44566->10.133.0.47:15021: read: connection reset by peer body:
01:03:56 (x2)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-5896d4dd49-5mpgg	Started	Started container istio-proxy
01:03:56 (x2)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-5896d4dd49-5mpgg	Created	Created container: istio-proxy
01:03:56	openshift-ingress	kubelet	maas-default-gateway-openshift-default-5896d4dd49-5mpgg	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine
01:04:00 (x3)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-5896d4dd49-5mpgg	Unhealthy	Startup probe failed: Get "http://10.133.0.47:15021/healthz/ready": dial tcp 10.133.0.47:15021: connect: connection refused
01:04:00 (x3)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-5896d4dd49-5mpgg	ProbeError	Startup probe error: Get "http://10.133.0.47:15021/healthz/ready": dial tcp 10.133.0.47:15021: connect: connection refused body:
01:19:39	openshift-ingress	service-controller	e2e-ait-a486953c-openshift-default	EnsuringLoadBalancer	Ensuring load balancer
01:19:39	openshift-ingress	deployment-controller	e2e-ait-a486953c-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-ait-a486953c-openshift-default-dfcc6bbbf from 0 to 1
01:19:39	openshift-ingress	gateway_labeler_controller	e2e-ait-a486953c	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-ait-a486953c
01:19:39	openshift-ingress	replicaset-controller	e2e-ait-a486953c-openshift-default-dfcc6bbbf	SuccessfulCreate	Created pod: e2e-ait-a486953c-openshift-default-dfcc6bbbf-fsmbq
01:19:40	openshift-ingress	kubelet	e2e-ait-a486953c-openshift-default-dfcc6bbbf-fsmbq	Started	Started container istio-proxy
01:19:40	openshift-ingress	kubelet	e2e-ait-a486953c-openshift-default-dfcc6bbbf-fsmbq	Created	Created container: istio-proxy
01:19:40	openshift-ingress	kubelet	e2e-ait-a486953c-openshift-default-dfcc6bbbf-fsmbq	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine
01:19:40	openshift-ingress	multus	e2e-ait-a486953c-openshift-default-dfcc6bbbf-fsmbq	AddedInterface	Add eth0 [10.132.0.34/23] from ovn-kubernetes
01:19:43	openshift-ingress	service-controller	e2e-ait-a486953c-openshift-default	EnsuredLoadBalancer	Ensured load balancer
01:19:46	openshift-ingress	kubelet	e2e-ait-a486953c-openshift-default-dfcc6bbbf-fsmbq	Killing	Stopping container istio-proxy
01:19:46	openshift-ingress	service-controller	e2e-ait-a486953c-openshift-default	DeletingLoadBalancer	Deleting load balancer
01:19:48	openshift-ingress	service-controller	e2e-ait-a486953c-openshift-default	DeletedLoadBalancer	Deleted load balancer
01:19:52	openshift-ingress	replicaset-controller	e2e-ait-e6bc8ba4-openshift-default-6dbc9d78c7	SuccessfulCreate	Created pod: e2e-ait-e6bc8ba4-openshift-default-6dbc9d78c7-hpmxj
01:19:52	openshift-ingress	service-controller	e2e-ait-e6bc8ba4-openshift-default	EnsuringLoadBalancer	Ensuring load balancer
01:19:52	openshift-ingress	kubelet	e2e-ait-e6bc8ba4-openshift-default-6dbc9d78c7-hpmxj	Started	Started container istio-proxy
01:19:52	openshift-ingress	kubelet	e2e-ait-e6bc8ba4-openshift-default-6dbc9d78c7-hpmxj	Created	Created container: istio-proxy
01:19:52	openshift-ingress	gateway_labeler_controller	e2e-ait-e6bc8ba4	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-ait-e6bc8ba4
01:19:52	openshift-ingress	kubelet	e2e-ait-e6bc8ba4-openshift-default-6dbc9d78c7-hpmxj	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine
01:19:52	openshift-ingress	deployment-controller	e2e-ait-e6bc8ba4-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-ait-e6bc8ba4-openshift-default-6dbc9d78c7 from 0 to 1
01:19:52	openshift-ingress	multus	e2e-ait-e6bc8ba4-openshift-default-6dbc9d78c7-hpmxj	AddedInterface	Add eth0 [10.132.0.35/23] from ovn-kubernetes
01:19:55	openshift-ingress	service-controller	e2e-ait-e6bc8ba4-openshift-default	EnsuredLoadBalancer	Ensured load balancer
01:20:04	openshift-ingress	kubelet	e2e-ait-e6bc8ba4-openshift-default-6dbc9d78c7-hpmxj	Killing	Stopping container istio-proxy
01:20:04	openshift-ingress	service-controller	e2e-ait-e6bc8ba4-openshift-default	DeletingLoadBalancer	Deleting load balancer
01:20:07	openshift-ingress	service-controller	e2e-ait-e6bc8ba4-openshift-default	DeletedLoadBalancer	Deleted load balancer
01:20:08	openshift-ingress	kubelet	e2e-ait-e6bc8ba4-openshift-default-6dbc9d78c7-hpmxj	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
01:20:08	openshift-ingress	kubelet	e2e-ait-e6bc8ba4-openshift-default-6dbc9d78c7-hpmxj	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
01:20:10	openshift-ingress	gateway_labeler_controller	e2e-derive-488986e9	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-derive-488986e9
01:20:10	openshift-ingress	service-controller	e2e-derive-488986e9-openshift-default	EnsuringLoadBalancer	Ensuring load balancer
01:20:10	openshift-ingress	deployment-controller	e2e-derive-488986e9-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-derive-488986e9-openshift-default-56bdc775d7 from 0 to 1
01:20:10	openshift-ingress	replicaset-controller	e2e-derive-488986e9-openshift-default-56bdc775d7	SuccessfulCreate	Created pod: e2e-derive-488986e9-openshift-default-56bdc775d7-2tzkh
01:20:11	openshift-ingress	kubelet	e2e-derive-488986e9-openshift-default-56bdc775d7-2tzkh	Started	Started container istio-proxy
01:20:11	openshift-ingress	kubelet	e2e-derive-488986e9-openshift-default-56bdc775d7-2tzkh	Created	Created container: istio-proxy
01:20:11	openshift-ingress	kubelet	e2e-derive-488986e9-openshift-default-56bdc775d7-2tzkh	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine
01:20:11	openshift-ingress	multus	e2e-derive-488986e9-openshift-default-56bdc775d7-2tzkh	AddedInterface	Add eth0 [10.132.0.36/23] from ovn-kubernetes
01:20:13	openshift-ingress	service-controller	e2e-derive-488986e9-openshift-default	EnsuredLoadBalancer	Ensured load balancer
01:20:16	openshift-ingress	service-controller	e2e-derive-488986e9-openshift-default	DeletingLoadBalancer	Deleting load balancer
01:20:16	openshift-ingress	kubelet	e2e-derive-488986e9-openshift-default-56bdc775d7-2tzkh	Killing	Stopping container istio-proxy
01:20:17	openshift-ingress	service-controller	e2e-derive-488986e9-openshift-default	DeletedLoadBalancer	Deleted load balancer
01:21:56	openshift-ingress	gateway_labeler_controller	e2e-mt-6b5edbb9	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-mt-6b5edbb9
01:21:56	openshift-ingress	deployment-controller	e2e-mt-6b5edbb9-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-mt-6b5edbb9-openshift-default-74dcd66d75 from 0 to 1
01:21:56	openshift-ingress	replicaset-controller	e2e-mt-6b5edbb9-openshift-default-74dcd66d75	SuccessfulCreate	Created pod: e2e-mt-6b5edbb9-openshift-default-74dcd66d75-stdrb
01:21:57	openshift-ingress	multus	e2e-mt-6b5edbb9-openshift-default-74dcd66d75-stdrb	AddedInterface	Add eth0 [10.132.0.37/23] from ovn-kubernetes
01:22:10 (x2)	openshift-ingress	kubelet	e2e-mt-6b5edbb9-openshift-default-74dcd66d75-stdrb	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine
01:22:10 (x2)	openshift-ingress	kubelet	e2e-mt-6b5edbb9-openshift-default-74dcd66d75-stdrb	Created	Created container: istio-proxy
01:22:10 (x2)	openshift-ingress	kubelet	e2e-mt-6b5edbb9-openshift-default-74dcd66d75-stdrb	Started	Started container istio-proxy
01:22:14 (x4)	openshift-ingress	kubelet	e2e-mt-6b5edbb9-openshift-default-74dcd66d75-stdrb	ProbeError	Startup probe error: Get "http://10.132.0.37:15021/healthz/ready": dial tcp 10.132.0.37:15021: connect: connection refused body:
01:22:14 (x4)	openshift-ingress	kubelet	e2e-mt-6b5edbb9-openshift-default-74dcd66d75-stdrb	Unhealthy	Startup probe failed: Get "http://10.132.0.37:15021/healthz/ready": dial tcp 10.132.0.37:15021: connect: connection refused
01:22:17	openshift-ingress	kubelet	e2e-mt-6b5edbb9-openshift-default-74dcd66d75-stdrb	Killing	Stopping container istio-proxy
01:22:36	openshift-ingress	replicaset-controller	e2e-mt-e0f06239-openshift-default-66bdb889f5	SuccessfulCreate	Created pod: e2e-mt-e0f06239-openshift-default-66bdb889f5-2vgl6
01:22:36	openshift-ingress	deployment-controller	e2e-mt-e0f06239-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-mt-e0f06239-openshift-default-66bdb889f5 from 0 to 1
01:22:36	openshift-ingress	gateway_labeler_controller	e2e-mt-e0f06239	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-mt-e0f06239
01:22:37	openshift-ingress	multus	e2e-mt-e0f06239-openshift-default-66bdb889f5-2vgl6	AddedInterface	Add eth0 [10.132.0.38/23] from ovn-kubernetes
01:22:50 (x2)	openshift-ingress	kubelet	e2e-mt-e0f06239-openshift-default-66bdb889f5-2vgl6	Created	Created container: istio-proxy
01:22:50 (x2)	openshift-ingress	kubelet	e2e-mt-e0f06239-openshift-default-66bdb889f5-2vgl6	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine
01:22:50 (x2)	openshift-ingress	kubelet	e2e-mt-e0f06239-openshift-default-66bdb889f5-2vgl6	Started	Started container istio-proxy
01:22:54 (x4)	openshift-ingress	kubelet	e2e-mt-e0f06239-openshift-default-66bdb889f5-2vgl6	ProbeError	Startup probe error: Get "http://10.132.0.38:15021/healthz/ready": dial tcp 10.132.0.38:15021: connect: connection refused body:
01:22:54 (x4)	openshift-ingress	kubelet	e2e-mt-e0f06239-openshift-default-66bdb889f5-2vgl6	Unhealthy	Startup probe failed: Get "http://10.132.0.38:15021/healthz/ready": dial tcp 10.132.0.38:15021: connect: connection refused
01:24:30	openshift-ingress	kubelet	e2e-mt-e0f06239-openshift-default-66bdb889f5-2vgl6	Killing	Stopping container istio-proxy
01:25:24	openshift-ingress	deployment-controller	e2e-inf-a-3460b5-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-inf-a-3460b5-openshift-default-7756b9db5 from 0 to 1
01:25:24	openshift-ingress	gateway_labeler_controller	e2e-inf-a-3460b5	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-3460b5
01:25:24	openshift-ingress	replicaset-controller	e2e-inf-a-3460b5-openshift-default-7756b9db5	SuccessfulCreate	Created pod: e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc
01:25:25	openshift-ingress	multus	e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc	AddedInterface	Add eth0 [10.132.0.39/23] from ovn-kubernetes
01:25:33	openshift-ingress	deployment-controller	e2e-inf-b-adaf0e-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-inf-b-adaf0e-openshift-default-7cddc6b66f from 0 to 1
01:25:33	openshift-ingress	gateway_labeler_controller	e2e-inf-b-adaf0e	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-adaf0e
01:25:33	openshift-ingress	replicaset-controller	e2e-inf-b-adaf0e-openshift-default-7cddc6b66f	SuccessfulCreate	Created pod: e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz
01:25:33	openshift-ingress	multus	e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz	AddedInterface	Add eth0 [10.132.0.40/23] from ovn-kubernetes
01:25:43	openshift-ingress	kubelet	e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc	Unhealthy	Readiness probe failed: Get "http://10.132.0.39:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
01:25:43	openshift-ingress	kubelet	e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc	ProbeError	Readiness probe error: Get "http://10.132.0.39:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
01:25:44 (x2)	openshift-ingress	kubelet	e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine
01:25:44 (x2)	openshift-ingress	kubelet	e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc	Created	Created container: istio-proxy
01:25:44 (x2)	openshift-ingress	kubelet	e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc	Started	Started container istio-proxy
01:25:49 (x4)	openshift-ingress	kubelet	e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc	Unhealthy	Startup probe failed: Get "http://10.132.0.39:15021/healthz/ready": dial tcp 10.132.0.39:15021: connect: connection refused
01:25:49 (x4)	openshift-ingress	kubelet	e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc	ProbeError	Startup probe error: Get "http://10.132.0.39:15021/healthz/ready": dial tcp 10.132.0.39:15021: connect: connection refused body:
01:25:50 (x2)	openshift-ingress	kubelet	e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz	Started	Started container istio-proxy
01:25:50	openshift-ingress	kubelet	e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz	Unhealthy	Readiness probe failed: Get "http://10.132.0.40:15021/healthz/ready": dial tcp 10.132.0.40:15021: connect: connection refused
01:25:50	openshift-ingress	kubelet	e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz	ProbeError	Readiness probe error: Get "http://10.132.0.40:15021/healthz/ready": dial tcp 10.132.0.40:15021: connect: connection refused body:
01:25:50 (x2)	openshift-ingress	kubelet	e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine
01:25:50 (x2)	openshift-ingress	kubelet	e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz	Created	Created container: istio-proxy
01:25:55 (x5)	openshift-ingress	kubelet	e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz	ProbeError	Startup probe error: Get "http://10.132.0.40:15021/healthz/ready": dial tcp 10.132.0.40:15021: connect: connection refused body:
01:25:55 (x5)	openshift-ingress	kubelet	e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz	Unhealthy	Startup probe failed: Get "http://10.132.0.40:15021/healthz/ready": dial tcp 10.132.0.40:15021: connect: connection refused
01:27:28	openshift-ingress	kubelet	e2e-inf-a-3460b5-openshift-default-7756b9db5-lqtdc	Killing	Stopping container istio-proxy
01:27:34	openshift-ingress	kubelet	e2e-inf-b-adaf0e-openshift-default-7cddc6b66f-ckzhz	Killing	Stopping container istio-proxy
01:27:35	openshift-ingress	gateway_labeler_controller	e2e-api-a-45d60b	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-45d60b
01:27:35	openshift-ingress	deployment-controller	e2e-api-a-45d60b-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-api-a-45d60b-openshift-default-d458c89d5 from 0 to 1
01:27:35	openshift-ingress	replicaset-controller	e2e-api-a-45d60b-openshift-default-d458c89d5	SuccessfulCreate	Created pod: e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd
01:27:36	openshift-ingress	multus	e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd	AddedInterface	Add eth0 [10.132.0.41/23] from ovn-kubernetes
01:27:44	openshift-ingress	deployment-controller	e2e-api-b-fbc435-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-api-b-fbc435-openshift-default-74fd574679 from 0 to 1
01:27:44	openshift-ingress	gateway_labeler_controller	e2e-api-b-fbc435	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-fbc435
01:27:44	openshift-ingress	replicaset-controller	e2e-api-b-fbc435-openshift-default-74fd574679	SuccessfulCreate	Created pod: e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh
01:27:44	openshift-ingress	multus	e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh	AddedInterface	Add eth0 [10.132.0.42/23] from ovn-kubernetes
01:27:51 (x2)	openshift-ingress	kubelet	e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine
01:27:51 (x2)	openshift-ingress	kubelet	e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd	Started	Started container istio-proxy
01:27:51 (x2)	openshift-ingress	kubelet	e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd	Created	Created container: istio-proxy
01:27:55 (x4)	openshift-ingress	kubelet	e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd	ProbeError	Startup probe error: Get "http://10.132.0.41:15021/healthz/ready": dial tcp 10.132.0.41:15021: connect: connection refused body:
01:27:55 (x4)	openshift-ingress	kubelet	e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd	Unhealthy	Startup probe failed: Get "http://10.132.0.41:15021/healthz/ready": dial tcp 10.132.0.41:15021: connect: connection refused
01:28:01	openshift-ingress	kubelet	e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh	Unhealthy	Readiness probe failed: Get "http://10.132.0.42:15021/healthz/ready": dial tcp 10.132.0.42:15021: connect: connection refused
01:28:01 (x2)	openshift-ingress	kubelet	e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh	Created	Created container: istio-proxy
01:28:01 (x2)	openshift-ingress	kubelet	e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh	Started	Started container istio-proxy
01:28:01	openshift-ingress	kubelet	e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh	ProbeError	Readiness probe error: Get "http://10.132.0.42:15021/healthz/ready": dial tcp 10.132.0.42:15021: connect: connection refused body:
01:28:01 (x2)	openshift-ingress	kubelet	e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine
01:28:05 (x4)	openshift-ingress	kubelet	e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh	ProbeError	Startup probe error: Get "http://10.132.0.42:15021/healthz/ready": dial tcp 10.132.0.42:15021: connect: connection refused body:
01:28:05 (x4)	openshift-ingress	kubelet	e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh	Unhealthy	Startup probe failed: Get "http://10.132.0.42:15021/healthz/ready": dial tcp 10.132.0.42:15021: connect: connection refused
01:28:06	openshift-ingress	kubelet	e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd	Killing	Stopping container istio-proxy
01:28:11	openshift-ingress	kubelet	e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
01:28:11	openshift-ingress	kubelet	e2e-api-a-45d60b-openshift-default-d458c89d5-pz7pd	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
01:28:13	openshift-ingress	deployment-controller	e2e-shared-a-88a238-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-shared-a-88a238-openshift-default-6f5f9c75d7 from 0 to 1
01:28:13	openshift-ingress	replicaset-controller	e2e-shared-a-88a238-openshift-default-6f5f9c75d7	SuccessfulCreate	Created pod: e2e-shared-a-88a238-openshift-default-6f5f9c75d7-98f5h
01:28:13	openshift-ingress	gateway_labeler_controller	e2e-shared-a-88a238	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-88a238
01:28:13	openshift-ingress	kubelet	e2e-api-b-fbc435-openshift-default-74fd574679-z7kjh	Killing	Stopping container istio-proxy
01:28:14	openshift-ingress	kubelet	e2e-shared-a-88a238-openshift-default-6f5f9c75d7-98f5h	Pulling	Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8"
01:28:14	openshift-ingress	multus	e2e-shared-a-88a238-openshift-default-6f5f9c75d7-98f5h	AddedInterface	Add eth0 [10.134.0.33/23] from ovn-kubernetes
01:28:18	openshift-ingress	kubelet	e2e-shared-a-88a238-openshift-default-6f5f9c75d7-98f5h	Pulled	Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" in 4.301s (4.301s including waiting). Image size: 181251556 bytes.
01:28:26	openshift-ingress	replicaset-controller	e2e-shared-b-52d242-openshift-default-789c964bdc	SuccessfulCreate	Created pod: e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j
01:28:26	openshift-ingress	gateway_labeler_controller	e2e-shared-b-52d242	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-52d242
01:28:26	openshift-ingress	multus	e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j	AddedInterface	Add eth0 [10.132.0.43/23] from ovn-kubernetes
01:28:26	openshift-ingress	deployment-controller	e2e-shared-b-52d242-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-shared-b-52d242-openshift-default-789c964bdc from 0 to 1
01:28:36	openshift-ingress	kubelet	e2e-shared-a-88a238-openshift-default-6f5f9c75d7-98f5h	Unhealthy	Readiness probe failed: Get "http://10.134.0.33:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
01:28:36	openshift-ingress	kubelet	e2e-shared-a-88a238-openshift-default-6f5f9c75d7-98f5h	ProbeError	Readiness probe error: Get "http://10.134.0.33:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
01:28:37 (x2)	openshift-ingress	kubelet	e2e-shared-a-88a238-openshift-default-6f5f9c75d7-98f5h	Created	Created container: istio-proxy
01:28:37 (x2)	openshift-ingress	kubelet	e2e-shared-a-88a238-openshift-default-6f5f9c75d7-98f5h	Started	Started container istio-proxy
01:28:37	openshift-ingress	kubelet	e2e-shared-a-88a238-openshift-default-6f5f9c75d7-98f5h	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine
01:28:41 (x3)	openshift-ingress	kubelet	e2e-shared-a-88a238-openshift-default-6f5f9c75d7-98f5h	ProbeError	Startup probe error: Get "http://10.134.0.33:15021/healthz/ready": dial tcp 10.134.0.33:15021: connect: connection refused body:
01:28:41 (x3)	openshift-ingress	kubelet	e2e-shared-a-88a238-openshift-default-6f5f9c75d7-98f5h	Unhealthy	Startup probe failed: Get "http://10.134.0.33:15021/healthz/ready": dial tcp 10.134.0.33:15021: connect: connection refused
01:28:44	openshift-ingress	kubelet	e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j	ProbeError	Readiness probe error: Get "http://10.132.0.43:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
01:28:44	openshift-ingress	kubelet	e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j	Unhealthy	Readiness probe failed: Get "http://10.132.0.43:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
01:28:45 (x2)	openshift-ingress	kubelet	e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine
01:28:45 (x2)	openshift-ingress	kubelet	e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j	Created	Created container: istio-proxy
01:28:45 (x2)	openshift-ingress	kubelet	e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j	Started	Started container istio-proxy
01:28:49 (x4)	openshift-ingress	kubelet	e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j	ProbeError	Startup probe error: Get "http://10.132.0.43:15021/healthz/ready": dial tcp 10.132.0.43:15021: connect: connection refused body:
01:28:49 (x4)	openshift-ingress	kubelet	e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j	Unhealthy	Startup probe failed: Get "http://10.132.0.43:15021/healthz/ready": dial tcp 10.132.0.43:15021: connect: connection refused
01:34:30	openshift-ingress	multus	test-curl-7700-140124469915056	AddedInterface	Add eth0 [10.133.0.74/23] from ovn-kubernetes
01:34:30	openshift-ingress	kubelet	test-curl-7700-140124469915056	Pulling	Pulling image "curlimages/curl:latest"
01:34:31	openshift-ingress	kubelet	test-curl-7700-140124469915056	Started	Started container test-curl-7700-140124469915056
01:34:31	openshift-ingress	kubelet	test-curl-7700-140124469915056	Pulled	Successfully pulled image "curlimages/curl:latest" in 732ms (732ms including waiting). Image size: 24157632 bytes.
01:34:31	openshift-ingress	kubelet	test-curl-7700-140124469915056	Created	Created container: test-curl-7700-140124469915056
01:34:33	openshift-ingress	kubelet	test-curl-7700-140124469915696	Pulled	Successfully pulled image "curlimages/curl:latest" in 275ms (275ms including waiting). Image size: 24157632 bytes.
01:34:33	openshift-ingress	multus	test-curl-7700-140124469915696	AddedInterface	Add eth0 [10.133.0.75/23] from ovn-kubernetes
01:34:33	openshift-ingress	kubelet	test-curl-7700-140124469915696	Pulling	Pulling image "curlimages/curl:latest"
01:34:33	openshift-ingress	kubelet	test-curl-7700-140124469915696	Created	Created container: test-curl-7700-140124469915696
01:34:33	openshift-ingress	kubelet	test-curl-7700-140124469915696	Started	Started container test-curl-7700-140124469915696
01:34:36	openshift-ingress	kubelet	test-curl-7700-140124472305536	Created	Created container: test-curl-7700-140124472305536
01:34:36	openshift-ingress	multus	test-curl-7700-140124472305536	AddedInterface	Add eth0 [10.133.0.76/23] from ovn-kubernetes
01:34:36	openshift-ingress	kubelet	test-curl-7700-140124472305536	Pulling	Pulling image "curlimages/curl:latest"
01:34:36	openshift-ingress	kubelet	test-curl-7700-140124472305536	Started	Started container test-curl-7700-140124472305536
01:34:36	openshift-ingress	kubelet	test-curl-7700-140124472305536	Pulled	Successfully pulled image "curlimages/curl:latest" in 273ms (273ms including waiting). Image size: 24157632 bytes.
01:34:39	openshift-ingress	multus	test-curl-7700-140124472305536	AddedInterface	Add eth0 [10.133.0.77/23] from ovn-kubernetes
01:34:39	openshift-ingress	kubelet	test-curl-7700-140124472305536	Pulled	Successfully pulled image "curlimages/curl:latest" in 304ms (304ms including waiting). Image size: 24157632 bytes.
01:34:39	openshift-ingress	kubelet	test-curl-7700-140124472305536	Created	Created container: test-curl-7700-140124472305536
01:34:39	openshift-ingress	kubelet	test-curl-7700-140124472305536	Pulling	Pulling image "curlimages/curl:latest"
01:34:39	openshift-ingress	kubelet	test-curl-7700-140124472305536	Started	Started container test-curl-7700-140124472305536
01:34:42	openshift-ingress	kubelet	test-curl-7700-140124470191856	Pulling	Pulling image "curlimages/curl:latest"
01:34:42	openshift-ingress	kubelet	test-curl-7700-140124470191856	Started	Started container test-curl-7700-140124470191856
01:34:42	openshift-ingress	multus	test-curl-7700-140124470191856	AddedInterface	Add eth0 [10.133.0.78/23] from ovn-kubernetes
01:34:42	openshift-ingress	kubelet	test-curl-7700-140124470191856	Pulled	Successfully pulled image "curlimages/curl:latest" in 311ms (311ms including waiting). Image size: 24157632 bytes.
01:34:42	openshift-ingress	kubelet	test-curl-7700-140124470191856	Created	Created container: test-curl-7700-140124470191856
01:34:45	openshift-ingress	kubelet	test-curl-7700-140124470191856	Pulling	Pulling image "curlimages/curl:latest"
01:34:45	openshift-ingress	multus	test-curl-7700-140124470191856	AddedInterface	Add eth0 [10.133.0.79/23] from ovn-kubernetes
01:34:45	openshift-ingress	kubelet	test-curl-7700-140124470191856	Pulled	Successfully pulled image "curlimages/curl:latest" in 288ms (288ms including waiting). Image size: 24157632 bytes.
01:34:45	openshift-ingress	kubelet	test-curl-7700-140124470191856	Started	Started container test-curl-7700-140124470191856
01:34:45	openshift-ingress	kubelet	test-curl-7700-140124470191856	Created	Created container: test-curl-7700-140124470191856
01:34:54	openshift-ingress	kubelet	e2e-shared-a-88a238-openshift-default-6f5f9c75d7-98f5h	Killing	Stopping container istio-proxy
01:34:57	openshift-ingress	kubelet	e2e-shared-a-88a238-openshift-default-6f5f9c75d7-98f5h	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
01:34:57	openshift-ingress	kubelet	e2e-shared-a-88a238-openshift-default-6f5f9c75d7-98f5h	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
01:35:01	openshift-ingress	kubelet	e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j	Killing	Stopping container istio-proxy
01:35:05	openshift-ingress	kubelet	e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
01:35:05	openshift-ingress	kubelet	e2e-shared-b-52d242-openshift-default-789c964bdc-fgb6j	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503