Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-processing-e2e-shared-a-02b433-64b69b946-dkgqn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-02b433-64b69b946-dkgqn to ip-10-0-133-70.ec2.internal

openshift-ingress

payload-processing-e2e-mt-d2645e95-987c647bb-mzhqv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-d2645e95-987c647bb-mzhqv to ip-10-0-133-70.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-f6c2cb-8585bdd7f6-pn2lw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-f6c2cb-8585bdd7f6-pn2lw to ip-10-0-133-70.ec2.internal

openshift-ingress

e2e-mt-29433603-openshift-default-797d58c956-6d7jc

Scheduled

Successfully assigned openshift-ingress/e2e-mt-29433603-openshift-default-797d58c956-6d7jc to ip-10-0-132-37.ec2.internal

openshift-ingress

payload-processing-e2e-ait-ff3f79bc-784f447856-rk8rz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-ff3f79bc-784f447856-rk8rz to ip-10-0-133-70.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-09f3f8-797cf8fdd4-nxgtf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-09f3f8-797cf8fdd4-nxgtf to ip-10-0-133-70.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-09f3f8-74d5f9568b-2w4p4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-09f3f8-74d5f9568b-2w4p4 to ip-10-0-133-70.ec2.internal

openshift-ingress

e2e-shared-b-46e6bf-openshift-default-6b97c6bcfb-kdlrp

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-46e6bf-openshift-default-6b97c6bcfb-kdlrp to ip-10-0-132-37.ec2.internal

openshift-ingress

e2e-ait-ff3f79bc-openshift-default-648767fd7b-v2hxt

Scheduled

Successfully assigned openshift-ingress/e2e-ait-ff3f79bc-openshift-default-648767fd7b-v2hxt to ip-10-0-132-37.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-e051d82f-c68b886b8-s9qk6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-e051d82f-c68b886b8-s9qk6 to ip-10-0-133-70.ec2.internal

openshift-ingress

payload-processing-e2e-ait-ffdafb25-6d97cbd7d8-wns4p

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-ffdafb25-6d97cbd7d8-wns4p to ip-10-0-133-70.ec2.internal

openshift-ingress

payload-processing-e2e-derive-e051d82f-5869dfc5d-7qnjg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-e051d82f-5869dfc5d-7qnjg to ip-10-0-133-70.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-x7llj

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-x7llj to ip-10-0-132-37.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-034ebc-5dcd84cd8-76gs2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-034ebc-5dcd84cd8-76gs2 to ip-10-0-133-70.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-f2130f-7cc98d4b7d-wmsj8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-f2130f-7cc98d4b7d-wmsj8 to ip-10-0-134-153.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-b2b0ab-77bf64b4-9c29r

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-b2b0ab-77bf64b4-9c29r to ip-10-0-134-153.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-64d8dc-75cf4cc5c4-2d5gp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-64d8dc-75cf4cc5c4-2d5gp to ip-10-0-133-70.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-h2bl5

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-h2bl5 to ip-10-0-132-37.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-s55pd

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-s55pd to ip-10-0-134-153.ec2.internal

openshift-ingress

e2e-ait-ffdafb25-openshift-default-8454d4c688-7s85x

Scheduled

Successfully assigned openshift-ingress/e2e-ait-ffdafb25-openshift-default-8454d4c688-7s85x to ip-10-0-132-37.ec2.internal

openshift-ingress

e2e-migrate-bb276d9d-gw-openshift-default-5b86fc8d88-rrr9k

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-bb276d9d-gw-openshift-default-5b86fc8d88-rrr9k to ip-10-0-132-37.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-034ebc-5d6c97b6d6-gjxjc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-034ebc-5d6c97b6d6-gjxjc to ip-10-0-134-153.ec2.internal

openshift-ingress

payload-processing-5cc6cd444b-x5xxr

Scheduled

Successfully assigned openshift-ingress/payload-processing-5cc6cd444b-x5xxr to ip-10-0-133-70.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-46e6bf-7654444fdd-gq9tg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-46e6bf-7654444fdd-gq9tg to ip-10-0-134-153.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-02b433-6448b9c7fb-6kdfp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-02b433-6448b9c7fb-6kdfp to ip-10-0-133-70.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-fc56ab-c9d847b84-xrmx4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fc56ab-c9d847b84-xrmx4 to ip-10-0-133-70.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-b2b0ab-55d8b4b584-f5qdw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-b2b0ab-55d8b4b584-f5qdw to ip-10-0-134-153.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-f6c2cb-6df64bf4d-ntsv5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-f6c2cb-6df64bf4d-ntsv5 to ip-10-0-133-70.ec2.internal

openshift-ingress

e2e-ipp-cleanup-fc56ab-openshift-default-7b5b99dd94-wrhpg

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-fc56ab-openshift-default-7b5b99dd94-wrhpg to ip-10-0-132-37.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-fc56ab-7f4c99b966-rhnf4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-fc56ab-7f4c99b966-rhnf4 to ip-10-0-133-70.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-bb276d9d-6ccb648b5-l2ndz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-bb276d9d-6ccb648b5-l2ndz to ip-10-0-133-70.ec2.internal

openshift-ingress

e2e-mt-d2645e95-openshift-default-65684b4d56-8q58h

Scheduled

Successfully assigned openshift-ingress/e2e-mt-d2645e95-openshift-default-65684b4d56-8q58h to ip-10-0-132-37.ec2.internal

openshift-ingress

payload-processing-e2e-mt-29433603-675bc98598-sw6z4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-29433603-675bc98598-sw6z4 to ip-10-0-133-70.ec2.internal

openshift-ingress

e2e-ipp-b-f6c2cb-openshift-default-549bdfb8b4-85j7s

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-f6c2cb-openshift-default-549bdfb8b4-85j7s to ip-10-0-132-37.ec2.internal

openshift-ingress

e2e-api-a-64d8dc-openshift-default-69588b8c4b-2l478

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-64d8dc-openshift-default-69588b8c4b-2l478 to ip-10-0-132-37.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-64d8dc-777947d4d-cmd7q

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-64d8dc-777947d4d-cmd7q to ip-10-0-133-70.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-f2130f-7645859b7b-m8bjc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-f2130f-7645859b7b-m8bjc to ip-10-0-133-70.ec2.internal

openshift-ingress

payload-pre-processing-687dbb6cf6-g467b

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-687dbb6cf6-g467b to ip-10-0-133-70.ec2.internal

openshift-ingress

e2e-inf-a-09f3f8-openshift-default-748f49bc5d-9p9qc

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-09f3f8-openshift-default-748f49bc5d-9p9qc to ip-10-0-132-37.ec2.internal

openshift-ingress

e2e-inf-b-034ebc-openshift-default-9f79d5774-58xvg

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-034ebc-openshift-default-9f79d5774-58xvg to ip-10-0-132-37.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-bb276d9d-7487cc55c6-tm4dp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-bb276d9d-7487cc55c6-tm4dp to ip-10-0-133-70.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-d2645e95-775b7bdf5b-4487l

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-d2645e95-775b7bdf5b-4487l to ip-10-0-133-70.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-ff3f79bc-88959c8fb-crhjr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-ff3f79bc-88959c8fb-crhjr to ip-10-0-133-70.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-ffdafb25-f464674c6-fdn8c

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-ffdafb25-f464674c6-fdn8c to ip-10-0-133-70.ec2.internal

openshift-ingress

e2e-derive-e051d82f-openshift-default-7c5bd659d4-zxlh4

Scheduled

Successfully assigned openshift-ingress/e2e-derive-e051d82f-openshift-default-7c5bd659d4-zxlh4 to ip-10-0-132-37.ec2.internal

openshift-ingress

e2e-ipp-a-b2b0ab-openshift-default-ff97cd6dd-8jzq7

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-b2b0ab-openshift-default-ff97cd6dd-8jzq7 to ip-10-0-132-37.ec2.internal

openshift-ingress

kube-auth-proxy-8f6d6f675-6v9n6

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-8f6d6f675-6v9n6 to ip-10-0-134-153.ec2.internal

openshift-ingress

kube-auth-proxy-8f6d6f675-rqjgd

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-8f6d6f675-rqjgd to ip-10-0-133-70.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-29433603-c75dc879b-4gvcc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-29433603-c75dc879b-4gvcc to ip-10-0-133-70.ec2.internal

openshift-ingress

e2e-api-b-f2130f-openshift-default-6cc76bddf8-4wd75

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-f2130f-openshift-default-6cc76bddf8-4wd75 to ip-10-0-132-37.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-46e6bf-846bd765cd-hgzpn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-46e6bf-846bd765cd-hgzpn to ip-10-0-133-70.ec2.internal

openshift-ingress

e2e-shared-a-02b433-openshift-default-86bf8dc7fb-9m9kw

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-02b433-openshift-default-86bf8dc7fb-9m9kw to ip-10-0-132-37.ec2.internal

openshift-ingress

router-default-cbf86bfcb-8pv7r

Scheduled

Successfully assigned openshift-ingress/router-default-cbf86bfcb-8pv7r to ip-10-0-132-37.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-cbf86bfcb from 0 to 1

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer
(x13)

openshift-ingress

replicaset-controller

router-default-cbf86bfcb

FailedCreate

Error creating: pods "router-default-cbf86bfcb-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x16)

openshift-ingress

replicaset-controller

router-default-cbf86bfcb

FailedCreate

Error creating: pods "router-default-cbf86bfcb-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-cbf86bfcb

SuccessfulCreate

Created pod: router-default-cbf86bfcb-8pv7r
(x5)

openshift-ingress

kubelet

router-default-cbf86bfcb-8pv7r

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x5)

openshift-ingress

kubelet

router-default-cbf86bfcb-8pv7r

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

kubelet

router-default-cbf86bfcb-8pv7r

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:627e54de31981702dfc5986fda8e14dd7490cc3ccfa94709d1b412defbb073bf" already present on machine

openshift-ingress

kubelet

router-default-cbf86bfcb-8pv7r

Created

Created container: router

openshift-ingress

kubelet

router-default-cbf86bfcb-8pv7r

Started

Started container router

openshift-ingress

multus

router-default-cbf86bfcb-8pv7r

AddedInterface

Add eth0 [10.133.0.11/23] from ovn-kubernetes
(x3)

openshift-ingress

replicaset-controller

kube-auth-proxy-8f6d6f675

FailedCreate

Error creating: pods "kube-auth-proxy-8f6d6f675-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-8f6d6f675

SuccessfulCreate

Created pod: kube-auth-proxy-8f6d6f675-rqjgd

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-8f6d6f675 from 0 to 2

openshift-ingress

replicaset-controller

kube-auth-proxy-8f6d6f675

SuccessfulCreate

Created pod: kube-auth-proxy-8f6d6f675-6v9n6

openshift-ingress

kubelet

kube-auth-proxy-8f6d6f675-6v9n6

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-8f6d6f675-6v9n6

AddedInterface

Add eth0 [10.134.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-8f6d6f675-rqjgd

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-8f6d6f675-rqjgd

AddedInterface

Add eth0 [10.132.0.27/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-8f6d6f675-rqjgd

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : failed to sync secret cache: timed out waiting for the condition

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-s55pd

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-s55pd

AddedInterface

Add eth0 [10.134.0.36/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-s55pd

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

kube-auth-proxy-8f6d6f675-rqjgd

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-8f6d6f675-6v9n6

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 4.238s (4.238s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-8f6d6f675-rqjgd

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 3.022s (3.022s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-8f6d6f675-rqjgd

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-8f6d6f675-6v9n6

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-8f6d6f675-6v9n6

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-s55pd

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-s55pd

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 4.212s (4.212s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-s55pd

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-s55pd

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-s55pd

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-h2bl5

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-h2bl5

AddedInterface

Add eth0 [10.133.0.18/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-h2bl5

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-h2bl5

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-h2bl5

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 3.229s (3.229s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-h2bl5

Started

Started container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-x7llj

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-x7llj

AddedInterface

Add eth0 [10.133.0.25/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5cc6cd444b from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-687dbb6cf6 from 0 to 1

openshift-ingress

kubelet

payload-processing-5cc6cd444b-x5xxr

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

replicaset-controller

payload-pre-processing-687dbb6cf6

SuccessfulCreate

Created pod: payload-pre-processing-687dbb6cf6-g467b
(x6)

openshift-ingress

replicaset-controller

payload-processing-5cc6cd444b

FailedCreate

Error creating: pods "payload-processing-5cc6cd444b-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-processing-5cc6cd444b

SuccessfulCreate

Created pod: payload-processing-5cc6cd444b-x5xxr

openshift-ingress

multus

payload-processing-5cc6cd444b-x5xxr

AddedInterface

Add eth0 [10.132.0.35/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-687dbb6cf6

FailedCreate

Error creating: pods "payload-pre-processing-687dbb6cf6-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

multus

payload-pre-processing-687dbb6cf6-g467b

AddedInterface

Add eth0 [10.132.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-g467b

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-g467b

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-5cc6cd444b-x5xxr

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-g467b

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-g467b

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.625s (1.626s including waiting). Image size: 165907127 bytes.

openshift-ingress

kubelet

payload-processing-5cc6cd444b-x5xxr

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-5cc6cd444b-x5xxr

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.866s (1.866s including waiting). Image size: 165907127 bytes.
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-x7llj

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-x7llj

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-x7llj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-x7llj

ProbeError

Startup probe error: Get "http://10.133.0.25:15021/healthz/ready": dial tcp 10.133.0.25:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-x7llj

Unhealthy

Startup probe failed: Get "http://10.133.0.25:15021/healthz/ready": dial tcp 10.133.0.25:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-ait-ffdafb25-openshift-default-8454d4c688

SuccessfulCreate

Created pod: e2e-ait-ffdafb25-openshift-default-8454d4c688-7s85x

openshift-ingress

multus

e2e-ait-ffdafb25-openshift-default-8454d4c688-7s85x

AddedInterface

Add eth0 [10.133.0.38/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ait-ffdafb25

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-ffdafb25

openshift-ingress

deployment-controller

e2e-ait-ffdafb25-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-ffdafb25-openshift-default-8454d4c688 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-ffdafb25

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-ffdafb25-f464674c6 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ait-ffdafb25

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-ffdafb25-6d97cbd7d8 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-ffdafb25-f464674c6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-ffdafb25-f464674c6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-ffdafb25: serviceaccount "payload-processing-e2e-ait-ffdafb25" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-ffdafb25-6d97cbd7d8

FailedCreate

Error creating: pods "payload-processing-e2e-ait-ffdafb25-6d97cbd7d8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-ffdafb25: serviceaccount "payload-processing-e2e-ait-ffdafb25" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-ffdafb25-6d97cbd7d8

SuccessfulCreate

Created pod: payload-processing-e2e-ait-ffdafb25-6d97cbd7d8-wns4p

openshift-ingress

multus

payload-pre-processing-e2e-ait-ffdafb25-f464674c6-fdn8c

AddedInterface

Add eth0 [10.132.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-ffdafb25-6d97cbd7d8-wns4p

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-ffdafb25-f464674c6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-ffdafb25-f464674c6-fdn8c

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-ffdafb25-f464674c6-fdn8c

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-ffdafb25-6d97cbd7d8-wns4p

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-ffdafb25-6d97cbd7d8-wns4p

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-ffdafb25-6d97cbd7d8-wns4p

AddedInterface

Add eth0 [10.132.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-ffdafb25-f464674c6-fdn8c

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-ffdafb25-f464674c6-fdn8c

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-ait-ffdafb25-openshift-default-8454d4c688-7s85x

Unhealthy

Readiness probe failed: Get "http://10.133.0.38:15021/healthz/ready": dial tcp 10.133.0.38:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-ait-ffdafb25-openshift-default-8454d4c688-7s85x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-ffdafb25-openshift-default-8454d4c688-7s85x

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-ffdafb25-openshift-default-8454d4c688-7s85x

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-ait-ffdafb25-openshift-default-8454d4c688-7s85x

ProbeError

Readiness probe error: Get "http://10.133.0.38:15021/healthz/ready": dial tcp 10.133.0.38:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-ffdafb25-openshift-default-8454d4c688-7s85x

ProbeError

Startup probe error: Get "http://10.133.0.38:15021/healthz/ready": dial tcp 10.133.0.38:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-ffdafb25-openshift-default-8454d4c688-7s85x

Unhealthy

Startup probe failed: Get "http://10.133.0.38:15021/healthz/ready": dial tcp 10.133.0.38:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-ffdafb25-f464674c6-fdn8c

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-ffdafb25-6d97cbd7d8-wns4p

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-ffdafb25-openshift-default-8454d4c688-7s85x

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-migrate-bb276d9d-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-bb276d9d-gw-openshift-default-5b86fc8d88 from 0 to 1

openshift-ingress

multus

e2e-migrate-bb276d9d-gw-openshift-default-5b86fc8d88-rrr9k

AddedInterface

Add eth0 [10.133.0.40/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-migrate-bb276d9d-gw-openshift-default-5b86fc8d88

SuccessfulCreate

Created pod: e2e-migrate-bb276d9d-gw-openshift-default-5b86fc8d88-rrr9k

openshift-ingress

gateway_labeler_controller

e2e-migrate-bb276d9d-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-bb276d9d-gw

openshift-ingress

kubelet

e2e-ait-ffdafb25-openshift-default-8454d4c688-7s85x

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ait-ffdafb25-openshift-default-8454d4c688-7s85x

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-bb276d9d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-bb276d9d-7487cc55c6 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-bb276d9d-6ccb648b5

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-bb276d9d-6ccb648b5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-bb276d9d: serviceaccount "payload-processing-e2e-migrate-bb276d9d" not found

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-bb276d9d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-bb276d9d-6ccb648b5 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-bb276d9d-7487cc55c6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-bb276d9d-7487cc55c6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-bb276d9d: serviceaccount "payload-processing-e2e-migrate-bb276d9d" not found

openshift-ingress

multus

payload-pre-processing-e2e-migrate-bb276d9d-7487cc55c6-tm4dp

AddedInterface

Add eth0 [10.132.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-bb276d9d-6ccb648b5-l2ndz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-migrate-bb276d9d-6ccb648b5-l2ndz

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-bb276d9d-7487cc55c6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-bb276d9d-7487cc55c6-tm4dp

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-bb276d9d-7487cc55c6-tm4dp

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-bb276d9d-7487cc55c6-tm4dp

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-bb276d9d-7487cc55c6-tm4dp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-migrate-bb276d9d-6ccb648b5-l2ndz

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-bb276d9d-6ccb648b5-l2ndz

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-bb276d9d-6ccb648b5

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-bb276d9d-6ccb648b5-l2ndz
(x2)

openshift-ingress

kubelet

e2e-migrate-bb276d9d-gw-openshift-default-5b86fc8d88-rrr9k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-bb276d9d-gw-openshift-default-5b86fc8d88-rrr9k

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-bb276d9d-gw-openshift-default-5b86fc8d88-rrr9k

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-migrate-bb276d9d-gw-openshift-default-5b86fc8d88-rrr9k

ProbeError

Startup probe error: Get "http://10.133.0.40:15021/healthz/ready": dial tcp 10.133.0.40:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-migrate-bb276d9d-gw-openshift-default-5b86fc8d88-rrr9k

Unhealthy

Startup probe failed: Get "http://10.133.0.40:15021/healthz/ready": dial tcp 10.133.0.40:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-bb276d9d-7487cc55c6-tm4dp

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-migrate-bb276d9d

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-migrate-bb276d9d: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-migrate-bb276d9d": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-migrate-bb276d9d, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: b88136a2-a3f3-4b1b-84ad-ed0350368ca7, UID in object meta:

openshift-ingress

endpoint-slice-controller

payload-pre-processing-e2e-migrate-bb276d9d

FailedToUpdateEndpointSlices

Error updating Endpoint Slices for Service openshift-ingress/payload-pre-processing-e2e-migrate-bb276d9d: failed to update payload-pre-processing-e2e-migrate-bb276d9d-nfwc2 EndpointSlice for Service openshift-ingress/payload-pre-processing-e2e-migrate-bb276d9d: endpointslices.discovery.k8s.io "payload-pre-processing-e2e-migrate-bb276d9d-nfwc2" not found

openshift-ingress

kubelet

payload-processing-e2e-migrate-bb276d9d-6ccb648b5-l2ndz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-migrate-bb276d9d-gw-openshift-default-5b86fc8d88-rrr9k

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ait-ff3f79bc

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-ff3f79bc

openshift-ingress

multus

e2e-ait-ff3f79bc-openshift-default-648767fd7b-v2hxt

AddedInterface

Add eth0 [10.133.0.42/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ait-ff3f79bc-openshift-default-648767fd7b

SuccessfulCreate

Created pod: e2e-ait-ff3f79bc-openshift-default-648767fd7b-v2hxt

openshift-ingress

deployment-controller

e2e-ait-ff3f79bc-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-ff3f79bc-openshift-default-648767fd7b from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-ff3f79bc

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-ff3f79bc-88959c8fb from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-ff3f79bc-88959c8fb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-ff3f79bc-88959c8fb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-ff3f79bc: serviceaccount "payload-processing-e2e-ait-ff3f79bc" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-ff3f79bc-784f447856

FailedCreate

Error creating: pods "payload-processing-e2e-ait-ff3f79bc-784f447856-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-ff3f79bc: serviceaccount "payload-processing-e2e-ait-ff3f79bc" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-ff3f79bc-88959c8fb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-ff3f79bc-88959c8fb-crhjr

openshift-ingress

deployment-controller

payload-processing-e2e-ait-ff3f79bc

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-ff3f79bc-784f447856 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-ff3f79bc-784f447856

SuccessfulCreate

Created pod: payload-processing-e2e-ait-ff3f79bc-784f447856-rk8rz

openshift-ingress

kubelet

payload-processing-e2e-ait-ff3f79bc-784f447856-rk8rz

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-ff3f79bc-784f447856-rk8rz

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-ff3f79bc-784f447856-rk8rz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-ff3f79bc-88959c8fb-crhjr

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-ff3f79bc-88959c8fb-crhjr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-ff3f79bc-784f447856-rk8rz

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-ff3f79bc-88959c8fb-crhjr

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-ff3f79bc-88959c8fb-crhjr

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ait-ff3f79bc-openshift-default-648767fd7b-v2hxt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-ff3f79bc-openshift-default-648767fd7b-v2hxt

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-ff3f79bc-openshift-default-648767fd7b-v2hxt

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ait-ff3f79bc-openshift-default-648767fd7b-v2hxt

Unhealthy

Startup probe failed: Get "http://10.133.0.42:15021/healthz/ready": dial tcp 10.133.0.42:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-ff3f79bc-openshift-default-648767fd7b-v2hxt

ProbeError

Startup probe error: Get "http://10.133.0.42:15021/healthz/ready": dial tcp 10.133.0.42:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-ff3f79bc-88959c8fb-crhjr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-ff3f79bc-784f447856-rk8rz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-ff3f79bc-openshift-default-648767fd7b-v2hxt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-derive-e051d82f-openshift-default-7c5bd659d4-zxlh4

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-derive-e051d82f-openshift-default-7c5bd659d4-zxlh4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-derive-e051d82f-openshift-default-7c5bd659d4-zxlh4

Started

Started container istio-proxy

openshift-ingress

replicaset-controller

e2e-derive-e051d82f-openshift-default-7c5bd659d4

SuccessfulCreate

Created pod: e2e-derive-e051d82f-openshift-default-7c5bd659d4-zxlh4

openshift-ingress

multus

e2e-derive-e051d82f-openshift-default-7c5bd659d4-zxlh4

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-derive-e051d82f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-e051d82f-openshift-default-7c5bd659d4 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-derive-e051d82f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-e051d82f

openshift-ingress

kubelet

e2e-derive-e051d82f-openshift-default-7c5bd659d4-zxlh4

ProbeError

Startup probe error: Get "http://10.133.0.43:15021/healthz/ready": dial tcp 10.133.0.43:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-derive-e051d82f-openshift-default-7c5bd659d4-zxlh4

Unhealthy

Startup probe failed: Get "http://10.133.0.43:15021/healthz/ready": dial tcp 10.133.0.43:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-e051d82f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-e051d82f-c68b886b8 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-e051d82f-5869dfc5d

FailedCreate

Error creating: pods "payload-processing-e2e-derive-e051d82f-5869dfc5d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-e051d82f: serviceaccount "payload-processing-e2e-derive-e051d82f" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-e051d82f-c68b886b8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-e051d82f-c68b886b8-s9qk6

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-e051d82f-5869dfc5d

SuccessfulCreate

Created pod: payload-processing-e2e-derive-e051d82f-5869dfc5d-7qnjg

openshift-ingress

deployment-controller

payload-processing-e2e-derive-e051d82f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-e051d82f-5869dfc5d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-e051d82f-c68b886b8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-e051d82f-c68b886b8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-e051d82f: serviceaccount "payload-processing-e2e-derive-e051d82f" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-e051d82f-c68b886b8-s9qk6

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-derive-e051d82f-5869dfc5d-7qnjg

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-e051d82f-5869dfc5d-7qnjg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-derive-e051d82f-5869dfc5d-7qnjg

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-derive-e051d82f-c68b886b8-s9qk6

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-e051d82f-c68b886b8-s9qk6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-e051d82f-c68b886b8-s9qk6

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-e051d82f-5869dfc5d-7qnjg

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-e051d82f-5869dfc5d-7qnjg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-e051d82f-c68b886b8-s9qk6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-e051d82f-openshift-default-7c5bd659d4-zxlh4

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-mt-29433603-openshift-default-797d58c956

SuccessfulCreate

Created pod: e2e-mt-29433603-openshift-default-797d58c956-6d7jc

openshift-ingress

deployment-controller

e2e-mt-29433603-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-29433603-openshift-default-797d58c956 from 0 to 1

openshift-ingress

multus

e2e-mt-29433603-openshift-default-797d58c956-6d7jc

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-mt-29433603

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-29433603

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-29433603-675bc98598

SuccessfulCreate

Created pod: payload-processing-e2e-mt-29433603-675bc98598-sw6z4
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-29433603-675bc98598

FailedCreate

Error creating: pods "payload-processing-e2e-mt-29433603-675bc98598-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-29433603: serviceaccount "payload-processing-e2e-mt-29433603" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-29433603

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-29433603-675bc98598 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-29433603-c75dc879b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-29433603-c75dc879b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-29433603: serviceaccount "payload-processing-e2e-mt-29433603" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-29433603-c75dc879b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-29433603-c75dc879b-4gvcc

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-29433603

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-29433603-c75dc879b from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-mt-29433603-c75dc879b-4gvcc

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-29433603-c75dc879b-4gvcc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-29433603-c75dc879b-4gvcc

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-29433603-c75dc879b-4gvcc

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-29433603-675bc98598-sw6z4

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-29433603-675bc98598-sw6z4

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-29433603-675bc98598-sw6z4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-29433603-675bc98598-sw6z4

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-mt-29433603-openshift-default-797d58c956-6d7jc

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-29433603-openshift-default-797d58c956-6d7jc

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-29433603-openshift-default-797d58c956-6d7jc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-mt-29433603-openshift-default-797d58c956-6d7jc

Unhealthy

Startup probe failed: Get "http://10.133.0.45:15021/healthz/ready": dial tcp 10.133.0.45:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-29433603-openshift-default-797d58c956-6d7jc

ProbeError

Startup probe error: Get "http://10.133.0.45:15021/healthz/ready": dial tcp 10.133.0.45:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-29433603-c75dc879b-4gvcc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-29433603-675bc98598-sw6z4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-29433603-openshift-default-797d58c956-6d7jc

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-mt-d2645e95-openshift-default-65684b4d56-8q58h

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-mt-d2645e95

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-d2645e95

openshift-ingress

deployment-controller

e2e-mt-d2645e95-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-d2645e95-openshift-default-65684b4d56 from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-d2645e95-openshift-default-65684b4d56

SuccessfulCreate

Created pod: e2e-mt-d2645e95-openshift-default-65684b4d56-8q58h

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-d2645e95-775b7bdf5b-4487l

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-d2645e95-775b7bdf5b-4487l

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-d2645e95-987c647bb-mzhqv

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-d2645e95-987c647bb-mzhqv

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-d2645e95-775b7bdf5b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-d2645e95-775b7bdf5b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-d2645e95: serviceaccount "payload-processing-e2e-mt-d2645e95" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-d2645e95-775b7bdf5b-4487l

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-d2645e95-987c647bb-mzhqv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-mt-d2645e95-775b7bdf5b-4487l

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-d2645e95-987c647bb

SuccessfulCreate

Created pod: payload-processing-e2e-mt-d2645e95-987c647bb-mzhqv

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-d2645e95

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-d2645e95-775b7bdf5b from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-mt-d2645e95

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-d2645e95-987c647bb from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-d2645e95-775b7bdf5b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-d2645e95-775b7bdf5b-4487l
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-d2645e95-987c647bb

FailedCreate

Error creating: pods "payload-processing-e2e-mt-d2645e95-987c647bb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-d2645e95: serviceaccount "payload-processing-e2e-mt-d2645e95" not found

openshift-ingress

multus

payload-processing-e2e-mt-d2645e95-987c647bb-mzhqv

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-d2645e95-openshift-default-65684b4d56-8q58h

ProbeError

Readiness probe error: Get "http://10.133.0.48:15021/healthz/ready": read tcp 10.133.0.2:34912->10.133.0.48:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-mt-d2645e95-openshift-default-65684b4d56-8q58h

Unhealthy

Readiness probe failed: Get "http://10.133.0.48:15021/healthz/ready": read tcp 10.133.0.2:34912->10.133.0.48:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-mt-d2645e95-openshift-default-65684b4d56-8q58h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-d2645e95-openshift-default-65684b4d56-8q58h

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-d2645e95-openshift-default-65684b4d56-8q58h

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-mt-d2645e95-openshift-default-65684b4d56-8q58h

ProbeError

Startup probe error: Get "http://10.133.0.48:15021/healthz/ready": dial tcp 10.133.0.48:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-d2645e95-openshift-default-65684b4d56-8q58h

Unhealthy

Startup probe failed: Get "http://10.133.0.48:15021/healthz/ready": dial tcp 10.133.0.48:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-mt-d2645e95-987c647bb-mzhqv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-d2645e95-775b7bdf5b-4487l

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-d2645e95-openshift-default-65684b4d56-8q58h

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-inf-a-09f3f8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-09f3f8

openshift-ingress

deployment-controller

e2e-inf-a-09f3f8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-09f3f8-openshift-default-748f49bc5d from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-09f3f8-openshift-default-748f49bc5d

SuccessfulCreate

Created pod: e2e-inf-a-09f3f8-openshift-default-748f49bc5d-9p9qc

openshift-ingress

multus

e2e-inf-a-09f3f8-openshift-default-748f49bc5d-9p9qc

AddedInterface

Add eth0 [10.133.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-09f3f8-74d5f9568b-2w4p4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-09f3f8-797cf8fdd4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-09f3f8-797cf8fdd4-nxgtf

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-09f3f8-797cf8fdd4-nxgtf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-09f3f8-797cf8fdd4-nxgtf

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-09f3f8-797cf8fdd4-nxgtf

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-09f3f8-797cf8fdd4-nxgtf

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-09f3f8-797cf8fdd4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-09f3f8-797cf8fdd4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-09f3f8: serviceaccount "payload-processing-e2e-inf-a-09f3f8" not found

openshift-ingress

multus

payload-processing-e2e-inf-a-09f3f8-74d5f9568b-2w4p4

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-09f3f8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-09f3f8-797cf8fdd4 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-09f3f8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-09f3f8-74d5f9568b from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-09f3f8-74d5f9568b

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-09f3f8-74d5f9568b-2w4p4
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-09f3f8-74d5f9568b

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-09f3f8-74d5f9568b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-09f3f8: serviceaccount "payload-processing-e2e-inf-a-09f3f8" not found

openshift-ingress

kubelet

payload-processing-e2e-inf-a-09f3f8-74d5f9568b-2w4p4

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-09f3f8-74d5f9568b-2w4p4

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-inf-a-09f3f8-openshift-default-748f49bc5d-9p9qc

Unhealthy

Readiness probe failed: Get "http://10.133.0.50:15021/healthz/ready": read tcp 10.133.0.2:45394->10.133.0.50:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-inf-a-09f3f8-openshift-default-748f49bc5d-9p9qc

ProbeError

Readiness probe error: Get "http://10.133.0.50:15021/healthz/ready": read tcp 10.133.0.2:45394->10.133.0.50:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-inf-a-09f3f8-openshift-default-748f49bc5d-9p9qc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-09f3f8-openshift-default-748f49bc5d-9p9qc

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-09f3f8-openshift-default-748f49bc5d-9p9qc

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-inf-a-09f3f8-openshift-default-748f49bc5d-9p9qc

ProbeError

Startup probe error: Get "http://10.133.0.50:15021/healthz/ready": dial tcp 10.133.0.50:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-a-09f3f8-openshift-default-748f49bc5d-9p9qc

Unhealthy

Startup probe failed: Get "http://10.133.0.50:15021/healthz/ready": dial tcp 10.133.0.50:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-inf-b-034ebc-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-034ebc-openshift-default-9f79d5774 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-b-034ebc

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-034ebc

openshift-ingress

multus

e2e-inf-b-034ebc-openshift-default-9f79d5774-58xvg

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-inf-b-034ebc-openshift-default-9f79d5774

SuccessfulCreate

Created pod: e2e-inf-b-034ebc-openshift-default-9f79d5774-58xvg

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-034ebc-5d6c97b6d6

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-034ebc-5d6c97b6d6-gjxjc

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-034ebc

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-034ebc-5d6c97b6d6 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-034ebc-5d6c97b6d6

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-034ebc-5d6c97b6d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-034ebc: serviceaccount "payload-processing-e2e-inf-b-034ebc" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-034ebc

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-034ebc-5dcd84cd8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-034ebc-5dcd84cd8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-034ebc-5dcd84cd8-76gs2
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-034ebc-5dcd84cd8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-034ebc-5dcd84cd8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-034ebc: serviceaccount "payload-processing-e2e-inf-b-034ebc" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-034ebc-5dcd84cd8-76gs2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-b-034ebc-5d6c97b6d6-gjxjc

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-e2e-inf-b-034ebc-5d6c97b6d6-gjxjc

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-034ebc-5dcd84cd8-76gs2

AddedInterface

Add eth0 [10.132.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-034ebc-5dcd84cd8-76gs2

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-034ebc-5dcd84cd8-76gs2

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-034ebc-5d6c97b6d6-gjxjc

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-034ebc-5d6c97b6d6-gjxjc

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-034ebc-5d6c97b6d6-gjxjc

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.091s (2.091s including waiting). Image size: 165907127 bytes.

openshift-ingress

kubelet

e2e-inf-b-034ebc-openshift-default-9f79d5774-58xvg

Unhealthy

Readiness probe failed: Get "http://10.133.0.51:15021/healthz/ready": read tcp 10.133.0.2:58016->10.133.0.51:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-inf-b-034ebc-openshift-default-9f79d5774-58xvg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-034ebc-openshift-default-9f79d5774-58xvg

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-034ebc-openshift-default-9f79d5774-58xvg

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-034ebc-openshift-default-9f79d5774-58xvg

ProbeError

Readiness probe error: Get "http://10.133.0.51:15021/healthz/ready": read tcp 10.133.0.2:58016->10.133.0.51:15021: read: connection reset by peer body:
(x5)

openshift-ingress

kubelet

e2e-inf-b-034ebc-openshift-default-9f79d5774-58xvg

ProbeError

Startup probe error: Get "http://10.133.0.51:15021/healthz/ready": dial tcp 10.133.0.51:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-b-034ebc-openshift-default-9f79d5774-58xvg

Unhealthy

Startup probe failed: Get "http://10.133.0.51:15021/healthz/ready": dial tcp 10.133.0.51:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-09f3f8-797cf8fdd4-nxgtf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-09f3f8-74d5f9568b-2w4p4

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-inf-a-09f3f8

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-inf-a-09f3f8: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-inf-a-09f3f8": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-inf-a-09f3f8, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 85b980c6-2e6d-4db1-9824-b73cdf84cd4d, UID in object meta:

openshift-ingress

kubelet

e2e-inf-a-09f3f8-openshift-default-748f49bc5d-9p9qc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-09f3f8-openshift-default-748f49bc5d-9p9qc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-a-09f3f8-openshift-default-748f49bc5d-9p9qc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-inf-b-034ebc

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-inf-b-034ebc: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-inf-b-034ebc": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-inf-b-034ebc, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: c0193bee-6dce-47b4-914a-67d72659c70e, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-inf-b-034ebc-5d6c97b6d6-gjxjc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-034ebc-5dcd84cd8-76gs2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-b-034ebc-openshift-default-9f79d5774-58xvg

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-api-a-64d8dc

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-64d8dc

openshift-ingress

deployment-controller

e2e-api-a-64d8dc-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-64d8dc-openshift-default-69588b8c4b from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-64d8dc-openshift-default-69588b8c4b

SuccessfulCreate

Created pod: e2e-api-a-64d8dc-openshift-default-69588b8c4b-2l478

openshift-ingress

multus

e2e-api-a-64d8dc-openshift-default-69588b8c4b-2l478

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-64d8dc-75cf4cc5c4

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-64d8dc-75cf4cc5c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-64d8dc: serviceaccount "payload-processing-e2e-api-a-64d8dc" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-64d8dc-777947d4d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-64d8dc-777947d4d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-64d8dc: serviceaccount "payload-processing-e2e-api-a-64d8dc" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-64d8dc

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-64d8dc-777947d4d from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-64d8dc

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-64d8dc-75cf4cc5c4 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-64d8dc-777947d4d-cmd7q

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-a-64d8dc-777947d4d-cmd7q

AddedInterface

Add eth0 [10.132.0.65/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-64d8dc-75cf4cc5c4

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-64d8dc-75cf4cc5c4-2d5gp

openshift-ingress

kubelet

payload-processing-e2e-api-a-64d8dc-75cf4cc5c4-2d5gp

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-64d8dc-75cf4cc5c4-2d5gp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-api-a-64d8dc-75cf4cc5c4-2d5gp

AddedInterface

Add eth0 [10.132.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-64d8dc-75cf4cc5c4-2d5gp

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-64d8dc-777947d4d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-64d8dc-777947d4d-cmd7q

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-64d8dc-777947d4d-cmd7q

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-64d8dc-777947d4d-cmd7q

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-api-a-64d8dc-openshift-default-69588b8c4b-2l478

Unhealthy

Readiness probe failed: Get "http://10.133.0.53:15021/healthz/ready": dial tcp 10.133.0.53:15021: connect: connection refused

openshift-ingress

kubelet

e2e-api-a-64d8dc-openshift-default-69588b8c4b-2l478

ProbeError

Readiness probe error: Get "http://10.133.0.53:15021/healthz/ready": dial tcp 10.133.0.53:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-api-a-64d8dc-openshift-default-69588b8c4b-2l478

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-64d8dc-openshift-default-69588b8c4b-2l478

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-64d8dc-openshift-default-69588b8c4b-2l478

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-api-a-64d8dc-openshift-default-69588b8c4b-2l478

ProbeError

Startup probe error: Get "http://10.133.0.53:15021/healthz/ready": dial tcp 10.133.0.53:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-a-64d8dc-openshift-default-69588b8c4b-2l478

Unhealthy

Startup probe failed: Get "http://10.133.0.53:15021/healthz/ready": dial tcp 10.133.0.53:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-api-b-f2130f-openshift-default-6cc76bddf8

SuccessfulCreate

Created pod: e2e-api-b-f2130f-openshift-default-6cc76bddf8-4wd75

openshift-ingress

deployment-controller

e2e-api-b-f2130f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-f2130f-openshift-default-6cc76bddf8 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-f2130f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-f2130f

openshift-ingress

multus

e2e-api-b-f2130f-openshift-default-6cc76bddf8-4wd75

AddedInterface

Add eth0 [10.133.0.54/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-f2130f-7cc98d4b7d

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-f2130f-7cc98d4b7d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-f2130f: serviceaccount "payload-processing-e2e-api-b-f2130f" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-f2130f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-f2130f-7cc98d4b7d from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-f2130f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-f2130f-7645859b7b from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-f2130f-7645859b7b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-f2130f-7645859b7b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-f2130f: serviceaccount "payload-processing-e2e-api-b-f2130f" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-f2130f-7645859b7b-m8bjc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-b-f2130f-7cc98d4b7d-wmsj8

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-f2130f-7645859b7b-m8bjc

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-api-b-f2130f-7cc98d4b7d-wmsj8

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-f2130f-7cc98d4b7d-wmsj8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-f2130f-7645859b7b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-f2130f-7645859b7b-m8bjc

openshift-ingress

kubelet

payload-processing-e2e-api-b-f2130f-7cc98d4b7d-wmsj8

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-f2130f-7645859b7b-m8bjc

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-f2130f-7cc98d4b7d

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-f2130f-7cc98d4b7d-wmsj8

openshift-ingress

multus

payload-pre-processing-e2e-api-b-f2130f-7645859b7b-m8bjc

AddedInterface

Add eth0 [10.132.0.67/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-api-b-f2130f-openshift-default-6cc76bddf8-4wd75

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-f2130f-openshift-default-6cc76bddf8-4wd75

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-f2130f-openshift-default-6cc76bddf8-4wd75

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-api-b-f2130f-openshift-default-6cc76bddf8-4wd75

Unhealthy

Readiness probe failed: Get "http://10.133.0.54:15021/healthz/ready": dial tcp 10.133.0.54:15021: connect: connection refused

openshift-ingress

kubelet

e2e-api-b-f2130f-openshift-default-6cc76bddf8-4wd75

ProbeError

Readiness probe error: Get "http://10.133.0.54:15021/healthz/ready": dial tcp 10.133.0.54:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-f2130f-openshift-default-6cc76bddf8-4wd75

ProbeError

Startup probe error: Get "http://10.133.0.54:15021/healthz/ready": dial tcp 10.133.0.54:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-f2130f-openshift-default-6cc76bddf8-4wd75

Unhealthy

Startup probe failed: Get "http://10.133.0.54:15021/healthz/ready": dial tcp 10.133.0.54:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-64d8dc-777947d4d-cmd7q

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-64d8dc-75cf4cc5c4-2d5gp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-a-64d8dc-openshift-default-69588b8c4b-2l478

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-64d8dc-openshift-default-69588b8c4b-2l478

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-a-64d8dc-openshift-default-69588b8c4b-2l478

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-api-b-f2130f-7cc98d4b7d-wmsj8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-f2130f-7645859b7b-m8bjc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-f2130f-openshift-default-6cc76bddf8-4wd75

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-a-02b433

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-02b433

openshift-ingress

deployment-controller

e2e-shared-a-02b433-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-02b433-openshift-default-86bf8dc7fb from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-02b433-openshift-default-86bf8dc7fb

SuccessfulCreate

Created pod: e2e-shared-a-02b433-openshift-default-86bf8dc7fb-9m9kw

openshift-ingress

multus

e2e-shared-a-02b433-openshift-default-86bf8dc7fb-9m9kw

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-02b433-64b69b946

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-02b433-64b69b946-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-02b433: serviceaccount "payload-processing-e2e-shared-a-02b433" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-02b433

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-02b433-6448b9c7fb from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-02b433

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-02b433-64b69b946 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-02b433-64b69b946

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-02b433-64b69b946-dkgqn
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-02b433-6448b9c7fb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-02b433-6448b9c7fb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-02b433: serviceaccount "payload-processing-e2e-shared-a-02b433" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-02b433-6448b9c7fb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-02b433-6448b9c7fb-6kdfp

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-02b433-6448b9c7fb-6kdfp

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-02b433-6448b9c7fb-6kdfp

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-02b433-64b69b946-dkgqn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-02b433-64b69b946-dkgqn

AddedInterface

Add eth0 [10.132.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-02b433-6448b9c7fb-6kdfp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-02b433-64b69b946-dkgqn

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-02b433-64b69b946-dkgqn

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-02b433-6448b9c7fb-6kdfp

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-a-02b433-openshift-default-86bf8dc7fb-9m9kw

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-02b433-openshift-default-86bf8dc7fb-9m9kw

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-02b433-openshift-default-86bf8dc7fb-9m9kw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-a-02b433-openshift-default-86bf8dc7fb-9m9kw

ProbeError

Startup probe error: Get "http://10.133.0.55:15021/healthz/ready": dial tcp 10.133.0.55:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-02b433-openshift-default-86bf8dc7fb-9m9kw

Unhealthy

Startup probe failed: Get "http://10.133.0.55:15021/healthz/ready": dial tcp 10.133.0.55:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-shared-b-46e6bf-openshift-default-6b97c6bcfb

SuccessfulCreate

Created pod: e2e-shared-b-46e6bf-openshift-default-6b97c6bcfb-kdlrp

openshift-ingress

deployment-controller

e2e-shared-b-46e6bf-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-46e6bf-openshift-default-6b97c6bcfb from 0 to 1

openshift-ingress

multus

e2e-shared-b-46e6bf-openshift-default-6b97c6bcfb-kdlrp

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-shared-b-46e6bf

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-46e6bf
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-46e6bf-846bd765cd

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-46e6bf-846bd765cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-46e6bf: serviceaccount "payload-processing-e2e-shared-b-46e6bf" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-46e6bf-846bd765cd

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-46e6bf-846bd765cd-hgzpn
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-46e6bf-7654444fdd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-46e6bf-7654444fdd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-46e6bf: serviceaccount "payload-processing-e2e-shared-b-46e6bf" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-46e6bf-7654444fdd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-46e6bf-7654444fdd-gq9tg

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-46e6bf

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-46e6bf-7654444fdd from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-46e6bf

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-46e6bf-846bd765cd from 0 to 1

openshift-ingress

multus

payload-processing-e2e-shared-b-46e6bf-846bd765cd-hgzpn

AddedInterface

Add eth0 [10.132.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-46e6bf-7654444fdd-gq9tg

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-46e6bf-7654444fdd-gq9tg

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-46e6bf-846bd765cd-hgzpn

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-46e6bf-846bd765cd-hgzpn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-46e6bf-7654444fdd-gq9tg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-46e6bf-7654444fdd-gq9tg

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-46e6bf-846bd765cd-hgzpn

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-shared-b-46e6bf-openshift-default-6b97c6bcfb-kdlrp

ProbeError

Readiness probe error: Get "http://10.133.0.56:15021/healthz/ready": dial tcp 10.133.0.56:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-shared-b-46e6bf-openshift-default-6b97c6bcfb-kdlrp

Unhealthy

Readiness probe failed: Get "http://10.133.0.56:15021/healthz/ready": dial tcp 10.133.0.56:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-b-46e6bf-openshift-default-6b97c6bcfb-kdlrp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-46e6bf-openshift-default-6b97c6bcfb-kdlrp

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-46e6bf-openshift-default-6b97c6bcfb-kdlrp

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-46e6bf-openshift-default-6b97c6bcfb-kdlrp

Unhealthy

Startup probe failed: Get "http://10.133.0.56:15021/healthz/ready": dial tcp 10.133.0.56:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-46e6bf-openshift-default-6b97c6bcfb-kdlrp

ProbeError

Startup probe error: Get "http://10.133.0.56:15021/healthz/ready": dial tcp 10.133.0.56:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-ipp-a-b2b0ab-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-b2b0ab-openshift-default-ff97cd6dd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-b2b0ab

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-b2b0ab

openshift-ingress

replicaset-controller

e2e-ipp-a-b2b0ab-openshift-default-ff97cd6dd

SuccessfulCreate

Created pod: e2e-ipp-a-b2b0ab-openshift-default-ff97cd6dd-8jzq7

openshift-ingress

multus

e2e-ipp-a-b2b0ab-openshift-default-ff97cd6dd-8jzq7

AddedInterface

Add eth0 [10.133.0.61/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-b2b0ab-55d8b4b584

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-b2b0ab-55d8b4b584-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-b2b0ab: serviceaccount "payload-processing-e2e-ipp-a-b2b0ab" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-b2b0ab-77bf64b4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-b2b0ab-77bf64b4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-b2b0ab: serviceaccount "payload-processing-e2e-ipp-a-b2b0ab" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-b2b0ab

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-b2b0ab-77bf64b4 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-b2b0ab

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-b2b0ab-55d8b4b584 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-b2b0ab-55d8b4b584-f5qdw

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-b2b0ab-77bf64b4-9c29r

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-b2b0ab-77bf64b4-9c29r

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-b2b0ab-55d8b4b584-f5qdw

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-b2b0ab-55d8b4b584

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-b2b0ab-55d8b4b584-f5qdw

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-b2b0ab-55d8b4b584-f5qdw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-b2b0ab-77bf64b4-9c29r

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-b2b0ab-77bf64b4-9c29r

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-b2b0ab-77bf64b4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-b2b0ab-77bf64b4-9c29r

openshift-ingress

multus

payload-processing-e2e-ipp-a-b2b0ab-55d8b4b584-f5qdw

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-a-b2b0ab-openshift-default-ff97cd6dd-8jzq7

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-b2b0ab-openshift-default-ff97cd6dd-8jzq7

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-b2b0ab-openshift-default-ff97cd6dd-8jzq7

ProbeError

Readiness probe error: Get "http://10.133.0.61:15021/healthz/ready": dial tcp 10.133.0.61:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ipp-a-b2b0ab-openshift-default-ff97cd6dd-8jzq7

Unhealthy

Readiness probe failed: Get "http://10.133.0.61:15021/healthz/ready": dial tcp 10.133.0.61:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-ipp-a-b2b0ab-openshift-default-ff97cd6dd-8jzq7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-a-b2b0ab-openshift-default-ff97cd6dd-8jzq7

ProbeError

Startup probe error: Get "http://10.133.0.61:15021/healthz/ready": dial tcp 10.133.0.61:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-b2b0ab-openshift-default-ff97cd6dd-8jzq7

Unhealthy

Startup probe failed: Get "http://10.133.0.61:15021/healthz/ready": dial tcp 10.133.0.61:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-f6c2cb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-f6c2cb

openshift-ingress

deployment-controller

e2e-ipp-b-f6c2cb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-f6c2cb-openshift-default-549bdfb8b4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-f6c2cb-openshift-default-549bdfb8b4

SuccessfulCreate

Created pod: e2e-ipp-b-f6c2cb-openshift-default-549bdfb8b4-85j7s

openshift-ingress

multus

e2e-ipp-b-f6c2cb-openshift-default-549bdfb8b4-85j7s

AddedInterface

Add eth0 [10.133.0.62/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-f6c2cb-6df64bf4d

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-f6c2cb-6df64bf4d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-f6c2cb: serviceaccount "payload-processing-e2e-ipp-b-f6c2cb" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-f6c2cb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-f6c2cb-8585bdd7f6 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-f6c2cb-8585bdd7f6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-f6c2cb-8585bdd7f6-pn2lw
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-f6c2cb-8585bdd7f6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-f6c2cb-8585bdd7f6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-f6c2cb: serviceaccount "payload-processing-e2e-ipp-b-f6c2cb" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-f6c2cb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-f6c2cb-6df64bf4d from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-f6c2cb-8585bdd7f6-pn2lw

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-f6c2cb-6df64bf4d-ntsv5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-f6c2cb-6df64bf4d-ntsv5

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-f6c2cb-6df64bf4d-ntsv5

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-ipp-b-f6c2cb-6df64bf4d-ntsv5

AddedInterface

Add eth0 [10.132.0.76/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-f6c2cb-6df64bf4d

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-f6c2cb-6df64bf4d-ntsv5

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-f6c2cb-8585bdd7f6-pn2lw

AddedInterface

Add eth0 [10.132.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-f6c2cb-8585bdd7f6-pn2lw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-f6c2cb-8585bdd7f6-pn2lw

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-b-f6c2cb-openshift-default-549bdfb8b4-85j7s

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-f6c2cb-openshift-default-549bdfb8b4-85j7s

ProbeError

Readiness probe error: Get "http://10.133.0.62:15021/healthz/ready": dial tcp 10.133.0.62:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-ipp-b-f6c2cb-openshift-default-549bdfb8b4-85j7s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-ipp-b-f6c2cb-openshift-default-549bdfb8b4-85j7s

Unhealthy

Readiness probe failed: Get "http://10.133.0.62:15021/healthz/ready": dial tcp 10.133.0.62:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-ipp-b-f6c2cb-openshift-default-549bdfb8b4-85j7s

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-b-f6c2cb-openshift-default-549bdfb8b4-85j7s

Unhealthy

Startup probe failed: Get "http://10.133.0.62:15021/healthz/ready": dial tcp 10.133.0.62:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-f6c2cb-openshift-default-549bdfb8b4-85j7s

ProbeError

Startup probe error: Get "http://10.133.0.62:15021/healthz/ready": dial tcp 10.133.0.62:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-fc56ab

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-fc56ab

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-fc56ab-openshift-default-7b5b99dd94

SuccessfulCreate

Created pod: e2e-ipp-cleanup-fc56ab-openshift-default-7b5b99dd94-wrhpg

openshift-ingress

multus

e2e-ipp-cleanup-fc56ab-openshift-default-7b5b99dd94-wrhpg

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ipp-cleanup-fc56ab-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-fc56ab-openshift-default-7b5b99dd94 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-fc56ab-c9d847b84-xrmx4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-fc56ab-7f4c99b966-rhnf4

Created

Created container: payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-fc56ab-7f4c99b966

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-fc56ab-7f4c99b966-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-fc56ab: serviceaccount "payload-processing-e2e-ipp-cleanup-fc56ab" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-fc56ab-7f4c99b966

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-fc56ab-7f4c99b966-rhnf4

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-fc56ab

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-fc56ab-c9d847b84 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-fc56ab-7f4c99b966-rhnf4

AddedInterface

Add eth0 [10.132.0.78/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-fc56ab

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-fc56ab-7f4c99b966 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-fc56ab-c9d847b84

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-fc56ab-c9d847b84-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-fc56ab: serviceaccount "payload-processing-e2e-ipp-cleanup-fc56ab" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-fc56ab-7f4c99b966-rhnf4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-fc56ab-c9d847b84-xrmx4

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-fc56ab-c9d847b84-xrmx4

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-fc56ab-c9d847b84

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-fc56ab-c9d847b84-xrmx4

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-fc56ab-c9d847b84-xrmx4

AddedInterface

Add eth0 [10.132.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-fc56ab-7f4c99b966-rhnf4

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-fc56ab-openshift-default-7b5b99dd94-wrhpg

Unhealthy

Readiness probe failed: Get "http://10.133.0.63:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-cleanup-fc56ab-openshift-default-7b5b99dd94-wrhpg

ProbeError

Readiness probe error: Get "http://10.133.0.63:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-fc56ab-openshift-default-7b5b99dd94-wrhpg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-fc56ab-openshift-default-7b5b99dd94-wrhpg

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-fc56ab-openshift-default-7b5b99dd94-wrhpg

Started

Started container istio-proxy

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-cleanup-fc56ab

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fc56ab: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-cleanup-fc56ab": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fc56ab, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 1c29f328-0f1f-4ef4-870b-af3e39f48f2c, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-fc56ab-c9d847b84-xrmx4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-fc56ab-7f4c99b966-rhnf4

Killing

Stopping container payload-processing
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-fc56ab-openshift-default-7b5b99dd94-wrhpg

ProbeError

Startup probe error: Get "http://10.133.0.63:15021/healthz/ready": dial tcp 10.133.0.63:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-fc56ab-openshift-default-7b5b99dd94-wrhpg

Unhealthy

Startup probe failed: Get "http://10.133.0.63:15021/healthz/ready": dial tcp 10.133.0.63:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ipp-cleanup-fc56ab-openshift-default-7b5b99dd94-wrhpg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-b2b0ab-55d8b4b584-f5qdw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-b2b0ab-77bf64b4-9c29r

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-b2b0ab-openshift-default-ff97cd6dd-8jzq7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-f6c2cb-6df64bf4d-ntsv5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-f6c2cb-8585bdd7f6-pn2lw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-f6c2cb-openshift-default-549bdfb8b4-85j7s

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-02b433-6448b9c7fb-6kdfp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-02b433-64b69b946-dkgqn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-02b433-openshift-default-86bf8dc7fb-9m9kw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-46e6bf-7654444fdd-gq9tg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-46e6bf-846bd765cd-hgzpn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-46e6bf-openshift-default-6b97c6bcfb-kdlrp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-46e6bf-openshift-default-6b97c6bcfb-kdlrp

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-46e6bf-openshift-default-6b97c6bcfb-kdlrp

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503