Time Namespace Component RelatedObject Reason Message

openshift-ingress

kube-auth-proxy-5f5845fd56-ht8ts

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-5f5845fd56-ht8ts to ip-10-0-142-16.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-e80635b4-5f8887f9bf-bc6sw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-e80635b4-5f8887f9bf-bc6sw to ip-10-0-135-248.ec2.internal

openshift-ingress

e2e-ipp-b-f36365-openshift-default-65cbc46dd6-9r2ld

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-f36365-openshift-default-65cbc46dd6-9r2ld to ip-10-0-142-16.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-6d42a5b6-5894db7964-4v72p

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-6d42a5b6-5894db7964-4v72p to ip-10-0-135-248.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-a448180e-f59bd8596-fv5gd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-a448180e-f59bd8596-fv5gd to ip-10-0-135-248.ec2.internal

openshift-ingress

e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486-5ls9p

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486-5ls9p to ip-10-0-130-75.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-5ccb968c66-fdsmh

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-fdsmh to ip-10-0-142-16.ec2.internal

openshift-ingress

e2e-migrate-e80635b4-gw-openshift-default-5f55976948-dw9q9

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-e80635b4-gw-openshift-default-5f55976948-dw9q9 to ip-10-0-142-16.ec2.internal

openshift-ingress

e2e-ait-6d42a5b6-openshift-default-5bf8d994fb-rfqz6

Scheduled

Successfully assigned openshift-ingress/e2e-ait-6d42a5b6-openshift-default-5bf8d994fb-rfqz6 to ip-10-0-142-16.ec2.internal

openshift-ingress

payload-processing-e2e-ait-a448180e-68574b5bf4-x5kpb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-a448180e-68574b5bf4-x5kpb to ip-10-0-135-248.ec2.internal

openshift-ingress

e2e-mt-77b3a01f-openshift-default-6b99c95b8-7ns99

Scheduled

Successfully assigned openshift-ingress/e2e-mt-77b3a01f-openshift-default-6b99c95b8-7ns99 to ip-10-0-142-16.ec2.internal

openshift-ingress

e2e-inf-a-909676-openshift-default-568c49c9f6-fb47c

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-909676-openshift-default-568c49c9f6-fb47c to ip-10-0-142-16.ec2.internal

openshift-ingress

kube-auth-proxy-5f5845fd56-v72b6

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-5f5845fd56-v72b6 to ip-10-0-135-248.ec2.internal

openshift-ingress

payload-processing-5cc6cd444b-dhqmz

Scheduled

Successfully assigned openshift-ingress/payload-processing-5cc6cd444b-dhqmz to ip-10-0-135-248.ec2.internal

openshift-ingress

e2e-derive-3a338fad-openshift-default-6cc4869868-lfclk

Scheduled

Successfully assigned openshift-ingress/e2e-derive-3a338fad-openshift-default-6cc4869868-lfclk to ip-10-0-142-16.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-9xj6h

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9xj6h to ip-10-0-142-16.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-808386-6c59b7dbc6-nq7jr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-808386-6c59b7dbc6-nq7jr to ip-10-0-135-248.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-9e7a39-776f998c9b-mb2gn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-9e7a39-776f998c9b-mb2gn to ip-10-0-135-248.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-f9937e-7cff6f8956-fsp8c

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-f9937e-7cff6f8956-fsp8c to ip-10-0-135-248.ec2.internal

openshift-ingress

payload-processing-e2e-derive-3a338fad-6549496d4b-58njc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-3a338fad-6549496d4b-58njc to ip-10-0-135-248.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-909676-565844c848-tnjld

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-909676-565844c848-tnjld to ip-10-0-135-248.ec2.internal

openshift-ingress

e2e-ait-a448180e-openshift-default-5664986798-cphnn

Scheduled

Successfully assigned openshift-ingress/e2e-ait-a448180e-openshift-default-5664986798-cphnn to ip-10-0-142-16.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-b3bf1c-67876f8d8b-8xp8r

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-b3bf1c-67876f8d8b-8xp8r to ip-10-0-135-248.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-9e7a39-595dd78588-mjd4q

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-9e7a39-595dd78588-mjd4q to ip-10-0-135-248.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-f9937e-c974c4596-pdnfc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-f9937e-c974c4596-pdnfc to ip-10-0-135-248.ec2.internal

openshift-ingress

e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6 to ip-10-0-130-75.ec2.internal

openshift-ingress

e2e-shared-a-8e241a-openshift-default-c799dfb84-4cjs7

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-8e241a-openshift-default-c799dfb84-4cjs7 to ip-10-0-142-16.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-3a338fad-658cf6ffb-fkm8t

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-3a338fad-658cf6ffb-fkm8t to ip-10-0-135-248.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-909676-59d895cc48-2dfff

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-909676-59d895cc48-2dfff to ip-10-0-135-248.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-b3bf1c-65d7b67d88-sm7fz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-b3bf1c-65d7b67d88-sm7fz to ip-10-0-135-248.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-9d9f53-68955b9d8-p9tsh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-9d9f53-68955b9d8-p9tsh to ip-10-0-135-248.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-f36365-6756d8c85b-rffx2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-f36365-6756d8c85b-rffx2 to ip-10-0-135-248.ec2.internal

openshift-ingress

e2e-api-a-9e7a39-openshift-default-546446dff6-t4rdc

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-9e7a39-openshift-default-546446dff6-t4rdc to ip-10-0-142-16.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-e80635b4-6c7bccd888-b54qd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-e80635b4-6c7bccd888-b54qd to ip-10-0-135-248.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-68cf4d799cpzlb9

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpzlb9 to ip-10-0-142-16.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-040fde-fb9b8894d-8p2q7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-040fde-fb9b8894d-8p2q7 to ip-10-0-135-248.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-8e241a-84cdfd5bdd-v2pxg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-8e241a-84cdfd5bdd-v2pxg to ip-10-0-135-248.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-9d9f53-8468456b54-lxpnj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-9d9f53-8468456b54-lxpnj to ip-10-0-135-248.ec2.internal

openshift-ingress

router-default-6b8dd8f79f-j8jln

Scheduled

Successfully assigned openshift-ingress/router-default-6b8dd8f79f-j8jln to ip-10-0-130-75.ec2.internal

openshift-ingress

payload-processing-e2e-mt-77b3a01f-7f4986b7c8-2qrhq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-77b3a01f-7f4986b7c8-2qrhq to ip-10-0-135-248.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-808386-6dbbdc7698-dklmb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-808386-6dbbdc7698-dklmb to ip-10-0-135-248.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-8e241a-664b5975d-cpfwt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-8e241a-664b5975d-cpfwt to ip-10-0-135-248.ec2.internal

openshift-ingress

payload-processing-e2e-mt-7beba8e5-669d6bc5cd-ln5cq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-7beba8e5-669d6bc5cd-ln5cq to ip-10-0-135-248.ec2.internal

openshift-ingress

e2e-shared-b-808386-openshift-default-6476498c4d-c9wjl

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-808386-openshift-default-6476498c4d-c9wjl to ip-10-0-142-16.ec2.internal

openshift-ingress

payload-pre-processing-687dbb6cf6-2vdwb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-687dbb6cf6-2vdwb to ip-10-0-142-16.ec2.internal

openshift-ingress

e2e-mt-7beba8e5-openshift-default-6749858548-fk65t

Scheduled

Successfully assigned openshift-ingress/e2e-mt-7beba8e5-openshift-default-6749858548-fk65t to ip-10-0-142-16.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-77b3a01f-7df58699b-f8lqc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-77b3a01f-7df58699b-f8lqc to ip-10-0-135-248.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-4m4fk

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-4m4fk to ip-10-0-130-75.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-7beba8e5-f6b5f5ff6-rsj7w

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-7beba8e5-f6b5f5ff6-rsj7w to ip-10-0-135-248.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-f36365-6dddcbb4d6-k2k47

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-f36365-6dddcbb4d6-k2k47 to ip-10-0-135-248.ec2.internal

openshift-ingress

e2e-api-b-f9937e-openshift-default-b87768c56-g872g

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-f9937e-openshift-default-b87768c56-g872g to ip-10-0-142-16.ec2.internal

openshift-ingress

payload-processing-e2e-ait-6d42a5b6-5668c74dbd-fqggb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-6d42a5b6-5668c74dbd-fqggb to ip-10-0-135-248.ec2.internal

openshift-ingress

e2e-inf-b-b3bf1c-openshift-default-557f898894-hvwpt

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-b3bf1c-openshift-default-557f898894-hvwpt to ip-10-0-142-16.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-040fde-58688db7f4-r8mhg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-040fde-58688db7f4-r8mhg to ip-10-0-135-248.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-6b8dd8f79f from 0 to 1

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer
(x11)

openshift-ingress

replicaset-controller

router-default-6b8dd8f79f

FailedCreate

Error creating: pods "router-default-6b8dd8f79f-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x17)

openshift-ingress

replicaset-controller

router-default-6b8dd8f79f

FailedCreate

Error creating: pods "router-default-6b8dd8f79f-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-6b8dd8f79f

SuccessfulCreate

Created pod: router-default-6b8dd8f79f-j8jln
(x5)

openshift-ingress

kubelet

router-default-6b8dd8f79f-j8jln

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x6)

openshift-ingress

kubelet

router-default-6b8dd8f79f-j8jln

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

kubelet

router-default-6b8dd8f79f-j8jln

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559" already present on machine

openshift-ingress

kubelet

router-default-6b8dd8f79f-j8jln

Started

Started container router

openshift-ingress

kubelet

router-default-6b8dd8f79f-j8jln

Created

Created container: router

openshift-ingress

multus

router-default-6b8dd8f79f-j8jln

AddedInterface

Add eth0 [10.133.0.10/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

kube-auth-proxy-5f5845fd56

SuccessfulCreate

Created pod: kube-auth-proxy-5f5845fd56-ht8ts
(x5)

openshift-ingress

replicaset-controller

kube-auth-proxy-5f5845fd56

FailedCreate

Error creating: pods "kube-auth-proxy-5f5845fd56-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-5f5845fd56 from 0 to 2

openshift-ingress

replicaset-controller

kube-auth-proxy-5f5845fd56

SuccessfulCreate

Created pod: kube-auth-proxy-5f5845fd56-v72b6

openshift-ingress

kubelet

kube-auth-proxy-5f5845fd56-ht8ts

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-5f5845fd56-v72b6

AddedInterface

Add eth0 [10.134.0.29/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-5f5845fd56-v72b6

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-5f5845fd56-ht8ts

AddedInterface

Add eth0 [10.132.0.23/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-9xj6h

openshift-ingress

kubelet

kube-auth-proxy-5f5845fd56-v72b6

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.908s (2.908s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-5f5845fd56-v72b6

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-5f5845fd56-v72b6

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-5f5845fd56-ht8ts

Started

Started container kube-auth-proxy

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-9xj6h

AddedInterface

Add eth0 [10.132.0.26/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-5f5845fd56-ht8ts

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-5f5845fd56-ht8ts

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 4.361s (4.361s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-9xj6h

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-9xj6h

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-9xj6h

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.726s (2.726s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-9xj6h

Started

Started container discovery

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-4m4fk

AddedInterface

Add eth0 [10.133.0.22/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-9xj6h

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-9xj6h

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-4m4fk

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-4m4fk

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-68cf4d799c from 0 to 1

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-68cf4d799c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-68cf4d799cpzlb9

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-68cf4d799cpzlb9

AddedInterface

Add eth0 [10.132.0.27/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cpzlb9

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-4m4fk

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.309s (2.309s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-4m4fk

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-4m4fk

Created

Created container: discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-9xj6h

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-9xj6h

Killing

Stopping container discovery

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cpzlb9

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 5.287s (5.287s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cpzlb9

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cpzlb9

Created

Created container: istio-proxy

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5ccb968c66

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5ccb968c66-fdsmh

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-5ccb968c66 from 0 to 1

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

multus

maas-default-gateway-openshift-default-5ccb968c66-fdsmh

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5cc6cd444b from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-5cc6cd444b

FailedCreate

Error creating: pods "payload-processing-5cc6cd444b-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

multus

payload-processing-5cc6cd444b-dhqmz

AddedInterface

Add eth0 [10.134.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-2vdwb

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-687dbb6cf6-2vdwb

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-687dbb6cf6 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-687dbb6cf6

FailedCreate

Error creating: pods "payload-pre-processing-687dbb6cf6-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-pre-processing-687dbb6cf6

SuccessfulCreate

Created pod: payload-pre-processing-687dbb6cf6-2vdwb

openshift-ingress

replicaset-controller

payload-processing-5cc6cd444b

SuccessfulCreate

Created pod: payload-processing-5cc6cd444b-dhqmz

openshift-ingress

kubelet

payload-processing-5cc6cd444b-dhqmz

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-2vdwb

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-5cc6cd444b-dhqmz

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-5cc6cd444b-dhqmz

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5cc6cd444b-dhqmz

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.357s (2.357s including waiting). Image size: 165907129 bytes.

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-2vdwb

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-2vdwb

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.779s (2.779s including waiting). Image size: 165907129 bytes.
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-fdsmh

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-fdsmh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-fdsmh

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-fdsmh

Unhealthy

Startup probe failed: Get "http://10.132.0.45:15021/healthz/ready": dial tcp 10.132.0.45:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-fdsmh

ProbeError

Startup probe error: Get "http://10.132.0.45:15021/healthz/ready": dial tcp 10.132.0.45:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-ait-a448180e-openshift-default-5664986798

SuccessfulCreate

Created pod: e2e-ait-a448180e-openshift-default-5664986798-cphnn

openshift-ingress

GatewayAuthBootstrap

e2e-ait-a448180e

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-ait-a448180e-authn-ssl: envoyfilters.networking.istio.io "e2e-ait-a448180e-authn-ssl" already exists

openshift-ingress

deployment-controller

e2e-ait-a448180e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-a448180e-openshift-default-5664986798 from 0 to 1

openshift-ingress

multus

e2e-ait-a448180e-openshift-default-5664986798-cphnn

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ait-a448180e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-a448180e

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-a448180e-f59bd8596

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-a448180e-f59bd8596-fv5gd

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-a448180e-68574b5bf4

SuccessfulCreate

Created pod: payload-processing-e2e-ait-a448180e-68574b5bf4-x5kpb

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-a448180e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-a448180e-f59bd8596 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-a448180e-68574b5bf4

FailedCreate

Error creating: pods "payload-processing-e2e-ait-a448180e-68574b5bf4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-a448180e: serviceaccount "payload-processing-e2e-ait-a448180e" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-a448180e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-a448180e-68574b5bf4 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-a448180e-f59bd8596

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-a448180e-f59bd8596-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-a448180e: serviceaccount "payload-processing-e2e-ait-a448180e" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a448180e-f59bd8596-fv5gd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a448180e-f59bd8596-fv5gd

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ait-a448180e-68574b5bf4-x5kpb

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-a448180e-68574b5bf4-x5kpb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-a448180e-68574b5bf4-x5kpb

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-a448180e-68574b5bf4-x5kpb

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-a448180e-f59bd8596-fv5gd

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a448180e-f59bd8596-fv5gd

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ait-a448180e-openshift-default-5664986798-cphnn

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-a448180e-openshift-default-5664986798-cphnn

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-a448180e-openshift-default-5664986798-cphnn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-ait-a448180e-openshift-default-5664986798-cphnn

Unhealthy

Startup probe failed: Get "http://10.132.0.60:15021/healthz/ready": dial tcp 10.132.0.60:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-ait-a448180e-openshift-default-5664986798-cphnn

ProbeError

Startup probe error: Get "http://10.132.0.60:15021/healthz/ready": dial tcp 10.132.0.60:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ait-a448180e-68574b5bf4-x5kpb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-a448180e-openshift-default-5664986798-cphnn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a448180e-f59bd8596-fv5gd

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-migrate-e80635b4-gw-openshift-default-5f55976948

SuccessfulCreate

Created pod: e2e-migrate-e80635b4-gw-openshift-default-5f55976948-dw9q9

openshift-ingress

gateway_labeler_controller

e2e-migrate-e80635b4-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-e80635b4-gw

openshift-ingress

deployment-controller

e2e-migrate-e80635b4-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-e80635b4-gw-openshift-default-5f55976948 from 0 to 1

openshift-ingress

multus

e2e-migrate-e80635b4-gw-openshift-default-5f55976948-dw9q9

AddedInterface

Add eth0 [10.132.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-a448180e-openshift-default-5664986798-cphnn

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ait-a448180e-openshift-default-5664986798-cphnn

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-e80635b4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-e80635b4-5f8887f9bf from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-e80635b4-5f8887f9bf

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-e80635b4-5f8887f9bf-bc6sw
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-e80635b4-5f8887f9bf

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-e80635b4-5f8887f9bf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-e80635b4: serviceaccount "payload-processing-e2e-migrate-e80635b4" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-e80635b4-6c7bccd888

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-e80635b4-6c7bccd888-b54qd

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-e80635b4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-e80635b4-6c7bccd888 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-e80635b4-6c7bccd888

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-e80635b4-6c7bccd888-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-e80635b4: serviceaccount "payload-processing-e2e-migrate-e80635b4" not found

openshift-ingress

kubelet

payload-processing-e2e-migrate-e80635b4-5f8887f9bf-bc6sw

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-migrate-e80635b4-6c7bccd888-b54qd

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-e80635b4-6c7bccd888-b54qd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-e80635b4-6c7bccd888-b54qd

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-e80635b4-6c7bccd888-b54qd

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-migrate-e80635b4-5f8887f9bf-bc6sw

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-e80635b4-5f8887f9bf-bc6sw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-migrate-e80635b4-5f8887f9bf-bc6sw

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-migrate-e80635b4-gw-openshift-default-5f55976948-dw9q9

Unhealthy

Readiness probe failed: Get "http://10.132.0.61:15021/healthz/ready": read tcp 10.132.0.2:52624->10.132.0.61:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-migrate-e80635b4-gw-openshift-default-5f55976948-dw9q9

ProbeError

Readiness probe error: Get "http://10.132.0.61:15021/healthz/ready": read tcp 10.132.0.2:52624->10.132.0.61:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-migrate-e80635b4-gw-openshift-default-5f55976948-dw9q9

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-e80635b4-gw-openshift-default-5f55976948-dw9q9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-e80635b4-gw-openshift-default-5f55976948-dw9q9

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-migrate-e80635b4-gw-openshift-default-5f55976948-dw9q9

Unhealthy

Startup probe failed: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-migrate-e80635b4-gw-openshift-default-5f55976948-dw9q9

ProbeError

Startup probe error: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-e80635b4-6c7bccd888-b54qd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-e80635b4-5f8887f9bf-bc6sw

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-ait-6d42a5b6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-6d42a5b6

openshift-ingress

deployment-controller

e2e-ait-6d42a5b6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-6d42a5b6-openshift-default-5bf8d994fb from 0 to 1

openshift-ingress

kubelet

e2e-migrate-e80635b4-gw-openshift-default-5f55976948-dw9q9

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-ait-6d42a5b6-openshift-default-5bf8d994fb

SuccessfulCreate

Created pod: e2e-ait-6d42a5b6-openshift-default-5bf8d994fb-rfqz6

openshift-ingress

multus

e2e-ait-6d42a5b6-openshift-default-5bf8d994fb-rfqz6

AddedInterface

Add eth0 [10.132.0.62/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ait-6d42a5b6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-6d42a5b6-5668c74dbd from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-6d42a5b6-5668c74dbd-fqggb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-6d42a5b6-5668c74dbd

FailedCreate

Error creating: pods "payload-processing-e2e-ait-6d42a5b6-5668c74dbd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-6d42a5b6: serviceaccount "payload-processing-e2e-ait-6d42a5b6" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-6d42a5b6-5668c74dbd

SuccessfulCreate

Created pod: payload-processing-e2e-ait-6d42a5b6-5668c74dbd-fqggb

openshift-ingress

kubelet

payload-processing-e2e-ait-6d42a5b6-5668c74dbd-fqggb

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-6d42a5b6-5668c74dbd-fqggb

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-ait-6d42a5b6-5668c74dbd-fqggb

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-6d42a5b6-5894db7964-4v72p

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-6d42a5b6-5894db7964-4v72p

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-6d42a5b6-5894db7964-4v72p

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-6d42a5b6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-6d42a5b6-5894db7964 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-6d42a5b6-5894db7964

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-6d42a5b6-5894db7964-4v72p
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-6d42a5b6-5894db7964

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-6d42a5b6-5894db7964-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-6d42a5b6: serviceaccount "payload-processing-e2e-ait-6d42a5b6" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-6d42a5b6-5894db7964-4v72p

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-migrate-e80635b4-gw-openshift-default-5f55976948-dw9q9

Unhealthy

Readiness probe failed: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused

openshift-ingress

kubelet

e2e-migrate-e80635b4-gw-openshift-default-5f55976948-dw9q9

ProbeError

Readiness probe error: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-ait-6d42a5b6-openshift-default-5bf8d994fb-rfqz6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-6d42a5b6-openshift-default-5bf8d994fb-rfqz6

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-6d42a5b6-openshift-default-5bf8d994fb-rfqz6

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-ait-6d42a5b6-openshift-default-5bf8d994fb-rfqz6

ProbeError

Readiness probe error: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ait-6d42a5b6-openshift-default-5bf8d994fb-rfqz6

Unhealthy

Readiness probe failed: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-ait-6d42a5b6-openshift-default-5bf8d994fb-rfqz6

ProbeError

Startup probe error: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-ait-6d42a5b6-openshift-default-5bf8d994fb-rfqz6

Unhealthy

Startup probe failed: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-6d42a5b6-5894db7964-4v72p

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-6d42a5b6-5668c74dbd-fqggb

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-derive-3a338fad

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-3a338fad

openshift-ingress

deployment-controller

e2e-derive-3a338fad-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-3a338fad-openshift-default-6cc4869868 from 0 to 1

openshift-ingress

replicaset-controller

e2e-derive-3a338fad-openshift-default-6cc4869868

SuccessfulCreate

Created pod: e2e-derive-3a338fad-openshift-default-6cc4869868-lfclk

openshift-ingress

kubelet

e2e-ait-6d42a5b6-openshift-default-5bf8d994fb-rfqz6

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-derive-3a338fad-openshift-default-6cc4869868-lfclk

AddedInterface

Add eth0 [10.132.0.63/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-3a338fad

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-3a338fad-658cf6ffb from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-3a338fad-658cf6ffb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-3a338fad-658cf6ffb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-3a338fad: serviceaccount "payload-processing-e2e-derive-3a338fad" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-3a338fad-658cf6ffb-fkm8t

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-3a338fad-6549496d4b-58njc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-derive-3a338fad-6549496d4b-58njc

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-derive-3a338fad

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-3a338fad-6549496d4b from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-3a338fad-658cf6ffb-fkm8t

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-3a338fad-6549496d4b

SuccessfulCreate

Created pod: payload-processing-e2e-derive-3a338fad-6549496d4b-58njc

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-3a338fad-658cf6ffb-fkm8t

Created

Created container: payload-pre-processing
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-3a338fad-6549496d4b

FailedCreate

Error creating: pods "payload-processing-e2e-derive-3a338fad-6549496d4b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-3a338fad: serviceaccount "payload-processing-e2e-derive-3a338fad" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-3a338fad-658cf6ffb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-3a338fad-658cf6ffb-fkm8t

openshift-ingress

multus

payload-pre-processing-e2e-derive-3a338fad-658cf6ffb-fkm8t

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-3a338fad-6549496d4b-58njc

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-3a338fad-6549496d4b-58njc

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-derive-3a338fad-openshift-default-6cc4869868-lfclk

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-3a338fad-openshift-default-6cc4869868-lfclk

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-3a338fad-openshift-default-6cc4869868-lfclk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-derive-3a338fad-openshift-default-6cc4869868-lfclk

ProbeError

Startup probe error: Get "http://10.132.0.63:15021/healthz/ready": dial tcp 10.132.0.63:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-derive-3a338fad-openshift-default-6cc4869868-lfclk

Unhealthy

Startup probe failed: Get "http://10.132.0.63:15021/healthz/ready": dial tcp 10.132.0.63:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-3a338fad-658cf6ffb-fkm8t

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-3a338fad-6549496d4b-58njc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-derive-3a338fad-openshift-default-6cc4869868-lfclk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-derive-3a338fad-openshift-default-6cc4869868-lfclk

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

kubelet

e2e-derive-3a338fad-openshift-default-6cc4869868-lfclk

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

gateway_labeler_controller

e2e-mt-7beba8e5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-7beba8e5

openshift-ingress

multus

e2e-mt-7beba8e5-openshift-default-6749858548-fk65t

AddedInterface

Add eth0 [10.132.0.64/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-mt-7beba8e5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-7beba8e5-openshift-default-6749858548 from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-7beba8e5-openshift-default-6749858548

SuccessfulCreate

Created pod: e2e-mt-7beba8e5-openshift-default-6749858548-fk65t

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-7beba8e5-669d6bc5cd

SuccessfulCreate

Created pod: payload-processing-e2e-mt-7beba8e5-669d6bc5cd-ln5cq

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-7beba8e5-f6b5f5ff6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-7beba8e5-f6b5f5ff6-rsj7w
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-7beba8e5-f6b5f5ff6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-7beba8e5-f6b5f5ff6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-7beba8e5: serviceaccount "payload-processing-e2e-mt-7beba8e5" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-7beba8e5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-7beba8e5-f6b5f5ff6 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-mt-7beba8e5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-7beba8e5-669d6bc5cd from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-7beba8e5-669d6bc5cd

FailedCreate

Error creating: pods "payload-processing-e2e-mt-7beba8e5-669d6bc5cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-7beba8e5: serviceaccount "payload-processing-e2e-mt-7beba8e5" not found

openshift-ingress

multus

payload-processing-e2e-mt-7beba8e5-669d6bc5cd-ln5cq

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-mt-7beba8e5-f6b5f5ff6-rsj7w

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-7beba8e5-669d6bc5cd-ln5cq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-7beba8e5-669d6bc5cd-ln5cq

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-7beba8e5-669d6bc5cd-ln5cq

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-7beba8e5-f6b5f5ff6-rsj7w

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-7beba8e5-f6b5f5ff6-rsj7w

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-7beba8e5-f6b5f5ff6-rsj7w

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-7beba8e5-openshift-default-6749858548-fk65t

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-7beba8e5-openshift-default-6749858548-fk65t

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-7beba8e5-openshift-default-6749858548-fk65t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-mt-7beba8e5-openshift-default-6749858548-fk65t

Unhealthy

Startup probe failed: Get "http://10.132.0.64:15021/healthz/ready": dial tcp 10.132.0.64:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-mt-7beba8e5-openshift-default-6749858548-fk65t

ProbeError

Startup probe error: Get "http://10.132.0.64:15021/healthz/ready": dial tcp 10.132.0.64:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-mt-7beba8e5-669d6bc5cd-ln5cq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-7beba8e5-f6b5f5ff6-rsj7w

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-7beba8e5-f6b5f5ff6-rsj7w

Unhealthy

Readiness probe failed: dial tcp 10.134.0.58:9004: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-mt-7beba8e5-669d6bc5cd-ln5cq

Unhealthy

Readiness probe failed: dial tcp 10.134.0.57:9004: i/o timeout

openshift-ingress

kubelet

e2e-mt-7beba8e5-openshift-default-6749858548-fk65t

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-mt-77b3a01f-openshift-default-6b99c95b8

SuccessfulCreate

Created pod: e2e-mt-77b3a01f-openshift-default-6b99c95b8-7ns99

openshift-ingress

gateway_labeler_controller

e2e-mt-77b3a01f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-77b3a01f

openshift-ingress

deployment-controller

e2e-mt-77b3a01f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-77b3a01f-openshift-default-6b99c95b8 from 0 to 1

openshift-ingress

multus

e2e-mt-77b3a01f-openshift-default-6b99c95b8-7ns99

AddedInterface

Add eth0 [10.132.0.65/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-77b3a01f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-77b3a01f-7df58699b from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-77b3a01f-7f4986b7c8

FailedCreate

Error creating: pods "payload-processing-e2e-mt-77b3a01f-7f4986b7c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-77b3a01f: serviceaccount "payload-processing-e2e-mt-77b3a01f" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-77b3a01f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-77b3a01f-7f4986b7c8 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-mt-77b3a01f-7f4986b7c8-2qrhq

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-77b3a01f-7df58699b-f8lqc

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-77b3a01f-7df58699b-f8lqc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-mt-77b3a01f-7df58699b-f8lqc

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-77b3a01f-7df58699b-f8lqc

Started

Started container payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-77b3a01f-7df58699b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-77b3a01f-7df58699b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-77b3a01f: serviceaccount "payload-processing-e2e-mt-77b3a01f" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-77b3a01f-7f4986b7c8

SuccessfulCreate

Created pod: payload-processing-e2e-mt-77b3a01f-7f4986b7c8-2qrhq

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-77b3a01f-7df58699b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-77b3a01f-7df58699b-f8lqc

openshift-ingress

kubelet

payload-processing-e2e-mt-77b3a01f-7f4986b7c8-2qrhq

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-77b3a01f-7f4986b7c8-2qrhq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-77b3a01f-7f4986b7c8-2qrhq

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-mt-77b3a01f-openshift-default-6b99c95b8-7ns99

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-77b3a01f-openshift-default-6b99c95b8-7ns99

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-77b3a01f-openshift-default-6b99c95b8-7ns99

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-mt-77b3a01f-openshift-default-6b99c95b8-7ns99

Unhealthy

Startup probe failed: Get "http://10.132.0.65:15021/healthz/ready": dial tcp 10.132.0.65:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-mt-77b3a01f-openshift-default-6b99c95b8-7ns99

ProbeError

Startup probe error: Get "http://10.132.0.65:15021/healthz/ready": dial tcp 10.132.0.65:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-mt-77b3a01f-7f4986b7c8-2qrhq

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-mt-77b3a01f

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-mt-77b3a01f: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-mt-77b3a01f": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-mt-77b3a01f, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: d41aaa7e-9791-476b-9f16-032d5d609fbd, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-77b3a01f-7df58699b-f8lqc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-77b3a01f-openshift-default-6b99c95b8-7ns99

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-inf-a-909676

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-909676

openshift-ingress

GatewayAuthBootstrap

e2e-inf-a-909676

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-inf-a-909676-authn-ssl: envoyfilters.networking.istio.io "e2e-inf-a-909676-authn-ssl" already exists

openshift-ingress

replicaset-controller

e2e-inf-a-909676-openshift-default-568c49c9f6

SuccessfulCreate

Created pod: e2e-inf-a-909676-openshift-default-568c49c9f6-fb47c

openshift-ingress

deployment-controller

e2e-inf-a-909676-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-909676-openshift-default-568c49c9f6 from 0 to 1

openshift-ingress

multus

e2e-inf-a-909676-openshift-default-568c49c9f6-fb47c

AddedInterface

Add eth0 [10.132.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-909676-565844c848-tnjld

Created

Created container: payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-909676-565844c848

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-909676-565844c848-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-909676: serviceaccount "payload-processing-e2e-inf-a-909676" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-909676

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-909676-59d895cc48 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-909676-59d895cc48

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-909676-59d895cc48-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-909676: serviceaccount "payload-processing-e2e-inf-a-909676" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-909676-59d895cc48-2dfff

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-909676-59d895cc48-2dfff

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-909676-59d895cc48-2dfff

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-inf-a-909676-565844c848-tnjld

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-909676-565844c848-tnjld

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-909676-59d895cc48-2dfff

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-909676-565844c848-tnjld

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-909676-59d895cc48

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-909676-59d895cc48-2dfff

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-909676-565844c848

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-909676-565844c848-tnjld

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-909676

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-909676-565844c848 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-inf-a-909676-openshift-default-568c49c9f6-fb47c

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-909676-openshift-default-568c49c9f6-fb47c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-909676-openshift-default-568c49c9f6-fb47c

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-inf-a-909676-openshift-default-568c49c9f6-fb47c

Unhealthy

Readiness probe failed: Get "http://10.132.0.66:15021/healthz/ready": dial tcp 10.132.0.66:15021: connect: connection refused

openshift-ingress

kubelet

e2e-inf-a-909676-openshift-default-568c49c9f6-fb47c

ProbeError

Readiness probe error: Get "http://10.132.0.66:15021/healthz/ready": dial tcp 10.132.0.66:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-inf-a-909676-openshift-default-568c49c9f6-fb47c

Unhealthy

Startup probe failed: Get "http://10.132.0.66:15021/healthz/ready": dial tcp 10.132.0.66:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-inf-a-909676-openshift-default-568c49c9f6-fb47c

ProbeError

Startup probe error: Get "http://10.132.0.66:15021/healthz/ready": dial tcp 10.132.0.66:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-inf-b-b3bf1c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-b3bf1c

openshift-ingress

deployment-controller

e2e-inf-b-b3bf1c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-b3bf1c-openshift-default-557f898894 from 0 to 1

openshift-ingress

multus

e2e-inf-b-b3bf1c-openshift-default-557f898894-hvwpt

AddedInterface

Add eth0 [10.132.0.67/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-inf-b-b3bf1c-openshift-default-557f898894

SuccessfulCreate

Created pod: e2e-inf-b-b3bf1c-openshift-default-557f898894-hvwpt

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-b3bf1c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-b3bf1c-67876f8d8b from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-b3bf1c-67876f8d8b

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-b3bf1c-67876f8d8b-8xp8r
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-b3bf1c-67876f8d8b

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-b3bf1c-67876f8d8b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-b3bf1c: serviceaccount "payload-processing-e2e-inf-b-b3bf1c" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-b3bf1c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-b3bf1c-65d7b67d88 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-b3bf1c-65d7b67d88

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-b3bf1c-65d7b67d88-sm7fz
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-b3bf1c-65d7b67d88

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-b3bf1c-65d7b67d88-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-b3bf1c: serviceaccount "payload-processing-e2e-inf-b-b3bf1c" not found

openshift-ingress

kubelet

payload-processing-e2e-inf-b-b3bf1c-67876f8d8b-8xp8r

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-inf-b-b3bf1c-67876f8d8b-8xp8r

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-b3bf1c-67876f8d8b-8xp8r

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-b3bf1c-65d7b67d88-sm7fz

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-b3bf1c-65d7b67d88-sm7fz

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-b3bf1c-65d7b67d88-sm7fz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-b3bf1c-65d7b67d88-sm7fz

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-b3bf1c-67876f8d8b-8xp8r

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-b3bf1c-openshift-default-557f898894-hvwpt

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-b3bf1c-openshift-default-557f898894-hvwpt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-b3bf1c-openshift-default-557f898894-hvwpt

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-inf-b-b3bf1c-openshift-default-557f898894-hvwpt

Unhealthy

Startup probe failed: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-inf-b-b3bf1c-openshift-default-557f898894-hvwpt

ProbeError

Startup probe error: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-909676-59d895cc48-2dfff

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-909676-565844c848-tnjld

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-a-909676-openshift-default-568c49c9f6-fb47c

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-inf-b-b3bf1c-67876f8d8b-8xp8r

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-inf-b-b3bf1c

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-inf-b-b3bf1c: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-inf-b-b3bf1c": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-inf-b-b3bf1c, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: eef34884-b24e-453f-a0f0-104fafb67b6a, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-b3bf1c-65d7b67d88-sm7fz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-b-b3bf1c-openshift-default-557f898894-hvwpt

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-api-a-9e7a39-openshift-default-546446dff6

SuccessfulCreate

Created pod: e2e-api-a-9e7a39-openshift-default-546446dff6-t4rdc

openshift-ingress

deployment-controller

e2e-api-a-9e7a39-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-9e7a39-openshift-default-546446dff6 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-9e7a39

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-9e7a39

openshift-ingress

multus

e2e-api-a-9e7a39-openshift-default-546446dff6-t4rdc

AddedInterface

Add eth0 [10.132.0.68/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-9e7a39

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-9e7a39-595dd78588 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-9e7a39

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-9e7a39-776f998c9b from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-9e7a39-776f998c9b

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-9e7a39-776f998c9b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-9e7a39: serviceaccount "payload-processing-e2e-api-a-9e7a39" not found

openshift-ingress

kubelet

payload-processing-e2e-api-a-9e7a39-776f998c9b-mb2gn

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-api-a-9e7a39-776f998c9b-mb2gn

AddedInterface

Add eth0 [10.134.0.72/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-api-a-9e7a39-595dd78588-mjd4q

AddedInterface

Add eth0 [10.134.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-9e7a39-776f998c9b-mb2gn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-9e7a39-595dd78588-mjd4q

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-9e7a39-595dd78588

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-9e7a39-595dd78588-mjd4q
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-9e7a39-595dd78588

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-9e7a39-595dd78588-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-9e7a39: serviceaccount "payload-processing-e2e-api-a-9e7a39" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-9e7a39-595dd78588-mjd4q

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-9e7a39-776f998c9b-mb2gn

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-9e7a39-595dd78588-mjd4q

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-9e7a39-776f998c9b

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-9e7a39-776f998c9b-mb2gn

openshift-ingress

gateway_labeler_controller

e2e-api-b-f9937e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-f9937e

openshift-ingress

replicaset-controller

e2e-api-b-f9937e-openshift-default-b87768c56

SuccessfulCreate

Created pod: e2e-api-b-f9937e-openshift-default-b87768c56-g872g

openshift-ingress

deployment-controller

e2e-api-b-f9937e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-f9937e-openshift-default-b87768c56 from 0 to 1

openshift-ingress

multus

e2e-api-b-f9937e-openshift-default-b87768c56-g872g

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-api-a-9e7a39-openshift-default-546446dff6-t4rdc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-9e7a39-openshift-default-546446dff6-t4rdc

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-9e7a39-openshift-default-546446dff6-t4rdc

Started

Started container istio-proxy
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-f9937e-7cff6f8956

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-f9937e-7cff6f8956-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-f9937e: serviceaccount "payload-processing-e2e-api-b-f9937e" not found

openshift-ingress

kubelet

e2e-api-a-9e7a39-openshift-default-546446dff6-t4rdc

ProbeError

Readiness probe error: Get "http://10.132.0.68:15021/healthz/ready": dial tcp 10.132.0.68:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-api-a-9e7a39-openshift-default-546446dff6-t4rdc

Unhealthy

Readiness probe failed: Get "http://10.132.0.68:15021/healthz/ready": dial tcp 10.132.0.68:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-f9937e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-f9937e-7cff6f8956 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-f9937e-c974c4596

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-f9937e-c974c4596-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-f9937e: serviceaccount "payload-processing-e2e-api-b-f9937e" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-f9937e-c974c4596

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-f9937e-c974c4596-pdnfc

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-f9937e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-f9937e-c974c4596 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-api-b-f9937e-c974c4596-pdnfc

AddedInterface

Add eth0 [10.134.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-f9937e-c974c4596-pdnfc

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-api-b-f9937e-7cff6f8956-fsp8c

AddedInterface

Add eth0 [10.134.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-f9937e-7cff6f8956-fsp8c

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-f9937e-7cff6f8956-fsp8c

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-f9937e-7cff6f8956

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-f9937e-7cff6f8956-fsp8c

openshift-ingress

kubelet

payload-processing-e2e-api-b-f9937e-7cff6f8956-fsp8c

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-f9937e-c974c4596-pdnfc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-f9937e-c974c4596-pdnfc

Created

Created container: payload-pre-processing
(x4)

openshift-ingress

kubelet

e2e-api-a-9e7a39-openshift-default-546446dff6-t4rdc

ProbeError

Startup probe error: Get "http://10.132.0.68:15021/healthz/ready": dial tcp 10.132.0.68:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-api-a-9e7a39-openshift-default-546446dff6-t4rdc

Unhealthy

Startup probe failed: Get "http://10.132.0.68:15021/healthz/ready": dial tcp 10.132.0.68:15021: connect: connection refused

openshift-ingress

kubelet

e2e-api-b-f9937e-openshift-default-b87768c56-g872g

Unhealthy

Readiness probe failed: Get "http://10.132.0.69:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-api-b-f9937e-openshift-default-b87768c56-g872g

ProbeError

Readiness probe error: Get "http://10.132.0.69:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-api-b-f9937e-openshift-default-b87768c56-g872g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-f9937e-openshift-default-b87768c56-g872g

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-f9937e-openshift-default-b87768c56-g872g

Created

Created container: istio-proxy
(x4)

openshift-ingress

kubelet

e2e-api-b-f9937e-openshift-default-b87768c56-g872g

Unhealthy

Startup probe failed: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-api-b-f9937e-openshift-default-b87768c56-g872g

ProbeError

Startup probe error: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-api-a-9e7a39-776f998c9b-mb2gn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-9e7a39-595dd78588-mjd4q

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-a-9e7a39-openshift-default-546446dff6-t4rdc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-9e7a39-openshift-default-546446dff6-t4rdc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-a-9e7a39-openshift-default-546446dff6-t4rdc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-api-b-f9937e-7cff6f8956-fsp8c

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-f9937e-c974c4596-pdnfc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-f9937e-openshift-default-b87768c56-g872g

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-a-8e241a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-8e241a-openshift-default-c799dfb84 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-8e241a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-8e241a

openshift-ingress

replicaset-controller

e2e-shared-a-8e241a-openshift-default-c799dfb84

SuccessfulCreate

Created pod: e2e-shared-a-8e241a-openshift-default-c799dfb84-4cjs7

openshift-ingress

multus

e2e-shared-a-8e241a-openshift-default-c799dfb84-4cjs7

AddedInterface

Add eth0 [10.132.0.70/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-8e241a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-8e241a-664b5975d from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-8e241a-84cdfd5bdd-v2pxg

AddedInterface

Add eth0 [10.134.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-8e241a-84cdfd5bdd-v2pxg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-8e241a-664b5975d-cpfwt

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-8e241a-664b5975d-cpfwt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-8e241a-664b5975d

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-8e241a-664b5975d-cpfwt

openshift-ingress

kubelet

payload-processing-e2e-shared-a-8e241a-664b5975d-cpfwt

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-8e241a-84cdfd5bdd-v2pxg

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-8e241a-84cdfd5bdd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-8e241a-84cdfd5bdd-v2pxg
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-8e241a-84cdfd5bdd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-8e241a-84cdfd5bdd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-8e241a: serviceaccount "payload-processing-e2e-shared-a-8e241a" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-8e241a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-8e241a-84cdfd5bdd from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-8e241a-664b5975d

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-8e241a-664b5975d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-8e241a: serviceaccount "payload-processing-e2e-shared-a-8e241a" not found

openshift-ingress

multus

payload-processing-e2e-shared-a-8e241a-664b5975d-cpfwt

AddedInterface

Add eth0 [10.134.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-8e241a-84cdfd5bdd-v2pxg

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-shared-a-8e241a-openshift-default-c799dfb84-4cjs7

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-8e241a-openshift-default-c799dfb84-4cjs7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-8e241a-openshift-default-c799dfb84-4cjs7

Created

Created container: istio-proxy
(x4)

openshift-ingress

kubelet

e2e-shared-a-8e241a-openshift-default-c799dfb84-4cjs7

ProbeError

Startup probe error: Get "http://10.132.0.70:15021/healthz/ready": dial tcp 10.132.0.70:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-shared-a-8e241a-openshift-default-c799dfb84-4cjs7

Unhealthy

Startup probe failed: Get "http://10.132.0.70:15021/healthz/ready": dial tcp 10.132.0.70:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-shared-b-808386

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-808386

openshift-ingress

replicaset-controller

e2e-shared-b-808386-openshift-default-6476498c4d

SuccessfulCreate

Created pod: e2e-shared-b-808386-openshift-default-6476498c4d-c9wjl

openshift-ingress

deployment-controller

e2e-shared-b-808386-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-808386-openshift-default-6476498c4d from 0 to 1

openshift-ingress

multus

e2e-shared-b-808386-openshift-default-6476498c4d-c9wjl

AddedInterface

Add eth0 [10.132.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-808386-6c59b7dbc6-nq7jr

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-808386-6dbbdc7698-dklmb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-808386-6dbbdc7698

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-808386-6dbbdc7698-dklmb

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-808386-6c59b7dbc6-nq7jr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-808386

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-808386-6dbbdc7698 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-808386-6c59b7dbc6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-808386-6c59b7dbc6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-808386: serviceaccount "payload-processing-e2e-shared-b-808386" not found

openshift-ingress

multus

payload-processing-e2e-shared-b-808386-6dbbdc7698-dklmb

AddedInterface

Add eth0 [10.134.0.81/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-808386-6c59b7dbc6-nq7jr

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-808386-6c59b7dbc6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-808386-6c59b7dbc6-nq7jr

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-808386-6c59b7dbc6-nq7jr

AddedInterface

Add eth0 [10.134.0.80/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-808386-6dbbdc7698-dklmb

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-808386-6dbbdc7698-dklmb

Started

Started container payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-808386

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-808386-6c59b7dbc6 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-808386-6dbbdc7698

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-808386-6dbbdc7698-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-808386: serviceaccount "payload-processing-e2e-shared-b-808386" not found

openshift-ingress

kubelet

e2e-shared-b-808386-openshift-default-6476498c4d-c9wjl

Unhealthy

Readiness probe failed: Get "http://10.132.0.71:15021/healthz/ready": read tcp 10.132.0.2:46972->10.132.0.71:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-shared-b-808386-openshift-default-6476498c4d-c9wjl

ProbeError

Readiness probe error: Get "http://10.132.0.71:15021/healthz/ready": read tcp 10.132.0.2:46972->10.132.0.71:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-808386-openshift-default-6476498c4d-c9wjl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-808386-openshift-default-6476498c4d-c9wjl

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-808386-openshift-default-6476498c4d-c9wjl

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-shared-b-808386-openshift-default-6476498c4d-c9wjl

ProbeError

Startup probe error: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-shared-b-808386-openshift-default-6476498c4d-c9wjl

Unhealthy

Startup probe failed: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b

SuccessfulCreate

Created pod: e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6

openshift-ingress

deployment-controller

e2e-ipp-a-9d9f53-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-9d9f53

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-9d9f53

openshift-ingress

kubelet

e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.823s (2.823s including waiting). Image size: 181318953 bytes.
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-9d9f53-68955b9d8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-9d9f53-68955b9d8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-9d9f53: serviceaccount "payload-processing-e2e-ipp-a-9d9f53" not found

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-9d9f53-68955b9d8-p9tsh

AddedInterface

Add eth0 [10.134.0.87/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-9d9f53

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-9d9f53-68955b9d8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-9d9f53-68955b9d8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-9d9f53-68955b9d8-p9tsh

openshift-ingress

multus

payload-processing-e2e-ipp-a-9d9f53-8468456b54-lxpnj

AddedInterface

Add eth0 [10.134.0.88/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-9d9f53-8468456b54

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-9d9f53-8468456b54-lxpnj
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-9d9f53-8468456b54

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-9d9f53-8468456b54-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-9d9f53: serviceaccount "payload-processing-e2e-ipp-a-9d9f53" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-9d9f53-68955b9d8-p9tsh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-9d9f53

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-9d9f53-8468456b54 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-9d9f53-8468456b54-lxpnj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-9d9f53-68955b9d8-p9tsh

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-9d9f53-8468456b54-lxpnj

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-9d9f53-68955b9d8-p9tsh

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-9d9f53-8468456b54-lxpnj

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6

Unhealthy

Startup probe failed: Get "http://10.133.0.43:15021/healthz/ready": dial tcp 10.133.0.43:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6

ProbeError

Startup probe error: Get "http://10.133.0.43:15021/healthz/ready": dial tcp 10.133.0.43:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-ipp-b-f36365-openshift-default-65cbc46dd6

SuccessfulCreate

Created pod: e2e-ipp-b-f36365-openshift-default-65cbc46dd6-9r2ld

openshift-ingress

deployment-controller

e2e-ipp-b-f36365-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-f36365-openshift-default-65cbc46dd6 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-f36365

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-f36365

openshift-ingress

multus

e2e-ipp-b-f36365-openshift-default-65cbc46dd6-9r2ld

AddedInterface

Add eth0 [10.132.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-f36365-6756d8c85b-rffx2

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-b-f36365-6dddcbb4d6-k2k47

AddedInterface

Add eth0 [10.134.0.91/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-f36365-6dddcbb4d6

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-f36365-6dddcbb4d6-k2k47

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-f36365-6756d8c85b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-f36365-6756d8c85b-rffx2
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-f36365-6756d8c85b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-f36365-6756d8c85b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-f36365: serviceaccount "payload-processing-e2e-ipp-b-f36365" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-f36365-6dddcbb4d6

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-f36365-6dddcbb4d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-f36365: serviceaccount "payload-processing-e2e-ipp-b-f36365" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-f36365-6dddcbb4d6-k2k47

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-f36365-6756d8c85b-rffx2

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-f36365

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-f36365-6dddcbb4d6 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-f36365

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-f36365-6756d8c85b from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-f36365-6756d8c85b-rffx2

AddedInterface

Add eth0 [10.134.0.90/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-f36365-6756d8c85b-rffx2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-f36365-6dddcbb4d6-k2k47

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-f36365-6dddcbb4d6-k2k47

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-b-f36365-openshift-default-65cbc46dd6-9r2ld

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-f36365-openshift-default-65cbc46dd6-9r2ld

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-f36365-openshift-default-65cbc46dd6-9r2ld

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-ipp-b-f36365-openshift-default-65cbc46dd6-9r2ld

Unhealthy

Startup probe failed: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-ipp-b-f36365-openshift-default-65cbc46dd6-9r2ld

ProbeError

Startup probe error: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486

SuccessfulCreate

Created pod: e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486-5ls9p

openshift-ingress

deployment-controller

e2e-ipp-cleanup-040fde-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-040fde

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-040fde

openshift-ingress

multus

e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486-5ls9p

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-040fde

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-040fde-58688db7f4 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-040fde-fb9b8894d-8p2q7

AddedInterface

Add eth0 [10.134.0.93/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-040fde-fb9b8894d-8p2q7

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-040fde-58688db7f4-r8mhg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-040fde-58688db7f4-r8mhg

AddedInterface

Add eth0 [10.134.0.94/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-040fde-58688db7f4-r8mhg

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-040fde-58688db7f4-r8mhg

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-040fde-fb9b8894d-8p2q7

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-040fde

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-040fde-fb9b8894d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-040fde-fb9b8894d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-040fde-fb9b8894d-8p2q7
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-040fde-fb9b8894d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-040fde-fb9b8894d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-040fde: serviceaccount "payload-processing-e2e-ipp-cleanup-040fde" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-040fde-fb9b8894d-8p2q7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-040fde-58688db7f4

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-040fde-58688db7f4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-040fde: serviceaccount "payload-processing-e2e-ipp-cleanup-040fde" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-040fde-58688db7f4

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-040fde-58688db7f4-r8mhg
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486-5ls9p

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486-5ls9p

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486-5ls9p

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486-5ls9p

Unhealthy

Startup probe failed: Get "http://10.133.0.46:15021/healthz/ready": dial tcp 10.133.0.46:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486-5ls9p

ProbeError

Startup probe error: Get "http://10.133.0.46:15021/healthz/ready": dial tcp 10.133.0.46:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-040fde-fb9b8894d-8p2q7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-040fde-58688db7f4-r8mhg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486-5ls9p

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-9d9f53-8468456b54-lxpnj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-9d9f53-68955b9d8-p9tsh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-f36365-6dddcbb4d6-k2k47

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-b-f36365

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-b-f36365: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-b-f36365": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-b-f36365, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: f1c8a810-aea2-4c3c-b15b-3a22a0441864, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-f36365-6756d8c85b-rffx2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-f36365-openshift-default-65cbc46dd6-9r2ld

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-8e241a-664b5975d-cpfwt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-8e241a-84cdfd5bdd-v2pxg

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-a-8e241a

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-a-8e241a: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-a-8e241a": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-a-8e241a, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: d11a3550-73c3-4b73-9674-e76a3dd1208f, UID in object meta:

openshift-ingress

kubelet

e2e-shared-a-8e241a-openshift-default-c799dfb84-4cjs7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-808386-6dbbdc7698-dklmb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-808386-6c59b7dbc6-nq7jr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-808386-openshift-default-6476498c4d-c9wjl

Killing

Stopping container istio-proxy