Time Namespace Component RelatedObject Reason Message

openshift-ingress

e2e-migrate-00691797-gw-openshift-default-75876f54fb-r7gnv

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-00691797-gw-openshift-default-75876f54fb-r7gnv to ip-10-0-142-171.ec2.internal

openshift-ingress

payload-processing-e2e-mt-76809045-548f695c94-bws5g

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-76809045-548f695c94-bws5g to ip-10-0-142-171.ec2.internal

openshift-ingress

e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl to ip-10-0-142-171.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-96grz

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-96grz to ip-10-0-140-57.ec2.internal

openshift-ingress

e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb

Scheduled

Successfully assigned openshift-ingress/e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb to ip-10-0-140-57.ec2.internal

openshift-ingress

payload-pre-processing-687dbb6cf6-2nz8x

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-687dbb6cf6-2nz8x to ip-10-0-142-171.ec2.internal

openshift-ingress

e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9

Scheduled

Successfully assigned openshift-ingress/e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9 to ip-10-0-140-57.ec2.internal

openshift-ingress

kube-auth-proxy-5dd59b47cf-nbqnw

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-5dd59b47cf-nbqnw to ip-10-0-142-171.ec2.internal

openshift-ingress

e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs

Scheduled

Successfully assigned openshift-ingress/e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs to ip-10-0-140-57.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-0b1393fc-6fd6cd9d96-8fxqp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-0b1393fc-6fd6cd9d96-8fxqp to ip-10-0-142-171.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-bb026c71-67697dc976-qxzwf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-bb026c71-67697dc976-qxzwf to ip-10-0-142-171.ec2.internal

openshift-ingress

e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8 to ip-10-0-140-57.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-944fa0-69c8f47d44-f446k

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-944fa0-69c8f47d44-f446k to ip-10-0-142-171.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-74909c-556b798db4-vgwt8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-74909c-556b798db4-vgwt8 to ip-10-0-142-171.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-5dae47b4-64c966bcbd-f86pm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-5dae47b4-64c966bcbd-f86pm to ip-10-0-142-171.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-35bf7c-59b568cd8d-bh8v6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-35bf7c-59b568cd8d-bh8v6 to ip-10-0-142-171.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-d59e9c-78d5b6c56-pf5mv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-d59e9c-78d5b6c56-pf5mv to ip-10-0-142-171.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-f227a8-6b9bb5d644-2msqt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-f227a8-6b9bb5d644-2msqt to ip-10-0-132-61.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-b78801-bd8698dfb-7stpv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-b78801-bd8698dfb-7stpv to ip-10-0-132-61.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-00691797-746586d5dd-jnzrs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-00691797-746586d5dd-jnzrs to ip-10-0-142-171.ec2.internal

openshift-ingress

kube-auth-proxy-5dd59b47cf-88vhs

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-5dd59b47cf-88vhs to ip-10-0-132-61.ec2.internal

openshift-ingress

e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8

Scheduled

Successfully assigned openshift-ingress/e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8 to ip-10-0-140-57.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-hc7jb

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hc7jb to ip-10-0-142-171.ec2.internal

openshift-ingress

e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds to ip-10-0-140-57.ec2.internal

openshift-ingress

e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn to ip-10-0-142-171.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-76809045-f8f56ddb4-vqwdz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-76809045-f8f56ddb4-vqwdz to ip-10-0-142-171.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-c581614e-b8f78cc64-q6gnl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-c581614e-b8f78cc64-q6gnl to ip-10-0-142-171.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-b4cd12-789fd8bdf6-429wd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-b4cd12-789fd8bdf6-429wd to ip-10-0-132-61.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-70aa40-784cd4888-gh94j

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-70aa40-784cd4888-gh94j to ip-10-0-142-171.ec2.internal

openshift-ingress

e2e-ipp-a-f227a8-openshift-default-f9b4b56f8-rqfkr

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-f227a8-openshift-default-f9b4b56f8-rqfkr to ip-10-0-142-171.ec2.internal

openshift-ingress

payload-processing-5cc6cd444b-pfwms

Scheduled

Successfully assigned openshift-ingress/payload-processing-5cc6cd444b-pfwms to ip-10-0-142-171.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-3ff2a8-8b4b47c6-gh2ml

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3ff2a8-8b4b47c6-gh2ml to ip-10-0-132-61.ec2.internal

openshift-ingress

payload-processing-e2e-ait-0b1393fc-5b86b77f98-f447z

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-0b1393fc-5b86b77f98-f447z to ip-10-0-142-171.ec2.internal

openshift-ingress

e2e-inf-b-d59e9c-openshift-default-59f56ff4b6-269lc

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-d59e9c-openshift-default-59f56ff4b6-269lc to ip-10-0-140-57.ec2.internal

openshift-ingress

e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx to ip-10-0-142-171.ec2.internal

openshift-ingress

payload-processing-e2e-ait-bb026c71-6d45f86d9d-bvvj7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-bb026c71-6d45f86d9d-bvvj7 to ip-10-0-142-171.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-72h87

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-72h87 to ip-10-0-140-57.ec2.internal

openshift-ingress

e2e-inf-a-35bf7c-openshift-default-84d949dd9d-28kll

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-35bf7c-openshift-default-84d949dd9d-28kll to ip-10-0-142-171.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-944fa0-7574458d4d-czbpd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-944fa0-7574458d4d-czbpd to ip-10-0-142-171.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-74909c-7585747598-wwdjh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-74909c-7585747598-wwdjh to ip-10-0-132-61.ec2.internal

openshift-ingress

payload-processing-e2e-derive-5dae47b4-566f8c6cf8-fjrvg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-5dae47b4-566f8c6cf8-fjrvg to ip-10-0-142-171.ec2.internal

openshift-ingress

router-default-6c46d44f97-sg67g

Scheduled

Successfully assigned openshift-ingress/router-default-6c46d44f97-sg67g to ip-10-0-142-171.ec2.internal

openshift-ingress

router-default-6c46d44f97-sg67g

FailedScheduling

0/3 nodes are available: 3 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/3 nodes are available: 3 Preemption is not helpful for scheduling.

openshift-ingress

payload-processing-e2e-inf-a-35bf7c-7f78bbccb6-vk86q

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-35bf7c-7f78bbccb6-vk86q to ip-10-0-142-171.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-70aa40-7b576cd6fd-j2gpj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-70aa40-7b576cd6fd-j2gpj to ip-10-0-132-61.ec2.internal

openshift-ingress

e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp to ip-10-0-140-57.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-b4cd12-7b876f55f4-zqgpw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-b4cd12-7b876f55f4-zqgpw to ip-10-0-132-61.ec2.internal

openshift-ingress

payload-processing-e2e-mt-c581614e-9d6979546-n7vx4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-c581614e-9d6979546-n7vx4 to ip-10-0-142-171.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-d59e9c-6688b8f5d-6z68j

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-d59e9c-6688b8f5d-6z68j to ip-10-0-142-171.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-f227a8-777ddd4b74-n8477

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-f227a8-777ddd4b74-n8477 to ip-10-0-132-61.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-b78801-5988855988-5mllg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-b78801-5988855988-5mllg to ip-10-0-132-61.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-3ff2a8-57bd5df964-w2zzj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-3ff2a8-57bd5df964-w2zzj to ip-10-0-142-171.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-k22wq

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-k22wq to ip-10-0-142-171.ec2.internal

openshift-ingress

e2e-derive-5dae47b4-openshift-default-76d7cb7948-n4fzp

Scheduled

Successfully assigned openshift-ingress/e2e-derive-5dae47b4-openshift-default-76d7cb7948-n4fzp to ip-10-0-142-171.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-00691797-6d9846bc6f-tp6s7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-00691797-6d9846bc6f-tp6s7 to ip-10-0-142-171.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-6c46d44f97 from 0 to 1

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer
(x14)

openshift-ingress

replicaset-controller

router-default-6c46d44f97

FailedCreate

Error creating: pods "router-default-6c46d44f97-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x16)

openshift-ingress

replicaset-controller

router-default-6c46d44f97

FailedCreate

Error creating: pods "router-default-6c46d44f97-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-6c46d44f97

SuccessfulCreate

Created pod: router-default-6c46d44f97-sg67g
(x6)

openshift-ingress

kubelet

router-default-6c46d44f97-sg67g

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x6)

openshift-ingress

kubelet

router-default-6c46d44f97-sg67g

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found

openshift-ingress

kubelet

router-default-6c46d44f97-sg67g

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559" already present on machine

openshift-ingress

multus

router-default-6c46d44f97-sg67g

AddedInterface

Add eth0 [10.132.0.15/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-6c46d44f97-sg67g

Started

Started container router

openshift-ingress

kubelet

router-default-6c46d44f97-sg67g

Created

Created container: router

openshift-ingress

replicaset-controller

kube-auth-proxy-5dd59b47cf

SuccessfulCreate

Created pod: kube-auth-proxy-5dd59b47cf-nbqnw

openshift-ingress

replicaset-controller

kube-auth-proxy-5dd59b47cf

SuccessfulCreate

Created pod: kube-auth-proxy-5dd59b47cf-88vhs
(x3)

openshift-ingress

replicaset-controller

kube-auth-proxy-5dd59b47cf

FailedCreate

Error creating: pods "kube-auth-proxy-5dd59b47cf-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-5dd59b47cf from 0 to 2

openshift-ingress

multus

kube-auth-proxy-5dd59b47cf-nbqnw

AddedInterface

Add eth0 [10.132.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-5dd59b47cf-nbqnw

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

kubelet

kube-auth-proxy-5dd59b47cf-88vhs

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-5dd59b47cf-88vhs

AddedInterface

Add eth0 [10.133.0.24/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-hc7jb

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-hc7jb

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-hc7jb

AddedInterface

Add eth0 [10.132.0.36/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-5dd59b47cf-88vhs

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-5dd59b47cf-88vhs

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 3.012s (3.012s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-5dd59b47cf-88vhs

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-5dd59b47cf-nbqnw

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-5dd59b47cf-nbqnw

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-5dd59b47cf-nbqnw

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 3.69s (3.69s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-hc7jb

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.866s (3.866s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-hc7jb

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-hc7jb

Started

Started container discovery

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-72h87

AddedInterface

Add eth0 [10.134.0.17/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-k22wq

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-72h87

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-72h87

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-k22wq

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-k22wq

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-k22wq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" already present on machine

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-k22wq

AddedInterface

Add eth0 [10.132.0.37/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-hc7jb

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-hc7jb

Killing

Stopping container discovery

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-72h87

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-72h87

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 3.373s (3.373s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-72h87

Created

Created container: istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-96grz

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-96grz

AddedInterface

Add eth0 [10.134.0.22/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-5cc6cd444b

FailedCreate

Error creating: pods "payload-processing-5cc6cd444b-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5cc6cd444b from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-687dbb6cf6 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-687dbb6cf6

FailedCreate

Error creating: pods "payload-pre-processing-687dbb6cf6-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-processing-5cc6cd444b

SuccessfulCreate

Created pod: payload-processing-5cc6cd444b-pfwms

openshift-ingress

replicaset-controller

payload-pre-processing-687dbb6cf6

SuccessfulCreate

Created pod: payload-pre-processing-687dbb6cf6-2nz8x

openshift-ingress

kubelet

payload-processing-5cc6cd444b-pfwms

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-687dbb6cf6-2nz8x

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-2nz8x

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-5cc6cd444b-pfwms

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5cc6cd444b-pfwms

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5cc6cd444b-pfwms

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.975s (1.975s including waiting). Image size: 165907129 bytes.

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-2nz8x

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.795s (1.795s including waiting). Image size: 165907129 bytes.

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-2nz8x

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-5cc6cd444b-pfwms

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-2nz8x

Started

Started container payload-pre-processing

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-96grz

ProbeError

Readiness probe error: Get "http://10.134.0.22:15021/healthz/ready": read tcp 10.134.0.2:39960->10.134.0.22:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-96grz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-96grz

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-96grz

Started

Started container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-96grz

Unhealthy

Readiness probe failed: Get "http://10.134.0.22:15021/healthz/ready": read tcp 10.134.0.2:39960->10.134.0.22:15021: read: connection reset by peer
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-96grz

ProbeError

Startup probe error: Get "http://10.134.0.22:15021/healthz/ready": dial tcp 10.134.0.22:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-96grz

Unhealthy

Startup probe failed: Get "http://10.134.0.22:15021/healthz/ready": dial tcp 10.134.0.22:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-ait-0b1393fc

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-0b1393fc

openshift-ingress

replicaset-controller

e2e-ait-0b1393fc-openshift-default-5478b484f4

SuccessfulCreate

Created pod: e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs

openshift-ingress

deployment-controller

e2e-ait-0b1393fc-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-0b1393fc-openshift-default-5478b484f4 from 0 to 1

openshift-ingress

multus

e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs

AddedInterface

Add eth0 [10.134.0.29/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-0b1393fc-6fd6cd9d96

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-0b1393fc-6fd6cd9d96-8fxqp
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-0b1393fc-6fd6cd9d96

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-0b1393fc-6fd6cd9d96-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-0b1393fc: serviceaccount "payload-processing-e2e-ait-0b1393fc" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-0b1393fc

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-0b1393fc-5b86b77f98 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-0b1393fc-5b86b77f98

SuccessfulCreate

Created pod: payload-processing-e2e-ait-0b1393fc-5b86b77f98-f447z
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-0b1393fc-5b86b77f98

FailedCreate

Error creating: pods "payload-processing-e2e-ait-0b1393fc-5b86b77f98-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-0b1393fc: serviceaccount "payload-processing-e2e-ait-0b1393fc" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-0b1393fc

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-0b1393fc-6fd6cd9d96 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-0b1393fc-5b86b77f98-f447z

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-0b1393fc-6fd6cd9d96-8fxqp

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-0b1393fc-6fd6cd9d96-8fxqp

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-0b1393fc-6fd6cd9d96-8fxqp

AddedInterface

Add eth0 [10.132.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-0b1393fc-6fd6cd9d96-8fxqp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-0b1393fc-5b86b77f98-f447z

AddedInterface

Add eth0 [10.132.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-0b1393fc-5b86b77f98-f447z

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-0b1393fc-5b86b77f98-f447z

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs

ProbeError

Readiness probe error: Get "http://10.134.0.29:15021/healthz/ready": dial tcp 10.134.0.29:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs

Unhealthy

Readiness probe failed: Get "http://10.134.0.29:15021/healthz/ready": dial tcp 10.134.0.29:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs

ProbeError

Startup probe error: Get "http://10.134.0.29:15021/healthz/ready": dial tcp 10.134.0.29:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs

Unhealthy

Startup probe failed: Get "http://10.134.0.29:15021/healthz/ready": dial tcp 10.134.0.29:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ait-0b1393fc-5b86b77f98-f447z

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-0b1393fc-6fd6cd9d96-8fxqp

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ait-0b1393fc

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ait-0b1393fc: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ait-0b1393fc": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ait-0b1393fc, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 58a8b1b0-4c3e-430e-8c45-03a97af5039b, UID in object meta:

openshift-ingress

kubelet

e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-migrate-00691797-gw-openshift-default-75876f54fb-r7gnv

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

gateway_labeler_controller

e2e-migrate-00691797-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-00691797-gw

openshift-ingress

replicaset-controller

e2e-migrate-00691797-gw-openshift-default-75876f54fb

SuccessfulCreate

Created pod: e2e-migrate-00691797-gw-openshift-default-75876f54fb-r7gnv

openshift-ingress

deployment-controller

e2e-migrate-00691797-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-00691797-gw-openshift-default-75876f54fb from 0 to 1

openshift-ingress

multus

e2e-migrate-00691797-gw-openshift-default-75876f54fb-r7gnv

AddedInterface

Add eth0 [10.132.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-migrate-00691797-gw-openshift-default-75876f54fb-r7gnv

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.651s (2.651s including waiting). Image size: 181318953 bytes.
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-00691797-6d9846bc6f

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-00691797-6d9846bc6f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-00691797: serviceaccount "payload-processing-e2e-migrate-00691797" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-00691797-746586d5dd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-00691797-746586d5dd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-00691797: serviceaccount "payload-processing-e2e-migrate-00691797" not found

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-00691797

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-00691797-6d9846bc6f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-00691797-6d9846bc6f

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-00691797-6d9846bc6f-tp6s7

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-00691797

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-00691797-746586d5dd from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-00691797-746586d5dd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-00691797-746586d5dd-jnzrs

openshift-ingress

kubelet

payload-processing-e2e-migrate-00691797-6d9846bc6f-tp6s7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-migrate-00691797-6d9846bc6f-tp6s7

AddedInterface

Add eth0 [10.132.0.72/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-migrate-00691797-746586d5dd-jnzrs

AddedInterface

Add eth0 [10.132.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-00691797-746586d5dd-jnzrs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-00691797-746586d5dd-jnzrs

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-00691797-746586d5dd-jnzrs

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-00691797-6d9846bc6f-tp6s7

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-00691797-6d9846bc6f-tp6s7

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-migrate-00691797-gw-openshift-default-75876f54fb-r7gnv

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-00691797-gw-openshift-default-75876f54fb-r7gnv

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-migrate-00691797-gw-openshift-default-75876f54fb-r7gnv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x3)

openshift-ingress

kubelet

e2e-migrate-00691797-gw-openshift-default-75876f54fb-r7gnv

Unhealthy

Startup probe failed: Get "http://10.132.0.70:15021/healthz/ready": dial tcp 10.132.0.70:15021: connect: connection refused
(x3)

openshift-ingress

kubelet

e2e-migrate-00691797-gw-openshift-default-75876f54fb-r7gnv

ProbeError

Startup probe error: Get "http://10.132.0.70:15021/healthz/ready": dial tcp 10.132.0.70:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-migrate-00691797-6d9846bc6f-tp6s7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-migrate-00691797-gw-openshift-default-75876f54fb-r7gnv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-00691797-746586d5dd-jnzrs

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-ait-bb026c71

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-bb026c71

openshift-ingress

deployment-controller

e2e-ait-bb026c71-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-bb026c71-openshift-default-7b849fb4f4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-bb026c71-openshift-default-7b849fb4f4

SuccessfulCreate

Created pod: e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8

openshift-ingress

multus

e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8

AddedInterface

Add eth0 [10.134.0.31/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ait-bb026c71

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-bb026c71-6d45f86d9d from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-bb026c71-6d45f86d9d

SuccessfulCreate

Created pod: payload-processing-e2e-ait-bb026c71-6d45f86d9d-bvvj7
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-bb026c71-6d45f86d9d

FailedCreate

Error creating: pods "payload-processing-e2e-ait-bb026c71-6d45f86d9d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-bb026c71: serviceaccount "payload-processing-e2e-ait-bb026c71" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-bb026c71-67697dc976

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-bb026c71-67697dc976-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-bb026c71: serviceaccount "payload-processing-e2e-ait-bb026c71" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-bb026c71

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-bb026c71-67697dc976 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-bb026c71-67697dc976

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-bb026c71-67697dc976-qxzwf

openshift-ingress

kubelet

payload-processing-e2e-ait-bb026c71-6d45f86d9d-bvvj7

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-bb026c71-67697dc976-qxzwf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-bb026c71-67697dc976-qxzwf

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-bb026c71-6d45f86d9d-bvvj7

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-bb026c71-6d45f86d9d-bvvj7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-bb026c71-6d45f86d9d-bvvj7

AddedInterface

Add eth0 [10.132.0.74/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ait-bb026c71-67697dc976-qxzwf

AddedInterface

Add eth0 [10.132.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-bb026c71-67697dc976-qxzwf

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8

Unhealthy

Readiness probe failed: Get "http://10.134.0.31:15021/healthz/ready": dial tcp 10.134.0.31:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8

ProbeError

Readiness probe error: Get "http://10.134.0.31:15021/healthz/ready": dial tcp 10.134.0.31:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8

Created

Created container: istio-proxy
(x4)

openshift-ingress

kubelet

e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8

Unhealthy

Startup probe failed: Get "http://10.134.0.31:15021/healthz/ready": dial tcp 10.134.0.31:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8

ProbeError

Startup probe error: Get "http://10.134.0.31:15021/healthz/ready": dial tcp 10.134.0.31:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ait-bb026c71-6d45f86d9d-bvvj7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-bb026c71-67697dc976-qxzwf

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ait-bb026c71

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ait-bb026c71: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ait-bb026c71": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ait-bb026c71, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: c0b9df35-e781-4a24-8ee9-34725e835618, UID in object meta:

openshift-ingress

kubelet

e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-derive-5dae47b4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-5dae47b4

openshift-ingress

deployment-controller

e2e-derive-5dae47b4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-5dae47b4-openshift-default-76d7cb7948 from 0 to 1

openshift-ingress

replicaset-controller

e2e-derive-5dae47b4-openshift-default-76d7cb7948

SuccessfulCreate

Created pod: e2e-derive-5dae47b4-openshift-default-76d7cb7948-n4fzp

openshift-ingress

multus

e2e-derive-5dae47b4-openshift-default-76d7cb7948-n4fzp

AddedInterface

Add eth0 [10.132.0.77/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-5dae47b4-566f8c6cf8

FailedCreate

Error creating: pods "payload-processing-e2e-derive-5dae47b4-566f8c6cf8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-5dae47b4: serviceaccount "payload-processing-e2e-derive-5dae47b4" not found

openshift-ingress

multus

payload-pre-processing-e2e-derive-5dae47b4-64c966bcbd-f86pm

AddedInterface

Add eth0 [10.132.0.78/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-derive-5dae47b4-566f8c6cf8-fjrvg

AddedInterface

Add eth0 [10.132.0.79/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-5dae47b4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-5dae47b4-64c966bcbd from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-derive-5dae47b4-566f8c6cf8-fjrvg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-derive-5dae47b4-566f8c6cf8-fjrvg

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-5dae47b4-566f8c6cf8-fjrvg

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-5dae47b4-64c966bcbd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-5dae47b4-64c966bcbd-f86pm
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-5dae47b4-64c966bcbd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-5dae47b4-64c966bcbd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-5dae47b4: serviceaccount "payload-processing-e2e-derive-5dae47b4" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-5dae47b4-566f8c6cf8

SuccessfulCreate

Created pod: payload-processing-e2e-derive-5dae47b4-566f8c6cf8-fjrvg

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-5dae47b4-64c966bcbd-f86pm

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-5dae47b4-64c966bcbd-f86pm

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-5dae47b4-64c966bcbd-f86pm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-derive-5dae47b4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-5dae47b4-566f8c6cf8 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-derive-5dae47b4-openshift-default-76d7cb7948-n4fzp

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-5dae47b4-openshift-default-76d7cb7948-n4fzp

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-5dae47b4-openshift-default-76d7cb7948-n4fzp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-derive-5dae47b4-openshift-default-76d7cb7948-n4fzp

Unhealthy

Startup probe failed: Get "http://10.132.0.77:15021/healthz/ready": dial tcp 10.132.0.77:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-derive-5dae47b4-openshift-default-76d7cb7948-n4fzp

ProbeError

Startup probe error: Get "http://10.132.0.77:15021/healthz/ready": dial tcp 10.132.0.77:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-derive-5dae47b4-566f8c6cf8-fjrvg

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-derive-5dae47b4

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-derive-5dae47b4: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-derive-5dae47b4": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-derive-5dae47b4, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: cbc8462a-adf7-48e6-a88e-56cc350aea03, UID in object meta:

openshift-ingress

kubelet

e2e-derive-5dae47b4-openshift-default-76d7cb7948-n4fzp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-5dae47b4-64c966bcbd-f86pm

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-mt-c581614e-openshift-default-7d49b6db96

SuccessfulCreate

Created pod: e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb

openshift-ingress

deployment-controller

e2e-mt-c581614e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-c581614e-openshift-default-7d49b6db96 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-c581614e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-c581614e

openshift-ingress

multus

e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb

AddedInterface

Add eth0 [10.134.0.34/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-c581614e-9d6979546

FailedCreate

Error creating: pods "payload-processing-e2e-mt-c581614e-9d6979546-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-c581614e: serviceaccount "payload-processing-e2e-mt-c581614e" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-c581614e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-c581614e-b8f78cc64 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-mt-c581614e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-c581614e-9d6979546 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-c581614e-b8f78cc64

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-c581614e-b8f78cc64-q6gnl
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-c581614e-b8f78cc64

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-c581614e-b8f78cc64-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-c581614e: serviceaccount "payload-processing-e2e-mt-c581614e" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-c581614e-9d6979546

SuccessfulCreate

Created pod: payload-processing-e2e-mt-c581614e-9d6979546-n7vx4

openshift-ingress

multus

payload-processing-e2e-mt-c581614e-9d6979546-n7vx4

AddedInterface

Add eth0 [10.132.0.82/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-c581614e-9d6979546-n7vx4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-c581614e-9d6979546-n7vx4

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-c581614e-9d6979546-n7vx4

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-c581614e-b8f78cc64-q6gnl

AddedInterface

Add eth0 [10.132.0.81/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-c581614e-b8f78cc64-q6gnl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-c581614e-b8f78cc64-q6gnl

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-c581614e-b8f78cc64-q6gnl

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb

ProbeError

Readiness probe error: Get "http://10.134.0.34:15021/healthz/ready": dial tcp 10.134.0.34:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb

Unhealthy

Readiness probe failed: Get "http://10.134.0.34:15021/healthz/ready": dial tcp 10.134.0.34:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb

Unhealthy

Startup probe failed: Get "http://10.134.0.34:15021/healthz/ready": dial tcp 10.134.0.34:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb

ProbeError

Startup probe error: Get "http://10.134.0.34:15021/healthz/ready": dial tcp 10.134.0.34:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-c581614e-b8f78cc64-q6gnl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-c581614e-9d6979546-n7vx4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-mt-76809045-openshift-default-8499bd4bf6

SuccessfulCreate

Created pod: e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9

openshift-ingress

multus

e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9

AddedInterface

Add eth0 [10.134.0.36/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-mt-76809045

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-76809045

openshift-ingress

deployment-controller

e2e-mt-76809045-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-76809045-openshift-default-8499bd4bf6 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-76809045-f8f56ddb4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-76809045-f8f56ddb4-vqwdz

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-76809045-548f695c94

SuccessfulCreate

Created pod: payload-processing-e2e-mt-76809045-548f695c94-bws5g

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-76809045

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-76809045-f8f56ddb4 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-mt-76809045

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-76809045-548f695c94 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-76809045-f8f56ddb4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-76809045-f8f56ddb4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-76809045: serviceaccount "payload-processing-e2e-mt-76809045" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-76809045-548f695c94

FailedCreate

Error creating: pods "payload-processing-e2e-mt-76809045-548f695c94-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-76809045: serviceaccount "payload-processing-e2e-mt-76809045" not found

openshift-ingress

kubelet

payload-processing-e2e-mt-76809045-548f695c94-bws5g

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-76809045-548f695c94-bws5g

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-76809045-f8f56ddb4-vqwdz

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-76809045-f8f56ddb4-vqwdz

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-76809045-548f695c94-bws5g

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-76809045-f8f56ddb4-vqwdz

AddedInterface

Add eth0 [10.132.0.85/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-76809045-f8f56ddb4-vqwdz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-76809045-548f695c94-bws5g

AddedInterface

Add eth0 [10.132.0.86/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9

Unhealthy

Readiness probe failed: Get "http://10.134.0.36:15021/healthz/ready": read tcp 10.134.0.2:34354->10.134.0.36:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9

ProbeError

Readiness probe error: Get "http://10.134.0.36:15021/healthz/ready": read tcp 10.134.0.2:34354->10.134.0.36:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9

Unhealthy

Startup probe failed: Get "http://10.134.0.36:15021/healthz/ready": dial tcp 10.134.0.36:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9

ProbeError

Startup probe error: Get "http://10.134.0.36:15021/healthz/ready": dial tcp 10.134.0.36:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-mt-76809045-548f695c94-bws5g

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-76809045-f8f56ddb4-vqwdz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-inf-a-35bf7c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-35bf7c-openshift-default-84d949dd9d from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-35bf7c-openshift-default-84d949dd9d

SuccessfulCreate

Created pod: e2e-inf-a-35bf7c-openshift-default-84d949dd9d-28kll

openshift-ingress

gateway_labeler_controller

e2e-inf-a-35bf7c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-35bf7c

openshift-ingress

multus

e2e-inf-a-35bf7c-openshift-default-84d949dd9d-28kll

AddedInterface

Add eth0 [10.132.0.88/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-35bf7c-59b568cd8d-bh8v6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-35bf7c-59b568cd8d-bh8v6

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-35bf7c-59b568cd8d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-35bf7c-59b568cd8d-bh8v6

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-35bf7c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-35bf7c-59b568cd8d from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-35bf7c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-35bf7c-7f78bbccb6 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-35bf7c-7f78bbccb6

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-35bf7c-7f78bbccb6-vk86q
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-35bf7c-7f78bbccb6

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-35bf7c-7f78bbccb6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-35bf7c: serviceaccount "payload-processing-e2e-inf-a-35bf7c" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-35bf7c-59b568cd8d-bh8v6

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-inf-a-35bf7c-7f78bbccb6-vk86q

AddedInterface

Add eth0 [10.132.0.90/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-35bf7c-7f78bbccb6-vk86q

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-a-35bf7c-7f78bbccb6-vk86q

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-35bf7c-7f78bbccb6-vk86q

Started

Started container payload-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-35bf7c-59b568cd8d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-35bf7c-59b568cd8d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-35bf7c: serviceaccount "payload-processing-e2e-inf-a-35bf7c" not found

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-35bf7c-59b568cd8d-bh8v6

AddedInterface

Add eth0 [10.132.0.89/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-inf-b-d59e9c-openshift-default-59f56ff4b6

SuccessfulCreate

Created pod: e2e-inf-b-d59e9c-openshift-default-59f56ff4b6-269lc

openshift-ingress

deployment-controller

e2e-inf-b-d59e9c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-d59e9c-openshift-default-59f56ff4b6 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-b-d59e9c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-d59e9c

openshift-ingress

multus

e2e-inf-b-d59e9c-openshift-default-59f56ff4b6-269lc

AddedInterface

Add eth0 [10.134.0.38/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-d59e9c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-d59e9c-78d5b6c56 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-d59e9c-6688b8f5d

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-d59e9c-6688b8f5d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-d59e9c: serviceaccount "payload-processing-e2e-inf-b-d59e9c" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-d59e9c-78d5b6c56

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-d59e9c-78d5b6c56-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-d59e9c: serviceaccount "payload-processing-e2e-inf-b-d59e9c" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-d59e9c-78d5b6c56

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-d59e9c-78d5b6c56-pf5mv

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-d59e9c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-d59e9c-6688b8f5d from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-d59e9c-6688b8f5d

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-d59e9c-6688b8f5d-6z68j

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-d59e9c-78d5b6c56-pf5mv

AddedInterface

Add eth0 [10.132.0.91/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-d59e9c-78d5b6c56-pf5mv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-inf-b-d59e9c-6688b8f5d-6z68j

AddedInterface

Add eth0 [10.132.0.92/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-d59e9c-6688b8f5d-6z68j

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-b-d59e9c-6688b8f5d-6z68j

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-d59e9c-78d5b6c56-pf5mv

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-d59e9c-78d5b6c56-pf5mv

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-d59e9c-6688b8f5d-6z68j

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-inf-a-35bf7c-openshift-default-84d949dd9d-28kll

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-35bf7c-openshift-default-84d949dd9d-28kll

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-35bf7c-openshift-default-84d949dd9d-28kll

Started

Started container istio-proxy
(x3)

openshift-ingress

kubelet

e2e-inf-a-35bf7c-openshift-default-84d949dd9d-28kll

ProbeError

Startup probe error: Get "http://10.132.0.88:15021/healthz/ready": dial tcp 10.132.0.88:15021: connect: connection refused body:
(x3)

openshift-ingress

kubelet

e2e-inf-a-35bf7c-openshift-default-84d949dd9d-28kll

Unhealthy

Startup probe failed: Get "http://10.132.0.88:15021/healthz/ready": dial tcp 10.132.0.88:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-inf-b-d59e9c-openshift-default-59f56ff4b6-269lc

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-d59e9c-openshift-default-59f56ff4b6-269lc

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-d59e9c-openshift-default-59f56ff4b6-269lc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-inf-b-d59e9c-openshift-default-59f56ff4b6-269lc

Unhealthy

Startup probe failed: Get "http://10.134.0.38:15021/healthz/ready": dial tcp 10.134.0.38:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-inf-b-d59e9c-openshift-default-59f56ff4b6-269lc

ProbeError

Startup probe error: Get "http://10.134.0.38:15021/healthz/ready": dial tcp 10.134.0.38:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-35bf7c-59b568cd8d-bh8v6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-35bf7c-7f78bbccb6-vk86q

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-a-35bf7c-openshift-default-84d949dd9d-28kll

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-inf-b-d59e9c-6688b8f5d-6z68j

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-d59e9c-78d5b6c56-pf5mv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-b-d59e9c-openshift-default-59f56ff4b6-269lc

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-api-a-944fa0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-944fa0-openshift-default-5459778df6 from 0 to 1

openshift-ingress

multus

e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx

AddedInterface

Add eth0 [10.132.0.95/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-api-a-944fa0-openshift-default-5459778df6

SuccessfulCreate

Created pod: e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx

openshift-ingress

gateway_labeler_controller

e2e-api-a-944fa0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-944fa0

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-944fa0-7574458d4d

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-944fa0-7574458d4d-czbpd

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-944fa0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-944fa0-7574458d4d from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-944fa0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-944fa0-69c8f47d44 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-944fa0-69c8f47d44

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-944fa0-69c8f47d44-f446k
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-944fa0-69c8f47d44

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-944fa0-69c8f47d44-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-944fa0: serviceaccount "payload-processing-e2e-api-a-944fa0" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-944fa0-7574458d4d

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-944fa0-7574458d4d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-944fa0: serviceaccount "payload-processing-e2e-api-a-944fa0" not found

openshift-ingress

multus

payload-processing-e2e-api-a-944fa0-7574458d4d-czbpd

AddedInterface

Add eth0 [10.132.0.97/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-944fa0-7574458d4d-czbpd

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-944fa0-69c8f47d44-f446k

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-944fa0-69c8f47d44-f446k

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-a-944fa0-69c8f47d44-f446k

AddedInterface

Add eth0 [10.132.0.96/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-944fa0-69c8f47d44-f446k

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-944fa0-7574458d4d-czbpd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-a-944fa0-7574458d4d-czbpd

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

e2e-api-b-74909c-openshift-default-6fcf994f9d

SuccessfulCreate

Created pod: e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp

openshift-ingress

multus

e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-api-b-74909c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-74909c-openshift-default-6fcf994f9d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-74909c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-74909c

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-74909c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-74909c-556b798db4 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-74909c-7585747598

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-74909c-7585747598-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-74909c: serviceaccount "payload-processing-e2e-api-b-74909c" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-74909c-556b798db4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-74909c-556b798db4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-74909c: serviceaccount "payload-processing-e2e-api-b-74909c" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-74909c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-74909c-7585747598 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-74909c-556b798db4-vgwt8

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-74909c-556b798db4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-74909c-556b798db4-vgwt8

openshift-ingress

kubelet

payload-processing-e2e-api-b-74909c-7585747598-wwdjh

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-e2e-api-b-74909c-7585747598-wwdjh

AddedInterface

Add eth0 [10.133.0.38/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-74909c-556b798db4-vgwt8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-b-74909c-556b798db4-vgwt8

AddedInterface

Add eth0 [10.132.0.98/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-74909c-7585747598

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-74909c-7585747598-wwdjh

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-74909c-556b798db4-vgwt8

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-74909c-7585747598-wwdjh

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.227s (2.227s including waiting). Image size: 165907129 bytes.

openshift-ingress

kubelet

payload-processing-e2e-api-b-74909c-7585747598-wwdjh

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-74909c-7585747598-wwdjh

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx

Unhealthy

Startup probe failed: Get "http://10.132.0.95:15021/healthz/ready": dial tcp 10.132.0.95:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx

ProbeError

Startup probe error: Get "http://10.132.0.95:15021/healthz/ready": dial tcp 10.132.0.95:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp

ProbeError

Readiness probe error: Get "http://10.134.0.41:15021/healthz/ready": read tcp 10.134.0.2:59720->10.134.0.41:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp

Unhealthy

Readiness probe failed: Get "http://10.134.0.41:15021/healthz/ready": read tcp 10.134.0.2:59720->10.134.0.41:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp

ProbeError

Startup probe error: Get "http://10.134.0.41:15021/healthz/ready": dial tcp 10.134.0.41:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp

Unhealthy

Startup probe failed: Get "http://10.134.0.41:15021/healthz/ready": dial tcp 10.134.0.41:15021: connect: connection refused

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-api-a-944fa0

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-api-a-944fa0: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-api-a-944fa0": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-api-a-944fa0, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: a2fa9c9c-3eed-4ecf-be45-1588f2653fd2, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-api-a-944fa0-7574458d4d-czbpd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-944fa0-69c8f47d44-f446k

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx

Killing

Stopping container istio-proxy

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-api-b-74909c

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-api-b-74909c: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-api-b-74909c": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-api-b-74909c, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: bfe4e290-4b8f-4ce5-8abe-993e31878d99, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-api-b-74909c-7585747598-wwdjh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-74909c-556b798db4-vgwt8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-a-b4cd12

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-b4cd12

openshift-ingress

replicaset-controller

e2e-shared-a-b4cd12-openshift-default-689779dbcb

SuccessfulCreate

Created pod: e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl

openshift-ingress

deployment-controller

e2e-shared-a-b4cd12-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-b4cd12-openshift-default-689779dbcb from 0 to 1

openshift-ingress

multus

e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl

AddedInterface

Add eth0 [10.132.0.101/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-b4cd12-789fd8bdf6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-b4cd12-789fd8bdf6-429wd

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-b4cd12

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-b4cd12-7b876f55f4 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-b4cd12-7b876f55f4

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-b4cd12-7b876f55f4-zqgpw
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-b4cd12-7b876f55f4

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-b4cd12-7b876f55f4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-b4cd12: serviceaccount "payload-processing-e2e-shared-a-b4cd12" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-b4cd12-789fd8bdf6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-b4cd12-789fd8bdf6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-b4cd12: serviceaccount "payload-processing-e2e-shared-a-b4cd12" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-b4cd12

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-b4cd12-789fd8bdf6 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-b4cd12-789fd8bdf6-429wd

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-b4cd12-7b876f55f4-zqgpw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-b4cd12-789fd8bdf6-429wd

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-b4cd12-7b876f55f4-zqgpw

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-b4cd12-789fd8bdf6-429wd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-b4cd12-789fd8bdf6-429wd

AddedInterface

Add eth0 [10.133.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-b4cd12-7b876f55f4-zqgpw

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-b4cd12-7b876f55f4-zqgpw

AddedInterface

Add eth0 [10.133.0.40/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-shared-b-70aa40

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-70aa40

openshift-ingress

deployment-controller

e2e-shared-b-70aa40-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-70aa40-openshift-default-5cfcd8794d from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-70aa40-openshift-default-5cfcd8794d

SuccessfulCreate

Created pod: e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds

openshift-ingress

multus

e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-70aa40-7b576cd6fd-j2gpj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-70aa40-784cd4888

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-70aa40-784cd4888-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-70aa40: serviceaccount "payload-processing-e2e-shared-b-70aa40" not found

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-70aa40-784cd4888-gh94j

AddedInterface

Add eth0 [10.132.0.102/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-70aa40-784cd4888-gh94j

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-70aa40-7b576cd6fd

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-70aa40-7b576cd6fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-70aa40: serviceaccount "payload-processing-e2e-shared-b-70aa40" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-70aa40

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-70aa40-784cd4888 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-70aa40-784cd4888

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-70aa40-784cd4888-gh94j

openshift-ingress

multus

payload-processing-e2e-shared-b-70aa40-7b576cd6fd-j2gpj

AddedInterface

Add eth0 [10.133.0.41/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-70aa40-7b576cd6fd

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-70aa40-7b576cd6fd-j2gpj

openshift-ingress

kubelet

payload-processing-e2e-shared-b-70aa40-7b576cd6fd-j2gpj

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-70aa40-7b576cd6fd-j2gpj

Started

Started container payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-70aa40

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-70aa40-7b576cd6fd from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-70aa40-784cd4888-gh94j

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-70aa40-784cd4888-gh94j

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl

Unhealthy

Readiness probe failed: Get "http://10.132.0.101:15021/healthz/ready": dial tcp 10.132.0.101:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl

ProbeError

Readiness probe error: Get "http://10.132.0.101:15021/healthz/ready": dial tcp 10.132.0.101:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl

Unhealthy

Startup probe failed: Get "http://10.132.0.101:15021/healthz/ready": dial tcp 10.132.0.101:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl

ProbeError

Startup probe error: Get "http://10.132.0.101:15021/healthz/ready": dial tcp 10.132.0.101:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds

ProbeError

Readiness probe error: Get "http://10.134.0.44:15021/healthz/ready": dial tcp 10.134.0.44:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds

Unhealthy

Readiness probe failed: Get "http://10.134.0.44:15021/healthz/ready": dial tcp 10.134.0.44:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds

Unhealthy

Startup probe failed: Get "http://10.134.0.44:15021/healthz/ready": dial tcp 10.134.0.44:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds

ProbeError

Startup probe error: Get "http://10.134.0.44:15021/healthz/ready": dial tcp 10.134.0.44:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-ipp-a-f227a8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-f227a8-openshift-default-f9b4b56f8 from 0 to 1

openshift-ingress

multus

e2e-ipp-a-f227a8-openshift-default-f9b4b56f8-rqfkr

AddedInterface

Add eth0 [10.132.0.111/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-f227a8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-f227a8

openshift-ingress

replicaset-controller

e2e-ipp-a-f227a8-openshift-default-f9b4b56f8

SuccessfulCreate

Created pod: e2e-ipp-a-f227a8-openshift-default-f9b4b56f8-rqfkr

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-f227a8-6b9bb5d644

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-f227a8-6b9bb5d644-2msqt
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-f227a8-6b9bb5d644

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-f227a8-6b9bb5d644-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-f227a8: serviceaccount "payload-processing-e2e-ipp-a-f227a8" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-f227a8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-f227a8-6b9bb5d644 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f227a8-6b9bb5d644-2msqt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-f227a8-6b9bb5d644-2msqt

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-a-f227a8-777ddd4b74-n8477

AddedInterface

Add eth0 [10.133.0.49/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-f227a8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-f227a8-777ddd4b74 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-f227a8-777ddd4b74

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-f227a8-777ddd4b74-n8477
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-f227a8-777ddd4b74

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-f227a8-777ddd4b74-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-f227a8: serviceaccount "payload-processing-e2e-ipp-a-f227a8" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f227a8-777ddd4b74-n8477

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f227a8-777ddd4b74-n8477

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f227a8-6b9bb5d644-2msqt

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f227a8-6b9bb5d644-2msqt

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f227a8-777ddd4b74-n8477

Started

Started container payload-processing

openshift-ingress

multus

e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn

AddedInterface

Add eth0 [10.132.0.112/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-b-b78801-openshift-default-777f779448

SuccessfulCreate

Created pod: e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn

openshift-ingress

deployment-controller

e2e-ipp-b-b78801-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-b78801-openshift-default-777f779448 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-b78801

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-b78801
(x2)

openshift-ingress

kubelet

e2e-ipp-a-f227a8-openshift-default-f9b4b56f8-rqfkr

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-f227a8-openshift-default-f9b4b56f8-rqfkr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-f227a8-openshift-default-f9b4b56f8-rqfkr

Created

Created container: istio-proxy
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-b78801-bd8698dfb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-b78801-bd8698dfb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-b78801: serviceaccount "payload-processing-e2e-ipp-b-b78801" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-b78801

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-b78801-5988855988 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-b78801-5988855988

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-b78801-5988855988-5mllg
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-b78801-5988855988

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-b78801-5988855988-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-b78801: serviceaccount "payload-processing-e2e-ipp-b-b78801" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-b78801

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-b78801-bd8698dfb from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-b78801-bd8698dfb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-b78801-bd8698dfb-7stpv

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b78801-5988855988-5mllg

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-ipp-b-b78801-5988855988-5mllg

AddedInterface

Add eth0 [10.133.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b78801-bd8698dfb-7stpv

Created

Created container: payload-pre-processing
(x3)

openshift-ingress

kubelet

e2e-ipp-a-f227a8-openshift-default-f9b4b56f8-rqfkr

ProbeError

Startup probe error: Get "http://10.132.0.111:15021/healthz/ready": dial tcp 10.132.0.111:15021: connect: connection refused body:
(x3)

openshift-ingress

kubelet

e2e-ipp-a-f227a8-openshift-default-f9b4b56f8-rqfkr

Unhealthy

Startup probe failed: Get "http://10.132.0.111:15021/healthz/ready": dial tcp 10.132.0.111:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b78801-5988855988-5mllg

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b78801-bd8698dfb-7stpv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b78801-5988855988-5mllg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-b78801-bd8698dfb-7stpv

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b78801-bd8698dfb-7stpv

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b78801-bd8698dfb-7stpv

Unhealthy

Readiness probe failed: dial tcp 10.133.0.51:9004: connect: connection refused

openshift-ingress

kubelet

e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn

Unhealthy

Readiness probe failed: Get "http://10.132.0.112:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn

ProbeError

Readiness probe error: Get "http://10.132.0.112:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn

ProbeError

Startup probe error: Get "http://10.132.0.112:15021/healthz/ready": dial tcp 10.132.0.112:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn

Unhealthy

Startup probe failed: Get "http://10.132.0.112:15021/healthz/ready": dial tcp 10.132.0.112:15021: connect: connection refused

openshift-ingress

multus

e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ipp-cleanup-3ff2a8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-3ff2a8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-3ff2a8

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868

SuccessfulCreate

Created pod: e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-3ff2a8-57bd5df964-w2zzj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-3ff2a8-57bd5df964-w2zzj

AddedInterface

Add eth0 [10.132.0.114/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-3ff2a8-8b4b47c6-gh2ml

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-3ff2a8-8b4b47c6-gh2ml

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-3ff2a8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-3ff2a8-57bd5df964 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-3ff2a8-57bd5df964

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-3ff2a8-57bd5df964-w2zzj
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-3ff2a8-8b4b47c6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-3ff2a8-8b4b47c6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-3ff2a8: serviceaccount "payload-processing-e2e-ipp-cleanup-3ff2a8" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-3ff2a8-8b4b47c6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-3ff2a8-8b4b47c6-gh2ml

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-3ff2a8-8b4b47c6-gh2ml

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-3ff2a8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-3ff2a8-8b4b47c6 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-3ff2a8-8b4b47c6-gh2ml

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-3ff2a8-57bd5df964-w2zzj

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-3ff2a8-57bd5df964-w2zzj

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-3ff2a8-57bd5df964

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-3ff2a8-57bd5df964-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-3ff2a8: serviceaccount "payload-processing-e2e-ipp-cleanup-3ff2a8" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-3ff2a8-8b4b47c6-gh2ml

Unhealthy

Readiness probe failed: dial tcp 10.133.0.53:9004: connect: connection refused

openshift-ingress

kubelet

e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8

Unhealthy

Readiness probe failed: Get "http://10.134.0.49:15021/healthz/ready": read tcp 10.134.0.2:47804->10.134.0.49:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8

ProbeError

Readiness probe error: Get "http://10.134.0.49:15021/healthz/ready": read tcp 10.134.0.2:47804->10.134.0.49:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8

ProbeError

Startup probe error: Get "http://10.134.0.49:15021/healthz/ready": dial tcp 10.134.0.49:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8

Unhealthy

Startup probe failed: Get "http://10.134.0.49:15021/healthz/ready": dial tcp 10.134.0.49:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-3ff2a8-57bd5df964-w2zzj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-3ff2a8-8b4b47c6-gh2ml

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f227a8-777ddd4b74-n8477

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f227a8-6b9bb5d644-2msqt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-f227a8-openshift-default-f9b4b56f8-rqfkr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b78801-5988855988-5mllg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b78801-bd8698dfb-7stpv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-a-b4cd12

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-a-b4cd12: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-a-b4cd12": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-a-b4cd12, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: b8b124de-e16c-45a0-bc53-c9cd4cb87087, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-b4cd12-789fd8bdf6-429wd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-b4cd12-7b876f55f4-zqgpw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-shared-b-70aa40-7b576cd6fd-j2gpj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-70aa40-784cd4888-gh94j

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-b-70aa40

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-b-70aa40: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-b-70aa40": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-b-70aa40, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: b7d973f0-9f99-4423-b11d-18a6a309a364, UID in object meta:

openshift-ingress

kubelet

e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds

Killing

Stopping container istio-proxy