Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-pre-processing-e2e-ipp-a-e3f0a9-7d4d78f456-wtj88

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-e3f0a9-7d4d78f456-wtj88 to ip-10-0-143-53.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-c6e95b-6549469f7b-9l8kx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-c6e95b-6549469f7b-9l8kx to ip-10-0-143-53.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-cnsqc

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cnsqc to ip-10-0-139-136.ec2.internal

openshift-ingress

e2e-shared-a-499dd1-openshift-default-758c466b96-pvn99

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-499dd1-openshift-default-758c466b96-pvn99 to ip-10-0-143-53.ec2.internal

openshift-ingress

e2e-mt-85e566ec-openshift-default-5584db7984-nnvwv

Scheduled

Successfully assigned openshift-ingress/e2e-mt-85e566ec-openshift-default-5584db7984-nnvwv to ip-10-0-143-53.ec2.internal

openshift-ingress

kube-auth-proxy-7d58b94969-c45m2

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-7d58b94969-c45m2 to ip-10-0-132-132.ec2.internal

openshift-ingress

kube-auth-proxy-7d58b94969-q748r

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-7d58b94969-q748r to ip-10-0-139-136.ec2.internal

openshift-ingress

e2e-mt-540d8b1d-openshift-default-665848bfd8-2klrl

Scheduled

Successfully assigned openshift-ingress/e2e-mt-540d8b1d-openshift-default-665848bfd8-2klrl to ip-10-0-143-53.ec2.internal

openshift-ingress

e2e-ait-2db675aa-openshift-default-7d4674f988-rsdgh

Scheduled

Successfully assigned openshift-ingress/e2e-ait-2db675aa-openshift-default-7d4674f988-rsdgh to ip-10-0-143-53.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-85e566ec-6f855fb8d-q4vq7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-85e566ec-6f855fb8d-q4vq7 to ip-10-0-143-53.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-540d8b1d-856d54688d-5vwmp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-540d8b1d-856d54688d-5vwmp to ip-10-0-143-53.ec2.internal

openshift-ingress

e2e-inf-b-422c4e-openshift-default-7585b75796-5x266

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-422c4e-openshift-default-7585b75796-5x266 to ip-10-0-143-53.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-1bab8920-6d6cfc694d-vvwvk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-1bab8920-6d6cfc694d-vvwvk to ip-10-0-143-53.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-aac4b8-d9679579d-q6l6f

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-aac4b8-d9679579d-q6l6f to ip-10-0-143-53.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-aac4b8-679b679556-9dfqc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-aac4b8-679b679556-9dfqc to ip-10-0-143-53.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-76c851-55c86df6b6-xfvgl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-76c851-55c86df6b6-xfvgl to ip-10-0-143-53.ec2.internal

openshift-ingress

payload-processing-e2e-derive-869c695e-5bc7594d58-j7bmf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-869c695e-5bc7594d58-j7bmf to ip-10-0-143-53.ec2.internal

openshift-ingress

payload-processing-e2e-ait-64bba790-6cc6b5c9bb-mk48n

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-64bba790-6cc6b5c9bb-mk48n to ip-10-0-143-53.ec2.internal

openshift-ingress

e2e-inf-a-11557e-openshift-default-6665b67986-ftkbg

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-11557e-openshift-default-6665b67986-ftkbg to ip-10-0-143-53.ec2.internal

openshift-ingress

payload-processing-5cc6cd444b-cbc94

Scheduled

Successfully assigned openshift-ingress/payload-processing-5cc6cd444b-cbc94 to ip-10-0-143-53.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-e15986-7687667dbd-dpdf6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-e15986-7687667dbd-dpdf6 to ip-10-0-143-53.ec2.internal

openshift-ingress

e2e-ait-64bba790-openshift-default-79786f8986-7znqd

Scheduled

Successfully assigned openshift-ingress/e2e-ait-64bba790-openshift-default-79786f8986-7znqd to ip-10-0-143-53.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-gqmsq

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-gqmsq to ip-10-0-143-53.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-phlct

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-phlct to ip-10-0-143-53.ec2.internal

openshift-ingress

e2e-migrate-1bab8920-gw-openshift-default-6699b59bc6-lwkmt

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-1bab8920-gw-openshift-default-6699b59bc6-lwkmt to ip-10-0-143-53.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-4xpv5

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4xpv5 to ip-10-0-132-132.ec2.internal

openshift-ingress

e2e-ipp-cleanup-34f01f-openshift-default-5ff59f98d8-c6nkl

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-34f01f-openshift-default-5ff59f98d8-c6nkl to ip-10-0-132-132.ec2.internal

openshift-ingress

payload-pre-processing-687dbb6cf6-49gcl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-687dbb6cf6-49gcl to ip-10-0-139-136.ec2.internal

openshift-ingress

e2e-ipp-b-c6e95b-openshift-default-7c655cbb96-tmj4r

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-c6e95b-openshift-default-7c655cbb96-tmj4r to ip-10-0-132-132.ec2.internal

openshift-ingress

e2e-derive-869c695e-openshift-default-586f56856d-s2wlw

Scheduled

Successfully assigned openshift-ingress/e2e-derive-869c695e-openshift-default-586f56856d-s2wlw to ip-10-0-143-53.ec2.internal

openshift-ingress

e2e-shared-b-e15986-openshift-default-5f8d668c44-7fn4d

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-e15986-openshift-default-5f8d668c44-7fn4d to ip-10-0-143-53.ec2.internal

openshift-ingress

e2e-ipp-a-e3f0a9-openshift-default-8588586558-2br4m

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-e3f0a9-openshift-default-8588586558-2br4m to ip-10-0-132-132.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-11557e-5bc756d49d-jf645

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-11557e-5bc756d49d-jf645 to ip-10-0-143-53.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-64bba790-557d95b6fb-n4t7n

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-64bba790-557d95b6fb-n4t7n to ip-10-0-143-53.ec2.internal

openshift-ingress

payload-processing-e2e-ait-2db675aa-64c548df76-tjrrq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-2db675aa-64c548df76-tjrrq to ip-10-0-143-53.ec2.internal

openshift-ingress

router-default-858d756bd9-xqm8h

Scheduled

Successfully assigned openshift-ingress/router-default-858d756bd9-xqm8h to ip-10-0-143-53.ec2.internal

openshift-ingress

e2e-api-a-aac4b8-openshift-default-559b4847d-kxbvz

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-aac4b8-openshift-default-559b4847d-kxbvz to ip-10-0-143-53.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-e15986-96d7d798b-prtrg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-e15986-96d7d798b-prtrg to ip-10-0-143-53.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-499dd1-794dc545d6-fqrtx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-499dd1-794dc545d6-fqrtx to ip-10-0-143-53.ec2.internal

openshift-ingress

payload-processing-e2e-mt-85e566ec-854fcf587d-z74nt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-85e566ec-854fcf587d-z74nt to ip-10-0-143-53.ec2.internal

openshift-ingress

payload-processing-e2e-mt-540d8b1d-df98989b6-kvmwk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-540d8b1d-df98989b6-kvmwk to ip-10-0-143-53.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-76c851-76c9b594c6-tws9p

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-76c851-76c9b594c6-tws9p to ip-10-0-143-53.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-869c695e-5f8664f744-r7tcj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-869c695e-5f8664f744-r7tcj to ip-10-0-143-53.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-11557e-7ccbb4bf6-cmssp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-11557e-7ccbb4bf6-cmssp to ip-10-0-143-53.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-422c4e-7c9f7c586d-ztrsl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-422c4e-7c9f7c586d-ztrsl to ip-10-0-143-53.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-2db675aa-86f8bb4b7b-7w2cc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-2db675aa-86f8bb4b7b-7w2cc to ip-10-0-143-53.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-499dd1-7c7bdd9bbd-tsm5k

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-499dd1-7c7bdd9bbd-tsm5k to ip-10-0-143-53.ec2.internal

openshift-ingress

e2e-api-b-76c851-openshift-default-6d484b9766-jgr8f

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-76c851-openshift-default-6d484b9766-jgr8f to ip-10-0-143-53.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-34f01f-6d9dc64684-r8dgr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-34f01f-6d9dc64684-r8dgr to ip-10-0-143-53.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-1bab8920-6fc8bcd485-hw6zg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-1bab8920-6fc8bcd485-hw6zg to ip-10-0-143-53.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-34f01f-f8684c588-vprc2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-34f01f-f8684c588-vprc2 to ip-10-0-143-53.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-c6e95b-7599796564-dshgv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-c6e95b-7599796564-dshgv to ip-10-0-143-53.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-e3f0a9-5b4956c5f8-5pbpm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-e3f0a9-5b4956c5f8-5pbpm to ip-10-0-143-53.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-422c4e-78454df584-4nxsz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-422c4e-78454df584-4nxsz to ip-10-0-143-53.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-858d756bd9 from 0 to 1

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x12)

openshift-ingress

replicaset-controller

router-default-858d756bd9

FailedCreate

Error creating: pods "router-default-858d756bd9-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x16)

openshift-ingress

replicaset-controller

router-default-858d756bd9

FailedCreate

Error creating: pods "router-default-858d756bd9-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-858d756bd9

SuccessfulCreate

Created pod: router-default-858d756bd9-xqm8h
(x5)

openshift-ingress

kubelet

router-default-858d756bd9-xqm8h

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x6)

openshift-ingress

kubelet

router-default-858d756bd9-xqm8h

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

multus

router-default-858d756bd9-xqm8h

AddedInterface

Add eth0 [10.134.0.9/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-858d756bd9-xqm8h

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559" already present on machine

openshift-ingress

kubelet

router-default-858d756bd9-xqm8h

Created

Created container: router

openshift-ingress

kubelet

router-default-858d756bd9-xqm8h

Started

Started container router

openshift-ingress

replicaset-controller

kube-auth-proxy-7d58b94969

SuccessfulCreate

Created pod: kube-auth-proxy-7d58b94969-c45m2

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-7d58b94969 from 0 to 2
(x5)

openshift-ingress

replicaset-controller

kube-auth-proxy-7d58b94969

FailedCreate

Error creating: pods "kube-auth-proxy-7d58b94969-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-7d58b94969

SuccessfulCreate

Created pod: kube-auth-proxy-7d58b94969-q748r

openshift-ingress

kubelet

kube-auth-proxy-7d58b94969-q748r

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-7d58b94969-c45m2

AddedInterface

Add eth0 [10.132.0.26/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-7d58b94969-c45m2

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-7d58b94969-q748r

AddedInterface

Add eth0 [10.133.0.27/23] from ovn-kubernetes

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-cnsqc

AddedInterface

Add eth0 [10.133.0.30/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-cnsqc

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-cnsqc

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

kube-auth-proxy-7d58b94969-c45m2

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-7d58b94969-c45m2

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-7d58b94969-c45m2

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 3.077s (3.077s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-cnsqc

Started

Started container discovery

openshift-ingress

kubelet

kube-auth-proxy-7d58b94969-q748r

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-7d58b94969-q748r

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-cnsqc

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.883s (3.883s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-cnsqc

Created

Created container: discovery

openshift-ingress

kubelet

kube-auth-proxy-7d58b94969-q748r

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 5.23s (5.23s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-cnsqc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-cnsqc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-gqmsq

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-phlct

AddedInterface

Add eth0 [10.134.0.23/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-phlct

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-gqmsq

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-phlct

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-gqmsq

AddedInterface

Add eth0 [10.134.0.22/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-phlct

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.652s (3.652s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-phlct

Created

Created container: discovery

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-gqmsq

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 3.995s (3.995s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-gqmsq

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-gqmsq

Started

Started container istio-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-phlct

Started

Started container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-cnsqc

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-cnsqc

Unhealthy

Readiness probe failed: Get "http://10.133.0.30:8080/ready": dial tcp 10.133.0.30:8080: connect: connection refused

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-cnsqc

ProbeError

Readiness probe error: Get "http://10.133.0.30:8080/ready": dial tcp 10.133.0.30:8080: connect: connection refused body:

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-cnsqc

Killing

Stopping container discovery

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-4xpv5

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-4xpv5

AddedInterface

Add eth0 [10.132.0.30/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-4xpv5

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-4xpv5

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.727s (2.727s including waiting). Image size: 181318953 bytes.

openshift-ingress

multus

payload-pre-processing-687dbb6cf6-49gcl

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-49gcl

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5cc6cd444b from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-687dbb6cf6 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-5cc6cd444b

FailedCreate

Error creating: pods "payload-processing-5cc6cd444b-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

multus

payload-processing-5cc6cd444b-cbc94

AddedInterface

Add eth0 [10.134.0.28/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-687dbb6cf6

FailedCreate

Error creating: pods "payload-pre-processing-687dbb6cf6-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-processing-5cc6cd444b

SuccessfulCreate

Created pod: payload-processing-5cc6cd444b-cbc94

openshift-ingress

kubelet

payload-processing-5cc6cd444b-cbc94

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

replicaset-controller

payload-pre-processing-687dbb6cf6

SuccessfulCreate

Created pod: payload-pre-processing-687dbb6cf6-49gcl

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-49gcl

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.693s (1.693s including waiting). Image size: 165907128 bytes.

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-49gcl

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-5cc6cd444b-cbc94

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.474s (1.474s including waiting). Image size: 165907128 bytes.

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-49gcl

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-5cc6cd444b-cbc94

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5cc6cd444b-cbc94

Started

Started container payload-processing

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-4xpv5

ProbeError

Readiness probe error: Get "http://10.132.0.30:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-4xpv5

Unhealthy

Readiness probe failed: Get "http://10.132.0.30:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-4xpv5

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-4xpv5

Created

Created container: istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-4xpv5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-4xpv5

Unhealthy

Startup probe failed: Get "http://10.132.0.30:15021/healthz/ready": dial tcp 10.132.0.30:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-4xpv5

ProbeError

Startup probe error: Get "http://10.132.0.30:15021/healthz/ready": dial tcp 10.132.0.30:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ait-64bba790

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-64bba790

openshift-ingress

deployment-controller

e2e-ait-64bba790-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-64bba790-openshift-default-79786f8986 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-64bba790-openshift-default-79786f8986

SuccessfulCreate

Created pod: e2e-ait-64bba790-openshift-default-79786f8986-7znqd

openshift-ingress

multus

e2e-ait-64bba790-openshift-default-79786f8986-7znqd

AddedInterface

Add eth0 [10.134.0.34/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-64bba790-557d95b6fb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-64bba790-557d95b6fb-n4t7n

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-64bba790-6cc6b5c9bb

SuccessfulCreate

Created pod: payload-processing-e2e-ait-64bba790-6cc6b5c9bb-mk48n

openshift-ingress

deployment-controller

payload-processing-e2e-ait-64bba790

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-64bba790-6cc6b5c9bb from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-64bba790

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-64bba790-557d95b6fb from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-64bba790-6cc6b5c9bb

FailedCreate

Error creating: pods "payload-processing-e2e-ait-64bba790-6cc6b5c9bb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-64bba790: serviceaccount "payload-processing-e2e-ait-64bba790" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-64bba790-557d95b6fb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-64bba790-557d95b6fb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-64bba790: serviceaccount "payload-processing-e2e-ait-64bba790" not found

openshift-ingress

multus

payload-pre-processing-e2e-ait-64bba790-557d95b6fb-n4t7n

AddedInterface

Add eth0 [10.134.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-64bba790-557d95b6fb-n4t7n

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-64bba790-6cc6b5c9bb-mk48n

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-64bba790-6cc6b5c9bb-mk48n

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-64bba790-6cc6b5c9bb-mk48n

AddedInterface

Add eth0 [10.134.0.36/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-64bba790-6cc6b5c9bb-mk48n

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-64bba790-557d95b6fb-n4t7n

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-64bba790-557d95b6fb-n4t7n

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ait-64bba790-openshift-default-79786f8986-7znqd

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-64bba790-openshift-default-79786f8986-7znqd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-64bba790-openshift-default-79786f8986-7znqd

Created

Created container: istio-proxy
(x4)

openshift-ingress

kubelet

e2e-ait-64bba790-openshift-default-79786f8986-7znqd

Unhealthy

Startup probe failed: Get "http://10.134.0.34:15021/healthz/ready": dial tcp 10.134.0.34:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-ait-64bba790-openshift-default-79786f8986-7znqd

ProbeError

Startup probe error: Get "http://10.134.0.34:15021/healthz/ready": dial tcp 10.134.0.34:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ait-64bba790-6cc6b5c9bb-mk48n

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-64bba790-557d95b6fb-n4t7n

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-64bba790-openshift-default-79786f8986-7znqd

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-migrate-1bab8920-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-1bab8920-gw

openshift-ingress

replicaset-controller

e2e-migrate-1bab8920-gw-openshift-default-6699b59bc6

SuccessfulCreate

Created pod: e2e-migrate-1bab8920-gw-openshift-default-6699b59bc6-lwkmt

openshift-ingress

deployment-controller

e2e-migrate-1bab8920-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-1bab8920-gw-openshift-default-6699b59bc6 from 0 to 1

openshift-ingress

multus

e2e-migrate-1bab8920-gw-openshift-default-6699b59bc6-lwkmt

AddedInterface

Add eth0 [10.134.0.37/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-1bab8920-6fc8bcd485

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-1bab8920-6fc8bcd485-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-1bab8920: serviceaccount "payload-processing-e2e-migrate-1bab8920" not found

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-1bab8920

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-1bab8920-6fc8bcd485 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-1bab8920

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-1bab8920-6d6cfc694d from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-1bab8920-6fc8bcd485

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-1bab8920-6fc8bcd485-hw6zg

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-1bab8920-6d6cfc694d-vvwvk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-1bab8920-6d6cfc694d-vvwvk

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-1bab8920-6d6cfc694d-vvwvk

Started

Started container payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-1bab8920-6d6cfc694d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-1bab8920-6d6cfc694d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-1bab8920: serviceaccount "payload-processing-e2e-migrate-1bab8920" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-1bab8920-6d6cfc694d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-1bab8920-6d6cfc694d-vvwvk

openshift-ingress

multus

payload-pre-processing-e2e-migrate-1bab8920-6d6cfc694d-vvwvk

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-migrate-1bab8920-6fc8bcd485-hw6zg

AddedInterface

Add eth0 [10.134.0.38/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-1bab8920-6fc8bcd485-hw6zg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-migrate-1bab8920-6fc8bcd485-hw6zg

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-1bab8920-6fc8bcd485-hw6zg

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-migrate-1bab8920-gw-openshift-default-6699b59bc6-lwkmt

ProbeError

Readiness probe error: Get "http://10.134.0.37:15021/healthz/ready": read tcp 10.134.0.2:49178->10.134.0.37:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-migrate-1bab8920-gw-openshift-default-6699b59bc6-lwkmt

Unhealthy

Readiness probe failed: Get "http://10.134.0.37:15021/healthz/ready": read tcp 10.134.0.2:49178->10.134.0.37:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-migrate-1bab8920-gw-openshift-default-6699b59bc6-lwkmt

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-1bab8920-gw-openshift-default-6699b59bc6-lwkmt

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-1bab8920-gw-openshift-default-6699b59bc6-lwkmt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x3)

openshift-ingress

kubelet

e2e-migrate-1bab8920-gw-openshift-default-6699b59bc6-lwkmt

Unhealthy

Startup probe failed: Get "http://10.134.0.37:15021/healthz/ready": dial tcp 10.134.0.37:15021: connect: connection refused
(x3)

openshift-ingress

kubelet

e2e-migrate-1bab8920-gw-openshift-default-6699b59bc6-lwkmt

ProbeError

Startup probe error: Get "http://10.134.0.37:15021/healthz/ready": dial tcp 10.134.0.37:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-migrate-1bab8920-6fc8bcd485-hw6zg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-1bab8920-6d6cfc694d-vvwvk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-migrate-1bab8920-gw-openshift-default-6699b59bc6-lwkmt

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-ait-2db675aa-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-2db675aa-openshift-default-7d4674f988 from 0 to 1

openshift-ingress

multus

e2e-ait-2db675aa-openshift-default-7d4674f988-rsdgh

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ait-2db675aa

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-2db675aa

openshift-ingress

replicaset-controller

e2e-ait-2db675aa-openshift-default-7d4674f988

SuccessfulCreate

Created pod: e2e-ait-2db675aa-openshift-default-7d4674f988-rsdgh

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-2db675aa-86f8bb4b7b-7w2cc

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-ait-2db675aa

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-2db675aa-64c548df76 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-2db675aa-64c548df76-tjrrq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-2db675aa-86f8bb4b7b-7w2cc

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-2db675aa-86f8bb4b7b-7w2cc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-2db675aa-64c548df76-tjrrq

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-2db675aa-86f8bb4b7b-7w2cc

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ait-2db675aa-64c548df76-tjrrq

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-2db675aa-64c548df76-tjrrq

Started

Started container payload-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-2db675aa-86f8bb4b7b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-2db675aa-86f8bb4b7b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-2db675aa: serviceaccount "payload-processing-e2e-ait-2db675aa" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-2db675aa-64c548df76

FailedCreate

Error creating: pods "payload-processing-e2e-ait-2db675aa-64c548df76-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-2db675aa: serviceaccount "payload-processing-e2e-ait-2db675aa" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-2db675aa-86f8bb4b7b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-2db675aa-86f8bb4b7b-7w2cc

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-2db675aa

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-2db675aa-86f8bb4b7b from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-2db675aa-64c548df76

SuccessfulCreate

Created pod: payload-processing-e2e-ait-2db675aa-64c548df76-tjrrq

openshift-ingress

kubelet

e2e-ait-2db675aa-openshift-default-7d4674f988-rsdgh

Unhealthy

Readiness probe failed: Get "http://10.134.0.40:15021/healthz/ready": read tcp 10.134.0.2:35006->10.134.0.40:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-ait-2db675aa-openshift-default-7d4674f988-rsdgh

ProbeError

Readiness probe error: Get "http://10.134.0.40:15021/healthz/ready": read tcp 10.134.0.2:35006->10.134.0.40:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-ait-2db675aa-openshift-default-7d4674f988-rsdgh

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-2db675aa-openshift-default-7d4674f988-rsdgh

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-2db675aa-openshift-default-7d4674f988-rsdgh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-ait-2db675aa-openshift-default-7d4674f988-rsdgh

ProbeError

Startup probe error: Get "http://10.134.0.40:15021/healthz/ready": dial tcp 10.134.0.40:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-ait-2db675aa-openshift-default-7d4674f988-rsdgh

Unhealthy

Startup probe failed: Get "http://10.134.0.40:15021/healthz/ready": dial tcp 10.134.0.40:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ait-2db675aa-64c548df76-tjrrq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-2db675aa-86f8bb4b7b-7w2cc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-2db675aa-openshift-default-7d4674f988-rsdgh

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-derive-869c695e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-869c695e

openshift-ingress

replicaset-controller

e2e-derive-869c695e-openshift-default-586f56856d

SuccessfulCreate

Created pod: e2e-derive-869c695e-openshift-default-586f56856d-s2wlw

openshift-ingress

deployment-controller

e2e-derive-869c695e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-869c695e-openshift-default-586f56856d from 0 to 1

openshift-ingress

multus

e2e-derive-869c695e-openshift-default-586f56856d-s2wlw

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-869c695e-5f8664f744

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-869c695e-5f8664f744-r7tcj

openshift-ingress

deployment-controller

payload-processing-e2e-derive-869c695e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-869c695e-5bc7594d58 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-869c695e-5bc7594d58

FailedCreate

Error creating: pods "payload-processing-e2e-derive-869c695e-5bc7594d58-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-869c695e: serviceaccount "payload-processing-e2e-derive-869c695e" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-869c695e-5bc7594d58

SuccessfulCreate

Created pod: payload-processing-e2e-derive-869c695e-5bc7594d58-j7bmf

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-869c695e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-869c695e-5f8664f744 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-869c695e-5f8664f744

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-869c695e-5f8664f744-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-869c695e: serviceaccount "payload-processing-e2e-derive-869c695e" not found

openshift-ingress

multus

payload-pre-processing-e2e-derive-869c695e-5f8664f744-r7tcj

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-869c695e-5f8664f744-r7tcj

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-derive-869c695e-5bc7594d58-j7bmf

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-869c695e-5bc7594d58-j7bmf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-869c695e-5f8664f744-r7tcj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-869c695e-5f8664f744-r7tcj

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-869c695e-5bc7594d58-j7bmf

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-869c695e-5bc7594d58-j7bmf

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-derive-869c695e-openshift-default-586f56856d-s2wlw

Unhealthy

Readiness probe failed: Get "http://10.134.0.43:15021/healthz/ready": dial tcp 10.134.0.43:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-derive-869c695e-openshift-default-586f56856d-s2wlw

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-869c695e-openshift-default-586f56856d-s2wlw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-derive-869c695e-openshift-default-586f56856d-s2wlw

ProbeError

Readiness probe error: Get "http://10.134.0.43:15021/healthz/ready": dial tcp 10.134.0.43:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-derive-869c695e-openshift-default-586f56856d-s2wlw

Created

Created container: istio-proxy
(x3)

openshift-ingress

kubelet

e2e-derive-869c695e-openshift-default-586f56856d-s2wlw

ProbeError

Startup probe error: Get "http://10.134.0.43:15021/healthz/ready": dial tcp 10.134.0.43:15021: connect: connection refused body:
(x3)

openshift-ingress

kubelet

e2e-derive-869c695e-openshift-default-586f56856d-s2wlw

Unhealthy

Startup probe failed: Get "http://10.134.0.43:15021/healthz/ready": dial tcp 10.134.0.43:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-869c695e-5f8664f744-r7tcj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-869c695e-5bc7594d58-j7bmf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-derive-869c695e-openshift-default-586f56856d-s2wlw

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-mt-85e566ec

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-85e566ec

openshift-ingress

deployment-controller

e2e-mt-85e566ec-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-85e566ec-openshift-default-5584db7984 from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-85e566ec-openshift-default-5584db7984

SuccessfulCreate

Created pod: e2e-mt-85e566ec-openshift-default-5584db7984-nnvwv

openshift-ingress

multus

e2e-mt-85e566ec-openshift-default-5584db7984-nnvwv

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-85e566ec-6f855fb8d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-85e566ec-6f855fb8d-q4vq7

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-85e566ec-854fcf587d

SuccessfulCreate

Created pod: payload-processing-e2e-mt-85e566ec-854fcf587d-z74nt
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-85e566ec-854fcf587d

FailedCreate

Error creating: pods "payload-processing-e2e-mt-85e566ec-854fcf587d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-85e566ec: serviceaccount "payload-processing-e2e-mt-85e566ec" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-85e566ec

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-85e566ec-6f855fb8d from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-85e566ec-6f855fb8d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-85e566ec-6f855fb8d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-85e566ec: serviceaccount "payload-processing-e2e-mt-85e566ec" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-85e566ec

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-85e566ec-854fcf587d from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-85e566ec-6f855fb8d-q4vq7

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-85e566ec-854fcf587d-z74nt

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-85e566ec-6f855fb8d-q4vq7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-85e566ec-6f855fb8d-q4vq7

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-85e566ec-6f855fb8d-q4vq7

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-mt-85e566ec-854fcf587d-z74nt

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-85e566ec-854fcf587d-z74nt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-85e566ec-854fcf587d-z74nt

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-mt-85e566ec-openshift-default-5584db7984-nnvwv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-85e566ec-openshift-default-5584db7984-nnvwv

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-85e566ec-openshift-default-5584db7984-nnvwv

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-mt-85e566ec-openshift-default-5584db7984-nnvwv

Unhealthy

Startup probe failed: Get "http://10.134.0.46:15021/healthz/ready": dial tcp 10.134.0.46:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-mt-85e566ec-openshift-default-5584db7984-nnvwv

ProbeError

Startup probe error: Get "http://10.134.0.46:15021/healthz/ready": dial tcp 10.134.0.46:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-mt-85e566ec-854fcf587d-z74nt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-85e566ec-6f855fb8d-q4vq7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-85e566ec-openshift-default-5584db7984-nnvwv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-85e566ec-openshift-default-5584db7984-nnvwv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-85e566ec-openshift-default-5584db7984-nnvwv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

multus

e2e-mt-540d8b1d-openshift-default-665848bfd8-2klrl

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-mt-540d8b1d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-540d8b1d

openshift-ingress

replicaset-controller

e2e-mt-540d8b1d-openshift-default-665848bfd8

SuccessfulCreate

Created pod: e2e-mt-540d8b1d-openshift-default-665848bfd8-2klrl

openshift-ingress

deployment-controller

e2e-mt-540d8b1d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-540d8b1d-openshift-default-665848bfd8 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-540d8b1d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-540d8b1d-856d54688d from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-mt-540d8b1d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-540d8b1d-df98989b6 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-mt-540d8b1d-df98989b6-kvmwk

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-540d8b1d-856d54688d-5vwmp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-540d8b1d-856d54688d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-540d8b1d-856d54688d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-540d8b1d: serviceaccount "payload-processing-e2e-mt-540d8b1d" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-540d8b1d-856d54688d-5vwmp

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-540d8b1d-856d54688d-5vwmp

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-540d8b1d-df98989b6-kvmwk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-540d8b1d-df98989b6

SuccessfulCreate

Created pod: payload-processing-e2e-mt-540d8b1d-df98989b6-kvmwk
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-540d8b1d-df98989b6

FailedCreate

Error creating: pods "payload-processing-e2e-mt-540d8b1d-df98989b6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-540d8b1d: serviceaccount "payload-processing-e2e-mt-540d8b1d" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-540d8b1d-856d54688d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-540d8b1d-856d54688d-5vwmp

openshift-ingress

kubelet

payload-processing-e2e-mt-540d8b1d-df98989b6-kvmwk

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-540d8b1d-856d54688d-5vwmp

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-540d8b1d-df98989b6-kvmwk

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-mt-540d8b1d-openshift-default-665848bfd8-2klrl

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-540d8b1d-openshift-default-665848bfd8-2klrl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-540d8b1d-openshift-default-665848bfd8-2klrl

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-mt-540d8b1d-openshift-default-665848bfd8-2klrl

Unhealthy

Startup probe failed: Get "http://10.134.0.49:15021/healthz/ready": dial tcp 10.134.0.49:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-mt-540d8b1d-openshift-default-665848bfd8-2klrl

ProbeError

Startup probe error: Get "http://10.134.0.49:15021/healthz/ready": dial tcp 10.134.0.49:15021: connect: connection refused body:

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-mt-540d8b1d

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-mt-540d8b1d: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-mt-540d8b1d": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-mt-540d8b1d, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: edbaaaba-c695-4dc9-a894-a0c998849050, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-mt-540d8b1d-df98989b6-kvmwk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-540d8b1d-856d54688d-5vwmp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-540d8b1d-openshift-default-665848bfd8-2klrl

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-inf-a-11557e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-11557e

openshift-ingress

deployment-controller

e2e-inf-a-11557e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-11557e-openshift-default-6665b67986 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-11557e-openshift-default-6665b67986

SuccessfulCreate

Created pod: e2e-inf-a-11557e-openshift-default-6665b67986-ftkbg

openshift-ingress

multus

e2e-inf-a-11557e-openshift-default-6665b67986-ftkbg

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-11557e-5bc756d49d

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-11557e-5bc756d49d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-11557e: serviceaccount "payload-processing-e2e-inf-a-11557e" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-11557e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-11557e-7ccbb4bf6 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-11557e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-11557e-5bc756d49d from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-11557e-7ccbb4bf6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-11557e-7ccbb4bf6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-11557e: serviceaccount "payload-processing-e2e-inf-a-11557e" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-11557e-7ccbb4bf6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-11557e-7ccbb4bf6-cmssp

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-11557e-7ccbb4bf6-cmssp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-11557e-7ccbb4bf6-cmssp

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-11557e-7ccbb4bf6-cmssp

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-11557e-5bc756d49d

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-11557e-5bc756d49d-jf645

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-11557e-7ccbb4bf6-cmssp

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-11557e-5bc756d49d-jf645

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-11557e-5bc756d49d-jf645

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-11557e-5bc756d49d-jf645

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-inf-a-11557e-5bc756d49d-jf645

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

multus

e2e-inf-b-422c4e-openshift-default-7585b75796-5x266

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-inf-b-422c4e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-422c4e-openshift-default-7585b75796 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-422c4e-openshift-default-7585b75796

SuccessfulCreate

Created pod: e2e-inf-b-422c4e-openshift-default-7585b75796-5x266

openshift-ingress

gateway_labeler_controller

e2e-inf-b-422c4e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-422c4e

openshift-ingress

kubelet

payload-processing-e2e-inf-b-422c4e-78454df584-4nxsz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-422c4e-7c9f7c586d-ztrsl

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-422c4e-7c9f7c586d-ztrsl

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-422c4e-7c9f7c586d-ztrsl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-422c4e-7c9f7c586d-ztrsl

Created

Created container: payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-422c4e-7c9f7c586d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-422c4e-7c9f7c586d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-422c4e: serviceaccount "payload-processing-e2e-inf-b-422c4e" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-422c4e-7c9f7c586d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-422c4e-7c9f7c586d-ztrsl

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-422c4e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-422c4e-78454df584 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-422c4e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-422c4e-7c9f7c586d from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-422c4e-78454df584

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-422c4e-78454df584-4nxsz
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-422c4e-78454df584

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-422c4e-78454df584-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-422c4e: serviceaccount "payload-processing-e2e-inf-b-422c4e" not found

openshift-ingress

multus

payload-processing-e2e-inf-b-422c4e-78454df584-4nxsz

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-422c4e-78454df584-4nxsz

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-422c4e-78454df584-4nxsz

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-inf-a-11557e-openshift-default-6665b67986-ftkbg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-11557e-openshift-default-6665b67986-ftkbg

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-11557e-openshift-default-6665b67986-ftkbg

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-inf-a-11557e-openshift-default-6665b67986-ftkbg

ProbeError

Startup probe error: Get "http://10.134.0.52:15021/healthz/ready": dial tcp 10.134.0.52:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-a-11557e-openshift-default-6665b67986-ftkbg

Unhealthy

Startup probe failed: Get "http://10.134.0.52:15021/healthz/ready": dial tcp 10.134.0.52:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-inf-b-422c4e-openshift-default-7585b75796-5x266

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-422c4e-openshift-default-7585b75796-5x266

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-422c4e-openshift-default-7585b75796-5x266

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-inf-b-422c4e-openshift-default-7585b75796-5x266

Unhealthy

Startup probe failed: Get "http://10.134.0.55:15021/healthz/ready": dial tcp 10.134.0.55:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-inf-b-422c4e-openshift-default-7585b75796-5x266

ProbeError

Startup probe error: Get "http://10.134.0.55:15021/healthz/ready": dial tcp 10.134.0.55:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-11557e-7ccbb4bf6-cmssp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-11557e-5bc756d49d-jf645

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-a-11557e-openshift-default-6665b67986-ftkbg

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-a-11557e-openshift-default-6665b67986-ftkbg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-11557e-openshift-default-6665b67986-ftkbg

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-422c4e-7c9f7c586d-ztrsl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-422c4e-78454df584-4nxsz

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-inf-b-422c4e

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-inf-b-422c4e: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-inf-b-422c4e": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-inf-b-422c4e, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 88d533b6-53c2-4288-b436-3f470f2f3584, UID in object meta:

openshift-ingress

deployment-controller

e2e-api-a-aac4b8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-aac4b8-openshift-default-559b4847d from 0 to 1

openshift-ingress

kubelet

e2e-inf-b-422c4e-openshift-default-7585b75796-5x266

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-api-a-aac4b8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-aac4b8

openshift-ingress

replicaset-controller

e2e-api-a-aac4b8-openshift-default-559b4847d

SuccessfulCreate

Created pod: e2e-api-a-aac4b8-openshift-default-559b4847d-kxbvz

openshift-ingress

multus

e2e-api-a-aac4b8-openshift-default-559b4847d-kxbvz

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-aac4b8-679b679556

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-aac4b8-679b679556-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-aac4b8: serviceaccount "payload-processing-e2e-api-a-aac4b8" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-aac4b8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-aac4b8-d9679579d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-aac4b8-d9679579d

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-aac4b8-d9679579d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-aac4b8: serviceaccount "payload-processing-e2e-api-a-aac4b8" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-aac4b8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-aac4b8-679b679556 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-a-aac4b8-d9679579d-q6l6f

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-aac4b8-679b679556-9dfqc

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-aac4b8-d9679579d

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-aac4b8-d9679579d-q6l6f

openshift-ingress

multus

payload-processing-e2e-api-a-aac4b8-d9679579d-q6l6f

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-aac4b8-679b679556-9dfqc

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-aac4b8-d9679579d-q6l6f

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-aac4b8-d9679579d-q6l6f

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-aac4b8-679b679556-9dfqc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-a-aac4b8-679b679556-9dfqc

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-aac4b8-679b679556

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-aac4b8-679b679556-9dfqc

openshift-ingress

gateway_labeler_controller

e2e-api-b-76c851

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-76c851

openshift-ingress

deployment-controller

e2e-api-b-76c851-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-76c851-openshift-default-6d484b9766 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-76c851-openshift-default-6d484b9766

SuccessfulCreate

Created pod: e2e-api-b-76c851-openshift-default-6d484b9766-jgr8f

openshift-ingress

multus

e2e-api-b-76c851-openshift-default-6d484b9766-jgr8f

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-76c851

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-76c851-55c86df6b6 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-76c851-55c86df6b6

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-76c851-55c86df6b6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-76c851: serviceaccount "payload-processing-e2e-api-b-76c851" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-76c851

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-76c851-76c9b594c6 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-76c851-76c9b594c6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-76c851-76c9b594c6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-76c851: serviceaccount "payload-processing-e2e-api-b-76c851" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-76c851-76c9b594c6-tws9p

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-76c851-55c86df6b6

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-76c851-55c86df6b6-xfvgl

openshift-ingress

multus

payload-processing-e2e-api-b-76c851-55c86df6b6-xfvgl

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-76c851-55c86df6b6-xfvgl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-76c851-76c9b594c6-tws9p

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-b-76c851-55c86df6b6-xfvgl

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-76c851-55c86df6b6-xfvgl

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-76c851-76c9b594c6-tws9p

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-76c851-76c9b594c6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-76c851-76c9b594c6-tws9p

openshift-ingress

multus

payload-pre-processing-e2e-api-b-76c851-76c9b594c6-tws9p

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-a-aac4b8-openshift-default-559b4847d-kxbvz

ProbeError

Readiness probe error: Get "http://10.134.0.59:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-api-a-aac4b8-openshift-default-559b4847d-kxbvz

Unhealthy

Readiness probe failed: Get "http://10.134.0.59:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-api-a-aac4b8-openshift-default-559b4847d-kxbvz

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-aac4b8-openshift-default-559b4847d-kxbvz

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-aac4b8-openshift-default-559b4847d-kxbvz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-api-a-aac4b8-openshift-default-559b4847d-kxbvz

Unhealthy

Startup probe failed: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-api-a-aac4b8-openshift-default-559b4847d-kxbvz

ProbeError

Startup probe error: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-api-b-76c851-openshift-default-6d484b9766-jgr8f

Unhealthy

Readiness probe failed: Get "http://10.134.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-api-b-76c851-openshift-default-6d484b9766-jgr8f

ProbeError

Readiness probe error: Get "http://10.134.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-api-b-76c851-openshift-default-6d484b9766-jgr8f

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-76c851-openshift-default-6d484b9766-jgr8f

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-76c851-openshift-default-6d484b9766-jgr8f

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-api-b-76c851-openshift-default-6d484b9766-jgr8f

Unhealthy

Startup probe failed: Get "http://10.134.0.62:15021/healthz/ready": dial tcp 10.134.0.62:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-api-b-76c851-openshift-default-6d484b9766-jgr8f

ProbeError

Startup probe error: Get "http://10.134.0.62:15021/healthz/ready": dial tcp 10.134.0.62:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-aac4b8-679b679556-9dfqc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-aac4b8-d9679579d-q6l6f

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-a-aac4b8-openshift-default-559b4847d-kxbvz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-aac4b8-openshift-default-559b4847d-kxbvz

ProbeError

Readiness probe error: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-api-a-aac4b8-openshift-default-559b4847d-kxbvz

Unhealthy

Readiness probe failed: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-76c851-76c9b594c6-tws9p

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-76c851-55c86df6b6-xfvgl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-b-76c851-openshift-default-6d484b9766-jgr8f

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-a-499dd1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-499dd1

openshift-ingress

replicaset-controller

e2e-shared-a-499dd1-openshift-default-758c466b96

SuccessfulCreate

Created pod: e2e-shared-a-499dd1-openshift-default-758c466b96-pvn99

openshift-ingress

deployment-controller

e2e-shared-a-499dd1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-499dd1-openshift-default-758c466b96 from 0 to 1

openshift-ingress

kubelet

e2e-api-b-76c851-openshift-default-6d484b9766-jgr8f

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-b-76c851-openshift-default-6d484b9766-jgr8f

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

multus

e2e-shared-a-499dd1-openshift-default-758c466b96-pvn99

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-499dd1-794dc545d6

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-499dd1-794dc545d6-fqrtx

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-499dd1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-499dd1-7c7bdd9bbd from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-a-499dd1-794dc545d6-fqrtx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-499dd1-7c7bdd9bbd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-499dd1-7c7bdd9bbd-tsm5k

openshift-ingress

multus

payload-processing-e2e-shared-a-499dd1-794dc545d6-fqrtx

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-499dd1-7c7bdd9bbd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-499dd1-7c7bdd9bbd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-499dd1: serviceaccount "payload-processing-e2e-shared-a-499dd1" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-499dd1-7c7bdd9bbd-tsm5k

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-499dd1-7c7bdd9bbd-tsm5k

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-499dd1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-499dd1-794dc545d6 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-499dd1-7c7bdd9bbd-tsm5k

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-499dd1-794dc545d6-fqrtx

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-499dd1-794dc545d6-fqrtx

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-499dd1-794dc545d6

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-499dd1-794dc545d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-499dd1: serviceaccount "payload-processing-e2e-shared-a-499dd1" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-499dd1-7c7bdd9bbd-tsm5k

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

e2e-shared-b-e15986-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-e15986-openshift-default-5f8d668c44 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-e15986

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-e15986

openshift-ingress

replicaset-controller

e2e-shared-b-e15986-openshift-default-5f8d668c44

SuccessfulCreate

Created pod: e2e-shared-b-e15986-openshift-default-5f8d668c44-7fn4d

openshift-ingress

multus

e2e-shared-b-e15986-openshift-default-5f8d668c44-7fn4d

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-e15986

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-e15986-96d7d798b from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-e15986-7687667dbd-dpdf6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-e15986-7687667dbd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-e15986-7687667dbd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-e15986: serviceaccount "payload-processing-e2e-shared-b-e15986" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-e15986-7687667dbd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-e15986-7687667dbd-dpdf6

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-e15986

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-e15986-7687667dbd from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-e15986-7687667dbd-dpdf6

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-e15986-7687667dbd-dpdf6

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-e15986-96d7d798b-prtrg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-b-e15986-96d7d798b-prtrg

AddedInterface

Add eth0 [10.134.0.71/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-e15986-96d7d798b

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-e15986-96d7d798b-prtrg
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-e15986-96d7d798b

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-e15986-96d7d798b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-e15986: serviceaccount "payload-processing-e2e-shared-b-e15986" not found

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-e15986-7687667dbd-dpdf6

AddedInterface

Add eth0 [10.134.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-e15986-96d7d798b-prtrg

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-e15986-96d7d798b-prtrg

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-shared-a-499dd1-openshift-default-758c466b96-pvn99

ProbeError

Readiness probe error: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-shared-a-499dd1-openshift-default-758c466b96-pvn99

Unhealthy

Readiness probe failed: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-a-499dd1-openshift-default-758c466b96-pvn99

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-499dd1-openshift-default-758c466b96-pvn99

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-499dd1-openshift-default-758c466b96-pvn99

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-shared-a-499dd1-openshift-default-758c466b96-pvn99

ProbeError

Startup probe error: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-shared-a-499dd1-openshift-default-758c466b96-pvn99

Unhealthy

Startup probe failed: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-b-e15986-openshift-default-5f8d668c44-7fn4d

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-e15986-openshift-default-5f8d668c44-7fn4d

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-e15986-openshift-default-5f8d668c44-7fn4d

Created

Created container: istio-proxy
(x4)

openshift-ingress

kubelet

e2e-shared-b-e15986-openshift-default-5f8d668c44-7fn4d

ProbeError

Startup probe error: Get "http://10.134.0.69:15021/healthz/ready": dial tcp 10.134.0.69:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-shared-b-e15986-openshift-default-5f8d668c44-7fn4d

Unhealthy

Startup probe failed: Get "http://10.134.0.69:15021/healthz/ready": dial tcp 10.134.0.69:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-ipp-a-e3f0a9-openshift-default-8588586558

SuccessfulCreate

Created pod: e2e-ipp-a-e3f0a9-openshift-default-8588586558-2br4m

openshift-ingress

deployment-controller

e2e-ipp-a-e3f0a9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-e3f0a9-openshift-default-8588586558 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-e3f0a9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-e3f0a9

openshift-ingress

multus

e2e-ipp-a-e3f0a9-openshift-default-8588586558-2br4m

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-e3f0a9-7d4d78f456

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-e3f0a9-7d4d78f456-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-e3f0a9: serviceaccount "payload-processing-e2e-ipp-a-e3f0a9" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-e3f0a9-7d4d78f456

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-e3f0a9-7d4d78f456-wtj88

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-e3f0a9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-e3f0a9-5b4956c5f8 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-e3f0a9-5b4956c5f8

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-e3f0a9-5b4956c5f8-5pbpm

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-e3f0a9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-e3f0a9-7d4d78f456 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-e3f0a9-5b4956c5f8

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-e3f0a9-5b4956c5f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-e3f0a9: serviceaccount "payload-processing-e2e-ipp-a-e3f0a9" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-e3f0a9-5b4956c5f8-5pbpm

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-e3f0a9-5b4956c5f8-5pbpm

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-e3f0a9-5b4956c5f8-5pbpm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-a-e3f0a9-5b4956c5f8-5pbpm

AddedInterface

Add eth0 [10.134.0.75/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-e3f0a9-7d4d78f456-wtj88

AddedInterface

Add eth0 [10.134.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-e3f0a9-7d4d78f456-wtj88

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-e3f0a9-7d4d78f456-wtj88

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-e3f0a9-7d4d78f456-wtj88

Created

Created container: payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-c6e95b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-c6e95b

openshift-ingress

replicaset-controller

e2e-ipp-b-c6e95b-openshift-default-7c655cbb96

SuccessfulCreate

Created pod: e2e-ipp-b-c6e95b-openshift-default-7c655cbb96-tmj4r

openshift-ingress

deployment-controller

e2e-ipp-b-c6e95b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-c6e95b-openshift-default-7c655cbb96 from 0 to 1

openshift-ingress

kubelet

e2e-ipp-a-e3f0a9-openshift-default-8588586558-2br4m

ProbeError

Readiness probe error: Get "http://10.132.0.47:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-a-e3f0a9-openshift-default-8588586558-2br4m

Unhealthy

Readiness probe failed: Get "http://10.132.0.47:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

multus

e2e-ipp-b-c6e95b-openshift-default-7c655cbb96-tmj4r

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-a-e3f0a9-openshift-default-8588586558-2br4m

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-e3f0a9-openshift-default-8588586558-2br4m

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-e3f0a9-openshift-default-8588586558-2br4m

Created

Created container: istio-proxy
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-c6e95b-7599796564

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-c6e95b-7599796564-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-c6e95b: serviceaccount "payload-processing-e2e-ipp-b-c6e95b" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-c6e95b-6549469f7b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-c6e95b-6549469f7b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-c6e95b: serviceaccount "payload-processing-e2e-ipp-b-c6e95b" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-c6e95b-7599796564

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-c6e95b-7599796564-dshgv

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-c6e95b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-c6e95b-7599796564 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-c6e95b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-c6e95b-6549469f7b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-c6e95b-6549469f7b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-c6e95b-6549469f7b-9l8kx

openshift-ingress

multus

payload-processing-e2e-ipp-b-c6e95b-7599796564-dshgv

AddedInterface

Add eth0 [10.134.0.76/23] from ovn-kubernetes
(x4)

openshift-ingress

kubelet

e2e-ipp-a-e3f0a9-openshift-default-8588586558-2br4m

Unhealthy

Startup probe failed: Get "http://10.132.0.47:15021/healthz/ready": dial tcp 10.132.0.47:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-ipp-a-e3f0a9-openshift-default-8588586558-2br4m

ProbeError

Startup probe error: Get "http://10.132.0.47:15021/healthz/ready": dial tcp 10.132.0.47:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-c6e95b-7599796564-dshgv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-c6e95b-7599796564-dshgv

FailedMount

MountVolume.SetUp failed for volume "plugins-config-volume" : failed to sync configmap cache: timed out waiting for the condition

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-c6e95b-6549469f7b-9l8kx

FailedMount

MountVolume.SetUp failed for volume "plugins-config-volume" : failed to sync configmap cache: timed out waiting for the condition

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-c6e95b-6549469f7b-9l8kx

AddedInterface

Add eth0 [10.134.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-c6e95b-7599796564-dshgv

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-c6e95b-6549469f7b-9l8kx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-c6e95b-6549469f7b-9l8kx

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-c6e95b-6549469f7b-9l8kx

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-c6e95b-7599796564-dshgv

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-ipp-b-c6e95b-openshift-default-7c655cbb96-tmj4r

Unhealthy

Readiness probe failed: Get "http://10.132.0.48:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-b-c6e95b-openshift-default-7c655cbb96-tmj4r

ProbeError

Readiness probe error: Get "http://10.132.0.48:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ipp-b-c6e95b-openshift-default-7c655cbb96-tmj4r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-c6e95b-openshift-default-7c655cbb96-tmj4r

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-c6e95b-openshift-default-7c655cbb96-tmj4r

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-ipp-b-c6e95b-openshift-default-7c655cbb96-tmj4r

ProbeError

Startup probe error: Get "http://10.132.0.48:15021/healthz/ready": dial tcp 10.132.0.48:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-ipp-b-c6e95b-openshift-default-7c655cbb96-tmj4r

Unhealthy

Startup probe failed: Get "http://10.132.0.48:15021/healthz/ready": dial tcp 10.132.0.48:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-34f01f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-34f01f

openshift-ingress

deployment-controller

e2e-ipp-cleanup-34f01f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-34f01f-openshift-default-5ff59f98d8 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-34f01f-openshift-default-5ff59f98d8

SuccessfulCreate

Created pod: e2e-ipp-cleanup-34f01f-openshift-default-5ff59f98d8-c6nkl

openshift-ingress

multus

e2e-ipp-cleanup-34f01f-openshift-default-5ff59f98d8-c6nkl

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-34f01f-f8684c588

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-34f01f-f8684c588-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-34f01f: serviceaccount "payload-processing-e2e-ipp-cleanup-34f01f" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-34f01f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-34f01f-f8684c588 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-34f01f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-34f01f-6d9dc64684 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-34f01f-f8684c588-vprc2

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-34f01f-6d9dc64684-r8dgr

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-34f01f-6d9dc64684

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-34f01f-6d9dc64684-r8dgr
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-34f01f-6d9dc64684

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-34f01f-6d9dc64684-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-34f01f: serviceaccount "payload-processing-e2e-ipp-cleanup-34f01f" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-34f01f-6d9dc64684-r8dgr

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-34f01f-f8684c588-vprc2

AddedInterface

Add eth0 [10.134.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-34f01f-6d9dc64684-r8dgr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-34f01f-f8684c588-vprc2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-34f01f-6d9dc64684-r8dgr

AddedInterface

Add eth0 [10.134.0.79/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-34f01f-f8684c588

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-34f01f-f8684c588-vprc2

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-34f01f-f8684c588-vprc2

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-34f01f-openshift-default-5ff59f98d8-c6nkl

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-34f01f-openshift-default-5ff59f98d8-c6nkl

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-34f01f-openshift-default-5ff59f98d8-c6nkl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-ipp-cleanup-34f01f-openshift-default-5ff59f98d8-c6nkl

ProbeError

Startup probe error: Get "http://10.132.0.50:15021/healthz/ready": dial tcp 10.132.0.50:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-ipp-cleanup-34f01f-openshift-default-5ff59f98d8-c6nkl

Unhealthy

Startup probe failed: Get "http://10.132.0.50:15021/healthz/ready": dial tcp 10.132.0.50:15021: connect: connection refused

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-cleanup-34f01f

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-34f01f: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-cleanup-34f01f": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-34f01f, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 7bde1674-3e9d-48ac-9c9f-fccd00606e63, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-34f01f-6d9dc64684-r8dgr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-34f01f-f8684c588-vprc2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-34f01f-openshift-default-5ff59f98d8-c6nkl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-e3f0a9-7d4d78f456-wtj88

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-slice-controller

payload-pre-processing-e2e-ipp-a-e3f0a9

FailedToUpdateEndpointSlices

Error updating Endpoint Slices for Service openshift-ingress/payload-pre-processing-e2e-ipp-a-e3f0a9: failed to update payload-pre-processing-e2e-ipp-a-e3f0a9-vn878 EndpointSlice for Service openshift-ingress/payload-pre-processing-e2e-ipp-a-e3f0a9: endpointslices.discovery.k8s.io "payload-pre-processing-e2e-ipp-a-e3f0a9-vn878" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-e3f0a9-5b4956c5f8-5pbpm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-e3f0a9-openshift-default-8588586558-2br4m

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-c6e95b-7599796564-dshgv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-c6e95b-6549469f7b-9l8kx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-c6e95b-openshift-default-7c655cbb96-tmj4r

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-c6e95b-openshift-default-7c655cbb96-tmj4r

Unhealthy

Readiness probe failed: Get "http://10.132.0.48:15021/healthz/ready": EOF

openshift-ingress

kubelet

e2e-ipp-b-c6e95b-openshift-default-7c655cbb96-tmj4r

ProbeError

Readiness probe error: Get "http://10.132.0.48:15021/healthz/ready": EOF body:

openshift-ingress

kubelet

payload-processing-e2e-shared-a-499dd1-794dc545d6-fqrtx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-499dd1-7c7bdd9bbd-tsm5k

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-499dd1-openshift-default-758c466b96-pvn99

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-e15986-96d7d798b-prtrg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-e15986-7687667dbd-dpdf6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-e15986-openshift-default-5f8d668c44-7fn4d

Killing

Stopping container istio-proxy