Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-processing-e2e-ipp-b-e30975-5c9ffb87f7-vxxgn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-e30975-5c9ffb87f7-vxxgn to ip-10-0-128-131.ec2.internal

openshift-ingress

e2e-api-a-61f413-openshift-default-c9445fd78-btsns

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-61f413-openshift-default-c9445fd78-btsns to ip-10-0-139-55.ec2.internal

openshift-ingress

kube-auth-proxy-56cf6b7cfc-p9rkx

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-56cf6b7cfc-p9rkx to ip-10-0-133-120.ec2.internal

openshift-ingress

kube-auth-proxy-56cf6b7cfc-nlzbq

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-56cf6b7cfc-nlzbq to ip-10-0-128-131.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-hw6cm

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hw6cm to ip-10-0-133-120.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-sl9bc

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-sl9bc to ip-10-0-133-120.ec2.internal

openshift-ingress

payload-processing-e2e-ait-7553b8c9-6f756897b7-wggbz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-7553b8c9-6f756897b7-wggbz to ip-10-0-128-131.ec2.internal

openshift-ingress

e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z to ip-10-0-139-55.ec2.internal

openshift-ingress

e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69

Scheduled

Successfully assigned openshift-ingress/e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69 to ip-10-0-139-55.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-61f413-7f54488789-jpw68

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-61f413-7f54488789-jpw68 to ip-10-0-133-120.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-f2ae08-5b55b95469-ztq7w

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-f2ae08-5b55b95469-ztq7w to ip-10-0-128-131.ec2.internal

openshift-ingress

payload-processing-e2e-autores-616972-7454b64d6c-5whn4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-616972-7454b64d6c-5whn4 to ip-10-0-128-131.ec2.internal

openshift-ingress

e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf to ip-10-0-139-55.ec2.internal

openshift-ingress

payload-processing-e2e-derive-2fb1f7b7-55bc45bfd5-tk7zh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-2fb1f7b7-55bc45bfd5-tk7zh to ip-10-0-128-131.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-mrfvn

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mrfvn to ip-10-0-139-55.ec2.internal

openshift-ingress

e2e-shared-a-w3-a4942b-openshift-default-65d8854976-sjgdt

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-a4942b-openshift-default-65d8854976-sjgdt to ip-10-0-128-131.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-384f4f-7b4f8d854f-7h28k

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-384f4f-7b4f8d854f-7h28k to ip-10-0-128-131.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-ltrmf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-ltrmf to ip-10-0-128-131.ec2.internal

openshift-ingress

e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr to ip-10-0-139-55.ec2.internal

openshift-ingress

e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf

Scheduled

Successfully assigned openshift-ingress/e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf to ip-10-0-139-55.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-6dd85108-844466c854-msm9d

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-6dd85108-844466c854-msm9d to ip-10-0-133-120.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-421f5bb0-65d75dd4f8-7sxpm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-421f5bb0-65d75dd4f8-7sxpm to ip-10-0-133-120.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-7553b8c9-564cb5bfd6-m6hj9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-7553b8c9-564cb5bfd6-m6hj9 to ip-10-0-128-131.ec2.internal

openshift-ingress

e2e-noten-56547c-openshift-default-5496d9b88d-hw4bq

Scheduled

Successfully assigned openshift-ingress/e2e-noten-56547c-openshift-default-5496d9b88d-hw4bq to ip-10-0-128-131.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-ff43b8-5db6656b55-59r5r

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-ff43b8-5db6656b55-59r5r to ip-10-0-133-120.ec2.internal

openshift-ingress

e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd

Scheduled

Successfully assigned openshift-ingress/e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd to ip-10-0-139-55.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-61f413-676968d9cd-x8vfv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-61f413-676968d9cd-x8vfv to ip-10-0-133-120.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-870dc0-8647bd7df9-fx8pb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-870dc0-8647bd7df9-fx8pb to ip-10-0-128-131.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-5bvgf

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5bvgf to ip-10-0-139-55.ec2.internal

openshift-ingress

payload-processing-e2e-ait-6dd85108-f88f45cd7-9jj8l

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-6dd85108-f88f45cd7-9jj8l to ip-10-0-128-131.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-f2ae08-5fbff9ddf8-cbk7l

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-f2ae08-5fbff9ddf8-cbk7l to ip-10-0-128-131.ec2.internal

openshift-ingress

e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s

Scheduled

Successfully assigned openshift-ingress/e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s to ip-10-0-139-55.ec2.internal

openshift-ingress

e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s to ip-10-0-139-55.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-55a703-789cf7579-g92b6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-55a703-789cf7579-g92b6 to ip-10-0-133-120.ec2.internal

openshift-ingress

e2e-ipp-b-e30975-openshift-default-f898c84b6-smrnz

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-e30975-openshift-default-f898c84b6-smrnz to ip-10-0-139-55.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-804182-6cddfdd757-8s9z2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-804182-6cddfdd757-8s9z2 to ip-10-0-128-131.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-421f5bb0-598bf4ff98-mpxpg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-421f5bb0-598bf4ff98-mpxpg to ip-10-0-128-131.ec2.internal

openshift-ingress

e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv to ip-10-0-139-55.ec2.internal

openshift-ingress

payload-processing-e2e-mt-a69d4afb-5fbfcfbddf-m2s2h

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-a69d4afb-5fbfcfbddf-m2s2h to ip-10-0-133-120.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-lvk8f

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-lvk8f to ip-10-0-133-120.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-823397-644fb758-nk8nh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-823397-644fb758-nk8nh to ip-10-0-133-120.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-b0b77f-6bd9859c86-mk4bc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-b0b77f-6bd9859c86-mk4bc to ip-10-0-128-131.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-616972-7fc6c8588b-vjj6k

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-616972-7fc6c8588b-vjj6k to ip-10-0-128-131.ec2.internal

openshift-ingress

payload-processing-e2e-mt-b16e488f-559cf656bf-98zd4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-b16e488f-559cf656bf-98zd4 to ip-10-0-133-120.ec2.internal

openshift-ingress

e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97 to ip-10-0-139-55.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-5a3b57-769fcf87d7-xcvsf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-5a3b57-769fcf87d7-xcvsf to ip-10-0-128-131.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-a4942b-779bc57c4c-vjknz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-a4942b-779bc57c4c-vjknz to ip-10-0-128-131.ec2.internal

openshift-ingress

e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8 to ip-10-0-139-55.ec2.internal

openshift-ingress

e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v to ip-10-0-139-55.ec2.internal

openshift-ingress

router-default-59f4cd9c7b-hpl9h

Scheduled

Successfully assigned openshift-ingress/router-default-59f4cd9c7b-hpl9h to ip-10-0-133-120.ec2.internal

openshift-ingress

router-default-59f4cd9c7b-hpl9h

FailedScheduling

0/2 nodes are available: 2 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/2 nodes are available: 2 Preemption is not helpful for scheduling.

openshift-ingress

payload-pre-processing-e2e-derive-2fb1f7b7-bd48946c8-t5gzx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-2fb1f7b7-bd48946c8-t5gzx to ip-10-0-128-131.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-823397-77b7bc5d8f-zl764

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-823397-77b7bc5d8f-zl764 to ip-10-0-128-131.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-b0b77f-84f684d55-ptfpt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-b0b77f-84f684d55-ptfpt to ip-10-0-128-131.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-384f4f-5fc75bd998-6449v

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-384f4f-5fc75bd998-6449v to ip-10-0-128-131.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-ff43b8-666b566bdb-47dxf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-ff43b8-666b566bdb-47dxf to ip-10-0-128-131.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-804182-fb467896b-qstrc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-804182-fb467896b-qstrc to ip-10-0-128-131.ec2.internal

openshift-ingress

e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd

Scheduled

Successfully assigned openshift-ingress/e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd to ip-10-0-139-55.ec2.internal

openshift-ingress

e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt to ip-10-0-139-55.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-870dc0-79dc7b5894-fdg2m

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-870dc0-79dc7b5894-fdg2m to ip-10-0-128-131.ec2.internal

openshift-ingress

e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln to ip-10-0-139-55.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-55a703-69c6c569fd-qvbxk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-55a703-69c6c569fd-qvbxk to ip-10-0-133-120.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-a4942b-75d6cd9dcd-2s6b8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-a4942b-75d6cd9dcd-2s6b8 to ip-10-0-128-131.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-5a3b57-7ffb667df4-wx6gg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-5a3b57-7ffb667df4-wx6gg to ip-10-0-133-120.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-a69d4afb-c88868754-kg6z7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-a69d4afb-c88868754-kg6z7 to ip-10-0-128-131.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-b16e488f-6b675544cd-8f5fz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-b16e488f-6b675544cd-8f5fz to ip-10-0-128-131.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-e30975-84cb54bb4b-x8rxn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-e30975-84cb54bb4b-x8rxn to ip-10-0-128-131.ec2.internal

openshift-ingress

e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt

Scheduled

Successfully assigned openshift-ingress/e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt to ip-10-0-139-55.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-59f4cd9c7b from 0 to 1

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer
(x13)

openshift-ingress

replicaset-controller

router-default-59f4cd9c7b

FailedCreate

Error creating: pods "router-default-59f4cd9c7b-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x16)

openshift-ingress

replicaset-controller

router-default-59f4cd9c7b

FailedCreate

Error creating: pods "router-default-59f4cd9c7b-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

replicaset-controller

router-default-59f4cd9c7b

SuccessfulCreate

Created pod: router-default-59f4cd9c7b-hpl9h
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts
(x6)

openshift-ingress

kubelet

router-default-59f4cd9c7b-hpl9h

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x6)

openshift-ingress

kubelet

router-default-59f4cd9c7b-hpl9h

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

kubelet

router-default-59f4cd9c7b-hpl9h

Started

Started container router

openshift-ingress

kubelet

router-default-59f4cd9c7b-hpl9h

Created

Created container: router

openshift-ingress

kubelet

router-default-59f4cd9c7b-hpl9h

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:da130d90f0bffd5c5876c94544c91b2a1be0d23ce2747ddfeafe88e03ee7d8d1" already present on machine

openshift-ingress

multus

router-default-59f4cd9c7b-hpl9h

AddedInterface

Add eth0 [10.132.0.8/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

kube-auth-proxy-56cf6b7cfc

SuccessfulCreate

Created pod: kube-auth-proxy-56cf6b7cfc-p9rkx

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-56cf6b7cfc from 0 to 2
(x5)

openshift-ingress

replicaset-controller

kube-auth-proxy-56cf6b7cfc

FailedCreate

Error creating: pods "kube-auth-proxy-56cf6b7cfc-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

multus

kube-auth-proxy-56cf6b7cfc-p9rkx

AddedInterface

Add eth0 [10.132.0.22/23] from ovn-kubernetes

openshift-ingress

multus

kube-auth-proxy-56cf6b7cfc-nlzbq

AddedInterface

Add eth0 [10.134.0.27/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-56cf6b7cfc-nlzbq

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

kubelet

kube-auth-proxy-56cf6b7cfc-p9rkx

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

replicaset-controller

kube-auth-proxy-56cf6b7cfc

SuccessfulCreate

Created pod: kube-auth-proxy-56cf6b7cfc-nlzbq

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

kubelet

kube-auth-proxy-56cf6b7cfc-nlzbq

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.865s (2.865s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-56cf6b7cfc-nlzbq

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-56cf6b7cfc-nlzbq

Started

Started container kube-auth-proxy

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-hw6cm

openshift-ingress

kubelet

kube-auth-proxy-56cf6b7cfc-p9rkx

Created

Created container: kube-auth-proxy

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-hw6cm

AddedInterface

Add eth0 [10.132.0.23/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-56cf6b7cfc-p9rkx

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-hw6cm

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

kube-auth-proxy-56cf6b7cfc-p9rkx

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 3.33s (3.33s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-hw6cm

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.58s (2.58s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-hw6cm

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-hw6cm

Started

Started container discovery
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-hw6cm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-5bvgf

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-5bvgf

AddedInterface

Add eth0 [10.133.0.27/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-hw6cm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-5bvgf

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-5bvgf

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-5bvgf

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 5.407s (5.407s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-5bvgf

Created

Created container: istio-proxy

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-sl9bc

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-sl9bc

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-sl9bc

Created

Created container: discovery

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-sl9bc

AddedInterface

Add eth0 [10.132.0.24/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-sl9bc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" already present on machine

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-sl9bc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-sl9bc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-hw6cm

Killing

Stopping container discovery

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-hw6cm
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x4)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-mrfvn

AddedInterface

Add eth0 [10.133.0.38/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-mrfvn

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-lvk8f

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-ltrmf

AddedInterface

Add eth0 [10.134.0.34/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-5b54b7fbb7-lvk8f

AddedInterface

Add eth0 [10.132.0.36/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-ltrmf

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-ltrmf

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-lvk8f

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-ltrmf

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.478s (1.478s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-ltrmf

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-ltrmf

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-lvk8f

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-lvk8f

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.541s (2.541s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-lvk8f

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-mrfvn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-mrfvn

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-mrfvn

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-mrfvn

ProbeError

Startup probe error: Get "http://10.133.0.38:15021/healthz/ready": dial tcp 10.133.0.38:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-mrfvn

Unhealthy

Startup probe failed: Get "http://10.133.0.38:15021/healthz/ready": dial tcp 10.133.0.38:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-inf-a-ff43b8-openshift-default-78dd55d8f6

SuccessfulCreate

Created pod: e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt

openshift-ingress

deployment-controller

e2e-inf-a-ff43b8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-ff43b8-openshift-default-78dd55d8f6 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-a-ff43b8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-ff43b8

openshift-ingress

multus

e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt

AddedInterface

Add eth0 [10.133.0.42/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-ff43b8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-ff43b8-666b566bdb from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-ff43b8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-ff43b8-5db6656b55 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-ff43b8-666b566bdb-47dxf

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-ff43b8-666b566bdb-47dxf

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-ff43b8-5db6656b55

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-ff43b8-5db6656b55-59r5r
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-ff43b8-5db6656b55

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-ff43b8-5db6656b55-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-ff43b8: serviceaccount "payload-processing-e2e-inf-a-ff43b8" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-ff43b8-666b566bdb-47dxf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-ff43b8-666b566bdb-47dxf

Created

Created container: payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-ff43b8-666b566bdb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-ff43b8-666b566bdb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-ff43b8: serviceaccount "payload-processing-e2e-inf-a-ff43b8" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-ff43b8-666b566bdb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-ff43b8-666b566bdb-47dxf

openshift-ingress

kubelet

payload-processing-e2e-inf-a-ff43b8-5db6656b55-59r5r

FailedMount

MountVolume.SetUp failed for volume "plugins-config-volume" : failed to sync configmap cache: timed out waiting for the condition

openshift-ingress

kubelet

payload-processing-e2e-inf-a-ff43b8-5db6656b55-59r5r

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-inf-a-ff43b8-5db6656b55-59r5r

AddedInterface

Add eth0 [10.132.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-ff43b8-5db6656b55-59r5r

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-ff43b8-5db6656b55-59r5r

Started

Started container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-ait-7553b8c9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-7553b8c9

openshift-ingress

GatewayAuthBootstrap

e2e-ait-7553b8c9

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-ait-7553b8c9-authn-ssl: envoyfilters.networking.istio.io "e2e-ait-7553b8c9-authn-ssl" already exists

openshift-ingress

gateway_labeler_controller

e2e-autores-616972

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-616972

openshift-ingress

multus

e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf

AddedInterface

Add eth0 [10.133.0.44/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ait-7553b8c9-openshift-default-7b4c66488

SuccessfulCreate

Created pod: e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf

openshift-ingress

deployment-controller

e2e-ait-7553b8c9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-7553b8c9-openshift-default-7b4c66488 from 0 to 1

openshift-ingress

deployment-controller

e2e-autores-616972-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-616972-openshift-default-5bdb9bbdcb from 0 to 1

openshift-ingress

replicaset-controller

e2e-autores-616972-openshift-default-5bdb9bbdcb

SuccessfulCreate

Created pod: e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd

openshift-ingress

multus

e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ait-7553b8c9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-7553b8c9-6f756897b7 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-7553b8c9-564cb5bfd6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-7553b8c9-564cb5bfd6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-7553b8c9: serviceaccount "payload-processing-e2e-ait-7553b8c9" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-7553b8c9-564cb5bfd6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-7553b8c9-564cb5bfd6-m6hj9
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-7553b8c9-6f756897b7

FailedCreate

Error creating: pods "payload-processing-e2e-ait-7553b8c9-6f756897b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-7553b8c9: serviceaccount "payload-processing-e2e-ait-7553b8c9" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-7553b8c9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-7553b8c9-564cb5bfd6 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ait-7553b8c9-6f756897b7-wggbz

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-7553b8c9-6f756897b7

SuccessfulCreate

Created pod: payload-processing-e2e-ait-7553b8c9-6f756897b7-wggbz
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-616972-7fc6c8588b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-616972-7fc6c8588b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-616972: serviceaccount "payload-processing-e2e-autores-616972" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-616972-7fc6c8588b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-616972-7fc6c8588b-vjj6k

openshift-ingress

kubelet

payload-processing-e2e-ait-7553b8c9-6f756897b7-wggbz

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-7553b8c9-564cb5bfd6-m6hj9

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-7553b8c9-564cb5bfd6-m6hj9

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-7553b8c9-564cb5bfd6-m6hj9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-7553b8c9-564cb5bfd6-m6hj9

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-616972

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-616972-7fc6c8588b from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-7553b8c9-6f756897b7-wggbz

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-7553b8c9-6f756897b7-wggbz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-616972-7454b64d6c

FailedCreate

Error creating: pods "payload-processing-e2e-autores-616972-7454b64d6c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-616972: serviceaccount "payload-processing-e2e-autores-616972" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-616972-7454b64d6c

SuccessfulCreate

Created pod: payload-processing-e2e-autores-616972-7454b64d6c-5whn4

openshift-ingress

deployment-controller

payload-processing-e2e-autores-616972

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-616972-7454b64d6c from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-autores-616972-7454b64d6c-5whn4

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-616972-7454b64d6c-5whn4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-autores-616972-7fc6c8588b-vjj6k

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-616972-7fc6c8588b-vjj6k

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-616972-7fc6c8588b-vjj6k

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-616972-7fc6c8588b-vjj6k

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-autores-616972-7454b64d6c-5whn4

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-616972-7454b64d6c-5whn4

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt

Unhealthy

Startup probe failed: Get "http://10.133.0.42:15021/healthz/ready": dial tcp 10.133.0.42:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt

ProbeError

Startup probe error: Get "http://10.133.0.42:15021/healthz/ready": dial tcp 10.133.0.42:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf

Unhealthy

Readiness probe failed: Get "http://10.133.0.44:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf

ProbeError

Readiness probe error: Get "http://10.133.0.44:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

replicaset-controller

e2e-inf-b-870dc0-openshift-default-68b7745584

SuccessfulCreate

Created pod: e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v

openshift-ingress

multus

e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-inf-b-870dc0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-870dc0

openshift-ingress

deployment-controller

e2e-inf-b-870dc0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-870dc0-openshift-default-68b7745584 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf

Created

Created container: istio-proxy
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-870dc0-79dc7b5894

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-870dc0-79dc7b5894-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-870dc0: serviceaccount "payload-processing-e2e-inf-b-870dc0" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-870dc0-8647bd7df9

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-870dc0-8647bd7df9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-870dc0: serviceaccount "payload-processing-e2e-inf-b-870dc0" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-870dc0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-870dc0-8647bd7df9 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-870dc0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-870dc0-79dc7b5894 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-870dc0-79dc7b5894

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-870dc0-79dc7b5894-fdg2m

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-870dc0-79dc7b5894-fdg2m

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-870dc0-8647bd7df9-fx8pb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-b-870dc0-8647bd7df9-fx8pb

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-870dc0-79dc7b5894-fdg2m

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-870dc0-79dc7b5894-fdg2m

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-870dc0-79dc7b5894-fdg2m

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-inf-b-870dc0-8647bd7df9-fx8pb

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd

Started

Started container istio-proxy

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-870dc0-8647bd7df9

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-870dc0-8647bd7df9-fx8pb

openshift-ingress

kubelet

payload-processing-e2e-inf-b-870dc0-8647bd7df9-fx8pb

Created

Created container: payload-processing
(x5)

openshift-ingress

kubelet

e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf

ProbeError

Startup probe error: Get "http://10.133.0.44:15021/healthz/ready": dial tcp 10.133.0.44:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf

Unhealthy

Startup probe failed: Get "http://10.133.0.44:15021/healthz/ready": dial tcp 10.133.0.44:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd

Unhealthy

Startup probe failed: Get "http://10.133.0.45:15021/healthz/ready": dial tcp 10.133.0.45:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd

ProbeError

Startup probe error: Get "http://10.133.0.45:15021/healthz/ready": dial tcp 10.133.0.45:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-7553b8c9-6f756897b7-wggbz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-7553b8c9-564cb5bfd6-m6hj9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-7553b8c9-openshift-default-7b4c66488-6r5mf

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-migrate-421f5bb0-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-421f5bb0-gw

openshift-ingress

deployment-controller

e2e-migrate-421f5bb0-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8 from 0 to 1

openshift-ingress

replicaset-controller

e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8

SuccessfulCreate

Created pod: e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s
(x5)

openshift-ingress

kubelet

e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v

ProbeError

Startup probe error: Get "http://10.133.0.46:15021/healthz/ready": dial tcp 10.133.0.46:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v

Unhealthy

Startup probe failed: Get "http://10.133.0.46:15021/healthz/ready": dial tcp 10.133.0.46:15021: connect: connection refused

openshift-ingress

multus

e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s

AddedInterface

Add eth0 [10.133.0.49/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-421f5bb0-65d75dd4f8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-421f5bb0-65d75dd4f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-421f5bb0: serviceaccount "payload-processing-e2e-migrate-421f5bb0" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-421f5bb0-598bf4ff98

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-421f5bb0-598bf4ff98-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-421f5bb0: serviceaccount "payload-processing-e2e-migrate-421f5bb0" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-421f5bb0-598bf4ff98

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-421f5bb0-598bf4ff98-mpxpg

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-421f5bb0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-421f5bb0-598bf4ff98 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-421f5bb0-65d75dd4f8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-421f5bb0-65d75dd4f8-7sxpm

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-421f5bb0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-421f5bb0-65d75dd4f8 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-migrate-421f5bb0-65d75dd4f8-7sxpm

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-421f5bb0-598bf4ff98-mpxpg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-421f5bb0-65d75dd4f8-7sxpm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-migrate-421f5bb0-598bf4ff98-mpxpg

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-421f5bb0-598bf4ff98-mpxpg

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-421f5bb0-65d75dd4f8-7sxpm

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-421f5bb0-598bf4ff98-mpxpg

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-421f5bb0-65d75dd4f8-7sxpm

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s

ProbeError

Readiness probe error: Get "http://10.133.0.49:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s

Unhealthy

Readiness probe failed: Get "http://10.133.0.49:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s

ProbeError

Startup probe error: Get "http://10.133.0.49:15021/healthz/ready": dial tcp 10.133.0.49:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s

Unhealthy

Startup probe failed: Get "http://10.133.0.49:15021/healthz/ready": dial tcp 10.133.0.49:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-migrate-421f5bb0-598bf4ff98-mpxpg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-421f5bb0-65d75dd4f8-7sxpm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-migrate-421f5bb0-gw-openshift-default-59bcbdffb8-jc79s

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ait-6dd85108

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-6dd85108

openshift-ingress

replicaset-controller

e2e-ait-6dd85108-openshift-default-74b64df5fb

SuccessfulCreate

Created pod: e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69

openshift-ingress

deployment-controller

e2e-ait-6dd85108-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-6dd85108-openshift-default-74b64df5fb from 0 to 1

openshift-ingress

multus

e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-6dd85108-f88f45cd7

SuccessfulCreate

Created pod: payload-processing-e2e-ait-6dd85108-f88f45cd7-9jj8l

openshift-ingress

deployment-controller

payload-processing-e2e-ait-6dd85108

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-6dd85108-f88f45cd7 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-6dd85108-f88f45cd7

FailedCreate

Error creating: pods "payload-processing-e2e-ait-6dd85108-f88f45cd7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-6dd85108: serviceaccount "payload-processing-e2e-ait-6dd85108" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-6dd85108

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-6dd85108-844466c854 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-6dd85108-844466c854

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-6dd85108-844466c854-msm9d
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-6dd85108-844466c854

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-6dd85108-844466c854-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-6dd85108: serviceaccount "payload-processing-e2e-ait-6dd85108" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-6dd85108-844466c854-msm9d

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-6dd85108-844466c854-msm9d

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-6dd85108-844466c854-msm9d

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-6dd85108-844466c854-msm9d

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-6dd85108-f88f45cd7-9jj8l

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-ait-6dd85108-f88f45cd7-9jj8l

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-6dd85108-f88f45cd7-9jj8l

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-6dd85108-f88f45cd7-9jj8l

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69

Started

Started container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-autores-616972-7454b64d6c-5whn4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-616972-7fc6c8588b-vjj6k

Killing

Stopping container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69

ProbeError

Startup probe error: Get "http://10.133.0.52:15021/healthz/ready": dial tcp 10.133.0.52:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69

Unhealthy

Startup probe failed: Get "http://10.133.0.52:15021/healthz/ready": dial tcp 10.133.0.52:15021: connect: connection refused

openshift-ingress

kubelet

e2e-autores-616972-openshift-default-5bdb9bbdcb-6bpxd

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-explicit-384f4f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-384f4f

openshift-ingress

deployment-controller

e2e-explicit-384f4f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-384f4f-openshift-default-57b9dddb5b from 0 to 1

openshift-ingress

replicaset-controller

e2e-explicit-384f4f-openshift-default-57b9dddb5b

SuccessfulCreate

Created pod: e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln

openshift-ingress

multus

e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln

AddedInterface

Add eth0 [10.133.0.54/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-384f4f-5fc75bd998

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-384f4f-5fc75bd998-6449v
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-384f4f-5fc75bd998

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-384f4f-5fc75bd998-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-384f4f: serviceaccount "payload-processing-e2e-explicit-384f4f" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-384f4f-7b4f8d854f

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-384f4f-7b4f8d854f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-384f4f: serviceaccount "payload-processing-e2e-explicit-384f4f" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-384f4f-7b4f8d854f

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-384f4f-7b4f8d854f-7h28k

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-384f4f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-384f4f-7b4f8d854f from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-384f4f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-384f4f-5fc75bd998 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-384f4f-5fc75bd998-6449v

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-384f4f-5fc75bd998-6449v

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-explicit-384f4f-7b4f8d854f-7h28k

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-384f4f-7b4f8d854f-7h28k

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-explicit-384f4f-5fc75bd998-6449v

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-384f4f-5fc75bd998-6449v

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-384f4f-7b4f8d854f-7h28k

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-explicit-384f4f-7b4f8d854f-7h28k

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-6dd85108-844466c854-msm9d

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ait-6dd85108

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ait-6dd85108: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ait-6dd85108": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ait-6dd85108, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 775c8a3d-898c-41c4-981a-1835cde82bba, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-ait-6dd85108-f88f45cd7-9jj8l

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-6dd85108-openshift-default-74b64df5fb-ccp69

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-derive-2fb1f7b7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-2fb1f7b7

openshift-ingress

deployment-controller

e2e-derive-2fb1f7b7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-2fb1f7b7-openshift-default-6648979bd4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-derive-2fb1f7b7-openshift-default-6648979bd4

SuccessfulCreate

Created pod: e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt

openshift-ingress

multus

e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-2fb1f7b7-bd48946c8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-2fb1f7b7-bd48946c8-t5gzx

openshift-ingress

deployment-controller

payload-processing-e2e-derive-2fb1f7b7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-2fb1f7b7-55bc45bfd5 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-2fb1f7b7-bd48946c8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-2fb1f7b7-bd48946c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-2fb1f7b7: serviceaccount "payload-processing-e2e-derive-2fb1f7b7" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-2fb1f7b7-55bc45bfd5

FailedCreate

Error creating: pods "payload-processing-e2e-derive-2fb1f7b7-55bc45bfd5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-2fb1f7b7: serviceaccount "payload-processing-e2e-derive-2fb1f7b7" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-2fb1f7b7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-2fb1f7b7-bd48946c8 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-derive-2fb1f7b7-55bc45bfd5-tk7zh

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-2fb1f7b7-bd48946c8-t5gzx

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-2fb1f7b7-55bc45bfd5-tk7zh

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-2fb1f7b7-55bc45bfd5-tk7zh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-2fb1f7b7-bd48946c8-t5gzx

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-2fb1f7b7-55bc45bfd5-tk7zh

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-2fb1f7b7-55bc45bfd5

SuccessfulCreate

Created pod: payload-processing-e2e-derive-2fb1f7b7-55bc45bfd5-tk7zh

openshift-ingress

multus

payload-pre-processing-e2e-derive-2fb1f7b7-bd48946c8-t5gzx

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-2fb1f7b7-bd48946c8-t5gzx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln

Unhealthy

Startup probe failed: Get "http://10.133.0.54:15021/healthz/ready": dial tcp 10.133.0.54:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln

ProbeError

Startup probe error: Get "http://10.133.0.54:15021/healthz/ready": dial tcp 10.133.0.54:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt

Unhealthy

Startup probe failed: Get "http://10.133.0.55:15021/healthz/ready": dial tcp 10.133.0.55:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt

ProbeError

Startup probe error: Get "http://10.133.0.55:15021/healthz/ready": dial tcp 10.133.0.55:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-derive-2fb1f7b7-55bc45bfd5-tk7zh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-2fb1f7b7-bd48946c8-t5gzx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-2fb1f7b7-openshift-default-6648979bd4-rsmjt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-explicit-384f4f-7b4f8d854f-7h28k

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-384f4f-5fc75bd998-6449v

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-384f4f-7b4f8d854f-7h28k

Unhealthy

Readiness probe failed: dial tcp 10.134.0.51:9004: i/o timeout

openshift-ingress

deployment-controller

e2e-noten-56547c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-56547c-openshift-default-5496d9b88d from 0 to 1

openshift-ingress

replicaset-controller

e2e-noten-56547c-openshift-default-5496d9b88d

SuccessfulCreate

Created pod: e2e-noten-56547c-openshift-default-5496d9b88d-hw4bq

openshift-ingress

gateway_labeler_controller

e2e-noten-56547c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-56547c

openshift-ingress

kubelet

e2e-explicit-384f4f-openshift-default-57b9dddb5b-qvdln

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-noten-56547c-openshift-default-5496d9b88d-hw4bq

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

e2e-noten-56547c-openshift-default-5496d9b88d-hw4bq

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-56547c-openshift-default-5496d9b88d-hw4bq

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-noten-56547c-openshift-default-5496d9b88d-hw4bq

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-noten-56547c-openshift-default-5496d9b88d-hw4bq

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 3.017s (3.017s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

e2e-noten-56547c-openshift-default-5496d9b88d-hw4bq

Unhealthy

Startup probe failed: Get "http://10.134.0.57:15021/healthz/ready": dial tcp 10.134.0.57:15021: connect: connection refused

openshift-ingress

kubelet

e2e-noten-56547c-openshift-default-5496d9b88d-hw4bq

ProbeError

Startup probe error: Get "http://10.134.0.57:15021/healthz/ready": dial tcp 10.134.0.57:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-noten-56547c-openshift-default-5496d9b88d-hw4bq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-inf-a-ff43b8-5db6656b55-59r5r

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-ff43b8-666b566bdb-47dxf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-a-ff43b8-openshift-default-78dd55d8f6-lnrlt

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

gateway_labeler_controller

e2e-mt-a69d4afb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-a69d4afb

openshift-ingress

deployment-controller

e2e-mt-a69d4afb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-a69d4afb-openshift-default-6db69967c6 from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-a69d4afb-openshift-default-6db69967c6

SuccessfulCreate

Created pod: e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-870dc0-79dc7b5894-fdg2m

Killing

Stopping container payload-pre-processing

openshift-ingress

multus

e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-870dc0-8647bd7df9-fx8pb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-a69d4afb-c88868754-kg6z7

Created

Created container: payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-a69d4afb-c88868754

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-a69d4afb-c88868754-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-a69d4afb: serviceaccount "payload-processing-e2e-mt-a69d4afb" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-a69d4afb-5fbfcfbddf

FailedCreate

Error creating: pods "payload-processing-e2e-mt-a69d4afb-5fbfcfbddf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-a69d4afb: serviceaccount "payload-processing-e2e-mt-a69d4afb" not found

openshift-ingress

kubelet

payload-processing-e2e-mt-a69d4afb-5fbfcfbddf-m2s2h

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-a69d4afb-5fbfcfbddf-m2s2h

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-a69d4afb-5fbfcfbddf-m2s2h

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-a69d4afb-5fbfcfbddf-m2s2h

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-mt-a69d4afb-c88868754-kg6z7

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-a69d4afb-c88868754-kg6z7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-mt-a69d4afb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-a69d4afb-5fbfcfbddf from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-a69d4afb-c88868754

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-a69d4afb-c88868754-kg6z7

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-a69d4afb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-a69d4afb-c88868754 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-a69d4afb-5fbfcfbddf

SuccessfulCreate

Created pod: payload-processing-e2e-mt-a69d4afb-5fbfcfbddf-m2s2h

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-a69d4afb-c88868754-kg6z7

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-a-w3-a4942b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-a4942b-openshift-default-65d8854976 from 0 to 1

openshift-ingress

multus

e2e-shared-a-w3-a4942b-openshift-default-65d8854976-sjgdt

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-a-w3-a4942b-openshift-default-65d8854976

SuccessfulCreate

Created pod: e2e-shared-a-w3-a4942b-openshift-default-65d8854976-sjgdt

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-a4942b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-a4942b

openshift-ingress

kubelet

e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-b-870dc0-openshift-default-68b7745584-zn95v

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-a4942b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-a4942b-779bc57c4c from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-a4942b-75d6cd9dcd-2s6b8

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-a4942b-779bc57c4c-vjknz

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-a4942b-779bc57c4c-vjknz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-a4942b-779bc57c4c-vjknz

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-a4942b-75d6cd9dcd-2s6b8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-a4942b-779bc57c4c-vjknz

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-a4942b-75d6cd9dcd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-a4942b-75d6cd9dcd-2s6b8

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-a4942b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-a4942b-75d6cd9dcd from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-a4942b-75d6cd9dcd-2s6b8

Created

Created container: payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-a4942b-779bc57c4c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-a4942b-779bc57c4c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-a4942b: serviceaccount "payload-processing-e2e-shared-a-w3-a4942b" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-a4942b-779bc57c4c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-a4942b-779bc57c4c-vjknz

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-a4942b-75d6cd9dcd-2s6b8

Started

Started container payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-a4942b-75d6cd9dcd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-a4942b-75d6cd9dcd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-a4942b: serviceaccount "payload-processing-e2e-shared-a-w3-a4942b" not found

openshift-ingress

kubelet

e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s

Unhealthy

Readiness probe failed: Get "http://10.133.0.58:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s

ProbeError

Readiness probe error: Get "http://10.133.0.58:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s

Unhealthy

Startup probe failed: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s

ProbeError

Startup probe error: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-a4942b-openshift-default-65d8854976-sjgdt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-a4942b-openshift-default-65d8854976-sjgdt

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-a4942b-openshift-default-65d8854976-sjgdt

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-a4942b-openshift-default-65d8854976-sjgdt

ProbeError

Readiness probe error: Get "http://10.134.0.62:15021/healthz/ready": read tcp 10.134.0.2:36978->10.134.0.62:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-shared-a-w3-a4942b-openshift-default-65d8854976-sjgdt

Unhealthy

Readiness probe failed: Get "http://10.134.0.62:15021/healthz/ready": read tcp 10.134.0.2:36978->10.134.0.62:15021: read: connection reset by peer
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-a4942b-openshift-default-65d8854976-sjgdt

ProbeError

Startup probe error: Get "http://10.134.0.62:15021/healthz/ready": dial tcp 10.134.0.62:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-a4942b-openshift-default-65d8854976-sjgdt

Unhealthy

Startup probe failed: Get "http://10.134.0.62:15021/healthz/ready": dial tcp 10.134.0.62:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-823397

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-823397

openshift-ingress

replicaset-controller

e2e-shared-b-w3-823397-openshift-default-d75778794

SuccessfulCreate

Created pod: e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z

openshift-ingress

deployment-controller

e2e-shared-b-w3-823397-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-823397-openshift-default-d75778794 from 0 to 1

openshift-ingress

multus

e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-823397-77b7bc5d8f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-823397-77b7bc5d8f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-823397: serviceaccount "payload-processing-e2e-shared-b-w3-823397" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-823397

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-823397-77b7bc5d8f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-823397-77b7bc5d8f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-823397-77b7bc5d8f-zl764

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-823397

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-823397-644fb758 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-823397-644fb758

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-823397-644fb758-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-823397: serviceaccount "payload-processing-e2e-shared-b-w3-823397" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-823397-644fb758

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-823397-644fb758-nk8nh

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-823397-644fb758-nk8nh

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-823397-77b7bc5d8f-zl764

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-823397-644fb758-nk8nh

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-823397-77b7bc5d8f-zl764

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-823397-77b7bc5d8f-zl764

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-823397-77b7bc5d8f-zl764

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-823397-644fb758-nk8nh

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-823397-644fb758-nk8nh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-mt-a69d4afb

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-mt-a69d4afb: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-mt-a69d4afb": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-mt-a69d4afb, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 7f02cee9-ec3c-40cd-a7db-8ce6370adf9c, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-mt-a69d4afb-5fbfcfbddf-m2s2h

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-a69d4afb-c88868754-kg6z7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-a69d4afb-openshift-default-6db69967c6-f6k4s

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z

Unhealthy

Startup probe failed: Get "http://10.133.0.60:15021/healthz/ready": dial tcp 10.133.0.60:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z

ProbeError

Startup probe error: Get "http://10.133.0.60:15021/healthz/ready": dial tcp 10.133.0.60:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-5a3b57

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-5a3b57

openshift-ingress

deployment-controller

e2e-shared-a-w2-5a3b57-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88

SuccessfulCreate

Created pod: e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr

openshift-ingress

multus

e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr

AddedInterface

Add eth0 [10.133.0.61/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-5a3b57-7ffb667df4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-5a3b57-7ffb667df4-wx6gg

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-5a3b57-769fcf87d7

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-5a3b57-769fcf87d7-xcvsf

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-5a3b57

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-5a3b57-7ffb667df4 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-5a3b57-769fcf87d7

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-5a3b57-769fcf87d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-5a3b57: serviceaccount "payload-processing-e2e-shared-a-w2-5a3b57" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-5a3b57

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-5a3b57-769fcf87d7 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-5a3b57-7ffb667df4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-5a3b57-7ffb667df4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-5a3b57: serviceaccount "payload-processing-e2e-shared-a-w2-5a3b57" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-5a3b57-769fcf87d7-xcvsf

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-5a3b57-7ffb667df4-wx6gg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-5a3b57-7ffb667df4-wx6gg

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-5a3b57-769fcf87d7-xcvsf

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-5a3b57-7ffb667df4-wx6gg

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-5a3b57-769fcf87d7-xcvsf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-5a3b57-7ffb667df4-wx6gg

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-5a3b57-769fcf87d7-xcvsf

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr

ProbeError

Readiness probe error: Get "http://10.133.0.61:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr

Unhealthy

Readiness probe failed: Get "http://10.133.0.61:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr

ProbeError

Startup probe error: Get "http://10.133.0.61:15021/healthz/ready": dial tcp 10.133.0.61:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr

Unhealthy

Startup probe failed: Get "http://10.133.0.61:15021/healthz/ready": dial tcp 10.133.0.61:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-b0b77f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-b0b77f

openshift-ingress

deployment-controller

e2e-shared-b-w2-b0b77f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-b0b77f-openshift-default-69994974bd from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w2-b0b77f-openshift-default-69994974bd

SuccessfulCreate

Created pod: e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf

openshift-ingress

multus

e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf

AddedInterface

Add eth0 [10.133.0.64/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-b0b77f-6bd9859c86

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-b0b77f-6bd9859c86-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-b0b77f: serviceaccount "payload-processing-e2e-shared-b-w2-b0b77f" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-b0b77f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-b0b77f-6bd9859c86 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-b0b77f-6bd9859c86

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-b0b77f-6bd9859c86-mk4bc
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-b0b77f-84f684d55

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-b0b77f-84f684d55-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-b0b77f: serviceaccount "payload-processing-e2e-shared-b-w2-b0b77f" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-b0b77f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-b0b77f-84f684d55 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-b0b77f-84f684d55

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-b0b77f-84f684d55-ptfpt

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-b0b77f-84f684d55-ptfpt

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-b0b77f-84f684d55-ptfpt

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-b0b77f-84f684d55-ptfpt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-b0b77f-6bd9859c86-mk4bc

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-b0b77f-6bd9859c86-mk4bc

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-b0b77f-6bd9859c86-mk4bc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-b0b77f-6bd9859c86-mk4bc

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-b0b77f-84f684d55-ptfpt

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf

ProbeError

Startup probe error: Get "http://10.133.0.64:15021/healthz/ready": dial tcp 10.133.0.64:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf

Unhealthy

Startup probe failed: Get "http://10.133.0.64:15021/healthz/ready": dial tcp 10.133.0.64:15021: connect: connection refused

openshift-ingress

multus

e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd

AddedInterface

Add eth0 [10.133.0.69/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-mt-b16e488f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-b16e488f-openshift-default-7c668f68c6 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-b16e488f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-b16e488f

openshift-ingress

replicaset-controller

e2e-mt-b16e488f-openshift-default-7c668f68c6

SuccessfulCreate

Created pod: e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-b16e488f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-b16e488f-6b675544cd from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-b16e488f-559cf656bf

SuccessfulCreate

Created pod: payload-processing-e2e-mt-b16e488f-559cf656bf-98zd4

openshift-ingress

deployment-controller

payload-processing-e2e-mt-b16e488f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-b16e488f-559cf656bf from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-b16e488f-559cf656bf

FailedCreate

Error creating: pods "payload-processing-e2e-mt-b16e488f-559cf656bf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-b16e488f: serviceaccount "payload-processing-e2e-mt-b16e488f" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-b16e488f-6b675544cd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-b16e488f-6b675544cd-8f5fz
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-b16e488f-6b675544cd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-b16e488f-6b675544cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-b16e488f: serviceaccount "payload-processing-e2e-mt-b16e488f" not found

openshift-ingress

multus

payload-pre-processing-e2e-mt-b16e488f-6b675544cd-8f5fz

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-mt-b16e488f-559cf656bf-98zd4

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-b16e488f-559cf656bf-98zd4

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-b16e488f-6b675544cd-8f5fz

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-b16e488f-559cf656bf-98zd4

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-b16e488f-559cf656bf-98zd4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-b16e488f-6b675544cd-8f5fz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-b16e488f-6b675544cd-8f5fz

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd

Unhealthy

Startup probe failed: Get "http://10.133.0.69:15021/healthz/ready": dial tcp 10.133.0.69:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd

ProbeError

Startup probe error: Get "http://10.133.0.69:15021/healthz/ready": dial tcp 10.133.0.69:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-mt-b16e488f-559cf656bf-98zd4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-b16e488f-6b675544cd-8f5fz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-b16e488f-openshift-default-7c668f68c6-g24cd

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-api-a-61f413

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-61f413

openshift-ingress

replicaset-controller

e2e-api-a-61f413-openshift-default-c9445fd78

SuccessfulCreate

Created pod: e2e-api-a-61f413-openshift-default-c9445fd78-btsns

openshift-ingress

multus

e2e-api-a-61f413-openshift-default-c9445fd78-btsns

AddedInterface

Add eth0 [10.133.0.74/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-api-a-61f413-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-61f413-openshift-default-c9445fd78 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-61f413

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-61f413-676968d9cd from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-61f413

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-61f413-7f54488789 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-a-61f413-7f54488789-jpw68

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-61f413-676968d9cd-x8vfv

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-a-61f413-676968d9cd-x8vfv

AddedInterface

Add eth0 [10.132.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-61f413-676968d9cd-x8vfv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-61f413-7f54488789

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-61f413-7f54488789-jpw68
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-61f413-7f54488789

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-61f413-7f54488789-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-61f413: serviceaccount "payload-processing-e2e-api-a-61f413" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-61f413-676968d9cd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-61f413-676968d9cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-61f413: serviceaccount "payload-processing-e2e-api-a-61f413" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-61f413-676968d9cd-x8vfv

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-api-a-61f413-7f54488789-jpw68

AddedInterface

Add eth0 [10.132.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-61f413-7f54488789-jpw68

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-61f413-676968d9cd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-61f413-676968d9cd-x8vfv

openshift-ingress

kubelet

payload-processing-e2e-api-a-61f413-7f54488789-jpw68

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-api-a-61f413-openshift-default-c9445fd78-btsns

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-61f413-openshift-default-c9445fd78-btsns

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-61f413-openshift-default-c9445fd78-btsns

Started

Started container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-api-b-f2ae08

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-f2ae08

openshift-ingress

deployment-controller

e2e-api-b-f2ae08-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-f2ae08-openshift-default-64847cc5fd from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-f2ae08-openshift-default-64847cc5fd

SuccessfulCreate

Created pod: e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97

openshift-ingress

multus

e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97

AddedInterface

Add eth0 [10.133.0.79/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-api-a-61f413-openshift-default-c9445fd78-btsns

ProbeError

Startup probe error: Get "http://10.133.0.74:15021/healthz/ready": dial tcp 10.133.0.74:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-a-61f413-openshift-default-c9445fd78-btsns

Unhealthy

Startup probe failed: Get "http://10.133.0.74:15021/healthz/ready": dial tcp 10.133.0.74:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-f2ae08-5fbff9ddf8-cbk7l

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-f2ae08-5fbff9ddf8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-f2ae08-5fbff9ddf8-cbk7l

openshift-ingress

multus

payload-pre-processing-e2e-api-b-f2ae08-5fbff9ddf8-cbk7l

AddedInterface

Add eth0 [10.134.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-f2ae08-5fbff9ddf8-cbk7l

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-f2ae08-5fbff9ddf8-cbk7l

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-f2ae08

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-f2ae08-5b55b95469 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-f2ae08-5b55b95469

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-f2ae08-5b55b95469-ztq7w
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-f2ae08-5b55b95469

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-f2ae08-5b55b95469-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-f2ae08: serviceaccount "payload-processing-e2e-api-b-f2ae08" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-f2ae08-5fbff9ddf8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-f2ae08-5fbff9ddf8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-f2ae08: serviceaccount "payload-processing-e2e-api-b-f2ae08" not found

openshift-ingress

kubelet

payload-processing-e2e-api-b-f2ae08-5b55b95469-ztq7w

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-f2ae08-5b55b95469-ztq7w

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-f2ae08-5b55b95469-ztq7w

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-api-b-f2ae08-5b55b95469-ztq7w

AddedInterface

Add eth0 [10.134.0.75/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-f2ae08

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-f2ae08-5fbff9ddf8 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97

Unhealthy

Startup probe failed: Get "http://10.133.0.79:15021/healthz/ready": dial tcp 10.133.0.79:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97

ProbeError

Startup probe error: Get "http://10.133.0.79:15021/healthz/ready": dial tcp 10.133.0.79:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-61f413-676968d9cd-x8vfv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-61f413-7f54488789-jpw68

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-a-61f413-openshift-default-c9445fd78-btsns

Killing

Stopping container istio-proxy

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-api-b-f2ae08

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-api-b-f2ae08: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-api-b-f2ae08": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-api-b-f2ae08, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 5658458e-f50b-4077-b955-5227d028212e, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-api-b-f2ae08-5b55b95469-ztq7w

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-f2ae08-5fbff9ddf8-cbk7l

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-b-f2ae08-openshift-default-64847cc5fd-6zg97

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

e2e-ipp-a-55a703-openshift-default-6b467575d4

SuccessfulCreate

Created pod: e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8

openshift-ingress

deployment-controller

e2e-ipp-a-55a703-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-55a703-openshift-default-6b467575d4 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-55a703

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-55a703

openshift-ingress

multus

e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8

AddedInterface

Add eth0 [10.133.0.85/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-55a703-69c6c569fd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-55a703-69c6c569fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-55a703: serviceaccount "payload-processing-e2e-ipp-a-55a703" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-55a703

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-55a703-789cf7579 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-55a703-789cf7579

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-55a703-789cf7579-g92b6
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-55a703-789cf7579

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-55a703-789cf7579-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-55a703: serviceaccount "payload-processing-e2e-ipp-a-55a703" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-55a703-69c6c569fd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-55a703-69c6c569fd-qvbxk

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-55a703

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-55a703-69c6c569fd from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-55a703-69c6c569fd-qvbxk

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-55a703-69c6c569fd-qvbxk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-55a703-789cf7579-g92b6

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-55a703-69c6c569fd-qvbxk

AddedInterface

Add eth0 [10.132.0.67/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-a-55a703-789cf7579-g92b6

AddedInterface

Add eth0 [10.132.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-55a703-789cf7579-g92b6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-55a703-789cf7579-g92b6

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-55a703-69c6c569fd-qvbxk

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-5a3b57-769fcf87d7-xcvsf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-5a3b57-7ffb667df4-wx6gg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w2-5a3b57-openshift-default-7759df5b88-v2hpr

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8

Created

Created container: istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-b0b77f-84f684d55-ptfpt

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-b-w2-b0b77f

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-b-w2-b0b77f: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-b-w2-b0b77f": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-b-w2-b0b77f, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 46aead1e-c6c6-4c50-bc72-c2043c2fa3e0, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-b0b77f-6bd9859c86-mk4bc

Killing

Stopping container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8

ProbeError

Startup probe error: Get "http://10.133.0.85:15021/healthz/ready": dial tcp 10.133.0.85:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-ipp-b-e30975-openshift-default-f898c84b6

SuccessfulCreate

Created pod: e2e-ipp-b-e30975-openshift-default-f898c84b6-smrnz

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-e30975

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-e30975
(x5)

openshift-ingress

kubelet

e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8

Unhealthy

Startup probe failed: Get "http://10.133.0.85:15021/healthz/ready": dial tcp 10.133.0.85:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-ipp-b-e30975-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-e30975-openshift-default-f898c84b6 from 0 to 1

openshift-ingress

multus

e2e-ipp-b-e30975-openshift-default-f898c84b6-smrnz

AddedInterface

Add eth0 [10.133.0.87/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w2-b0b77f-openshift-default-69994974bd-dn6jf

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-e30975-5c9ffb87f7

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-e30975-5c9ffb87f7-vxxgn

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-e30975-84cb54bb4b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-e30975-84cb54bb4b-x8rxn

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-e30975

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-e30975-5c9ffb87f7 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-e30975

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-e30975-84cb54bb4b from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-e30975-84cb54bb4b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-e30975-84cb54bb4b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-e30975: serviceaccount "payload-processing-e2e-ipp-b-e30975" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-e30975-5c9ffb87f7

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-e30975-5c9ffb87f7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-e30975: serviceaccount "payload-processing-e2e-ipp-b-e30975" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-e30975-84cb54bb4b-x8rxn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-e30975-84cb54bb4b-x8rxn

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-e30975-84cb54bb4b-x8rxn

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-e30975-84cb54bb4b-x8rxn

AddedInterface

Add eth0 [10.134.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-e30975-5c9ffb87f7-vxxgn

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-e30975-5c9ffb87f7-vxxgn

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-e30975-5c9ffb87f7-vxxgn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-b-e30975-5c9ffb87f7-vxxgn

AddedInterface

Add eth0 [10.134.0.77/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-b-e30975-openshift-default-f898c84b6-smrnz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-e30975-openshift-default-f898c84b6-smrnz

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-e30975-openshift-default-f898c84b6-smrnz

Created

Created container: istio-proxy
(x4)

openshift-ingress

kubelet

e2e-ipp-b-e30975-openshift-default-f898c84b6-smrnz

Unhealthy

Startup probe failed: Get "http://10.133.0.87:15021/healthz/ready": dial tcp 10.133.0.87:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-ipp-b-e30975-openshift-default-f898c84b6-smrnz

ProbeError

Startup probe error: Get "http://10.133.0.87:15021/healthz/ready": dial tcp 10.133.0.87:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-804182

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-804182

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-804182-openshift-default-56dcd5695d

SuccessfulCreate

Created pod: e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv

openshift-ingress

deployment-controller

e2e-ipp-cleanup-804182-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-804182-openshift-default-56dcd5695d from 0 to 1

openshift-ingress

multus

e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv

AddedInterface

Add eth0 [10.133.0.89/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-804182

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-804182-fb467896b from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-804182-6cddfdd757

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-804182-6cddfdd757-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-804182: serviceaccount "payload-processing-e2e-ipp-cleanup-804182" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-804182-6cddfdd757

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-804182-6cddfdd757-8s9z2

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-804182

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-804182-6cddfdd757 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-804182-fb467896b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-804182-fb467896b-qstrc
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-804182-fb467896b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-804182-fb467896b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-804182: serviceaccount "payload-processing-e2e-ipp-cleanup-804182" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-804182-fb467896b-qstrc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-804182-fb467896b-qstrc

AddedInterface

Add eth0 [10.134.0.79/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-804182-6cddfdd757-8s9z2

AddedInterface

Add eth0 [10.134.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-804182-fb467896b-qstrc

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-804182-6cddfdd757-8s9z2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-804182-6cddfdd757-8s9z2

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-804182-6cddfdd757-8s9z2

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-804182-fb467896b-qstrc

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv

ProbeError

Readiness probe error: Get "http://10.133.0.89:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv

Unhealthy

Readiness probe failed: Get "http://10.133.0.89:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-804182-6cddfdd757-8s9z2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-804182-fb467896b-qstrc

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv

ProbeError

Startup probe error: Get "http://10.133.0.89:15021/healthz/ready": dial tcp 10.133.0.89:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-ipp-cleanup-804182-openshift-default-56dcd5695d-jdfqv

Unhealthy

Startup probe failed: Get "http://10.133.0.89:15021/healthz/ready": dial tcp 10.133.0.89:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-55a703-69c6c569fd-qvbxk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-55a703-789cf7579-g92b6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-55a703-openshift-default-6b467575d4-xzmr8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-e30975-84cb54bb4b-x8rxn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-e30975-5c9ffb87f7-vxxgn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-e30975-openshift-default-f898c84b6-smrnz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-a4942b-75d6cd9dcd-2s6b8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-a4942b-779bc57c4c-vjknz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w3-a4942b-openshift-default-65d8854976-sjgdt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-a4942b-openshift-default-65d8854976-sjgdt

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w3-a4942b-openshift-default-65d8854976-sjgdt

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-823397-77b7bc5d8f-zl764

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-823397-644fb758-nk8nh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w3-823397-openshift-default-d75778794-rr27z

Killing

Stopping container istio-proxy