Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-processing-e2e-ipp-cleanup-8fa57c-6fb987f4d7-6kvq6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-8fa57c-6fb987f4d7-6kvq6 to ip-10-0-139-235.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-f4de10-857b967875-n67cq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-f4de10-857b967875-n67cq to ip-10-0-139-235.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-6745bb66bc2sgf6

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc2sgf6 to ip-10-0-138-14.ec2.internal

openshift-ingress

e2e-mt-6f69f6e6-openshift-default-697758b5bd-xdb9b

Scheduled

Successfully assigned openshift-ingress/e2e-mt-6f69f6e6-openshift-default-697758b5bd-xdb9b to ip-10-0-142-82.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-9516b91d-754f94ffd6-m927q

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-9516b91d-754f94ffd6-m927q to ip-10-0-139-235.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-fd82e780-688877958b-mb2rw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-fd82e780-688877958b-mb2rw to ip-10-0-139-235.ec2.internal

openshift-ingress

e2e-migrate-0b6ae428-gw-openshift-default-66845cc4d-h4kjv

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-0b6ae428-gw-openshift-default-66845cc4d-h4kjv to ip-10-0-142-82.ec2.internal

openshift-ingress

payload-processing-e2e-mt-ef3c90aa-59c4f7db7c-5mfmf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-ef3c90aa-59c4f7db7c-5mfmf to ip-10-0-139-235.ec2.internal

openshift-ingress

e2e-mt-ef3c90aa-openshift-default-7b99494568-djzbg

Scheduled

Successfully assigned openshift-ingress/e2e-mt-ef3c90aa-openshift-default-7b99494568-djzbg to ip-10-0-138-14.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-f72st

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-f72st to ip-10-0-138-14.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-f729f8-57b47d7b6-7brc8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-f729f8-57b47d7b6-7brc8 to ip-10-0-139-235.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-cbjdn

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-cbjdn to ip-10-0-138-14.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-76bb56-85f969dc7-r9w54

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-76bb56-85f969dc7-r9w54 to ip-10-0-142-82.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-e98d1e-65864c5fb5-ggszd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-e98d1e-65864c5fb5-ggszd to ip-10-0-139-235.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-be588a-6cdffc5cf8-xnhx6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-be588a-6cdffc5cf8-xnhx6 to ip-10-0-139-235.ec2.internal

openshift-ingress

e2e-ipp-cleanup-8fa57c-openshift-default-c8f44bf68-zq7q7

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-8fa57c-openshift-default-c8f44bf68-zq7q7 to ip-10-0-138-14.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-987d60-78c8b64f6f-hws9z

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-987d60-78c8b64f6f-hws9z to ip-10-0-142-82.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-2c1e69-6cd8cbffb6-k5pwp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-2c1e69-6cd8cbffb6-k5pwp to ip-10-0-139-235.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-d6e26b-78d4d6b489-jq8ct

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-d6e26b-78d4d6b489-jq8ct to ip-10-0-139-235.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-4f6824-68859fc547-47gtd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-4f6824-68859fc547-47gtd to ip-10-0-139-235.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-6573d049-69dfd459bb-cmfnr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-6573d049-69dfd459bb-cmfnr to ip-10-0-139-235.ec2.internal

openshift-ingress

e2e-ait-9516b91d-openshift-default-76cb6c78d6-q9c5b

Scheduled

Successfully assigned openshift-ingress/e2e-ait-9516b91d-openshift-default-76cb6c78d6-q9c5b to ip-10-0-142-82.ec2.internal

openshift-ingress

e2e-ipp-b-40f90a-openshift-default-c6dc47dc6-kr8vj

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-40f90a-openshift-default-c6dc47dc6-kr8vj to ip-10-0-142-82.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-987d60-5d8998b46b-gbljd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-987d60-5d8998b46b-gbljd to ip-10-0-139-235.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-e98d1e-98bcf4-brhgp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-e98d1e-98bcf4-brhgp to ip-10-0-139-235.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-cd176e-79cc7879f4-tg9wg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-cd176e-79cc7879f4-tg9wg to ip-10-0-139-235.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-b9930f-6cbdc6f967-879w7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-b9930f-6cbdc6f967-879w7 to ip-10-0-142-82.ec2.internal

openshift-ingress

e2e-worker-w0-f4de10-openshift-default-7d6bb4864-hqmb9

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-f4de10-openshift-default-7d6bb4864-hqmb9 to ip-10-0-138-14.ec2.internal

openshift-ingress

e2e-shared-b-w3-b9930f-openshift-default-5cc6ff4964-q6qbb

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-b9930f-openshift-default-5cc6ff4964-q6qbb to ip-10-0-138-14.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-10a215-d478dc4dc-twwq2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-10a215-d478dc4dc-twwq2 to ip-10-0-142-82.ec2.internal

openshift-ingress

e2e-noten-4ec6e9-openshift-default-788667c47b-9ts4s

Scheduled

Successfully assigned openshift-ingress/e2e-noten-4ec6e9-openshift-default-788667c47b-9ts4s to ip-10-0-138-14.ec2.internal

openshift-ingress

e2e-worker-w4-cd176e-openshift-default-7fdc756776-m5cdj

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-cd176e-openshift-default-7fdc756776-m5cdj to ip-10-0-138-14.ec2.internal

openshift-ingress

e2e-ait-fd82e780-openshift-default-69744654bd-d295j

Scheduled

Successfully assigned openshift-ingress/e2e-ait-fd82e780-openshift-default-69744654bd-d295j to ip-10-0-142-82.ec2.internal

openshift-ingress

kube-auth-proxy-58fc6d6988-dvf8m

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-58fc6d6988-dvf8m to ip-10-0-139-235.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w4-cd176e-fb97d86c5-4z2c5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-cd176e-fb97d86c5-4z2c5 to ip-10-0-142-82.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-c1edc6-7c6f5584df-f5pkt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-c1edc6-7c6f5584df-f5pkt to ip-10-0-139-235.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-40f90a-6b7f8c5df9-fpjwc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-40f90a-6b7f8c5df9-fpjwc to ip-10-0-139-235.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-f4de10-977ff8d6-6g49f

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-f4de10-977ff8d6-6g49f to ip-10-0-139-235.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-dxdkg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-dxdkg to ip-10-0-139-235.ec2.internal

openshift-ingress

e2e-shared-b-w2-4f6824-openshift-default-fcb676cb4-d7lxx

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-4f6824-openshift-default-fcb676cb4-d7lxx to ip-10-0-142-82.ec2.internal

openshift-ingress

e2e-explicit-987d60-openshift-default-6768b96b4d-qns7n

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-987d60-openshift-default-6768b96b4d-qns7n to ip-10-0-142-82.ec2.internal

openshift-ingress

e2e-shared-a-w2-76bb56-openshift-default-54985b7cfd-2pm67

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-76bb56-openshift-default-54985b7cfd-2pm67 to ip-10-0-138-14.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-t27rf

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-t27rf to ip-10-0-138-14.ec2.internal

openshift-ingress

kube-auth-proxy-58fc6d6988-7j7gd

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-58fc6d6988-7j7gd to ip-10-0-138-14.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-10a215-6bf5478bc4-z948j

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-10a215-6bf5478bc4-z948j to ip-10-0-139-235.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-qrb6l

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-qrb6l to ip-10-0-138-14.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-0b6ae428-d9c99cfd-pgz6v

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-0b6ae428-d9c99cfd-pgz6v to ip-10-0-139-235.ec2.internal

openshift-ingress

e2e-api-a-f729f8-openshift-default-86f7f474dd-vghhn

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-f729f8-openshift-default-86f7f474dd-vghhn to ip-10-0-142-82.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-c1edc6-86d99bdbf8-8hhms

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-c1edc6-86d99bdbf8-8hhms to ip-10-0-139-235.ec2.internal

openshift-ingress

payload-processing-e2e-derive-6573d049-788d8d7cdf-v2zxr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-6573d049-788d8d7cdf-v2zxr to ip-10-0-139-235.ec2.internal

openshift-ingress

e2e-inf-b-10a215-openshift-default-6d646bd59b-98jhh

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-10a215-openshift-default-6d646bd59b-98jhh to ip-10-0-138-14.ec2.internal

openshift-ingress

e2e-shared-a-w3-d6e26b-openshift-default-6c8cd59c7d-blspp

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-d6e26b-openshift-default-6c8cd59c7d-blspp to ip-10-0-138-14.ec2.internal

openshift-ingress

e2e-inf-a-e98d1e-openshift-default-995569d9d-lrzsm

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-e98d1e-openshift-default-995569d9d-lrzsm to ip-10-0-138-14.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-40f90a-58cb6f886b-xmwmb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-40f90a-58cb6f886b-xmwmb to ip-10-0-139-235.ec2.internal

openshift-ingress

e2e-api-b-be588a-openshift-default-8f67f9ccb-ntqhz

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-be588a-openshift-default-8f67f9ccb-ntqhz to ip-10-0-142-82.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-vwx5p

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vwx5p to ip-10-0-139-235.ec2.internal

openshift-ingress

payload-processing-e2e-mt-6f69f6e6-79bf759489-llzpv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-6f69f6e6-79bf759489-llzpv to ip-10-0-142-82.ec2.internal

openshift-ingress

payload-processing-e2e-autores-2c1e69-6ff7b679df-nvthr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-2c1e69-6ff7b679df-nvthr to ip-10-0-139-235.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-be588a-65d9794cf-9b2d7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-be588a-65d9794cf-9b2d7 to ip-10-0-139-235.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-f729f8-fbb9d5d9f-dhb4r

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-f729f8-fbb9d5d9f-dhb4r to ip-10-0-139-235.ec2.internal

openshift-ingress

router-default-6994df4f88-cwhzx

Scheduled

Successfully assigned openshift-ingress/router-default-6994df4f88-cwhzx to ip-10-0-142-82.ec2.internal

openshift-ingress

router-default-6994df4f88-cwhzx

FailedScheduling

0/1 nodes are available: 1 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-8fa57c-54dc9bcbb-cjklq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8fa57c-54dc9bcbb-cjklq to ip-10-0-142-82.ec2.internal

openshift-ingress

e2e-ipp-a-c1edc6-openshift-default-6c98cd4f94-lq27w

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-c1edc6-openshift-default-6c98cd4f94-lq27w to ip-10-0-142-82.ec2.internal

openshift-ingress

payload-processing-e2e-ait-fd82e780-687dbc8bc5-zpj47

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-fd82e780-687dbc8bc5-zpj47 to ip-10-0-139-235.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-0b6ae428-7f54bc76c4-s27dn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-0b6ae428-7f54bc76c4-s27dn to ip-10-0-139-235.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-6f69f6e6-55f997794-7s9fv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-6f69f6e6-55f997794-7s9fv to ip-10-0-139-235.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-ef3c90aa-57d456c986-xx76b

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-ef3c90aa-57d456c986-xx76b to ip-10-0-142-82.ec2.internal

openshift-ingress

e2e-autores-2c1e69-openshift-default-5994fd4578-7wnbr

Scheduled

Successfully assigned openshift-ingress/e2e-autores-2c1e69-openshift-default-5994fd4578-7wnbr to ip-10-0-138-14.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-76bb56-5cdb6ffcc8-ntrpk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-76bb56-5cdb6ffcc8-ntrpk to ip-10-0-142-82.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-d6e26b-64f4dc94fd-ckm8g

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-d6e26b-64f4dc94fd-ckm8g to ip-10-0-139-235.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-b9930f-cb59bb98b-p7ndh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-b9930f-cb59bb98b-p7ndh to ip-10-0-139-235.ec2.internal

openshift-ingress

payload-processing-e2e-ait-9516b91d-7cfd4dc57-kvdfc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-9516b91d-7cfd4dc57-kvdfc to ip-10-0-139-235.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-4f6824-647f95d65d-kflvl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-4f6824-647f95d65d-kflvl to ip-10-0-139-235.ec2.internal

openshift-ingress

e2e-derive-6573d049-openshift-default-7d86df964-t6x4s

Scheduled

Successfully assigned openshift-ingress/e2e-derive-6573d049-openshift-default-7d86df964-t6x4s to ip-10-0-138-14.ec2.internal

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-6994df4f88 from 0 to 1
(x10)

openshift-ingress

replicaset-controller

router-default-6994df4f88

FailedCreate

Error creating: pods "router-default-6994df4f88-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x16)

openshift-ingress

replicaset-controller

router-default-6994df4f88

FailedCreate

Error creating: pods "router-default-6994df4f88-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

replicaset-controller

router-default-6994df4f88

SuccessfulCreate

Created pod: router-default-6994df4f88-cwhzx
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts
(x6)

openshift-ingress

kubelet

router-default-6994df4f88-cwhzx

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x6)

openshift-ingress

kubelet

router-default-6994df4f88-cwhzx

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

kubelet

router-default-6994df4f88-cwhzx

Created

Created container: router

openshift-ingress

kubelet

router-default-6994df4f88-cwhzx

Started

Started container router

openshift-ingress

kubelet

router-default-6994df4f88-cwhzx

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:48526e08a2a06d05806dbcf3ddb069e5182371667d9e9f7d2cf09f60cd247d20" already present on machine

openshift-ingress

multus

router-default-6994df4f88-cwhzx

AddedInterface

Add eth0 [10.132.0.11/23] from ovn-kubernetes
(x3)

openshift-ingress

replicaset-controller

kube-auth-proxy-58fc6d6988

FailedCreate

Error creating: pods "kube-auth-proxy-58fc6d6988-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

kubelet

kube-auth-proxy-58fc6d6988-7j7gd

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-58fc6d6988

SuccessfulCreate

Created pod: kube-auth-proxy-58fc6d6988-7j7gd

openshift-ingress

replicaset-controller

kube-auth-proxy-58fc6d6988

SuccessfulCreate

Created pod: kube-auth-proxy-58fc6d6988-dvf8m

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-58fc6d6988 from 0 to 2

openshift-ingress

kubelet

kube-auth-proxy-58fc6d6988-7j7gd

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-58fc6d6988-dvf8m

AddedInterface

Add eth0 [10.134.0.18/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-58fc6d6988-dvf8m

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-58fc6d6988-7j7gd

AddedInterface

Add eth0 [10.133.0.34/23] from ovn-kubernetes

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-vwx5p

AddedInterface

Add eth0 [10.134.0.19/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-vwx5p

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-vwx5p

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

kube-auth-proxy-58fc6d6988-7j7gd

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-58fc6d6988-7j7gd

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-58fc6d6988-7j7gd

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.708s (2.708s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-58fc6d6988-dvf8m

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.833s (2.833s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-58fc6d6988-dvf8m

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-58fc6d6988-dvf8m

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-vwx5p

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-vwx5p

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-vwx5p

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.778s (2.778s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-vwx5p

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-vwx5p

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-cbjdn

AddedInterface

Add eth0 [10.133.0.36/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-cbjdn

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-6745bb66bc from 0 to 1

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bc2sgf6

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-cbjdn

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-6745bb66bc

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-6745bb66bc2sgf6

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-6745bb66bc2sgf6

AddedInterface

Add eth0 [10.133.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-cbjdn

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-cbjdn

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.496s (2.496s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bc2sgf6

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.641s (2.641s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bc2sgf6

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-cbjdn

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bc2sgf6

Started

Started container istio-proxy

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled down replica set data-science-gateway-data-science-gateway-class-6745bb66bc from 1 to 0

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-6745bb66bc

SuccessfulDelete

Deleted pod: data-science-gateway-data-science-gateway-class-6745bb66bc2sgf6
(x3)

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bc2sgf6

ProbeError

Startup probe error: Get "http://10.133.0.35:15021/healthz/ready": dial tcp 10.133.0.35:15021: connect: connection refused body:
(x3)

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bc2sgf6

Unhealthy

Startup probe failed: Get "http://10.133.0.35:15021/healthz/ready": dial tcp 10.133.0.35:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bc2sgf6

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-qrb6l

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-qrb6l

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-qrb6l

AddedInterface

Add eth0 [10.133.0.37/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-qrb6l

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.541s (2.541s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-qrb6l

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-qrb6l

Created

Created container: discovery

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-vwx5p

Killing

Stopping container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-vwx5p

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-f72st

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-f72st

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-dxdkg
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-t27rf

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

multus

payload-processing-5b54b7fbb7-t27rf

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-dxdkg

AddedInterface

Add eth0 [10.134.0.25/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-t27rf

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-dxdkg

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-dxdkg

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-dxdkg

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.156s (2.156s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-dxdkg

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-t27rf

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.493s (2.493s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-t27rf

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-t27rf

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-f72st

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-f72st

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-f72st

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-f72st

Unhealthy

Startup probe failed: Get "http://10.133.0.45:15021/healthz/ready": dial tcp 10.133.0.45:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-f72st

ProbeError

Startup probe error: Get "http://10.133.0.45:15021/healthz/ready": dial tcp 10.133.0.45:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-worker-w0-f4de10-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-f4de10-openshift-default-7d6bb4864 from 0 to 1

openshift-ingress

deployment-controller

e2e-worker-w4-cd176e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-cd176e-openshift-default-7fdc756776 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w4-cd176e-openshift-default-7fdc756776

SuccessfulCreate

Created pod: e2e-worker-w4-cd176e-openshift-default-7fdc756776-m5cdj

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-cd176e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-cd176e

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-f4de10

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-f4de10

openshift-ingress

gateway_labeler_controller

e2e-inf-a-e98d1e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-e98d1e

openshift-ingress

deployment-controller

e2e-inf-a-e98d1e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-e98d1e-openshift-default-995569d9d from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w0-f4de10-openshift-default-7d6bb4864

SuccessfulCreate

Created pod: e2e-worker-w0-f4de10-openshift-default-7d6bb4864-hqmb9

openshift-ingress

replicaset-controller

e2e-inf-a-e98d1e-openshift-default-995569d9d

SuccessfulCreate

Created pod: e2e-inf-a-e98d1e-openshift-default-995569d9d-lrzsm

openshift-ingress

multus

e2e-inf-a-e98d1e-openshift-default-995569d9d-lrzsm

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w4-cd176e-openshift-default-7fdc756776-m5cdj

AddedInterface

Add eth0 [10.133.0.54/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w0-f4de10-openshift-default-7d6bb4864-hqmb9

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-e98d1e-98bcf4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-e98d1e-98bcf4-brhgp
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-e98d1e-98bcf4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-e98d1e-98bcf4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-e98d1e: serviceaccount "payload-processing-e2e-inf-a-e98d1e" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-e98d1e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-e98d1e-98bcf4 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-e98d1e-65864c5fb5

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-e98d1e-65864c5fb5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-e98d1e: serviceaccount "payload-processing-e2e-inf-a-e98d1e" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-e98d1e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-e98d1e-65864c5fb5 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-e98d1e-65864c5fb5

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-e98d1e-65864c5fb5-ggszd
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-f4de10-857b967875

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-f4de10-857b967875-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-f4de10: serviceaccount "payload-processing-e2e-worker-w0-f4de10" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-e98d1e-98bcf4-brhgp

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-e98d1e-65864c5fb5-ggszd

Started

Started container payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-f4de10

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-f4de10-977ff8d6 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-f4de10

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-f4de10-857b967875 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-e98d1e-98bcf4-brhgp

AddedInterface

Add eth0 [10.134.0.30/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-e98d1e-98bcf4-brhgp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-e98d1e-98bcf4-brhgp

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-e98d1e-65864c5fb5-ggszd

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-e98d1e-65864c5fb5-ggszd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-inf-a-e98d1e-65864c5fb5-ggszd

AddedInterface

Add eth0 [10.134.0.31/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-f4de10-977ff8d6-6g49f

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-f4de10-977ff8d6-6g49f

AddedInterface

Add eth0 [10.134.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-f4de10-977ff8d6-6g49f

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-f4de10-977ff8d6-6g49f

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-f4de10-857b967875

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-f4de10-857b967875-n67cq
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-f4de10-977ff8d6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-f4de10-977ff8d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-f4de10: serviceaccount "payload-processing-e2e-worker-w0-f4de10" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-f4de10-977ff8d6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-f4de10-977ff8d6-6g49f

openshift-ingress

multus

payload-processing-e2e-worker-w0-f4de10-857b967875-n67cq

AddedInterface

Add eth0 [10.134.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-f4de10-857b967875-n67cq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-f4de10-857b967875-n67cq

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-f4de10-857b967875-n67cq

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-cd176e-79cc7879f4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-cd176e-79cc7879f4-tg9wg
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-cd176e-79cc7879f4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-cd176e-79cc7879f4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-cd176e: serviceaccount "payload-processing-e2e-worker-w4-cd176e" not found

openshift-ingress

multus

payload-processing-e2e-worker-w4-cd176e-fb97d86c5-4z2c5

AddedInterface

Add eth0 [10.132.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-cd176e-fb97d86c5-4z2c5

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-cd176e-79cc7879f4-tg9wg

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-cd176e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-cd176e-79cc7879f4 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-cd176e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-cd176e-fb97d86c5 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-cd176e-fb97d86c5

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-cd176e-fb97d86c5-4z2c5
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-cd176e-fb97d86c5

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-cd176e-fb97d86c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-cd176e: serviceaccount "payload-processing-e2e-worker-w4-cd176e" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-cd176e-79cc7879f4-tg9wg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-cd176e-79cc7879f4-tg9wg

AddedInterface

Add eth0 [10.134.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-cd176e-79cc7879f4-tg9wg

Created

Created container: payload-pre-processing

openshift-ingress

multus

e2e-autores-2c1e69-openshift-default-5994fd4578-7wnbr

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ait-fd82e780-openshift-default-69744654bd

SuccessfulCreate

Created pod: e2e-ait-fd82e780-openshift-default-69744654bd-d295j

openshift-ingress

deployment-controller

e2e-ait-fd82e780-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-fd82e780-openshift-default-69744654bd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-fd82e780

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-fd82e780

openshift-ingress

gateway_labeler_controller

e2e-autores-2c1e69

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-2c1e69

openshift-ingress

replicaset-controller

e2e-autores-2c1e69-openshift-default-5994fd4578

SuccessfulCreate

Created pod: e2e-autores-2c1e69-openshift-default-5994fd4578-7wnbr

openshift-ingress

deployment-controller

e2e-autores-2c1e69-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-2c1e69-openshift-default-5994fd4578 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-cd176e-fb97d86c5-4z2c5

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-cd176e-fb97d86c5-4z2c5

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 3.005s (3.005s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-cd176e-fb97d86c5-4z2c5

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-ait-fd82e780-openshift-default-69744654bd-d295j

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

e2e-ait-fd82e780-openshift-default-69744654bd-d295j

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-fd82e780-openshift-default-69744654bd-d295j

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.764s (2.764s including waiting). Image size: 181318953 bytes.

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-2c1e69-6cd8cbffb6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-2c1e69-6cd8cbffb6-k5pwp
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-2c1e69-6cd8cbffb6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-2c1e69-6cd8cbffb6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-2c1e69: serviceaccount "payload-processing-e2e-autores-2c1e69" not found

openshift-ingress

deployment-controller

payload-processing-e2e-autores-2c1e69

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-2c1e69-6ff7b679df from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-2c1e69-6ff7b679df

FailedCreate

Error creating: pods "payload-processing-e2e-autores-2c1e69-6ff7b679df-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-2c1e69: serviceaccount "payload-processing-e2e-autores-2c1e69" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-2c1e69

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-2c1e69-6cd8cbffb6 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-2c1e69-6ff7b679df

SuccessfulCreate

Created pod: payload-processing-e2e-autores-2c1e69-6ff7b679df-nvthr

openshift-ingress

kubelet

payload-processing-e2e-autores-2c1e69-6ff7b679df-nvthr

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-2c1e69-6cd8cbffb6-k5pwp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-autores-2c1e69-6ff7b679df-nvthr

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-2c1e69-6ff7b679df-nvthr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-2c1e69-6cd8cbffb6-k5pwp

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-autores-2c1e69-6ff7b679df-nvthr

AddedInterface

Add eth0 [10.134.0.37/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-2c1e69-6cd8cbffb6-k5pwp

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-autores-2c1e69-6cd8cbffb6-k5pwp

AddedInterface

Add eth0 [10.134.0.36/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-fd82e780-687dbc8bc5

SuccessfulCreate

Created pod: payload-processing-e2e-ait-fd82e780-687dbc8bc5-zpj47

openshift-ingress

multus

payload-pre-processing-e2e-ait-fd82e780-688877958b-mb2rw

AddedInterface

Add eth0 [10.134.0.38/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-fd82e780-687dbc8bc5-zpj47

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-inf-a-e98d1e-openshift-default-995569d9d-lrzsm

Unhealthy

Readiness probe failed: Get "http://10.133.0.55:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-processing-e2e-ait-fd82e780-687dbc8bc5-zpj47

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-fd82e780-687dbc8bc5-zpj47

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-fd82e780-688877958b-mb2rw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-fd82e780-687dbc8bc5-zpj47

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-fd82e780-687dbc8bc5

FailedCreate

Error creating: pods "payload-processing-e2e-ait-fd82e780-687dbc8bc5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-fd82e780: serviceaccount "payload-processing-e2e-ait-fd82e780" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-fd82e780

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-fd82e780-687dbc8bc5 from 0 to 1

openshift-ingress

kubelet

e2e-inf-a-e98d1e-openshift-default-995569d9d-lrzsm

ProbeError

Readiness probe error: Get "http://10.133.0.55:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-fd82e780

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-fd82e780-688877958b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-fd82e780-688877958b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-fd82e780-688877958b-mb2rw
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-fd82e780-688877958b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-fd82e780-688877958b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-fd82e780: serviceaccount "payload-processing-e2e-ait-fd82e780" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-fd82e780-688877958b-mb2rw

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-fd82e780-688877958b-mb2rw

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-inf-a-e98d1e-openshift-default-995569d9d-lrzsm

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-f4de10-openshift-default-7d6bb4864-hqmb9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w4-cd176e-openshift-default-7fdc756776-m5cdj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w4-cd176e-openshift-default-7fdc756776-m5cdj

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-cd176e-openshift-default-7fdc756776-m5cdj

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-e98d1e-openshift-default-995569d9d-lrzsm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w0-f4de10-openshift-default-7d6bb4864-hqmb9

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-f4de10-openshift-default-7d6bb4864-hqmb9

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-e98d1e-openshift-default-995569d9d-lrzsm

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-worker-w4-cd176e-openshift-default-7fdc756776-m5cdj

ProbeError

Startup probe error: Get "http://10.133.0.54:15021/healthz/ready": dial tcp 10.133.0.54:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w4-cd176e-openshift-default-7fdc756776-m5cdj

Unhealthy

Startup probe failed: Get "http://10.133.0.54:15021/healthz/ready": dial tcp 10.133.0.54:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-inf-b-10a215

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-10a215

openshift-ingress

deployment-controller

e2e-inf-b-10a215-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-10a215-openshift-default-6d646bd59b from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-10a215-openshift-default-6d646bd59b

SuccessfulCreate

Created pod: e2e-inf-b-10a215-openshift-default-6d646bd59b-98jhh
(x6)

openshift-ingress

kubelet

e2e-inf-a-e98d1e-openshift-default-995569d9d-lrzsm

ProbeError

Startup probe error: Get "http://10.133.0.55:15021/healthz/ready": dial tcp 10.133.0.55:15021: connect: connection refused body:

openshift-ingress

GatewayAuthBootstrap

e2e-inf-b-10a215

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-inf-b-10a215-authn-ssl: envoyfilters.networking.istio.io "e2e-inf-b-10a215-authn-ssl" already exists
(x6)

openshift-ingress

kubelet

e2e-inf-a-e98d1e-openshift-default-995569d9d-lrzsm

Unhealthy

Startup probe failed: Get "http://10.133.0.55:15021/healthz/ready": dial tcp 10.133.0.55:15021: connect: connection refused

openshift-ingress

multus

e2e-inf-b-10a215-openshift-default-6d646bd59b-98jhh

AddedInterface

Add eth0 [10.133.0.61/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w0-f4de10-openshift-default-7d6bb4864-hqmb9

Unhealthy

Startup probe failed: Get "http://10.133.0.56:15021/healthz/ready": dial tcp 10.133.0.56:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-f4de10-openshift-default-7d6bb4864-hqmb9

ProbeError

Startup probe error: Get "http://10.133.0.56:15021/healthz/ready": dial tcp 10.133.0.56:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ait-fd82e780-openshift-default-69744654bd-d295j

Unhealthy

Readiness probe failed: Get "http://10.132.0.43:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ait-fd82e780-openshift-default-69744654bd-d295j

ProbeError

Readiness probe error: Get "http://10.132.0.43:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ait-fd82e780-openshift-default-69744654bd-d295j

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-ait-fd82e780-openshift-default-69744654bd-d295j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-fd82e780-openshift-default-69744654bd-d295j

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-2c1e69-openshift-default-5994fd4578-7wnbr

Created

Created container: istio-proxy

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-10a215-d478dc4dc

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-10a215-d478dc4dc-twwq2
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-10a215-6bf5478bc4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-10a215-6bf5478bc4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-10a215: serviceaccount "payload-processing-e2e-inf-b-10a215" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-10a215-6bf5478bc4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-10a215-6bf5478bc4-z948j
(x2)

openshift-ingress

kubelet

e2e-autores-2c1e69-openshift-default-5994fd4578-7wnbr

Started

Started container istio-proxy
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-10a215-d478dc4dc

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-10a215-d478dc4dc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-10a215: serviceaccount "payload-processing-e2e-inf-b-10a215" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-10a215

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-10a215-6bf5478bc4 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-autores-2c1e69-openshift-default-5994fd4578-7wnbr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-10a215

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-10a215-d478dc4dc from 0 to 1

openshift-ingress

multus

payload-processing-e2e-inf-b-10a215-d478dc4dc-twwq2

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-10a215-6bf5478bc4-z948j

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-b-10a215-d478dc4dc-twwq2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-b-10a215-d478dc4dc-twwq2

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-10a215-d478dc4dc-twwq2

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-10a215-6bf5478bc4-z948j

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-10a215-6bf5478bc4-z948j

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-10a215-6bf5478bc4-z948j

Started

Started container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-autores-2c1e69-openshift-default-5994fd4578-7wnbr

Unhealthy

Startup probe failed: Get "http://10.133.0.59:15021/healthz/ready": dial tcp 10.133.0.59:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-fd82e780-openshift-default-69744654bd-d295j

Unhealthy

Startup probe failed: Get "http://10.132.0.43:15021/healthz/ready": dial tcp 10.132.0.43:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-fd82e780-openshift-default-69744654bd-d295j

ProbeError

Startup probe error: Get "http://10.132.0.43:15021/healthz/ready": dial tcp 10.132.0.43:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-autores-2c1e69-openshift-default-5994fd4578-7wnbr

ProbeError

Startup probe error: Get "http://10.133.0.59:15021/healthz/ready": dial tcp 10.133.0.59:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ait-fd82e780-openshift-default-69744654bd-d295j

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-fd82e780-688877958b-mb2rw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-fd82e780-687dbc8bc5-zpj47

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-migrate-0b6ae428-gw-openshift-default-66845cc4d

SuccessfulCreate

Created pod: e2e-migrate-0b6ae428-gw-openshift-default-66845cc4d-h4kjv

openshift-ingress

gateway_labeler_controller

e2e-migrate-0b6ae428-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-0b6ae428-gw

openshift-ingress

deployment-controller

e2e-migrate-0b6ae428-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-0b6ae428-gw-openshift-default-66845cc4d from 0 to 1

openshift-ingress

multus

e2e-migrate-0b6ae428-gw-openshift-default-66845cc4d-h4kjv

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-0b6ae428

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-0b6ae428-d9c99cfd from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-0b6ae428-d9c99cfd

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-0b6ae428-d9c99cfd-pgz6v
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-0b6ae428-d9c99cfd

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-0b6ae428-d9c99cfd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-0b6ae428: serviceaccount "payload-processing-e2e-migrate-0b6ae428" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-0b6ae428-7f54bc76c4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-0b6ae428-7f54bc76c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-0b6ae428: serviceaccount "payload-processing-e2e-migrate-0b6ae428" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-0b6ae428-7f54bc76c4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-0b6ae428-7f54bc76c4-s27dn

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-0b6ae428

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-0b6ae428-7f54bc76c4 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-0b6ae428-7f54bc76c4-s27dn

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-0b6ae428-d9c99cfd-pgz6v

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-migrate-0b6ae428-d9c99cfd-pgz6v

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-0b6ae428-d9c99cfd-pgz6v

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-migrate-0b6ae428-d9c99cfd-pgz6v

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-migrate-0b6ae428-7f54bc76c4-s27dn

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-0b6ae428-7f54bc76c4-s27dn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-0b6ae428-7f54bc76c4-s27dn

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-inf-b-10a215-openshift-default-6d646bd59b-98jhh

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-10a215-openshift-default-6d646bd59b-98jhh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-10a215-openshift-default-6d646bd59b-98jhh

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-inf-b-10a215-openshift-default-6d646bd59b-98jhh

ProbeError

Startup probe error: Get "http://10.133.0.61:15021/healthz/ready": dial tcp 10.133.0.61:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-b-10a215-openshift-default-6d646bd59b-98jhh

Unhealthy

Startup probe failed: Get "http://10.133.0.61:15021/healthz/ready": dial tcp 10.133.0.61:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-migrate-0b6ae428-gw-openshift-default-66845cc4d-h4kjv

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-0b6ae428-gw-openshift-default-66845cc4d-h4kjv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-0b6ae428-gw-openshift-default-66845cc4d-h4kjv

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-migrate-0b6ae428-gw-openshift-default-66845cc4d-h4kjv

ProbeError

Startup probe error: Get "http://10.132.0.46:15021/healthz/ready": dial tcp 10.132.0.46:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-migrate-0b6ae428-gw-openshift-default-66845cc4d-h4kjv

Unhealthy

Startup probe failed: Get "http://10.132.0.46:15021/healthz/ready": dial tcp 10.132.0.46:15021: connect: connection refused

openshift-ingress

kubelet

e2e-migrate-0b6ae428-gw-openshift-default-66845cc4d-h4kjv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-migrate-0b6ae428-d9c99cfd-pgz6v

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-0b6ae428-7f54bc76c4-s27dn

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

e2e-ait-9516b91d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-9516b91d-openshift-default-76cb6c78d6 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-9516b91d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-9516b91d

openshift-ingress

replicaset-controller

e2e-ait-9516b91d-openshift-default-76cb6c78d6

SuccessfulCreate

Created pod: e2e-ait-9516b91d-openshift-default-76cb6c78d6-q9c5b

openshift-ingress

multus

e2e-ait-9516b91d-openshift-default-76cb6c78d6-q9c5b

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-9516b91d-7cfd4dc57

FailedCreate

Error creating: pods "payload-processing-e2e-ait-9516b91d-7cfd4dc57-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-9516b91d: serviceaccount "payload-processing-e2e-ait-9516b91d" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-9516b91d-7cfd4dc57

SuccessfulCreate

Created pod: payload-processing-e2e-ait-9516b91d-7cfd4dc57-kvdfc
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-9516b91d-754f94ffd6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-9516b91d-754f94ffd6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-9516b91d: serviceaccount "payload-processing-e2e-ait-9516b91d" not found
(x2)

openshift-ingress

kubelet

e2e-migrate-0b6ae428-gw-openshift-default-66845cc4d-h4kjv

Unhealthy

Readiness probe failed: Get "http://10.132.0.46:15021/healthz/ready": dial tcp 10.132.0.46:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-migrate-0b6ae428-gw-openshift-default-66845cc4d-h4kjv

ProbeError

Readiness probe error: Get "http://10.132.0.46:15021/healthz/ready": dial tcp 10.132.0.46:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-processing-e2e-ait-9516b91d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-9516b91d-7cfd4dc57 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-9516b91d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-9516b91d-754f94ffd6 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-9516b91d-754f94ffd6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-9516b91d-754f94ffd6-m927q

openshift-ingress

multus

payload-processing-e2e-ait-9516b91d-7cfd4dc57-kvdfc

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-9516b91d-7cfd4dc57-kvdfc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-9516b91d-754f94ffd6-m927q

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-9516b91d-754f94ffd6-m927q

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-9516b91d-754f94ffd6-m927q

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-9516b91d-7cfd4dc57-kvdfc

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-9516b91d-754f94ffd6-m927q

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-9516b91d-7cfd4dc57-kvdfc

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-ait-9516b91d-openshift-default-76cb6c78d6-q9c5b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-9516b91d-openshift-default-76cb6c78d6-q9c5b

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-9516b91d-openshift-default-76cb6c78d6-q9c5b

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ait-9516b91d-openshift-default-76cb6c78d6-q9c5b

Unhealthy

Startup probe failed: Get "http://10.132.0.48:15021/healthz/ready": dial tcp 10.132.0.48:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-9516b91d-openshift-default-76cb6c78d6-q9c5b

ProbeError

Startup probe error: Get "http://10.132.0.48:15021/healthz/ready": dial tcp 10.132.0.48:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-9516b91d-754f94ffd6-m927q

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ait-9516b91d

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ait-9516b91d: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ait-9516b91d": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ait-9516b91d, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 91c6267d-dd8a-4782-8118-3fc7d0ab66a5, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-ait-9516b91d-7cfd4dc57-kvdfc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-9516b91d-openshift-default-76cb6c78d6-q9c5b

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-derive-6573d049-openshift-default-7d86df964

SuccessfulCreate

Created pod: e2e-derive-6573d049-openshift-default-7d86df964-t6x4s

openshift-ingress

deployment-controller

e2e-derive-6573d049-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-6573d049-openshift-default-7d86df964 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-derive-6573d049

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-6573d049

openshift-ingress

multus

e2e-derive-6573d049-openshift-default-7d86df964-t6x4s

AddedInterface

Add eth0 [10.133.0.65/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-6573d049-69dfd459bb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-6573d049-69dfd459bb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-6573d049: serviceaccount "payload-processing-e2e-derive-6573d049" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-6573d049-69dfd459bb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-6573d049-69dfd459bb-cmfnr
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-6573d049-788d8d7cdf

FailedCreate

Error creating: pods "payload-processing-e2e-derive-6573d049-788d8d7cdf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-6573d049: serviceaccount "payload-processing-e2e-derive-6573d049" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-6573d049-788d8d7cdf

SuccessfulCreate

Created pod: payload-processing-e2e-derive-6573d049-788d8d7cdf-v2zxr

openshift-ingress

deployment-controller

payload-processing-e2e-derive-6573d049

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-6573d049-788d8d7cdf from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-6573d049

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-6573d049-69dfd459bb from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-derive-6573d049-788d8d7cdf-v2zxr

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-6573d049-69dfd459bb-cmfnr

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-6573d049-788d8d7cdf-v2zxr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-derive-6573d049-788d8d7cdf-v2zxr

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-6573d049-69dfd459bb-cmfnr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-derive-6573d049-69dfd459bb-cmfnr

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-6573d049-788d8d7cdf-v2zxr

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-6573d049-69dfd459bb-cmfnr

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-derive-6573d049-openshift-default-7d86df964-t6x4s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-6573d049-openshift-default-7d86df964-t6x4s

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-6573d049-openshift-default-7d86df964-t6x4s

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-derive-6573d049-openshift-default-7d86df964-t6x4s

Unhealthy

Startup probe failed: Get "http://10.133.0.65:15021/healthz/ready": dial tcp 10.133.0.65:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-derive-6573d049-openshift-default-7d86df964-t6x4s

ProbeError

Startup probe error: Get "http://10.133.0.65:15021/healthz/ready": dial tcp 10.133.0.65:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-6573d049-69dfd459bb-cmfnr

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-derive-6573d049

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-derive-6573d049: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-derive-6573d049": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-derive-6573d049, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 9f5d5465-03ce-46fa-82e3-190d78d90cec, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-derive-6573d049-788d8d7cdf-v2zxr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-derive-6573d049-openshift-default-7d86df964-t6x4s

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-2c1e69-6cd8cbffb6-k5pwp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-2c1e69-6ff7b679df-nvthr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-autores-2c1e69-openshift-default-5994fd4578-7wnbr

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-explicit-987d60

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-987d60

openshift-ingress

deployment-controller

e2e-explicit-987d60-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-987d60-openshift-default-6768b96b4d from 0 to 1

openshift-ingress

replicaset-controller

e2e-explicit-987d60-openshift-default-6768b96b4d

SuccessfulCreate

Created pod: e2e-explicit-987d60-openshift-default-6768b96b4d-qns7n

openshift-ingress

multus

e2e-explicit-987d60-openshift-default-6768b96b4d-qns7n

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-987d60

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-987d60-78c8b64f6f from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-987d60

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-987d60-5d8998b46b from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-explicit-987d60-78c8b64f6f-hws9z

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-explicit-987d60-78c8b64f6f-hws9z

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-987d60-5d8998b46b-gbljd

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-987d60-5d8998b46b-gbljd

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-987d60-78c8b64f6f

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-987d60-78c8b64f6f-hws9z
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-987d60-5d8998b46b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-987d60-5d8998b46b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-987d60: serviceaccount "payload-processing-e2e-explicit-987d60" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-987d60-5d8998b46b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-987d60-5d8998b46b-gbljd

openshift-ingress

multus

payload-pre-processing-e2e-explicit-987d60-5d8998b46b-gbljd

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-987d60-78c8b64f6f

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-987d60-78c8b64f6f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-987d60: serviceaccount "payload-processing-e2e-explicit-987d60" not found

openshift-ingress

kubelet

payload-processing-e2e-explicit-987d60-78c8b64f6f-hws9z

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-987d60-5d8998b46b-gbljd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-explicit-987d60-78c8b64f6f-hws9z

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-explicit-987d60-openshift-default-6768b96b4d-qns7n

Unhealthy

Readiness probe failed: Get "http://10.132.0.53:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-explicit-987d60-openshift-default-6768b96b4d-qns7n

ProbeError

Readiness probe error: Get "http://10.132.0.53:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-explicit-987d60-openshift-default-6768b96b4d-qns7n

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-987d60-openshift-default-6768b96b4d-qns7n

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-987d60-openshift-default-6768b96b4d-qns7n

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-explicit-987d60-openshift-default-6768b96b4d-qns7n

ProbeError

Startup probe error: Get "http://10.132.0.53:15021/healthz/ready": dial tcp 10.132.0.53:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-explicit-987d60-openshift-default-6768b96b4d-qns7n

Unhealthy

Startup probe failed: Get "http://10.132.0.53:15021/healthz/ready": dial tcp 10.132.0.53:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-mt-ef3c90aa

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-ef3c90aa

openshift-ingress

deployment-controller

e2e-mt-ef3c90aa-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-ef3c90aa-openshift-default-7b99494568 from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-ef3c90aa-openshift-default-7b99494568

SuccessfulCreate

Created pod: e2e-mt-ef3c90aa-openshift-default-7b99494568-djzbg

openshift-ingress

multus

e2e-mt-ef3c90aa-openshift-default-7b99494568-djzbg

AddedInterface

Add eth0 [10.133.0.66/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-ef3c90aa-59c4f7db7c

SuccessfulCreate

Created pod: payload-processing-e2e-mt-ef3c90aa-59c4f7db7c-5mfmf
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-ef3c90aa-59c4f7db7c

FailedCreate

Error creating: pods "payload-processing-e2e-mt-ef3c90aa-59c4f7db7c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-ef3c90aa: serviceaccount "payload-processing-e2e-mt-ef3c90aa" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-ef3c90aa

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-ef3c90aa-57d456c986 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-mt-ef3c90aa

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-ef3c90aa-59c4f7db7c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-ef3c90aa-57d456c986

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-ef3c90aa-57d456c986-xx76b
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-ef3c90aa-57d456c986

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-ef3c90aa-57d456c986-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-ef3c90aa: serviceaccount "payload-processing-e2e-mt-ef3c90aa" not found

openshift-ingress

kubelet

payload-processing-e2e-mt-ef3c90aa-59c4f7db7c-5mfmf

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-ef3c90aa-57d456c986-xx76b

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-mt-ef3c90aa-57d456c986-xx76b

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-ef3c90aa-57d456c986-xx76b

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-mt-ef3c90aa-59c4f7db7c-5mfmf

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-ef3c90aa-59c4f7db7c-5mfmf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-ef3c90aa-59c4f7db7c-5mfmf

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-ef3c90aa-57d456c986-xx76b

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-ef3c90aa-openshift-default-7b99494568-djzbg

Unhealthy

Readiness probe failed: Get "http://10.133.0.66:15021/healthz/ready": read tcp 10.133.0.2:47868->10.133.0.66:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-mt-ef3c90aa-openshift-default-7b99494568-djzbg

ProbeError

Readiness probe error: Get "http://10.133.0.66:15021/healthz/ready": read tcp 10.133.0.2:47868->10.133.0.66:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-mt-ef3c90aa-openshift-default-7b99494568-djzbg

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-ef3c90aa-openshift-default-7b99494568-djzbg

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-ef3c90aa-openshift-default-7b99494568-djzbg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-mt-ef3c90aa-openshift-default-7b99494568-djzbg

ProbeError

Startup probe error: Get "http://10.133.0.66:15021/healthz/ready": dial tcp 10.133.0.66:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-mt-ef3c90aa-openshift-default-7b99494568-djzbg

Unhealthy

Startup probe failed: Get "http://10.133.0.66:15021/healthz/ready": dial tcp 10.133.0.66:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-ef3c90aa-57d456c986-xx76b

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-ef3c90aa-59c4f7db7c-5mfmf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-ef3c90aa-openshift-default-7b99494568-djzbg

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-76bb56

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-76bb56

openshift-ingress

deployment-controller

e2e-shared-a-w2-76bb56-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-76bb56-openshift-default-54985b7cfd from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w2-76bb56-openshift-default-54985b7cfd

SuccessfulCreate

Created pod: e2e-shared-a-w2-76bb56-openshift-default-54985b7cfd-2pm67

openshift-ingress

multus

e2e-shared-a-w2-76bb56-openshift-default-54985b7cfd-2pm67

AddedInterface

Add eth0 [10.133.0.68/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-76bb56-85f969dc7

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-76bb56-85f969dc7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-76bb56: serviceaccount "payload-processing-e2e-shared-a-w2-76bb56" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-76bb56-85f969dc7

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-76bb56-85f969dc7-r9w54

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-76bb56

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-76bb56-85f969dc7 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-76bb56-5cdb6ffcc8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-76bb56-5cdb6ffcc8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-76bb56: serviceaccount "payload-processing-e2e-shared-a-w2-76bb56" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-76bb56-5cdb6ffcc8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-76bb56-5cdb6ffcc8-ntrpk

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-76bb56

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-76bb56-5cdb6ffcc8 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-76bb56-5cdb6ffcc8-ntrpk

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-76bb56-5cdb6ffcc8-ntrpk

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-76bb56-85f969dc7-r9w54

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-76bb56-5cdb6ffcc8-ntrpk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-76bb56-85f969dc7-r9w54

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-76bb56-85f969dc7-r9w54

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-76bb56-5cdb6ffcc8-ntrpk

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-76bb56-85f969dc7-r9w54

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-987d60-5d8998b46b-gbljd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-987d60-78c8b64f6f-hws9z

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-76bb56-openshift-default-54985b7cfd-2pm67

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-76bb56-openshift-default-54985b7cfd-2pm67

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-76bb56-openshift-default-54985b7cfd-2pm67

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-cd176e-79cc7879f4-tg9wg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-cd176e-fb97d86c5-4z2c5

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-4f6824

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-4f6824

openshift-ingress

deployment-controller

e2e-shared-b-w2-4f6824-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-4f6824-openshift-default-fcb676cb4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w2-4f6824-openshift-default-fcb676cb4

SuccessfulCreate

Created pod: e2e-shared-b-w2-4f6824-openshift-default-fcb676cb4-d7lxx
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-76bb56-openshift-default-54985b7cfd-2pm67

Unhealthy

Startup probe failed: Get "http://10.133.0.68:15021/healthz/ready": dial tcp 10.133.0.68:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-76bb56-openshift-default-54985b7cfd-2pm67

ProbeError

Startup probe error: Get "http://10.133.0.68:15021/healthz/ready": dial tcp 10.133.0.68:15021: connect: connection refused body:

openshift-ingress

multus

e2e-shared-b-w2-4f6824-openshift-default-fcb676cb4-d7lxx

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-4f6824-647f95d65d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-4f6824-647f95d65d-kflvl

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-4f6824-68859fc547

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-4f6824-68859fc547-47gtd

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-4f6824

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-4f6824-68859fc547 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-4f6824-68859fc547

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-4f6824-68859fc547-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-4f6824: serviceaccount "payload-processing-e2e-shared-b-w2-4f6824" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-4f6824-647f95d65d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-4f6824-647f95d65d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-4f6824: serviceaccount "payload-processing-e2e-shared-b-w2-4f6824" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-4f6824

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-4f6824-647f95d65d from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-4f6824-647f95d65d-kflvl

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-4f6824-68859fc547-47gtd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-worker-w4-cd176e-openshift-default-7fdc756776-m5cdj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-4f6824-68859fc547-47gtd

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-4f6824-68859fc547-47gtd

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-4f6824-68859fc547-47gtd

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-4f6824-647f95d65d-kflvl

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-4f6824-647f95d65d-kflvl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-4f6824-647f95d65d-kflvl

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w4-cd176e-openshift-default-7fdc756776-m5cdj

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w4-cd176e-openshift-default-7fdc756776-m5cdj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-4f6824-openshift-default-fcb676cb4-d7lxx

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-4f6824-openshift-default-fcb676cb4-d7lxx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-4f6824-openshift-default-fcb676cb4-d7lxx

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-explicit-987d60-openshift-default-6768b96b4d-qns7n

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-noten-4ec6e9-openshift-default-788667c47b

SuccessfulCreate

Created pod: e2e-noten-4ec6e9-openshift-default-788667c47b-9ts4s

openshift-ingress

gateway_labeler_controller

e2e-noten-4ec6e9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-4ec6e9

openshift-ingress

deployment-controller

e2e-noten-4ec6e9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-4ec6e9-openshift-default-788667c47b from 0 to 1

openshift-ingress

kubelet

e2e-noten-4ec6e9-openshift-default-788667c47b-9ts4s

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-noten-4ec6e9-openshift-default-788667c47b-9ts4s

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-noten-4ec6e9-openshift-default-788667c47b-9ts4s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

multus

e2e-noten-4ec6e9-openshift-default-788667c47b-9ts4s

AddedInterface

Add eth0 [10.133.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-explicit-987d60-openshift-default-6768b96b4d-qns7n

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-explicit-987d60-openshift-default-6768b96b4d-qns7n

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-4f6824-openshift-default-fcb676cb4-d7lxx

Unhealthy

Startup probe failed: Get "http://10.132.0.60:15021/healthz/ready": dial tcp 10.132.0.60:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-4f6824-openshift-default-fcb676cb4-d7lxx

ProbeError

Startup probe error: Get "http://10.132.0.60:15021/healthz/ready": dial tcp 10.132.0.60:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-mt-6f69f6e6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-6f69f6e6

openshift-ingress

deployment-controller

e2e-mt-6f69f6e6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-6f69f6e6-openshift-default-697758b5bd from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-6f69f6e6-openshift-default-697758b5bd

SuccessfulCreate

Created pod: e2e-mt-6f69f6e6-openshift-default-697758b5bd-xdb9b

openshift-ingress

multus

e2e-mt-6f69f6e6-openshift-default-697758b5bd-xdb9b

AddedInterface

Add eth0 [10.132.0.65/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-6f69f6e6-55f997794

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-6f69f6e6-55f997794-7s9fv

openshift-ingress

deployment-controller

payload-processing-e2e-mt-6f69f6e6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-6f69f6e6-79bf759489 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-mt-6f69f6e6-79bf759489-llzpv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-6f69f6e6-79bf759489-llzpv

AddedInterface

Add eth0 [10.132.0.66/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-6f69f6e6-79bf759489

SuccessfulCreate

Created pod: payload-processing-e2e-mt-6f69f6e6-79bf759489-llzpv

openshift-ingress

kubelet

payload-processing-e2e-mt-6f69f6e6-79bf759489-llzpv

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-6f69f6e6-79bf759489

FailedCreate

Error creating: pods "payload-processing-e2e-mt-6f69f6e6-79bf759489-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-6f69f6e6: serviceaccount "payload-processing-e2e-mt-6f69f6e6" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-6f69f6e6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-6f69f6e6-55f997794 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-mt-6f69f6e6-55f997794-7s9fv

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-6f69f6e6-79bf759489-llzpv

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-6f69f6e6-55f997794-7s9fv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-6f69f6e6-55f997794

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-6f69f6e6-55f997794-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-6f69f6e6: serviceaccount "payload-processing-e2e-mt-6f69f6e6" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-6f69f6e6-55f997794-7s9fv

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-6f69f6e6-55f997794-7s9fv

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-mt-6f69f6e6-openshift-default-697758b5bd-xdb9b

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-6f69f6e6-openshift-default-697758b5bd-xdb9b

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-6f69f6e6-openshift-default-697758b5bd-xdb9b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-mt-6f69f6e6-openshift-default-697758b5bd-xdb9b

ProbeError

Startup probe error: Get "http://10.132.0.65:15021/healthz/ready": dial tcp 10.132.0.65:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-6f69f6e6-openshift-default-697758b5bd-xdb9b

Unhealthy

Startup probe failed: Get "http://10.132.0.65:15021/healthz/ready": dial tcp 10.132.0.65:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-inf-a-e98d1e-65864c5fb5-ggszd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-e98d1e-98bcf4-brhgp

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-inf-a-e98d1e

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-inf-a-e98d1e: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-inf-a-e98d1e": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-inf-a-e98d1e, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: db559cb0-c945-447a-8499-f40540b40202, UID in object meta:

openshift-ingress

kubelet

e2e-noten-4ec6e9-openshift-default-788667c47b-9ts4s

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-e98d1e-openshift-default-995569d9d-lrzsm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-inf-b-10a215-d478dc4dc-twwq2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-10a215-6bf5478bc4-z948j

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-b-10a215-openshift-default-6d646bd59b-98jhh

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-w3-d6e26b-openshift-default-6c8cd59c7d

SuccessfulCreate

Created pod: e2e-shared-a-w3-d6e26b-openshift-default-6c8cd59c7d-blspp

openshift-ingress

deployment-controller

e2e-shared-a-w3-d6e26b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-d6e26b-openshift-default-6c8cd59c7d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-d6e26b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-d6e26b

openshift-ingress

multus

e2e-shared-a-w3-d6e26b-openshift-default-6c8cd59c7d-blspp

AddedInterface

Add eth0 [10.133.0.73/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-d6e26b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-d6e26b-78d4d6b489 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-d6e26b-64f4dc94fd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-d6e26b-64f4dc94fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-d6e26b: serviceaccount "payload-processing-e2e-shared-a-w3-d6e26b" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-d6e26b-64f4dc94fd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-d6e26b-64f4dc94fd-ckm8g

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-d6e26b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-d6e26b-64f4dc94fd from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-d6e26b-78d4d6b489

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-d6e26b-78d4d6b489-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-d6e26b: serviceaccount "payload-processing-e2e-shared-a-w3-d6e26b" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-d6e26b-78d4d6b489

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-d6e26b-78d4d6b489-jq8ct

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-d6e26b-78d4d6b489-jq8ct

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-d6e26b-78d4d6b489-jq8ct

AddedInterface

Add eth0 [10.134.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-d6e26b-78d4d6b489-jq8ct

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-d6e26b-64f4dc94fd-ckm8g

AddedInterface

Add eth0 [10.134.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-d6e26b-64f4dc94fd-ckm8g

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-d6e26b-64f4dc94fd-ckm8g

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-d6e26b-78d4d6b489-jq8ct

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-d6e26b-64f4dc94fd-ckm8g

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-d6e26b-openshift-default-6c8cd59c7d-blspp

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-d6e26b-openshift-default-6c8cd59c7d-blspp

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-d6e26b-openshift-default-6c8cd59c7d-blspp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-b9930f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-b9930f

openshift-ingress

deployment-controller

e2e-shared-b-w3-b9930f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-b9930f-openshift-default-5cc6ff4964 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w3-b9930f-openshift-default-5cc6ff4964

SuccessfulCreate

Created pod: e2e-shared-b-w3-b9930f-openshift-default-5cc6ff4964-q6qbb

openshift-ingress

multus

e2e-shared-b-w3-b9930f-openshift-default-5cc6ff4964-q6qbb

AddedInterface

Add eth0 [10.133.0.75/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-d6e26b-openshift-default-6c8cd59c7d-blspp

Unhealthy

Startup probe failed: Get "http://10.133.0.73:15021/healthz/ready": dial tcp 10.133.0.73:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-d6e26b-openshift-default-6c8cd59c7d-blspp

ProbeError

Startup probe error: Get "http://10.133.0.73:15021/healthz/ready": dial tcp 10.133.0.73:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-b9930f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-b9930f-cb59bb98b from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-b9930f-cb59bb98b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-b9930f-cb59bb98b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-b9930f: serviceaccount "payload-processing-e2e-shared-b-w3-b9930f" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-b9930f-6cbdc6f967

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-b9930f-6cbdc6f967-879w7
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-b9930f-6cbdc6f967

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-b9930f-6cbdc6f967-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-b9930f: serviceaccount "payload-processing-e2e-shared-b-w3-b9930f" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-b9930f-cb59bb98b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-b9930f-cb59bb98b-p7ndh

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-b9930f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-b9930f-6cbdc6f967 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-b9930f-6cbdc6f967-879w7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-b9930f-cb59bb98b-p7ndh

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-b9930f-6cbdc6f967-879w7

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-b9930f-cb59bb98b-p7ndh

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-b9930f-6cbdc6f967-879w7

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-b9930f-6cbdc6f967-879w7

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-b9930f-cb59bb98b-p7ndh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-b9930f-cb59bb98b-p7ndh

AddedInterface

Add eth0 [10.134.0.76/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-b9930f-openshift-default-5cc6ff4964-q6qbb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-b9930f-openshift-default-5cc6ff4964-q6qbb

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-b9930f-openshift-default-5cc6ff4964-q6qbb

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w3-b9930f-openshift-default-5cc6ff4964-q6qbb

ProbeError

Readiness probe error: Get "http://10.133.0.75:15021/healthz/ready": dial tcp 10.133.0.75:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-shared-b-w3-b9930f-openshift-default-5cc6ff4964-q6qbb

Unhealthy

Readiness probe failed: Get "http://10.133.0.75:15021/healthz/ready": dial tcp 10.133.0.75:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-6f69f6e6-55f997794-7s9fv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-6f69f6e6-79bf759489-llzpv

Killing

Stopping container payload-processing
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-b9930f-openshift-default-5cc6ff4964-q6qbb

ProbeError

Startup probe error: Get "http://10.133.0.75:15021/healthz/ready": dial tcp 10.133.0.75:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-b9930f-openshift-default-5cc6ff4964-q6qbb

Unhealthy

Startup probe failed: Get "http://10.133.0.75:15021/healthz/ready": dial tcp 10.133.0.75:15021: connect: connection refused

openshift-ingress

kubelet

e2e-mt-6f69f6e6-openshift-default-697758b5bd-xdb9b

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-f4de10-857b967875-n67cq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-f4de10-977ff8d6-6g49f

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w0-f4de10-openshift-default-7d6bb4864-hqmb9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-f4de10-openshift-default-7d6bb4864-hqmb9

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w0-f4de10-openshift-default-7d6bb4864-hqmb9

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

e2e-api-a-f729f8-openshift-default-86f7f474dd

SuccessfulCreate

Created pod: e2e-api-a-f729f8-openshift-default-86f7f474dd-vghhn

openshift-ingress

gateway_labeler_controller

e2e-api-a-f729f8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-f729f8

openshift-ingress

deployment-controller

e2e-api-a-f729f8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-f729f8-openshift-default-86f7f474dd from 0 to 1

openshift-ingress

multus

e2e-api-a-f729f8-openshift-default-86f7f474dd-vghhn

AddedInterface

Add eth0 [10.132.0.70/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-f729f8-fbb9d5d9f

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-f729f8-fbb9d5d9f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-f729f8: serviceaccount "payload-processing-e2e-api-a-f729f8" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-f729f8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-f729f8-fbb9d5d9f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-f729f8-fbb9d5d9f

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-f729f8-fbb9d5d9f-dhb4r

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-f729f8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-f729f8-57b47d7b6 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-f729f8-57b47d7b6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-f729f8-57b47d7b6-7brc8
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-f729f8-57b47d7b6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-f729f8-57b47d7b6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-f729f8: serviceaccount "payload-processing-e2e-api-a-f729f8" not found

openshift-ingress

kubelet

payload-processing-e2e-api-a-f729f8-fbb9d5d9f-dhb4r

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-api-a-f729f8-fbb9d5d9f-dhb4r

AddedInterface

Add eth0 [10.134.0.81/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-f729f8-57b47d7b6-7brc8

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-f729f8-57b47d7b6-7brc8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-a-f729f8-57b47d7b6-7brc8

AddedInterface

Add eth0 [10.134.0.80/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-f729f8-57b47d7b6-7brc8

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-f729f8-fbb9d5d9f-dhb4r

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-f729f8-fbb9d5d9f-dhb4r

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-api-a-f729f8-openshift-default-86f7f474dd-vghhn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-f729f8-openshift-default-86f7f474dd-vghhn

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-f729f8-openshift-default-86f7f474dd-vghhn

Started

Started container istio-proxy

openshift-ingress

replicaset-controller

e2e-api-b-be588a-openshift-default-8f67f9ccb

SuccessfulCreate

Created pod: e2e-api-b-be588a-openshift-default-8f67f9ccb-ntqhz

openshift-ingress

gateway_labeler_controller

e2e-api-b-be588a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-be588a

openshift-ingress

deployment-controller

e2e-api-b-be588a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-be588a-openshift-default-8f67f9ccb from 0 to 1

openshift-ingress

multus

e2e-api-b-be588a-openshift-default-8f67f9ccb-ntqhz

AddedInterface

Add eth0 [10.132.0.71/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-api-a-f729f8-openshift-default-86f7f474dd-vghhn

Unhealthy

Startup probe failed: Get "http://10.132.0.70:15021/healthz/ready": dial tcp 10.132.0.70:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-a-f729f8-openshift-default-86f7f474dd-vghhn

ProbeError

Startup probe error: Get "http://10.132.0.70:15021/healthz/ready": dial tcp 10.132.0.70:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-be588a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-be588a-65d9794cf from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-be588a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-be588a-6cdffc5cf8 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-be588a-65d9794cf

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-be588a-65d9794cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-be588a: serviceaccount "payload-processing-e2e-api-b-be588a" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-be588a-6cdffc5cf8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-be588a-6cdffc5cf8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-be588a: serviceaccount "payload-processing-e2e-api-b-be588a" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-be588a-6cdffc5cf8-xnhx6

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-be588a-65d9794cf-9b2d7

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-be588a-65d9794cf

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-be588a-65d9794cf-9b2d7

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-be588a-6cdffc5cf8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-be588a-6cdffc5cf8-xnhx6

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-be588a-6cdffc5cf8-xnhx6

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-be588a-6cdffc5cf8-xnhx6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-b-be588a-6cdffc5cf8-xnhx6

AddedInterface

Add eth0 [10.134.0.82/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-be588a-65d9794cf-9b2d7

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-api-b-be588a-65d9794cf-9b2d7

AddedInterface

Add eth0 [10.134.0.83/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-be588a-65d9794cf-9b2d7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-be588a-openshift-default-8f67f9ccb-ntqhz

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-be588a-openshift-default-8f67f9ccb-ntqhz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-be588a-openshift-default-8f67f9ccb-ntqhz

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-b-be588a-openshift-default-8f67f9ccb-ntqhz

ProbeError

Startup probe error: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-be588a-openshift-default-8f67f9ccb-ntqhz

Unhealthy

Startup probe failed: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-f729f8-57b47d7b6-7brc8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-f729f8-fbb9d5d9f-dhb4r

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-a-f729f8-openshift-default-86f7f474dd-vghhn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-be588a-6cdffc5cf8-xnhx6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-be588a-65d9794cf-9b2d7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-b-be588a-openshift-default-8f67f9ccb-ntqhz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-be588a-openshift-default-8f67f9ccb-ntqhz

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-b-be588a-openshift-default-8f67f9ccb-ntqhz

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-76bb56-85f969dc7-r9w54

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-76bb56-5cdb6ffcc8-ntrpk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w2-76bb56-openshift-default-54985b7cfd-2pm67

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-4f6824-68859fc547-47gtd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-4f6824-647f95d65d-kflvl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w2-4f6824-openshift-default-fcb676cb4-d7lxx

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-ipp-a-c1edc6-openshift-default-6c98cd4f94

SuccessfulCreate

Created pod: e2e-ipp-a-c1edc6-openshift-default-6c98cd4f94-lq27w

openshift-ingress

deployment-controller

e2e-ipp-a-c1edc6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-c1edc6-openshift-default-6c98cd4f94 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-c1edc6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-c1edc6

openshift-ingress

multus

e2e-ipp-a-c1edc6-openshift-default-6c98cd4f94-lq27w

AddedInterface

Add eth0 [10.132.0.76/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-c1edc6-86d99bdbf8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-c1edc6-86d99bdbf8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-c1edc6: serviceaccount "payload-processing-e2e-ipp-a-c1edc6" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-c1edc6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-c1edc6-7c6f5584df from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-c1edc6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-c1edc6-86d99bdbf8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-c1edc6-86d99bdbf8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-c1edc6-86d99bdbf8-8hhms
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-c1edc6-7c6f5584df

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-c1edc6-7c6f5584df-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-c1edc6: serviceaccount "payload-processing-e2e-ipp-a-c1edc6" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-c1edc6-7c6f5584df

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-c1edc6-7c6f5584df-f5pkt

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-c1edc6-86d99bdbf8-8hhms

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-c1edc6-7c6f5584df-f5pkt

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-c1edc6-7c6f5584df-f5pkt

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-c1edc6-86d99bdbf8-8hhms

AddedInterface

Add eth0 [10.134.0.92/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-a-c1edc6-7c6f5584df-f5pkt

AddedInterface

Add eth0 [10.134.0.93/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-c1edc6-7c6f5584df-f5pkt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-c1edc6-86d99bdbf8-8hhms

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-c1edc6-86d99bdbf8-8hhms

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-ipp-a-c1edc6-openshift-default-6c98cd4f94-lq27w

ProbeError

Readiness probe error: Get "http://10.132.0.76:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-a-c1edc6-openshift-default-6c98cd4f94-lq27w

Unhealthy

Readiness probe failed: Get "http://10.132.0.76:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ipp-a-c1edc6-openshift-default-6c98cd4f94-lq27w

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-c1edc6-openshift-default-6c98cd4f94-lq27w

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-c1edc6-openshift-default-6c98cd4f94-lq27w

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-a-c1edc6-openshift-default-6c98cd4f94-lq27w

Unhealthy

Startup probe failed: Get "http://10.132.0.76:15021/healthz/ready": dial tcp 10.132.0.76:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-c1edc6-openshift-default-6c98cd4f94-lq27w

ProbeError

Startup probe error: Get "http://10.132.0.76:15021/healthz/ready": dial tcp 10.132.0.76:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-ipp-b-40f90a-openshift-default-c6dc47dc6

SuccessfulCreate

Created pod: e2e-ipp-b-40f90a-openshift-default-c6dc47dc6-kr8vj

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-40f90a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-40f90a

openshift-ingress

deployment-controller

e2e-ipp-b-40f90a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-40f90a-openshift-default-c6dc47dc6 from 0 to 1

openshift-ingress

multus

e2e-ipp-b-40f90a-openshift-default-c6dc47dc6-kr8vj

AddedInterface

Add eth0 [10.132.0.78/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-40f90a-6b7f8c5df9

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-40f90a-6b7f8c5df9-fpjwc
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-40f90a-6b7f8c5df9

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-40f90a-6b7f8c5df9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-40f90a: serviceaccount "payload-processing-e2e-ipp-b-40f90a" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-40f90a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-40f90a-58cb6f886b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-40f90a-58cb6f886b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-40f90a-58cb6f886b-xmwmb
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-40f90a-58cb6f886b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-40f90a-58cb6f886b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-40f90a: serviceaccount "payload-processing-e2e-ipp-b-40f90a" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-40f90a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-40f90a-6b7f8c5df9 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-40f90a-58cb6f886b-xmwmb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-40f90a-58cb6f886b-xmwmb

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-40f90a-58cb6f886b-xmwmb

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-40f90a-6b7f8c5df9-fpjwc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-40f90a-6b7f8c5df9-fpjwc

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-40f90a-6b7f8c5df9-fpjwc

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-ipp-b-40f90a-6b7f8c5df9-fpjwc

AddedInterface

Add eth0 [10.134.0.95/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-40f90a-58cb6f886b-xmwmb

AddedInterface

Add eth0 [10.134.0.94/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-b-40f90a-openshift-default-c6dc47dc6-kr8vj

Unhealthy

Readiness probe failed: Get "http://10.132.0.78:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-b-40f90a-openshift-default-c6dc47dc6-kr8vj

ProbeError

Readiness probe error: Get "http://10.132.0.78:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ipp-b-40f90a-openshift-default-c6dc47dc6-kr8vj

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-40f90a-openshift-default-c6dc47dc6-kr8vj

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-40f90a-openshift-default-c6dc47dc6-kr8vj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-ipp-b-40f90a-openshift-default-c6dc47dc6-kr8vj

ProbeError

Startup probe error: Get "http://10.132.0.78:15021/healthz/ready": dial tcp 10.132.0.78:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-b-40f90a-openshift-default-c6dc47dc6-kr8vj

Unhealthy

Startup probe failed: Get "http://10.132.0.78:15021/healthz/ready": dial tcp 10.132.0.78:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-8fa57c-openshift-default-c8f44bf68

SuccessfulCreate

Created pod: e2e-ipp-cleanup-8fa57c-openshift-default-c8f44bf68-zq7q7

openshift-ingress

deployment-controller

e2e-ipp-cleanup-8fa57c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-8fa57c-openshift-default-c8f44bf68 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-8fa57c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-8fa57c

openshift-ingress

multus

e2e-ipp-cleanup-8fa57c-openshift-default-c8f44bf68-zq7q7

AddedInterface

Add eth0 [10.133.0.80/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-8fa57c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-8fa57c-6fb987f4d7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-8fa57c-6fb987f4d7

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-8fa57c-6fb987f4d7-6kvq6
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-8fa57c-6fb987f4d7

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-8fa57c-6fb987f4d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-8fa57c: serviceaccount "payload-processing-e2e-ipp-cleanup-8fa57c" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-8fa57c-54dc9bcbb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-8fa57c-54dc9bcbb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-8fa57c: serviceaccount "payload-processing-e2e-ipp-cleanup-8fa57c" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-8fa57c-54dc9bcbb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-8fa57c-54dc9bcbb-cjklq

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-8fa57c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-8fa57c-54dc9bcbb from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-8fa57c-6fb987f4d7-6kvq6

AddedInterface

Add eth0 [10.134.0.99/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-8fa57c-54dc9bcbb-cjklq

AddedInterface

Add eth0 [10.132.0.82/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-8fa57c-6fb987f4d7-6kvq6

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-8fa57c-6fb987f4d7-6kvq6

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-8fa57c-54dc9bcbb-cjklq

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-8fa57c-54dc9bcbb-cjklq

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-8fa57c-54dc9bcbb-cjklq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-8fa57c-6fb987f4d7-6kvq6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-8fa57c-openshift-default-c8f44bf68-zq7q7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-8fa57c-openshift-default-c8f44bf68-zq7q7

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-8fa57c-openshift-default-c8f44bf68-zq7q7

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-8fa57c-openshift-default-c8f44bf68-zq7q7

Unhealthy

Startup probe failed: Get "http://10.133.0.80:15021/healthz/ready": dial tcp 10.133.0.80:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-8fa57c-openshift-default-c8f44bf68-zq7q7

ProbeError

Startup probe error: Get "http://10.133.0.80:15021/healthz/ready": dial tcp 10.133.0.80:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-8fa57c-54dc9bcbb-cjklq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-8fa57c-6fb987f4d7-6kvq6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-8fa57c-openshift-default-c8f44bf68-zq7q7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-cleanup-8fa57c-openshift-default-c8f44bf68-zq7q7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-cleanup-8fa57c-openshift-default-c8f44bf68-zq7q7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-c1edc6-86d99bdbf8-8hhms

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-c1edc6-7c6f5584df-f5pkt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-c1edc6-openshift-default-6c98cd4f94-lq27w

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-c1edc6-openshift-default-6c98cd4f94-lq27w

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-a-c1edc6-openshift-default-6c98cd4f94-lq27w

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-40f90a-6b7f8c5df9-fpjwc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-40f90a-58cb6f886b-xmwmb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-40f90a-openshift-default-c6dc47dc6-kr8vj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-d6e26b-78d4d6b489-jq8ct

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-d6e26b-64f4dc94fd-ckm8g

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-a-w3-d6e26b

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-a-w3-d6e26b: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-a-w3-d6e26b": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-a-w3-d6e26b, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 42b73808-3115-4059-846c-7b1943d5b09f, UID in object meta:

openshift-ingress

kubelet

e2e-shared-a-w3-d6e26b-openshift-default-6c8cd59c7d-blspp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-d6e26b-openshift-default-6c8cd59c7d-blspp

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w3-d6e26b-openshift-default-6c8cd59c7d-blspp

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-b9930f-6cbdc6f967-879w7

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-processing-e2e-shared-b-w3-b9930f

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-processing-e2e-shared-b-w3-b9930f: Operation cannot be fulfilled on endpoints "payload-processing-e2e-shared-b-w3-b9930f": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-processing-e2e-shared-b-w3-b9930f, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 47eb6a16-247f-4b3a-beb4-961e3a2828e6, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-b9930f-cb59bb98b-p7ndh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w3-b9930f-openshift-default-5cc6ff4964-q6qbb

Killing

Stopping container istio-proxy