Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-pre-processing-e2e-api-a-4583f0-5cfd4d5b5d-r5n4k

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-4583f0-5cfd4d5b5d-r5n4k to ip-10-0-133-172.ec2.internal

openshift-ingress

e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd to ip-10-0-141-99.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-027c8100-848b646b9d-jwglj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-027c8100-848b646b9d-jwglj to ip-10-0-141-255.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-6ad61446-f4f6c84f4-9ks2m

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-6ad61446-f4f6c84f4-9ks2m to ip-10-0-141-255.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-62f806-85c544dfd-7ght8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-62f806-85c544dfd-7ght8 to ip-10-0-141-255.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-ab559b-69c6fb8479-4m56j

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-ab559b-69c6fb8479-4m56j to ip-10-0-141-99.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-a13357-55fb4c4c95-mrhv4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-a13357-55fb4c4c95-mrhv4 to ip-10-0-141-255.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-7f10d8-868497d6c7-85nt2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-7f10d8-868497d6c7-85nt2 to ip-10-0-141-255.ec2.internal

openshift-ingress

e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9

Scheduled

Successfully assigned openshift-ingress/e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9 to ip-10-0-141-99.ec2.internal

openshift-ingress

payload-processing-e2e-derive-35758849-5c8cc9476f-gf6wl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-35758849-5c8cc9476f-gf6wl to ip-10-0-141-255.ec2.internal

openshift-ingress

e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk to ip-10-0-141-99.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-c59ml

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-c59ml to ip-10-0-141-255.ec2.internal

openshift-ingress

e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9 to ip-10-0-141-99.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-3aa245-59c7f7d78-bjsf7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3aa245-59c7f7d78-bjsf7 to ip-10-0-133-172.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-adba81-795f4bc679-rlb75

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-adba81-795f4bc679-rlb75 to ip-10-0-141-255.ec2.internal

openshift-ingress

e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn to ip-10-0-141-99.ec2.internal

openshift-ingress

e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7

Scheduled

Successfully assigned openshift-ingress/e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7 to ip-10-0-141-99.ec2.internal

openshift-ingress

payload-processing-e2e-autores-0ffe43-56b9f9b997-74cbj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-0ffe43-56b9f9b997-74cbj to ip-10-0-141-255.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-4209a4-679b78d797-xfmbp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-4209a4-679b78d797-xfmbp to ip-10-0-141-255.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-b981e2-7cf8fb8467-6676s

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-b981e2-7cf8fb8467-6676s to ip-10-0-133-172.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-3d28c1-58d5b6cd79-2gfkt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-3d28c1-58d5b6cd79-2gfkt to ip-10-0-141-255.ec2.internal

openshift-ingress

e2e-ait-82b6dcec-openshift-default-844946c46-5s98v

Scheduled

Successfully assigned openshift-ingress/e2e-ait-82b6dcec-openshift-default-844946c46-5s98v to ip-10-0-141-99.ec2.internal

openshift-ingress

e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7 to ip-10-0-141-99.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-58a8ca-5465987875-hbpl2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-58a8ca-5465987875-hbpl2 to ip-10-0-141-255.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-3aa245-85bf5869c5-8vx65

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-3aa245-85bf5869c5-8vx65 to ip-10-0-133-172.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-8ed3d70b-56ddd5dc7d-k699x

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-8ed3d70b-56ddd5dc7d-k699x to ip-10-0-141-255.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-58a8ca-597c4d899d-tck47

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-58a8ca-597c4d899d-tck47 to ip-10-0-133-172.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-2krc7

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2krc7 to ip-10-0-141-99.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w4-59b357-6978cbb9-hmttn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-59b357-6978cbb9-hmttn to ip-10-0-141-255.ec2.internal

openshift-ingress

payload-processing-e2e-mt-027c8100-5cf9c98645-cxtv7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-027c8100-5cf9c98645-cxtv7 to ip-10-0-141-99.ec2.internal

openshift-ingress

e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz to ip-10-0-141-99.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-wn6lc

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wn6lc to ip-10-0-141-99.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-aa9dcd-6c8b667b6c-hxrwh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-aa9dcd-6c8b667b6c-hxrwh to ip-10-0-141-255.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-adba81-5ffd65b88b-g94sf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-adba81-5ffd65b88b-g94sf to ip-10-0-133-172.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-ab559b-79b445f574-f5dhw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-ab559b-79b445f574-f5dhw to ip-10-0-141-99.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-123a30-c75879546-l8ntk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-123a30-c75879546-l8ntk to ip-10-0-141-255.ec2.internal

openshift-ingress

e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf to ip-10-0-141-99.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-z62nt

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-z62nt to ip-10-0-141-255.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-3d28c1-9f97856d6-lq8xp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-3d28c1-9f97856d6-lq8xp to ip-10-0-141-255.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-4209a4-7b767c9766-hc7g8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-4209a4-7b767c9766-hc7g8 to ip-10-0-141-255.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-4583f0-656d576d6c-25m5v

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-4583f0-656d576d6c-25m5v to ip-10-0-141-255.ec2.internal

openshift-ingress

e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5 to ip-10-0-141-99.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-35758849-5df745b4f8-k4mw8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-35758849-5df745b4f8-k4mw8 to ip-10-0-141-255.ec2.internal

openshift-ingress

e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms to ip-10-0-141-99.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-aa9dcd-59cd7b7dcd-np9nw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-aa9dcd-59cd7b7dcd-np9nw to ip-10-0-141-255.ec2.internal

openshift-ingress

e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x

Scheduled

Successfully assigned openshift-ingress/e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x to ip-10-0-141-99.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-0ffe43-7dcb8c5c6b-656ll

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-0ffe43-7dcb8c5c6b-656ll to ip-10-0-141-255.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-7f10d8-54cc6fb958-wm5cf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7f10d8-54cc6fb958-wm5cf to ip-10-0-141-255.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-b981e2-bc886767d-zbkng

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-b981e2-bc886767d-zbkng to ip-10-0-133-172.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-a13357-7b6898dccd-gzcx5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-a13357-7b6898dccd-gzcx5 to ip-10-0-141-99.ec2.internal

openshift-ingress

router-default-6454c8d7fd-6mjst

Scheduled

Successfully assigned openshift-ingress/router-default-6454c8d7fd-6mjst to ip-10-0-141-255.ec2.internal

openshift-ingress

payload-processing-e2e-mt-6ad61446-5467586ccc-xcfxl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-6ad61446-5467586ccc-xcfxl to ip-10-0-141-99.ec2.internal

openshift-ingress

e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d to ip-10-0-141-99.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-8ed3d70b-76bd69d654-g88m6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-8ed3d70b-76bd69d654-g88m6 to ip-10-0-141-255.ec2.internal

openshift-ingress

e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h

Scheduled

Successfully assigned openshift-ingress/e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h to ip-10-0-141-99.ec2.internal

openshift-ingress

e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb

Scheduled

Successfully assigned openshift-ingress/e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb to ip-10-0-141-99.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-82b6dcec-7fddd48d94-fkxns

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-82b6dcec-7fddd48d94-fkxns to ip-10-0-141-99.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-0144e4de-64bd79d4c4-pqjqc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-0144e4de-64bd79d4c4-pqjqc to ip-10-0-141-255.ec2.internal

openshift-ingress

e2e-noten-268aff-openshift-default-57b8fb58f4-f6dk4

Scheduled

Successfully assigned openshift-ingress/e2e-noten-268aff-openshift-default-57b8fb58f4-f6dk4 to ip-10-0-141-99.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-7229m

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-7229m to ip-10-0-141-99.ec2.internal

openshift-ingress

e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc to ip-10-0-141-99.ec2.internal

openshift-ingress

payload-processing-e2e-ait-82b6dcec-c47f778d5-zt6s8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-82b6dcec-c47f778d5-zt6s8 to ip-10-0-141-255.ec2.internal

openshift-ingress

payload-processing-e2e-ait-0144e4de-78c954fdc7-hnhw9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-0144e4de-78c954fdc7-hnhw9 to ip-10-0-141-255.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-jzpjr

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jzpjr to ip-10-0-141-99.ec2.internal

openshift-ingress

e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn to ip-10-0-141-99.ec2.internal

openshift-ingress

e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2 to ip-10-0-141-99.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-59b357-5cd87464cd-s9sr4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-59b357-5cd87464cd-s9sr4 to ip-10-0-141-255.ec2.internal

openshift-ingress

e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n to ip-10-0-141-99.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-62f806-db68bc95c-5d5dg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-62f806-db68bc95c-5d5dg to ip-10-0-141-99.ec2.internal

openshift-ingress

kube-auth-proxy-666584dbdf-c64gg

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-666584dbdf-c64gg to ip-10-0-141-99.ec2.internal

openshift-ingress

e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl to ip-10-0-141-99.ec2.internal

openshift-ingress

kube-auth-proxy-666584dbdf-v2qxh

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-666584dbdf-v2qxh to ip-10-0-133-172.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-123a30-5f56bf8b75-h2dwv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-123a30-5f56bf8b75-h2dwv to ip-10-0-141-99.ec2.internal

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-6454c8d7fd from 0 to 1

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer
(x10)

openshift-ingress

replicaset-controller

router-default-6454c8d7fd

FailedCreate

Error creating: pods "router-default-6454c8d7fd-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x16)

openshift-ingress

replicaset-controller

router-default-6454c8d7fd

FailedCreate

Error creating: pods "router-default-6454c8d7fd-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-6454c8d7fd

SuccessfulCreate

Created pod: router-default-6454c8d7fd-6mjst
(x5)

openshift-ingress

kubelet

router-default-6454c8d7fd-6mjst

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x6)

openshift-ingress

kubelet

router-default-6454c8d7fd-6mjst

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

kubelet

router-default-6454c8d7fd-6mjst

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eaa467bc105be2f7695ecfea0f0c53f4c5cd52f1f705da378c7a33d13f1d102f" already present on machine

openshift-ingress

kubelet

router-default-6454c8d7fd-6mjst

Created

Created container: router

openshift-ingress

kubelet

router-default-6454c8d7fd-6mjst

Started

Started container router

openshift-ingress

multus

router-default-6454c8d7fd-6mjst

AddedInterface

Add eth0 [10.134.0.9/23] from ovn-kubernetes

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-666584dbdf from 0 to 2
(x5)

openshift-ingress

replicaset-controller

kube-auth-proxy-666584dbdf

FailedCreate

Error creating: pods "kube-auth-proxy-666584dbdf-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

kubelet

kube-auth-proxy-666584dbdf-c64gg

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-666584dbdf-c64gg

AddedInterface

Add eth0 [10.133.0.26/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

kube-auth-proxy-666584dbdf

SuccessfulCreate

Created pod: kube-auth-proxy-666584dbdf-c64gg

openshift-ingress

replicaset-controller

kube-auth-proxy-666584dbdf

SuccessfulCreate

Created pod: kube-auth-proxy-666584dbdf-v2qxh

openshift-ingress

kubelet

kube-auth-proxy-666584dbdf-v2qxh

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-666584dbdf-v2qxh

AddedInterface

Add eth0 [10.132.0.24/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-2krc7

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-2krc7

AddedInterface

Add eth0 [10.133.0.27/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-666584dbdf-c64gg

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.926s (2.926s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-2krc7

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

kube-auth-proxy-666584dbdf-c64gg

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-666584dbdf-c64gg

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-666584dbdf-v2qxh

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-666584dbdf-v2qxh

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 3.982s (3.982s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-666584dbdf-v2qxh

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-2krc7

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-2krc7

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 4.948s (4.948s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-2krc7

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-2krc7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-2krc7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-wn6lc

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-wn6lc

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-wn6lc

AddedInterface

Add eth0 [10.133.0.29/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-c59ml

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-c59ml

AddedInterface

Add eth0 [10.134.0.26/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-c59ml

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-c59ml

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.215s (2.215s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-c59ml

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-c59ml

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-c59ml

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-c59ml

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-2krc7

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-2krc7

Killing

Stopping container discovery

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-wn6lc

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-wn6lc

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-wn6lc

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 19.13s (19.13s including waiting). Image size: 181318953 bytes.

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-jzpjr

AddedInterface

Add eth0 [10.133.0.44/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-jzpjr

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-7229m

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-z62nt
(x6)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-7229m

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-7229m

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-z62nt

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-5b54b7fbb7-z62nt

AddedInterface

Add eth0 [10.134.0.28/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-z62nt

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-7229m

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.481s (1.481s including waiting). Image size: 166453408 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-7229m

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-7229m

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-z62nt

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.365s (1.365s including waiting). Image size: 166453408 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-z62nt

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-jzpjr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-jzpjr

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-jzpjr

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-jzpjr

Unhealthy

Startup probe failed: Get "http://10.133.0.44:15021/healthz/ready": dial tcp 10.133.0.44:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-jzpjr

ProbeError

Startup probe error: Get "http://10.133.0.44:15021/healthz/ready": dial tcp 10.133.0.44:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-inf-a-3d28c1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-3d28c1

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-a13357

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-a13357

openshift-ingress

replicaset-controller

e2e-inf-a-3d28c1-openshift-default-6745f5d8d8

SuccessfulCreate

Created pod: e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn

openshift-ingress

multus

e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-59b357

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-59b357

openshift-ingress

deployment-controller

e2e-worker-w4-59b357-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-59b357-openshift-default-84b8cd88c8 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w4-59b357-openshift-default-84b8cd88c8

SuccessfulCreate

Created pod: e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk

openshift-ingress

deployment-controller

e2e-inf-a-3d28c1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-3d28c1-openshift-default-6745f5d8d8 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w0-a13357-openshift-default-6dbf49559b

SuccessfulCreate

Created pod: e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9

openshift-ingress

deployment-controller

e2e-worker-w0-a13357-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-a13357-openshift-default-6dbf49559b from 0 to 1

openshift-ingress

multus

e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk

AddedInterface

Add eth0 [10.133.0.54/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-3d28c1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-3d28c1-58d5b6cd79 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-3d28c1-9f97856d6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-3d28c1-9f97856d6-lq8xp

openshift-ingress

kubelet

payload-processing-e2e-inf-a-3d28c1-58d5b6cd79-2gfkt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-3d28c1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-3d28c1-9f97856d6 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-3d28c1-9f97856d6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-3d28c1-9f97856d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-3d28c1: serviceaccount "payload-processing-e2e-inf-a-3d28c1" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-3d28c1-9f97856d6-lq8xp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-3d28c1-9f97856d6-lq8xp

AddedInterface

Add eth0 [10.134.0.32/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-inf-a-3d28c1-58d5b6cd79-2gfkt

AddedInterface

Add eth0 [10.134.0.33/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-3d28c1-58d5b6cd79

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-3d28c1-58d5b6cd79-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-3d28c1: serviceaccount "payload-processing-e2e-inf-a-3d28c1" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-3d28c1-58d5b6cd79

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-3d28c1-58d5b6cd79-2gfkt

openshift-ingress

kubelet

payload-processing-e2e-inf-a-3d28c1-58d5b6cd79-2gfkt

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-3d28c1-9f97856d6-lq8xp

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-3d28c1-58d5b6cd79-2gfkt

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-3d28c1-9f97856d6-lq8xp

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-59b357-5cd87464cd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-59b357-5cd87464cd-s9sr4

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-59b357

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-59b357-5cd87464cd from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-59b357

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-59b357-6978cbb9 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-59b357-6978cbb9

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-59b357-6978cbb9-hmttn
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-59b357-6978cbb9

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-59b357-6978cbb9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-59b357: serviceaccount "payload-processing-e2e-worker-w4-59b357" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-59b357-5cd87464cd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-59b357-5cd87464cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-59b357: serviceaccount "payload-processing-e2e-worker-w4-59b357" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-59b357-6978cbb9-hmttn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-59b357-6978cbb9-hmttn

Created

Created container: payload-processing

openshift-ingress

GatewayAuthBootstrap

e2e-autores-0ffe43

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-autores-0ffe43-authn-ssl: envoyfilters.networking.istio.io "e2e-autores-0ffe43-authn-ssl" already exists

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-a13357

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-a13357-55fb4c4c95 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-worker-w4-59b357-6978cbb9-hmttn

AddedInterface

Add eth0 [10.134.0.35/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-a13357

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-a13357-7b6898dccd from 0 to 1

openshift-ingress

deployment-controller

e2e-autores-0ffe43-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-0ffe43-openshift-default-78d47b88c8 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-autores-0ffe43

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-0ffe43

openshift-ingress

replicaset-controller

e2e-autores-0ffe43-openshift-default-78d47b88c8

SuccessfulCreate

Created pod: e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h

openshift-ingress

multus

e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-59b357-5cd87464cd-s9sr4

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-59b357-5cd87464cd-s9sr4

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-59b357-6978cbb9-hmttn

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-59b357-5cd87464cd-s9sr4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-59b357-5cd87464cd-s9sr4

AddedInterface

Add eth0 [10.134.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-a13357-55fb4c4c95-mrhv4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-a13357-55fb4c4c95

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-a13357-55fb4c4c95-mrhv4

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-a13357-7b6898dccd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-a13357-7b6898dccd-gzcx5

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-a13357-7b6898dccd-gzcx5

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-a13357-7b6898dccd-gzcx5

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-a13357-7b6898dccd-gzcx5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-a13357-7b6898dccd-gzcx5

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-a13357-7b6898dccd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-a13357-7b6898dccd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-a13357: serviceaccount "payload-processing-e2e-worker-w0-a13357" not found

openshift-ingress

multus

payload-processing-e2e-worker-w0-a13357-55fb4c4c95-mrhv4

AddedInterface

Add eth0 [10.134.0.36/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-a13357-55fb4c4c95-mrhv4

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-a13357-55fb4c4c95-mrhv4

Started

Started container payload-processing
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-a13357-55fb4c4c95

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-a13357-55fb4c4c95-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-a13357: serviceaccount "payload-processing-e2e-worker-w0-a13357" not found

openshift-ingress

deployment-controller

e2e-ait-82b6dcec-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-82b6dcec-openshift-default-844946c46 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-82b6dcec

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-82b6dcec

openshift-ingress

replicaset-controller

e2e-ait-82b6dcec-openshift-default-844946c46

SuccessfulCreate

Created pod: e2e-ait-82b6dcec-openshift-default-844946c46-5s98v

openshift-ingress

kubelet

e2e-ait-82b6dcec-openshift-default-844946c46-5s98v

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-ait-82b6dcec-openshift-default-844946c46-5s98v

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-ait-82b6dcec-openshift-default-844946c46-5s98v

Created

Created container: istio-proxy

openshift-ingress

multus

e2e-ait-82b6dcec-openshift-default-844946c46-5s98v

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-0ffe43-7dcb8c5c6b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-0ffe43-7dcb8c5c6b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-0ffe43: serviceaccount "payload-processing-e2e-autores-0ffe43" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-0ffe43-7dcb8c5c6b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-0ffe43-7dcb8c5c6b-656ll

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-0ffe43

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-0ffe43-7dcb8c5c6b from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-autores-0ffe43

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-0ffe43-56b9f9b997 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-0ffe43-56b9f9b997

FailedCreate

Error creating: pods "payload-processing-e2e-autores-0ffe43-56b9f9b997-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-0ffe43: serviceaccount "payload-processing-e2e-autores-0ffe43" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-0ffe43-56b9f9b997

SuccessfulCreate

Created pod: payload-processing-e2e-autores-0ffe43-56b9f9b997-74cbj

openshift-ingress

kubelet

payload-processing-e2e-autores-0ffe43-56b9f9b997-74cbj

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-autores-0ffe43-56b9f9b997-74cbj

AddedInterface

Add eth0 [10.134.0.38/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-autores-0ffe43-7dcb8c5c6b-656ll

AddedInterface

Add eth0 [10.134.0.37/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-0ffe43-7dcb8c5c6b-656ll

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-0ffe43-7dcb8c5c6b-656ll

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-0ffe43-7dcb8c5c6b-656ll

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-0ffe43-56b9f9b997-74cbj

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-0ffe43-56b9f9b997-74cbj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-82b6dcec-c47f778d5

FailedCreate

Error creating: pods "payload-processing-e2e-ait-82b6dcec-c47f778d5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-82b6dcec: serviceaccount "payload-processing-e2e-ait-82b6dcec" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-82b6dcec

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-82b6dcec-7fddd48d94 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-82b6dcec-7fddd48d94

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-82b6dcec-7fddd48d94-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-82b6dcec: serviceaccount "payload-processing-e2e-ait-82b6dcec" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-82b6dcec

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-82b6dcec-c47f778d5 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn

Created

Created container: istio-proxy

openshift-ingress

multus

payload-pre-processing-e2e-ait-82b6dcec-7fddd48d94-fkxns

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-82b6dcec-c47f778d5-zt6s8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-82b6dcec-c47f778d5-zt6s8

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn

Started

Started container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-inf-b-ab559b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-ab559b

openshift-ingress

deployment-controller

e2e-inf-b-ab559b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-ab559b-openshift-default-6b94d48488 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-82b6dcec-c47f778d5

SuccessfulCreate

Created pod: payload-processing-e2e-ait-82b6dcec-c47f778d5-zt6s8

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-82b6dcec-7fddd48d94-fkxns

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-82b6dcec-7fddd48d94-fkxns

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-82b6dcec-7fddd48d94-fkxns

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-inf-b-ab559b-openshift-default-6b94d48488

SuccessfulCreate

Created pod: e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-82b6dcec-7fddd48d94

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-82b6dcec-7fddd48d94-fkxns

openshift-ingress

multus

e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d

AddedInterface

Add eth0 [10.133.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-82b6dcec-c47f778d5-zt6s8

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-82b6dcec-c47f778d5-zt6s8

Started

Started container payload-processing
(x7)

openshift-ingress

kubelet

e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk

ProbeError

Startup probe error: Get "http://10.133.0.54:15021/healthz/ready": dial tcp 10.133.0.54:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk

Unhealthy

Startup probe failed: Get "http://10.133.0.54:15021/healthz/ready": dial tcp 10.133.0.54:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn

Unhealthy

Startup probe failed: Get "http://10.133.0.53:15021/healthz/ready": dial tcp 10.133.0.53:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn

ProbeError

Startup probe error: Get "http://10.133.0.53:15021/healthz/ready": dial tcp 10.133.0.53:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-inf-b-ab559b-69c6fb8479-4m56j

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-ab559b-79b445f574-f5dhw

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-ab559b-79b445f574

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-ab559b-79b445f574-f5dhw

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-ab559b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-ab559b-79b445f574 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-ab559b-79b445f574

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-ab559b-79b445f574-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-ab559b: serviceaccount "payload-processing-e2e-inf-b-ab559b" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-ab559b-79b445f574-f5dhw

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-ab559b-79b445f574-f5dhw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-ab559b-79b445f574-f5dhw

AddedInterface

Add eth0 [10.133.0.62/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-ab559b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-ab559b-69c6fb8479 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-inf-b-ab559b-69c6fb8479-4m56j

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-ab559b-69c6fb8479-4m56j

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-b-ab559b-69c6fb8479-4m56j

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-ab559b-69c6fb8479

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-ab559b-69c6fb8479-4m56j
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-ab559b-69c6fb8479

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-ab559b-69c6fb8479-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-ab559b: serviceaccount "payload-processing-e2e-inf-b-ab559b" not found
(x2)

openshift-ingress

kubelet

e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x7)

openshift-ingress

kubelet

e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h

ProbeError

Startup probe error: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h

Unhealthy

Startup probe failed: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9

Unhealthy

Startup probe failed: Get "http://10.133.0.55:15021/healthz/ready": dial tcp 10.133.0.55:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9

ProbeError

Startup probe error: Get "http://10.133.0.55:15021/healthz/ready": dial tcp 10.133.0.55:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-82b6dcec-7fddd48d94-fkxns

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-82b6dcec-openshift-default-844946c46-5s98v

Killing

Stopping container istio-proxy

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ait-82b6dcec

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ait-82b6dcec: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ait-82b6dcec": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ait-82b6dcec, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: d6fe9ecd-0e3c-4e20-97af-d1523bd0d0b3, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-ait-82b6dcec-c47f778d5-zt6s8

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-migrate-8ed3d70b-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-8ed3d70b-gw

openshift-ingress

replicaset-controller

e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d

SuccessfulCreate

Created pod: e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf

openshift-ingress

deployment-controller

e2e-migrate-8ed3d70b-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d from 0 to 1

openshift-ingress

multus

e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf

AddedInterface

Add eth0 [10.133.0.64/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d

Unhealthy

Startup probe failed: Get "http://10.133.0.61:15021/healthz/ready": dial tcp 10.133.0.61:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d

ProbeError

Startup probe error: Get "http://10.133.0.61:15021/healthz/ready": dial tcp 10.133.0.61:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-8ed3d70b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-8ed3d70b-56ddd5dc7d from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-8ed3d70b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-8ed3d70b-76bd69d654 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-8ed3d70b-76bd69d654

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-8ed3d70b-76bd69d654-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-8ed3d70b: serviceaccount "payload-processing-e2e-migrate-8ed3d70b" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-8ed3d70b-56ddd5dc7d

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-8ed3d70b-56ddd5dc7d-k699x
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-8ed3d70b-56ddd5dc7d

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-8ed3d70b-56ddd5dc7d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-8ed3d70b: serviceaccount "payload-processing-e2e-migrate-8ed3d70b" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-8ed3d70b-76bd69d654

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-8ed3d70b-76bd69d654-g88m6

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-8ed3d70b-76bd69d654-g88m6

FailedMount

MountVolume.SetUp failed for volume "plugins-config-volume" : failed to sync configmap cache: timed out waiting for the condition

openshift-ingress

kubelet

payload-processing-e2e-migrate-8ed3d70b-56ddd5dc7d-k699x

FailedMount

MountVolume.SetUp failed for volume "plugins-config-volume" : failed to sync configmap cache: timed out waiting for the condition

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-8ed3d70b-76bd69d654-g88m6

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-migrate-8ed3d70b-56ddd5dc7d-k699x

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-8ed3d70b-76bd69d654-g88m6

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-8ed3d70b-56ddd5dc7d-k699x

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-8ed3d70b-56ddd5dc7d-k699x

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-8ed3d70b-76bd69d654-g88m6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-migrate-8ed3d70b-56ddd5dc7d-k699x

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-migrate-8ed3d70b-76bd69d654-g88m6

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf

ProbeError

Startup probe error: Get "http://10.133.0.64:15021/healthz/ready": dial tcp 10.133.0.64:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf

Unhealthy

Startup probe failed: Get "http://10.133.0.64:15021/healthz/ready": dial tcp 10.133.0.64:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-migrate-8ed3d70b-56ddd5dc7d-k699x

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-8ed3d70b-76bd69d654-g88m6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ait-0144e4de

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-0144e4de

openshift-ingress

deployment-controller

e2e-ait-0144e4de-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-0144e4de-openshift-default-86cb848f5d from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-0144e4de-openshift-default-86cb848f5d

SuccessfulCreate

Created pod: e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9

openshift-ingress

multus

e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9

AddedInterface

Add eth0 [10.133.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-migrate-8ed3d70b-gw-openshift-default-7dbfdb54d-bwrbf

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-0144e4de-78c954fdc7

FailedCreate

Error creating: pods "payload-processing-e2e-ait-0144e4de-78c954fdc7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-0144e4de: serviceaccount "payload-processing-e2e-ait-0144e4de" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-0144e4de-64bd79d4c4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-0144e4de-64bd79d4c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-0144e4de: serviceaccount "payload-processing-e2e-ait-0144e4de" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-0144e4de

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-0144e4de-78c954fdc7 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-0144e4de

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-0144e4de-64bd79d4c4 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-0144e4de-78c954fdc7

SuccessfulCreate

Created pod: payload-processing-e2e-ait-0144e4de-78c954fdc7-hnhw9

openshift-ingress

kubelet

payload-processing-e2e-ait-0144e4de-78c954fdc7-hnhw9

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-0144e4de-64bd79d4c4-pqjqc

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-0144e4de-64bd79d4c4-pqjqc

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-0144e4de-64bd79d4c4-pqjqc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-0144e4de-64bd79d4c4-pqjqc

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-0144e4de-64bd79d4c4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-0144e4de-64bd79d4c4-pqjqc

openshift-ingress

multus

payload-processing-e2e-ait-0144e4de-78c954fdc7-hnhw9

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-0144e4de-78c954fdc7-hnhw9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-0144e4de-78c954fdc7-hnhw9

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9

Unhealthy

Startup probe failed: Get "http://10.133.0.70:15021/healthz/ready": dial tcp 10.133.0.70:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9

ProbeError

Startup probe error: Get "http://10.133.0.70:15021/healthz/ready": dial tcp 10.133.0.70:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ait-0144e4de-78c954fdc7-hnhw9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-0144e4de-64bd79d4c4-pqjqc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-derive-35758849-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-35758849-openshift-default-5bd7d4f6d8 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-derive-35758849

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-35758849

openshift-ingress

multus

e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7

AddedInterface

Add eth0 [10.133.0.72/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-derive-35758849-openshift-default-5bd7d4f6d8

SuccessfulCreate

Created pod: e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7

openshift-ingress

kubelet

e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ait-0144e4de-openshift-default-86cb848f5d-wrgv9

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-35758849-5c8cc9476f

FailedCreate

Error creating: pods "payload-processing-e2e-derive-35758849-5c8cc9476f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-35758849: serviceaccount "payload-processing-e2e-derive-35758849" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-35758849

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-35758849-5df745b4f8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-35758849-5df745b4f8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-35758849-5df745b4f8-k4mw8
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-35758849-5df745b4f8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-35758849-5df745b4f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-35758849: serviceaccount "payload-processing-e2e-derive-35758849" not found

openshift-ingress

deployment-controller

payload-processing-e2e-derive-35758849

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-35758849-5c8cc9476f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-35758849-5c8cc9476f

SuccessfulCreate

Created pod: payload-processing-e2e-derive-35758849-5c8cc9476f-gf6wl

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-35758849-5df745b4f8-k4mw8

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-35758849-5c8cc9476f-gf6wl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-derive-35758849-5c8cc9476f-gf6wl

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-35758849-5df745b4f8-k4mw8

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-derive-35758849-5c8cc9476f-gf6wl

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-35758849-5df745b4f8-k4mw8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-derive-35758849-5df745b4f8-k4mw8

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-35758849-5c8cc9476f-gf6wl

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-0ffe43-56b9f9b997-74cbj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-0ffe43-7dcb8c5c6b-656ll

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7

Unhealthy

Startup probe failed: Get "http://10.133.0.72:15021/healthz/ready": dial tcp 10.133.0.72:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7

ProbeError

Startup probe error: Get "http://10.133.0.72:15021/healthz/ready": dial tcp 10.133.0.72:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-35758849-5df745b4f8-k4mw8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-derive-35758849-5c8cc9476f-gf6wl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-derive-35758849-openshift-default-5bd7d4f6d8-s7kh7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-explicit-4209a4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-4209a4

openshift-ingress

replicaset-controller

e2e-explicit-4209a4-openshift-default-57976f4696

SuccessfulCreate

Created pod: e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n

openshift-ingress

deployment-controller

e2e-explicit-4209a4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-4209a4-openshift-default-57976f4696 from 0 to 1

openshift-ingress

multus

e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n

AddedInterface

Add eth0 [10.133.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-autores-0ffe43-openshift-default-78d47b88c8-97m7h

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-4209a4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-4209a4-7b767c9766 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-4209a4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-4209a4-679b78d797 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-4209a4-679b78d797

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-4209a4-679b78d797-xfmbp

openshift-ingress

multus

payload-pre-processing-e2e-explicit-4209a4-7b767c9766-hc7g8

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-4209a4-7b767c9766

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-4209a4-7b767c9766-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-4209a4: serviceaccount "payload-processing-e2e-explicit-4209a4" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-4209a4-7b767c9766

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-4209a4-7b767c9766-hc7g8

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-4209a4-7b767c9766-hc7g8

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-4209a4-679b78d797-xfmbp

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-4209a4-679b78d797-xfmbp

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-4209a4-679b78d797-xfmbp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-explicit-4209a4-679b78d797-xfmbp

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-4209a4-7b767c9766-hc7g8

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-4209a4-7b767c9766-hc7g8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-4209a4-679b78d797

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-4209a4-679b78d797-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-4209a4: serviceaccount "payload-processing-e2e-explicit-4209a4" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-a13357-7b6898dccd-gzcx5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-a13357-55fb4c4c95-mrhv4

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-worker-w0-a13357-openshift-default-6dbf49559b-zznj9

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n

ProbeError

Startup probe error: Get "http://10.133.0.74:15021/healthz/ready": dial tcp 10.133.0.74:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n

Unhealthy

Startup probe failed: Get "http://10.133.0.74:15021/healthz/ready": dial tcp 10.133.0.74:15021: connect: connection refused

openshift-ingress

multus

e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb

AddedInterface

Add eth0 [10.133.0.76/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-mt-6ad61446

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-6ad61446

openshift-ingress

deployment-controller

e2e-mt-6ad61446-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-6ad61446-openshift-default-76976d5984 from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-6ad61446-openshift-default-76976d5984

SuccessfulCreate

Created pod: e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-6ad61446

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-6ad61446-f4f6c84f4 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-6ad61446-5467586ccc

FailedCreate

Error creating: pods "payload-processing-e2e-mt-6ad61446-5467586ccc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-6ad61446: serviceaccount "payload-processing-e2e-mt-6ad61446" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-6ad61446-f4f6c84f4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-6ad61446-f4f6c84f4-9ks2m

openshift-ingress

deployment-controller

payload-processing-e2e-mt-6ad61446

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-6ad61446-5467586ccc from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-6ad61446-f4f6c84f4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-6ad61446-f4f6c84f4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-6ad61446: serviceaccount "payload-processing-e2e-mt-6ad61446" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-6ad61446-5467586ccc

SuccessfulCreate

Created pod: payload-processing-e2e-mt-6ad61446-5467586ccc-xcfxl

openshift-ingress

kubelet

payload-processing-e2e-mt-6ad61446-5467586ccc-xcfxl

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-mt-6ad61446-5467586ccc-xcfxl

AddedInterface

Add eth0 [10.133.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-6ad61446-5467586ccc-xcfxl

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-6ad61446-f4f6c84f4-9ks2m

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-6ad61446-5467586ccc-xcfxl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-6ad61446-f4f6c84f4-9ks2m

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-6ad61446-f4f6c84f4-9ks2m

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-6ad61446-f4f6c84f4-9ks2m

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-4209a4-7b767c9766-hc7g8

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-explicit-4209a4

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-explicit-4209a4: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-explicit-4209a4": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-explicit-4209a4, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 535926db-5a43-43bc-b128-f097335da5f0, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-explicit-4209a4-679b78d797-xfmbp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-explicit-4209a4-openshift-default-57976f4696-7tn9n

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-noten-268aff-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-268aff-openshift-default-57b8fb58f4 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-noten-268aff

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-268aff

openshift-ingress

replicaset-controller

e2e-noten-268aff-openshift-default-57b8fb58f4

SuccessfulCreate

Created pod: e2e-noten-268aff-openshift-default-57b8fb58f4-f6dk4

openshift-ingress

kubelet

e2e-noten-268aff-openshift-default-57b8fb58f4-f6dk4

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-noten-268aff-openshift-default-57b8fb58f4-f6dk4

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-noten-268aff-openshift-default-57b8fb58f4-f6dk4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

multus

e2e-noten-268aff-openshift-default-57b8fb58f4-f6dk4

AddedInterface

Add eth0 [10.133.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb

ProbeError

Readiness probe error: Get "http://10.133.0.76:15021/healthz/ready": read tcp 10.133.0.2:59868->10.133.0.76:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb

Unhealthy

Readiness probe failed: Get "http://10.133.0.76:15021/healthz/ready": read tcp 10.133.0.2:59868->10.133.0.76:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb

Unhealthy

Startup probe failed: Get "http://10.133.0.76:15021/healthz/ready": dial tcp 10.133.0.76:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb

ProbeError

Startup probe error: Get "http://10.133.0.76:15021/healthz/ready": dial tcp 10.133.0.76:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-mt-6ad61446-5467586ccc-xcfxl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-6ad61446-f4f6c84f4-9ks2m

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-noten-268aff-openshift-default-57b8fb58f4-f6dk4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-6ad61446-openshift-default-76976d5984-mhzwb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-noten-268aff-openshift-default-57b8fb58f4-f6dk4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-noten-268aff-openshift-default-57b8fb58f4-f6dk4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

multus

e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc

AddedInterface

Add eth0 [10.133.0.81/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-a-w2-62f806-openshift-default-678f9b6b98

SuccessfulCreate

Created pod: e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc

openshift-ingress

deployment-controller

e2e-shared-a-w2-62f806-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-62f806-openshift-default-678f9b6b98 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-62f806

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-62f806
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-62f806-85c544dfd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-62f806-85c544dfd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-62f806: serviceaccount "payload-processing-e2e-shared-a-w2-62f806" not found

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-62f806-85c544dfd-7ght8

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-62f806

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-62f806-db68bc95c from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-62f806-db68bc95c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-62f806-db68bc95c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-62f806: serviceaccount "payload-processing-e2e-shared-a-w2-62f806" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-62f806-db68bc95c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-62f806-db68bc95c-5d5dg

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-62f806

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-62f806-85c544dfd from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-62f806-85c544dfd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-62f806-85c544dfd-7ght8

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-62f806-db68bc95c-5d5dg

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-62f806-db68bc95c-5d5dg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-62f806-85c544dfd-7ght8

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-62f806-db68bc95c-5d5dg

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-62f806-db68bc95c-5d5dg

AddedInterface

Add eth0 [10.133.0.82/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-62f806-85c544dfd-7ght8

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-62f806-85c544dfd-7ght8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

multus

e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2

AddedInterface

Add eth0 [10.133.0.84/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-aa9dcd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-aa9dcd

openshift-ingress

deployment-controller

e2e-shared-b-w2-aa9dcd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb

SuccessfulCreate

Created pod: e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc

ProbeError

Startup probe error: Get "http://10.133.0.81:15021/healthz/ready": dial tcp 10.133.0.81:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc

Unhealthy

Startup probe failed: Get "http://10.133.0.81:15021/healthz/ready": dial tcp 10.133.0.81:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-3d28c1-9f97856d6-lq8xp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-3d28c1-58d5b6cd79-2gfkt

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-aa9dcd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-aa9dcd-6c8b667b6c from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-aa9dcd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-aa9dcd-59cd7b7dcd from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-aa9dcd-59cd7b7dcd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-aa9dcd-59cd7b7dcd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-aa9dcd: serviceaccount "payload-processing-e2e-shared-b-w2-aa9dcd" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-aa9dcd-6c8b667b6c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-aa9dcd-6c8b667b6c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-aa9dcd: serviceaccount "payload-processing-e2e-shared-b-w2-aa9dcd" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-aa9dcd-6c8b667b6c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-aa9dcd-6c8b667b6c-hxrwh

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-aa9dcd-6c8b667b6c-hxrwh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-aa9dcd-6c8b667b6c-hxrwh

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-aa9dcd-59cd7b7dcd-np9nw

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-aa9dcd-59cd7b7dcd-np9nw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-aa9dcd-59cd7b7dcd-np9nw

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-aa9dcd-59cd7b7dcd-np9nw

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-aa9dcd-6c8b667b6c-hxrwh

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-aa9dcd-59cd7b7dcd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-aa9dcd-59cd7b7dcd-np9nw

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-aa9dcd-6c8b667b6c-hxrwh

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-3d28c1-openshift-default-6745f5d8d8-mdxtn

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-ab559b-79b445f574-f5dhw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-ab559b-69c6fb8479-4m56j

Killing

Stopping container payload-processing
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2

ProbeError

Startup probe error: Get "http://10.133.0.84:15021/healthz/ready": dial tcp 10.133.0.84:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2

Unhealthy

Startup probe failed: Get "http://10.133.0.84:15021/healthz/ready": dial tcp 10.133.0.84:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-mt-027c8100-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-027c8100-openshift-default-85cdb9b7cb from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-027c8100

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-027c8100

openshift-ingress

replicaset-controller

e2e-mt-027c8100-openshift-default-85cdb9b7cb

SuccessfulCreate

Created pod: e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x

openshift-ingress

multus

e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x

AddedInterface

Add eth0 [10.133.0.87/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-ab559b-openshift-default-6b94d48488-hx84d

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-w3-123a30-openshift-default-79444bfb7b

SuccessfulCreate

Created pod: e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-123a30

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-123a30

openshift-ingress

deployment-controller

e2e-shared-a-w3-123a30-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-123a30-openshift-default-79444bfb7b from 0 to 1

openshift-ingress

multus

e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl

AddedInterface

Add eth0 [10.133.0.88/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-mt-027c8100

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-027c8100-5cf9c98645 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-027c8100

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-027c8100-848b646b9d from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-027c8100-5cf9c98645

FailedCreate

Error creating: pods "payload-processing-e2e-mt-027c8100-5cf9c98645-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-027c8100: serviceaccount "payload-processing-e2e-mt-027c8100" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-027c8100-5cf9c98645

SuccessfulCreate

Created pod: payload-processing-e2e-mt-027c8100-5cf9c98645-cxtv7

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-027c8100-848b646b9d-jwglj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-mt-027c8100-848b646b9d-jwglj

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-027c8100-848b646b9d-jwglj

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-027c8100-848b646b9d-jwglj

Started

Started container payload-pre-processing
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-027c8100-848b646b9d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-027c8100-848b646b9d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-027c8100: serviceaccount "payload-processing-e2e-mt-027c8100" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-027c8100-848b646b9d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-027c8100-848b646b9d-jwglj

openshift-ingress

kubelet

payload-processing-e2e-mt-027c8100-5cf9c98645-cxtv7

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-mt-027c8100-5cf9c98645-cxtv7

AddedInterface

Add eth0 [10.133.0.89/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-027c8100-5cf9c98645-cxtv7

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-027c8100-5cf9c98645-cxtv7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-123a30-c75879546

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-123a30-c75879546-l8ntk

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-123a30

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-123a30-c75879546 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-123a30-5f56bf8b75

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-123a30-5f56bf8b75-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-123a30: serviceaccount "payload-processing-e2e-shared-a-w3-123a30" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-123a30-5f56bf8b75

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-123a30-5f56bf8b75-h2dwv
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-123a30-c75879546

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-123a30-c75879546-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-123a30: serviceaccount "payload-processing-e2e-shared-a-w3-123a30" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-123a30

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-123a30-5f56bf8b75 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-123a30-5f56bf8b75-h2dwv

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-123a30-5f56bf8b75-h2dwv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-123a30-c75879546-l8ntk

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-123a30-c75879546-l8ntk

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-123a30-c75879546-l8ntk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-123a30-c75879546-l8ntk

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-123a30-5f56bf8b75-h2dwv

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-123a30-5f56bf8b75-h2dwv

AddedInterface

Add eth0 [10.133.0.90/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x

ProbeError

Startup probe error: Get "http://10.133.0.87:15021/healthz/ready": dial tcp 10.133.0.87:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-shared-b-w3-7f10d8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58

SuccessfulCreate

Created pod: e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-7f10d8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-7f10d8
(x6)

openshift-ingress

kubelet

e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x

Unhealthy

Startup probe failed: Get "http://10.133.0.87:15021/healthz/ready": dial tcp 10.133.0.87:15021: connect: connection refused

openshift-ingress

multus

e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5

AddedInterface

Add eth0 [10.133.0.91/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl

Started

Started container istio-proxy

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-7f10d8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-7f10d8-54cc6fb958 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-7f10d8-54cc6fb958

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-7f10d8-54cc6fb958-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-7f10d8: serviceaccount "payload-processing-e2e-shared-b-w3-7f10d8" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-7f10d8-54cc6fb958

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-7f10d8-54cc6fb958-wm5cf
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-7f10d8-868497d6c7

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-7f10d8-868497d6c7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-7f10d8: serviceaccount "payload-processing-e2e-shared-b-w3-7f10d8" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-7f10d8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-7f10d8-868497d6c7 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-7f10d8-54cc6fb958-wm5cf

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-7f10d8-54cc6fb958-wm5cf

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-7f10d8-868497d6c7-85nt2

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-7f10d8-868497d6c7-85nt2

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-7f10d8-868497d6c7-85nt2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-7f10d8-868497d6c7-85nt2

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-7f10d8-54cc6fb958-wm5cf

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-7f10d8-54cc6fb958-wm5cf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-7f10d8-868497d6c7

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-7f10d8-868497d6c7-85nt2
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl

ProbeError

Startup probe error: Get "http://10.133.0.88:15021/healthz/ready": dial tcp 10.133.0.88:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl

Unhealthy

Startup probe failed: Get "http://10.133.0.88:15021/healthz/ready": dial tcp 10.133.0.88:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5

Unhealthy

Startup probe failed: Get "http://10.133.0.91:15021/healthz/ready": dial tcp 10.133.0.91:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5

ProbeError

Startup probe error: Get "http://10.133.0.91:15021/healthz/ready": dial tcp 10.133.0.91:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-027c8100-848b646b9d-jwglj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-027c8100-5cf9c98645-cxtv7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-027c8100-openshift-default-85cdb9b7cb-fl25x

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-api-a-4583f0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-4583f0

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-59b357-5cd87464cd-s9sr4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-59b357-6978cbb9-hmttn

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

e2e-api-a-4583f0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-4583f0-openshift-default-68b9ddcbdd from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-4583f0-openshift-default-68b9ddcbdd

SuccessfulCreate

Created pod: e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz

openshift-ingress

multus

e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz

AddedInterface

Add eth0 [10.133.0.95/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-4583f0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-4583f0-656d576d6c from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-4583f0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-4583f0-5cfd4d5b5d from 0 to 1

openshift-ingress

multus

payload-processing-e2e-api-a-4583f0-656d576d6c-25m5v

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-4583f0-656d576d6c

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-4583f0-656d576d6c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-4583f0: serviceaccount "payload-processing-e2e-api-a-4583f0" not found

openshift-ingress

kubelet

payload-processing-e2e-api-a-4583f0-656d576d6c-25m5v

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-4583f0-5cfd4d5b5d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-4583f0-5cfd4d5b5d-r5n4k

openshift-ingress

kubelet

payload-processing-e2e-api-a-4583f0-656d576d6c-25m5v

Started

Started container payload-processing
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-4583f0-5cfd4d5b5d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-4583f0-5cfd4d5b5d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-4583f0: serviceaccount "payload-processing-e2e-api-a-4583f0" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-4583f0-5cfd4d5b5d-r5n4k

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-e2e-api-a-4583f0-5cfd4d5b5d-r5n4k

AddedInterface

Add eth0 [10.132.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-4583f0-656d576d6c-25m5v

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-4583f0-656d576d6c

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-4583f0-656d576d6c-25m5v

openshift-ingress

kubelet

e2e-worker-w4-59b357-openshift-default-84b8cd88c8-vjhfk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-4583f0-5cfd4d5b5d-r5n4k

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.297s (1.297s including waiting). Image size: 166453408 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-4583f0-5cfd4d5b5d-r5n4k

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-4583f0-5cfd4d5b5d-r5n4k

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz

Created

Created container: istio-proxy

openshift-ingress

replicaset-controller

e2e-api-b-b981e2-openshift-default-68877f56f6

SuccessfulCreate

Created pod: e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms

openshift-ingress

gateway_labeler_controller

e2e-api-b-b981e2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-b981e2

openshift-ingress

deployment-controller

e2e-api-b-b981e2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-b981e2-openshift-default-68877f56f6 from 0 to 1

openshift-ingress

multus

e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms

AddedInterface

Add eth0 [10.133.0.96/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz

ProbeError

Startup probe error: Get "http://10.133.0.95:15021/healthz/ready": dial tcp 10.133.0.95:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz

Unhealthy

Startup probe failed: Get "http://10.133.0.95:15021/healthz/ready": dial tcp 10.133.0.95:15021: connect: connection refused

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-b981e2-bc886767d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-b981e2-bc886767d-zbkng

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-b981e2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-b981e2-bc886767d from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-b981e2-7cf8fb8467

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-b981e2-7cf8fb8467-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-b981e2: serviceaccount "payload-processing-e2e-api-b-b981e2" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-b981e2-7cf8fb8467

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-b981e2-7cf8fb8467-6676s

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-b981e2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-b981e2-7cf8fb8467 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-b981e2-bc886767d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-b981e2-bc886767d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-b981e2: serviceaccount "payload-processing-e2e-api-b-b981e2" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-b981e2-bc886767d-zbkng

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-b981e2-7cf8fb8467-6676s

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-b-b981e2-bc886767d-zbkng

AddedInterface

Add eth0 [10.132.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-b981e2-bc886767d-zbkng

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-b-b981e2-7cf8fb8467-6676s

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-api-b-b981e2-7cf8fb8467-6676s

AddedInterface

Add eth0 [10.132.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-b981e2-bc886767d-zbkng

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-b981e2-7cf8fb8467-6676s

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms

Unhealthy

Startup probe failed: Get "http://10.133.0.96:15021/healthz/ready": dial tcp 10.133.0.96:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms

ProbeError

Startup probe error: Get "http://10.133.0.96:15021/healthz/ready": dial tcp 10.133.0.96:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-api-a-4583f0-656d576d6c-25m5v

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-4583f0-5cfd4d5b5d-r5n4k

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-a-4583f0-openshift-default-68b9ddcbdd-gn8hz

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-b981e2-bc886767d-zbkng

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-b981e2-7cf8fb8467-6676s

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-b-b981e2-openshift-default-68877f56f6-sm5ms

Killing

Stopping container istio-proxy

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-a-w2-62f806

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-a-w2-62f806: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-a-w2-62f806": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-a-w2-62f806, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: e037c0c7-db99-46df-bebf-8e0f7123ace4, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-62f806-db68bc95c-5d5dg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-62f806-85c544dfd-7ght8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc

Unhealthy

Readiness probe failed: Get "http://10.133.0.81:15021/healthz/ready": dial tcp 10.133.0.81:15021: connect: connection refused

openshift-ingress

kubelet

e2e-shared-a-w2-62f806-openshift-default-678f9b6b98-7xbhc

ProbeError

Readiness probe error: Get "http://10.133.0.81:15021/healthz/ready": dial tcp 10.133.0.81:15021: connect: connection refused body:

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-b-w2-aa9dcd

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-b-w2-aa9dcd: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-b-w2-aa9dcd": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-b-w2-aa9dcd, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 0ad2c784-203b-48f0-b2fa-ff18f9464feb, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-aa9dcd-6c8b667b6c-hxrwh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-aa9dcd-59cd7b7dcd-np9nw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w2-aa9dcd-openshift-default-6dcc9d97fb-4z9l2

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-adba81

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-adba81

openshift-ingress

deployment-controller

e2e-ipp-a-adba81-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-adba81-openshift-default-554cf9cf44 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-adba81-openshift-default-554cf9cf44

SuccessfulCreate

Created pod: e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd

openshift-ingress

multus

e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd

AddedInterface

Add eth0 [10.133.0.106/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-adba81

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-adba81-795f4bc679 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-adba81-795f4bc679

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-adba81-795f4bc679-rlb75
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-adba81-795f4bc679

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-adba81-795f4bc679-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-adba81: serviceaccount "payload-processing-e2e-ipp-a-adba81" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-adba81-5ffd65b88b-g94sf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-adba81-5ffd65b88b-g94sf

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-adba81-5ffd65b88b-g94sf

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-a-adba81-795f4bc679-rlb75

AddedInterface

Add eth0 [10.134.0.73/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-adba81-5ffd65b88b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-adba81-5ffd65b88b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-adba81: serviceaccount "payload-processing-e2e-ipp-a-adba81" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-adba81-5ffd65b88b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-adba81-5ffd65b88b-g94sf

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-adba81

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-adba81-5ffd65b88b from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-adba81-5ffd65b88b-g94sf

AddedInterface

Add eth0 [10.132.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-adba81-795f4bc679-rlb75

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-adba81-795f4bc679-rlb75

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-adba81-795f4bc679-rlb75

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd

ProbeError

Startup probe error: Get "http://10.133.0.106:15021/healthz/ready": dial tcp 10.133.0.106:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd

Unhealthy

Startup probe failed: Get "http://10.133.0.106:15021/healthz/ready": dial tcp 10.133.0.106:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-ipp-b-58a8ca-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-58a8ca-openshift-default-5bd8d547b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-58a8ca

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-58a8ca

openshift-ingress

replicaset-controller

e2e-ipp-b-58a8ca-openshift-default-5bd8d547b

SuccessfulCreate

Created pod: e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn

openshift-ingress

multus

e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn

AddedInterface

Add eth0 [10.133.0.107/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-58a8ca-5465987875

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-58a8ca-5465987875-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-58a8ca: serviceaccount "payload-processing-e2e-ipp-b-58a8ca" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-58a8ca

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-58a8ca-597c4d899d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-58a8ca-597c4d899d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-58a8ca-597c4d899d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-58a8ca: serviceaccount "payload-processing-e2e-ipp-b-58a8ca" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-58a8ca

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-58a8ca-5465987875 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-58a8ca-5465987875

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-58a8ca-5465987875-hbpl2

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-58a8ca-5465987875-hbpl2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-58a8ca-597c4d899d-tck47

AddedInterface

Add eth0 [10.132.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-58a8ca-597c4d899d-tck47

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-b-58a8ca-5465987875-hbpl2

AddedInterface

Add eth0 [10.134.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-58a8ca-5465987875-hbpl2

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-58a8ca-597c4d899d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-58a8ca-597c4d899d-tck47

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-58a8ca-597c4d899d-tck47

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-58a8ca-5465987875-hbpl2

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-58a8ca-597c4d899d-tck47

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn

ProbeError

Readiness probe error: Get "http://10.133.0.107:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn

Unhealthy

Readiness probe failed: Get "http://10.133.0.107:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn

Unhealthy

Startup probe failed: Get "http://10.133.0.107:15021/healthz/ready": dial tcp 10.133.0.107:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn

ProbeError

Startup probe error: Get "http://10.133.0.107:15021/healthz/ready": dial tcp 10.133.0.107:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd

SuccessfulCreate

Created pod: e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7

openshift-ingress

deployment-controller

e2e-ipp-cleanup-3aa245-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-3aa245

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-3aa245

openshift-ingress

multus

e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7

AddedInterface

Add eth0 [10.133.0.108/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-3aa245

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-3aa245-85bf5869c5 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-3aa245-85bf5869c5

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-3aa245-85bf5869c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-3aa245: serviceaccount "payload-processing-e2e-ipp-cleanup-3aa245" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-3aa245

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-3aa245-59c7f7d78 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-3aa245-59c7f7d78

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-3aa245-59c7f7d78-bjsf7
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-3aa245-59c7f7d78

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-3aa245-59c7f7d78-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-3aa245: serviceaccount "payload-processing-e2e-ipp-cleanup-3aa245" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-3aa245-85bf5869c5

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-3aa245-85bf5869c5-8vx65

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-3aa245-85bf5869c5-8vx65

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-3aa245-59c7f7d78-bjsf7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-3aa245-85bf5869c5-8vx65

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-3aa245-85bf5869c5-8vx65

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-3aa245-85bf5869c5-8vx65

AddedInterface

Add eth0 [10.132.0.73/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-3aa245-59c7f7d78-bjsf7

AddedInterface

Add eth0 [10.132.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-3aa245-59c7f7d78-bjsf7

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-3aa245-59c7f7d78-bjsf7

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7

Unhealthy

Startup probe failed: Get "http://10.133.0.108:15021/healthz/ready": dial tcp 10.133.0.108:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7

ProbeError

Startup probe error: Get "http://10.133.0.108:15021/healthz/ready": dial tcp 10.133.0.108:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-3aa245-59c7f7d78-bjsf7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-3aa245-85bf5869c5-8vx65

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-3aa245-openshift-default-7774dcdfbd-zrpr7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-adba81-795f4bc679-rlb75

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-adba81-5ffd65b88b-g94sf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-a-adba81-openshift-default-554cf9cf44-4sggd

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-58a8ca-5465987875-hbpl2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-58a8ca-597c4d899d-tck47

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-b-58a8ca-openshift-default-5bd8d547b-grctn

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-123a30-c75879546-l8ntk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-123a30-5f56bf8b75-h2dwv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w3-123a30-openshift-default-79444bfb7b-8l2hl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-7f10d8-868497d6c7-85nt2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-7f10d8-54cc6fb958-wm5cf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w3-7f10d8-openshift-default-5fcb6bbd58-7xtq5

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503