Time Namespace Component RelatedObject Reason Message

openshift-ingress

e2e-inf-a-679c94-openshift-default-586587fdb6-727nf

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-679c94-openshift-default-586587fdb6-727nf to ip-10-0-135-96.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-51383f0b-788557fcd-kw656

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-51383f0b-788557fcd-kw656 to ip-10-0-129-219.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-bda598-58f8675fdc-qqnbb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-bda598-58f8675fdc-qqnbb to ip-10-0-129-219.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-72f076-6d5866f554-cjcjm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-72f076-6d5866f554-cjcjm to ip-10-0-130-246.ec2.internal

openshift-ingress

payload-processing-e2e-derive-51383f0b-589d4ffc85-bqg8z

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-51383f0b-589d4ffc85-bqg8z to ip-10-0-130-246.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-b3d9be-54c486c86f-9cbfx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-b3d9be-54c486c86f-9cbfx to ip-10-0-130-246.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-a4c77c-7d646cb87d-fvjsn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-a4c77c-7d646cb87d-fvjsn to ip-10-0-129-219.ec2.internal

openshift-ingress

payload-processing-e2e-mt-76145153-78dfb9457-hlkbl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-76145153-78dfb9457-hlkbl to ip-10-0-129-219.ec2.internal

openshift-ingress

e2e-ait-c5c3fdb6-openshift-default-79c6fbd5b8-j9rlq

Scheduled

Successfully assigned openshift-ingress/e2e-ait-c5c3fdb6-openshift-default-79c6fbd5b8-j9rlq to ip-10-0-135-96.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-568856-8448cc7ff-cgvl8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-568856-8448cc7ff-cgvl8 to ip-10-0-130-246.ec2.internal

openshift-ingress

e2e-shared-b-w3-83be66-openshift-default-5bdd849c5d-fxzfv

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-83be66-openshift-default-5bdd849c5d-fxzfv to ip-10-0-135-96.ec2.internal

openshift-ingress

e2e-worker-w0-6ce17e-openshift-default-848b659b94-72crk

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-6ce17e-openshift-default-848b659b94-72crk to ip-10-0-135-96.ec2.internal

openshift-ingress

e2e-ipp-cleanup-230464-openshift-default-684b5fffb6-tjwrf

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-230464-openshift-default-684b5fffb6-tjwrf to ip-10-0-135-96.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-679c94-675dc79477-ckbhl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-679c94-675dc79477-ckbhl to ip-10-0-130-246.ec2.internal

openshift-ingress

e2e-shared-b-w2-7b202f-openshift-default-5687c5cfd-rhzq4

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-7b202f-openshift-default-5687c5cfd-rhzq4 to ip-10-0-135-96.ec2.internal

openshift-ingress

e2e-worker-w4-7025b9-openshift-default-7b6bccd4d6-fbnml

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-7025b9-openshift-default-7b6bccd4d6-fbnml to ip-10-0-135-96.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-7025b9-6cc7967d46-67pc7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-7025b9-6cc7967d46-67pc7 to ip-10-0-130-246.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-83be66-744498577d-hz4r2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-83be66-744498577d-hz4r2 to ip-10-0-130-246.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-ea2b31-7bc7597d5c-8jld5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-ea2b31-7bc7597d5c-8jld5 to ip-10-0-129-219.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-7b202f-77c5474c46-r2x7f

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-7b202f-77c5474c46-r2x7f to ip-10-0-130-246.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-706b9d-ffd4595dc-zhcx2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-706b9d-ffd4595dc-zhcx2 to ip-10-0-130-246.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-230464-6b95d9cc49-dvvfm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-230464-6b95d9cc49-dvvfm to ip-10-0-130-246.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-7dbe617a-6f5598bb94-5sz4q

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-7dbe617a-6f5598bb94-5sz4q to ip-10-0-130-246.ec2.internal

openshift-ingress

e2e-ait-f897c8bb-openshift-default-657bcd5bf8-bp4gn

Scheduled

Successfully assigned openshift-ingress/e2e-ait-f897c8bb-openshift-default-657bcd5bf8-bp4gn to ip-10-0-135-96.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-dh2sn

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-dh2sn to ip-10-0-129-219.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-f897c8bb-86bdf55bb-ftptt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-f897c8bb-86bdf55bb-ftptt to ip-10-0-130-246.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-689fe3-6b7c8f9f46-q27xt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-689fe3-6b7c8f9f46-q27xt to ip-10-0-130-246.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-6c97f2-6b499fd7cc-gz6pm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-6c97f2-6b499fd7cc-gz6pm to ip-10-0-130-246.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-7b202f-9f7687869-x2dxh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-7b202f-9f7687869-x2dxh to ip-10-0-129-219.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-mcn47

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-mcn47 to ip-10-0-130-246.ec2.internal

openshift-ingress

e2e-shared-a-w3-6c97f2-openshift-default-6669fbd6bb-9xp88

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-6c97f2-openshift-default-6669fbd6bb-9xp88 to ip-10-0-135-96.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-c5c3fdb6-5bc86d7df4-fksxl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-c5c3fdb6-5bc86d7df4-fksxl to ip-10-0-130-246.ec2.internal

openshift-ingress

e2e-migrate-7dbe617a-gw-openshift-default-7c5b6dcd7b-8w77j

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-7dbe617a-gw-openshift-default-7c5b6dcd7b-8w77j to ip-10-0-135-96.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-qzpst

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qzpst to ip-10-0-129-219.ec2.internal

openshift-ingress

e2e-api-a-a4c77c-openshift-default-944d679c4-s8cxb

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-a4c77c-openshift-default-944d679c4-s8cxb to ip-10-0-135-96.ec2.internal

openshift-ingress

e2e-ipp-b-706b9d-openshift-default-674f6dcb6d-krhlr

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-706b9d-openshift-default-674f6dcb6d-krhlr to ip-10-0-135-96.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-6ce17e-5b6fd8b698-9sxtx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-6ce17e-5b6fd8b698-9sxtx to ip-10-0-130-246.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-68cf4d799cb7v7w

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cb7v7w to ip-10-0-135-96.ec2.internal

openshift-ingress

e2e-mt-76145153-openshift-default-979f65fcb-q7g24

Scheduled

Successfully assigned openshift-ingress/e2e-mt-76145153-openshift-default-979f65fcb-q7g24 to ip-10-0-135-96.ec2.internal

openshift-ingress

payload-processing-e2e-ait-c5c3fdb6-5c8489fd4c-zwwl5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-c5c3fdb6-5c8489fd4c-zwwl5 to ip-10-0-130-246.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-bdnnx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-bdnnx to ip-10-0-129-219.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-83be66-6769cb6845-pqvwr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-83be66-6769cb6845-pqvwr to ip-10-0-130-246.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-6ce17e-696f5ff8d5-bdzk8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-6ce17e-696f5ff8d5-bdzk8 to ip-10-0-130-246.ec2.internal

openshift-ingress

e2e-mt-5d061fe3-openshift-default-79b45ccdb4-dm8j5

Scheduled

Successfully assigned openshift-ingress/e2e-mt-5d061fe3-openshift-default-79b45ccdb4-dm8j5 to ip-10-0-135-96.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-5ccb968c66-j687t

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-j687t to ip-10-0-135-96.ec2.internal

openshift-ingress

e2e-api-b-72f076-openshift-default-5699c8958b-whvfq

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-72f076-openshift-default-5699c8958b-whvfq to ip-10-0-135-96.ec2.internal

openshift-ingress

e2e-ipp-a-ea2b31-openshift-default-86666c467d-zxv65

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-ea2b31-openshift-default-86666c467d-zxv65 to ip-10-0-135-96.ec2.internal

openshift-ingress

payload-processing-e2e-ait-f897c8bb-8d9d6c597-j4c6s

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-f897c8bb-8d9d6c597-j4c6s to ip-10-0-130-246.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-b3d9be-59fbb6466-shg8n

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-b3d9be-59fbb6466-shg8n to ip-10-0-130-246.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-679c94-7f6f876966-pknkw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-679c94-7f6f876966-pknkw to ip-10-0-130-246.ec2.internal

openshift-ingress

router-default-8484fd4884-9th5k

Scheduled

Successfully assigned openshift-ingress/router-default-8484fd4884-9th5k to ip-10-0-130-246.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w4-7025b9-6cd5b6ff89-9b7xv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-7025b9-6cd5b6ff89-9b7xv to ip-10-0-130-246.ec2.internal

openshift-ingress

e2e-explicit-b3d9be-openshift-default-76d446df4d-w2f9p

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-b3d9be-openshift-default-76d446df4d-w2f9p to ip-10-0-135-96.ec2.internal

openshift-ingress

e2e-inf-b-568856-openshift-default-5d7f66dcf6-2pwws

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-568856-openshift-default-5d7f66dcf6-2pwws to ip-10-0-135-96.ec2.internal

openshift-ingress

kube-auth-proxy-5d6c69d6b7-xltjl

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-5d6c69d6b7-xltjl to ip-10-0-129-219.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-568856-678b76cc8-zbp9g

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-568856-678b76cc8-zbp9g to ip-10-0-129-219.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-ea2b31-55f6d848c8-zmb7v

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-ea2b31-55f6d848c8-zmb7v to ip-10-0-129-219.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-230464-79f9676c6b-c8xbs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-230464-79f9676c6b-c8xbs to ip-10-0-130-246.ec2.internal

openshift-ingress

e2e-autores-689fe3-openshift-default-c89d5bbd4-d8fj9

Scheduled

Successfully assigned openshift-ingress/e2e-autores-689fe3-openshift-default-c89d5bbd4-d8fj9 to ip-10-0-135-96.ec2.internal

openshift-ingress

payload-processing-e2e-autores-689fe3-fcf84fdf5-6nlkf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-689fe3-fcf84fdf5-6nlkf to ip-10-0-130-246.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-6c97f2-5879ccf68b-fhjkn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-6c97f2-5879ccf68b-fhjkn to ip-10-0-130-246.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-72f076-77d97bb65c-vd6px

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-72f076-77d97bb65c-vd6px to ip-10-0-129-219.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-a4c77c-d4cc46797-qxvsj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-a4c77c-d4cc46797-qxvsj to ip-10-0-130-246.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-bda598-688599fd66-cw6t6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-bda598-688599fd66-cw6t6 to ip-10-0-129-219.ec2.internal

openshift-ingress

e2e-shared-a-w2-bda598-openshift-default-77b79bd476-hdhhg

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-bda598-openshift-default-77b79bd476-hdhhg to ip-10-0-135-96.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-76145153-5d9f749df8-8xmbd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-76145153-5d9f749df8-8xmbd to ip-10-0-130-246.ec2.internal

openshift-ingress

kube-auth-proxy-5d6c69d6b7-stgvr

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-5d6c69d6b7-stgvr to ip-10-0-130-246.ec2.internal

openshift-ingress

e2e-noten-c93e93-openshift-default-86965d8768-cf2rq

Scheduled

Successfully assigned openshift-ingress/e2e-noten-c93e93-openshift-default-86965d8768-cf2rq to ip-10-0-135-96.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-706b9d-6cffdd7dd6-m5t2c

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-706b9d-6cffdd7dd6-m5t2c to ip-10-0-130-246.ec2.internal

openshift-ingress

e2e-derive-51383f0b-openshift-default-54994cc4b4-4szj2

Scheduled

Successfully assigned openshift-ingress/e2e-derive-51383f0b-openshift-default-54994cc4b4-4szj2 to ip-10-0-135-96.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-5d061fe3-7cbcb9d494-plm49

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-5d061fe3-7cbcb9d494-plm49 to ip-10-0-129-219.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-7dbe617a-5cb86d978-zgzmv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-7dbe617a-5cb86d978-zgzmv to ip-10-0-130-246.ec2.internal

openshift-ingress

payload-processing-e2e-mt-5d061fe3-95ccb6b8f-9sl4h

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-5d061fe3-95ccb6b8f-9sl4h to ip-10-0-129-219.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-8484fd4884 from 0 to 1

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x11)

openshift-ingress

replicaset-controller

router-default-8484fd4884

FailedCreate

Error creating: pods "router-default-8484fd4884-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x16)

openshift-ingress

replicaset-controller

router-default-8484fd4884

FailedCreate

Error creating: pods "router-default-8484fd4884-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-8484fd4884

SuccessfulCreate

Created pod: router-default-8484fd4884-9th5k
(x6)

openshift-ingress

kubelet

router-default-8484fd4884-9th5k

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x6)

openshift-ingress

kubelet

router-default-8484fd4884-9th5k

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found

openshift-ingress

multus

router-default-8484fd4884-9th5k

AddedInterface

Add eth0 [10.132.0.11/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-8484fd4884-9th5k

Started

Started container router

openshift-ingress

kubelet

router-default-8484fd4884-9th5k

Created

Created container: router

openshift-ingress

kubelet

router-default-8484fd4884-9th5k

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:48526e08a2a06d05806dbcf3ddb069e5182371667d9e9f7d2cf09f60cd247d20" already present on machine

openshift-ingress

kubelet

kube-auth-proxy-5d6c69d6b7-stgvr

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-5d6c69d6b7 from 0 to 2

openshift-ingress

multus

kube-auth-proxy-5d6c69d6b7-stgvr

AddedInterface

Add eth0 [10.132.0.25/23] from ovn-kubernetes

openshift-ingress

multus

kube-auth-proxy-5d6c69d6b7-xltjl

AddedInterface

Add eth0 [10.133.0.19/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

kube-auth-proxy-5d6c69d6b7

SuccessfulCreate

Created pod: kube-auth-proxy-5d6c69d6b7-stgvr

openshift-ingress

replicaset-controller

kube-auth-proxy-5d6c69d6b7

SuccessfulCreate

Created pod: kube-auth-proxy-5d6c69d6b7-xltjl
(x4)

openshift-ingress

replicaset-controller

kube-auth-proxy-5d6c69d6b7

FailedCreate

Error creating: pods "kube-auth-proxy-5d6c69d6b7-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

kubelet

kube-auth-proxy-5d6c69d6b7-xltjl

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-qzpst

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-qzpst

AddedInterface

Add eth0 [10.133.0.20/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-qzpst

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

kube-auth-proxy-5d6c69d6b7-stgvr

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.698s (2.698s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-5d6c69d6b7-xltjl

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-5d6c69d6b7-stgvr

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-5d6c69d6b7-xltjl

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-5d6c69d6b7-xltjl

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.722s (2.722s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-5d6c69d6b7-stgvr

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-qzpst

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-qzpst

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.307s (3.307s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-qzpst

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-qzpst

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-qzpst

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-68cf4d799c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-68cf4d799cb7v7w

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-68cf4d799c from 0 to 1

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-68cf4d799cb7v7w

AddedInterface

Add eth0 [10.134.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cb7v7w

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cb7v7w

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cb7v7w

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cb7v7w

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 3.369s (3.37s including waiting). Image size: 181318953 bytes.

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-dh2sn

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-dh2sn

AddedInterface

Add eth0 [10.133.0.23/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-dh2sn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" already present on machine

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-dh2sn

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-dh2sn

Started

Started container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-qzpst

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-qzpst

Killing

Stopping container discovery
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-5ccb968c66 from 0 to 1

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5ccb968c66

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5ccb968c66-j687t

openshift-ingress

multus

maas-default-gateway-openshift-default-5ccb968c66-j687t

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-bdnnx

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-mcn47

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-mcn47

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-5b54b7fbb7-mcn47

AddedInterface

Add eth0 [10.132.0.32/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-bdnnx

AddedInterface

Add eth0 [10.133.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-bdnnx

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-mcn47

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-bdnnx

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-bdnnx

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.615s (1.615s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-mcn47

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.125s (2.125s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-mcn47

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-bdnnx

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-j687t

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-j687t

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-j687t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-j687t

Unhealthy

Startup probe failed: Get "http://10.134.0.43:15021/healthz/ready": dial tcp 10.134.0.43:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-j687t

ProbeError

Startup probe error: Get "http://10.134.0.43:15021/healthz/ready": dial tcp 10.134.0.43:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-inf-a-679c94-openshift-default-586587fdb6

SuccessfulCreate

Created pod: e2e-inf-a-679c94-openshift-default-586587fdb6-727nf

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-6ce17e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-6ce17e

openshift-ingress

multus

e2e-inf-a-679c94-openshift-default-586587fdb6-727nf

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w0-6ce17e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-6ce17e-openshift-default-848b659b94 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w0-6ce17e-openshift-default-848b659b94

SuccessfulCreate

Created pod: e2e-worker-w0-6ce17e-openshift-default-848b659b94-72crk

openshift-ingress

multus

e2e-worker-w0-6ce17e-openshift-default-848b659b94-72crk

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-inf-a-679c94-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-679c94-openshift-default-586587fdb6 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-a-679c94

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-679c94

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-7025b9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-7025b9

openshift-ingress

deployment-controller

e2e-worker-w4-7025b9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-7025b9-openshift-default-7b6bccd4d6 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w4-7025b9-openshift-default-7b6bccd4d6

SuccessfulCreate

Created pod: e2e-worker-w4-7025b9-openshift-default-7b6bccd4d6-fbnml

openshift-ingress

multus

e2e-worker-w4-7025b9-openshift-default-7b6bccd4d6-fbnml

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-7025b9-6cc7967d46

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-7025b9-6cc7967d46-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-7025b9: serviceaccount "payload-processing-e2e-worker-w4-7025b9" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-7025b9-6cd5b6ff89

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-7025b9-6cd5b6ff89-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-7025b9: serviceaccount "payload-processing-e2e-worker-w4-7025b9" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-7025b9-6cc7967d46

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-7025b9-6cc7967d46-67pc7

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-7025b9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-7025b9-6cc7967d46 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-7025b9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-7025b9-6cd5b6ff89 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-7025b9-6cd5b6ff89

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-7025b9-6cd5b6ff89-9b7xv

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-7025b9-6cd5b6ff89-9b7xv

Created

Created container: payload-processing
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-679c94-675dc79477

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-679c94-675dc79477-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-679c94: serviceaccount "payload-processing-e2e-inf-a-679c94" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-7025b9-6cc7967d46-67pc7

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-7025b9-6cc7967d46-67pc7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-7025b9-6cd5b6ff89-9b7xv

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-7025b9-6cc7967d46-67pc7

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-7025b9-6cd5b6ff89-9b7xv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-679c94-7f6f876966

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-679c94-7f6f876966-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-679c94: serviceaccount "payload-processing-e2e-inf-a-679c94" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-679c94-7f6f876966

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-679c94-7f6f876966-pknkw

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-679c94

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-679c94-7f6f876966 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-679c94-675dc79477

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-679c94-675dc79477-ckbhl

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-7025b9-6cc7967d46-67pc7

AddedInterface

Add eth0 [10.132.0.36/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-679c94

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-679c94-675dc79477 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-worker-w4-7025b9-6cd5b6ff89-9b7xv

AddedInterface

Add eth0 [10.132.0.37/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-6ce17e-696f5ff8d5

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-6ce17e-696f5ff8d5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-6ce17e: serviceaccount "payload-processing-e2e-worker-w0-6ce17e" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-6ce17e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-6ce17e-5b6fd8b698 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-679c94-7f6f876966-pknkw

AddedInterface

Add eth0 [10.132.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-679c94-675dc79477-ckbhl

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-679c94-675dc79477-ckbhl

Created

Created container: payload-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-6ce17e-5b6fd8b698

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-6ce17e-5b6fd8b698-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-6ce17e: serviceaccount "payload-processing-e2e-worker-w0-6ce17e" not found

openshift-ingress

kubelet

payload-processing-e2e-inf-a-679c94-675dc79477-ckbhl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-inf-a-679c94-675dc79477-ckbhl

AddedInterface

Add eth0 [10.132.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-679c94-7f6f876966-pknkw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-679c94-7f6f876966-pknkw

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-6ce17e-696f5ff8d5

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-6ce17e-696f5ff8d5-bdzk8

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-679c94-7f6f876966-pknkw

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-6ce17e-5b6fd8b698

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-6ce17e-5b6fd8b698-9sxtx

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-6ce17e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-6ce17e-696f5ff8d5 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-6ce17e-5b6fd8b698-9sxtx

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-6ce17e-696f5ff8d5-bdzk8

Started

Started container payload-processing

openshift-ingress

deployment-controller

e2e-autores-689fe3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-689fe3-openshift-default-c89d5bbd4 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-autores-689fe3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-689fe3

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-6ce17e-5b6fd8b698-9sxtx

AddedInterface

Add eth0 [10.132.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-6ce17e-5b6fd8b698-9sxtx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-6ce17e-696f5ff8d5-bdzk8

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-6ce17e-696f5ff8d5-bdzk8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-worker-w0-6ce17e-696f5ff8d5-bdzk8

AddedInterface

Add eth0 [10.132.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-6ce17e-5b6fd8b698-9sxtx

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-autores-689fe3-openshift-default-c89d5bbd4

SuccessfulCreate

Created pod: e2e-autores-689fe3-openshift-default-c89d5bbd4-d8fj9

openshift-ingress

replicaset-controller

e2e-ait-f897c8bb-openshift-default-657bcd5bf8

SuccessfulCreate

Created pod: e2e-ait-f897c8bb-openshift-default-657bcd5bf8-bp4gn

openshift-ingress

gateway_labeler_controller

e2e-ait-f897c8bb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-f897c8bb

openshift-ingress

deployment-controller

e2e-ait-f897c8bb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-f897c8bb-openshift-default-657bcd5bf8 from 0 to 1

openshift-ingress

multus

e2e-autores-689fe3-openshift-default-c89d5bbd4-d8fj9

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

multus

e2e-ait-f897c8bb-openshift-default-657bcd5bf8-bp4gn

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-689fe3-fcf84fdf5

SuccessfulCreate

Created pod: payload-processing-e2e-autores-689fe3-fcf84fdf5-6nlkf

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-689fe3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-689fe3-6b7c8f9f46 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-autores-689fe3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-689fe3-fcf84fdf5 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-689fe3-6b7c8f9f46

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-689fe3-6b7c8f9f46-q27xt
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-689fe3-6b7c8f9f46

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-689fe3-6b7c8f9f46-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-689fe3: serviceaccount "payload-processing-e2e-autores-689fe3" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-689fe3-fcf84fdf5

FailedCreate

Error creating: pods "payload-processing-e2e-autores-689fe3-fcf84fdf5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-689fe3: serviceaccount "payload-processing-e2e-autores-689fe3" not found

openshift-ingress

kubelet

payload-processing-e2e-autores-689fe3-fcf84fdf5-6nlkf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-ait-f897c8bb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-f897c8bb-8d9d6c597 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-689fe3-6b7c8f9f46-q27xt

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-689fe3-fcf84fdf5-6nlkf

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-689fe3-fcf84fdf5-6nlkf

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-689fe3-6b7c8f9f46-q27xt

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-autores-689fe3-fcf84fdf5-6nlkf

AddedInterface

Add eth0 [10.132.0.44/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-autores-689fe3-6b7c8f9f46-q27xt

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-689fe3-6b7c8f9f46-q27xt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-f897c8bb-86bdf55bb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-f897c8bb-86bdf55bb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-f897c8bb: serviceaccount "payload-processing-e2e-ait-f897c8bb" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-f897c8bb-86bdf55bb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-f897c8bb-86bdf55bb-ftptt

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-f897c8bb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-f897c8bb-86bdf55bb from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-f897c8bb-8d9d6c597

SuccessfulCreate

Created pod: payload-processing-e2e-ait-f897c8bb-8d9d6c597-j4c6s
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-f897c8bb-8d9d6c597

FailedCreate

Error creating: pods "payload-processing-e2e-ait-f897c8bb-8d9d6c597-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-f897c8bb: serviceaccount "payload-processing-e2e-ait-f897c8bb" not found

openshift-ingress

kubelet

payload-processing-e2e-ait-f897c8bb-8d9d6c597-j4c6s

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-f897c8bb-8d9d6c597-j4c6s

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-f897c8bb-8d9d6c597-j4c6s

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-f897c8bb-8d9d6c597-j4c6s

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f897c8bb-86bdf55bb-ftptt

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f897c8bb-86bdf55bb-ftptt

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-f897c8bb-86bdf55bb-ftptt

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f897c8bb-86bdf55bb-ftptt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w0-6ce17e-openshift-default-848b659b94-72crk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w4-7025b9-openshift-default-7b6bccd4d6-fbnml

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-679c94-openshift-default-586587fdb6-727nf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w0-6ce17e-openshift-default-848b659b94-72crk

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-679c94-openshift-default-586587fdb6-727nf

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-679c94-openshift-default-586587fdb6-727nf

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-7025b9-openshift-default-7b6bccd4d6-fbnml

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-7025b9-openshift-default-7b6bccd4d6-fbnml

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-6ce17e-openshift-default-848b659b94-72crk

Started

Started container istio-proxy

openshift-ingress

replicaset-controller

e2e-inf-b-568856-openshift-default-5d7f66dcf6

SuccessfulCreate

Created pod: e2e-inf-b-568856-openshift-default-5d7f66dcf6-2pwws

openshift-ingress

deployment-controller

e2e-inf-b-568856-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-568856-openshift-default-5d7f66dcf6 from 0 to 1

openshift-ingress

GatewayAuthBootstrap

e2e-inf-b-568856

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-inf-b-568856-authn-ssl: envoyfilters.networking.istio.io "e2e-inf-b-568856-authn-ssl" already exists

openshift-ingress

gateway_labeler_controller

e2e-inf-b-568856

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-568856

openshift-ingress

multus

e2e-inf-b-568856-openshift-default-5d7f66dcf6-2pwws

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes
(x8)

openshift-ingress

kubelet

e2e-inf-a-679c94-openshift-default-586587fdb6-727nf

Unhealthy

Startup probe failed: Get "http://10.134.0.49:15021/healthz/ready": dial tcp 10.134.0.49:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-inf-a-679c94-openshift-default-586587fdb6-727nf

ProbeError

Startup probe error: Get "http://10.134.0.49:15021/healthz/ready": dial tcp 10.134.0.49:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

e2e-worker-w0-6ce17e-openshift-default-848b659b94-72crk

Unhealthy

Startup probe failed: Get "http://10.134.0.48:15021/healthz/ready": dial tcp 10.134.0.48:15021: connect: connection refused
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-568856-678b76cc8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-568856-678b76cc8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-568856: serviceaccount "payload-processing-e2e-inf-b-568856" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-568856-678b76cc8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-568856-678b76cc8-zbp9g
(x9)

openshift-ingress

kubelet

e2e-worker-w4-7025b9-openshift-default-7b6bccd4d6-fbnml

Unhealthy

Startup probe failed: Get "http://10.134.0.50:15021/healthz/ready": dial tcp 10.134.0.50:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-568856

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-568856-678b76cc8 from 0 to 1
(x9)

openshift-ingress

kubelet

e2e-worker-w0-6ce17e-openshift-default-848b659b94-72crk

ProbeError

Startup probe error: Get "http://10.134.0.48:15021/healthz/ready": dial tcp 10.134.0.48:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

e2e-worker-w4-7025b9-openshift-default-7b6bccd4d6-fbnml

ProbeError

Startup probe error: Get "http://10.134.0.50:15021/healthz/ready": dial tcp 10.134.0.50:15021: connect: connection refused body:
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-568856-8448cc7ff

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-568856-8448cc7ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-568856: serviceaccount "payload-processing-e2e-inf-b-568856" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-568856-8448cc7ff

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-568856-8448cc7ff-cgvl8

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-568856

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-568856-8448cc7ff from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-b-568856-8448cc7ff-cgvl8

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-568856-8448cc7ff-cgvl8

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-568856-8448cc7ff-cgvl8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-568856-678b76cc8-zbp9g

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-568856-678b76cc8-zbp9g

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-568856-678b76cc8-zbp9g

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-568856-678b76cc8-zbp9g

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-inf-b-568856-8448cc7ff-cgvl8

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ait-f897c8bb-openshift-default-657bcd5bf8-bp4gn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-f897c8bb-openshift-default-657bcd5bf8-bp4gn

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-f897c8bb-openshift-default-657bcd5bf8-bp4gn

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-689fe3-openshift-default-c89d5bbd4-d8fj9

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-689fe3-openshift-default-c89d5bbd4-d8fj9

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-689fe3-openshift-default-c89d5bbd4-d8fj9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ait-f897c8bb-openshift-default-657bcd5bf8-bp4gn

Unhealthy

Startup probe failed: Get "http://10.134.0.52:15021/healthz/ready": dial tcp 10.134.0.52:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-f897c8bb-openshift-default-657bcd5bf8-bp4gn

ProbeError

Startup probe error: Get "http://10.134.0.52:15021/healthz/ready": dial tcp 10.134.0.52:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-autores-689fe3-openshift-default-c89d5bbd4-d8fj9

ProbeError

Startup probe error: Get "http://10.134.0.51:15021/healthz/ready": dial tcp 10.134.0.51:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-autores-689fe3-openshift-default-c89d5bbd4-d8fj9

Unhealthy

Startup probe failed: Get "http://10.134.0.51:15021/healthz/ready": dial tcp 10.134.0.51:15021: connect: connection refused

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ait-f897c8bb

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ait-f897c8bb: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ait-f897c8bb": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ait-f897c8bb, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 5ed852a0-134a-4cb0-8c3b-8e6de64d23af, UID in object meta:

openshift-ingress

kubelet

e2e-ait-f897c8bb-openshift-default-657bcd5bf8-bp4gn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ait-f897c8bb-8d9d6c597-j4c6s

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f897c8bb-86bdf55bb-ftptt

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

e2e-migrate-7dbe617a-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-7dbe617a-gw-openshift-default-7c5b6dcd7b from 0 to 1

openshift-ingress

replicaset-controller

e2e-migrate-7dbe617a-gw-openshift-default-7c5b6dcd7b

SuccessfulCreate

Created pod: e2e-migrate-7dbe617a-gw-openshift-default-7c5b6dcd7b-8w77j

openshift-ingress

gateway_labeler_controller

e2e-migrate-7dbe617a-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-7dbe617a-gw

openshift-ingress

multus

e2e-migrate-7dbe617a-gw-openshift-default-7c5b6dcd7b-8w77j

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-inf-b-568856-openshift-default-5d7f66dcf6-2pwws

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-568856-openshift-default-5d7f66dcf6-2pwws

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-568856-openshift-default-5d7f66dcf6-2pwws

Created

Created container: istio-proxy

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-7dbe617a-6f5598bb94

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-7dbe617a-6f5598bb94-5sz4q

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-7dbe617a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-7dbe617a-6f5598bb94 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-7dbe617a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-7dbe617a-5cb86d978 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-7dbe617a-5cb86d978

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-7dbe617a-5cb86d978-zgzmv
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-7dbe617a-5cb86d978

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-7dbe617a-5cb86d978-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-7dbe617a: serviceaccount "payload-processing-e2e-migrate-7dbe617a" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-7dbe617a-6f5598bb94

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-7dbe617a-6f5598bb94-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-7dbe617a: serviceaccount "payload-processing-e2e-migrate-7dbe617a" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-7dbe617a-5cb86d978-zgzmv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-7dbe617a-5cb86d978-zgzmv

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-7dbe617a-6f5598bb94-5sz4q

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-migrate-7dbe617a-5cb86d978-zgzmv

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-7dbe617a-5cb86d978-zgzmv

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-7dbe617a-6f5598bb94-5sz4q

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-7dbe617a-6f5598bb94-5sz4q

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-migrate-7dbe617a-6f5598bb94-5sz4q

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-inf-b-568856-openshift-default-5d7f66dcf6-2pwws

Unhealthy

Startup probe failed: Get "http://10.134.0.54:15021/healthz/ready": dial tcp 10.134.0.54:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-b-568856-openshift-default-5d7f66dcf6-2pwws

ProbeError

Startup probe error: Get "http://10.134.0.54:15021/healthz/ready": dial tcp 10.134.0.54:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-migrate-7dbe617a-gw-openshift-default-7c5b6dcd7b-8w77j

Unhealthy

Readiness probe failed: Get "http://10.134.0.58:15021/healthz/ready": read tcp 10.134.0.2:40586->10.134.0.58:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-migrate-7dbe617a-gw-openshift-default-7c5b6dcd7b-8w77j

ProbeError

Readiness probe error: Get "http://10.134.0.58:15021/healthz/ready": read tcp 10.134.0.2:40586->10.134.0.58:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-migrate-7dbe617a-gw-openshift-default-7c5b6dcd7b-8w77j

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-7dbe617a-gw-openshift-default-7c5b6dcd7b-8w77j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-7dbe617a-gw-openshift-default-7c5b6dcd7b-8w77j

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-migrate-7dbe617a-gw-openshift-default-7c5b6dcd7b-8w77j

Unhealthy

Startup probe failed: Get "http://10.134.0.58:15021/healthz/ready": dial tcp 10.134.0.58:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-migrate-7dbe617a-gw-openshift-default-7c5b6dcd7b-8w77j

ProbeError

Startup probe error: Get "http://10.134.0.58:15021/healthz/ready": dial tcp 10.134.0.58:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-7dbe617a-5cb86d978-zgzmv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-7dbe617a-6f5598bb94-5sz4q

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-migrate-7dbe617a-gw-openshift-default-7c5b6dcd7b-8w77j

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-ait-c5c3fdb6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-c5c3fdb6-openshift-default-79c6fbd5b8 from 0 to 1

openshift-ingress

multus

e2e-ait-c5c3fdb6-openshift-default-79c6fbd5b8-j9rlq

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ait-c5c3fdb6-openshift-default-79c6fbd5b8

SuccessfulCreate

Created pod: e2e-ait-c5c3fdb6-openshift-default-79c6fbd5b8-j9rlq

openshift-ingress

gateway_labeler_controller

e2e-ait-c5c3fdb6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-c5c3fdb6

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-c5c3fdb6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-c5c3fdb6-5bc86d7df4 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-c5c3fdb6-5bc86d7df4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-c5c3fdb6-5bc86d7df4-fksxl
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-c5c3fdb6-5bc86d7df4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-c5c3fdb6-5bc86d7df4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-c5c3fdb6: serviceaccount "payload-processing-e2e-ait-c5c3fdb6" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-c5c3fdb6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-c5c3fdb6-5c8489fd4c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-c5c3fdb6-5c8489fd4c

SuccessfulCreate

Created pod: payload-processing-e2e-ait-c5c3fdb6-5c8489fd4c-zwwl5
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-c5c3fdb6-5c8489fd4c

FailedCreate

Error creating: pods "payload-processing-e2e-ait-c5c3fdb6-5c8489fd4c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-c5c3fdb6: serviceaccount "payload-processing-e2e-ait-c5c3fdb6" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-c5c3fdb6-5bc86d7df4-fksxl

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-c5c3fdb6-5bc86d7df4-fksxl

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-c5c3fdb6-5c8489fd4c-zwwl5

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-c5c3fdb6-5c8489fd4c-zwwl5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-c5c3fdb6-5c8489fd4c-zwwl5

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-c5c3fdb6-5c8489fd4c-zwwl5

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-c5c3fdb6-5bc86d7df4-fksxl

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-c5c3fdb6-5bc86d7df4-fksxl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-c5c3fdb6-openshift-default-79c6fbd5b8-j9rlq

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-ait-c5c3fdb6-openshift-default-79c6fbd5b8-j9rlq

Unhealthy

Readiness probe failed: Get "http://10.134.0.61:15021/healthz/ready": read tcp 10.134.0.2:45204->10.134.0.61:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-ait-c5c3fdb6-openshift-default-79c6fbd5b8-j9rlq

ProbeError

Readiness probe error: Get "http://10.134.0.61:15021/healthz/ready": read tcp 10.134.0.2:45204->10.134.0.61:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-ait-c5c3fdb6-openshift-default-79c6fbd5b8-j9rlq

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-c5c3fdb6-openshift-default-79c6fbd5b8-j9rlq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-ait-c5c3fdb6-openshift-default-79c6fbd5b8-j9rlq

ProbeError

Startup probe error: Get "http://10.134.0.61:15021/healthz/ready": dial tcp 10.134.0.61:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-ait-c5c3fdb6-openshift-default-79c6fbd5b8-j9rlq

Unhealthy

Startup probe failed: Get "http://10.134.0.61:15021/healthz/ready": dial tcp 10.134.0.61:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-c5c3fdb6-5bc86d7df4-fksxl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-c5c3fdb6-5c8489fd4c-zwwl5

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-derive-51383f0b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-51383f0b

openshift-ingress

kubelet

e2e-ait-c5c3fdb6-openshift-default-79c6fbd5b8-j9rlq

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-derive-51383f0b-openshift-default-54994cc4b4

SuccessfulCreate

Created pod: e2e-derive-51383f0b-openshift-default-54994cc4b4-4szj2

openshift-ingress

deployment-controller

e2e-derive-51383f0b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-51383f0b-openshift-default-54994cc4b4 from 0 to 1

openshift-ingress

multus

e2e-derive-51383f0b-openshift-default-54994cc4b4-4szj2

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-derive-51383f0b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-51383f0b-589d4ffc85 from 0 to 1

openshift-ingress

kubelet

e2e-ait-c5c3fdb6-openshift-default-79c6fbd5b8-j9rlq

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

kubelet

e2e-ait-c5c3fdb6-openshift-default-79c6fbd5b8-j9rlq

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-51383f0b-788557fcd-kw656

Started

Started container payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-51383f0b-788557fcd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-51383f0b-788557fcd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-51383f0b: serviceaccount "payload-processing-e2e-derive-51383f0b" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-51383f0b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-51383f0b-788557fcd from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-51383f0b-788557fcd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-51383f0b-788557fcd-kw656

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-51383f0b-788557fcd-kw656

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-51383f0b-589d4ffc85

SuccessfulCreate

Created pod: payload-processing-e2e-derive-51383f0b-589d4ffc85-bqg8z
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-51383f0b-589d4ffc85

FailedCreate

Error creating: pods "payload-processing-e2e-derive-51383f0b-589d4ffc85-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-51383f0b: serviceaccount "payload-processing-e2e-derive-51383f0b" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-51383f0b-788557fcd-kw656

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-derive-51383f0b-589d4ffc85-bqg8z

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-derive-51383f0b-788557fcd-kw656

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-51383f0b-589d4ffc85-bqg8z

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-51383f0b-589d4ffc85-bqg8z

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-derive-51383f0b-589d4ffc85-bqg8z

AddedInterface

Add eth0 [10.132.0.61/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-derive-51383f0b-openshift-default-54994cc4b4-4szj2

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-51383f0b-openshift-default-54994cc4b4-4szj2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-51383f0b-openshift-default-54994cc4b4-4szj2

Created

Created container: istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-689fe3-6b7c8f9f46-q27xt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-689fe3-fcf84fdf5-6nlkf

Killing

Stopping container payload-processing
(x4)

openshift-ingress

kubelet

e2e-derive-51383f0b-openshift-default-54994cc4b4-4szj2

Unhealthy

Startup probe failed: Get "http://10.134.0.64:15021/healthz/ready": dial tcp 10.134.0.64:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-derive-51383f0b-openshift-default-54994cc4b4-4szj2

ProbeError

Startup probe error: Get "http://10.134.0.64:15021/healthz/ready": dial tcp 10.134.0.64:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-derive-51383f0b-openshift-default-54994cc4b4-4szj2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-51383f0b-788557fcd-kw656

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-51383f0b-589d4ffc85-bqg8z

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-autores-689fe3-openshift-default-c89d5bbd4-d8fj9

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-explicit-b3d9be-openshift-default-76d446df4d

SuccessfulCreate

Created pod: e2e-explicit-b3d9be-openshift-default-76d446df4d-w2f9p

openshift-ingress

gateway_labeler_controller

e2e-explicit-b3d9be

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-b3d9be

openshift-ingress

deployment-controller

e2e-explicit-b3d9be-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-b3d9be-openshift-default-76d446df4d from 0 to 1

openshift-ingress

multus

e2e-explicit-b3d9be-openshift-default-76d446df4d-w2f9p

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-b3d9be-59fbb6466-shg8n

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-b3d9be-59fbb6466-shg8n

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-b3d9be-54c486c86f-9cbfx

Started

Started container payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-b3d9be

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-b3d9be-54c486c86f from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-b3d9be

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-b3d9be-59fbb6466 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-b3d9be-59fbb6466

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-b3d9be-59fbb6466-shg8n

openshift-ingress

kubelet

payload-processing-e2e-explicit-b3d9be-54c486c86f-9cbfx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-b3d9be-59fbb6466

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-b3d9be-59fbb6466-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-b3d9be: serviceaccount "payload-processing-e2e-explicit-b3d9be" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-b3d9be-54c486c86f

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-b3d9be-54c486c86f-9cbfx

openshift-ingress

multus

payload-pre-processing-e2e-explicit-b3d9be-59fbb6466-shg8n

AddedInterface

Add eth0 [10.132.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-b3d9be-54c486c86f-9cbfx

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-b3d9be-59fbb6466-shg8n

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-b3d9be-54c486c86f

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-b3d9be-54c486c86f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-b3d9be: serviceaccount "payload-processing-e2e-explicit-b3d9be" not found

openshift-ingress

multus

payload-processing-e2e-explicit-b3d9be-54c486c86f-9cbfx

AddedInterface

Add eth0 [10.132.0.66/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-explicit-b3d9be-openshift-default-76d446df4d-w2f9p

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-b3d9be-openshift-default-76d446df4d-w2f9p

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-b3d9be-openshift-default-76d446df4d-w2f9p

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-explicit-b3d9be-openshift-default-76d446df4d-w2f9p

Unhealthy

Startup probe failed: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-explicit-b3d9be-openshift-default-76d446df4d-w2f9p

ProbeError

Startup probe error: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-mt-5d061fe3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-5d061fe3-openshift-default-79b45ccdb4 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-5d061fe3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-5d061fe3

openshift-ingress

multus

e2e-mt-5d061fe3-openshift-default-79b45ccdb4-dm8j5

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-mt-5d061fe3-openshift-default-79b45ccdb4

SuccessfulCreate

Created pod: e2e-mt-5d061fe3-openshift-default-79b45ccdb4-dm8j5

openshift-ingress

deployment-controller

payload-processing-e2e-mt-5d061fe3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-5d061fe3-95ccb6b8f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-5d061fe3-95ccb6b8f

SuccessfulCreate

Created pod: payload-processing-e2e-mt-5d061fe3-95ccb6b8f-9sl4h

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-5d061fe3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-5d061fe3-7cbcb9d494 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-5d061fe3-7cbcb9d494

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-5d061fe3-7cbcb9d494-plm49
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-5d061fe3-7cbcb9d494

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-5d061fe3-7cbcb9d494-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-5d061fe3: serviceaccount "payload-processing-e2e-mt-5d061fe3" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-5d061fe3-95ccb6b8f

FailedCreate

Error creating: pods "payload-processing-e2e-mt-5d061fe3-95ccb6b8f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-5d061fe3: serviceaccount "payload-processing-e2e-mt-5d061fe3" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-5d061fe3-7cbcb9d494-plm49

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-5d061fe3-7cbcb9d494-plm49

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-5d061fe3-7cbcb9d494-plm49

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-mt-5d061fe3-7cbcb9d494-plm49

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-mt-5d061fe3-95ccb6b8f-9sl4h

AddedInterface

Add eth0 [10.133.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-5d061fe3-95ccb6b8f-9sl4h

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-5d061fe3-95ccb6b8f-9sl4h

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-5d061fe3-95ccb6b8f-9sl4h

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-mt-5d061fe3-openshift-default-79b45ccdb4-dm8j5

Unhealthy

Readiness probe failed: Get "http://10.134.0.68:15021/healthz/ready": read tcp 10.134.0.2:47356->10.134.0.68:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-mt-5d061fe3-openshift-default-79b45ccdb4-dm8j5

ProbeError

Readiness probe error: Get "http://10.134.0.68:15021/healthz/ready": read tcp 10.134.0.2:47356->10.134.0.68:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-mt-5d061fe3-openshift-default-79b45ccdb4-dm8j5

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-5d061fe3-openshift-default-79b45ccdb4-dm8j5

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-5d061fe3-openshift-default-79b45ccdb4-dm8j5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-mt-5d061fe3-openshift-default-79b45ccdb4-dm8j5

Unhealthy

Startup probe failed: Get "http://10.134.0.68:15021/healthz/ready": dial tcp 10.134.0.68:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-mt-5d061fe3-openshift-default-79b45ccdb4-dm8j5

ProbeError

Startup probe error: Get "http://10.134.0.68:15021/healthz/ready": dial tcp 10.134.0.68:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-mt-5d061fe3-95ccb6b8f-9sl4h

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-5d061fe3-7cbcb9d494-plm49

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-5d061fe3-openshift-default-79b45ccdb4-dm8j5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-5d061fe3-openshift-default-79b45ccdb4-dm8j5

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

kubelet

e2e-mt-5d061fe3-openshift-default-79b45ccdb4-dm8j5

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

e2e-shared-a-w2-bda598-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-bda598-openshift-default-77b79bd476 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w2-bda598-openshift-default-77b79bd476

SuccessfulCreate

Created pod: e2e-shared-a-w2-bda598-openshift-default-77b79bd476-hdhhg

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-bda598

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-bda598

openshift-ingress

multus

e2e-shared-a-w2-bda598-openshift-default-77b79bd476-hdhhg

AddedInterface

Add eth0 [10.134.0.70/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-bda598-688599fd66

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-bda598-688599fd66-cw6t6
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-bda598-58f8675fdc

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-bda598-58f8675fdc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-bda598: serviceaccount "payload-processing-e2e-shared-a-w2-bda598" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-bda598

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-bda598-688599fd66 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-bda598-688599fd66

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-bda598-688599fd66-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-bda598: serviceaccount "payload-processing-e2e-shared-a-w2-bda598" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-bda598

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-bda598-58f8675fdc from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-bda598-58f8675fdc

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-bda598-58f8675fdc-qqnbb

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-bda598-58f8675fdc-qqnbb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-bda598-58f8675fdc-qqnbb

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-bda598-688599fd66-cw6t6

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-bda598-58f8675fdc-qqnbb

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-bda598-688599fd66-cw6t6

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-bda598-688599fd66-cw6t6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-bda598-688599fd66-cw6t6

AddedInterface

Add eth0 [10.133.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-bda598-58f8675fdc-qqnbb

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-b3d9be-59fbb6466-shg8n

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-explicit-b3d9be

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-explicit-b3d9be: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-explicit-b3d9be": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-explicit-b3d9be, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: e346c9a7-32a5-438a-83db-dd75f1c3e543, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-explicit-b3d9be-54c486c86f-9cbfx

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-shared-b-w2-7b202f-openshift-default-5687c5cfd

SuccessfulCreate

Created pod: e2e-shared-b-w2-7b202f-openshift-default-5687c5cfd-rhzq4

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-7b202f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-7b202f

openshift-ingress

deployment-controller

e2e-shared-b-w2-7b202f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-7b202f-openshift-default-5687c5cfd from 0 to 1

openshift-ingress

multus

e2e-shared-b-w2-7b202f-openshift-default-5687c5cfd-rhzq4

AddedInterface

Add eth0 [10.134.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-7b202f-77c5474c46-r2x7f

Created

Created container: payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-7b202f-77c5474c46

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-7b202f-77c5474c46-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-7b202f: serviceaccount "payload-processing-e2e-shared-b-w2-7b202f" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-7b202f-77c5474c46

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-7b202f-77c5474c46-r2x7f

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-7b202f-9f7687869-x2dxh

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-7b202f-77c5474c46-r2x7f

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-7b202f-9f7687869-x2dxh

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-7b202f-9f7687869-x2dxh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-7b202f-9f7687869

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-7b202f-9f7687869-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-7b202f: serviceaccount "payload-processing-e2e-shared-b-w2-7b202f" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-7b202f-9f7687869-x2dxh

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-7b202f-77c5474c46-r2x7f

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-7b202f-77c5474c46-r2x7f

AddedInterface

Add eth0 [10.132.0.72/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-7b202f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-7b202f-77c5474c46 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-7b202f-9f7687869

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-7b202f-9f7687869-x2dxh

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-7b202f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-7b202f-9f7687869 from 0 to 1

openshift-ingress

kubelet

e2e-shared-a-w2-bda598-openshift-default-77b79bd476-hdhhg

ProbeError

Readiness probe error: Get "http://10.134.0.70:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-a-w2-bda598-openshift-default-77b79bd476-hdhhg

Unhealthy

Readiness probe failed: Get "http://10.134.0.70:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-bda598-openshift-default-77b79bd476-hdhhg

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-bda598-openshift-default-77b79bd476-hdhhg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-bda598-openshift-default-77b79bd476-hdhhg

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-bda598-openshift-default-77b79bd476-hdhhg

Unhealthy

Startup probe failed: Get "http://10.134.0.70:15021/healthz/ready": dial tcp 10.134.0.70:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-bda598-openshift-default-77b79bd476-hdhhg

ProbeError

Startup probe error: Get "http://10.134.0.70:15021/healthz/ready": dial tcp 10.134.0.70:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-7b202f-openshift-default-5687c5cfd-rhzq4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-7b202f-openshift-default-5687c5cfd-rhzq4

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-7b202f-openshift-default-5687c5cfd-rhzq4

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-explicit-b3d9be-openshift-default-76d446df4d-w2f9p

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-noten-c93e93-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-c93e93-openshift-default-86965d8768 from 0 to 1

openshift-ingress

replicaset-controller

e2e-noten-c93e93-openshift-default-86965d8768

SuccessfulCreate

Created pod: e2e-noten-c93e93-openshift-default-86965d8768-cf2rq

openshift-ingress

gateway_labeler_controller

e2e-noten-c93e93

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-c93e93
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-7b202f-openshift-default-5687c5cfd-rhzq4

ProbeError

Startup probe error: Get "http://10.134.0.73:15021/healthz/ready": dial tcp 10.134.0.73:15021: connect: connection refused body:

openshift-ingress

multus

e2e-noten-c93e93-openshift-default-86965d8768-cf2rq

AddedInterface

Add eth0 [10.134.0.74/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-7b202f-openshift-default-5687c5cfd-rhzq4

Unhealthy

Startup probe failed: Get "http://10.134.0.73:15021/healthz/ready": dial tcp 10.134.0.73:15021: connect: connection refused

openshift-ingress

kubelet

e2e-noten-c93e93-openshift-default-86965d8768-cf2rq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-noten-c93e93-openshift-default-86965d8768-cf2rq

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-noten-c93e93-openshift-default-86965d8768-cf2rq

Created

Created container: istio-proxy

openshift-ingress

multus

e2e-mt-76145153-openshift-default-979f65fcb-q7g24

AddedInterface

Add eth0 [10.134.0.75/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-mt-76145153-openshift-default-979f65fcb

SuccessfulCreate

Created pod: e2e-mt-76145153-openshift-default-979f65fcb-q7g24

openshift-ingress

deployment-controller

e2e-mt-76145153-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-76145153-openshift-default-979f65fcb from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-76145153

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-76145153

openshift-ingress

deployment-controller

payload-processing-e2e-mt-76145153

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-76145153-78dfb9457 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-76145153-5d9f749df8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-76145153-5d9f749df8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-76145153: serviceaccount "payload-processing-e2e-mt-76145153" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-76145153-78dfb9457

FailedCreate

Error creating: pods "payload-processing-e2e-mt-76145153-78dfb9457-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-76145153: serviceaccount "payload-processing-e2e-mt-76145153" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-76145153-78dfb9457

SuccessfulCreate

Created pod: payload-processing-e2e-mt-76145153-78dfb9457-hlkbl

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-76145153

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-76145153-5d9f749df8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-76145153-5d9f749df8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-76145153-5d9f749df8-8xmbd

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-76145153-5d9f749df8-8xmbd

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-76145153-5d9f749df8-8xmbd

AddedInterface

Add eth0 [10.132.0.78/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-mt-76145153-78dfb9457-hlkbl

AddedInterface

Add eth0 [10.133.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-76145153-5d9f749df8-8xmbd

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-76145153-5d9f749df8-8xmbd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-76145153-78dfb9457-hlkbl

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-76145153-78dfb9457-hlkbl

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-76145153-78dfb9457-hlkbl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-679c94-7f6f876966-pknkw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-679c94-675dc79477-ckbhl

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-mt-76145153-openshift-default-979f65fcb-q7g24

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-76145153-openshift-default-979f65fcb-q7g24

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-76145153-openshift-default-979f65fcb-q7g24

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-mt-76145153-openshift-default-979f65fcb-q7g24

ProbeError

Startup probe error: Get "http://10.134.0.75:15021/healthz/ready": dial tcp 10.134.0.75:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-76145153-openshift-default-979f65fcb-q7g24

Unhealthy

Startup probe failed: Get "http://10.134.0.75:15021/healthz/ready": dial tcp 10.134.0.75:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-6ce17e-696f5ff8d5-bdzk8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-6ce17e-5b6fd8b698-9sxtx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-a-679c94-openshift-default-586587fdb6-727nf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-6ce17e-openshift-default-848b659b94-72crk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-6ce17e-openshift-default-848b659b94-72crk

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w0-6ce17e-openshift-default-848b659b94-72crk

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-568856-678b76cc8-zbp9g

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-568856-8448cc7ff-cgvl8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-noten-c93e93-openshift-default-86965d8768-cf2rq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-568856-openshift-default-5d7f66dcf6-2pwws

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-6c97f2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-6c97f2

openshift-ingress

deployment-controller

e2e-shared-a-w3-6c97f2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-6c97f2-openshift-default-6669fbd6bb from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w3-6c97f2-openshift-default-6669fbd6bb

SuccessfulCreate

Created pod: e2e-shared-a-w3-6c97f2-openshift-default-6669fbd6bb-9xp88

openshift-ingress

multus

e2e-shared-a-w3-6c97f2-openshift-default-6669fbd6bb-9xp88

AddedInterface

Add eth0 [10.134.0.77/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-6c97f2-6b499fd7cc-gz6pm

AddedInterface

Add eth0 [10.132.0.85/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-6c97f2-6b499fd7cc

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-6c97f2-6b499fd7cc-gz6pm

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-6c97f2-5879ccf68b-fhjkn

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-6c97f2-5879ccf68b-fhjkn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-6c97f2-5879ccf68b-fhjkn

AddedInterface

Add eth0 [10.132.0.84/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-6c97f2-6b499fd7cc-gz6pm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-6c97f2-6b499fd7cc-gz6pm

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-6c97f2-6b499fd7cc-gz6pm

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-6c97f2-6b499fd7cc

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-6c97f2-6b499fd7cc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-6c97f2: serviceaccount "payload-processing-e2e-shared-a-w3-6c97f2" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-6c97f2-5879ccf68b-fhjkn

Started

Started container payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-6c97f2-5879ccf68b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-6c97f2-5879ccf68b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-6c97f2: serviceaccount "payload-processing-e2e-shared-a-w3-6c97f2" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-6c97f2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-6c97f2-6b499fd7cc from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-6c97f2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-6c97f2-5879ccf68b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-6c97f2-5879ccf68b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-6c97f2-5879ccf68b-fhjkn

openshift-ingress

kubelet

e2e-shared-a-w3-6c97f2-openshift-default-6669fbd6bb-9xp88

ProbeError

Readiness probe error: Get "http://10.134.0.77:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-a-w3-6c97f2-openshift-default-6669fbd6bb-9xp88

Unhealthy

Readiness probe failed: Get "http://10.134.0.77:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-6c97f2-openshift-default-6669fbd6bb-9xp88

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-6c97f2-openshift-default-6669fbd6bb-9xp88

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-6c97f2-openshift-default-6669fbd6bb-9xp88

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-6c97f2-openshift-default-6669fbd6bb-9xp88

ProbeError

Startup probe error: Get "http://10.134.0.77:15021/healthz/ready": dial tcp 10.134.0.77:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-6c97f2-openshift-default-6669fbd6bb-9xp88

Unhealthy

Startup probe failed: Get "http://10.134.0.77:15021/healthz/ready": dial tcp 10.134.0.77:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-shared-b-w3-83be66-openshift-default-5bdd849c5d

SuccessfulCreate

Created pod: e2e-shared-b-w3-83be66-openshift-default-5bdd849c5d-fxzfv

openshift-ingress

deployment-controller

e2e-shared-b-w3-83be66-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-83be66-openshift-default-5bdd849c5d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-83be66

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-83be66

openshift-ingress

multus

e2e-shared-b-w3-83be66-openshift-default-5bdd849c5d-fxzfv

AddedInterface

Add eth0 [10.134.0.79/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-83be66-744498577d-hz4r2

AddedInterface

Add eth0 [10.132.0.86/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-83be66-6769cb6845

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-83be66-6769cb6845-pqvwr

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-83be66-744498577d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-83be66-744498577d-hz4r2
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-83be66-744498577d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-83be66-744498577d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-83be66: serviceaccount "payload-processing-e2e-shared-b-w3-83be66" not found

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-83be66-6769cb6845-pqvwr

AddedInterface

Add eth0 [10.132.0.87/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-83be66-6769cb6845-pqvwr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-83be66-744498577d-hz4r2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-83be66-744498577d-hz4r2

Created

Created container: payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-83be66

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-83be66-744498577d from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-83be66-744498577d-hz4r2

Started

Started container payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-83be66-6769cb6845

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-83be66-6769cb6845-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-83be66: serviceaccount "payload-processing-e2e-shared-b-w3-83be66" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-83be66

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-83be66-6769cb6845 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-83be66-6769cb6845-pqvwr

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-83be66-6769cb6845-pqvwr

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-83be66-openshift-default-5bdd849c5d-fxzfv

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-83be66-openshift-default-5bdd849c5d-fxzfv

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-83be66-openshift-default-5bdd849c5d-fxzfv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-83be66-openshift-default-5bdd849c5d-fxzfv

ProbeError

Startup probe error: Get "http://10.134.0.79:15021/healthz/ready": dial tcp 10.134.0.79:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-83be66-openshift-default-5bdd849c5d-fxzfv

Unhealthy

Startup probe failed: Get "http://10.134.0.79:15021/healthz/ready": dial tcp 10.134.0.79:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-mt-76145153-78dfb9457-hlkbl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-76145153-5d9f749df8-8xmbd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-76145153-openshift-default-979f65fcb-q7g24

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-76145153-openshift-default-979f65fcb-q7g24

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-76145153-openshift-default-979f65fcb-q7g24

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

gateway_labeler_controller

e2e-api-a-a4c77c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-a4c77c

openshift-ingress

deployment-controller

e2e-api-a-a4c77c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-a4c77c-openshift-default-944d679c4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-a4c77c-openshift-default-944d679c4

SuccessfulCreate

Created pod: e2e-api-a-a4c77c-openshift-default-944d679c4-s8cxb

openshift-ingress

multus

e2e-api-a-a4c77c-openshift-default-944d679c4-s8cxb

AddedInterface

Add eth0 [10.134.0.82/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-a4c77c-d4cc46797

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-a4c77c-d4cc46797-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-a4c77c: serviceaccount "payload-processing-e2e-api-a-a4c77c" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-a4c77c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-a4c77c-7d646cb87d from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-a4c77c-7d646cb87d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-a4c77c-7d646cb87d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-a4c77c: serviceaccount "payload-processing-e2e-api-a-a4c77c" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-a4c77c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-a4c77c-d4cc46797 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-a4c77c-d4cc46797

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-a4c77c-d4cc46797-qxvsj

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-a4c77c-7d646cb87d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-a4c77c-7d646cb87d-fvjsn

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-a4c77c-7d646cb87d-fvjsn

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-a4c77c-d4cc46797-qxvsj

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-a4c77c-d4cc46797-qxvsj

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-a4c77c-d4cc46797-qxvsj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-a4c77c-7d646cb87d-fvjsn

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-a-a4c77c-7d646cb87d-fvjsn

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-api-a-a4c77c-d4cc46797-qxvsj

AddedInterface

Add eth0 [10.132.0.91/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-a4c77c-7d646cb87d-fvjsn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-a4c77c-openshift-default-944d679c4-s8cxb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-a4c77c-openshift-default-944d679c4-s8cxb

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-a4c77c-openshift-default-944d679c4-s8cxb

Started

Started container istio-proxy

openshift-ingress

replicaset-controller

e2e-api-b-72f076-openshift-default-5699c8958b

SuccessfulCreate

Created pod: e2e-api-b-72f076-openshift-default-5699c8958b-whvfq

openshift-ingress

deployment-controller

e2e-api-b-72f076-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-72f076-openshift-default-5699c8958b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-72f076

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-72f076

openshift-ingress

multus

e2e-api-b-72f076-openshift-default-5699c8958b-whvfq

AddedInterface

Add eth0 [10.134.0.83/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-72f076-6d5866f554

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-72f076-6d5866f554-cjcjm

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-72f076

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-72f076-6d5866f554 from 0 to 1
(x7)

openshift-ingress

kubelet

e2e-api-a-a4c77c-openshift-default-944d679c4-s8cxb

Unhealthy

Startup probe failed: Get "http://10.134.0.82:15021/healthz/ready": dial tcp 10.134.0.82:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-api-a-a4c77c-openshift-default-944d679c4-s8cxb

ProbeError

Startup probe error: Get "http://10.134.0.82:15021/healthz/ready": dial tcp 10.134.0.82:15021: connect: connection refused body:
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-72f076-6d5866f554

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-72f076-6d5866f554-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-72f076: serviceaccount "payload-processing-e2e-api-b-72f076" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-72f076

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-72f076-77d97bb65c from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-72f076-77d97bb65c

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-72f076-77d97bb65c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-72f076: serviceaccount "payload-processing-e2e-api-b-72f076" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-72f076-77d97bb65c

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-72f076-77d97bb65c-vd6px

openshift-ingress

kubelet

payload-processing-e2e-api-b-72f076-77d97bb65c-vd6px

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-72f076-6d5866f554-cjcjm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-b-72f076-6d5866f554-cjcjm

AddedInterface

Add eth0 [10.132.0.93/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-72f076-6d5866f554-cjcjm

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-72f076-77d97bb65c-vd6px

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-72f076-77d97bb65c-vd6px

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-api-b-72f076-77d97bb65c-vd6px

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-72f076-6d5866f554-cjcjm

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-api-b-72f076-openshift-default-5699c8958b-whvfq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-72f076-openshift-default-5699c8958b-whvfq

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-72f076-openshift-default-5699c8958b-whvfq

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-b-72f076-openshift-default-5699c8958b-whvfq

ProbeError

Startup probe error: Get "http://10.134.0.83:15021/healthz/ready": dial tcp 10.134.0.83:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-72f076-openshift-default-5699c8958b-whvfq

Unhealthy

Startup probe failed: Get "http://10.134.0.83:15021/healthz/ready": dial tcp 10.134.0.83:15021: connect: connection refused

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-api-a-a4c77c

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-api-a-a4c77c: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-api-a-a4c77c": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-api-a-a4c77c, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 5f454ee2-70e3-4627-9e2a-adfa40b541dd, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-a4c77c-7d646cb87d-fvjsn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-a4c77c-d4cc46797-qxvsj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-a-a4c77c-openshift-default-944d679c4-s8cxb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-api-b-72f076-77d97bb65c-vd6px

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-72f076-6d5866f554-cjcjm

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-api-b-72f076

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-api-b-72f076: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-api-b-72f076": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-api-b-72f076, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 63530b26-85c8-4199-ae82-08ca6a82ff07, UID in object meta:

openshift-ingress

kubelet

e2e-api-b-72f076-openshift-default-5699c8958b-whvfq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-72f076-openshift-default-5699c8958b-whvfq

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-b-72f076-openshift-default-5699c8958b-whvfq

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-a-w2-bda598

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-a-w2-bda598: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-a-w2-bda598": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-a-w2-bda598, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 94f6b4b0-2427-4810-8e0a-9af55bdab02b, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-bda598-688599fd66-cw6t6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-bda598-58f8675fdc-qqnbb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w2-bda598-openshift-default-77b79bd476-hdhhg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-7b202f-9f7687869-x2dxh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-7b202f-77c5474c46-r2x7f

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w2-7b202f-openshift-default-5687c5cfd-rhzq4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-7025b9-6cd5b6ff89-9b7xv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-7025b9-6cc7967d46-67pc7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w4-7025b9-openshift-default-7b6bccd4d6-fbnml

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-7025b9-openshift-default-7b6bccd4d6-fbnml

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w4-7025b9-openshift-default-7b6bccd4d6-fbnml

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

e2e-ipp-a-ea2b31-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-ea2b31-openshift-default-86666c467d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-ea2b31

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-ea2b31

openshift-ingress

replicaset-controller

e2e-ipp-a-ea2b31-openshift-default-86666c467d

SuccessfulCreate

Created pod: e2e-ipp-a-ea2b31-openshift-default-86666c467d-zxv65

openshift-ingress

multus

e2e-ipp-a-ea2b31-openshift-default-86666c467d-zxv65

AddedInterface

Add eth0 [10.134.0.87/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-ea2b31-7bc7597d5c

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-ea2b31-7bc7597d5c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-ea2b31: serviceaccount "payload-processing-e2e-ipp-a-ea2b31" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-ea2b31

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-ea2b31-7bc7597d5c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-ea2b31-55f6d848c8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-ea2b31-55f6d848c8-zmb7v

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-ea2b31

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-ea2b31-55f6d848c8 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-ea2b31-55f6d848c8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-ea2b31-55f6d848c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-ea2b31: serviceaccount "payload-processing-e2e-ipp-a-ea2b31" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-ea2b31-7bc7597d5c

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-ea2b31-7bc7597d5c-8jld5

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-ea2b31-7bc7597d5c-8jld5

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-ipp-a-ea2b31-7bc7597d5c-8jld5

AddedInterface

Add eth0 [10.133.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-ea2b31-55f6d848c8-zmb7v

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-ea2b31-55f6d848c8-zmb7v

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-ea2b31-7bc7597d5c-8jld5

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-ea2b31-55f6d848c8-zmb7v

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-ea2b31-7bc7597d5c-8jld5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-ea2b31-55f6d848c8-zmb7v

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-ea2b31-openshift-default-86666c467d-zxv65

ProbeError

Readiness probe error: Get "http://10.134.0.87:15021/healthz/ready": read tcp 10.134.0.2:55604->10.134.0.87:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-ipp-a-ea2b31-openshift-default-86666c467d-zxv65

Unhealthy

Readiness probe failed: Get "http://10.134.0.87:15021/healthz/ready": read tcp 10.134.0.2:55604->10.134.0.87:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-ipp-a-ea2b31-openshift-default-86666c467d-zxv65

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-ea2b31-openshift-default-86666c467d-zxv65

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-ea2b31-openshift-default-86666c467d-zxv65

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-a-ea2b31-openshift-default-86666c467d-zxv65

Unhealthy

Startup probe failed: Get "http://10.134.0.87:15021/healthz/ready": dial tcp 10.134.0.87:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-ea2b31-openshift-default-86666c467d-zxv65

ProbeError

Startup probe error: Get "http://10.134.0.87:15021/healthz/ready": dial tcp 10.134.0.87:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-ipp-b-706b9d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-706b9d-openshift-default-674f6dcb6d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-706b9d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-706b9d

openshift-ingress

replicaset-controller

e2e-ipp-b-706b9d-openshift-default-674f6dcb6d

SuccessfulCreate

Created pod: e2e-ipp-b-706b9d-openshift-default-674f6dcb6d-krhlr

openshift-ingress

multus

e2e-ipp-b-706b9d-openshift-default-674f6dcb6d-krhlr

AddedInterface

Add eth0 [10.134.0.88/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-706b9d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-706b9d-ffd4595dc from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-706b9d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-706b9d-6cffdd7dd6 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-706b9d-ffd4595dc

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-706b9d-ffd4595dc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-706b9d: serviceaccount "payload-processing-e2e-ipp-b-706b9d" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-706b9d-6cffdd7dd6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-706b9d-6cffdd7dd6-m5t2c
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-706b9d-6cffdd7dd6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-706b9d-6cffdd7dd6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-706b9d: serviceaccount "payload-processing-e2e-ipp-b-706b9d" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-706b9d-ffd4595dc

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-706b9d-ffd4595dc-zhcx2

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-706b9d-ffd4595dc-zhcx2

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-706b9d-ffd4595dc-zhcx2

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-ipp-b-706b9d-ffd4595dc-zhcx2

AddedInterface

Add eth0 [10.132.0.106/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-706b9d-ffd4595dc-zhcx2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-706b9d-6cffdd7dd6-m5t2c

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-706b9d-6cffdd7dd6-m5t2c

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-706b9d-6cffdd7dd6-m5t2c

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-706b9d-6cffdd7dd6-m5t2c

AddedInterface

Add eth0 [10.132.0.105/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-b-706b9d-openshift-default-674f6dcb6d-krhlr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-706b9d-openshift-default-674f6dcb6d-krhlr

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-706b9d-openshift-default-674f6dcb6d-krhlr

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-b-706b9d-openshift-default-674f6dcb6d-krhlr

Unhealthy

Startup probe failed: Get "http://10.134.0.88:15021/healthz/ready": dial tcp 10.134.0.88:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-706b9d-openshift-default-674f6dcb6d-krhlr

ProbeError

Startup probe error: Get "http://10.134.0.88:15021/healthz/ready": dial tcp 10.134.0.88:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-230464-openshift-default-684b5fffb6

SuccessfulCreate

Created pod: e2e-ipp-cleanup-230464-openshift-default-684b5fffb6-tjwrf

openshift-ingress

deployment-controller

e2e-ipp-cleanup-230464-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-230464-openshift-default-684b5fffb6 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-230464

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-230464

openshift-ingress

multus

e2e-ipp-cleanup-230464-openshift-default-684b5fffb6-tjwrf

AddedInterface

Add eth0 [10.134.0.89/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-230464-6b95d9cc49

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-230464-6b95d9cc49-dvvfm

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-230464-79f9676c6b-c8xbs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-230464-6b95d9cc49

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-230464-6b95d9cc49-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-230464: serviceaccount "payload-processing-e2e-ipp-cleanup-230464" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-230464-79f9676c6b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-230464-79f9676c6b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-230464: serviceaccount "payload-processing-e2e-ipp-cleanup-230464" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-230464-79f9676c6b-c8xbs

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-230464-79f9676c6b-c8xbs

Created

Created container: payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-230464

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-230464-6b95d9cc49 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-230464-79f9676c6b-c8xbs

AddedInterface

Add eth0 [10.132.0.108/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-230464

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-230464-79f9676c6b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-230464-79f9676c6b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-230464-79f9676c6b-c8xbs

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-230464-6b95d9cc49-dvvfm

AddedInterface

Add eth0 [10.132.0.109/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-230464-6b95d9cc49-dvvfm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-230464-6b95d9cc49-dvvfm

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-230464-6b95d9cc49-dvvfm

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-230464-openshift-default-684b5fffb6-tjwrf

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-230464-openshift-default-684b5fffb6-tjwrf

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-230464-openshift-default-684b5fffb6-tjwrf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-ipp-cleanup-230464-openshift-default-684b5fffb6-tjwrf

ProbeError

Startup probe error: Get "http://10.134.0.89:15021/healthz/ready": dial tcp 10.134.0.89:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-cleanup-230464-openshift-default-684b5fffb6-tjwrf

Unhealthy

Startup probe failed: Get "http://10.134.0.89:15021/healthz/ready": dial tcp 10.134.0.89:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-230464-79f9676c6b-c8xbs

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-cleanup-230464

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-230464: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-cleanup-230464": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-230464, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 74cc1cc6-3f59-4f4f-a914-59077793b3bb, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-230464-6b95d9cc49-dvvfm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-230464-openshift-default-684b5fffb6-tjwrf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-cleanup-230464-openshift-default-684b5fffb6-tjwrf

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-cleanup-230464-openshift-default-684b5fffb6-tjwrf

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-ea2b31-55f6d848c8-zmb7v

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-ea2b31-7bc7597d5c-8jld5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-ea2b31-openshift-default-86666c467d-zxv65

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-ea2b31-openshift-default-86666c467d-zxv65

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-a-ea2b31-openshift-default-86666c467d-zxv65

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-b-706b9d

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-b-706b9d: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-b-706b9d": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-b-706b9d, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 13e5dd1b-ad02-4251-b20b-119212e9fac8, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-706b9d-ffd4595dc-zhcx2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-706b9d-6cffdd7dd6-m5t2c

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-706b9d-openshift-default-674f6dcb6d-krhlr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-706b9d-openshift-default-674f6dcb6d-krhlr

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-b-706b9d-openshift-default-674f6dcb6d-krhlr

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-6c97f2-6b499fd7cc-gz6pm

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-a-w3-6c97f2

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-a-w3-6c97f2: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-a-w3-6c97f2": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-a-w3-6c97f2, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: f9f12dc8-32a3-4068-ab6a-7db3a338788b, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-6c97f2-5879ccf68b-fhjkn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w3-6c97f2-openshift-default-6669fbd6bb-9xp88

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w3-6c97f2-openshift-default-6669fbd6bb-9xp88

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w3-6c97f2-openshift-default-6669fbd6bb-9xp88

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-83be66-6769cb6845-pqvwr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-83be66-744498577d-hz4r2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w3-83be66-openshift-default-5bdd849c5d-fxzfv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w3-83be66-openshift-default-5bdd849c5d-fxzfv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w3-83be66-openshift-default-5bdd849c5d-fxzfv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: