Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-27be50-599698f7b6-87fpn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-27be50-599698f7b6-87fpn to ip-10-0-132-238.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-h9d2d

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-h9d2d to ip-10-0-132-238.ec2.internal

openshift-ingress

e2e-ipp-b-7bbea9-openshift-default-56cd4b86d4-l28j5

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-7bbea9-openshift-default-56cd4b86d4-l28j5 to ip-10-0-133-99.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-6jjp4

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6jjp4 to ip-10-0-132-238.ec2.internal

openshift-ingress

payload-processing-e2e-mt-4ee4bdd9-5db967f57c-ggtgx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-4ee4bdd9-5db967f57c-ggtgx to ip-10-0-132-238.ec2.internal

openshift-ingress

payload-processing-e2e-mt-c7c6a48c-787f9896f7-sbtt5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-c7c6a48c-787f9896f7-sbtt5 to ip-10-0-132-238.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-2eeb50-64f96b44bc-8wgzq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-2eeb50-64f96b44bc-8wgzq to ip-10-0-132-238.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-2ff4a6-7859858b49-5nqtd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-2ff4a6-7859858b49-5nqtd to ip-10-0-132-238.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-a8c46f-746b7b7d67-844g5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-a8c46f-746b7b7d67-844g5 to ip-10-0-133-99.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-27be50-6565465c95-lmdjl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-27be50-6565465c95-lmdjl to ip-10-0-132-238.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-c366d3-668d8688df-dtphc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-c366d3-668d8688df-dtphc to ip-10-0-133-99.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-c366d3-5589b9798-mjbl6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-c366d3-5589b9798-mjbl6 to ip-10-0-137-105.ec2.internal

openshift-ingress

e2e-ipp-a-524a38-openshift-default-d897559fb-97xvm

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-524a38-openshift-default-d897559fb-97xvm to ip-10-0-132-238.ec2.internal

openshift-ingress

e2e-shared-b-w3-27be50-openshift-default-6d48cf8d84-sklh4

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-27be50-openshift-default-6d48cf8d84-sklh4 to ip-10-0-133-99.ec2.internal

openshift-ingress

e2e-ipp-cleanup-2339fb-openshift-default-7cb66954b6-8szld

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-2339fb-openshift-default-7cb66954b6-8szld to ip-10-0-132-238.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-60e333a9-575c6488c8-2h2wc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-60e333a9-575c6488c8-2h2wc to ip-10-0-133-99.ec2.internal

openshift-ingress

e2e-inf-b-e7fdd6-openshift-default-74bfd88f5b-64698

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-e7fdd6-openshift-default-74bfd88f5b-64698 to ip-10-0-132-238.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-2339fb-9967895f7-db2s9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-2339fb-9967895f7-db2s9 to ip-10-0-133-99.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-7bbea9-95557b9f-hkvwf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-7bbea9-95557b9f-hkvwf to ip-10-0-132-238.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-524a38-64f67b69c5-4bpc4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-524a38-64f67b69c5-4bpc4 to ip-10-0-133-99.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-gtt2g

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-gtt2g to ip-10-0-137-105.ec2.internal

openshift-ingress

e2e-ait-654e8bde-openshift-default-6dbc8bc8-bh59t

Scheduled

Successfully assigned openshift-ingress/e2e-ait-654e8bde-openshift-default-6dbc8bc8-bh59t to ip-10-0-132-238.ec2.internal

openshift-ingress

payload-processing-e2e-ait-654e8bde-f5c84745-5s7k2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-654e8bde-f5c84745-5s7k2 to ip-10-0-133-99.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-2339fb-9f8c9fb5d-lwgwm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-2339fb-9f8c9fb5d-lwgwm to ip-10-0-133-99.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-4ee4bdd9-69fbb96966-x8jdm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-4ee4bdd9-69fbb96966-x8jdm to ip-10-0-132-238.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-7bbea9-6c44bcf854-8mbns

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-7bbea9-6c44bcf854-8mbns to ip-10-0-133-99.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-c7c6a48c-7f9cf4474b-qrmzh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-c7c6a48c-7f9cf4474b-qrmzh to ip-10-0-133-99.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-524a38-86b8879754-kkckd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-524a38-86b8879754-kkckd to ip-10-0-132-238.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-2eeb50-68db997bf4-s7kpn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-2eeb50-68db997bf4-s7kpn to ip-10-0-133-99.ec2.internal

openshift-ingress

payload-processing-e2e-ait-8f579f00-68c4db85cc-6z8zf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-8f579f00-68c4db85cc-6z8zf to ip-10-0-133-99.ec2.internal

openshift-ingress

e2e-shared-b-w2-a8c46f-openshift-default-5c9bd8464d-8vl64

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-a8c46f-openshift-default-5c9bd8464d-8vl64 to ip-10-0-132-238.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-5t7fb

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-5t7fb to ip-10-0-132-238.ec2.internal

openshift-ingress

e2e-ait-8f579f00-openshift-default-5d5dcf9d4b-ndv5l

Scheduled

Successfully assigned openshift-ingress/e2e-ait-8f579f00-openshift-default-5d5dcf9d4b-ndv5l to ip-10-0-133-99.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-e7fdd6-6d5f6c59c8-kwsxf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-e7fdd6-6d5f6c59c8-kwsxf to ip-10-0-132-238.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-2ff4a6-78bb8d9894-28fgr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-2ff4a6-78bb8d9894-28fgr to ip-10-0-132-238.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-6cb472-74ccccb955-7jkt4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-6cb472-74ccccb955-7jkt4 to ip-10-0-133-99.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-09203c-54db9f8bc9-gww9w

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-09203c-54db9f8bc9-gww9w to ip-10-0-132-238.ec2.internal

openshift-ingress

payload-processing-e2e-autores-f14475-857d5b4f79-crdsn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-f14475-857d5b4f79-crdsn to ip-10-0-133-99.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-a8c46f-8585cb8f4-vjtwx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-a8c46f-8585cb8f4-vjtwx to ip-10-0-133-99.ec2.internal

openshift-ingress

e2e-worker-w0-c366d3-openshift-default-6584d9b774-tv5q5

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-c366d3-openshift-default-6584d9b774-tv5q5 to ip-10-0-137-105.ec2.internal

openshift-ingress

e2e-shared-a-w3-2ff4a6-openshift-default-6cdbbdbf5d-glrj5

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-2ff4a6-openshift-default-6cdbbdbf5d-glrj5 to ip-10-0-133-99.ec2.internal

openshift-ingress

payload-processing-e2e-derive-2a2a3973-cff7fb645-wmr6k

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-2a2a3973-cff7fb645-wmr6k to ip-10-0-133-99.ec2.internal

openshift-ingress

e2e-worker-w4-e08402-openshift-default-f6f5dc8f4-czx5r

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-e08402-openshift-default-f6f5dc8f4-czx5r to ip-10-0-132-238.ec2.internal

openshift-ingress

e2e-shared-a-w2-2eeb50-openshift-default-85f875f444-mhrvb

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-2eeb50-openshift-default-85f875f444-mhrvb to ip-10-0-132-238.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-667664-5bd57bd994-52n8z

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-667664-5bd57bd994-52n8z to ip-10-0-133-99.ec2.internal

openshift-ingress

e2e-api-a-6cb472-openshift-default-56b886b47b-c78dr

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-6cb472-openshift-default-56b886b47b-c78dr to ip-10-0-133-99.ec2.internal

openshift-ingress

kube-auth-proxy-96745c74f-xnltl

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-96745c74f-xnltl to ip-10-0-133-99.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-60e333a9-79654cfdfd-mfmjv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-60e333a9-79654cfdfd-mfmjv to ip-10-0-133-99.ec2.internal

openshift-ingress

e2e-inf-a-667664-openshift-default-8675dc4d6d-g7d2n

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-667664-openshift-default-8675dc4d6d-g7d2n to ip-10-0-132-238.ec2.internal

openshift-ingress

e2e-migrate-60e333a9-gw-openshift-default-5496f8f78d-7dwrm

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-60e333a9-gw-openshift-default-5496f8f78d-7dwrm to ip-10-0-132-238.ec2.internal

openshift-ingress

kube-auth-proxy-96745c74f-dttph

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-96745c74f-dttph to ip-10-0-137-105.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-654e8bde-5c9d48dbf4-mqjqq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-654e8bde-5c9d48dbf4-mqjqq to ip-10-0-133-99.ec2.internal

openshift-ingress

e2e-explicit-9529a1-openshift-default-5fb7fd4688-px7qr

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-9529a1-openshift-default-5fb7fd4688-px7qr to ip-10-0-133-99.ec2.internal

openshift-ingress

e2e-mt-4ee4bdd9-openshift-default-7fccc644fb-7847s

Scheduled

Successfully assigned openshift-ingress/e2e-mt-4ee4bdd9-openshift-default-7fccc644fb-7847s to ip-10-0-133-99.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-8f579f00-848cdc564b-k8797

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-8f579f00-848cdc564b-k8797 to ip-10-0-132-238.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-6cb472-7b66768854-pk99s

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-6cb472-7b66768854-pk99s to ip-10-0-132-238.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-e08402-67784fb846-dhznh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-e08402-67784fb846-dhznh to ip-10-0-132-238.ec2.internal

openshift-ingress

e2e-derive-2a2a3973-openshift-default-7698ff55bd-8mfjx

Scheduled

Successfully assigned openshift-ingress/e2e-derive-2a2a3973-openshift-default-7698ff55bd-8mfjx to ip-10-0-132-238.ec2.internal

openshift-ingress

e2e-api-b-09203c-openshift-default-6d94744596-vzrnv

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-09203c-openshift-default-6d94744596-vzrnv to ip-10-0-133-99.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-09203c-c76dd9494-b95q7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-09203c-c76dd9494-b95q7 to ip-10-0-132-238.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-q7src

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-q7src to ip-10-0-137-105.ec2.internal

openshift-ingress

router-default-c9d6db5f8-lqphc

Scheduled

Successfully assigned openshift-ingress/router-default-c9d6db5f8-lqphc to ip-10-0-133-99.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-9529a1-7f565fd978-mtdwz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-9529a1-7f565fd978-mtdwz to ip-10-0-133-99.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-h564w

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-h564w to ip-10-0-132-238.ec2.internal

openshift-ingress

e2e-mt-c7c6a48c-openshift-default-785bf6b7f6-8w7qd

Scheduled

Successfully assigned openshift-ingress/e2e-mt-c7c6a48c-openshift-default-785bf6b7f6-8w7qd to ip-10-0-133-99.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-e7fdd6-56c7655575-4ltrp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-e7fdd6-56c7655575-4ltrp to ip-10-0-133-99.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-f14475-59bb95458-z5mxz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-f14475-59bb95458-z5mxz to ip-10-0-133-99.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-2a2a3973-5985c67478-fjrj9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-2a2a3973-5985c67478-fjrj9 to ip-10-0-133-99.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-9529a1-6f7495cf77-p6vbq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-9529a1-6f7495cf77-p6vbq to ip-10-0-133-99.ec2.internal

openshift-ingress

e2e-noten-255ce3-openshift-default-dd5459cf8-4mjlh

Scheduled

Successfully assigned openshift-ingress/e2e-noten-255ce3-openshift-default-dd5459cf8-4mjlh to ip-10-0-133-99.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w4-e08402-7964d8d469-6tppq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-e08402-7964d8d469-6tppq to ip-10-0-132-238.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-6745bb66bckvq9f

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckvq9f to ip-10-0-132-238.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-667664-5bdbdc7d59-lck8r

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-667664-5bdbdc7d59-lck8r to ip-10-0-132-238.ec2.internal

openshift-ingress

e2e-autores-f14475-openshift-default-96796fcc6-bfzx9

Scheduled

Successfully assigned openshift-ingress/e2e-autores-f14475-openshift-default-96796fcc6-bfzx9 to ip-10-0-133-99.ec2.internal

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-c9d6db5f8 from 0 to 1

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer
(x10)

openshift-ingress

replicaset-controller

router-default-c9d6db5f8

FailedCreate

Error creating: pods "router-default-c9d6db5f8-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x16)

openshift-ingress

replicaset-controller

router-default-c9d6db5f8

FailedCreate

Error creating: pods "router-default-c9d6db5f8-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-c9d6db5f8

SuccessfulCreate

Created pod: router-default-c9d6db5f8-lqphc
(x5)

openshift-ingress

kubelet

router-default-c9d6db5f8-lqphc

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x6)

openshift-ingress

kubelet

router-default-c9d6db5f8-lqphc

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

multus

router-default-c9d6db5f8-lqphc

AddedInterface

Add eth0 [10.133.0.9/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-c9d6db5f8-lqphc

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:48526e08a2a06d05806dbcf3ddb069e5182371667d9e9f7d2cf09f60cd247d20" already present on machine

openshift-ingress

kubelet

router-default-c9d6db5f8-lqphc

Started

Started container router

openshift-ingress

kubelet

router-default-c9d6db5f8-lqphc

Created

Created container: router
(x2)

openshift-ingress

replicaset-controller

kube-auth-proxy-96745c74f

FailedCreate

Error creating: pods "kube-auth-proxy-96745c74f-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

kubelet

kube-auth-proxy-96745c74f-xnltl

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-96745c74f

SuccessfulCreate

Created pod: kube-auth-proxy-96745c74f-xnltl

openshift-ingress

replicaset-controller

kube-auth-proxy-96745c74f

SuccessfulCreate

Created pod: kube-auth-proxy-96745c74f-dttph

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-96745c74f from 0 to 2

openshift-ingress

kubelet

kube-auth-proxy-96745c74f-xnltl

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-96745c74f-xnltl

AddedInterface

Add eth0 [10.133.0.23/23] from ovn-kubernetes

openshift-ingress

multus

kube-auth-proxy-96745c74f-dttph

AddedInterface

Add eth0 [10.134.0.26/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-96745c74f-dttph

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-q7src

openshift-ingress

kubelet

kube-auth-proxy-96745c74f-dttph

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.616s (2.616s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-96745c74f-xnltl

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-96745c74f-xnltl

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.924s (2.924s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-96745c74f-xnltl

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-96745c74f-dttph

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-q7src

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-q7src

AddedInterface

Add eth0 [10.134.0.27/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-96745c74f-dttph

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-q7src

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-q7src

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.601s (2.601s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-q7src

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-q7src

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-6745bb66bc

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-6745bb66bckvq9f

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-6745bb66bckvq9f

AddedInterface

Add eth0 [10.132.0.27/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bckvq9f

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-q7src

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-h9d2d

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-h9d2d

AddedInterface

Add eth0 [10.132.0.28/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-h9d2d

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-6745bb66bc from 0 to 1

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bckvq9f

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 3.163s (3.163s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-h9d2d

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-h9d2d

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bckvq9f

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-h9d2d

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.899s (2.899s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bckvq9f

Created

Created container: istio-proxy

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-6745bb66bc

SuccessfulDelete

Deleted pod: data-science-gateway-data-science-gateway-class-6745bb66bckvq9f

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled down replica set data-science-gateway-data-science-gateway-class-6745bb66bc from 1 to 0
(x3)

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bckvq9f

Unhealthy

Startup probe failed: Get "http://10.132.0.27:15021/healthz/ready": dial tcp 10.132.0.27:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bckvq9f

ProbeError

Startup probe error: Get "http://10.132.0.27:15021/healthz/ready": dial tcp 10.132.0.27:15021: connect: connection refused body:

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bckvq9f

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-h564w

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-h564w

AddedInterface

Add eth0 [10.132.0.30/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-h564w

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-h564w

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.491s (2.491s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-h564w

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-h564w

Started

Started container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-q7src

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-q7src

Killing

Stopping container discovery

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-6jjp4

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-6jjp4

AddedInterface

Add eth0 [10.132.0.31/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-gtt2g
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-gtt2g

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-5b54b7fbb7-5t7fb

AddedInterface

Add eth0 [10.132.0.32/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-5t7fb

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-5t7fb

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-gtt2g

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-5t7fb

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-5t7fb

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-5t7fb

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.524s (1.524s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-gtt2g

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-gtt2g

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.767s (2.767s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-gtt2g

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-6jjp4

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-6jjp4

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-6jjp4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-6jjp4

Unhealthy

Startup probe failed: Get "http://10.132.0.31:15021/healthz/ready": dial tcp 10.132.0.31:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-6jjp4

ProbeError

Startup probe error: Get "http://10.132.0.31:15021/healthz/ready": dial tcp 10.132.0.31:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-c366d3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-c366d3

openshift-ingress

deployment-controller

e2e-inf-a-667664-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-667664-openshift-default-8675dc4d6d from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-667664-openshift-default-8675dc4d6d

SuccessfulCreate

Created pod: e2e-inf-a-667664-openshift-default-8675dc4d6d-g7d2n

openshift-ingress

gateway_labeler_controller

e2e-inf-a-667664

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-667664

openshift-ingress

replicaset-controller

e2e-worker-w0-c366d3-openshift-default-6584d9b774

SuccessfulCreate

Created pod: e2e-worker-w0-c366d3-openshift-default-6584d9b774-tv5q5

openshift-ingress

deployment-controller

e2e-worker-w0-c366d3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-c366d3-openshift-default-6584d9b774 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w4-e08402-openshift-default-f6f5dc8f4

SuccessfulCreate

Created pod: e2e-worker-w4-e08402-openshift-default-f6f5dc8f4-czx5r

openshift-ingress

deployment-controller

e2e-worker-w4-e08402-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-e08402-openshift-default-f6f5dc8f4 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-e08402

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-e08402

openshift-ingress

multus

e2e-worker-w0-c366d3-openshift-default-6584d9b774-tv5q5

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-c366d3-openshift-default-6584d9b774-tv5q5

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

e2e-inf-a-667664-openshift-default-8675dc4d6d-g7d2n

AddedInterface

Add eth0 [10.132.0.36/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w4-e08402-openshift-default-f6f5dc8f4-czx5r

AddedInterface

Add eth0 [10.132.0.37/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-c366d3-openshift-default-6584d9b774-tv5q5

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.917s (2.917s including waiting). Image size: 181318953 bytes.

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-667664

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-667664-5bdbdc7d59 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-667664

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-667664-5bd57bd994 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-667664-5bd57bd994

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-667664-5bd57bd994-52n8z
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-667664-5bd57bd994

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-667664-5bd57bd994-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-667664: serviceaccount "payload-processing-e2e-inf-a-667664" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-667664-5bdbdc7d59

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-667664-5bdbdc7d59-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-667664: serviceaccount "payload-processing-e2e-inf-a-667664" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-667664-5bdbdc7d59

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-667664-5bdbdc7d59-lck8r

openshift-ingress

multus

payload-processing-e2e-inf-a-667664-5bdbdc7d59-lck8r

AddedInterface

Add eth0 [10.132.0.38/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-667664-5bdbdc7d59-lck8r

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-667664-5bdbdc7d59-lck8r

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-a-667664-5bdbdc7d59-lck8r

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-667664-5bd57bd994-52n8z

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-667664-5bd57bd994-52n8z

AddedInterface

Add eth0 [10.133.0.37/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-e08402

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-e08402-67784fb846 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-e08402-7964d8d469

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-e08402-7964d8d469-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-e08402: serviceaccount "payload-processing-e2e-worker-w4-e08402" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-667664-5bd57bd994-52n8z

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.256s (1.256s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-667664-5bd57bd994-52n8z

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-667664-5bd57bd994-52n8z

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-e08402-67784fb846

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-e08402-67784fb846-dhznh
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-e08402-67784fb846

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-e08402-67784fb846-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-e08402: serviceaccount "payload-processing-e2e-worker-w4-e08402" not found

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-e08402

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-e08402-7964d8d469 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-e08402-7964d8d469

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-e08402-7964d8d469-6tppq

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-e08402-67784fb846-dhznh

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-e08402-67784fb846-dhznh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-e08402-7964d8d469-6tppq

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-e08402-7964d8d469-6tppq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-worker-w4-e08402-7964d8d469-6tppq

AddedInterface

Add eth0 [10.132.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-e08402-67784fb846-dhznh

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-c366d3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-c366d3-668d8688df from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-c366d3-668d8688df

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-c366d3-668d8688df-dtphc
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-c366d3-668d8688df

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-c366d3-668d8688df-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-c366d3: serviceaccount "payload-processing-e2e-worker-w0-c366d3" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-c366d3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-c366d3-5589b9798 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-c366d3-5589b9798

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-c366d3-5589b9798-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-c366d3: serviceaccount "payload-processing-e2e-worker-w0-c366d3" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-e08402-7964d8d469-6tppq

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-e08402-67784fb846-dhznh

AddedInterface

Add eth0 [10.132.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-c366d3-5589b9798-mjbl6

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-c366d3-5589b9798

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-c366d3-5589b9798-mjbl6

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-c366d3-5589b9798-mjbl6

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-c366d3-5589b9798-mjbl6

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-c366d3-668d8688df-dtphc

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-c366d3-5589b9798-mjbl6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-c366d3-668d8688df-dtphc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-worker-w0-c366d3-668d8688df-dtphc

AddedInterface

Add eth0 [10.133.0.38/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-c366d3-668d8688df-dtphc

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

e2e-ait-654e8bde-openshift-default-6dbc8bc8

SuccessfulCreate

Created pod: e2e-ait-654e8bde-openshift-default-6dbc8bc8-bh59t

openshift-ingress

multus

e2e-ait-654e8bde-openshift-default-6dbc8bc8-bh59t

AddedInterface

Add eth0 [10.132.0.41/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ait-654e8bde

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-654e8bde

openshift-ingress

deployment-controller

e2e-ait-654e8bde-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-654e8bde-openshift-default-6dbc8bc8 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ait-654e8bde

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-654e8bde-f5c84745 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-654e8bde-f5c84745

FailedCreate

Error creating: pods "payload-processing-e2e-ait-654e8bde-f5c84745-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-654e8bde: serviceaccount "payload-processing-e2e-ait-654e8bde" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-654e8bde-5c9d48dbf4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-654e8bde-5c9d48dbf4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-654e8bde: serviceaccount "payload-processing-e2e-ait-654e8bde" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-654e8bde-5c9d48dbf4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-654e8bde-5c9d48dbf4-mqjqq

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-654e8bde

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-654e8bde-5c9d48dbf4 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ait-654e8bde-5c9d48dbf4-mqjqq

AddedInterface

Add eth0 [10.133.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-654e8bde-f5c84745-5s7k2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-654e8bde-5c9d48dbf4-mqjqq

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-654e8bde-5c9d48dbf4-mqjqq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-654e8bde-f5c84745

SuccessfulCreate

Created pod: payload-processing-e2e-ait-654e8bde-f5c84745-5s7k2

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-654e8bde-5c9d48dbf4-mqjqq

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ait-654e8bde-f5c84745-5s7k2

AddedInterface

Add eth0 [10.133.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-654e8bde-f5c84745-5s7k2

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-654e8bde-f5c84745-5s7k2

Created

Created container: payload-processing

openshift-ingress

deployment-controller

e2e-inf-b-e7fdd6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-e7fdd6-openshift-default-74bfd88f5b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-b-e7fdd6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-e7fdd6

openshift-ingress

replicaset-controller

e2e-inf-b-e7fdd6-openshift-default-74bfd88f5b

SuccessfulCreate

Created pod: e2e-inf-b-e7fdd6-openshift-default-74bfd88f5b-64698

openshift-ingress

multus

e2e-inf-b-e7fdd6-openshift-default-74bfd88f5b-64698

AddedInterface

Add eth0 [10.132.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-c366d3-openshift-default-6584d9b774-tv5q5

ProbeError

Readiness probe error: Get "http://10.134.0.52:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-c366d3-openshift-default-6584d9b774-tv5q5

Unhealthy

Readiness probe failed: Get "http://10.134.0.52:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-inf-a-667664-openshift-default-8675dc4d6d-g7d2n

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w4-e08402-openshift-default-f6f5dc8f4-czx5r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w4-e08402-openshift-default-f6f5dc8f4-czx5r

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-e08402-openshift-default-f6f5dc8f4-czx5r

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-667664-openshift-default-8675dc4d6d-g7d2n

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-c366d3-openshift-default-6584d9b774-tv5q5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-667664-openshift-default-8675dc4d6d-g7d2n

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-c366d3-openshift-default-6584d9b774-tv5q5

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-c366d3-openshift-default-6584d9b774-tv5q5

Created

Created container: istio-proxy

openshift-ingress

replicaset-controller

e2e-autores-f14475-openshift-default-96796fcc6

SuccessfulCreate

Created pod: e2e-autores-f14475-openshift-default-96796fcc6-bfzx9

openshift-ingress

deployment-controller

e2e-autores-f14475-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-f14475-openshift-default-96796fcc6 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-autores-f14475

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-f14475

openshift-ingress

GatewayAuthBootstrap

e2e-autores-f14475

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-autores-f14475-authn-ssl: envoyfilters.networking.istio.io "e2e-autores-f14475-authn-ssl" already exists

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-e7fdd6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-e7fdd6-6d5f6c59c8 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-e7fdd6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-e7fdd6-56c7655575 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-e7fdd6-56c7655575

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-e7fdd6-56c7655575-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-e7fdd6: serviceaccount "payload-processing-e2e-inf-b-e7fdd6" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-e7fdd6-56c7655575

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-e7fdd6-56c7655575-4ltrp

openshift-ingress

kubelet

e2e-autores-f14475-openshift-default-96796fcc6-bfzx9

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-e7fdd6-6d5f6c59c8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-e7fdd6-6d5f6c59c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-e7fdd6: serviceaccount "payload-processing-e2e-inf-b-e7fdd6" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-e7fdd6-6d5f6c59c8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-e7fdd6-6d5f6c59c8-kwsxf

openshift-ingress

multus

e2e-autores-f14475-openshift-default-96796fcc6-bfzx9

AddedInterface

Add eth0 [10.133.0.41/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-worker-w0-c366d3-openshift-default-6584d9b774-tv5q5

Unhealthy

Startup probe failed: Get "http://10.134.0.52:15021/healthz/ready": dial tcp 10.134.0.52:15021: connect: connection refused

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-e7fdd6-6d5f6c59c8-kwsxf

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-e7fdd6-6d5f6c59c8-kwsxf

Created

Created container: payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-worker-w0-c366d3-openshift-default-6584d9b774-tv5q5

ProbeError

Startup probe error: Get "http://10.134.0.52:15021/healthz/ready": dial tcp 10.134.0.52:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-inf-b-e7fdd6-56c7655575-4ltrp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-e7fdd6-6d5f6c59c8-kwsxf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-e7fdd6-6d5f6c59c8-kwsxf

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-inf-b-e7fdd6-56c7655575-4ltrp

AddedInterface

Add eth0 [10.133.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-e7fdd6-56c7655575-4ltrp

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-e7fdd6-56c7655575-4ltrp

Created

Created container: payload-processing
(x6)

openshift-ingress

kubelet

e2e-worker-w4-e08402-openshift-default-f6f5dc8f4-czx5r

Unhealthy

Startup probe failed: Get "http://10.132.0.37:15021/healthz/ready": dial tcp 10.132.0.37:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-e08402-openshift-default-f6f5dc8f4-czx5r

ProbeError

Startup probe error: Get "http://10.132.0.37:15021/healthz/ready": dial tcp 10.132.0.37:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-a-667664-openshift-default-8675dc4d6d-g7d2n

ProbeError

Startup probe error: Get "http://10.132.0.36:15021/healthz/ready": dial tcp 10.132.0.36:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-a-667664-openshift-default-8675dc4d6d-g7d2n

Unhealthy

Startup probe failed: Get "http://10.132.0.36:15021/healthz/ready": dial tcp 10.132.0.36:15021: connect: connection refused

openshift-ingress

kubelet

e2e-autores-f14475-openshift-default-96796fcc6-bfzx9

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.999s (2.999s including waiting). Image size: 181318953 bytes.
(x2)

openshift-ingress

kubelet

e2e-ait-654e8bde-openshift-default-6dbc8bc8-bh59t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-654e8bde-openshift-default-6dbc8bc8-bh59t

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-654e8bde-openshift-default-6dbc8bc8-bh59t

Created

Created container: istio-proxy
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-f14475-857d5b4f79

FailedCreate

Error creating: pods "payload-processing-e2e-autores-f14475-857d5b4f79-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-f14475: serviceaccount "payload-processing-e2e-autores-f14475" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-f14475-59bb95458

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-f14475-59bb95458-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-f14475: serviceaccount "payload-processing-e2e-autores-f14475" not found

openshift-ingress

deployment-controller

payload-processing-e2e-autores-f14475

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-f14475-857d5b4f79 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-f14475

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-f14475-59bb95458 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-autores-f14475-857d5b4f79-crdsn

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-autores-f14475-59bb95458-z5mxz

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-autores-f14475-857d5b4f79-crdsn

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-f14475-59bb95458-z5mxz

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-f14475-59bb95458

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-f14475-59bb95458-z5mxz

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-f14475-59bb95458-z5mxz

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-f14475-59bb95458-z5mxz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-f14475-857d5b4f79

SuccessfulCreate

Created pod: payload-processing-e2e-autores-f14475-857d5b4f79-crdsn

openshift-ingress

kubelet

payload-processing-e2e-autores-f14475-857d5b4f79-crdsn

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-f14475-857d5b4f79-crdsn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ait-654e8bde-openshift-default-6dbc8bc8-bh59t

Unhealthy

Startup probe failed: Get "http://10.132.0.41:15021/healthz/ready": dial tcp 10.132.0.41:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-654e8bde-5c9d48dbf4-mqjqq

Killing

Stopping container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-ait-654e8bde-openshift-default-6dbc8bc8-bh59t

ProbeError

Startup probe error: Get "http://10.132.0.41:15021/healthz/ready": dial tcp 10.132.0.41:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ait-654e8bde-f5c84745-5s7k2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-654e8bde-openshift-default-6dbc8bc8-bh59t

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-migrate-60e333a9-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-60e333a9-gw

openshift-ingress

deployment-controller

e2e-migrate-60e333a9-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-60e333a9-gw-openshift-default-5496f8f78d from 0 to 1

openshift-ingress

replicaset-controller

e2e-migrate-60e333a9-gw-openshift-default-5496f8f78d

SuccessfulCreate

Created pod: e2e-migrate-60e333a9-gw-openshift-default-5496f8f78d-7dwrm

openshift-ingress

multus

e2e-migrate-60e333a9-gw-openshift-default-5496f8f78d-7dwrm

AddedInterface

Add eth0 [10.132.0.44/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-inf-b-e7fdd6-openshift-default-74bfd88f5b-64698

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-e7fdd6-openshift-default-74bfd88f5b-64698

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-e7fdd6-openshift-default-74bfd88f5b-64698

Created

Created container: istio-proxy

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-60e333a9-79654cfdfd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-60e333a9-79654cfdfd-mfmjv
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-60e333a9-79654cfdfd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-60e333a9-79654cfdfd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-60e333a9: serviceaccount "payload-processing-e2e-migrate-60e333a9" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-60e333a9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-60e333a9-79654cfdfd from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-60e333a9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-60e333a9-575c6488c8 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-60e333a9-575c6488c8

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-60e333a9-575c6488c8-2h2wc
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-60e333a9-575c6488c8

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-60e333a9-575c6488c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-60e333a9: serviceaccount "payload-processing-e2e-migrate-60e333a9" not found

openshift-ingress

kubelet

payload-processing-e2e-migrate-60e333a9-575c6488c8-2h2wc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-migrate-60e333a9-575c6488c8-2h2wc

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-60e333a9-575c6488c8-2h2wc

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-60e333a9-575c6488c8-2h2wc

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-60e333a9-79654cfdfd-mfmjv

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-60e333a9-79654cfdfd-mfmjv

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-60e333a9-79654cfdfd-mfmjv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-migrate-60e333a9-79654cfdfd-mfmjv

AddedInterface

Add eth0 [10.133.0.47/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-inf-b-e7fdd6-openshift-default-74bfd88f5b-64698

ProbeError

Startup probe error: Get "http://10.132.0.42:15021/healthz/ready": dial tcp 10.132.0.42:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-b-e7fdd6-openshift-default-74bfd88f5b-64698

Unhealthy

Startup probe failed: Get "http://10.132.0.42:15021/healthz/ready": dial tcp 10.132.0.42:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-autores-f14475-openshift-default-96796fcc6-bfzx9

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-f14475-openshift-default-96796fcc6-bfzx9

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-autores-f14475-openshift-default-96796fcc6-bfzx9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-autores-f14475-openshift-default-96796fcc6-bfzx9

Unhealthy

Startup probe failed: Get "http://10.133.0.41:15021/healthz/ready": dial tcp 10.133.0.41:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-autores-f14475-openshift-default-96796fcc6-bfzx9

ProbeError

Startup probe error: Get "http://10.133.0.41:15021/healthz/ready": dial tcp 10.133.0.41:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-migrate-60e333a9-gw-openshift-default-5496f8f78d-7dwrm

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-60e333a9-gw-openshift-default-5496f8f78d-7dwrm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-60e333a9-gw-openshift-default-5496f8f78d-7dwrm

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-migrate-60e333a9-gw-openshift-default-5496f8f78d-7dwrm

Unhealthy

Startup probe failed: Get "http://10.132.0.44:15021/healthz/ready": dial tcp 10.132.0.44:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-migrate-60e333a9-gw-openshift-default-5496f8f78d-7dwrm

ProbeError

Startup probe error: Get "http://10.132.0.44:15021/healthz/ready": dial tcp 10.132.0.44:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-60e333a9-79654cfdfd-mfmjv

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-migrate-60e333a9

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-migrate-60e333a9: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-migrate-60e333a9": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-migrate-60e333a9, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 7fda308b-c7e3-4833-947b-5ba5adb2e98d, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-migrate-60e333a9-575c6488c8-2h2wc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-migrate-60e333a9-gw-openshift-default-5496f8f78d-7dwrm

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-ait-8f579f00-openshift-default-5d5dcf9d4b

SuccessfulCreate

Created pod: e2e-ait-8f579f00-openshift-default-5d5dcf9d4b-ndv5l

openshift-ingress

deployment-controller

e2e-ait-8f579f00-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-8f579f00-openshift-default-5d5dcf9d4b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-8f579f00

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-8f579f00

openshift-ingress

multus

e2e-ait-8f579f00-openshift-default-5d5dcf9d4b-ndv5l

AddedInterface

Add eth0 [10.133.0.50/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-8f579f00-68c4db85cc

SuccessfulCreate

Created pod: payload-processing-e2e-ait-8f579f00-68c4db85cc-6z8zf
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-8f579f00-68c4db85cc

FailedCreate

Error creating: pods "payload-processing-e2e-ait-8f579f00-68c4db85cc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-8f579f00: serviceaccount "payload-processing-e2e-ait-8f579f00" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-8f579f00-848cdc564b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-8f579f00-848cdc564b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-8f579f00: serviceaccount "payload-processing-e2e-ait-8f579f00" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-8f579f00

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-8f579f00-848cdc564b from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ait-8f579f00

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-8f579f00-68c4db85cc from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-8f579f00-848cdc564b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-8f579f00-848cdc564b-k8797

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-8f579f00-848cdc564b-k8797

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ait-8f579f00-68c4db85cc-6z8zf

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-8f579f00-68c4db85cc-6z8zf

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-8f579f00-68c4db85cc-6z8zf

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-8f579f00-848cdc564b-k8797

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-8f579f00-848cdc564b-k8797

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-8f579f00-848cdc564b-k8797

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-8f579f00-68c4db85cc-6z8zf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-8f579f00-openshift-default-5d5dcf9d4b-ndv5l

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-8f579f00-openshift-default-5d5dcf9d4b-ndv5l

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-8f579f00-openshift-default-5d5dcf9d4b-ndv5l

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ait-8f579f00-openshift-default-5d5dcf9d4b-ndv5l

Unhealthy

Startup probe failed: Get "http://10.133.0.50:15021/healthz/ready": dial tcp 10.133.0.50:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-8f579f00-openshift-default-5d5dcf9d4b-ndv5l

ProbeError

Startup probe error: Get "http://10.133.0.50:15021/healthz/ready": dial tcp 10.133.0.50:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-8f579f00-848cdc564b-k8797

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-8f579f00-68c4db85cc-6z8zf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-8f579f00-openshift-default-5d5dcf9d4b-ndv5l

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ait-8f579f00-openshift-default-5d5dcf9d4b-ndv5l

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ait-8f579f00-openshift-default-5d5dcf9d4b-ndv5l

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

multus

e2e-derive-2a2a3973-openshift-default-7698ff55bd-8mfjx

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-derive-2a2a3973

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-2a2a3973

openshift-ingress

deployment-controller

e2e-derive-2a2a3973-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-2a2a3973-openshift-default-7698ff55bd from 0 to 1

openshift-ingress

replicaset-controller

e2e-derive-2a2a3973-openshift-default-7698ff55bd

SuccessfulCreate

Created pod: e2e-derive-2a2a3973-openshift-default-7698ff55bd-8mfjx

openshift-ingress

deployment-controller

payload-processing-e2e-derive-2a2a3973

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-2a2a3973-cff7fb645 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-derive-2a2a3973-5985c67478-fjrj9

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-2a2a3973-cff7fb645-wmr6k

Created

Created container: payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-2a2a3973-cff7fb645

FailedCreate

Error creating: pods "payload-processing-e2e-derive-2a2a3973-cff7fb645-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-2a2a3973: serviceaccount "payload-processing-e2e-derive-2a2a3973" not found

openshift-ingress

multus

payload-processing-e2e-derive-2a2a3973-cff7fb645-wmr6k

AddedInterface

Add eth0 [10.133.0.54/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-2a2a3973

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-2a2a3973-5985c67478 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-2a2a3973-5985c67478

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-2a2a3973-5985c67478-fjrj9
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-2a2a3973-5985c67478

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-2a2a3973-5985c67478-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-2a2a3973: serviceaccount "payload-processing-e2e-derive-2a2a3973" not found

openshift-ingress

kubelet

payload-processing-e2e-derive-2a2a3973-cff7fb645-wmr6k

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-2a2a3973-5985c67478-fjrj9

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-2a2a3973-cff7fb645-wmr6k

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-2a2a3973-5985c67478-fjrj9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-2a2a3973-5985c67478-fjrj9

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-2a2a3973-cff7fb645

SuccessfulCreate

Created pod: payload-processing-e2e-derive-2a2a3973-cff7fb645-wmr6k
(x2)

openshift-ingress

kubelet

e2e-derive-2a2a3973-openshift-default-7698ff55bd-8mfjx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-2a2a3973-openshift-default-7698ff55bd-8mfjx

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-2a2a3973-openshift-default-7698ff55bd-8mfjx

Created

Created container: istio-proxy
(x7)

openshift-ingress

kubelet

e2e-derive-2a2a3973-openshift-default-7698ff55bd-8mfjx

Unhealthy

Startup probe failed: Get "http://10.132.0.47:15021/healthz/ready": dial tcp 10.132.0.47:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-derive-2a2a3973-openshift-default-7698ff55bd-8mfjx

ProbeError

Startup probe error: Get "http://10.132.0.47:15021/healthz/ready": dial tcp 10.132.0.47:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-derive-2a2a3973-cff7fb645-wmr6k

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-2a2a3973-5985c67478-fjrj9

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-derive-2a2a3973

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-derive-2a2a3973: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-derive-2a2a3973": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-derive-2a2a3973, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: b43d2d1a-8687-4e33-826f-8a0efbf23dc2, UID in object meta:

openshift-ingress

kubelet

e2e-derive-2a2a3973-openshift-default-7698ff55bd-8mfjx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-derive-2a2a3973-openshift-default-7698ff55bd-8mfjx

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-derive-2a2a3973-openshift-default-7698ff55bd-8mfjx

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-autores-f14475-857d5b4f79-crdsn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-f14475-59bb95458-z5mxz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-c366d3-668d8688df-dtphc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-c366d3-5589b9798-mjbl6

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-worker-w0-c366d3

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-worker-w0-c366d3: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-worker-w0-c366d3": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-worker-w0-c366d3, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: eb558006-bbb2-4f3e-88a9-25cd2a325249, UID in object meta:

openshift-ingress

kubelet

e2e-worker-w0-c366d3-openshift-default-6584d9b774-tv5q5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-autores-f14475-openshift-default-96796fcc6-bfzx9

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-explicit-9529a1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-9529a1-openshift-default-5fb7fd4688 from 0 to 1

openshift-ingress

replicaset-controller

e2e-explicit-9529a1-openshift-default-5fb7fd4688

SuccessfulCreate

Created pod: e2e-explicit-9529a1-openshift-default-5fb7fd4688-px7qr

openshift-ingress

gateway_labeler_controller

e2e-explicit-9529a1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-9529a1

openshift-ingress

multus

e2e-explicit-9529a1-openshift-default-5fb7fd4688-px7qr

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-9529a1-7f565fd978

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-9529a1-7f565fd978-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-9529a1: serviceaccount "payload-processing-e2e-explicit-9529a1" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-9529a1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-9529a1-7f565fd978 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-9529a1-7f565fd978

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-9529a1-7f565fd978-mtdwz

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-9529a1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-9529a1-6f7495cf77 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-9529a1-6f7495cf77

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-9529a1-6f7495cf77-p6vbq
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-9529a1-6f7495cf77

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-9529a1-6f7495cf77-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-9529a1: serviceaccount "payload-processing-e2e-explicit-9529a1" not found

openshift-ingress

multus

payload-processing-e2e-explicit-9529a1-6f7495cf77-p6vbq

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-explicit-9529a1-7f565fd978-mtdwz

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-9529a1-6f7495cf77-p6vbq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-explicit-9529a1-6f7495cf77-p6vbq

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-9529a1-6f7495cf77-p6vbq

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-9529a1-7f565fd978-mtdwz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-9529a1-7f565fd978-mtdwz

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-9529a1-7f565fd978-mtdwz

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

e2e-mt-4ee4bdd9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-4ee4bdd9-openshift-default-7fccc644fb from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-4ee4bdd9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-4ee4bdd9

openshift-ingress

replicaset-controller

e2e-mt-4ee4bdd9-openshift-default-7fccc644fb

SuccessfulCreate

Created pod: e2e-mt-4ee4bdd9-openshift-default-7fccc644fb-7847s

openshift-ingress

multus

e2e-mt-4ee4bdd9-openshift-default-7fccc644fb-7847s

AddedInterface

Add eth0 [10.133.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-4ee4bdd9-5db967f57c-ggtgx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-4ee4bdd9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-4ee4bdd9-69fbb96966 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-4ee4bdd9-5db967f57c

FailedCreate

Error creating: pods "payload-processing-e2e-mt-4ee4bdd9-5db967f57c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-4ee4bdd9: serviceaccount "payload-processing-e2e-mt-4ee4bdd9" not found

openshift-ingress

kubelet

payload-processing-e2e-mt-4ee4bdd9-5db967f57c-ggtgx

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-4ee4bdd9-5db967f57c-ggtgx

Created

Created container: payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-mt-4ee4bdd9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-4ee4bdd9-5db967f57c from 0 to 1

openshift-ingress

multus

payload-processing-e2e-mt-4ee4bdd9-5db967f57c-ggtgx

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-4ee4bdd9-5db967f57c

SuccessfulCreate

Created pod: payload-processing-e2e-mt-4ee4bdd9-5db967f57c-ggtgx

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-4ee4bdd9-69fbb96966

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-4ee4bdd9-69fbb96966-x8jdm
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-4ee4bdd9-69fbb96966

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-4ee4bdd9-69fbb96966-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-4ee4bdd9: serviceaccount "payload-processing-e2e-mt-4ee4bdd9" not found

openshift-ingress

multus

payload-pre-processing-e2e-mt-4ee4bdd9-69fbb96966-x8jdm

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-4ee4bdd9-69fbb96966-x8jdm

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-4ee4bdd9-69fbb96966-x8jdm

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-4ee4bdd9-69fbb96966-x8jdm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-9529a1-openshift-default-5fb7fd4688-px7qr

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-9529a1-openshift-default-5fb7fd4688-px7qr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-9529a1-openshift-default-5fb7fd4688-px7qr

Started

Started container istio-proxy
(x7)

openshift-ingress

kubelet

e2e-explicit-9529a1-openshift-default-5fb7fd4688-px7qr

ProbeError

Startup probe error: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-explicit-9529a1-openshift-default-5fb7fd4688-px7qr

Unhealthy

Startup probe failed: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-mt-4ee4bdd9-openshift-default-7fccc644fb-7847s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-4ee4bdd9-openshift-default-7fccc644fb-7847s

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-4ee4bdd9-openshift-default-7fccc644fb-7847s

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-4ee4bdd9-openshift-default-7fccc644fb-7847s

ProbeError

Startup probe error: Get "http://10.133.0.62:15021/healthz/ready": dial tcp 10.133.0.62:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-4ee4bdd9-openshift-default-7fccc644fb-7847s

Unhealthy

Startup probe failed: Get "http://10.133.0.62:15021/healthz/ready": dial tcp 10.133.0.62:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-4ee4bdd9-69fbb96966-x8jdm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-4ee4bdd9-5db967f57c-ggtgx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-4ee4bdd9-openshift-default-7fccc644fb-7847s

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-4ee4bdd9-openshift-default-7fccc644fb-7847s

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-4ee4bdd9-openshift-default-7fccc644fb-7847s

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-2eeb50

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-2eeb50

openshift-ingress

deployment-controller

e2e-shared-a-w2-2eeb50-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-2eeb50-openshift-default-85f875f444 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w2-2eeb50-openshift-default-85f875f444

SuccessfulCreate

Created pod: e2e-shared-a-w2-2eeb50-openshift-default-85f875f444-mhrvb

openshift-ingress

multus

e2e-shared-a-w2-2eeb50-openshift-default-85f875f444-mhrvb

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-2eeb50-64f96b44bc

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-2eeb50-64f96b44bc-8wgzq

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-2eeb50

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-2eeb50-64f96b44bc from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-2eeb50-68db997bf4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-2eeb50-68db997bf4-s7kpn
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-2eeb50-64f96b44bc

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-2eeb50-64f96b44bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-2eeb50: serviceaccount "payload-processing-e2e-shared-a-w2-2eeb50" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-2eeb50-68db997bf4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-2eeb50-68db997bf4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-2eeb50: serviceaccount "payload-processing-e2e-shared-a-w2-2eeb50" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-2eeb50

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-2eeb50-68db997bf4 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-2eeb50-68db997bf4-s7kpn

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-2eeb50-68db997bf4-s7kpn

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-2eeb50-68db997bf4-s7kpn

AddedInterface

Add eth0 [10.133.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-2eeb50-64f96b44bc-8wgzq

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-2eeb50-64f96b44bc-8wgzq

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-2eeb50-64f96b44bc-8wgzq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-2eeb50-64f96b44bc-8wgzq

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-2eeb50-68db997bf4-s7kpn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-2eeb50-openshift-default-85f875f444-mhrvb

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-2eeb50-openshift-default-85f875f444-mhrvb

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-2eeb50-openshift-default-85f875f444-mhrvb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-2eeb50-openshift-default-85f875f444-mhrvb

ProbeError

Startup probe error: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-2eeb50-openshift-default-85f875f444-mhrvb

Unhealthy

Startup probe failed: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-a8c46f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-a8c46f

openshift-ingress

replicaset-controller

e2e-shared-b-w2-a8c46f-openshift-default-5c9bd8464d

SuccessfulCreate

Created pod: e2e-shared-b-w2-a8c46f-openshift-default-5c9bd8464d-8vl64

openshift-ingress

deployment-controller

e2e-shared-b-w2-a8c46f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-a8c46f-openshift-default-5c9bd8464d from 0 to 1

openshift-ingress

multus

e2e-shared-b-w2-a8c46f-openshift-default-5c9bd8464d-8vl64

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-a8c46f-8585cb8f4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-a8c46f-8585cb8f4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-a8c46f: serviceaccount "payload-processing-e2e-shared-b-w2-a8c46f" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-a8c46f-8585cb8f4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-a8c46f-8585cb8f4-vjtwx
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-a8c46f-746b7b7d67

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-a8c46f-746b7b7d67-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-a8c46f: serviceaccount "payload-processing-e2e-shared-b-w2-a8c46f" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-a8c46f-746b7b7d67

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-a8c46f-746b7b7d67-844g5

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-a8c46f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-a8c46f-746b7b7d67 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-a8c46f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-a8c46f-8585cb8f4 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-a8c46f-8585cb8f4-vjtwx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-a8c46f-8585cb8f4-vjtwx

AddedInterface

Add eth0 [10.133.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-a8c46f-746b7b7d67-844g5

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-a8c46f-746b7b7d67-844g5

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-a8c46f-746b7b7d67-844g5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-a8c46f-8585cb8f4-vjtwx

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-a8c46f-8585cb8f4-vjtwx

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-a8c46f-746b7b7d67-844g5

AddedInterface

Add eth0 [10.133.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w2-a8c46f-openshift-default-5c9bd8464d-8vl64

Unhealthy

Readiness probe failed: Get "http://10.132.0.56:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-b-w2-a8c46f-openshift-default-5c9bd8464d-8vl64

ProbeError

Readiness probe error: Get "http://10.132.0.56:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-a8c46f-openshift-default-5c9bd8464d-8vl64

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-a8c46f-openshift-default-5c9bd8464d-8vl64

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-a8c46f-openshift-default-5c9bd8464d-8vl64

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-explicit-9529a1

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-explicit-9529a1: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-explicit-9529a1": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-explicit-9529a1, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: f721a870-efca-4a85-9366-bc916ed17531, UID in object meta:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-a8c46f-openshift-default-5c9bd8464d-8vl64

Unhealthy

Startup probe failed: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-a8c46f-openshift-default-5c9bd8464d-8vl64

ProbeError

Startup probe error: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-9529a1-7f565fd978-mtdwz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-9529a1-6f7495cf77-p6vbq

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-mt-c7c6a48c-openshift-default-785bf6b7f6

SuccessfulCreate

Created pod: e2e-mt-c7c6a48c-openshift-default-785bf6b7f6-8w7qd

openshift-ingress

deployment-controller

e2e-mt-c7c6a48c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-c7c6a48c-openshift-default-785bf6b7f6 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-c7c6a48c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-c7c6a48c

openshift-ingress

multus

e2e-mt-c7c6a48c-openshift-default-785bf6b7f6-8w7qd

AddedInterface

Add eth0 [10.133.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-explicit-9529a1-openshift-default-5fb7fd4688-px7qr

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-noten-255ce3-openshift-default-dd5459cf8-4mjlh

AddedInterface

Add eth0 [10.133.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-255ce3-openshift-default-dd5459cf8-4mjlh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

gateway_labeler_controller

e2e-noten-255ce3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-255ce3

openshift-ingress

deployment-controller

e2e-noten-255ce3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-255ce3-openshift-default-dd5459cf8 from 0 to 1

openshift-ingress

replicaset-controller

e2e-noten-255ce3-openshift-default-dd5459cf8

SuccessfulCreate

Created pod: e2e-noten-255ce3-openshift-default-dd5459cf8-4mjlh

openshift-ingress

kubelet

e2e-noten-255ce3-openshift-default-dd5459cf8-4mjlh

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-noten-255ce3-openshift-default-dd5459cf8-4mjlh

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-explicit-9529a1-openshift-default-5fb7fd4688-px7qr

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-explicit-9529a1-openshift-default-5fb7fd4688-px7qr

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-c7c6a48c-7f9cf4474b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-c7c6a48c-7f9cf4474b-qrmzh

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-c7c6a48c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-c7c6a48c-7f9cf4474b from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-c7c6a48c-7f9cf4474b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-c7c6a48c-7f9cf4474b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-c7c6a48c: serviceaccount "payload-processing-e2e-mt-c7c6a48c" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-c7c6a48c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-c7c6a48c-787f9896f7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-c7c6a48c-787f9896f7

SuccessfulCreate

Created pod: payload-processing-e2e-mt-c7c6a48c-787f9896f7-sbtt5
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-c7c6a48c-787f9896f7

FailedCreate

Error creating: pods "payload-processing-e2e-mt-c7c6a48c-787f9896f7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-c7c6a48c: serviceaccount "payload-processing-e2e-mt-c7c6a48c" not found

openshift-ingress

kubelet

payload-processing-e2e-mt-c7c6a48c-787f9896f7-sbtt5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-mt-c7c6a48c-7f9cf4474b-qrmzh

AddedInterface

Add eth0 [10.133.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-c7c6a48c-787f9896f7-sbtt5

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-c7c6a48c-787f9896f7-sbtt5

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-mt-c7c6a48c-787f9896f7-sbtt5

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-c7c6a48c-7f9cf4474b-qrmzh

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-c7c6a48c-7f9cf4474b-qrmzh

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-c7c6a48c-7f9cf4474b-qrmzh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-c7c6a48c-openshift-default-785bf6b7f6-8w7qd

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-c7c6a48c-openshift-default-785bf6b7f6-8w7qd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-c7c6a48c-openshift-default-785bf6b7f6-8w7qd

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-c7c6a48c-openshift-default-785bf6b7f6-8w7qd

ProbeError

Startup probe error: Get "http://10.133.0.68:15021/healthz/ready": dial tcp 10.133.0.68:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-c7c6a48c-openshift-default-785bf6b7f6-8w7qd

Unhealthy

Startup probe failed: Get "http://10.133.0.68:15021/healthz/ready": dial tcp 10.133.0.68:15021: connect: connection refused

openshift-ingress

kubelet

e2e-noten-255ce3-openshift-default-dd5459cf8-4mjlh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-noten-255ce3-openshift-default-dd5459cf8-4mjlh

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-noten-255ce3-openshift-default-dd5459cf8-4mjlh

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-inf-a-667664

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-inf-a-667664: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-inf-a-667664": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-inf-a-667664, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 4086dcc2-f108-4fdb-9ac3-4c2524031777, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-inf-a-667664-5bdbdc7d59-lck8r

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-667664-5bd57bd994-52n8z

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-a-667664-openshift-default-8675dc4d6d-g7d2n

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-inf-b-e7fdd6-56c7655575-4ltrp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-e7fdd6-6d5f6c59c8-kwsxf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-b-e7fdd6-openshift-default-74bfd88f5b-64698

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-2ff4a6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-2ff4a6

openshift-ingress

deployment-controller

e2e-shared-a-w3-2ff4a6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-2ff4a6-openshift-default-6cdbbdbf5d from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w3-2ff4a6-openshift-default-6cdbbdbf5d

SuccessfulCreate

Created pod: e2e-shared-a-w3-2ff4a6-openshift-default-6cdbbdbf5d-glrj5

openshift-ingress

multus

e2e-shared-a-w3-2ff4a6-openshift-default-6cdbbdbf5d-glrj5

AddedInterface

Add eth0 [10.133.0.76/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-2ff4a6-78bb8d9894

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-2ff4a6-78bb8d9894-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-2ff4a6: serviceaccount "payload-processing-e2e-shared-a-w3-2ff4a6" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-2ff4a6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-2ff4a6-78bb8d9894 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-2ff4a6-7859858b49

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-2ff4a6-7859858b49-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-2ff4a6: serviceaccount "payload-processing-e2e-shared-a-w3-2ff4a6" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-2ff4a6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-2ff4a6-7859858b49 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-2ff4a6-7859858b49-5nqtd

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-2ff4a6-7859858b49

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-2ff4a6-7859858b49-5nqtd

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-2ff4a6-7859858b49-5nqtd

AddedInterface

Add eth0 [10.132.0.61/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-2ff4a6-78bb8d9894-28fgr

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-2ff4a6-78bb8d9894-28fgr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-2ff4a6-78bb8d9894-28fgr

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-2ff4a6-78bb8d9894-28fgr

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-2ff4a6-7859858b49-5nqtd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-2ff4a6-78bb8d9894

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-2ff4a6-78bb8d9894-28fgr

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-2ff4a6-7859858b49-5nqtd

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-c7c6a48c-787f9896f7-sbtt5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-c7c6a48c-7f9cf4474b-qrmzh

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-2ff4a6-openshift-default-6cdbbdbf5d-glrj5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-2ff4a6-openshift-default-6cdbbdbf5d-glrj5

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-2ff4a6-openshift-default-6cdbbdbf5d-glrj5

Started

Started container istio-proxy

openshift-ingress

multus

e2e-shared-b-w3-27be50-openshift-default-6d48cf8d84-sklh4

AddedInterface

Add eth0 [10.133.0.79/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-b-w3-27be50-openshift-default-6d48cf8d84

SuccessfulCreate

Created pod: e2e-shared-b-w3-27be50-openshift-default-6d48cf8d84-sklh4

openshift-ingress

deployment-controller

e2e-shared-b-w3-27be50-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-27be50-openshift-default-6d48cf8d84 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-27be50

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-27be50
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-2ff4a6-openshift-default-6cdbbdbf5d-glrj5

Unhealthy

Startup probe failed: Get "http://10.133.0.76:15021/healthz/ready": dial tcp 10.133.0.76:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-2ff4a6-openshift-default-6cdbbdbf5d-glrj5

ProbeError

Startup probe error: Get "http://10.133.0.76:15021/healthz/ready": dial tcp 10.133.0.76:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-27be50

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-27be50-599698f7b6 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-27be50-599698f7b6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-27be50-599698f7b6-87fpn

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-27be50-599698f7b6-87fpn

AddedInterface

Add eth0 [10.132.0.62/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-27be50-6565465c95

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-27be50-6565465c95-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-27be50: serviceaccount "payload-processing-e2e-shared-b-w3-27be50" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-27be50-6565465c95

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-27be50-6565465c95-lmdjl

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-27be50

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-27be50-6565465c95 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-27be50-599698f7b6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-27be50-599698f7b6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-27be50: serviceaccount "payload-processing-e2e-shared-b-w3-27be50" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-27be50-599698f7b6-87fpn

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-27be50-6565465c95-lmdjl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-27be50-6565465c95-lmdjl

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-27be50-6565465c95-lmdjl

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-27be50-6565465c95-lmdjl

AddedInterface

Add eth0 [10.132.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-27be50-599698f7b6-87fpn

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-27be50-599698f7b6-87fpn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-27be50-openshift-default-6d48cf8d84-sklh4

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-27be50-openshift-default-6d48cf8d84-sklh4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-27be50-openshift-default-6d48cf8d84-sklh4

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-27be50-openshift-default-6d48cf8d84-sklh4

Unhealthy

Startup probe failed: Get "http://10.133.0.79:15021/healthz/ready": dial tcp 10.133.0.79:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-27be50-openshift-default-6d48cf8d84-sklh4

ProbeError

Startup probe error: Get "http://10.133.0.79:15021/healthz/ready": dial tcp 10.133.0.79:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-mt-c7c6a48c-openshift-default-785bf6b7f6-8w7qd

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-api-a-6cb472-openshift-default-56b886b47b

SuccessfulCreate

Created pod: e2e-api-a-6cb472-openshift-default-56b886b47b-c78dr

openshift-ingress

gateway_labeler_controller

e2e-api-a-6cb472

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-6cb472

openshift-ingress

deployment-controller

e2e-api-a-6cb472-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-6cb472-openshift-default-56b886b47b from 0 to 1

openshift-ingress

multus

e2e-api-a-6cb472-openshift-default-56b886b47b-c78dr

AddedInterface

Add eth0 [10.133.0.81/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-6cb472-7b66768854-pk99s

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-6cb472-7b66768854

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-6cb472-7b66768854-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-6cb472: serviceaccount "payload-processing-e2e-api-a-6cb472" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-6cb472

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-6cb472-74ccccb955 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-api-a-6cb472-7b66768854-pk99s

AddedInterface

Add eth0 [10.132.0.65/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-6cb472-74ccccb955

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-6cb472-74ccccb955-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-6cb472: serviceaccount "payload-processing-e2e-api-a-6cb472" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-6cb472-7b66768854

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-6cb472-7b66768854-pk99s

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-6cb472-74ccccb955

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-6cb472-74ccccb955-7jkt4

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-6cb472

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-6cb472-7b66768854 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-6cb472-7b66768854-pk99s

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-api-a-6cb472-74ccccb955-7jkt4

AddedInterface

Add eth0 [10.133.0.82/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-6cb472-74ccccb955-7jkt4

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-6cb472-74ccccb955-7jkt4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-a-6cb472-74ccccb955-7jkt4

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-6cb472-7b66768854-pk99s

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-e08402-67784fb846-dhznh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-e08402-7964d8d469-6tppq

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

e2e-api-b-09203c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-09203c-openshift-default-6d94744596 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-09203c-openshift-default-6d94744596

SuccessfulCreate

Created pod: e2e-api-b-09203c-openshift-default-6d94744596-vzrnv

openshift-ingress

gateway_labeler_controller

e2e-api-b-09203c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-09203c

openshift-ingress

multus

e2e-api-b-09203c-openshift-default-6d94744596-vzrnv

AddedInterface

Add eth0 [10.133.0.83/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-e08402-openshift-default-f6f5dc8f4-czx5r

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-09203c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-09203c-54db9f8bc9 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-api-a-6cb472-openshift-default-56b886b47b-c78dr

Created

Created container: istio-proxy

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-09203c-c76dd9494

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-09203c-c76dd9494-b95q7
(x2)

openshift-ingress

kubelet

e2e-api-a-6cb472-openshift-default-56b886b47b-c78dr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-09203c-54db9f8bc9

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-09203c-54db9f8bc9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-09203c: serviceaccount "payload-processing-e2e-api-b-09203c" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-09203c-54db9f8bc9

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-09203c-54db9f8bc9-gww9w

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-09203c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-09203c-c76dd9494 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-api-b-09203c-c76dd9494-b95q7

AddedInterface

Add eth0 [10.132.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-09203c-c76dd9494-b95q7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-09203c-c76dd9494-b95q7

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-09203c-c76dd9494-b95q7

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-api-a-6cb472-openshift-default-56b886b47b-c78dr

Started

Started container istio-proxy
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-09203c-c76dd9494

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-09203c-c76dd9494-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-09203c: serviceaccount "payload-processing-e2e-api-b-09203c" not found

openshift-ingress

kubelet

payload-processing-e2e-api-b-09203c-54db9f8bc9-gww9w

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-09203c-54db9f8bc9-gww9w

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-09203c-54db9f8bc9-gww9w

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-api-b-09203c-54db9f8bc9-gww9w

AddedInterface

Add eth0 [10.132.0.67/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-api-a-6cb472-openshift-default-56b886b47b-c78dr

ProbeError

Startup probe error: Get "http://10.133.0.81:15021/healthz/ready": dial tcp 10.133.0.81:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-a-6cb472-openshift-default-56b886b47b-c78dr

Unhealthy

Startup probe failed: Get "http://10.133.0.81:15021/healthz/ready": dial tcp 10.133.0.81:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-api-b-09203c-openshift-default-6d94744596-vzrnv

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-09203c-openshift-default-6d94744596-vzrnv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-api-b-09203c-openshift-default-6d94744596-vzrnv

Unhealthy

Readiness probe failed: Get "http://10.133.0.83:15021/healthz/ready": dial tcp 10.133.0.83:15021: connect: connection refused

openshift-ingress

kubelet

e2e-api-b-09203c-openshift-default-6d94744596-vzrnv

ProbeError

Readiness probe error: Get "http://10.133.0.83:15021/healthz/ready": dial tcp 10.133.0.83:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-api-b-09203c-openshift-default-6d94744596-vzrnv

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-api-b-09203c-openshift-default-6d94744596-vzrnv

Unhealthy

Startup probe failed: Get "http://10.133.0.83:15021/healthz/ready": dial tcp 10.133.0.83:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-b-09203c-openshift-default-6d94744596-vzrnv

ProbeError

Startup probe error: Get "http://10.133.0.83:15021/healthz/ready": dial tcp 10.133.0.83:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-6cb472-7b66768854-pk99s

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-6cb472-74ccccb955-7jkt4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-a-6cb472-openshift-default-56b886b47b-c78dr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-6cb472-openshift-default-56b886b47b-c78dr

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-a-6cb472-openshift-default-56b886b47b-c78dr

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-09203c-c76dd9494-b95q7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-09203c-54db9f8bc9-gww9w

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-b-09203c-openshift-default-6d94744596-vzrnv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-09203c-openshift-default-6d94744596-vzrnv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-b-09203c-openshift-default-6d94744596-vzrnv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-2eeb50-68db997bf4-s7kpn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-2eeb50-64f96b44bc-8wgzq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w2-2eeb50-openshift-default-85f875f444-mhrvb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-2eeb50-openshift-default-85f875f444-mhrvb

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w2-2eeb50-openshift-default-85f875f444-mhrvb

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-b-w2-a8c46f

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-b-w2-a8c46f: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-b-w2-a8c46f": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-b-w2-a8c46f, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: b3b76d78-ca36-4d9f-8175-6d35fc885dd9, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-a8c46f-746b7b7d67-844g5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-a8c46f-8585cb8f4-vjtwx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w2-a8c46f-openshift-default-5c9bd8464d-8vl64

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-ipp-a-524a38-openshift-default-d897559fb

SuccessfulCreate

Created pod: e2e-ipp-a-524a38-openshift-default-d897559fb-97xvm

openshift-ingress

multus

e2e-ipp-a-524a38-openshift-default-d897559fb-97xvm

AddedInterface

Add eth0 [10.132.0.71/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-524a38

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-524a38

openshift-ingress

deployment-controller

e2e-ipp-a-524a38-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-524a38-openshift-default-d897559fb from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-524a38-64f67b69c5

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-524a38-64f67b69c5-4bpc4
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-524a38-86b8879754

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-524a38-86b8879754-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-524a38: serviceaccount "payload-processing-e2e-ipp-a-524a38" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-524a38-64f67b69c5

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-524a38-64f67b69c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-524a38: serviceaccount "payload-processing-e2e-ipp-a-524a38" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-524a38-86b8879754

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-524a38-86b8879754-kkckd

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-524a38

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-524a38-86b8879754 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-524a38

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-524a38-64f67b69c5 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-524a38-86b8879754-kkckd

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-524a38-64f67b69c5-4bpc4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-524a38-86b8879754-kkckd

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-a-524a38-64f67b69c5-4bpc4

AddedInterface

Add eth0 [10.133.0.95/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-524a38-86b8879754-kkckd

AddedInterface

Add eth0 [10.132.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-524a38-86b8879754-kkckd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-524a38-64f67b69c5-4bpc4

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-524a38-64f67b69c5-4bpc4

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-524a38-openshift-default-d897559fb-97xvm

ProbeError

Readiness probe error: Get "http://10.132.0.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-a-524a38-openshift-default-d897559fb-97xvm

Unhealthy

Readiness probe failed: Get "http://10.132.0.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ipp-a-524a38-openshift-default-d897559fb-97xvm

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-524a38-openshift-default-d897559fb-97xvm

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-524a38-openshift-default-d897559fb-97xvm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-a-524a38-openshift-default-d897559fb-97xvm

ProbeError

Startup probe error: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-524a38-openshift-default-d897559fb-97xvm

Unhealthy

Startup probe failed: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused

openshift-ingress

multus

e2e-ipp-b-7bbea9-openshift-default-56cd4b86d4-l28j5

AddedInterface

Add eth0 [10.133.0.96/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-b-7bbea9-openshift-default-56cd4b86d4

SuccessfulCreate

Created pod: e2e-ipp-b-7bbea9-openshift-default-56cd4b86d4-l28j5

openshift-ingress

deployment-controller

e2e-ipp-b-7bbea9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-7bbea9-openshift-default-56cd4b86d4 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-7bbea9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-7bbea9
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-7bbea9-6c44bcf854

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-7bbea9-6c44bcf854-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-7bbea9: serviceaccount "payload-processing-e2e-ipp-b-7bbea9" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-7bbea9-6c44bcf854

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-7bbea9-6c44bcf854-8mbns

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-7bbea9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-7bbea9-95557b9f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-7bbea9-95557b9f

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-7bbea9-95557b9f-hkvwf
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-7bbea9-95557b9f

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-7bbea9-95557b9f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-7bbea9: serviceaccount "payload-processing-e2e-ipp-b-7bbea9" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-7bbea9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-7bbea9-6c44bcf854 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-7bbea9-6c44bcf854-8mbns

AddedInterface

Add eth0 [10.133.0.97/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-7bbea9-95557b9f-hkvwf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-7bbea9-6c44bcf854-8mbns

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-7bbea9-6c44bcf854-8mbns

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-7bbea9-6c44bcf854-8mbns

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-7bbea9-95557b9f-hkvwf

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-ipp-b-7bbea9-95557b9f-hkvwf

AddedInterface

Add eth0 [10.132.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-7bbea9-95557b9f-hkvwf

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-7bbea9-openshift-default-56cd4b86d4-l28j5

Unhealthy

Readiness probe failed: Get "http://10.133.0.96:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-b-7bbea9-openshift-default-56cd4b86d4-l28j5

ProbeError

Readiness probe error: Get "http://10.133.0.96:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ipp-b-7bbea9-openshift-default-56cd4b86d4-l28j5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-7bbea9-openshift-default-56cd4b86d4-l28j5

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-7bbea9-openshift-default-56cd4b86d4-l28j5

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-b-7bbea9-openshift-default-56cd4b86d4-l28j5

Unhealthy

Startup probe failed: Get "http://10.133.0.96:15021/healthz/ready": dial tcp 10.133.0.96:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-7bbea9-openshift-default-56cd4b86d4-l28j5

ProbeError

Startup probe error: Get "http://10.133.0.96:15021/healthz/ready": dial tcp 10.133.0.96:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-2339fb-openshift-default-7cb66954b6

SuccessfulCreate

Created pod: e2e-ipp-cleanup-2339fb-openshift-default-7cb66954b6-8szld

openshift-ingress

deployment-controller

e2e-ipp-cleanup-2339fb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-2339fb-openshift-default-7cb66954b6 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-2339fb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-2339fb

openshift-ingress

multus

e2e-ipp-cleanup-2339fb-openshift-default-7cb66954b6-8szld

AddedInterface

Add eth0 [10.132.0.74/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-2339fb-9967895f7

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-2339fb-9967895f7-db2s9

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-2339fb-9f8c9fb5d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-2339fb-9f8c9fb5d-lwgwm
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-2339fb-9f8c9fb5d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-2339fb-9f8c9fb5d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-2339fb: serviceaccount "payload-processing-e2e-ipp-cleanup-2339fb" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-2339fb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-2339fb-9967895f7 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-2339fb-9967895f7

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-2339fb-9967895f7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-2339fb: serviceaccount "payload-processing-e2e-ipp-cleanup-2339fb" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-2339fb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-2339fb-9f8c9fb5d from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-2339fb-9f8c9fb5d-lwgwm

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-2339fb-9967895f7-db2s9

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-2339fb-9f8c9fb5d-lwgwm

AddedInterface

Add eth0 [10.133.0.99/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-2339fb-9f8c9fb5d-lwgwm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-2339fb-9f8c9fb5d-lwgwm

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-2339fb-9967895f7-db2s9

AddedInterface

Add eth0 [10.133.0.100/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-2339fb-9967895f7-db2s9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-2339fb-9967895f7-db2s9

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-2339fb-openshift-default-7cb66954b6-8szld

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-2339fb-openshift-default-7cb66954b6-8szld

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-2339fb-openshift-default-7cb66954b6-8szld

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-ipp-cleanup-2339fb-openshift-default-7cb66954b6-8szld

ProbeError

Startup probe error: Get "http://10.132.0.74:15021/healthz/ready": dial tcp 10.132.0.74:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-cleanup-2339fb-openshift-default-7cb66954b6-8szld

Unhealthy

Startup probe failed: Get "http://10.132.0.74:15021/healthz/ready": dial tcp 10.132.0.74:15021: connect: connection refused

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-cleanup-2339fb

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-2339fb: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-cleanup-2339fb": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-2339fb, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 3f8f01ee-60c7-4cab-a9ad-6d4a8d9884aa, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-2339fb-9f8c9fb5d-lwgwm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-2339fb-9967895f7-db2s9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-2339fb-openshift-default-7cb66954b6-8szld

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-524a38-86b8879754-kkckd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-524a38-64f67b69c5-4bpc4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-524a38-openshift-default-d897559fb-97xvm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-7bbea9-6c44bcf854-8mbns

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-7bbea9-95557b9f-hkvwf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-7bbea9-95557b9f-hkvwf

Unhealthy

Readiness probe failed: dial tcp 10.132.0.73:9004: i/o timeout

openshift-ingress

kubelet

e2e-ipp-b-7bbea9-openshift-default-56cd4b86d4-l28j5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-2ff4a6-78bb8d9894-28fgr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-2ff4a6-7859858b49-5nqtd

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-a-w3-2ff4a6

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-a-w3-2ff4a6: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-a-w3-2ff4a6": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-a-w3-2ff4a6, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: ca0ddb03-a546-41e6-b795-7eb93057b0f9, UID in object meta:

openshift-ingress

kubelet

e2e-shared-a-w3-2ff4a6-openshift-default-6cdbbdbf5d-glrj5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-27be50-6565465c95-lmdjl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-27be50-599698f7b6-87fpn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w3-27be50-openshift-default-6d48cf8d84-sklh4

Killing

Stopping container istio-proxy