Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-pre-processing-e2e-inf-a-4268e3-699f8ff594-hg468

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-4268e3-699f8ff594-hg468 to ip-10-0-143-165.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-269ba8-698c4bbcbf-76g29

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-269ba8-698c4bbcbf-76g29 to ip-10-0-143-165.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-75sk4

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-75sk4 to ip-10-0-143-165.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-vv6td

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-vv6td to ip-10-0-143-165.ec2.internal

openshift-ingress

e2e-worker-w4-2dc95c-openshift-default-7f7c49787b-kbn8x

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-2dc95c-openshift-default-7f7c49787b-kbn8x to ip-10-0-135-55.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-52b0af-76789c7db6-ljwcq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-52b0af-76789c7db6-ljwcq to ip-10-0-141-153.ec2.internal

openshift-ingress

e2e-worker-w0-52b0af-openshift-default-6745cc867b-njnxs

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-52b0af-openshift-default-6745cc867b-njnxs to ip-10-0-135-55.ec2.internal

openshift-ingress

kube-auth-proxy-75dc676c8d-f6b82

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-75dc676c8d-f6b82 to ip-10-0-141-153.ec2.internal

openshift-ingress

e2e-ait-ab1ade68-openshift-default-bb68fd844-klxqj

Scheduled

Successfully assigned openshift-ingress/e2e-ait-ab1ade68-openshift-default-bb68fd844-klxqj to ip-10-0-135-55.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-4268e3-54594494d5-qdfn4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-4268e3-54594494d5-qdfn4 to ip-10-0-143-165.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-327a3a-758897fc94-6ndmj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-327a3a-758897fc94-6ndmj to ip-10-0-143-165.ec2.internal

openshift-ingress

e2e-shared-b-w3-327a3a-openshift-default-5b79db7d64-ghqgq

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-327a3a-openshift-default-5b79db7d64-ghqgq to ip-10-0-135-55.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-bff65f-6b9bf45474-xdg4j

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-bff65f-6b9bf45474-xdg4j to ip-10-0-143-165.ec2.internal

openshift-ingress

kube-auth-proxy-75dc676c8d-z2798

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-75dc676c8d-z2798 to ip-10-0-143-165.ec2.internal

openshift-ingress

e2e-shared-b-w2-bff65f-openshift-default-cfdb9fc5d-hg4k7

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-bff65f-openshift-default-cfdb9fc5d-hg4k7 to ip-10-0-135-55.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-32d680-5bf5cf8c97-g6pvf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-32d680-5bf5cf8c97-g6pvf to ip-10-0-143-165.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-750358-7595cf8555-2nnnh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-750358-7595cf8555-2nnnh to ip-10-0-143-165.ec2.internal

openshift-ingress

e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr to ip-10-0-141-153.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-891cc8-d9bc7765f-kk59m

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-891cc8-d9bc7765f-kk59m to ip-10-0-143-165.ec2.internal

openshift-ingress

e2e-shared-a-w2-6b6653-openshift-default-7b589686c8-4s5v6

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-6b6653-openshift-default-7b589686c8-4s5v6 to ip-10-0-135-55.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-fq525

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fq525 to ip-10-0-135-55.ec2.internal

openshift-ingress

e2e-ait-d310aa61-openshift-default-6d6988b798-76tnx

Scheduled

Successfully assigned openshift-ingress/e2e-ait-d310aa61-openshift-default-6d6988b798-76tnx to ip-10-0-135-55.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-5969a028-59c4cf6f6b-9x5kj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-5969a028-59c4cf6f6b-9x5kj to ip-10-0-143-165.ec2.internal

openshift-ingress

e2e-noten-9459f0-openshift-default-5b98456494-xxl9s

Scheduled

Successfully assigned openshift-ingress/e2e-noten-9459f0-openshift-default-5b98456494-xxl9s to ip-10-0-141-153.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-qt6q4

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qt6q4 to ip-10-0-135-55.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-5zjwh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-5zjwh to ip-10-0-143-165.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-2fae12-dcbcf697d-c2qt5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-2fae12-dcbcf697d-c2qt5 to ip-10-0-143-165.ec2.internal

openshift-ingress

payload-processing-e2e-mt-31e12f72-869b47bb4f-zfntz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-31e12f72-869b47bb4f-zfntz to ip-10-0-141-153.ec2.internal

openshift-ingress

e2e-mt-6d422395-openshift-default-77fb9d86cb-gkxxq

Scheduled

Successfully assigned openshift-ingress/e2e-mt-6d422395-openshift-default-77fb9d86cb-gkxxq to ip-10-0-135-55.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-6b6653-79965c98fd-t84xk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-6b6653-79965c98fd-t84xk to ip-10-0-143-165.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-ab1ade68-59fcf454c8-pq2k4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-ab1ade68-59fcf454c8-pq2k4 to ip-10-0-141-153.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-d310aa61-7c59b557c4-pqncp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-d310aa61-7c59b557c4-pqncp to ip-10-0-141-153.ec2.internal

openshift-ingress

e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn to ip-10-0-141-153.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-935ef2-67fc767bcd-qlg4n

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-935ef2-67fc767bcd-qlg4n to ip-10-0-143-165.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-2cceea-7bd575c75c-289zn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-2cceea-7bd575c75c-289zn to ip-10-0-143-165.ec2.internal

openshift-ingress

e2e-mt-31e12f72-openshift-default-f9b7cbb8-vr8t7

Scheduled

Successfully assigned openshift-ingress/e2e-mt-31e12f72-openshift-default-f9b7cbb8-vr8t7 to ip-10-0-135-55.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-b34361-56d4b5f69d-8p4nk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-b34361-56d4b5f69d-8p4nk to ip-10-0-143-165.ec2.internal

openshift-ingress

payload-processing-e2e-derive-9abacf77-5fc5d74c4f-fl4tm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-9abacf77-5fc5d74c4f-fl4tm to ip-10-0-141-153.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-8b1a16-d5b9458f4-nd6km

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-8b1a16-d5b9458f4-nd6km to ip-10-0-143-165.ec2.internal

openshift-ingress

e2e-migrate-5969a028-gw-openshift-default-68d6f98664-fvdnt

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-5969a028-gw-openshift-default-68d6f98664-fvdnt to ip-10-0-135-55.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-6b6653-84c6c4c6d5-5nxp4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-6b6653-84c6c4c6d5-5nxp4 to ip-10-0-141-153.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-9abacf77-b8cf54698-q2676

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-9abacf77-b8cf54698-q2676 to ip-10-0-143-165.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-2cceea-7bd48d77bb-z6qvl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-2cceea-7bd48d77bb-z6qvl to ip-10-0-141-153.ec2.internal

openshift-ingress

payload-processing-e2e-mt-6d422395-5777b9b9b5-qsn2r

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-6d422395-5777b9b9b5-qsn2r to ip-10-0-141-153.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-2dc95c-5f974f57d6-tf8fc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-2dc95c-5f974f57d6-tf8fc to ip-10-0-143-165.ec2.internal

openshift-ingress

e2e-api-b-b34361-openshift-default-6b77778cd4-cwrl8

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-b34361-openshift-default-6b77778cd4-cwrl8 to ip-10-0-135-55.ec2.internal

openshift-ingress

e2e-ipp-cleanup-891cc8-openshift-default-79f494c796-xzbrk

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-891cc8-openshift-default-79f494c796-xzbrk to ip-10-0-135-55.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-2fae12-6645c8484f-bzd8m

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-2fae12-6645c8484f-bzd8m to ip-10-0-143-165.ec2.internal

openshift-ingress

router-default-7669dcd8d-whgmr

Scheduled

Successfully assigned openshift-ingress/router-default-7669dcd8d-whgmr to ip-10-0-143-165.ec2.internal

openshift-ingress

router-default-7669dcd8d-whgmr

FailedScheduling

0/3 nodes are available: 3 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/3 nodes are available: 3 Preemption is not helpful for scheduling.

openshift-ingress

payload-processing-e2e-shared-b-w2-bff65f-7dd7d745b5-r9pvk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-bff65f-7dd7d745b5-r9pvk to ip-10-0-143-165.ec2.internal

openshift-ingress

e2e-ipp-b-750358-openshift-default-b85cb6cfb-lrsvd

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-750358-openshift-default-b85cb6cfb-lrsvd to ip-10-0-135-55.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-32d680-85b754fb74-s4vf7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-32d680-85b754fb74-s4vf7 to ip-10-0-143-165.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-327a3a-798b88466c-7tq4d

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-327a3a-798b88466c-7tq4d to ip-10-0-143-165.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-52b0af-6b764dfd47-hhjtc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-52b0af-6b764dfd47-hhjtc to ip-10-0-143-165.ec2.internal

openshift-ingress

e2e-ipp-a-269ba8-openshift-default-c855998c4-dpr78

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-269ba8-openshift-default-c855998c4-dpr78 to ip-10-0-135-55.ec2.internal

openshift-ingress

e2e-inf-b-32d680-openshift-default-79c98d5dd6-zdv42

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-32d680-openshift-default-79c98d5dd6-zdv42 to ip-10-0-135-55.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w4-2dc95c-7f8985dd8c-s8psz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-2dc95c-7f8985dd8c-s8psz to ip-10-0-143-165.ec2.internal

openshift-ingress

e2e-autores-8b1a16-openshift-default-787d566cdd-x4wrb

Scheduled

Successfully assigned openshift-ingress/e2e-autores-8b1a16-openshift-default-787d566cdd-x4wrb to ip-10-0-135-55.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-269ba8-67dfcc44c8-x2b6m

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-269ba8-67dfcc44c8-x2b6m to ip-10-0-143-165.ec2.internal

openshift-ingress

payload-processing-e2e-autores-8b1a16-b95999f9-b9rdg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-8b1a16-b95999f9-b9rdg to ip-10-0-143-165.ec2.internal

openshift-ingress

e2e-inf-a-4268e3-openshift-default-5c6b854cf4-9gx4d

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-4268e3-openshift-default-5c6b854cf4-9gx4d to ip-10-0-135-55.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-d5s4b

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-d5s4b to ip-10-0-141-153.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-b34361-777d7b6b67-twlmw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-b34361-777d7b6b67-twlmw to ip-10-0-141-153.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-935ef2-55f98b5cb7-j7h24

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-935ef2-55f98b5cb7-j7h24 to ip-10-0-143-165.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-750358-698f985cf4-lbgmn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-750358-698f985cf4-lbgmn to ip-10-0-141-153.ec2.internal

openshift-ingress

payload-processing-e2e-ait-d310aa61-65898c45df-jfvzl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-d310aa61-65898c45df-jfvzl to ip-10-0-141-153.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-891cc8-b5c5867db-bnlk2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-891cc8-b5c5867db-bnlk2 to ip-10-0-141-153.ec2.internal

openshift-ingress

e2e-explicit-2cceea-openshift-default-5df55b44fb-s8vgq

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-2cceea-openshift-default-5df55b44fb-s8vgq to ip-10-0-135-55.ec2.internal

openshift-ingress

e2e-derive-9abacf77-openshift-default-f9549dcd4-4mchm

Scheduled

Successfully assigned openshift-ingress/e2e-derive-9abacf77-openshift-default-f9549dcd4-4mchm to ip-10-0-135-55.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-6d422395-7bddff4f6b-sjwl4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-6d422395-7bddff4f6b-sjwl4 to ip-10-0-143-165.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-31e12f72-5d7bd7bfdb-dvbcp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-31e12f72-5d7bd7bfdb-dvbcp to ip-10-0-143-165.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-5969a028-59b9875946-4qpbq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-5969a028-59b9875946-4qpbq to ip-10-0-141-153.ec2.internal

openshift-ingress

payload-processing-e2e-ait-ab1ade68-5cf97ccd79-zj2dq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-ab1ade68-5cf97ccd79-zj2dq to ip-10-0-143-165.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-7669dcd8d from 0 to 1
(x10)

openshift-ingress

replicaset-controller

router-default-7669dcd8d

FailedCreate

Error creating: pods "router-default-7669dcd8d-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x16)

openshift-ingress

replicaset-controller

router-default-7669dcd8d

FailedCreate

Error creating: pods "router-default-7669dcd8d-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-7669dcd8d

SuccessfulCreate

Created pod: router-default-7669dcd8d-whgmr
(x6)

openshift-ingress

kubelet

router-default-7669dcd8d-whgmr

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x6)

openshift-ingress

kubelet

router-default-7669dcd8d-whgmr

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found

openshift-ingress

multus

router-default-7669dcd8d-whgmr

AddedInterface

Add eth0 [10.132.0.6/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-7669dcd8d-whgmr

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:48526e08a2a06d05806dbcf3ddb069e5182371667d9e9f7d2cf09f60cd247d20" already present on machine

openshift-ingress

kubelet

router-default-7669dcd8d-whgmr

Created

Created container: router

openshift-ingress

kubelet

router-default-7669dcd8d-whgmr

Started

Started container router

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-75dc676c8d from 0 to 2

openshift-ingress

replicaset-controller

kube-auth-proxy-75dc676c8d

SuccessfulCreate

Created pod: kube-auth-proxy-75dc676c8d-f6b82
(x4)

openshift-ingress

replicaset-controller

kube-auth-proxy-75dc676c8d

FailedCreate

Error creating: pods "kube-auth-proxy-75dc676c8d-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

kubelet

kube-auth-proxy-75dc676c8d-z2798

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-75dc676c8d

SuccessfulCreate

Created pod: kube-auth-proxy-75dc676c8d-z2798

openshift-ingress

kubelet

kube-auth-proxy-75dc676c8d-z2798

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-75dc676c8d-f6b82

AddedInterface

Add eth0 [10.133.0.30/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-75dc676c8d-f6b82

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-75dc676c8d-z2798

AddedInterface

Add eth0 [10.132.0.23/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-75sk4

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-75sk4

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-75sk4

AddedInterface

Add eth0 [10.132.0.24/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-75dc676c8d-f6b82

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.597s (2.597s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-75dc676c8d-f6b82

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-75dc676c8d-f6b82

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-75dc676c8d-z2798

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-75dc676c8d-z2798

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-75dc676c8d-z2798

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.567s (2.567s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-75sk4

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-75sk4

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.309s (3.309s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-75sk4

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-75sk4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-75sk4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-qt6q4

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-qt6q4

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-qt6q4

AddedInterface

Add eth0 [10.134.0.24/23] from ovn-kubernetes

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-qt6q4

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-qt6q4

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-qt6q4

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.61s (2.61s including waiting). Image size: 181318953 bytes.

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-vv6td

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-vv6td

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" already present on machine

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-vv6td

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-vv6td

Created

Created container: discovery

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-vv6td

AddedInterface

Add eth0 [10.132.0.25/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-75sk4

Killing

Stopping container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-75sk4

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-fq525

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-fq525

AddedInterface

Add eth0 [10.134.0.32/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-5zjwh

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-d5s4b

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-d5s4b

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-5zjwh

AddedInterface

Add eth0 [10.132.0.32/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-5zjwh

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-5b54b7fbb7-d5s4b

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-d5s4b

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-d5s4b

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-d5s4b

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.832s (1.832s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-5zjwh

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.283s (2.283s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-5zjwh

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-5zjwh

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-fq525

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-fq525

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-fq525

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-fq525

Unhealthy

Startup probe failed: Get "http://10.134.0.32:15021/healthz/ready": dial tcp 10.134.0.32:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-fq525

ProbeError

Startup probe error: Get "http://10.134.0.32:15021/healthz/ready": dial tcp 10.134.0.32:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-inf-a-4268e3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-4268e3-openshift-default-5c6b854cf4 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-2dc95c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-2dc95c

openshift-ingress

replicaset-controller

e2e-worker-w4-2dc95c-openshift-default-7f7c49787b

SuccessfulCreate

Created pod: e2e-worker-w4-2dc95c-openshift-default-7f7c49787b-kbn8x

openshift-ingress

replicaset-controller

e2e-inf-a-4268e3-openshift-default-5c6b854cf4

SuccessfulCreate

Created pod: e2e-inf-a-4268e3-openshift-default-5c6b854cf4-9gx4d

openshift-ingress

gateway_labeler_controller

e2e-inf-a-4268e3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-4268e3

openshift-ingress

deployment-controller

e2e-worker-w4-2dc95c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-2dc95c-openshift-default-7f7c49787b from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w0-52b0af-openshift-default-6745cc867b

SuccessfulCreate

Created pod: e2e-worker-w0-52b0af-openshift-default-6745cc867b-njnxs

openshift-ingress

deployment-controller

e2e-worker-w0-52b0af-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-52b0af-openshift-default-6745cc867b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-52b0af

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-52b0af

openshift-ingress

multus

e2e-worker-w4-2dc95c-openshift-default-7f7c49787b-kbn8x

AddedInterface

Add eth0 [10.134.0.37/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w0-52b0af-openshift-default-6745cc867b-njnxs

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes

openshift-ingress

multus

e2e-inf-a-4268e3-openshift-default-5c6b854cf4-9gx4d

AddedInterface

Add eth0 [10.134.0.38/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-2dc95c-5f974f57d6-tf8fc

AddedInterface

Add eth0 [10.132.0.36/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-2dc95c-5f974f57d6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-2dc95c-5f974f57d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-2dc95c: serviceaccount "payload-processing-e2e-worker-w4-2dc95c" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-2dc95c-5f974f57d6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-2dc95c-5f974f57d6-tf8fc
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-2dc95c-7f8985dd8c

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-2dc95c-7f8985dd8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-2dc95c: serviceaccount "payload-processing-e2e-worker-w4-2dc95c" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-2dc95c-7f8985dd8c

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-2dc95c-7f8985dd8c-s8psz

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-2dc95c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-2dc95c-7f8985dd8c from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-2dc95c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-2dc95c-5f974f57d6 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-4268e3-54594494d5

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-4268e3-54594494d5-qdfn4

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-2dc95c-7f8985dd8c-s8psz

Created

Created container: payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-4268e3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-4268e3-54594494d5 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-2dc95c-5f974f57d6-tf8fc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-2dc95c-5f974f57d6-tf8fc

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-4268e3-699f8ff594

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-4268e3-699f8ff594-hg468
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-4268e3-54594494d5

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-4268e3-54594494d5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-4268e3: serviceaccount "payload-processing-e2e-inf-a-4268e3" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-4268e3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-4268e3-699f8ff594 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-4268e3-699f8ff594

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-4268e3-699f8ff594-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-4268e3: serviceaccount "payload-processing-e2e-inf-a-4268e3" not found

openshift-ingress

multus

payload-processing-e2e-worker-w4-2dc95c-7f8985dd8c-s8psz

AddedInterface

Add eth0 [10.132.0.37/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-2dc95c-7f8985dd8c-s8psz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-2dc95c-5f974f57d6-tf8fc

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-2dc95c-7f8985dd8c-s8psz

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-4268e3-54594494d5-qdfn4

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-4268e3-54594494d5-qdfn4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-52b0af-6b764dfd47

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-52b0af-6b764dfd47-hhjtc

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-4268e3-699f8ff594-hg468

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-4268e3-699f8ff594-hg468

Created

Created container: payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-52b0af-6b764dfd47

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-52b0af-6b764dfd47-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-52b0af: serviceaccount "payload-processing-e2e-worker-w0-52b0af" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-4268e3-699f8ff594-hg468

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-4268e3-699f8ff594-hg468

AddedInterface

Add eth0 [10.132.0.38/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-52b0af

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-52b0af-76789c7db6 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-a-4268e3-54594494d5-qdfn4

Created

Created container: payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-52b0af-76789c7db6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-52b0af-76789c7db6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-52b0af: serviceaccount "payload-processing-e2e-worker-w0-52b0af" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-52b0af-76789c7db6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-52b0af-76789c7db6-ljwcq

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-52b0af

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-52b0af-6b764dfd47 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-inf-a-4268e3-54594494d5-qdfn4

AddedInterface

Add eth0 [10.132.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-52b0af-6b764dfd47-hhjtc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

e2e-autores-8b1a16-openshift-default-787d566cdd

SuccessfulCreate

Created pod: e2e-autores-8b1a16-openshift-default-787d566cdd-x4wrb

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-52b0af-6b764dfd47-hhjtc

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-worker-w0-52b0af-6b764dfd47-hhjtc

AddedInterface

Add eth0 [10.132.0.40/23] from ovn-kubernetes

openshift-ingress

multus

e2e-autores-8b1a16-openshift-default-787d566cdd-x4wrb

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-52b0af-76789c7db6-ljwcq

AddedInterface

Add eth0 [10.133.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-52b0af-6b764dfd47-hhjtc

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-52b0af-76789c7db6-ljwcq

Created

Created container: payload-pre-processing

openshift-ingress

deployment-controller

e2e-autores-8b1a16-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-8b1a16-openshift-default-787d566cdd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-autores-8b1a16

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-8b1a16

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-52b0af-76789c7db6-ljwcq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-52b0af-76789c7db6-ljwcq

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-ait-ab1ade68-openshift-default-bb68fd844

SuccessfulCreate

Created pod: e2e-ait-ab1ade68-openshift-default-bb68fd844-klxqj

openshift-ingress

deployment-controller

e2e-ait-ab1ade68-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-ab1ade68-openshift-default-bb68fd844 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-ab1ade68

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-ab1ade68

openshift-ingress

multus

e2e-ait-ab1ade68-openshift-default-bb68fd844-klxqj

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-8b1a16-d5b9458f4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-8b1a16-d5b9458f4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-8b1a16: serviceaccount "payload-processing-e2e-autores-8b1a16" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-8b1a16-b95999f9

SuccessfulCreate

Created pod: payload-processing-e2e-autores-8b1a16-b95999f9-b9rdg

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-8b1a16-d5b9458f4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-8b1a16-d5b9458f4-nd6km

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-8b1a16

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-8b1a16-d5b9458f4 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-8b1a16-b95999f9

FailedCreate

Error creating: pods "payload-processing-e2e-autores-8b1a16-b95999f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-8b1a16: serviceaccount "payload-processing-e2e-autores-8b1a16" not found

openshift-ingress

deployment-controller

payload-processing-e2e-autores-8b1a16

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-8b1a16-b95999f9 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-autores-8b1a16-b95999f9-b9rdg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-8b1a16-d5b9458f4-nd6km

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-autores-8b1a16-b95999f9-b9rdg

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-8b1a16-b95999f9-b9rdg

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-autores-8b1a16-d5b9458f4-nd6km

AddedInterface

Add eth0 [10.132.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-8b1a16-d5b9458f4-nd6km

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-autores-8b1a16-b95999f9-b9rdg

AddedInterface

Add eth0 [10.132.0.41/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ait-ab1ade68

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-ab1ade68-5cf97ccd79 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-8b1a16-d5b9458f4-nd6km

Created

Created container: payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-inf-b-32d680

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-32d680

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-ab1ade68-59fcf454c8-pq2k4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-ab1ade68-5cf97ccd79-zj2dq

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-ab1ade68-5cf97ccd79-zj2dq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-ab1ade68-5cf97ccd79

FailedCreate

Error creating: pods "payload-processing-e2e-ait-ab1ade68-5cf97ccd79-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-ab1ade68: serviceaccount "payload-processing-e2e-ait-ab1ade68" not found

openshift-ingress

kubelet

payload-processing-e2e-ait-ab1ade68-5cf97ccd79-zj2dq

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-ab1ade68-59fcf454c8-pq2k4

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-ab1ade68-5cf97ccd79-zj2dq

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-ab1ade68-5cf97ccd79

SuccessfulCreate

Created pod: payload-processing-e2e-ait-ab1ade68-5cf97ccd79-zj2dq

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-ab1ade68-59fcf454c8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-ab1ade68-59fcf454c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-ab1ade68: serviceaccount "payload-processing-e2e-ait-ab1ade68" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-ab1ade68-59fcf454c8-pq2k4

Created

Created container: payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-ab1ade68

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-ab1ade68-59fcf454c8 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-ab1ade68-59fcf454c8-pq2k4

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

e2e-inf-b-32d680-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-32d680-openshift-default-79c98d5dd6 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-32d680-openshift-default-79c98d5dd6

SuccessfulCreate

Created pod: e2e-inf-b-32d680-openshift-default-79c98d5dd6-zdv42

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-ab1ade68-59fcf454c8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-ab1ade68-59fcf454c8-pq2k4

openshift-ingress

multus

e2e-inf-b-32d680-openshift-default-79c98d5dd6-zdv42

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-worker-w4-2dc95c-openshift-default-7f7c49787b-kbn8x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-4268e3-openshift-default-5c6b854cf4-9gx4d

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w4-2dc95c-openshift-default-7f7c49787b-kbn8x

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-2dc95c-openshift-default-7f7c49787b-kbn8x

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-52b0af-openshift-default-6745cc867b-njnxs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w0-52b0af-openshift-default-6745cc867b-njnxs

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-4268e3-openshift-default-5c6b854cf4-9gx4d

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-52b0af-openshift-default-6745cc867b-njnxs

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-4268e3-openshift-default-5c6b854cf4-9gx4d

Created

Created container: istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-32d680-85b754fb74-s4vf7

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-inf-b-32d680-5bf5cf8c97-g6pvf

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-32d680-5bf5cf8c97-g6pvf

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-32d680-85b754fb74-s4vf7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-32d680-85b754fb74-s4vf7

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-32d680

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-32d680-85b754fb74 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-b-32d680-5bf5cf8c97-g6pvf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-b-32d680-5bf5cf8c97-g6pvf

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-32d680-85b754fb74

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-32d680-85b754fb74-s4vf7
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-32d680-85b754fb74

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-32d680-85b754fb74-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-32d680: serviceaccount "payload-processing-e2e-inf-b-32d680" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-32d680-5bf5cf8c97

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-32d680-5bf5cf8c97-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-32d680: serviceaccount "payload-processing-e2e-inf-b-32d680" not found

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-32d680-85b754fb74-s4vf7

AddedInterface

Add eth0 [10.132.0.44/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-32d680-5bf5cf8c97

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-32d680-5bf5cf8c97-g6pvf

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-32d680

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-32d680-5bf5cf8c97 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-ab1ade68-59fcf454c8-pq2k4

Unhealthy

Readiness probe failed: dial tcp 10.133.0.57:9004: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w0-52b0af-openshift-default-6745cc867b-njnxs

ProbeError

Startup probe error: Get "http://10.134.0.39:15021/healthz/ready": dial tcp 10.134.0.39:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-inf-a-4268e3-openshift-default-5c6b854cf4-9gx4d

ProbeError

Startup probe error: Get "http://10.134.0.38:15021/healthz/ready": dial tcp 10.134.0.38:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w4-2dc95c-openshift-default-7f7c49787b-kbn8x

Unhealthy

Startup probe failed: Get "http://10.134.0.37:15021/healthz/ready": dial tcp 10.134.0.37:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w4-2dc95c-openshift-default-7f7c49787b-kbn8x

ProbeError

Startup probe error: Get "http://10.134.0.37:15021/healthz/ready": dial tcp 10.134.0.37:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-inf-a-4268e3-openshift-default-5c6b854cf4-9gx4d

Unhealthy

Startup probe failed: Get "http://10.134.0.38:15021/healthz/ready": dial tcp 10.134.0.38:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w0-52b0af-openshift-default-6745cc867b-njnxs

Unhealthy

Startup probe failed: Get "http://10.134.0.39:15021/healthz/ready": dial tcp 10.134.0.39:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-ait-ab1ade68-openshift-default-bb68fd844-klxqj

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-8b1a16-openshift-default-787d566cdd-x4wrb

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-8b1a16-openshift-default-787d566cdd-x4wrb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-autores-8b1a16-openshift-default-787d566cdd-x4wrb

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-ab1ade68-openshift-default-bb68fd844-klxqj

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-ab1ade68-openshift-default-bb68fd844-klxqj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-autores-8b1a16-openshift-default-787d566cdd-x4wrb

ProbeError

Startup probe error: Get "http://10.134.0.40:15021/healthz/ready": dial tcp 10.134.0.40:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-autores-8b1a16-openshift-default-787d566cdd-x4wrb

Unhealthy

Startup probe failed: Get "http://10.134.0.40:15021/healthz/ready": dial tcp 10.134.0.40:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-ab1ade68-openshift-default-bb68fd844-klxqj

ProbeError

Startup probe error: Get "http://10.134.0.41:15021/healthz/ready": dial tcp 10.134.0.41:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-ab1ade68-openshift-default-bb68fd844-klxqj

Unhealthy

Startup probe failed: Get "http://10.134.0.41:15021/healthz/ready": dial tcp 10.134.0.41:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-inf-b-32d680-openshift-default-79c98d5dd6-zdv42

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-32d680-openshift-default-79c98d5dd6-zdv42

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-32d680-openshift-default-79c98d5dd6-zdv42

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-inf-b-32d680-openshift-default-79c98d5dd6-zdv42

ProbeError

Startup probe error: Get "http://10.134.0.42:15021/healthz/ready": dial tcp 10.134.0.42:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-b-32d680-openshift-default-79c98d5dd6-zdv42

Unhealthy

Startup probe failed: Get "http://10.134.0.42:15021/healthz/ready": dial tcp 10.134.0.42:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-ab1ade68-59fcf454c8-pq2k4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-ab1ade68-5cf97ccd79-zj2dq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-ab1ade68-openshift-default-bb68fd844-klxqj

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-migrate-5969a028-gw-openshift-default-68d6f98664

SuccessfulCreate

Created pod: e2e-migrate-5969a028-gw-openshift-default-68d6f98664-fvdnt

openshift-ingress

deployment-controller

e2e-migrate-5969a028-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-5969a028-gw-openshift-default-68d6f98664 from 0 to 1

openshift-ingress

kubelet

e2e-ait-ab1ade68-openshift-default-bb68fd844-klxqj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ait-ab1ade68-openshift-default-bb68fd844-klxqj

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

gateway_labeler_controller

e2e-migrate-5969a028-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-5969a028-gw

openshift-ingress

multus

e2e-migrate-5969a028-gw-openshift-default-68d6f98664-fvdnt

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-5969a028

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-5969a028-59c4cf6f6b from 0 to 1

openshift-ingress

multus

payload-processing-e2e-migrate-5969a028-59c4cf6f6b-9x5kj

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-5969a028-59c4cf6f6b

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-5969a028-59c4cf6f6b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-5969a028: serviceaccount "payload-processing-e2e-migrate-5969a028" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-5969a028-59b9875946

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-5969a028-59b9875946-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-5969a028: serviceaccount "payload-processing-e2e-migrate-5969a028" not found

openshift-ingress

multus

payload-pre-processing-e2e-migrate-5969a028-59b9875946-4qpbq

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-5969a028-59b9875946-4qpbq

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-5969a028-59b9875946-4qpbq

Created

Created container: payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-5969a028

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-5969a028-59b9875946 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-migrate-5969a028-59c4cf6f6b-9x5kj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-migrate-5969a028-59c4cf6f6b-9x5kj

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-5969a028-59c4cf6f6b-9x5kj

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-5969a028-59b9875946-4qpbq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-5969a028-59b9875946

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-5969a028-59b9875946-4qpbq

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-5969a028-59c4cf6f6b

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-5969a028-59c4cf6f6b-9x5kj
(x2)

openshift-ingress

kubelet

e2e-migrate-5969a028-gw-openshift-default-68d6f98664-fvdnt

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-5969a028-gw-openshift-default-68d6f98664-fvdnt

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-5969a028-gw-openshift-default-68d6f98664-fvdnt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-migrate-5969a028-gw-openshift-default-68d6f98664-fvdnt

ProbeError

Startup probe error: Get "http://10.134.0.45:15021/healthz/ready": dial tcp 10.134.0.45:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-migrate-5969a028-gw-openshift-default-68d6f98664-fvdnt

Unhealthy

Startup probe failed: Get "http://10.134.0.45:15021/healthz/ready": dial tcp 10.134.0.45:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-migrate-5969a028-59c4cf6f6b-9x5kj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-5969a028-59b9875946-4qpbq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-migrate-5969a028-gw-openshift-default-68d6f98664-fvdnt

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-ait-d310aa61-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-d310aa61-openshift-default-6d6988b798 from 0 to 1

openshift-ingress

multus

e2e-ait-d310aa61-openshift-default-6d6988b798-76tnx

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ait-d310aa61-openshift-default-6d6988b798

SuccessfulCreate

Created pod: e2e-ait-d310aa61-openshift-default-6d6988b798-76tnx

openshift-ingress

gateway_labeler_controller

e2e-ait-d310aa61

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-d310aa61
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-d310aa61-7c59b557c4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-d310aa61-7c59b557c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-d310aa61: serviceaccount "payload-processing-e2e-ait-d310aa61" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-d310aa61-65898c45df

SuccessfulCreate

Created pod: payload-processing-e2e-ait-d310aa61-65898c45df-jfvzl

openshift-ingress

deployment-controller

payload-processing-e2e-ait-d310aa61

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-d310aa61-65898c45df from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-d310aa61-65898c45df

FailedCreate

Error creating: pods "payload-processing-e2e-ait-d310aa61-65898c45df-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-d310aa61: serviceaccount "payload-processing-e2e-ait-d310aa61" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-d310aa61

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-d310aa61-7c59b557c4 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-d310aa61-7c59b557c4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-d310aa61-7c59b557c4-pqncp

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-d310aa61-7c59b557c4-pqncp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-d310aa61-7c59b557c4-pqncp

AddedInterface

Add eth0 [10.133.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-d310aa61-7c59b557c4-pqncp

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-d310aa61-7c59b557c4-pqncp

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ait-d310aa61-65898c45df-jfvzl

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-d310aa61-65898c45df-jfvzl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-d310aa61-65898c45df-jfvzl

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-d310aa61-65898c45df-jfvzl

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-ait-d310aa61-openshift-default-6d6988b798-76tnx

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-d310aa61-openshift-default-6d6988b798-76tnx

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-d310aa61-openshift-default-6d6988b798-76tnx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ait-d310aa61-openshift-default-6d6988b798-76tnx

Unhealthy

Startup probe failed: Get "http://10.134.0.47:15021/healthz/ready": dial tcp 10.134.0.47:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-d310aa61-openshift-default-6d6988b798-76tnx

ProbeError

Startup probe error: Get "http://10.134.0.47:15021/healthz/ready": dial tcp 10.134.0.47:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-d310aa61-7c59b557c4-pqncp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-d310aa61-65898c45df-jfvzl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-d310aa61-openshift-default-6d6988b798-76tnx

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-derive-9abacf77

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-9abacf77

openshift-ingress

replicaset-controller

e2e-derive-9abacf77-openshift-default-f9549dcd4

SuccessfulCreate

Created pod: e2e-derive-9abacf77-openshift-default-f9549dcd4-4mchm

openshift-ingress

deployment-controller

e2e-derive-9abacf77-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-9abacf77-openshift-default-f9549dcd4 from 0 to 1

openshift-ingress

multus

e2e-derive-9abacf77-openshift-default-f9549dcd4-4mchm

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-9abacf77-5fc5d74c4f

FailedCreate

Error creating: pods "payload-processing-e2e-derive-9abacf77-5fc5d74c4f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-9abacf77: serviceaccount "payload-processing-e2e-derive-9abacf77" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-9abacf77

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-9abacf77-b8cf54698 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-derive-9abacf77

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-9abacf77-5fc5d74c4f from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-9abacf77-b8cf54698-q2676

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-9abacf77-b8cf54698-q2676

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-9abacf77-5fc5d74c4f-fl4tm

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-9abacf77-5fc5d74c4f-fl4tm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-9abacf77-b8cf54698

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-9abacf77-b8cf54698-q2676
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-9abacf77-b8cf54698

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-9abacf77-b8cf54698-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-9abacf77: serviceaccount "payload-processing-e2e-derive-9abacf77" not found

openshift-ingress

kubelet

payload-processing-e2e-derive-9abacf77-5fc5d74c4f-fl4tm

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-9abacf77-5fc5d74c4f

SuccessfulCreate

Created pod: payload-processing-e2e-derive-9abacf77-5fc5d74c4f-fl4tm

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-9abacf77-b8cf54698-q2676

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-derive-9abacf77-b8cf54698-q2676

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-derive-9abacf77-5fc5d74c4f-fl4tm

AddedInterface

Add eth0 [10.133.0.65/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-derive-9abacf77-openshift-default-f9549dcd4-4mchm

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-9abacf77-openshift-default-f9549dcd4-4mchm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-9abacf77-openshift-default-f9549dcd4-4mchm

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-derive-9abacf77-openshift-default-f9549dcd4-4mchm

ProbeError

Startup probe error: Get "http://10.134.0.52:15021/healthz/ready": dial tcp 10.134.0.52:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-derive-9abacf77-openshift-default-f9549dcd4-4mchm

Unhealthy

Startup probe failed: Get "http://10.134.0.52:15021/healthz/ready": dial tcp 10.134.0.52:15021: connect: connection refused

openshift-ingress

kubelet

e2e-derive-9abacf77-openshift-default-f9549dcd4-4mchm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-9abacf77-b8cf54698-q2676

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-9abacf77-5fc5d74c4f-fl4tm

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-derive-9abacf77

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-derive-9abacf77: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-derive-9abacf77": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-derive-9abacf77, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 60e3ac3a-424b-40aa-9cdc-97c55774d05b, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-autores-8b1a16-b95999f9-b9rdg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-8b1a16-d5b9458f4-nd6km

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-explicit-2cceea

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-2cceea

openshift-ingress

deployment-controller

e2e-explicit-2cceea-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-2cceea-openshift-default-5df55b44fb from 0 to 1

openshift-ingress

replicaset-controller

e2e-explicit-2cceea-openshift-default-5df55b44fb

SuccessfulCreate

Created pod: e2e-explicit-2cceea-openshift-default-5df55b44fb-s8vgq

openshift-ingress

kubelet

e2e-autores-8b1a16-openshift-default-787d566cdd-x4wrb

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-explicit-2cceea-openshift-default-5df55b44fb-s8vgq

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-2cceea-7bd48d77bb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-2cceea-7bd48d77bb-z6qvl

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-2cceea-7bd575c75c

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-2cceea-7bd575c75c-289zn
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-2cceea-7bd48d77bb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-2cceea-7bd48d77bb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-2cceea: serviceaccount "payload-processing-e2e-explicit-2cceea" not found

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-2cceea

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-2cceea-7bd575c75c from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-2cceea

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-2cceea-7bd48d77bb from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-2cceea-7bd575c75c

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-2cceea-7bd575c75c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-2cceea: serviceaccount "payload-processing-e2e-explicit-2cceea" not found

openshift-ingress

multus

payload-processing-e2e-explicit-2cceea-7bd575c75c-289zn

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-2cceea-7bd575c75c-289zn

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-explicit-2cceea-7bd48d77bb-z6qvl

AddedInterface

Add eth0 [10.133.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-2cceea-7bd48d77bb-z6qvl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-2cceea-7bd48d77bb-z6qvl

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-2cceea-7bd48d77bb-z6qvl

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-2cceea-7bd575c75c-289zn

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-2cceea-7bd575c75c-289zn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-2cceea-openshift-default-5df55b44fb-s8vgq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-2cceea-openshift-default-5df55b44fb-s8vgq

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-2cceea-openshift-default-5df55b44fb-s8vgq

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-explicit-2cceea-openshift-default-5df55b44fb-s8vgq

ProbeError

Startup probe error: Get "http://10.134.0.54:15021/healthz/ready": dial tcp 10.134.0.54:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-explicit-2cceea-openshift-default-5df55b44fb-s8vgq

Unhealthy

Startup probe failed: Get "http://10.134.0.54:15021/healthz/ready": dial tcp 10.134.0.54:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-mt-31e12f72-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-31e12f72-openshift-default-f9b7cbb8 from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-31e12f72-openshift-default-f9b7cbb8

SuccessfulCreate

Created pod: e2e-mt-31e12f72-openshift-default-f9b7cbb8-vr8t7

openshift-ingress

gateway_labeler_controller

e2e-mt-31e12f72

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-31e12f72

openshift-ingress

multus

e2e-mt-31e12f72-openshift-default-f9b7cbb8-vr8t7

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-31e12f72-5d7bd7bfdb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-31e12f72-5d7bd7bfdb-dvbcp

openshift-ingress

deployment-controller

payload-processing-e2e-mt-31e12f72

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-31e12f72-869b47bb4f from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-31e12f72

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-31e12f72-5d7bd7bfdb from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-31e12f72-869b47bb4f

FailedCreate

Error creating: pods "payload-processing-e2e-mt-31e12f72-869b47bb4f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-31e12f72: serviceaccount "payload-processing-e2e-mt-31e12f72" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-31e12f72-5d7bd7bfdb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-31e12f72-5d7bd7bfdb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-31e12f72: serviceaccount "payload-processing-e2e-mt-31e12f72" not found

openshift-ingress

kubelet

payload-processing-e2e-mt-31e12f72-869b47bb4f-zfntz

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-31e12f72-5d7bd7bfdb-dvbcp

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-31e12f72-5d7bd7bfdb-dvbcp

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-31e12f72-869b47bb4f-zfntz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-31e12f72-5d7bd7bfdb-dvbcp

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-31e12f72-5d7bd7bfdb-dvbcp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-31e12f72-869b47bb4f

SuccessfulCreate

Created pod: payload-processing-e2e-mt-31e12f72-869b47bb4f-zfntz

openshift-ingress

kubelet

payload-processing-e2e-mt-31e12f72-869b47bb4f-zfntz

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-mt-31e12f72-869b47bb4f-zfntz

AddedInterface

Add eth0 [10.133.0.69/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-mt-31e12f72-openshift-default-f9b7cbb8-vr8t7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-31e12f72-openshift-default-f9b7cbb8-vr8t7

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-31e12f72-openshift-default-f9b7cbb8-vr8t7

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-31e12f72-openshift-default-f9b7cbb8-vr8t7

ProbeError

Startup probe error: Get "http://10.134.0.60:15021/healthz/ready": dial tcp 10.134.0.60:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-31e12f72-openshift-default-f9b7cbb8-vr8t7

Unhealthy

Startup probe failed: Get "http://10.134.0.60:15021/healthz/ready": dial tcp 10.134.0.60:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-31e12f72-5d7bd7bfdb-dvbcp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-31e12f72-869b47bb4f-zfntz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-2cceea-7bd48d77bb-z6qvl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-2cceea-7bd575c75c-289zn

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-explicit-2cceea

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-explicit-2cceea: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-explicit-2cceea": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-explicit-2cceea, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: b410f001-e828-4208-a910-d03140eb5f62, UID in object meta:

openshift-ingress

kubelet

e2e-mt-31e12f72-openshift-default-f9b7cbb8-vr8t7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-31e12f72-openshift-default-f9b7cbb8-vr8t7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-31e12f72-openshift-default-f9b7cbb8-vr8t7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-explicit-2cceea-openshift-default-5df55b44fb-s8vgq

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-noten-9459f0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-9459f0

openshift-ingress

replicaset-controller

e2e-noten-9459f0-openshift-default-5b98456494

SuccessfulCreate

Created pod: e2e-noten-9459f0-openshift-default-5b98456494-xxl9s

openshift-ingress

deployment-controller

e2e-noten-9459f0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-9459f0-openshift-default-5b98456494 from 0 to 1

openshift-ingress

multus

e2e-noten-9459f0-openshift-default-5b98456494-xxl9s

AddedInterface

Add eth0 [10.133.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-9459f0-openshift-default-5b98456494-xxl9s

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

e2e-noten-9459f0-openshift-default-5b98456494-xxl9s

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.624s (2.624s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

e2e-noten-9459f0-openshift-default-5b98456494-xxl9s

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-noten-9459f0-openshift-default-5b98456494-xxl9s

Started

Started container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-6b6653

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-6b6653

openshift-ingress

multus

e2e-shared-a-w2-6b6653-openshift-default-7b589686c8-4s5v6

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-a-w2-6b6653-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-6b6653-openshift-default-7b589686c8 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w2-6b6653-openshift-default-7b589686c8

SuccessfulCreate

Created pod: e2e-shared-a-w2-6b6653-openshift-default-7b589686c8-4s5v6

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-6b6653-84c6c4c6d5

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-6b6653-84c6c4c6d5-5nxp4

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-6b6653

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-6b6653-84c6c4c6d5 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-6b6653-79965c98fd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-6b6653-79965c98fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-6b6653: serviceaccount "payload-processing-e2e-shared-a-w2-6b6653" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-6b6653-79965c98fd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-6b6653-79965c98fd-t84xk

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-6b6653

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-6b6653-79965c98fd from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-6b6653-84c6c4c6d5

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-6b6653-84c6c4c6d5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-6b6653: serviceaccount "payload-processing-e2e-shared-a-w2-6b6653" not found

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-6b6653-79965c98fd-t84xk

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-6b6653-84c6c4c6d5-5nxp4

AddedInterface

Add eth0 [10.133.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-6b6653-84c6c4c6d5-5nxp4

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-6b6653-84c6c4c6d5-5nxp4

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-6b6653-84c6c4c6d5-5nxp4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-6b6653-79965c98fd-t84xk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-6b6653-79965c98fd-t84xk

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-6b6653-79965c98fd-t84xk

Started

Started container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-bff65f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-bff65f

openshift-ingress

deployment-controller

e2e-shared-b-w2-bff65f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-bff65f-openshift-default-cfdb9fc5d from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w2-bff65f-openshift-default-cfdb9fc5d

SuccessfulCreate

Created pod: e2e-shared-b-w2-bff65f-openshift-default-cfdb9fc5d-hg4k7

openshift-ingress

multus

e2e-shared-b-w2-bff65f-openshift-default-cfdb9fc5d-hg4k7

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-bff65f-7dd7d745b5

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-bff65f-7dd7d745b5-r9pvk
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-bff65f-6b9bf45474

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-bff65f-6b9bf45474-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-bff65f: serviceaccount "payload-processing-e2e-shared-b-w2-bff65f" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-bff65f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-bff65f-7dd7d745b5 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-bff65f-7dd7d745b5

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-bff65f-7dd7d745b5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-bff65f: serviceaccount "payload-processing-e2e-shared-b-w2-bff65f" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-bff65f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-bff65f-6b9bf45474 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-bff65f-6b9bf45474

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-bff65f-6b9bf45474-xdg4j

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-bff65f-7dd7d745b5-r9pvk

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-bff65f-7dd7d745b5-r9pvk

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-bff65f-7dd7d745b5-r9pvk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-bff65f-6b9bf45474-xdg4j

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-bff65f-6b9bf45474-xdg4j

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-bff65f-7dd7d745b5-r9pvk

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-bff65f-6b9bf45474-xdg4j

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-bff65f-6b9bf45474-xdg4j

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-6b6653-openshift-default-7b589686c8-4s5v6

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-6b6653-openshift-default-7b589686c8-4s5v6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-6b6653-openshift-default-7b589686c8-4s5v6

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-6b6653-openshift-default-7b589686c8-4s5v6

ProbeError

Startup probe error: Get "http://10.134.0.62:15021/healthz/ready": dial tcp 10.134.0.62:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-6b6653-openshift-default-7b589686c8-4s5v6

Unhealthy

Startup probe failed: Get "http://10.134.0.62:15021/healthz/ready": dial tcp 10.134.0.62:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-bff65f-openshift-default-cfdb9fc5d-hg4k7

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-bff65f-openshift-default-cfdb9fc5d-hg4k7

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-bff65f-openshift-default-cfdb9fc5d-hg4k7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-bff65f-openshift-default-cfdb9fc5d-hg4k7

Unhealthy

Startup probe failed: Get "http://10.134.0.63:15021/healthz/ready": dial tcp 10.134.0.63:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-bff65f-openshift-default-cfdb9fc5d-hg4k7

ProbeError

Startup probe error: Get "http://10.134.0.63:15021/healthz/ready": dial tcp 10.134.0.63:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-mt-6d422395-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-6d422395-openshift-default-77fb9d86cb from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-6d422395

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-6d422395

openshift-ingress

replicaset-controller

e2e-mt-6d422395-openshift-default-77fb9d86cb

SuccessfulCreate

Created pod: e2e-mt-6d422395-openshift-default-77fb9d86cb-gkxxq

openshift-ingress

multus

e2e-mt-6d422395-openshift-default-77fb9d86cb-gkxxq

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-6d422395-7bddff4f6b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-6d422395-7bddff4f6b-sjwl4
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-6d422395-5777b9b9b5

FailedCreate

Error creating: pods "payload-processing-e2e-mt-6d422395-5777b9b9b5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-6d422395: serviceaccount "payload-processing-e2e-mt-6d422395" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-6d422395

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-6d422395-7bddff4f6b from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-mt-6d422395

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-6d422395-5777b9b9b5 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-6d422395-7bddff4f6b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-6d422395-7bddff4f6b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-6d422395: serviceaccount "payload-processing-e2e-mt-6d422395" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-6d422395-5777b9b9b5

SuccessfulCreate

Created pod: payload-processing-e2e-mt-6d422395-5777b9b9b5-qsn2r

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-6d422395-7bddff4f6b-sjwl4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-6d422395-7bddff4f6b-sjwl4

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-6d422395-7bddff4f6b-sjwl4

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-6d422395-5777b9b9b5-qsn2r

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-6d422395-7bddff4f6b-sjwl4

AddedInterface

Add eth0 [10.132.0.61/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-mt-6d422395-5777b9b9b5-qsn2r

AddedInterface

Add eth0 [10.133.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-6d422395-5777b9b9b5-qsn2r

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-6d422395-5777b9b9b5-qsn2r

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-4268e3-699f8ff594-hg468

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-inf-a-4268e3

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-inf-a-4268e3: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-inf-a-4268e3": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-inf-a-4268e3, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 67352cc5-7f80-4248-a9d8-a9cd189d05e2, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-inf-a-4268e3-54594494d5-qdfn4

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-mt-6d422395-openshift-default-77fb9d86cb-gkxxq

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-6d422395-openshift-default-77fb9d86cb-gkxxq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-6d422395-openshift-default-77fb9d86cb-gkxxq

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-6d422395-openshift-default-77fb9d86cb-gkxxq

ProbeError

Startup probe error: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-6d422395-openshift-default-77fb9d86cb-gkxxq

Unhealthy

Startup probe failed: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused

openshift-ingress

kubelet

e2e-noten-9459f0-openshift-default-5b98456494-xxl9s

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-4268e3-openshift-default-5c6b854cf4-9gx4d

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-inf-b-32d680-5bf5cf8c97-g6pvf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-32d680-85b754fb74-s4vf7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-b-32d680-openshift-default-79c98d5dd6-zdv42

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-w3-2fae12-openshift-default-6c64849794

SuccessfulCreate

Created pod: e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr

openshift-ingress

deployment-controller

e2e-shared-a-w3-2fae12-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-2fae12-openshift-default-6c64849794 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-2fae12

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-2fae12

openshift-ingress

multus

e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr

AddedInterface

Add eth0 [10.133.0.80/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-2fae12

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-2fae12-dcbcf697d from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-2fae12

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-2fae12-6645c8484f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-2fae12-6645c8484f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-2fae12-6645c8484f-bzd8m
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-2fae12-6645c8484f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-2fae12-6645c8484f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-2fae12: serviceaccount "payload-processing-e2e-shared-a-w3-2fae12" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-2fae12-dcbcf697d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-2fae12-dcbcf697d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-2fae12: serviceaccount "payload-processing-e2e-shared-a-w3-2fae12" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-2fae12-dcbcf697d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-2fae12-dcbcf697d-c2qt5

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-2fae12-6645c8484f-bzd8m

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-2fae12-6645c8484f-bzd8m

AddedInterface

Add eth0 [10.132.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-2fae12-6645c8484f-bzd8m

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-2fae12-6645c8484f-bzd8m

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-2fae12-dcbcf697d-c2qt5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-2fae12-dcbcf697d-c2qt5

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-2fae12-dcbcf697d-c2qt5

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-2fae12-dcbcf697d-c2qt5

AddedInterface

Add eth0 [10.132.0.66/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

replicaset-controller

e2e-shared-b-w3-327a3a-openshift-default-5b79db7d64

SuccessfulCreate

Created pod: e2e-shared-b-w3-327a3a-openshift-default-5b79db7d64-ghqgq

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-327a3a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-327a3a

openshift-ingress

deployment-controller

e2e-shared-b-w3-327a3a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-327a3a-openshift-default-5b79db7d64 from 0 to 1
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr

Unhealthy

Startup probe failed: Get "http://10.133.0.80:15021/healthz/ready": dial tcp 10.133.0.80:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr

ProbeError

Startup probe error: Get "http://10.133.0.80:15021/healthz/ready": dial tcp 10.133.0.80:15021: connect: connection refused body:

openshift-ingress

multus

e2e-shared-b-w3-327a3a-openshift-default-5b79db7d64-ghqgq

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-327a3a-798b88466c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-327a3a-798b88466c-7tq4d
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-327a3a-758897fc94

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-327a3a-758897fc94-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-327a3a: serviceaccount "payload-processing-e2e-shared-b-w3-327a3a" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-327a3a-758897fc94

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-327a3a-758897fc94-6ndmj

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-327a3a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-327a3a-758897fc94 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-327a3a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-327a3a-798b88466c from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-327a3a-798b88466c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-327a3a-798b88466c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-327a3a: serviceaccount "payload-processing-e2e-shared-b-w3-327a3a" not found

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-327a3a-758897fc94-6ndmj

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-327a3a-798b88466c-7tq4d

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-327a3a-798b88466c-7tq4d

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-327a3a-798b88466c-7tq4d

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-327a3a-798b88466c-7tq4d

AddedInterface

Add eth0 [10.132.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-327a3a-758897fc94-6ndmj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-327a3a-758897fc94-6ndmj

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-327a3a-758897fc94-6ndmj

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-327a3a-openshift-default-5b79db7d64-ghqgq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-327a3a-openshift-default-5b79db7d64-ghqgq

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-327a3a-openshift-default-5b79db7d64-ghqgq

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-327a3a-openshift-default-5b79db7d64-ghqgq

ProbeError

Startup probe error: Get "http://10.134.0.68:15021/healthz/ready": dial tcp 10.134.0.68:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-327a3a-openshift-default-5b79db7d64-ghqgq

Unhealthy

Startup probe failed: Get "http://10.134.0.68:15021/healthz/ready": dial tcp 10.134.0.68:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-mt-6d422395-5777b9b9b5-qsn2r

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-6d422395-7bddff4f6b-sjwl4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-6d422395-openshift-default-77fb9d86cb-gkxxq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-6d422395-openshift-default-77fb9d86cb-gkxxq

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-6d422395-openshift-default-77fb9d86cb-gkxxq

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

multus

e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn

AddedInterface

Add eth0 [10.133.0.83/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-api-a-935ef2-openshift-default-7869ff5656

SuccessfulCreate

Created pod: e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn

openshift-ingress

deployment-controller

e2e-api-a-935ef2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-935ef2-openshift-default-7869ff5656 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-935ef2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-935ef2

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-935ef2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-935ef2-55f98b5cb7 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-935ef2-67fc767bcd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-935ef2-67fc767bcd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-935ef2: serviceaccount "payload-processing-e2e-api-a-935ef2" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-935ef2-55f98b5cb7

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-935ef2-55f98b5cb7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-935ef2: serviceaccount "payload-processing-e2e-api-a-935ef2" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-935ef2-55f98b5cb7

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-935ef2-55f98b5cb7-j7h24

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-935ef2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-935ef2-67fc767bcd from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-935ef2-67fc767bcd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-935ef2-67fc767bcd-qlg4n

openshift-ingress

kubelet

payload-processing-e2e-api-a-935ef2-55f98b5cb7-j7h24

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-935ef2-67fc767bcd-qlg4n

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-935ef2-55f98b5cb7-j7h24

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-api-a-935ef2-55f98b5cb7-j7h24

AddedInterface

Add eth0 [10.132.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-935ef2-55f98b5cb7-j7h24

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-a-935ef2-67fc767bcd-qlg4n

AddedInterface

Add eth0 [10.132.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-935ef2-67fc767bcd-qlg4n

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-935ef2-67fc767bcd-qlg4n

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

e2e-api-b-b34361-openshift-default-6b77778cd4

SuccessfulCreate

Created pod: e2e-api-b-b34361-openshift-default-6b77778cd4-cwrl8

openshift-ingress

gateway_labeler_controller

e2e-api-b-b34361

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-b34361

openshift-ingress

deployment-controller

e2e-api-b-b34361-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-b34361-openshift-default-6b77778cd4 from 0 to 1

openshift-ingress

multus

e2e-api-b-b34361-openshift-default-6b77778cd4-cwrl8

AddedInterface

Add eth0 [10.134.0.73/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-b34361

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-b34361-777d7b6b67 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-b34361-56d4b5f69d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-b34361-56d4b5f69d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-b34361: serviceaccount "payload-processing-e2e-api-b-b34361" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-b34361-777d7b6b67

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-b34361-777d7b6b67-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-b34361: serviceaccount "payload-processing-e2e-api-b-b34361" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-b34361-56d4b5f69d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-b34361-56d4b5f69d-8p4nk

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-b34361

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-b34361-56d4b5f69d from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-b34361-777d7b6b67

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-b34361-777d7b6b67-twlmw

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-b34361-56d4b5f69d-8p4nk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn

Created

Created container: istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-api-b-b34361-777d7b6b67-twlmw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-b34361-56d4b5f69d-8p4nk

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-b34361-777d7b6b67-twlmw

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-b34361-777d7b6b67-twlmw

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-b34361-56d4b5f69d-8p4nk

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-b-b34361-56d4b5f69d-8p4nk

AddedInterface

Add eth0 [10.132.0.74/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-api-b-b34361-777d7b6b67-twlmw

AddedInterface

Add eth0 [10.133.0.86/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn

ProbeError

Startup probe error: Get "http://10.133.0.83:15021/healthz/ready": dial tcp 10.133.0.83:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn

Unhealthy

Startup probe failed: Get "http://10.133.0.83:15021/healthz/ready": dial tcp 10.133.0.83:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-52b0af-76789c7db6-ljwcq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-52b0af-6b764dfd47-hhjtc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w0-52b0af-openshift-default-6745cc867b-njnxs

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-api-a-935ef2-55f98b5cb7-j7h24

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-api-b-b34361-openshift-default-6b77778cd4-cwrl8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-api-b-b34361-openshift-default-6b77778cd4-cwrl8

ProbeError

Readiness probe error: Get "http://10.134.0.73:15021/healthz/ready": dial tcp 10.134.0.73:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-api-b-b34361-openshift-default-6b77778cd4-cwrl8

Unhealthy

Readiness probe failed: Get "http://10.134.0.73:15021/healthz/ready": dial tcp 10.134.0.73:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-935ef2-67fc767bcd-qlg4n

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-api-b-b34361-openshift-default-6b77778cd4-cwrl8

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-b34361-openshift-default-6b77778cd4-cwrl8

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-api-b-b34361-openshift-default-6b77778cd4-cwrl8

ProbeError

Startup probe error: Get "http://10.134.0.73:15021/healthz/ready": dial tcp 10.134.0.73:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-b-b34361-openshift-default-6b77778cd4-cwrl8

Unhealthy

Startup probe failed: Get "http://10.134.0.73:15021/healthz/ready": dial tcp 10.134.0.73:15021: connect: connection refused

openshift-ingress

kubelet

e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-b34361-56d4b5f69d-8p4nk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-b34361-777d7b6b67-twlmw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-b-b34361-openshift-default-6b77778cd4-cwrl8

Killing

Stopping container istio-proxy

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-a-w2-6b6653

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-a-w2-6b6653: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-a-w2-6b6653": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-a-w2-6b6653, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 47110dc1-7727-4c1f-bb97-cdbee10214ad, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-6b6653-84c6c4c6d5-5nxp4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-6b6653-79965c98fd-t84xk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w2-6b6653-openshift-default-7b589686c8-4s5v6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-bff65f-7dd7d745b5-r9pvk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-bff65f-6b9bf45474-xdg4j

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w2-bff65f-openshift-default-cfdb9fc5d-hg4k7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-bff65f-openshift-default-cfdb9fc5d-hg4k7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w2-bff65f-openshift-default-cfdb9fc5d-hg4k7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-2dc95c-5f974f57d6-tf8fc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-2dc95c-7f8985dd8c-s8psz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w4-2dc95c-openshift-default-7f7c49787b-kbn8x

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-ipp-a-269ba8-openshift-default-c855998c4

SuccessfulCreate

Created pod: e2e-ipp-a-269ba8-openshift-default-c855998c4-dpr78

openshift-ingress

deployment-controller

e2e-ipp-a-269ba8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-269ba8-openshift-default-c855998c4 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-269ba8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-269ba8

openshift-ingress

multus

e2e-ipp-a-269ba8-openshift-default-c855998c4-dpr78

AddedInterface

Add eth0 [10.134.0.84/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-269ba8-67dfcc44c8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-269ba8-67dfcc44c8-x2b6m
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-269ba8-698c4bbcbf

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-269ba8-698c4bbcbf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-269ba8: serviceaccount "payload-processing-e2e-ipp-a-269ba8" not found

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-269ba8-67dfcc44c8-x2b6m

AddedInterface

Add eth0 [10.132.0.77/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-a-269ba8-698c4bbcbf-76g29

AddedInterface

Add eth0 [10.132.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-269ba8-67dfcc44c8-x2b6m

Started

Started container payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-269ba8-67dfcc44c8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-269ba8-67dfcc44c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-269ba8: serviceaccount "payload-processing-e2e-ipp-a-269ba8" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-269ba8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-269ba8-698c4bbcbf from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-269ba8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-269ba8-67dfcc44c8 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-269ba8-698c4bbcbf

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-269ba8-698c4bbcbf-76g29

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-269ba8-67dfcc44c8-x2b6m

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-269ba8-67dfcc44c8-x2b6m

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-269ba8-698c4bbcbf-76g29

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-269ba8-698c4bbcbf-76g29

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-269ba8-698c4bbcbf-76g29

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-ipp-a-269ba8-openshift-default-c855998c4-dpr78

Unhealthy

Readiness probe failed: Get "http://10.134.0.84:15021/healthz/ready": read tcp 10.134.0.2:41434->10.134.0.84:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-ipp-a-269ba8-openshift-default-c855998c4-dpr78

ProbeError

Readiness probe error: Get "http://10.134.0.84:15021/healthz/ready": read tcp 10.134.0.2:41434->10.134.0.84:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-ipp-a-269ba8-openshift-default-c855998c4-dpr78

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-269ba8-openshift-default-c855998c4-dpr78

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-269ba8-openshift-default-c855998c4-dpr78

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-ipp-a-269ba8-openshift-default-c855998c4-dpr78

Unhealthy

Startup probe failed: Get "http://10.134.0.84:15021/healthz/ready": dial tcp 10.134.0.84:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-a-269ba8-openshift-default-c855998c4-dpr78

ProbeError

Startup probe error: Get "http://10.134.0.84:15021/healthz/ready": dial tcp 10.134.0.84:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-750358

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-750358

openshift-ingress

deployment-controller

e2e-ipp-b-750358-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-750358-openshift-default-b85cb6cfb from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-750358-openshift-default-b85cb6cfb

SuccessfulCreate

Created pod: e2e-ipp-b-750358-openshift-default-b85cb6cfb-lrsvd

openshift-ingress

multus

e2e-ipp-b-750358-openshift-default-b85cb6cfb-lrsvd

AddedInterface

Add eth0 [10.134.0.85/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-750358

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-750358-7595cf8555 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-750358-698f985cf4-lbgmn

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-750358-7595cf8555-2nnnh

Created

Created container: payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-750358

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-750358-698f985cf4 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-750358-698f985cf4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-750358-698f985cf4-lbgmn
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-750358-698f985cf4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-750358-698f985cf4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-750358: serviceaccount "payload-processing-e2e-ipp-b-750358" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-750358-7595cf8555

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-750358-7595cf8555-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-750358: serviceaccount "payload-processing-e2e-ipp-b-750358" not found

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-750358-698f985cf4-lbgmn

AddedInterface

Add eth0 [10.133.0.89/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-750358-698f985cf4-lbgmn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-750358-698f985cf4-lbgmn

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-750358-7595cf8555-2nnnh

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-750358-7595cf8555

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-750358-7595cf8555-2nnnh

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-750358-7595cf8555-2nnnh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-b-750358-7595cf8555-2nnnh

AddedInterface

Add eth0 [10.132.0.79/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-b-750358-openshift-default-b85cb6cfb-lrsvd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-750358-openshift-default-b85cb6cfb-lrsvd

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-750358-openshift-default-b85cb6cfb-lrsvd

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-b-750358-openshift-default-b85cb6cfb-lrsvd

ProbeError

Startup probe error: Get "http://10.134.0.85:15021/healthz/ready": dial tcp 10.134.0.85:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-b-750358-openshift-default-b85cb6cfb-lrsvd

Unhealthy

Startup probe failed: Get "http://10.134.0.85:15021/healthz/ready": dial tcp 10.134.0.85:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-891cc8-openshift-default-79f494c796

SuccessfulCreate

Created pod: e2e-ipp-cleanup-891cc8-openshift-default-79f494c796-xzbrk

openshift-ingress

multus

e2e-ipp-cleanup-891cc8-openshift-default-79f494c796-xzbrk

AddedInterface

Add eth0 [10.134.0.88/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ipp-cleanup-891cc8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-891cc8-openshift-default-79f494c796 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-891cc8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-891cc8

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-891cc8-d9bc7765f

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-891cc8-d9bc7765f-kk59m
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-891cc8-b5c5867db

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-891cc8-b5c5867db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-891cc8: serviceaccount "payload-processing-e2e-ipp-cleanup-891cc8" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-891cc8-b5c5867db

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-891cc8-b5c5867db-bnlk2

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-891cc8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-891cc8-b5c5867db from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-891cc8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-891cc8-d9bc7765f from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-891cc8-d9bc7765f

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-891cc8-d9bc7765f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-891cc8: serviceaccount "payload-processing-e2e-ipp-cleanup-891cc8" not found

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-891cc8-d9bc7765f-kk59m

AddedInterface

Add eth0 [10.132.0.83/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-891cc8-b5c5867db-bnlk2

AddedInterface

Add eth0 [10.133.0.91/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-891cc8-b5c5867db-bnlk2

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-891cc8-b5c5867db-bnlk2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-891cc8-d9bc7765f-kk59m

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-891cc8-d9bc7765f-kk59m

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-891cc8-d9bc7765f-kk59m

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-891cc8-b5c5867db-bnlk2

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-891cc8-openshift-default-79f494c796-xzbrk

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-891cc8-openshift-default-79f494c796-xzbrk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-891cc8-openshift-default-79f494c796-xzbrk

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-891cc8-openshift-default-79f494c796-xzbrk

ProbeError

Startup probe error: Get "http://10.134.0.88:15021/healthz/ready": dial tcp 10.134.0.88:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-891cc8-openshift-default-79f494c796-xzbrk

Unhealthy

Startup probe failed: Get "http://10.134.0.88:15021/healthz/ready": dial tcp 10.134.0.88:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-891cc8-b5c5867db-bnlk2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-891cc8-d9bc7765f-kk59m

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-891cc8-openshift-default-79f494c796-xzbrk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-269ba8-67dfcc44c8-x2b6m

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-a-269ba8

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-a-269ba8: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-a-269ba8": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-a-269ba8, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: b581c183-0a89-4697-813a-75374e64894e, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-269ba8-698c4bbcbf-76g29

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-269ba8-openshift-default-c855998c4-dpr78

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-750358-7595cf8555-2nnnh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-750358-698f985cf4-lbgmn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-750358-openshift-default-b85cb6cfb-lrsvd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-2fae12-dcbcf697d-c2qt5

Unhealthy

Readiness probe failed: dial tcp 10.132.0.66:9004: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-2fae12-6645c8484f-bzd8m

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-2fae12-6645c8484f-bzd8m

Unhealthy

Readiness probe failed: dial tcp 10.132.0.67:9004: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-2fae12-dcbcf697d-c2qt5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-327a3a-798b88466c-7tq4d

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-327a3a-758897fc94-6ndmj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w3-327a3a-openshift-default-5b79db7d64-ghqgq

Killing

Stopping container istio-proxy