Time Namespace Component RelatedObject Reason Message

openshift-ingress

e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q

Scheduled

Successfully assigned openshift-ingress/e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q to ip-10-0-142-242.ec2.internal

openshift-ingress

e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj

Scheduled

Successfully assigned openshift-ingress/e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj to ip-10-0-142-242.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-6745bb66bcbncx4

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcbncx4 to ip-10-0-136-121.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-5hvwt

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5hvwt to ip-10-0-136-121.ec2.internal

openshift-ingress

e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj to ip-10-0-142-242.ec2.internal

openshift-ingress

payload-processing-e2e-mt-0cfc70f5-5469dd7dc7-4v7vt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-0cfc70f5-5469dd7dc7-4v7vt to ip-10-0-136-121.ec2.internal

openshift-ingress

payload-processing-e2e-mt-9eca3408-5d5876c4d5-9tb4w

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-9eca3408-5d5876c4d5-9tb4w to ip-10-0-136-121.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-rzbx5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-rzbx5 to ip-10-0-139-121.ec2.internal

openshift-ingress

e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk to ip-10-0-142-242.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-8e62c2-7dc9c9d989-sq879

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-8e62c2-7dc9c9d989-sq879 to ip-10-0-136-121.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-6e7edcc4-cb497bc8b-q8hjp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-6e7edcc4-cb497bc8b-q8hjp to ip-10-0-136-121.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-lf8zq

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lf8zq to ip-10-0-142-242.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-b2dc0e67-98d9b9d4b-n9wjf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-b2dc0e67-98d9b9d4b-n9wjf to ip-10-0-136-121.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-033ca6-7cdcf6f6c8-crdlm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-033ca6-7cdcf6f6c8-crdlm to ip-10-0-136-121.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-61f73f-86c4868989-2rt7x

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-61f73f-86c4868989-2rt7x to ip-10-0-136-121.ec2.internal

openshift-ingress

e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj to ip-10-0-142-242.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-18b9d7-6bf785d4df-t57tj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-18b9d7-6bf785d4df-t57tj to ip-10-0-136-121.ec2.internal

openshift-ingress

kube-auth-proxy-5f75b6b767-xz9v9

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-5f75b6b767-xz9v9 to ip-10-0-139-121.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-f22962b3-5d4d5bc786-d82dg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-f22962b3-5d4d5bc786-d82dg to ip-10-0-142-242.ec2.internal

openshift-ingress

payload-processing-e2e-autores-64f698-7dd9b56b7-rt8wz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-64f698-7dd9b56b7-rt8wz to ip-10-0-136-121.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-49980f-85c77cf6cc-fpn7m

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-49980f-85c77cf6cc-fpn7m to ip-10-0-136-121.ec2.internal

openshift-ingress

e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx

Scheduled

Successfully assigned openshift-ingress/e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx to ip-10-0-142-242.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-ef5997-7cbccc4f9d-9c8fc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-ef5997-7cbccc4f9d-9c8fc to ip-10-0-136-121.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-61f73f-64cb7cc75d-s776g

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-61f73f-64cb7cc75d-s776g to ip-10-0-136-121.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-10ba6f-7dd6468598-x4wtl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-10ba6f-7dd6468598-x4wtl to ip-10-0-136-121.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-8e62c2-5459cb9c94-sn9vq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-8e62c2-5459cb9c94-sn9vq to ip-10-0-136-121.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-9eca3408-5598f7695d-kzbkn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-9eca3408-5598f7695d-kzbkn to ip-10-0-142-242.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-8a4fbb-86d587497-k5rt6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-8a4fbb-86d587497-k5rt6 to ip-10-0-136-121.ec2.internal

openshift-ingress

e2e-shared-b-w2-18b9d7-openshift-default-68d959d74-2bl5m

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-18b9d7-openshift-default-68d959d74-2bl5m to ip-10-0-136-121.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-5cee89-7c67799c5f-l2j77

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-5cee89-7c67799c5f-l2j77 to ip-10-0-142-242.ec2.internal

openshift-ingress

payload-processing-e2e-derive-7c4848b5-97495458f-796ft

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-7c4848b5-97495458f-796ft to ip-10-0-136-121.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-bf547a-6b845bc59c-dl889

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-bf547a-6b845bc59c-dl889 to ip-10-0-136-121.ec2.internal

openshift-ingress

e2e-ait-b2dc0e67-openshift-default-7c979d9dcd-jqh47

Scheduled

Successfully assigned openshift-ingress/e2e-ait-b2dc0e67-openshift-default-7c979d9dcd-jqh47 to ip-10-0-142-242.ec2.internal

openshift-ingress

e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577 to ip-10-0-142-242.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-033ca6-5dfc9cbb79-6q44j

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-033ca6-5dfc9cbb79-6q44j to ip-10-0-136-121.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-49980f-765dd7fd78-nhv22

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-49980f-765dd7fd78-nhv22 to ip-10-0-136-121.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-f19fd1-6647b85cfd-9vw6p

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-f19fd1-6647b85cfd-9vw6p to ip-10-0-136-121.ec2.internal

openshift-ingress

e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8 to ip-10-0-142-242.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-18b9d7-68887bbd94-27km5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-18b9d7-68887bbd94-27km5 to ip-10-0-136-121.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-ef5997-694bf45db7-rfvz8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-ef5997-694bf45db7-rfvz8 to ip-10-0-142-242.ec2.internal

openshift-ingress

e2e-worker-w4-f19fd1-openshift-default-74f6d7f46b-8tpgc

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-f19fd1-openshift-default-74f6d7f46b-8tpgc to ip-10-0-136-121.ec2.internal

openshift-ingress

e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8 to ip-10-0-142-242.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-10ba6f-d456458c-wfvzs

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-10ba6f-d456458c-wfvzs to ip-10-0-136-121.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-bfe85d-56c597df75-g7t59

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-bfe85d-56c597df75-g7t59 to ip-10-0-136-121.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-57b051-5944bdfcc9-dtkth

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-57b051-5944bdfcc9-dtkth to ip-10-0-136-121.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-5fbbcd-6f57f548d5-24wdf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-5fbbcd-6f57f548d5-24wdf to ip-10-0-136-121.ec2.internal

openshift-ingress

e2e-ipp-a-5fbbcd-openshift-default-75bc786786-9lmpl

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-5fbbcd-openshift-default-75bc786786-9lmpl to ip-10-0-136-121.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-64f698-d8ff9b97d-b28nx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-64f698-d8ff9b97d-b28nx to ip-10-0-136-121.ec2.internal

openshift-ingress

e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99

Scheduled

Successfully assigned openshift-ingress/e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99 to ip-10-0-142-242.ec2.internal

openshift-ingress

kube-auth-proxy-5f75b6b767-wrxh6

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-5f75b6b767-wrxh6 to ip-10-0-136-121.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-7c4848b5-65d8f5576b-mflww

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-7c4848b5-65d8f5576b-mflww to ip-10-0-136-121.ec2.internal

openshift-ingress

e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62 to ip-10-0-142-242.ec2.internal

openshift-ingress

e2e-api-b-49980f-openshift-default-7d59f74494-tb97t

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-49980f-openshift-default-7d59f74494-tb97t to ip-10-0-142-242.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-8a4fbb-6dc57499d-pzrgf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-8a4fbb-6dc57499d-pzrgf to ip-10-0-136-121.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-5cee89-57b4795f7d-xkczp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-5cee89-57b4795f7d-xkczp to ip-10-0-136-121.ec2.internal

openshift-ingress

router-default-764c597d88-hvw2x

Scheduled

Successfully assigned openshift-ingress/router-default-764c597d88-hvw2x to ip-10-0-142-242.ec2.internal

openshift-ingress

e2e-inf-a-5cee89-openshift-default-999db547b-mdnc7

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-5cee89-openshift-default-999db547b-mdnc7 to ip-10-0-136-121.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-bf547a-5fccd5fb54-vw4rd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-bf547a-5fccd5fb54-vw4rd to ip-10-0-142-242.ec2.internal

openshift-ingress

e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht to ip-10-0-142-242.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-5fbbcd-7b54c6f898-6fjqg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-5fbbcd-7b54c6f898-6fjqg to ip-10-0-136-121.ec2.internal

openshift-ingress

payload-processing-e2e-ait-b2dc0e67-6c87687fd9-jz25g

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-b2dc0e67-6c87687fd9-jz25g to ip-10-0-142-242.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-57b051-776d95fb58-8s5zp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-57b051-776d95fb58-8s5zp to ip-10-0-136-121.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-47vv5

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-47vv5 to ip-10-0-136-121.ec2.internal

openshift-ingress

payload-processing-e2e-ait-6e7edcc4-7c56f5bd49-bshmm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-6e7edcc4-7c56f5bd49-bshmm to ip-10-0-136-121.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w4-f19fd1-5c9c988f49-5fjvb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-f19fd1-5c9c988f49-5fjvb to ip-10-0-136-121.ec2.internal

openshift-ingress

e2e-explicit-8a4fbb-openshift-default-7449d76d7b-vw4wj

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-8a4fbb-openshift-default-7449d76d7b-vw4wj to ip-10-0-136-121.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-bfe85d-d875b66c8-6hksm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-bfe85d-d875b66c8-6hksm to ip-10-0-136-121.ec2.internal

openshift-ingress

e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb

Scheduled

Successfully assigned openshift-ingress/e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb to ip-10-0-142-242.ec2.internal

openshift-ingress

e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7 to ip-10-0-142-242.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-0cfc70f5-7cb7f8f598-zjm2d

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-0cfc70f5-7cb7f8f598-zjm2d to ip-10-0-136-121.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-f22962b3-6b5f4c6d78-hdlk8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-f22962b3-6b5f4c6d78-hdlk8 to ip-10-0-136-121.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-plxcj

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-plxcj to ip-10-0-136-121.ec2.internal

openshift-ingress

e2e-noten-bafa8a-openshift-default-6df8445d78-mfh8z

Scheduled

Successfully assigned openshift-ingress/e2e-noten-bafa8a-openshift-default-6df8445d78-mfh8z to ip-10-0-142-242.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-b6prj

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-b6prj to ip-10-0-136-121.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-764c597d88 from 0 to 1
(x11)

openshift-ingress

replicaset-controller

router-default-764c597d88

FailedCreate

Error creating: pods "router-default-764c597d88-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x16)

openshift-ingress

replicaset-controller

router-default-764c597d88

FailedCreate

Error creating: pods "router-default-764c597d88-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-764c597d88

SuccessfulCreate

Created pod: router-default-764c597d88-hvw2x
(x6)

openshift-ingress

kubelet

router-default-764c597d88-hvw2x

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x6)

openshift-ingress

kubelet

router-default-764c597d88-hvw2x

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

kubelet

router-default-764c597d88-hvw2x

Started

Started container router

openshift-ingress

kubelet

router-default-764c597d88-hvw2x

Created

Created container: router

openshift-ingress

kubelet

router-default-764c597d88-hvw2x

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:48526e08a2a06d05806dbcf3ddb069e5182371667d9e9f7d2cf09f60cd247d20" already present on machine

openshift-ingress

multus

router-default-764c597d88-hvw2x

AddedInterface

Add eth0 [10.133.0.10/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-5f75b6b767-xz9v9

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"
(x4)

openshift-ingress

replicaset-controller

kube-auth-proxy-5f75b6b767

FailedCreate

Error creating: pods "kube-auth-proxy-5f75b6b767-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-5f75b6b767

SuccessfulCreate

Created pod: kube-auth-proxy-5f75b6b767-wrxh6

openshift-ingress

multus

kube-auth-proxy-5f75b6b767-xz9v9

AddedInterface

Add eth0 [10.134.0.27/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

kube-auth-proxy-5f75b6b767

SuccessfulCreate

Created pod: kube-auth-proxy-5f75b6b767-xz9v9

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-5f75b6b767 from 0 to 2

openshift-ingress

multus

kube-auth-proxy-5f75b6b767-wrxh6

AddedInterface

Add eth0 [10.132.0.15/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-b6prj

openshift-ingress

kubelet

kube-auth-proxy-5f75b6b767-wrxh6

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-b6prj

AddedInterface

Add eth0 [10.132.0.16/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-5f75b6b767-xz9v9

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-5f75b6b767-wrxh6

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.463s (2.463s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-5f75b6b767-xz9v9

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.785s (2.785s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-b6prj

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

kube-auth-proxy-5f75b6b767-xz9v9

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-5f75b6b767-wrxh6

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-5f75b6b767-wrxh6

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-b6prj

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-b6prj

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-b6prj

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.647s (2.647s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcbncx4

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-lf8zq

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-lf8zq

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-lf8zq

AddedInterface

Add eth0 [10.133.0.35/23] from ovn-kubernetes

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-6745bb66bcbncx4

AddedInterface

Add eth0 [10.132.0.17/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-6745bb66bc

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-6745bb66bcbncx4

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-6745bb66bc from 0 to 1

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcbncx4

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcbncx4

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcbncx4

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.235s (2.235s including waiting). Image size: 181318953 bytes.

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-47vv5

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-47vv5

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-47vv5

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-47vv5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" already present on machine

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-47vv5

AddedInterface

Add eth0 [10.132.0.18/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-b6prj

Killing

Stopping container discovery

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-lf8zq

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-lf8zq

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-lf8zq

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 11.117s (11.117s including waiting). Image size: 181318953 bytes.

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-b6prj
(x10)

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcbncx4

ProbeError

Startup probe error: Get "http://10.132.0.17:15021/healthz/ready": dial tcp 10.132.0.17:15021: connect: connection refused body:
(x10)

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcbncx4

Unhealthy

Startup probe failed: Get "http://10.132.0.17:15021/healthz/ready": dial tcp 10.132.0.17:15021: connect: connection refused

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled down replica set data-science-gateway-data-science-gateway-class-6745bb66bc from 1 to 0

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-6745bb66bc

SuccessfulDelete

Deleted pod: data-science-gateway-data-science-gateway-class-6745bb66bcbncx4

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcbncx4

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-5hvwt

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-5hvwt

AddedInterface

Add eth0 [10.132.0.26/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-rzbx5

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-plxcj
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-plxcj

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-rzbx5

AddedInterface

Add eth0 [10.134.0.34/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-5b54b7fbb7-plxcj

AddedInterface

Add eth0 [10.132.0.28/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-rzbx5

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-plxcj

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.578s (1.578s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-plxcj

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-plxcj

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-rzbx5

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-rzbx5

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-rzbx5

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.496s (2.496s including waiting). Image size: 166449312 bytes.
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-5hvwt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-5hvwt

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-5hvwt

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-5hvwt

Unhealthy

Startup probe failed: Get "http://10.132.0.26:15021/healthz/ready": dial tcp 10.132.0.26:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-5hvwt

ProbeError

Startup probe error: Get "http://10.132.0.26:15021/healthz/ready": dial tcp 10.132.0.26:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-inf-a-5cee89

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-5cee89

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-10ba6f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-10ba6f

openshift-ingress

deployment-controller

e2e-worker-w0-10ba6f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-10ba6f-openshift-default-64985994d from 0 to 1

openshift-ingress

deployment-controller

e2e-worker-w4-f19fd1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-f19fd1-openshift-default-74f6d7f46b from 0 to 1

openshift-ingress

deployment-controller

e2e-inf-a-5cee89-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-5cee89-openshift-default-999db547b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-f19fd1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-f19fd1

openshift-ingress

replicaset-controller

e2e-worker-w4-f19fd1-openshift-default-74f6d7f46b

SuccessfulCreate

Created pod: e2e-worker-w4-f19fd1-openshift-default-74f6d7f46b-8tpgc

openshift-ingress

replicaset-controller

e2e-worker-w0-10ba6f-openshift-default-64985994d

SuccessfulCreate

Created pod: e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577

openshift-ingress

replicaset-controller

e2e-inf-a-5cee89-openshift-default-999db547b

SuccessfulCreate

Created pod: e2e-inf-a-5cee89-openshift-default-999db547b-mdnc7

openshift-ingress

multus

e2e-inf-a-5cee89-openshift-default-999db547b-mdnc7

AddedInterface

Add eth0 [10.132.0.31/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w4-f19fd1-openshift-default-74f6d7f46b-8tpgc

AddedInterface

Add eth0 [10.132.0.32/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-f19fd1-5c9c988f49

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-f19fd1-5c9c988f49-5fjvb

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-f19fd1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-f19fd1-5c9c988f49 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-f19fd1-6647b85cfd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-f19fd1-6647b85cfd-9vw6p

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-f19fd1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-f19fd1-6647b85cfd from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-f19fd1-6647b85cfd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-f19fd1-6647b85cfd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-f19fd1: serviceaccount "payload-processing-e2e-worker-w4-f19fd1" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-f19fd1-5c9c988f49

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-f19fd1-5c9c988f49-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-f19fd1: serviceaccount "payload-processing-e2e-worker-w4-f19fd1" not found

openshift-ingress

multus

payload-processing-e2e-worker-w4-f19fd1-5c9c988f49-5fjvb

AddedInterface

Add eth0 [10.132.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-f19fd1-6647b85cfd-9vw6p

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-f19fd1-6647b85cfd-9vw6p

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-f19fd1-6647b85cfd-9vw6p

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-f19fd1-5c9c988f49-5fjvb

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-f19fd1-5c9c988f49-5fjvb

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-f19fd1-5c9c988f49-5fjvb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-f19fd1-6647b85cfd-9vw6p

AddedInterface

Add eth0 [10.132.0.33/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-5cee89-57b4795f7d-xkczp

AddedInterface

Add eth0 [10.132.0.35/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-5cee89-7c67799c5f

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-5cee89-7c67799c5f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-5cee89: serviceaccount "payload-processing-e2e-inf-a-5cee89" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-5cee89-57b4795f7d-xkczp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-5cee89-57b4795f7d-xkczp

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-5cee89-57b4795f7d-xkczp

Started

Started container payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-5cee89-57b4795f7d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-5cee89-57b4795f7d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-5cee89: serviceaccount "payload-processing-e2e-inf-a-5cee89" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-5cee89-57b4795f7d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-5cee89-57b4795f7d-xkczp

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-5cee89

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-5cee89-57b4795f7d from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-a-5cee89-7c67799c5f-l2j77

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-e2e-inf-a-5cee89-7c67799c5f-l2j77

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-5cee89-7c67799c5f

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-5cee89-7c67799c5f-l2j77

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-5cee89

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-5cee89-7c67799c5f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-10ba6f-d456458c

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-10ba6f-d456458c-wfvzs

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-10ba6f-d456458c-wfvzs

Created

Created container: payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-10ba6f-7dd6468598

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-10ba6f-7dd6468598-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-10ba6f: serviceaccount "payload-processing-e2e-worker-w0-10ba6f" not found

openshift-ingress

gateway_labeler_controller

e2e-autores-64f698

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-64f698

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-10ba6f-7dd6468598-x4wtl

AddedInterface

Add eth0 [10.132.0.37/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-10ba6f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-10ba6f-7dd6468598 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-10ba6f-7dd6468598-x4wtl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-10ba6f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-10ba6f-d456458c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-10ba6f-7dd6468598

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-10ba6f-7dd6468598-x4wtl

openshift-ingress

multus

payload-processing-e2e-worker-w0-10ba6f-d456458c-wfvzs

AddedInterface

Add eth0 [10.132.0.36/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-10ba6f-d456458c-wfvzs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-10ba6f-d456458c

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-10ba6f-d456458c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-10ba6f: serviceaccount "payload-processing-e2e-worker-w0-10ba6f" not found

openshift-ingress

kubelet

payload-processing-e2e-inf-a-5cee89-7c67799c5f-l2j77

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-5cee89-7c67799c5f-l2j77

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-10ba6f-7dd6468598-x4wtl

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-5cee89-7c67799c5f-l2j77

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.407s (1.407s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-10ba6f-7dd6468598-x4wtl

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

e2e-autores-64f698-openshift-default-69c89b5ccb

SuccessfulCreate

Created pod: e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-10ba6f-d456458c-wfvzs

Started

Started container payload-processing

openshift-ingress

multus

e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-autores-64f698-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-64f698-openshift-default-69c89b5ccb from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-b2dc0e67-openshift-default-7c979d9dcd

SuccessfulCreate

Created pod: e2e-ait-b2dc0e67-openshift-default-7c979d9dcd-jqh47

openshift-ingress

gateway_labeler_controller

e2e-ait-b2dc0e67

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-b2dc0e67

openshift-ingress

deployment-controller

e2e-ait-b2dc0e67-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-b2dc0e67-openshift-default-7c979d9dcd from 0 to 1

openshift-ingress

multus

e2e-ait-b2dc0e67-openshift-default-7c979d9dcd-jqh47

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-autores-64f698

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-64f698-7dd9b56b7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-64f698-7dd9b56b7

SuccessfulCreate

Created pod: payload-processing-e2e-autores-64f698-7dd9b56b7-rt8wz

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-64f698-d8ff9b97d-b28nx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-autores-64f698-d8ff9b97d-b28nx

AddedInterface

Add eth0 [10.132.0.38/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-64f698-d8ff9b97d-b28nx

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-64f698-d8ff9b97d-b28nx

Started

Started container payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-64f698-d8ff9b97d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-64f698-d8ff9b97d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-64f698: serviceaccount "payload-processing-e2e-autores-64f698" not found

openshift-ingress

multus

payload-processing-e2e-autores-64f698-7dd9b56b7-rt8wz

AddedInterface

Add eth0 [10.132.0.39/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-64f698-d8ff9b97d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-64f698-d8ff9b97d-b28nx
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-64f698-7dd9b56b7

FailedCreate

Error creating: pods "payload-processing-e2e-autores-64f698-7dd9b56b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-64f698: serviceaccount "payload-processing-e2e-autores-64f698" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-64f698

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-64f698-d8ff9b97d from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-b2dc0e67-6c87687fd9

FailedCreate

Error creating: pods "payload-processing-e2e-ait-b2dc0e67-6c87687fd9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-b2dc0e67: serviceaccount "payload-processing-e2e-ait-b2dc0e67" not found

openshift-ingress

gateway_labeler_controller

e2e-inf-b-bf547a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-bf547a
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-b2dc0e67-98d9b9d4b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-b2dc0e67-98d9b9d4b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-b2dc0e67: serviceaccount "payload-processing-e2e-ait-b2dc0e67" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-b2dc0e67-98d9b9d4b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-b2dc0e67-98d9b9d4b-n9wjf

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-b2dc0e67

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-b2dc0e67-98d9b9d4b from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-autores-64f698-7dd9b56b7-rt8wz

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-64f698-7dd9b56b7-rt8wz

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-64f698-7dd9b56b7-rt8wz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-ait-b2dc0e67

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-b2dc0e67-6c87687fd9 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-b2dc0e67-6c87687fd9

SuccessfulCreate

Created pod: payload-processing-e2e-ait-b2dc0e67-6c87687fd9-jz25g

openshift-ingress

multus

payload-processing-e2e-ait-b2dc0e67-6c87687fd9-jz25g

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-b2dc0e67-6c87687fd9-jz25g

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-b2dc0e67-98d9b9d4b-n9wjf

AddedInterface

Add eth0 [10.132.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-b2dc0e67-98d9b9d4b-n9wjf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-b2dc0e67-98d9b9d4b-n9wjf

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-b2dc0e67-98d9b9d4b-n9wjf

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-inf-b-bf547a-openshift-default-6885c86f5d

SuccessfulCreate

Created pod: e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62

openshift-ingress

kubelet

payload-processing-e2e-ait-b2dc0e67-6c87687fd9-jz25g

Started

Started container payload-processing

openshift-ingress

deployment-controller

e2e-inf-b-bf547a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-bf547a-openshift-default-6885c86f5d from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-b2dc0e67-6c87687fd9-jz25g

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-worker-w4-f19fd1-openshift-default-74f6d7f46b-8tpgc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-5cee89-openshift-default-999db547b-mdnc7

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-f19fd1-openshift-default-74f6d7f46b-8tpgc

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-f19fd1-openshift-default-74f6d7f46b-8tpgc

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-5cee89-openshift-default-999db547b-mdnc7

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-5cee89-openshift-default-999db547b-mdnc7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577

Started

Started container istio-proxy
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-bf547a-6b845bc59c

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-bf547a-6b845bc59c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-bf547a: serviceaccount "payload-processing-e2e-inf-b-bf547a" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-bf547a-5fccd5fb54

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-bf547a-5fccd5fb54-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-bf547a: serviceaccount "payload-processing-e2e-inf-b-bf547a" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-bf547a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-bf547a-6b845bc59c from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-bf547a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-bf547a-5fccd5fb54 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-bf547a-6b845bc59c

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-bf547a-6b845bc59c-dl889

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-bf547a-5fccd5fb54

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-bf547a-5fccd5fb54-vw4rd

openshift-ingress

kubelet

payload-processing-e2e-inf-b-bf547a-6b845bc59c-dl889

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-bf547a-5fccd5fb54-vw4rd

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-inf-b-bf547a-6b845bc59c-dl889

AddedInterface

Add eth0 [10.132.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-bf547a-6b845bc59c-dl889

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-b-bf547a-6b845bc59c-dl889

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-bf547a-5fccd5fb54-vw4rd

AddedInterface

Add eth0 [10.133.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-bf547a-5fccd5fb54-vw4rd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-bf547a-5fccd5fb54-vw4rd

Started

Started container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-inf-a-5cee89-openshift-default-999db547b-mdnc7

ProbeError

Startup probe error: Get "http://10.132.0.31:15021/healthz/ready": dial tcp 10.132.0.31:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-a-5cee89-openshift-default-999db547b-mdnc7

Unhealthy

Startup probe failed: Get "http://10.132.0.31:15021/healthz/ready": dial tcp 10.132.0.31:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-f19fd1-openshift-default-74f6d7f46b-8tpgc

Unhealthy

Startup probe failed: Get "http://10.132.0.32:15021/healthz/ready": dial tcp 10.132.0.32:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-f19fd1-openshift-default-74f6d7f46b-8tpgc

ProbeError

Startup probe error: Get "http://10.132.0.32:15021/healthz/ready": dial tcp 10.132.0.32:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577

Unhealthy

Startup probe failed: Get "http://10.133.0.55:15021/healthz/ready": dial tcp 10.133.0.55:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577

ProbeError

Startup probe error: Get "http://10.133.0.55:15021/healthz/ready": dial tcp 10.133.0.55:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-b2dc0e67-openshift-default-7c979d9dcd-jqh47

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb

Created

Created container: istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ait-b2dc0e67-6c87687fd9-jz25g

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-ait-b2dc0e67-openshift-default-7c979d9dcd-jqh47

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-b2dc0e67-openshift-default-7c979d9dcd-jqh47

Created

Created container: istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-b2dc0e67-98d9b9d4b-n9wjf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-b2dc0e67-openshift-default-7c979d9dcd-jqh47

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-migrate-f22962b3-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-f22962b3-gw

openshift-ingress

deployment-controller

e2e-migrate-f22962b3-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8 from 0 to 1

openshift-ingress

replicaset-controller

e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8

SuccessfulCreate

Created pod: e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj

openshift-ingress

multus

e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb

Unhealthy

Startup probe failed: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb

ProbeError

Startup probe error: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62

Started

Started container istio-proxy
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-f22962b3-5d4d5bc786

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-f22962b3-5d4d5bc786-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-f22962b3: serviceaccount "payload-processing-e2e-migrate-f22962b3" not found

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-f22962b3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-f22962b3-5d4d5bc786 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-f22962b3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-f22962b3-6b5f4c6d78 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-migrate-f22962b3-5d4d5bc786-d82dg

AddedInterface

Add eth0 [10.133.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-f22962b3-5d4d5bc786-d82dg

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-f22962b3-5d4d5bc786-d82dg

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-f22962b3-6b5f4c6d78-hdlk8

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-f22962b3-5d4d5bc786-d82dg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-f22962b3-6b5f4c6d78

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-f22962b3-6b5f4c6d78-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-f22962b3: serviceaccount "payload-processing-e2e-migrate-f22962b3" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-f22962b3-6b5f4c6d78

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-f22962b3-6b5f4c6d78-hdlk8

openshift-ingress

multus

payload-pre-processing-e2e-migrate-f22962b3-6b5f4c6d78-hdlk8

AddedInterface

Add eth0 [10.132.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-f22962b3-6b5f4c6d78-hdlk8

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-f22962b3-5d4d5bc786

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-f22962b3-5d4d5bc786-d82dg

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-f22962b3-6b5f4c6d78-hdlk8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x6)

openshift-ingress

kubelet

e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62

Unhealthy

Startup probe failed: Get "http://10.133.0.60:15021/healthz/ready": dial tcp 10.133.0.60:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62

ProbeError

Startup probe error: Get "http://10.133.0.60:15021/healthz/ready": dial tcp 10.133.0.60:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj

ProbeError

Startup probe error: Get "http://10.133.0.63:15021/healthz/ready": dial tcp 10.133.0.63:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj

Unhealthy

Startup probe failed: Get "http://10.133.0.63:15021/healthz/ready": dial tcp 10.133.0.63:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-migrate-f22962b3-5d4d5bc786-d82dg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-f22962b3-6b5f4c6d78-hdlk8

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-ait-6e7edcc4-openshift-default-7db989958b

SuccessfulCreate

Created pod: e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx

openshift-ingress

gateway_labeler_controller

e2e-ait-6e7edcc4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-6e7edcc4

openshift-ingress

deployment-controller

e2e-ait-6e7edcc4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-6e7edcc4-openshift-default-7db989958b from 0 to 1

openshift-ingress

kubelet

e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

multus

e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx

AddedInterface

Add eth0 [10.133.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-6e7edcc4-7c56f5bd49

FailedCreate

Error creating: pods "payload-processing-e2e-ait-6e7edcc4-7c56f5bd49-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-6e7edcc4: serviceaccount "payload-processing-e2e-ait-6e7edcc4" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-6e7edcc4-cb497bc8b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-6e7edcc4-cb497bc8b-q8hjp

openshift-ingress

kubelet

payload-processing-e2e-ait-6e7edcc4-7c56f5bd49-bshmm

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-6e7edcc4-7c56f5bd49-bshmm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-6e7edcc4-7c56f5bd49-bshmm

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-6e7edcc4-cb497bc8b-q8hjp

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-6e7edcc4-cb497bc8b-q8hjp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-6e7edcc4-cb497bc8b-q8hjp

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-6e7edcc4-cb497bc8b-q8hjp

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-6e7edcc4-7c56f5bd49

SuccessfulCreate

Created pod: payload-processing-e2e-ait-6e7edcc4-7c56f5bd49-bshmm
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-6e7edcc4-cb497bc8b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-6e7edcc4-cb497bc8b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-6e7edcc4: serviceaccount "payload-processing-e2e-ait-6e7edcc4" not found

openshift-ingress

multus

payload-processing-e2e-ait-6e7edcc4-7c56f5bd49-bshmm

AddedInterface

Add eth0 [10.132.0.44/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-6e7edcc4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-6e7edcc4-cb497bc8b from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ait-6e7edcc4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-6e7edcc4-7c56f5bd49 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx

ProbeError

Startup probe error: Get "http://10.133.0.67:15021/healthz/ready": dial tcp 10.133.0.67:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx

Unhealthy

Startup probe failed: Get "http://10.133.0.67:15021/healthz/ready": dial tcp 10.133.0.67:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-6e7edcc4-cb497bc8b-q8hjp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-6e7edcc4-7c56f5bd49-bshmm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-derive-7c4848b5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-7c4848b5

openshift-ingress

replicaset-controller

e2e-derive-7c4848b5-openshift-default-58fcf8db64

SuccessfulCreate

Created pod: e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q

openshift-ingress

multus

e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q

AddedInterface

Add eth0 [10.133.0.69/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-derive-7c4848b5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-7c4848b5-openshift-default-58fcf8db64 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-7c4848b5-65d8f5576b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-7c4848b5-65d8f5576b-mflww

openshift-ingress

deployment-controller

payload-processing-e2e-derive-7c4848b5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-7c4848b5-97495458f from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-7c4848b5-65d8f5576b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-7c4848b5-65d8f5576b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-7c4848b5: serviceaccount "payload-processing-e2e-derive-7c4848b5" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-7c4848b5-97495458f

FailedCreate

Error creating: pods "payload-processing-e2e-derive-7c4848b5-97495458f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-7c4848b5: serviceaccount "payload-processing-e2e-derive-7c4848b5" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-7c4848b5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-7c4848b5-65d8f5576b from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-7c4848b5-97495458f

SuccessfulCreate

Created pod: payload-processing-e2e-derive-7c4848b5-97495458f-796ft

openshift-ingress

multus

payload-pre-processing-e2e-derive-7c4848b5-65d8f5576b-mflww

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-7c4848b5-65d8f5576b-mflww

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-derive-7c4848b5-97495458f-796ft

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-7c4848b5-65d8f5576b-mflww

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-7c4848b5-65d8f5576b-mflww

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-7c4848b5-97495458f-796ft

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-derive-7c4848b5-97495458f-796ft

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-7c4848b5-97495458f-796ft

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q

Unhealthy

Startup probe failed: Get "http://10.133.0.69:15021/healthz/ready": dial tcp 10.133.0.69:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q

ProbeError

Startup probe error: Get "http://10.133.0.69:15021/healthz/ready": dial tcp 10.133.0.69:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-derive-7c4848b5-97495458f-796ft

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-7c4848b5-65d8f5576b-mflww

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-64f698-d8ff9b97d-b28nx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-64f698-7dd9b56b7-rt8wz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-explicit-8a4fbb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-8a4fbb-openshift-default-7449d76d7b from 0 to 1

openshift-ingress

replicaset-controller

e2e-explicit-8a4fbb-openshift-default-7449d76d7b

SuccessfulCreate

Created pod: e2e-explicit-8a4fbb-openshift-default-7449d76d7b-vw4wj

openshift-ingress

gateway_labeler_controller

e2e-explicit-8a4fbb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-8a4fbb

openshift-ingress

multus

e2e-explicit-8a4fbb-openshift-default-7449d76d7b-vw4wj

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-8a4fbb-6dc57499d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-8a4fbb-6dc57499d-pzrgf
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-8a4fbb-6dc57499d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-8a4fbb-6dc57499d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-8a4fbb: serviceaccount "payload-processing-e2e-explicit-8a4fbb" not found

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-8a4fbb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-8a4fbb-86d587497 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-8a4fbb-86d587497

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-8a4fbb-86d587497-k5rt6
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-8a4fbb-86d587497

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-8a4fbb-86d587497-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-8a4fbb: serviceaccount "payload-processing-e2e-explicit-8a4fbb" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-8a4fbb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-8a4fbb-6dc57499d from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-explicit-8a4fbb-86d587497-k5rt6

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-8a4fbb-6dc57499d-pzrgf

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-8a4fbb-6dc57499d-pzrgf

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-8a4fbb-6dc57499d-pzrgf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-explicit-8a4fbb-86d587497-k5rt6

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-explicit-8a4fbb-6dc57499d-pzrgf

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-explicit-8a4fbb-86d587497-k5rt6

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-8a4fbb-86d587497-k5rt6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-8a4fbb-openshift-default-7449d76d7b-vw4wj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-8a4fbb-openshift-default-7449d76d7b-vw4wj

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-8a4fbb-openshift-default-7449d76d7b-vw4wj

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-explicit-8a4fbb-openshift-default-7449d76d7b-vw4wj

Unhealthy

Startup probe failed: Get "http://10.132.0.48:15021/healthz/ready": dial tcp 10.132.0.48:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-explicit-8a4fbb-openshift-default-7449d76d7b-vw4wj

ProbeError

Startup probe error: Get "http://10.132.0.48:15021/healthz/ready": dial tcp 10.132.0.48:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-mt-9eca3408

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-9eca3408

openshift-ingress

replicaset-controller

e2e-mt-9eca3408-openshift-default-7d66cfb4b4

SuccessfulCreate

Created pod: e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99

openshift-ingress

deployment-controller

e2e-mt-9eca3408-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-9eca3408-openshift-default-7d66cfb4b4 from 0 to 1

openshift-ingress

multus

e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99

AddedInterface

Add eth0 [10.133.0.76/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-mt-9eca3408

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-9eca3408-5d5876c4d5 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-9eca3408-5d5876c4d5

FailedCreate

Error creating: pods "payload-processing-e2e-mt-9eca3408-5d5876c4d5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-9eca3408: serviceaccount "payload-processing-e2e-mt-9eca3408" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-9eca3408-5598f7695d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-9eca3408-5598f7695d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-9eca3408: serviceaccount "payload-processing-e2e-mt-9eca3408" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-9eca3408

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-9eca3408-5598f7695d from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-9eca3408-5598f7695d-kzbkn

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-9eca3408-5598f7695d-kzbkn

AddedInterface

Add eth0 [10.133.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-9eca3408-5598f7695d-kzbkn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-9eca3408-5d5876c4d5

SuccessfulCreate

Created pod: payload-processing-e2e-mt-9eca3408-5d5876c4d5-9tb4w

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-9eca3408-5598f7695d-kzbkn

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-9eca3408-5598f7695d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-9eca3408-5598f7695d-kzbkn

openshift-ingress

kubelet

payload-processing-e2e-mt-9eca3408-5d5876c4d5-9tb4w

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-9eca3408-5d5876c4d5-9tb4w

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-9eca3408-5d5876c4d5-9tb4w

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-9eca3408-5d5876c4d5-9tb4w

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99

ProbeError

Readiness probe error: Get "http://10.133.0.76:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99

Unhealthy

Readiness probe failed: Get "http://10.133.0.76:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99

Unhealthy

Startup probe failed: Get "http://10.133.0.76:15021/healthz/ready": dial tcp 10.133.0.76:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99

ProbeError

Startup probe error: Get "http://10.133.0.76:15021/healthz/ready": dial tcp 10.133.0.76:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-mt-9eca3408-5d5876c4d5-9tb4w

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-mt-9eca3408

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-mt-9eca3408: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-mt-9eca3408": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-mt-9eca3408, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 19280188-e181-4bb3-9cd9-f41da80ffe24, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-9eca3408-5598f7695d-kzbkn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-a-w2-8e62c2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-8e62c2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-8e62c2

openshift-ingress

replicaset-controller

e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54

SuccessfulCreate

Created pod: e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7

openshift-ingress

multus

e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7

AddedInterface

Add eth0 [10.133.0.82/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-8a4fbb-6dc57499d-pzrgf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-8a4fbb-86d587497-k5rt6

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-8e62c2-7dc9c9d989

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-8e62c2-7dc9c9d989-sq879

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-8e62c2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-8e62c2-7dc9c9d989 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-8e62c2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-8e62c2-5459cb9c94 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-8e62c2-5459cb9c94

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-8e62c2-5459cb9c94-sn9vq
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-8e62c2-5459cb9c94

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-8e62c2-5459cb9c94-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-8e62c2: serviceaccount "payload-processing-e2e-shared-a-w2-8e62c2" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-8e62c2-7dc9c9d989

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-8e62c2-7dc9c9d989-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-8e62c2: serviceaccount "payload-processing-e2e-shared-a-w2-8e62c2" not found

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-8e62c2-5459cb9c94-sn9vq

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-8e62c2-7dc9c9d989-sq879

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-8e62c2-5459cb9c94-sn9vq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-8e62c2-5459cb9c94-sn9vq

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-8e62c2-5459cb9c94-sn9vq

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-8e62c2-7dc9c9d989-sq879

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-8e62c2-7dc9c9d989-sq879

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-8e62c2-7dc9c9d989-sq879

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-explicit-8a4fbb-openshift-default-7449d76d7b-vw4wj

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-noten-bafa8a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-bafa8a-openshift-default-6df8445d78 from 0 to 1

openshift-ingress

replicaset-controller

e2e-noten-bafa8a-openshift-default-6df8445d78

SuccessfulCreate

Created pod: e2e-noten-bafa8a-openshift-default-6df8445d78-mfh8z

openshift-ingress

multus

e2e-noten-bafa8a-openshift-default-6df8445d78-mfh8z

AddedInterface

Add eth0 [10.133.0.83/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-noten-bafa8a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-bafa8a

openshift-ingress

kubelet

e2e-noten-bafa8a-openshift-default-6df8445d78-mfh8z

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-noten-bafa8a-openshift-default-6df8445d78-mfh8z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-noten-bafa8a-openshift-default-6df8445d78-mfh8z

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7

ProbeError

Readiness probe error: Get "http://10.133.0.82:15021/healthz/ready": read tcp 10.133.0.2:36504->10.133.0.82:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7

Unhealthy

Readiness probe failed: Get "http://10.133.0.82:15021/healthz/ready": read tcp 10.133.0.2:36504->10.133.0.82:15021: read: connection reset by peer

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-18b9d7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-18b9d7
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7

Started

Started container istio-proxy

openshift-ingress

multus

e2e-shared-b-w2-18b9d7-openshift-default-68d959d74-2bl5m

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-b-w2-18b9d7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-18b9d7-openshift-default-68d959d74 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

replicaset-controller

e2e-shared-b-w2-18b9d7-openshift-default-68d959d74

SuccessfulCreate

Created pod: e2e-shared-b-w2-18b9d7-openshift-default-68d959d74-2bl5m

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-5cee89-57b4795f7d-xkczp

Killing

Stopping container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7

ProbeError

Startup probe error: Get "http://10.133.0.82:15021/healthz/ready": dial tcp 10.133.0.82:15021: connect: connection refused body:

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-inf-a-5cee89

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-inf-a-5cee89: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-inf-a-5cee89": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-inf-a-5cee89, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 71b11cce-e588-4a49-89dc-0c6369177af7, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-inf-a-5cee89-7c67799c5f-l2j77

Killing

Stopping container payload-processing
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7

Unhealthy

Startup probe failed: Get "http://10.133.0.82:15021/healthz/ready": dial tcp 10.133.0.82:15021: connect: connection refused
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-18b9d7-68887bbd94

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-18b9d7-68887bbd94-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-18b9d7: serviceaccount "payload-processing-e2e-shared-b-w2-18b9d7" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-18b9d7-68887bbd94

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-18b9d7-68887bbd94-27km5

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-18b9d7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-18b9d7-68887bbd94 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-18b9d7-6bf785d4df

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-18b9d7-6bf785d4df-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-18b9d7: serviceaccount "payload-processing-e2e-shared-b-w2-18b9d7" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-18b9d7-6bf785d4df

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-18b9d7-6bf785d4df-t57tj

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-18b9d7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-18b9d7-6bf785d4df from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-18b9d7-6bf785d4df-t57tj

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-18b9d7-6bf785d4df-t57tj

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-18b9d7-6bf785d4df-t57tj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-18b9d7-6bf785d4df-t57tj

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-18b9d7-68887bbd94-27km5

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-18b9d7-68887bbd94-27km5

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-18b9d7-68887bbd94-27km5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-18b9d7-68887bbd94-27km5

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-5cee89-openshift-default-999db547b-mdnc7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-bf547a-5fccd5fb54-vw4rd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-bf547a-6b845bc59c-dl889

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

e2e-mt-0cfc70f5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-0cfc70f5-openshift-default-5547b5fb6d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-0cfc70f5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-0cfc70f5

openshift-ingress

replicaset-controller

e2e-mt-0cfc70f5-openshift-default-5547b5fb6d

SuccessfulCreate

Created pod: e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj

openshift-ingress

multus

e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj

AddedInterface

Add eth0 [10.133.0.89/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-18b9d7-openshift-default-68d959d74-2bl5m

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-18b9d7-openshift-default-68d959d74-2bl5m

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-18b9d7-openshift-default-68d959d74-2bl5m

Started

Started container istio-proxy

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-0cfc70f5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-0cfc70f5-7cb7f8f598 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-0cfc70f5-5469dd7dc7

FailedCreate

Error creating: pods "payload-processing-e2e-mt-0cfc70f5-5469dd7dc7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-0cfc70f5: serviceaccount "payload-processing-e2e-mt-0cfc70f5" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-0cfc70f5-5469dd7dc7

SuccessfulCreate

Created pod: payload-processing-e2e-mt-0cfc70f5-5469dd7dc7-4v7vt

openshift-ingress

deployment-controller

payload-processing-e2e-mt-0cfc70f5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-0cfc70f5-5469dd7dc7 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-0cfc70f5-7cb7f8f598

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-0cfc70f5-7cb7f8f598-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-0cfc70f5: serviceaccount "payload-processing-e2e-mt-0cfc70f5" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-0cfc70f5-7cb7f8f598

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-0cfc70f5-7cb7f8f598-zjm2d

openshift-ingress

kubelet

payload-processing-e2e-mt-0cfc70f5-5469dd7dc7-4v7vt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-0cfc70f5-7cb7f8f598-zjm2d

Started

Started container payload-pre-processing
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-18b9d7-openshift-default-68d959d74-2bl5m

ProbeError

Startup probe error: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-18b9d7-openshift-default-68d959d74-2bl5m

Unhealthy

Startup probe failed: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-0cfc70f5-7cb7f8f598-zjm2d

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-mt-0cfc70f5-7cb7f8f598-zjm2d

AddedInterface

Add eth0 [10.132.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-0cfc70f5-7cb7f8f598-zjm2d

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-mt-0cfc70f5-5469dd7dc7-4v7vt

AddedInterface

Add eth0 [10.132.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-0cfc70f5-5469dd7dc7-4v7vt

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-0cfc70f5-5469dd7dc7-4v7vt

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj

Created

Created container: istio-proxy
(x7)

openshift-ingress

kubelet

e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj

ProbeError

Startup probe error: Get "http://10.133.0.89:15021/healthz/ready": dial tcp 10.133.0.89:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62

Killing

Stopping container istio-proxy
(x7)

openshift-ingress

kubelet

e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj

Unhealthy

Startup probe failed: Get "http://10.133.0.89:15021/healthz/ready": dial tcp 10.133.0.89:15021: connect: connection refused

openshift-ingress

multus

e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8

AddedInterface

Add eth0 [10.133.0.90/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-a-w3-61f73f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4 from 0 to 1

openshift-ingress

GatewayAuthBootstrap

e2e-shared-a-w3-61f73f

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-shared-a-w3-61f73f-authn-ssl: envoyfilters.networking.istio.io "e2e-shared-a-w3-61f73f-authn-ssl" already exists

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-61f73f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-61f73f

openshift-ingress

replicaset-controller

e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4

SuccessfulCreate

Created pod: e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-61f73f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-61f73f-86c4868989 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-61f73f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-61f73f-64cb7cc75d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-61f73f-64cb7cc75d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-61f73f-64cb7cc75d-s776g
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-61f73f-64cb7cc75d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-61f73f-64cb7cc75d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-61f73f: serviceaccount "payload-processing-e2e-shared-a-w3-61f73f" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-61f73f-86c4868989

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-61f73f-86c4868989-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-61f73f: serviceaccount "payload-processing-e2e-shared-a-w3-61f73f" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-61f73f-86c4868989

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-61f73f-86c4868989-2rt7x

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-61f73f-86c4868989-2rt7x

AddedInterface

Add eth0 [10.132.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-61f73f-86c4868989-2rt7x

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-61f73f-64cb7cc75d-s776g

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-61f73f-64cb7cc75d-s776g

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-61f73f-86c4868989-2rt7x

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-61f73f-86c4868989-2rt7x

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-61f73f-64cb7cc75d-s776g

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-61f73f-64cb7cc75d-s776g

AddedInterface

Add eth0 [10.132.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8

Unhealthy

Readiness probe failed: Get "http://10.133.0.90:15021/healthz/ready": read tcp 10.133.0.2:49608->10.133.0.90:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8

ProbeError

Readiness probe error: Get "http://10.133.0.90:15021/healthz/ready": read tcp 10.133.0.2:49608->10.133.0.90:15021: read: connection reset by peer body:

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-ef5997

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-ef5997

openshift-ingress

replicaset-controller

e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d

SuccessfulCreate

Created pod: e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht

openshift-ingress

deployment-controller

e2e-shared-b-w3-ef5997-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d from 0 to 1

openshift-ingress

multus

e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht

AddedInterface

Add eth0 [10.133.0.93/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8

ProbeError

Startup probe error: Get "http://10.133.0.90:15021/healthz/ready": dial tcp 10.133.0.90:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-noten-bafa8a-openshift-default-6df8445d78-mfh8z

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8

Unhealthy

Startup probe failed: Get "http://10.133.0.90:15021/healthz/ready": dial tcp 10.133.0.90:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-ef5997

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-ef5997-7cbccc4f9d from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-ef5997

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-ef5997-694bf45db7 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-ef5997-7cbccc4f9d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-ef5997-7cbccc4f9d-9c8fc
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-ef5997-694bf45db7

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-ef5997-694bf45db7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-ef5997: serviceaccount "payload-processing-e2e-shared-b-w3-ef5997" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-ef5997-7cbccc4f9d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-ef5997-7cbccc4f9d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-ef5997: serviceaccount "payload-processing-e2e-shared-b-w3-ef5997" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-ef5997-694bf45db7-rfvz8

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-ef5997-694bf45db7

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-ef5997-694bf45db7-rfvz8

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-ef5997-694bf45db7-rfvz8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-ef5997-694bf45db7-rfvz8

AddedInterface

Add eth0 [10.133.0.94/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-ef5997-694bf45db7-rfvz8

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-ef5997-7cbccc4f9d-9c8fc

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-ef5997-7cbccc4f9d-9c8fc

AddedInterface

Add eth0 [10.132.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-ef5997-7cbccc4f9d-9c8fc

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-ef5997-7cbccc4f9d-9c8fc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht

Unhealthy

Startup probe failed: Get "http://10.133.0.93:15021/healthz/ready": dial tcp 10.133.0.93:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht

ProbeError

Startup probe error: Get "http://10.133.0.93:15021/healthz/ready": dial tcp 10.133.0.93:15021: connect: connection refused body:

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-mt-0cfc70f5

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-mt-0cfc70f5: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-mt-0cfc70f5": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-mt-0cfc70f5, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 165de5fa-d9ca-4873-9e0e-e5ddaf4b37d7, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-0cfc70f5-7cb7f8f598-zjm2d

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-0cfc70f5-5469dd7dc7-4v7vt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj

ProbeError

Readiness probe error: Get "http://10.133.0.89:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj

Unhealthy

Readiness probe failed: Get "http://10.133.0.89:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

gateway_labeler_controller

e2e-api-a-033ca6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-033ca6

openshift-ingress

replicaset-controller

e2e-api-a-033ca6-openshift-default-586fbcc476

SuccessfulCreate

Created pod: e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8

openshift-ingress

deployment-controller

e2e-api-a-033ca6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-033ca6-openshift-default-586fbcc476 from 0 to 1

openshift-ingress

multus

e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8

AddedInterface

Add eth0 [10.133.0.100/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-033ca6-5dfc9cbb79

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-033ca6-5dfc9cbb79-6q44j
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-033ca6-7cdcf6f6c8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-033ca6-7cdcf6f6c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-033ca6: serviceaccount "payload-processing-e2e-api-a-033ca6" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-033ca6-7cdcf6f6c8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-033ca6-7cdcf6f6c8-crdlm
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-033ca6-5dfc9cbb79

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-033ca6-5dfc9cbb79-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-033ca6: serviceaccount "payload-processing-e2e-api-a-033ca6" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-033ca6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-033ca6-7cdcf6f6c8 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-033ca6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-033ca6-5dfc9cbb79 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-033ca6-7cdcf6f6c8-crdlm

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-api-a-033ca6-5dfc9cbb79-6q44j

AddedInterface

Add eth0 [10.132.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-033ca6-5dfc9cbb79-6q44j

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-033ca6-5dfc9cbb79-6q44j

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-033ca6-5dfc9cbb79-6q44j

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-a-033ca6-7cdcf6f6c8-crdlm

AddedInterface

Add eth0 [10.132.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-033ca6-7cdcf6f6c8-crdlm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-033ca6-7cdcf6f6c8-crdlm

Created

Created container: payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-api-b-49980f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-49980f

openshift-ingress

multus

e2e-api-b-49980f-openshift-default-7d59f74494-tb97t

AddedInterface

Add eth0 [10.133.0.101/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-api-b-49980f-openshift-default-7d59f74494

SuccessfulCreate

Created pod: e2e-api-b-49980f-openshift-default-7d59f74494-tb97t

openshift-ingress

deployment-controller

e2e-api-b-49980f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-49980f-openshift-default-7d59f74494 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-api-b-49980f-765dd7fd78-nhv22

AddedInterface

Add eth0 [10.132.0.70/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-api-b-49980f-85c77cf6cc-fpn7m

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-49980f-765dd7fd78-nhv22

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-49980f-765dd7fd78-nhv22

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-49980f-765dd7fd78-nhv22

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-49980f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-49980f-765dd7fd78 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-49980f-765dd7fd78

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-49980f-765dd7fd78-nhv22

openshift-ingress

kubelet

payload-processing-e2e-api-b-49980f-85c77cf6cc-fpn7m

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-b-49980f-85c77cf6cc-fpn7m

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-49980f-85c77cf6cc-fpn7m

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-49980f-765dd7fd78

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-49980f-765dd7fd78-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-49980f: serviceaccount "payload-processing-e2e-api-b-49980f" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-49980f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-49980f-85c77cf6cc from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-49980f-85c77cf6cc

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-49980f-85c77cf6cc-fpn7m
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-49980f-85c77cf6cc

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-49980f-85c77cf6cc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-49980f: serviceaccount "payload-processing-e2e-api-b-49980f" not found

openshift-ingress

kubelet

e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8

Unhealthy

Readiness probe failed: Get "http://10.133.0.100:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8

ProbeError

Readiness probe error: Get "http://10.133.0.100:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x7)

openshift-ingress

kubelet

e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8

ProbeError

Startup probe error: Get "http://10.133.0.100:15021/healthz/ready": dial tcp 10.133.0.100:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8

Unhealthy

Startup probe failed: Get "http://10.133.0.100:15021/healthz/ready": dial tcp 10.133.0.100:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-033ca6-7cdcf6f6c8-crdlm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-033ca6-5dfc9cbb79-6q44j

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-api-a-033ca6

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-api-a-033ca6: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-api-a-033ca6": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-api-a-033ca6, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 80597a4a-351a-4d80-b1d8-f2b21cac098e, UID in object meta:

openshift-ingress

kubelet

e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-49980f-openshift-default-7d59f74494-tb97t

ProbeError

Readiness probe error: Get "http://10.133.0.101:15021/healthz/ready": read tcp 10.133.0.2:33020->10.133.0.101:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-api-b-49980f-openshift-default-7d59f74494-tb97t

Unhealthy

Readiness probe failed: Get "http://10.133.0.101:15021/healthz/ready": read tcp 10.133.0.2:33020->10.133.0.101:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-api-b-49980f-openshift-default-7d59f74494-tb97t

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-49980f-openshift-default-7d59f74494-tb97t

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-49980f-openshift-default-7d59f74494-tb97t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-api-b-49980f-openshift-default-7d59f74494-tb97t

Unhealthy

Startup probe failed: Get "http://10.133.0.101:15021/healthz/ready": dial tcp 10.133.0.101:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-b-49980f-openshift-default-7d59f74494-tb97t

ProbeError

Startup probe error: Get "http://10.133.0.101:15021/healthz/ready": dial tcp 10.133.0.101:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-49980f-765dd7fd78-nhv22

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-49980f-85c77cf6cc-fpn7m

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-b-49980f-openshift-default-7d59f74494-tb97t

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-49980f-openshift-default-7d59f74494-tb97t

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-b-49980f-openshift-default-7d59f74494-tb97t

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-10ba6f-7dd6468598-x4wtl

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-worker-w0-10ba6f

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-worker-w0-10ba6f: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-worker-w0-10ba6f": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-worker-w0-10ba6f, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 0c00828f-ff25-4ef5-a7cb-1f689843a582, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-10ba6f-d456458c-wfvzs

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-8e62c2-5459cb9c94-sn9vq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-8e62c2-7dc9c9d989-sq879

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-18b9d7-6bf785d4df-t57tj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-18b9d7-68887bbd94-27km5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-f19fd1-5c9c988f49-5fjvb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-f19fd1-6647b85cfd-9vw6p

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w2-18b9d7-openshift-default-68d959d74-2bl5m

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-f19fd1-openshift-default-74f6d7f46b-8tpgc

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-5fbbcd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-5fbbcd

openshift-ingress

multus

e2e-ipp-a-5fbbcd-openshift-default-75bc786786-9lmpl

AddedInterface

Add eth0 [10.132.0.76/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ipp-a-5fbbcd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-5fbbcd-openshift-default-75bc786786 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-5fbbcd-openshift-default-75bc786786

SuccessfulCreate

Created pod: e2e-ipp-a-5fbbcd-openshift-default-75bc786786-9lmpl

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-5fbbcd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-5fbbcd-7b54c6f898 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-5fbbcd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-5fbbcd-6f57f548d5 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-5fbbcd-6f57f548d5

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-5fbbcd-6f57f548d5-24wdf
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-5fbbcd-6f57f548d5

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-5fbbcd-6f57f548d5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-5fbbcd: serviceaccount "payload-processing-e2e-ipp-a-5fbbcd" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-5fbbcd-7b54c6f898

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-5fbbcd-7b54c6f898-6fjqg
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-5fbbcd-7b54c6f898

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-5fbbcd-7b54c6f898-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-5fbbcd: serviceaccount "payload-processing-e2e-ipp-a-5fbbcd" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-5fbbcd-6f57f548d5-24wdf

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-5fbbcd-7b54c6f898-6fjqg

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-5fbbcd-7b54c6f898-6fjqg

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-5fbbcd-6f57f548d5-24wdf

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-ipp-a-5fbbcd-6f57f548d5-24wdf

AddedInterface

Add eth0 [10.132.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-5fbbcd-6f57f548d5-24wdf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-5fbbcd-7b54c6f898-6fjqg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-5fbbcd-7b54c6f898-6fjqg

AddedInterface

Add eth0 [10.132.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-5fbbcd-openshift-default-75bc786786-9lmpl

ProbeError

Readiness probe error: Get "http://10.132.0.76:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-a-5fbbcd-openshift-default-75bc786786-9lmpl

Unhealthy

Readiness probe failed: Get "http://10.132.0.76:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ipp-a-5fbbcd-openshift-default-75bc786786-9lmpl

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-5fbbcd-openshift-default-75bc786786-9lmpl

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-5fbbcd-openshift-default-75bc786786-9lmpl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-a-5fbbcd-openshift-default-75bc786786-9lmpl

Unhealthy

Startup probe failed: Get "http://10.132.0.76:15021/healthz/ready": dial tcp 10.132.0.76:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-5fbbcd-openshift-default-75bc786786-9lmpl

ProbeError

Startup probe error: Get "http://10.132.0.76:15021/healthz/ready": dial tcp 10.132.0.76:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-57b051

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-57b051

openshift-ingress

deployment-controller

e2e-ipp-b-57b051-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-57b051-openshift-default-85c658cb88 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-57b051-openshift-default-85c658cb88

SuccessfulCreate

Created pod: e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj

openshift-ingress

multus

e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj

AddedInterface

Add eth0 [10.133.0.105/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-57b051-5944bdfcc9

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-57b051-5944bdfcc9-dtkth
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-57b051-776d95fb58

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-57b051-776d95fb58-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-57b051: serviceaccount "payload-processing-e2e-ipp-b-57b051" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-57b051

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-57b051-5944bdfcc9 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-57b051-5944bdfcc9

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-57b051-5944bdfcc9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-57b051: serviceaccount "payload-processing-e2e-ipp-b-57b051" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-57b051

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-57b051-776d95fb58 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-57b051-776d95fb58

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-57b051-776d95fb58-8s5zp

openshift-ingress

multus

payload-processing-e2e-ipp-b-57b051-5944bdfcc9-dtkth

AddedInterface

Add eth0 [10.132.0.80/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-57b051-5944bdfcc9-dtkth

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-57b051-776d95fb58-8s5zp

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-57b051-776d95fb58-8s5zp

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-57b051-5944bdfcc9-dtkth

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-57b051-5944bdfcc9-dtkth

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-57b051-776d95fb58-8s5zp

AddedInterface

Add eth0 [10.132.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-57b051-776d95fb58-8s5zp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj

Unhealthy

Startup probe failed: Get "http://10.133.0.105:15021/healthz/ready": dial tcp 10.133.0.105:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj

ProbeError

Startup probe error: Get "http://10.133.0.105:15021/healthz/ready": dial tcp 10.133.0.105:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-bfe85d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-bfe85d

openshift-ingress

deployment-controller

e2e-ipp-cleanup-bfe85d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b

SuccessfulCreate

Created pod: e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk

openshift-ingress

multus

e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk

AddedInterface

Add eth0 [10.133.0.109/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-bfe85d-56c597df75-g7t59

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-bfe85d-d875b66c8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-bfe85d-d875b66c8-6hksm

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-bfe85d-d875b66c8-6hksm

AddedInterface

Add eth0 [10.132.0.83/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-bfe85d-d875b66c8-6hksm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-bfe85d-d875b66c8-6hksm

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-bfe85d-d875b66c8-6hksm

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-bfe85d-56c597df75-g7t59

AddedInterface

Add eth0 [10.132.0.84/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-bfe85d-56c597df75

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-bfe85d-56c597df75-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-bfe85d: serviceaccount "payload-processing-e2e-ipp-cleanup-bfe85d" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-bfe85d-56c597df75

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-bfe85d-56c597df75-g7t59
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-bfe85d-d875b66c8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-bfe85d-d875b66c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-bfe85d: serviceaccount "payload-processing-e2e-ipp-cleanup-bfe85d" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-bfe85d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-bfe85d-56c597df75 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-bfe85d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-bfe85d-d875b66c8 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-bfe85d-56c597df75-g7t59

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-bfe85d-56c597df75-g7t59

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk

ProbeError

Startup probe error: Get "http://10.133.0.109:15021/healthz/ready": dial tcp 10.133.0.109:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk

Unhealthy

Startup probe failed: Get "http://10.133.0.109:15021/healthz/ready": dial tcp 10.133.0.109:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-bfe85d-56c597df75-g7t59

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-bfe85d-d875b66c8-6hksm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk

Killing

Stopping container istio-proxy

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-a-5fbbcd

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-a-5fbbcd: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-a-5fbbcd": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-a-5fbbcd, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 9f160a30-4b62-46c9-8162-be1efafe97f5, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-5fbbcd-6f57f548d5-24wdf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-5fbbcd-7b54c6f898-6fjqg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-5fbbcd-openshift-default-75bc786786-9lmpl

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-a-5fbbcd-openshift-default-75bc786786-9lmpl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-5fbbcd-openshift-default-75bc786786-9lmpl

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-57b051-5944bdfcc9-dtkth

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-57b051-776d95fb58-8s5zp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-61f73f-86c4868989-2rt7x

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-61f73f-64cb7cc75d-s776g

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-ef5997-7cbccc4f9d-9c8fc

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-b-w3-ef5997

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-b-w3-ef5997: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-b-w3-ef5997": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-b-w3-ef5997, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 023c6ded-3f08-40df-9db7-379c6e3b7c96, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-ef5997-694bf45db7-rfvz8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: