Time Namespace Component RelatedObject Reason Message

openshift-ingress

e2e-mt-f3a3973e-openshift-default-654c69f956-t6xmr

Scheduled

Successfully assigned openshift-ingress/e2e-mt-f3a3973e-openshift-default-654c69f956-t6xmr to ip-10-0-132-17.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-5xgd2

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5xgd2 to ip-10-0-132-17.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-eb2ab2-6d6b7d45bc-p49c9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-eb2ab2-6d6b7d45bc-p49c9 to ip-10-0-139-51.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-52fd8c-56d789b695-xc8hd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-52fd8c-56d789b695-xc8hd to ip-10-0-139-51.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-f315c3-5989cc795f-7s6nb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-f315c3-5989cc795f-7s6nb to ip-10-0-139-51.ec2.internal

openshift-ingress

e2e-ipp-b-6586c3-openshift-default-6698875954-9wjff

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-6586c3-openshift-default-6698875954-9wjff to ip-10-0-132-17.ec2.internal

openshift-ingress

payload-processing-e2e-mt-f3a3973e-68f9c64889-fxvz9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-f3a3973e-68f9c64889-fxvz9 to ip-10-0-139-51.ec2.internal

openshift-ingress

payload-processing-e2e-mt-6148d487-848dc4b57-zcwn2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-6148d487-848dc4b57-zcwn2 to ip-10-0-139-51.ec2.internal

openshift-ingress

e2e-ait-1fd647e0-openshift-default-5d58657994-mkrj4

Scheduled

Successfully assigned openshift-ingress/e2e-ait-1fd647e0-openshift-default-5d58657994-mkrj4 to ip-10-0-132-17.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-48fbf0-59bd976b8b-x4rpq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-48fbf0-59bd976b8b-x4rpq to ip-10-0-139-51.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-6148d487-6f9db67646-ldzb2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-6148d487-6f9db67646-ldzb2 to ip-10-0-140-120.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-f3a3973e-85c465665d-6hnxd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-f3a3973e-85c465665d-6hnxd to ip-10-0-139-51.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-6586c3-8f6474b86-gb2w2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-6586c3-8f6474b86-gb2w2 to ip-10-0-139-51.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-f315c3-cb9cb5f58-2lncn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f315c3-cb9cb5f58-2lncn to ip-10-0-139-51.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-9ac315-67fbd9498b-rlhwn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-9ac315-67fbd9498b-rlhwn to ip-10-0-139-51.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-52fd8c-5889c878f8-bp69b

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-52fd8c-5889c878f8-bp69b to ip-10-0-139-51.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-ea8f09-78fcf89fbb-x4r4w

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-ea8f09-78fcf89fbb-x4r4w to ip-10-0-139-51.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-2ce8bc-858cccd9b6-mv4kh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-2ce8bc-858cccd9b6-mv4kh to ip-10-0-140-120.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-e2ea3e-6df5d54d54-qdqlz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-e2ea3e-6df5d54d54-qdqlz to ip-10-0-140-120.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-34d301-54fc64659d-zw78k

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-34d301-54fc64659d-zw78k to ip-10-0-139-51.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-97b645-9c77dbcdb-n5dbs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-97b645-9c77dbcdb-n5dbs to ip-10-0-139-51.ec2.internal

openshift-ingress

e2e-ait-41cc4972-openshift-default-57d98d5c8-55m4x

Scheduled

Successfully assigned openshift-ingress/e2e-ait-41cc4972-openshift-default-57d98d5c8-55m4x to ip-10-0-132-17.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-b2d51e27-7745b7ff8-s482g

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-b2d51e27-7745b7ff8-s482g to ip-10-0-139-51.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-708c6a-7df7f7d7b6-mp5j2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-708c6a-7df7f7d7b6-mp5j2 to ip-10-0-139-51.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-eb2ab2-77cb556dcd-crrrf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-eb2ab2-77cb556dcd-crrrf to ip-10-0-139-51.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-4acea1-56847c7df8-9prc5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-4acea1-56847c7df8-9prc5 to ip-10-0-139-51.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-f604b4-8955b4bc4-zhc56

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-f604b4-8955b4bc4-zhc56 to ip-10-0-139-51.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-9359a3-58cd9bcdb6-l4x6p

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-9359a3-58cd9bcdb6-l4x6p to ip-10-0-139-51.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-41cc4972-fb476d958-6kwfz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-41cc4972-fb476d958-6kwfz to ip-10-0-140-120.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-1fd647e0-8497bbc794-m7z5l

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-1fd647e0-8497bbc794-m7z5l to ip-10-0-139-51.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-7tvs6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-7tvs6 to ip-10-0-139-51.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-241a48eb-85b46f7d8b-f4fvw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-241a48eb-85b46f7d8b-f4fvw to ip-10-0-139-51.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-vwq2p

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vwq2p to ip-10-0-132-17.ec2.internal

openshift-ingress

e2e-ipp-cleanup-48fbf0-openshift-default-79dfd9df68-8hjk4

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-48fbf0-openshift-default-79dfd9df68-8hjk4 to ip-10-0-140-120.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-241a48eb-5fb95f6dc8-k9ll9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-241a48eb-5fb95f6dc8-k9ll9 to ip-10-0-139-51.ec2.internal

openshift-ingress

e2e-api-a-9359a3-openshift-default-789fd784b4-2frh8

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-9359a3-openshift-default-789fd784b4-2frh8 to ip-10-0-132-17.ec2.internal

openshift-ingress

e2e-shared-b-w3-34d301-openshift-default-cdcb745fb-mwsd5

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-34d301-openshift-default-cdcb745fb-mwsd5 to ip-10-0-132-17.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-mpcpf

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-mpcpf to ip-10-0-140-120.ec2.internal

openshift-ingress

e2e-worker-w0-eb2ab2-openshift-default-568c464d88-6vbnq

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-eb2ab2-openshift-default-568c464d88-6vbnq to ip-10-0-132-17.ec2.internal

openshift-ingress

e2e-worker-w4-f604b4-openshift-default-6d747fd9dd-f7wv9

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-f604b4-openshift-default-6d747fd9dd-f7wv9 to ip-10-0-140-120.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-27bhq

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-27bhq to ip-10-0-140-120.ec2.internal

openshift-ingress

e2e-inf-a-e2ea3e-openshift-default-8b88f74c6-2h2vf

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-e2ea3e-openshift-default-8b88f74c6-2h2vf to ip-10-0-132-17.ec2.internal

openshift-ingress

payload-processing-e2e-ait-41cc4972-54984bfb89-qd4wt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-41cc4972-54984bfb89-qd4wt to ip-10-0-139-51.ec2.internal

openshift-ingress

e2e-shared-b-w2-2ce8bc-openshift-default-86ccb8b49d-fhqnf

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-2ce8bc-openshift-default-86ccb8b49d-fhqnf to ip-10-0-132-17.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-9359a3-759cc6947f-bhfdv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-9359a3-759cc6947f-bhfdv to ip-10-0-139-51.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-4acea1-58789f44c5-skxb4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-4acea1-58789f44c5-skxb4 to ip-10-0-139-51.ec2.internal

openshift-ingress

e2e-api-b-4acea1-openshift-default-645987b79b-6kwts

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-4acea1-openshift-default-645987b79b-6kwts to ip-10-0-140-120.ec2.internal

openshift-ingress

payload-processing-e2e-autores-708c6a-68c9db4cd7-5nnvt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-708c6a-68c9db4cd7-5nnvt to ip-10-0-139-51.ec2.internal

openshift-ingress

e2e-shared-a-w3-52fd8c-openshift-default-69c94dbf4d-j2h5r

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-52fd8c-openshift-default-69c94dbf4d-j2h5r to ip-10-0-140-120.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-xhnrj

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xhnrj to ip-10-0-139-51.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-34d301-69c8766cb7-22nml

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-34d301-69c8766cb7-22nml to ip-10-0-140-120.ec2.internal

openshift-ingress

router-default-695c688bd8-jc78r

Scheduled

Successfully assigned openshift-ingress/router-default-695c688bd8-jc78r to ip-10-0-139-51.ec2.internal

openshift-ingress

payload-processing-e2e-derive-b2d51e27-55d5c48b97-ffrdb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-b2d51e27-55d5c48b97-ffrdb to ip-10-0-139-51.ec2.internal

openshift-ingress

e2e-explicit-97b645-openshift-default-74d488bbd4-k99x5

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-97b645-openshift-default-74d488bbd4-k99x5 to ip-10-0-132-17.ec2.internal

openshift-ingress

e2e-shared-a-w2-f315c3-openshift-default-7565b74f48-w7rnn

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-f315c3-openshift-default-7565b74f48-w7rnn to ip-10-0-140-120.ec2.internal

openshift-ingress

e2e-inf-b-ea8f09-openshift-default-569c9cdf46-cj7l5

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-ea8f09-openshift-default-569c9cdf46-cj7l5 to ip-10-0-132-17.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-48fbf0-577db8bf9-cmnrr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-48fbf0-577db8bf9-cmnrr to ip-10-0-139-51.ec2.internal

openshift-ingress

e2e-autores-708c6a-openshift-default-84d74f76c6-n8gf8

Scheduled

Successfully assigned openshift-ingress/e2e-autores-708c6a-openshift-default-84d74f76c6-n8gf8 to ip-10-0-132-17.ec2.internal

openshift-ingress

e2e-ipp-a-9ac315-openshift-default-78556459c4-5zsc9

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-9ac315-openshift-default-78556459c4-5zsc9 to ip-10-0-140-120.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-6586c3-88c878bb9-qsvql

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-6586c3-88c878bb9-qsvql to ip-10-0-140-120.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-97b645-5696dc9dd9-xpdwh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-97b645-5696dc9dd9-xpdwh to ip-10-0-139-51.ec2.internal

openshift-ingress

e2e-noten-538267-openshift-default-576c499686-m9z2j

Scheduled

Successfully assigned openshift-ingress/e2e-noten-538267-openshift-default-576c499686-m9z2j to ip-10-0-132-17.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-e2ea3e-66d68644c-jnvfs

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-e2ea3e-66d68644c-jnvfs to ip-10-0-139-51.ec2.internal

openshift-ingress

kube-auth-proxy-b966d4c98-vw7ts

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-b966d4c98-vw7ts to ip-10-0-140-120.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-9ac315-6fdcf764cc-6jzxj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-9ac315-6fdcf764cc-6jzxj to ip-10-0-139-51.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-2ce8bc-6cbc45685-f6jvd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-2ce8bc-6cbc45685-f6jvd to ip-10-0-139-51.ec2.internal

openshift-ingress

e2e-migrate-241a48eb-gw-openshift-default-6894f587dd-pmwmq

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-241a48eb-gw-openshift-default-6894f587dd-pmwmq to ip-10-0-132-17.ec2.internal

openshift-ingress

payload-processing-e2e-ait-1fd647e0-65dc4cfbd5-bhx5s

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-1fd647e0-65dc4cfbd5-bhx5s to ip-10-0-139-51.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-ea8f09-85854849bf-vm7gc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-ea8f09-85854849bf-vm7gc to ip-10-0-140-120.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w4-f604b4-854569ddc-qns9n

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-f604b4-854569ddc-qns9n to ip-10-0-139-51.ec2.internal

openshift-ingress

kube-auth-proxy-b966d4c98-g7fbv

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-b966d4c98-g7fbv to ip-10-0-139-51.ec2.internal

openshift-ingress

e2e-mt-6148d487-openshift-default-5b86bb995b-mn6rl

Scheduled

Successfully assigned openshift-ingress/e2e-mt-6148d487-openshift-default-5b86bb995b-mn6rl to ip-10-0-132-17.ec2.internal

openshift-ingress

e2e-derive-b2d51e27-openshift-default-6f66f474c6-cndrs

Scheduled

Successfully assigned openshift-ingress/e2e-derive-b2d51e27-openshift-default-6f66f474c6-cndrs to ip-10-0-132-17.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-695c688bd8 from 0 to 1
(x9)

openshift-ingress

replicaset-controller

router-default-695c688bd8

FailedCreate

Error creating: pods "router-default-695c688bd8-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x17)

openshift-ingress

replicaset-controller

router-default-695c688bd8

FailedCreate

Error creating: pods "router-default-695c688bd8-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-695c688bd8

SuccessfulCreate

Created pod: router-default-695c688bd8-jc78r
(x5)

openshift-ingress

kubelet

router-default-695c688bd8-jc78r

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x6)

openshift-ingress

kubelet

router-default-695c688bd8-jc78r

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

kubelet

router-default-695c688bd8-jc78r

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:48526e08a2a06d05806dbcf3ddb069e5182371667d9e9f7d2cf09f60cd247d20" already present on machine

openshift-ingress

multus

router-default-695c688bd8-jc78r

AddedInterface

Add eth0 [10.133.0.15/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-695c688bd8-jc78r

Created

Created container: router

openshift-ingress

kubelet

router-default-695c688bd8-jc78r

Started

Started container router

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-b966d4c98 from 0 to 2

openshift-ingress

replicaset-controller

kube-auth-proxy-b966d4c98

SuccessfulCreate

Created pod: kube-auth-proxy-b966d4c98-vw7ts

openshift-ingress

replicaset-controller

kube-auth-proxy-b966d4c98

SuccessfulCreate

Created pod: kube-auth-proxy-b966d4c98-g7fbv

openshift-ingress

kubelet

kube-auth-proxy-b966d4c98-g7fbv

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found
(x4)

openshift-ingress

replicaset-controller

kube-auth-proxy-b966d4c98

FailedCreate

Error creating: pods "kube-auth-proxy-b966d4c98-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

kubelet

kube-auth-proxy-b966d4c98-vw7ts

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-xhnrj

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-xhnrj

AddedInterface

Add eth0 [10.133.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-b966d4c98-vw7ts

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-b966d4c98-vw7ts

AddedInterface

Add eth0 [10.134.0.18/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-xhnrj

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

kubelet

kube-auth-proxy-b966d4c98-g7fbv

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-b966d4c98-g7fbv

AddedInterface

Add eth0 [10.133.0.32/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-b966d4c98-g7fbv

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-b966d4c98-g7fbv

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-b966d4c98-g7fbv

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.759s (2.759s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-xhnrj

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.83s (3.83s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-xhnrj

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-xhnrj

Created

Created container: discovery

openshift-ingress

kubelet

kube-auth-proxy-b966d4c98-vw7ts

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-b966d4c98-vw7ts

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-b966d4c98-vw7ts

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 5.079s (5.079s including waiting). Image size: 265120132 bytes.
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-xhnrj

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-xhnrj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-27bhq

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-5xgd2

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-27bhq

AddedInterface

Add eth0 [10.134.0.20/23] from ovn-kubernetes

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-5xgd2

AddedInterface

Add eth0 [10.132.0.24/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-5xgd2

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-27bhq

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-27bhq

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-27bhq

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-27bhq

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.467s (2.467s including waiting). Image size: 181126104 bytes.

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-xhnrj

Killing

Stopping container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-xhnrj

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-5xgd2

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-5xgd2

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-5xgd2

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 5.345s (5.345s including waiting). Image size: 181318953 bytes.
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-vwq2p

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-vwq2p

AddedInterface

Add eth0 [10.132.0.30/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-7tvs6

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-mpcpf

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-5b54b7fbb7-mpcpf

AddedInterface

Add eth0 [10.134.0.33/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-7tvs6

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-7tvs6

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-mpcpf

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-mpcpf

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.673s (1.673s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-mpcpf

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-7tvs6

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.342s (1.342s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-7tvs6

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-7tvs6

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-mpcpf

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-vwq2p

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-vwq2p

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-vwq2p

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-vwq2p

ProbeError

Startup probe error: Get "http://10.132.0.30:15021/healthz/ready": dial tcp 10.132.0.30:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-vwq2p

Unhealthy

Startup probe failed: Get "http://10.132.0.30:15021/healthz/ready": dial tcp 10.132.0.30:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w4-f604b4-openshift-default-6d747fd9dd

SuccessfulCreate

Created pod: e2e-worker-w4-f604b4-openshift-default-6d747fd9dd-f7wv9

openshift-ingress

replicaset-controller

e2e-inf-a-e2ea3e-openshift-default-8b88f74c6

SuccessfulCreate

Created pod: e2e-inf-a-e2ea3e-openshift-default-8b88f74c6-2h2vf

openshift-ingress

gateway_labeler_controller

e2e-inf-a-e2ea3e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-e2ea3e

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-f604b4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-f604b4

openshift-ingress

deployment-controller

e2e-worker-w4-f604b4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-f604b4-openshift-default-6d747fd9dd from 0 to 1

openshift-ingress

deployment-controller

e2e-inf-a-e2ea3e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-e2ea3e-openshift-default-8b88f74c6 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-eb2ab2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-eb2ab2

openshift-ingress

deployment-controller

e2e-worker-w0-eb2ab2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-eb2ab2-openshift-default-568c464d88 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w0-eb2ab2-openshift-default-568c464d88

SuccessfulCreate

Created pod: e2e-worker-w0-eb2ab2-openshift-default-568c464d88-6vbnq

openshift-ingress

kubelet

e2e-worker-w4-f604b4-openshift-default-6d747fd9dd-f7wv9

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

e2e-worker-w0-eb2ab2-openshift-default-568c464d88-6vbnq

AddedInterface

Add eth0 [10.132.0.34/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w4-f604b4-openshift-default-6d747fd9dd-f7wv9

AddedInterface

Add eth0 [10.134.0.36/23] from ovn-kubernetes

openshift-ingress

multus

e2e-inf-a-e2ea3e-openshift-default-8b88f74c6-2h2vf

AddedInterface

Add eth0 [10.132.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-f604b4-openshift-default-6d747fd9dd-f7wv9

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.847s (2.847s including waiting). Image size: 181318953 bytes.

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-eb2ab2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-eb2ab2-6d6b7d45bc from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-eb2ab2-6d6b7d45bc

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-eb2ab2-6d6b7d45bc-p49c9

openshift-ingress

multus

payload-processing-e2e-worker-w0-eb2ab2-6d6b7d45bc-p49c9

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-eb2ab2-77cb556dcd-crrrf

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-eb2ab2-77cb556dcd-crrrf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-eb2ab2-77cb556dcd-crrrf

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-eb2ab2-77cb556dcd-crrrf

Started

Started container payload-pre-processing
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-eb2ab2-6d6b7d45bc

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-eb2ab2-6d6b7d45bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-eb2ab2: serviceaccount "payload-processing-e2e-worker-w0-eb2ab2" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-eb2ab2-77cb556dcd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-eb2ab2-77cb556dcd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-eb2ab2: serviceaccount "payload-processing-e2e-worker-w0-eb2ab2" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-eb2ab2-77cb556dcd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-eb2ab2-77cb556dcd-crrrf

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-eb2ab2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-eb2ab2-77cb556dcd from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-eb2ab2-6d6b7d45bc-p49c9

Started

Started container payload-processing
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-e2ea3e-66d68644c

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-e2ea3e-66d68644c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-e2ea3e: serviceaccount "payload-processing-e2e-inf-a-e2ea3e" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-eb2ab2-6d6b7d45bc-p49c9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-e2ea3e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-e2ea3e-6df5d54d54 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-eb2ab2-6d6b7d45bc-p49c9

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-e2ea3e-6df5d54d54

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-e2ea3e-6df5d54d54-qdqlz
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-e2ea3e-6df5d54d54

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-e2ea3e-6df5d54d54-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-e2ea3e: serviceaccount "payload-processing-e2e-inf-a-e2ea3e" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-e2ea3e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-e2ea3e-66d68644c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-e2ea3e-66d68644c

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-e2ea3e-66d68644c-jnvfs

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-e2ea3e-6df5d54d54-qdqlz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-e2ea3e-6df5d54d54-qdqlz

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-e2ea3e-66d68644c-jnvfs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-inf-a-e2ea3e-66d68644c-jnvfs

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-e2ea3e-6df5d54d54-qdqlz

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-e2ea3e-66d68644c-jnvfs

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-e2ea3e-6df5d54d54-qdqlz

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-e2ea3e-66d68644c-jnvfs

Started

Started container payload-processing

openshift-ingress

replicaset-controller

e2e-autores-708c6a-openshift-default-84d74f76c6

SuccessfulCreate

Created pod: e2e-autores-708c6a-openshift-default-84d74f76c6-n8gf8

openshift-ingress

deployment-controller

e2e-autores-708c6a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-708c6a-openshift-default-84d74f76c6 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-autores-708c6a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-708c6a

openshift-ingress

deployment-controller

e2e-ait-41cc4972-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-41cc4972-openshift-default-57d98d5c8 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-41cc4972-openshift-default-57d98d5c8

SuccessfulCreate

Created pod: e2e-ait-41cc4972-openshift-default-57d98d5c8-55m4x

openshift-ingress

multus

e2e-autores-708c6a-openshift-default-84d74f76c6-n8gf8

AddedInterface

Add eth0 [10.132.0.36/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ait-41cc4972

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-41cc4972

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-f604b4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-f604b4-854569ddc from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-f604b4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-f604b4-8955b4bc4 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-f604b4-854569ddc

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-f604b4-854569ddc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-f604b4: serviceaccount "payload-processing-e2e-worker-w4-f604b4" not found

openshift-ingress

multus

e2e-ait-41cc4972-openshift-default-57d98d5c8-55m4x

AddedInterface

Add eth0 [10.132.0.37/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-worker-w4-f604b4-854569ddc-qns9n

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-f604b4-8955b4bc4-zhc56

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-f604b4-8955b4bc4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-f604b4-8955b4bc4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-f604b4: serviceaccount "payload-processing-e2e-worker-w4-f604b4" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-f604b4-8955b4bc4-zhc56

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-f604b4-854569ddc

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-f604b4-854569ddc-qns9n

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-f604b4-8955b4bc4-zhc56

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-f604b4-854569ddc-qns9n

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-f604b4-8955b4bc4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-f604b4-8955b4bc4-zhc56

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-f604b4-854569ddc-qns9n

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-f604b4-8955b4bc4-zhc56

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-f604b4-854569ddc-qns9n

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-autores-708c6a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-708c6a-68c9db4cd7 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-708c6a-7df7f7d7b6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-708c6a-7df7f7d7b6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-708c6a: serviceaccount "payload-processing-e2e-autores-708c6a" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-708c6a-7df7f7d7b6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-708c6a-7df7f7d7b6-mp5j2
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-708c6a-68c9db4cd7

FailedCreate

Error creating: pods "payload-processing-e2e-autores-708c6a-68c9db4cd7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-708c6a: serviceaccount "payload-processing-e2e-autores-708c6a" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-708c6a-68c9db4cd7

SuccessfulCreate

Created pod: payload-processing-e2e-autores-708c6a-68c9db4cd7-5nnvt

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-708c6a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-708c6a-7df7f7d7b6 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-41cc4972-54984bfb89

FailedCreate

Error creating: pods "payload-processing-e2e-ait-41cc4972-54984bfb89-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-41cc4972: serviceaccount "payload-processing-e2e-ait-41cc4972" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-708c6a-7df7f7d7b6-mp5j2

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-41cc4972-54984bfb89

SuccessfulCreate

Created pod: payload-processing-e2e-ait-41cc4972-54984bfb89-qd4wt

openshift-ingress

deployment-controller

payload-processing-e2e-ait-41cc4972

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-41cc4972-54984bfb89 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-autores-708c6a-68c9db4cd7-5nnvt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-autores-708c6a-68c9db4cd7-5nnvt

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-708c6a-68c9db4cd7-5nnvt

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-autores-708c6a-68c9db4cd7-5nnvt

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-708c6a-7df7f7d7b6-mp5j2

Created

Created container: payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-41cc4972-fb476d958

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-41cc4972-fb476d958-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-41cc4972: serviceaccount "payload-processing-e2e-ait-41cc4972" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-41cc4972-fb476d958

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-41cc4972-fb476d958-6kwfz

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-41cc4972

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-41cc4972-fb476d958 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-autores-708c6a-7df7f7d7b6-mp5j2

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-708c6a-7df7f7d7b6-mp5j2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-41cc4972-54984bfb89-qd4wt

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-41cc4972-fb476d958-6kwfz

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-41cc4972-fb476d958-6kwfz

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-41cc4972-fb476d958-6kwfz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-41cc4972-fb476d958-6kwfz

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ait-41cc4972-54984bfb89-qd4wt

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-41cc4972-54984bfb89-qd4wt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-41cc4972-54984bfb89-qd4wt

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-inf-a-e2ea3e-openshift-default-8b88f74c6-2h2vf

Unhealthy

Readiness probe failed: Get "http://10.132.0.35:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

gateway_labeler_controller

e2e-inf-b-ea8f09

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-ea8f09

openshift-ingress

deployment-controller

e2e-inf-b-ea8f09-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-ea8f09-openshift-default-569c9cdf46 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-ea8f09-openshift-default-569c9cdf46

SuccessfulCreate

Created pod: e2e-inf-b-ea8f09-openshift-default-569c9cdf46-cj7l5

openshift-ingress

GatewayAuthBootstrap

e2e-inf-b-ea8f09

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-inf-b-ea8f09-authn-ssl: envoyfilters.networking.istio.io "e2e-inf-b-ea8f09-authn-ssl" already exists

openshift-ingress

kubelet

e2e-inf-a-e2ea3e-openshift-default-8b88f74c6-2h2vf

ProbeError

Readiness probe error: Get "http://10.132.0.35:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-eb2ab2-openshift-default-568c464d88-6vbnq

Unhealthy

Readiness probe failed: Get "http://10.132.0.34:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-eb2ab2-openshift-default-568c464d88-6vbnq

ProbeError

Readiness probe error: Get "http://10.132.0.34:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w0-eb2ab2-openshift-default-568c464d88-6vbnq

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-eb2ab2-openshift-default-568c464d88-6vbnq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w0-eb2ab2-openshift-default-568c464d88-6vbnq

Created

Created container: istio-proxy

openshift-ingress

multus

e2e-inf-b-ea8f09-openshift-default-569c9cdf46-cj7l5

AddedInterface

Add eth0 [10.132.0.39/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-inf-a-e2ea3e-openshift-default-8b88f74c6-2h2vf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-e2ea3e-openshift-default-8b88f74c6-2h2vf

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-e2ea3e-openshift-default-8b88f74c6-2h2vf

Created

Created container: istio-proxy

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-ea8f09

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-ea8f09-85854849bf from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-ea8f09-78fcf89fbb-x4r4w

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-ea8f09-78fcf89fbb-x4r4w

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-ea8f09-78fcf89fbb-x4r4w

AddedInterface

Add eth0 [10.133.0.61/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-ea8f09

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-ea8f09-78fcf89fbb from 0 to 1

openshift-ingress

multus

payload-processing-e2e-inf-b-ea8f09-85854849bf-vm7gc

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-ea8f09-78fcf89fbb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-ea8f09-78fcf89fbb-x4r4w
(x6)

openshift-ingress

kubelet

e2e-worker-w0-eb2ab2-openshift-default-568c464d88-6vbnq

Unhealthy

Startup probe failed: Get "http://10.132.0.34:15021/healthz/ready": dial tcp 10.132.0.34:15021: connect: connection refused

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-ea8f09-85854849bf

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-ea8f09-85854849bf-vm7gc
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-ea8f09-85854849bf

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-ea8f09-85854849bf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-ea8f09: serviceaccount "payload-processing-e2e-inf-b-ea8f09" not found

openshift-ingress

kubelet

payload-processing-e2e-inf-b-ea8f09-85854849bf-vm7gc

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-ea8f09-78fcf89fbb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-ea8f09-78fcf89fbb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-ea8f09: serviceaccount "payload-processing-e2e-inf-b-ea8f09" not found

openshift-ingress

kubelet

payload-processing-e2e-inf-b-ea8f09-85854849bf-vm7gc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-ea8f09-78fcf89fbb-x4r4w

Created

Created container: payload-pre-processing
(x6)

openshift-ingress

kubelet

e2e-worker-w0-eb2ab2-openshift-default-568c464d88-6vbnq

ProbeError

Startup probe error: Get "http://10.132.0.34:15021/healthz/ready": dial tcp 10.132.0.34:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-inf-b-ea8f09-85854849bf-vm7gc

Created

Created container: payload-processing
(x5)

openshift-ingress

kubelet

e2e-inf-a-e2ea3e-openshift-default-8b88f74c6-2h2vf

ProbeError

Startup probe error: Get "http://10.132.0.35:15021/healthz/ready": dial tcp 10.132.0.35:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-a-e2ea3e-openshift-default-8b88f74c6-2h2vf

Unhealthy

Startup probe failed: Get "http://10.132.0.35:15021/healthz/ready": dial tcp 10.132.0.35:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w4-f604b4-openshift-default-6d747fd9dd-f7wv9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w4-f604b4-openshift-default-6d747fd9dd-f7wv9

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-f604b4-openshift-default-6d747fd9dd-f7wv9

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-worker-w4-f604b4-openshift-default-6d747fd9dd-f7wv9

Unhealthy

Startup probe failed: Get "http://10.134.0.36:15021/healthz/ready": dial tcp 10.134.0.36:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w4-f604b4-openshift-default-6d747fd9dd-f7wv9

ProbeError

Startup probe error: Get "http://10.134.0.36:15021/healthz/ready": dial tcp 10.134.0.36:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-autores-708c6a-openshift-default-84d74f76c6-n8gf8

ProbeError

Readiness probe error: Get "http://10.132.0.36:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-autores-708c6a-openshift-default-84d74f76c6-n8gf8

Unhealthy

Readiness probe failed: Get "http://10.132.0.36:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ait-41cc4972-openshift-default-57d98d5c8-55m4x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-ait-41cc4972-openshift-default-57d98d5c8-55m4x

ProbeError

Readiness probe error: Get "http://10.132.0.37:15021/healthz/ready": read tcp 10.132.0.2:34774->10.132.0.37:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-ait-41cc4972-openshift-default-57d98d5c8-55m4x

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-708c6a-openshift-default-84d74f76c6-n8gf8

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-708c6a-openshift-default-84d74f76c6-n8gf8

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-708c6a-openshift-default-84d74f76c6-n8gf8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-41cc4972-openshift-default-57d98d5c8-55m4x

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-ait-41cc4972-openshift-default-57d98d5c8-55m4x

Unhealthy

Readiness probe failed: Get "http://10.132.0.37:15021/healthz/ready": read tcp 10.132.0.2:34774->10.132.0.37:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-inf-b-ea8f09-openshift-default-569c9cdf46-cj7l5

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-ea8f09-openshift-default-569c9cdf46-cj7l5

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-ea8f09-openshift-default-569c9cdf46-cj7l5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-41cc4972-fb476d958-6kwfz

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ait-41cc4972-openshift-default-57d98d5c8-55m4x

Unhealthy

Startup probe failed: Get "http://10.132.0.37:15021/healthz/ready": dial tcp 10.132.0.37:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-ait-41cc4972-openshift-default-57d98d5c8-55m4x

ProbeError

Startup probe error: Get "http://10.132.0.37:15021/healthz/ready": dial tcp 10.132.0.37:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ait-41cc4972-54984bfb89-qd4wt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-41cc4972-openshift-default-57d98d5c8-55m4x

FailedToRetrieveImagePullSecret

Unable to retrieve some image pull secrets (e2e-ait-41cc4972-openshift-default-dockercfg-79nm6); attempting to pull the image may not succeed.

openshift-ingress

deployment-controller

e2e-migrate-241a48eb-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-241a48eb-gw-openshift-default-6894f587dd from 0 to 1

openshift-ingress

kubelet

e2e-ait-41cc4972-openshift-default-57d98d5c8-55m4x

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-migrate-241a48eb-gw-openshift-default-6894f587dd

SuccessfulCreate

Created pod: e2e-migrate-241a48eb-gw-openshift-default-6894f587dd-pmwmq

openshift-ingress

gateway_labeler_controller

e2e-migrate-241a48eb-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-241a48eb-gw

openshift-ingress

multus

e2e-migrate-241a48eb-gw-openshift-default-6894f587dd-pmwmq

AddedInterface

Add eth0 [10.132.0.40/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-autores-708c6a-openshift-default-84d74f76c6-n8gf8

Unhealthy

Startup probe failed: Get "http://10.132.0.36:15021/healthz/ready": dial tcp 10.132.0.36:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-autores-708c6a-openshift-default-84d74f76c6-n8gf8

ProbeError

Startup probe error: Get "http://10.132.0.36:15021/healthz/ready": dial tcp 10.132.0.36:15021: connect: connection refused body:
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-241a48eb-5fb95f6dc8

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-241a48eb-5fb95f6dc8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-241a48eb: serviceaccount "payload-processing-e2e-migrate-241a48eb" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-241a48eb-85b46f7d8b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-241a48eb-85b46f7d8b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-241a48eb: serviceaccount "payload-processing-e2e-migrate-241a48eb" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-241a48eb-85b46f7d8b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-241a48eb-85b46f7d8b-f4fvw

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-241a48eb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-241a48eb-85b46f7d8b from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-241a48eb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-241a48eb-5fb95f6dc8 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-241a48eb-5fb95f6dc8

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-241a48eb-5fb95f6dc8-k9ll9
(x6)

openshift-ingress

kubelet

e2e-inf-b-ea8f09-openshift-default-569c9cdf46-cj7l5

Unhealthy

Startup probe failed: Get "http://10.132.0.39:15021/healthz/ready": dial tcp 10.132.0.39:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-b-ea8f09-openshift-default-569c9cdf46-cj7l5

ProbeError

Startup probe error: Get "http://10.132.0.39:15021/healthz/ready": dial tcp 10.132.0.39:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-241a48eb-85b46f7d8b-f4fvw

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-241a48eb-5fb95f6dc8-k9ll9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-migrate-241a48eb-5fb95f6dc8-k9ll9

AddedInterface

Add eth0 [10.133.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-241a48eb-5fb95f6dc8-k9ll9

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-241a48eb-5fb95f6dc8-k9ll9

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-241a48eb-85b46f7d8b-f4fvw

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-241a48eb-85b46f7d8b-f4fvw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-migrate-241a48eb-85b46f7d8b-f4fvw

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-migrate-241a48eb-gw-openshift-default-6894f587dd-pmwmq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-241a48eb-gw-openshift-default-6894f587dd-pmwmq

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-241a48eb-gw-openshift-default-6894f587dd-pmwmq

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-migrate-241a48eb-gw-openshift-default-6894f587dd-pmwmq

ProbeError

Startup probe error: Get "http://10.132.0.40:15021/healthz/ready": dial tcp 10.132.0.40:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-migrate-241a48eb-gw-openshift-default-6894f587dd-pmwmq

Unhealthy

Startup probe failed: Get "http://10.132.0.40:15021/healthz/ready": dial tcp 10.132.0.40:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-migrate-241a48eb-5fb95f6dc8-k9ll9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-241a48eb-85b46f7d8b-f4fvw

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

e2e-ait-1fd647e0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-1fd647e0-openshift-default-5d58657994 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-1fd647e0-openshift-default-5d58657994

SuccessfulCreate

Created pod: e2e-ait-1fd647e0-openshift-default-5d58657994-mkrj4

openshift-ingress

kubelet

e2e-migrate-241a48eb-gw-openshift-default-6894f587dd-pmwmq

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ait-1fd647e0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-1fd647e0

openshift-ingress

multus

e2e-ait-1fd647e0-openshift-default-5d58657994-mkrj4

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-1fd647e0-8497bbc794

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-1fd647e0-8497bbc794-m7z5l
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-1fd647e0-65dc4cfbd5

FailedCreate

Error creating: pods "payload-processing-e2e-ait-1fd647e0-65dc4cfbd5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-1fd647e0: serviceaccount "payload-processing-e2e-ait-1fd647e0" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-1fd647e0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-1fd647e0-65dc4cfbd5 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-1fd647e0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-1fd647e0-8497bbc794 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-1fd647e0-65dc4cfbd5

SuccessfulCreate

Created pod: payload-processing-e2e-ait-1fd647e0-65dc4cfbd5-bhx5s
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-1fd647e0-8497bbc794

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-1fd647e0-8497bbc794-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-1fd647e0: serviceaccount "payload-processing-e2e-ait-1fd647e0" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-1fd647e0-8497bbc794-m7z5l

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-1fd647e0-8497bbc794-m7z5l

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-1fd647e0-8497bbc794-m7z5l

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ait-1fd647e0-65dc4cfbd5-bhx5s

AddedInterface

Add eth0 [10.133.0.67/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ait-1fd647e0-8497bbc794-m7z5l

AddedInterface

Add eth0 [10.133.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-1fd647e0-65dc4cfbd5-bhx5s

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-1fd647e0-65dc4cfbd5-bhx5s

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-1fd647e0-65dc4cfbd5-bhx5s

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-1fd647e0-openshift-default-5d58657994-mkrj4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-1fd647e0-openshift-default-5d58657994-mkrj4

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-1fd647e0-openshift-default-5d58657994-mkrj4

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ait-1fd647e0-openshift-default-5d58657994-mkrj4

ProbeError

Startup probe error: Get "http://10.132.0.43:15021/healthz/ready": dial tcp 10.132.0.43:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-1fd647e0-openshift-default-5d58657994-mkrj4

Unhealthy

Startup probe failed: Get "http://10.132.0.43:15021/healthz/ready": dial tcp 10.132.0.43:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ait-1fd647e0-65dc4cfbd5-bhx5s

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-1fd647e0-8497bbc794-m7z5l

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-1fd647e0-openshift-default-5d58657994-mkrj4

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-derive-b2d51e27-openshift-default-6f66f474c6-cndrs

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-derive-b2d51e27

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-b2d51e27

openshift-ingress

deployment-controller

e2e-derive-b2d51e27-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-b2d51e27-openshift-default-6f66f474c6 from 0 to 1

openshift-ingress

replicaset-controller

e2e-derive-b2d51e27-openshift-default-6f66f474c6

SuccessfulCreate

Created pod: e2e-derive-b2d51e27-openshift-default-6f66f474c6-cndrs

openshift-ingress

kubelet

e2e-ait-1fd647e0-openshift-default-5d58657994-mkrj4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ait-1fd647e0-openshift-default-5d58657994-mkrj4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-derive-b2d51e27

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-b2d51e27-55d5c48b97 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-derive-b2d51e27-7745b7ff8-s482g

AddedInterface

Add eth0 [10.133.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-b2d51e27-7745b7ff8-s482g

Started

Started container payload-pre-processing
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-b2d51e27-55d5c48b97

FailedCreate

Error creating: pods "payload-processing-e2e-derive-b2d51e27-55d5c48b97-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-b2d51e27: serviceaccount "payload-processing-e2e-derive-b2d51e27" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-b2d51e27-7745b7ff8-s482g

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-b2d51e27-55d5c48b97

SuccessfulCreate

Created pod: payload-processing-e2e-derive-b2d51e27-55d5c48b97-ffrdb

openshift-ingress

multus

payload-processing-e2e-derive-b2d51e27-55d5c48b97-ffrdb

AddedInterface

Add eth0 [10.133.0.70/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-b2d51e27

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-b2d51e27-7745b7ff8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-b2d51e27-7745b7ff8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-b2d51e27-7745b7ff8-s482g
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-b2d51e27-7745b7ff8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-b2d51e27-7745b7ff8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-b2d51e27: serviceaccount "payload-processing-e2e-derive-b2d51e27" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-b2d51e27-7745b7ff8-s482g

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-b2d51e27-55d5c48b97-ffrdb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-derive-b2d51e27-55d5c48b97-ffrdb

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-b2d51e27-55d5c48b97-ffrdb

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-derive-b2d51e27-openshift-default-6f66f474c6-cndrs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-b2d51e27-openshift-default-6f66f474c6-cndrs

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-b2d51e27-openshift-default-6f66f474c6-cndrs

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-derive-b2d51e27-openshift-default-6f66f474c6-cndrs

ProbeError

Startup probe error: Get "http://10.132.0.46:15021/healthz/ready": dial tcp 10.132.0.46:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-derive-b2d51e27-openshift-default-6f66f474c6-cndrs

Unhealthy

Startup probe failed: Get "http://10.132.0.46:15021/healthz/ready": dial tcp 10.132.0.46:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-derive-b2d51e27-55d5c48b97-ffrdb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-b2d51e27-7745b7ff8-s482g

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-b2d51e27-openshift-default-6f66f474c6-cndrs

FailedToRetrieveImagePullSecret

Unable to retrieve some image pull secrets (e2e-derive-b2d51e27-openshift-default-dockercfg-7s9sz); attempting to pull the image may not succeed.

openshift-ingress

kubelet

e2e-derive-b2d51e27-openshift-default-6f66f474c6-cndrs

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-autores-708c6a-68c9db4cd7-5nnvt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-708c6a-7df7f7d7b6-mp5j2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-eb2ab2-77cb556dcd-crrrf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-eb2ab2-6d6b7d45bc-p49c9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w0-eb2ab2-openshift-default-568c464d88-6vbnq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-f604b4-854569ddc-qns9n

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w0-eb2ab2-openshift-default-568c464d88-6vbnq

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w0-eb2ab2-openshift-default-568c464d88-6vbnq

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-f604b4-8955b4bc4-zhc56

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w4-f604b4-openshift-default-6d747fd9dd-f7wv9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-f604b4-openshift-default-6d747fd9dd-f7wv9

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w4-f604b4-openshift-default-6d747fd9dd-f7wv9

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

e2e-explicit-97b645-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-97b645-openshift-default-74d488bbd4 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-explicit-97b645

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-97b645

openshift-ingress

replicaset-controller

e2e-explicit-97b645-openshift-default-74d488bbd4

SuccessfulCreate

Created pod: e2e-explicit-97b645-openshift-default-74d488bbd4-k99x5

openshift-ingress

kubelet

e2e-autores-708c6a-openshift-default-84d74f76c6-n8gf8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-autores-708c6a-openshift-default-84d74f76c6-n8gf8

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-autores-708c6a-openshift-default-84d74f76c6-n8gf8

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

multus

e2e-explicit-97b645-openshift-default-74d488bbd4-k99x5

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-97b645-9c77dbcdb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-97b645-9c77dbcdb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-97b645: serviceaccount "payload-processing-e2e-explicit-97b645" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-97b645-9c77dbcdb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-97b645-9c77dbcdb-n5dbs

openshift-ingress

multus

payload-pre-processing-e2e-explicit-97b645-9c77dbcdb-n5dbs

AddedInterface

Add eth0 [10.133.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-97b645-9c77dbcdb-n5dbs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-explicit-97b645-5696dc9dd9-xpdwh

AddedInterface

Add eth0 [10.133.0.74/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-97b645-5696dc9dd9

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-97b645-5696dc9dd9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-97b645: serviceaccount "payload-processing-e2e-explicit-97b645" not found

openshift-ingress

kubelet

payload-processing-e2e-explicit-97b645-5696dc9dd9-xpdwh

Created

Created container: payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-97b645

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-97b645-5696dc9dd9 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-97b645-5696dc9dd9

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-97b645-5696dc9dd9-xpdwh

openshift-ingress

kubelet

payload-processing-e2e-explicit-97b645-5696dc9dd9-xpdwh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-97b645

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-97b645-9c77dbcdb from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-97b645-9c77dbcdb-n5dbs

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-97b645-5696dc9dd9-xpdwh

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-97b645-9c77dbcdb-n5dbs

Created

Created container: payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-mt-f3a3973e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-f3a3973e

openshift-ingress

GatewayAuthBootstrap

e2e-mt-f3a3973e

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-mt-f3a3973e-authn-ssl: envoyfilters.networking.istio.io "e2e-mt-f3a3973e-authn-ssl" already exists

openshift-ingress

replicaset-controller

e2e-mt-f3a3973e-openshift-default-654c69f956

SuccessfulCreate

Created pod: e2e-mt-f3a3973e-openshift-default-654c69f956-t6xmr

openshift-ingress

deployment-controller

e2e-mt-f3a3973e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-f3a3973e-openshift-default-654c69f956 from 0 to 1

openshift-ingress

multus

e2e-mt-f3a3973e-openshift-default-654c69f956-t6xmr

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-explicit-97b645-openshift-default-74d488bbd4-k99x5

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-97b645-openshift-default-74d488bbd4-k99x5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-97b645-openshift-default-74d488bbd4-k99x5

Started

Started container istio-proxy

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-f3a3973e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-f3a3973e-85c465665d from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-f3a3973e-85c465665d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-f3a3973e-85c465665d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-f3a3973e: serviceaccount "payload-processing-e2e-mt-f3a3973e" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-f3a3973e-68f9c64889

FailedCreate

Error creating: pods "payload-processing-e2e-mt-f3a3973e-68f9c64889-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-f3a3973e: serviceaccount "payload-processing-e2e-mt-f3a3973e" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-f3a3973e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-f3a3973e-68f9c64889 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-f3a3973e-85c465665d-6hnxd

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-f3a3973e-85c465665d-6hnxd

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-f3a3973e-85c465665d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-f3a3973e-85c465665d-6hnxd

openshift-ingress

kubelet

payload-processing-e2e-mt-f3a3973e-68f9c64889-fxvz9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-f3a3973e-68f9c64889-fxvz9

AddedInterface

Add eth0 [10.133.0.77/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-mt-f3a3973e-85c465665d-6hnxd

AddedInterface

Add eth0 [10.133.0.76/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-f3a3973e-68f9c64889

SuccessfulCreate

Created pod: payload-processing-e2e-mt-f3a3973e-68f9c64889-fxvz9

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-f3a3973e-85c465665d-6hnxd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-f3a3973e-68f9c64889-fxvz9

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-f3a3973e-68f9c64889-fxvz9

Created

Created container: payload-processing
(x5)

openshift-ingress

kubelet

e2e-explicit-97b645-openshift-default-74d488bbd4-k99x5

Unhealthy

Startup probe failed: Get "http://10.132.0.50:15021/healthz/ready": dial tcp 10.132.0.50:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-explicit-97b645-openshift-default-74d488bbd4-k99x5

ProbeError

Startup probe error: Get "http://10.132.0.50:15021/healthz/ready": dial tcp 10.132.0.50:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-mt-f3a3973e-openshift-default-654c69f956-t6xmr

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-f3a3973e-openshift-default-654c69f956-t6xmr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-f3a3973e-openshift-default-654c69f956-t6xmr

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-mt-f3a3973e-openshift-default-654c69f956-t6xmr

Unhealthy

Startup probe failed: Get "http://10.132.0.52:15021/healthz/ready": dial tcp 10.132.0.52:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-mt-f3a3973e-openshift-default-654c69f956-t6xmr

ProbeError

Startup probe error: Get "http://10.132.0.52:15021/healthz/ready": dial tcp 10.132.0.52:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-explicit-97b645-5696dc9dd9-xpdwh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-97b645-9c77dbcdb-n5dbs

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-mt-f3a3973e

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-mt-f3a3973e: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-mt-f3a3973e": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-mt-f3a3973e, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: d21d7c45-8894-4f21-8072-8048ebd256a5, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-f3a3973e-85c465665d-6hnxd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-f3a3973e-68f9c64889-fxvz9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-explicit-97b645-openshift-default-74d488bbd4-k99x5

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-noten-538267

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-538267

openshift-ingress

multus

e2e-noten-538267-openshift-default-576c499686-m9z2j

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-538267-openshift-default-576c499686-m9z2j

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-noten-538267-openshift-default-576c499686-m9z2j

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-noten-538267-openshift-default-576c499686-m9z2j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

replicaset-controller

e2e-noten-538267-openshift-default-576c499686

SuccessfulCreate

Created pod: e2e-noten-538267-openshift-default-576c499686-m9z2j

openshift-ingress

deployment-controller

e2e-noten-538267-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-538267-openshift-default-576c499686 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-a-e2ea3e-66d68644c-jnvfs

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-e2ea3e-6df5d54d54-qdqlz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-f3a3973e-openshift-default-654c69f956-t6xmr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-e2ea3e-openshift-default-8b88f74c6-2h2vf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-e2ea3e-openshift-default-8b88f74c6-2h2vf

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-a-e2ea3e-openshift-default-8b88f74c6-2h2vf

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

e2e-shared-a-w2-f315c3-openshift-default-7565b74f48

SuccessfulCreate

Created pod: e2e-shared-a-w2-f315c3-openshift-default-7565b74f48-w7rnn

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-f315c3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-f315c3

openshift-ingress

multus

e2e-shared-a-w2-f315c3-openshift-default-7565b74f48-w7rnn

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-a-w2-f315c3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-f315c3-openshift-default-7565b74f48 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-b-ea8f09-85854849bf-vm7gc

Unhealthy

Readiness probe failed: dial tcp 10.134.0.44:9004: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-ea8f09-78fcf89fbb-x4r4w

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-ea8f09-85854849bf-vm7gc

Killing

Stopping container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-f315c3-5989cc795f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-f315c3-5989cc795f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-f315c3: serviceaccount "payload-processing-e2e-shared-a-w2-f315c3" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-f315c3-cb9cb5f58

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-f315c3-cb9cb5f58-2lncn

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-f315c3-5989cc795f-7s6nb

AddedInterface

Add eth0 [10.133.0.82/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-f315c3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-f315c3-5989cc795f from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-f315c3-5989cc795f-7s6nb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-f315c3-cb9cb5f58-2lncn

AddedInterface

Add eth0 [10.133.0.83/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-f315c3-cb9cb5f58-2lncn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-f315c3-cb9cb5f58-2lncn

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-f315c3-cb9cb5f58-2lncn

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-f315c3-5989cc795f-7s6nb

Created

Created container: payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-f315c3-cb9cb5f58

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-f315c3-cb9cb5f58-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-f315c3: serviceaccount "payload-processing-e2e-shared-a-w2-f315c3" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-f315c3-5989cc795f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-f315c3-5989cc795f-7s6nb

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-f315c3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-f315c3-cb9cb5f58 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-f315c3-5989cc795f-7s6nb

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-inf-b-ea8f09-openshift-default-569c9cdf46-cj7l5

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-w3-52fd8c-openshift-default-69c94dbf4d

SuccessfulCreate

Created pod: e2e-shared-a-w3-52fd8c-openshift-default-69c94dbf4d-j2h5r

openshift-ingress

deployment-controller

e2e-shared-a-w3-52fd8c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-52fd8c-openshift-default-69c94dbf4d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-52fd8c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-52fd8c

openshift-ingress

multus

e2e-shared-a-w3-52fd8c-openshift-default-69c94dbf4d-j2h5r

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-538267-openshift-default-576c499686-m9z2j

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-noten-538267-openshift-default-576c499686-m9z2j

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-noten-538267-openshift-default-576c499686-m9z2j

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-52fd8c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-52fd8c-56d789b695 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-52fd8c-5889c878f8-bp69b

Created

Created container: payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-52fd8c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-52fd8c-5889c878f8 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-52fd8c-5889c878f8-bp69b

AddedInterface

Add eth0 [10.133.0.84/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-52fd8c-5889c878f8-bp69b

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-52fd8c-5889c878f8-bp69b

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-52fd8c-56d789b695-xc8hd

AddedInterface

Add eth0 [10.133.0.85/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-52fd8c-56d789b695-xc8hd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-52fd8c-5889c878f8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-52fd8c-5889c878f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-52fd8c: serviceaccount "payload-processing-e2e-shared-a-w3-52fd8c" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-52fd8c-5889c878f8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-52fd8c-5889c878f8-bp69b

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-52fd8c-56d789b695-xc8hd

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-52fd8c-56d789b695-xc8hd

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-52fd8c-56d789b695

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-52fd8c-56d789b695-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-52fd8c: serviceaccount "payload-processing-e2e-shared-a-w3-52fd8c" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-52fd8c-56d789b695

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-52fd8c-56d789b695-xc8hd

openshift-ingress

replicaset-controller

e2e-shared-b-w2-2ce8bc-openshift-default-86ccb8b49d

SuccessfulCreate

Created pod: e2e-shared-b-w2-2ce8bc-openshift-default-86ccb8b49d-fhqnf

openshift-ingress

kubelet

e2e-shared-a-w2-f315c3-openshift-default-7565b74f48-w7rnn

Unhealthy

Readiness probe failed: Get "http://10.134.0.48:15021/healthz/ready": read tcp 10.134.0.2:55112->10.134.0.48:15021: read: connection reset by peer

openshift-ingress

multus

e2e-shared-b-w2-2ce8bc-openshift-default-86ccb8b49d-fhqnf

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-b-w2-2ce8bc-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-2ce8bc-openshift-default-86ccb8b49d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-2ce8bc

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-2ce8bc

openshift-ingress

kubelet

e2e-shared-a-w2-f315c3-openshift-default-7565b74f48-w7rnn

ProbeError

Readiness probe error: Get "http://10.134.0.48:15021/healthz/ready": read tcp 10.134.0.2:55112->10.134.0.48:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-f315c3-openshift-default-7565b74f48-w7rnn

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-f315c3-openshift-default-7565b74f48-w7rnn

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-f315c3-openshift-default-7565b74f48-w7rnn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-2ce8bc-858cccd9b6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-2ce8bc-858cccd9b6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-2ce8bc: serviceaccount "payload-processing-e2e-shared-b-w2-2ce8bc" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-2ce8bc

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-2ce8bc-858cccd9b6 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-2ce8bc-6cbc45685

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-2ce8bc-6cbc45685-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-2ce8bc: serviceaccount "payload-processing-e2e-shared-b-w2-2ce8bc" not found
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-f315c3-openshift-default-7565b74f48-w7rnn

ProbeError

Startup probe error: Get "http://10.134.0.48:15021/healthz/ready": dial tcp 10.134.0.48:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-f315c3-openshift-default-7565b74f48-w7rnn

Unhealthy

Startup probe failed: Get "http://10.134.0.48:15021/healthz/ready": dial tcp 10.134.0.48:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-2ce8bc

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-2ce8bc-6cbc45685 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-2ce8bc-858cccd9b6-mv4kh

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-2ce8bc-858cccd9b6-mv4kh

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-2ce8bc-6cbc45685-f6jvd

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-2ce8bc-858cccd9b6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-2ce8bc-858cccd9b6-mv4kh

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-2ce8bc-858cccd9b6-mv4kh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-2ce8bc-858cccd9b6-mv4kh

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-2ce8bc-6cbc45685-f6jvd

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-2ce8bc-6cbc45685-f6jvd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-2ce8bc-6cbc45685

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-2ce8bc-6cbc45685-f6jvd

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-2ce8bc-6cbc45685-f6jvd

AddedInterface

Add eth0 [10.133.0.86/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-b-w3-34d301-openshift-default-cdcb745fb

SuccessfulCreate

Created pod: e2e-shared-b-w3-34d301-openshift-default-cdcb745fb-mwsd5

openshift-ingress

deployment-controller

e2e-shared-b-w3-34d301-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-34d301-openshift-default-cdcb745fb from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-34d301

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-34d301

openshift-ingress

multus

e2e-shared-b-w3-34d301-openshift-default-cdcb745fb-mwsd5

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-52fd8c-openshift-default-69c94dbf4d-j2h5r

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-52fd8c-openshift-default-69c94dbf4d-j2h5r

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-52fd8c-openshift-default-69c94dbf4d-j2h5r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-34d301-69c8766cb7

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-34d301-69c8766cb7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-34d301: serviceaccount "payload-processing-e2e-shared-b-w3-34d301" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-34d301-54fc64659d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-34d301-54fc64659d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-34d301: serviceaccount "payload-processing-e2e-shared-b-w3-34d301" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-34d301-69c8766cb7

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-34d301-69c8766cb7-22nml

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-34d301-54fc64659d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-34d301-54fc64659d-zw78k

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-34d301

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-34d301-69c8766cb7 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-34d301

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-34d301-54fc64659d from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-34d301-69c8766cb7-22nml

Started

Started container payload-processing
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-52fd8c-openshift-default-69c94dbf4d-j2h5r

ProbeError

Startup probe error: Get "http://10.134.0.50:15021/healthz/ready": dial tcp 10.134.0.50:15021: connect: connection refused body:

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-34d301-69c8766cb7-22nml

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-34d301-54fc64659d-zw78k

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-34d301-54fc64659d-zw78k

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-34d301-69c8766cb7-22nml

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-34d301-54fc64659d-zw78k

AddedInterface

Add eth0 [10.133.0.87/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-34d301-69c8766cb7-22nml

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-34d301-54fc64659d-zw78k

Created

Created container: payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-52fd8c-openshift-default-69c94dbf4d-j2h5r

Unhealthy

Startup probe failed: Get "http://10.134.0.50:15021/healthz/ready": dial tcp 10.134.0.50:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-2ce8bc-openshift-default-86ccb8b49d-fhqnf

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-2ce8bc-openshift-default-86ccb8b49d-fhqnf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-2ce8bc-openshift-default-86ccb8b49d-fhqnf

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-2ce8bc-openshift-default-86ccb8b49d-fhqnf

ProbeError

Startup probe error: Get "http://10.132.0.57:15021/healthz/ready": dial tcp 10.132.0.57:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-2ce8bc-openshift-default-86ccb8b49d-fhqnf

Unhealthy

Startup probe failed: Get "http://10.132.0.57:15021/healthz/ready": dial tcp 10.132.0.57:15021: connect: connection refused

openshift-ingress

GatewayAuthBootstrap

e2e-mt-6148d487

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-mt-6148d487-authn-ssl: envoyfilters.networking.istio.io "e2e-mt-6148d487-authn-ssl" already exists

openshift-ingress

multus

e2e-mt-6148d487-openshift-default-5b86bb995b-mn6rl

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-mt-6148d487-openshift-default-5b86bb995b

SuccessfulCreate

Created pod: e2e-mt-6148d487-openshift-default-5b86bb995b-mn6rl

openshift-ingress

deployment-controller

e2e-mt-6148d487-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-6148d487-openshift-default-5b86bb995b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-6148d487

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-6148d487
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-34d301-openshift-default-cdcb745fb-mwsd5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-34d301-openshift-default-cdcb745fb-mwsd5

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-34d301-openshift-default-cdcb745fb-mwsd5

Created

Created container: istio-proxy
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-6148d487-6f9db67646

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-6148d487-6f9db67646-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-6148d487: serviceaccount "payload-processing-e2e-mt-6148d487" not found
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-34d301-openshift-default-cdcb745fb-mwsd5

Unhealthy

Startup probe failed: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-6148d487-6f9db67646

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-6148d487-6f9db67646-ldzb2
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-34d301-openshift-default-cdcb745fb-mwsd5

ProbeError

Startup probe error: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-processing-e2e-mt-6148d487

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-6148d487-848dc4b57 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-6148d487

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-6148d487-6f9db67646 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-6148d487-848dc4b57

SuccessfulCreate

Created pod: payload-processing-e2e-mt-6148d487-848dc4b57-zcwn2
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-6148d487-848dc4b57

FailedCreate

Error creating: pods "payload-processing-e2e-mt-6148d487-848dc4b57-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-6148d487: serviceaccount "payload-processing-e2e-mt-6148d487" not found

openshift-ingress

multus

payload-processing-e2e-mt-6148d487-848dc4b57-zcwn2

AddedInterface

Add eth0 [10.133.0.92/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-mt-6148d487-6f9db67646-ldzb2

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-6148d487-6f9db67646-ldzb2

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-6148d487-6f9db67646-ldzb2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-6148d487-848dc4b57-zcwn2

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-6148d487-848dc4b57-zcwn2

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-6148d487-848dc4b57-zcwn2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-6148d487-6f9db67646-ldzb2

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-mt-6148d487-openshift-default-5b86bb995b-mn6rl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-6148d487-openshift-default-5b86bb995b-mn6rl

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-6148d487-openshift-default-5b86bb995b-mn6rl

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-mt-6148d487-openshift-default-5b86bb995b-mn6rl

Unhealthy

Startup probe failed: Get "http://10.132.0.60:15021/healthz/ready": dial tcp 10.132.0.60:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-mt-6148d487-openshift-default-5b86bb995b-mn6rl

ProbeError

Startup probe error: Get "http://10.132.0.60:15021/healthz/ready": dial tcp 10.132.0.60:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-6148d487-6f9db67646-ldzb2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-6148d487-848dc4b57-zcwn2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-6148d487-openshift-default-5b86bb995b-mn6rl

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-api-a-9359a3-openshift-default-789fd784b4

SuccessfulCreate

Created pod: e2e-api-a-9359a3-openshift-default-789fd784b4-2frh8

openshift-ingress

gateway_labeler_controller

e2e-api-a-9359a3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-9359a3

openshift-ingress

deployment-controller

e2e-api-a-9359a3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-9359a3-openshift-default-789fd784b4 from 0 to 1

openshift-ingress

multus

e2e-api-a-9359a3-openshift-default-789fd784b4-2frh8

AddedInterface

Add eth0 [10.132.0.67/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-9359a3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-9359a3-759cc6947f from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-9359a3-759cc6947f

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-9359a3-759cc6947f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-9359a3: serviceaccount "payload-processing-e2e-api-a-9359a3" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-9359a3-58cd9bcdb6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-9359a3-58cd9bcdb6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-9359a3: serviceaccount "payload-processing-e2e-api-a-9359a3" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-9359a3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-9359a3-58cd9bcdb6 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-9359a3-58cd9bcdb6-l4x6p

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-9359a3-58cd9bcdb6-l4x6p

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-9359a3-58cd9bcdb6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-9359a3-58cd9bcdb6-l4x6p

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-9359a3-58cd9bcdb6-l4x6p

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-a-9359a3-58cd9bcdb6-l4x6p

AddedInterface

Add eth0 [10.133.0.99/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-api-a-9359a3-759cc6947f-bhfdv

AddedInterface

Add eth0 [10.133.0.100/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-9359a3-759cc6947f-bhfdv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-a-9359a3-759cc6947f-bhfdv

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-9359a3-759cc6947f-bhfdv

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-9359a3-759cc6947f

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-9359a3-759cc6947f-bhfdv
(x2)

openshift-ingress

kubelet

e2e-api-a-9359a3-openshift-default-789fd784b4-2frh8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-9359a3-openshift-default-789fd784b4-2frh8

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-9359a3-openshift-default-789fd784b4-2frh8

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-a-9359a3-openshift-default-789fd784b4-2frh8

Unhealthy

Startup probe failed: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-a-9359a3-openshift-default-789fd784b4-2frh8

ProbeError

Startup probe error: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-api-b-4acea1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-4acea1-openshift-default-645987b79b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-4acea1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-4acea1

openshift-ingress

replicaset-controller

e2e-api-b-4acea1-openshift-default-645987b79b

SuccessfulCreate

Created pod: e2e-api-b-4acea1-openshift-default-645987b79b-6kwts

openshift-ingress

multus

e2e-api-b-4acea1-openshift-default-645987b79b-6kwts

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-4acea1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-4acea1-58789f44c5 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-4acea1-58789f44c5

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-4acea1-58789f44c5-skxb4
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-4acea1-58789f44c5

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-4acea1-58789f44c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-4acea1: serviceaccount "payload-processing-e2e-api-b-4acea1" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-4acea1-56847c7df8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-4acea1-56847c7df8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-4acea1: serviceaccount "payload-processing-e2e-api-b-4acea1" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-4acea1-56847c7df8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-4acea1-56847c7df8-9prc5

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-4acea1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-4acea1-56847c7df8 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-4acea1-56847c7df8-9prc5

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-api-b-4acea1-58789f44c5-skxb4

AddedInterface

Add eth0 [10.133.0.101/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-4acea1-58789f44c5-skxb4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-b-4acea1-58789f44c5-skxb4

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-4acea1-58789f44c5-skxb4

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-b-4acea1-56847c7df8-9prc5

AddedInterface

Add eth0 [10.133.0.102/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-4acea1-56847c7df8-9prc5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-4acea1-56847c7df8-9prc5

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-api-b-4acea1-openshift-default-645987b79b-6kwts

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-4acea1-openshift-default-645987b79b-6kwts

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-4acea1-openshift-default-645987b79b-6kwts

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-b-4acea1-openshift-default-645987b79b-6kwts

ProbeError

Startup probe error: Get "http://10.134.0.58:15021/healthz/ready": dial tcp 10.134.0.58:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-4acea1-openshift-default-645987b79b-6kwts

Unhealthy

Startup probe failed: Get "http://10.134.0.58:15021/healthz/ready": dial tcp 10.134.0.58:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-api-a-9359a3-759cc6947f-bhfdv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-9359a3-58cd9bcdb6-l4x6p

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-a-9359a3-openshift-default-789fd784b4-2frh8

Killing

Stopping container istio-proxy

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-api-b-4acea1

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-api-b-4acea1: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-api-b-4acea1": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-api-b-4acea1, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 02c052b7-9adb-4a29-a081-96fa7e55cfc6, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-api-b-4acea1-58789f44c5-skxb4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-4acea1-56847c7df8-9prc5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-4acea1-openshift-default-645987b79b-6kwts

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-f315c3-cb9cb5f58-2lncn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-f315c3-5989cc795f-7s6nb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w2-f315c3-openshift-default-7565b74f48-w7rnn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-2ce8bc-6cbc45685-f6jvd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-2ce8bc-858cccd9b6-mv4kh

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-ipp-a-9ac315-openshift-default-78556459c4

SuccessfulCreate

Created pod: e2e-ipp-a-9ac315-openshift-default-78556459c4-5zsc9

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-9ac315

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-9ac315

openshift-ingress

deployment-controller

e2e-ipp-a-9ac315-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-9ac315-openshift-default-78556459c4 from 0 to 1

openshift-ingress

multus

e2e-ipp-a-9ac315-openshift-default-78556459c4-5zsc9

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w2-2ce8bc-openshift-default-86ccb8b49d-fhqnf

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-9ac315

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-9ac315-67fbd9498b from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-9ac315

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-9ac315-6fdcf764cc from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-9ac315-6fdcf764cc

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-9ac315-6fdcf764cc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-9ac315: serviceaccount "payload-processing-e2e-ipp-a-9ac315" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-9ac315-67fbd9498b-rlhwn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-9ac315-67fbd9498b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-9ac315-67fbd9498b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-9ac315: serviceaccount "payload-processing-e2e-ipp-a-9ac315" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-9ac315-6fdcf764cc-6jzxj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-a-9ac315-6fdcf764cc-6jzxj

AddedInterface

Add eth0 [10.133.0.109/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-9ac315-6fdcf764cc-6jzxj

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-9ac315-6fdcf764cc

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-9ac315-6fdcf764cc-6jzxj

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-9ac315-6fdcf764cc-6jzxj

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-9ac315-67fbd9498b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-9ac315-67fbd9498b-rlhwn

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-9ac315-67fbd9498b-rlhwn

AddedInterface

Add eth0 [10.133.0.110/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-9ac315-67fbd9498b-rlhwn

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-9ac315-67fbd9498b-rlhwn

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-9ac315-openshift-default-78556459c4-5zsc9

Unhealthy

Readiness probe failed: Get "http://10.134.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-a-9ac315-openshift-default-78556459c4-5zsc9

ProbeError

Readiness probe error: Get "http://10.134.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ipp-a-9ac315-openshift-default-78556459c4-5zsc9

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-9ac315-openshift-default-78556459c4-5zsc9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-9ac315-openshift-default-78556459c4-5zsc9

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-a-9ac315-openshift-default-78556459c4-5zsc9

ProbeError

Startup probe error: Get "http://10.134.0.60:15021/healthz/ready": dial tcp 10.134.0.60:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-9ac315-openshift-default-78556459c4-5zsc9

Unhealthy

Startup probe failed: Get "http://10.134.0.60:15021/healthz/ready": dial tcp 10.134.0.60:15021: connect: connection refused

openshift-ingress

multus

e2e-ipp-b-6586c3-openshift-default-6698875954-9wjff

AddedInterface

Add eth0 [10.132.0.70/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-6586c3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-6586c3

openshift-ingress

deployment-controller

e2e-ipp-b-6586c3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-6586c3-openshift-default-6698875954 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-6586c3-openshift-default-6698875954

SuccessfulCreate

Created pod: e2e-ipp-b-6586c3-openshift-default-6698875954-9wjff

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-6586c3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-6586c3-8f6474b86 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-6586c3-88c878bb9

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-6586c3-88c878bb9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-6586c3: serviceaccount "payload-processing-e2e-ipp-b-6586c3" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-6586c3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-6586c3-88c878bb9 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-6586c3-88c878bb9-qsvql

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-6586c3-8f6474b86-gb2w2

Started

Started container payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-6586c3-8f6474b86

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-6586c3-8f6474b86-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-6586c3: serviceaccount "payload-processing-e2e-ipp-b-6586c3" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-6586c3-8f6474b86-gb2w2

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-6586c3-8f6474b86

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-6586c3-8f6474b86-gb2w2

openshift-ingress

multus

payload-processing-e2e-ipp-b-6586c3-88c878bb9-qsvql

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-6586c3-8f6474b86-gb2w2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-6586c3-8f6474b86-gb2w2

AddedInterface

Add eth0 [10.133.0.111/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-6586c3-88c878bb9-qsvql

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-6586c3-88c878bb9-qsvql

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-6586c3-88c878bb9

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-6586c3-88c878bb9-qsvql
(x2)

openshift-ingress

kubelet

e2e-ipp-b-6586c3-openshift-default-6698875954-9wjff

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-6586c3-openshift-default-6698875954-9wjff

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-6586c3-openshift-default-6698875954-9wjff

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-b-6586c3-openshift-default-6698875954-9wjff

Unhealthy

Startup probe failed: Get "http://10.132.0.70:15021/healthz/ready": dial tcp 10.132.0.70:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-6586c3-openshift-default-6698875954-9wjff

ProbeError

Startup probe error: Get "http://10.132.0.70:15021/healthz/ready": dial tcp 10.132.0.70:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-48fbf0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-48fbf0

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-48fbf0-openshift-default-79dfd9df68

SuccessfulCreate

Created pod: e2e-ipp-cleanup-48fbf0-openshift-default-79dfd9df68-8hjk4

openshift-ingress

multus

e2e-ipp-cleanup-48fbf0-openshift-default-79dfd9df68-8hjk4

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ipp-cleanup-48fbf0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-48fbf0-openshift-default-79dfd9df68 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-48fbf0-59bd976b8b-x4rpq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-48fbf0-577db8bf9

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-48fbf0-577db8bf9-cmnrr

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-48fbf0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-48fbf0-59bd976b8b from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-48fbf0-59bd976b8b-x4rpq

AddedInterface

Add eth0 [10.133.0.112/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-48fbf0-59bd976b8b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-48fbf0-59bd976b8b-x4rpq
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-48fbf0-59bd976b8b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-48fbf0-59bd976b8b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-48fbf0: serviceaccount "payload-processing-e2e-ipp-cleanup-48fbf0" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-48fbf0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-48fbf0-577db8bf9 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-48fbf0-577db8bf9

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-48fbf0-577db8bf9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-48fbf0: serviceaccount "payload-processing-e2e-ipp-cleanup-48fbf0" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-48fbf0-59bd976b8b-x4rpq

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-48fbf0-577db8bf9-cmnrr

AddedInterface

Add eth0 [10.133.0.113/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-48fbf0-59bd976b8b-x4rpq

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-48fbf0-577db8bf9-cmnrr

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-48fbf0-577db8bf9-cmnrr

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-48fbf0-577db8bf9-cmnrr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-48fbf0-openshift-default-79dfd9df68-8hjk4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-48fbf0-openshift-default-79dfd9df68-8hjk4

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-48fbf0-openshift-default-79dfd9df68-8hjk4

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-ipp-cleanup-48fbf0-openshift-default-79dfd9df68-8hjk4

Unhealthy

Startup probe failed: Get "http://10.134.0.63:15021/healthz/ready": dial tcp 10.134.0.63:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-cleanup-48fbf0-openshift-default-79dfd9df68-8hjk4

ProbeError

Startup probe error: Get "http://10.134.0.63:15021/healthz/ready": dial tcp 10.134.0.63:15021: connect: connection refused body:

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-cleanup-48fbf0

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-48fbf0: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-cleanup-48fbf0": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-48fbf0, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 23770de1-255e-4263-9203-bd61736d9aa3, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-48fbf0-59bd976b8b-x4rpq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-48fbf0-577db8bf9-cmnrr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-48fbf0-openshift-default-79dfd9df68-8hjk4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-9ac315-67fbd9498b-rlhwn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-9ac315-6fdcf764cc-6jzxj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-9ac315-openshift-default-78556459c4-5zsc9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-9ac315-openshift-default-78556459c4-5zsc9

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-a-9ac315-openshift-default-78556459c4-5zsc9

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-6586c3-88c878bb9-qsvql

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-6586c3-8f6474b86-gb2w2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-6586c3-openshift-default-6698875954-9wjff

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-6586c3-openshift-default-6698875954-9wjff

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-b-6586c3-openshift-default-6698875954-9wjff

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-52fd8c-5889c878f8-bp69b

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-52fd8c-56d789b695-xc8hd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w3-52fd8c-openshift-default-69c94dbf4d-j2h5r

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-52fd8c-openshift-default-69c94dbf4d-j2h5r

Unhealthy

Readiness probe failed: Get "http://10.134.0.50:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-a-w3-52fd8c-openshift-default-69c94dbf4d-j2h5r

ProbeError

Readiness probe error: Get "http://10.134.0.50:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-34d301-69c8766cb7-22nml

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-34d301-54fc64659d-zw78k

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w3-34d301-openshift-default-cdcb745fb-mwsd5

Killing

Stopping container istio-proxy