Time Namespace Component RelatedObject Reason Message

openshift-ingress

e2e-ipp-b-930288-openshift-default-674786887b-4hthg

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-930288-openshift-default-674786887b-4hthg to ip-10-0-141-49.ec2.internal

openshift-ingress

payload-processing-e2e-mt-01e18c68-86694fbfb9-hnjxs

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-01e18c68-86694fbfb9-hnjxs to ip-10-0-137-250.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-73c192-856b5dcd4f-p98jc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-73c192-856b5dcd4f-p98jc to ip-10-0-137-250.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-d91c81-5fd5cb655c-9gpgx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-d91c81-5fd5cb655c-9gpgx to ip-10-0-137-250.ec2.internal

openshift-ingress

payload-processing-e2e-autores-e04a57-587545b5f7-9kf8f

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-e04a57-587545b5f7-9kf8f to ip-10-0-137-250.ec2.internal

openshift-ingress

e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9 to ip-10-0-141-49.ec2.internal

openshift-ingress

payload-processing-e2e-ait-faf2bf41-ccd7c65f-llj29

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-faf2bf41-ccd7c65f-llj29 to ip-10-0-137-250.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-g8pgk

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-g8pgk to ip-10-0-142-24.ec2.internal

openshift-ingress

e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4

Scheduled

Successfully assigned openshift-ingress/e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4 to ip-10-0-141-49.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-ea7120c2-5b579c9cc4-bwj8q

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-ea7120c2-5b579c9cc4-bwj8q to ip-10-0-141-49.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-01e18c68-69b469864b-qhqlv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-01e18c68-69b469864b-qhqlv to ip-10-0-141-49.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-703730-5f45f69f78-lwf8m

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-703730-5f45f69f78-lwf8m to ip-10-0-141-49.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-c36aacf1-85cc79b9bb-w4qhq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-c36aacf1-85cc79b9bb-w4qhq to ip-10-0-137-250.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-930288-6f68f56fdb-65q49

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-930288-6f68f56fdb-65q49 to ip-10-0-141-49.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-eac764-574cd78f86-srh7c

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-eac764-574cd78f86-srh7c to ip-10-0-137-250.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-ef54fd-7f9584dff4-c2dth

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ef54fd-7f9584dff4-c2dth to ip-10-0-141-49.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-73a747-78fb5559c8-445n2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-73a747-78fb5559c8-445n2 to ip-10-0-137-250.ec2.internal

openshift-ingress

e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg to ip-10-0-141-49.ec2.internal

openshift-ingress

payload-processing-e2e-derive-a40054de-6d449774d5-jvwdt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-a40054de-6d449774d5-jvwdt to ip-10-0-141-49.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-clxtk

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-clxtk to ip-10-0-137-250.ec2.internal

openshift-ingress

e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd to ip-10-0-141-49.ec2.internal

openshift-ingress

e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2

Scheduled

Successfully assigned openshift-ingress/e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2 to ip-10-0-141-49.ec2.internal

openshift-ingress

kube-auth-proxy-6ff6468b6c-8k468

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-6ff6468b6c-8k468 to ip-10-0-141-49.ec2.internal

openshift-ingress

e2e-noten-3f08e4-openshift-default-78fc7784-vrsv6

Scheduled

Successfully assigned openshift-ingress/e2e-noten-3f08e4-openshift-default-78fc7784-vrsv6 to ip-10-0-141-49.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-a092eb-68bc75587c-586bb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-a092eb-68bc75587c-586bb to ip-10-0-141-49.ec2.internal

openshift-ingress

kube-auth-proxy-6ff6468b6c-lxdl9

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-6ff6468b6c-lxdl9 to ip-10-0-137-250.ec2.internal

openshift-ingress

e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz

Scheduled

Successfully assigned openshift-ingress/e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz to ip-10-0-141-49.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-6efc3a-5764b79d6f-g8zjt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-6efc3a-5764b79d6f-g8zjt to ip-10-0-137-250.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-krgcz

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-krgcz to ip-10-0-141-49.ec2.internal

openshift-ingress

e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2

Scheduled

Successfully assigned openshift-ingress/e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2 to ip-10-0-141-49.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-6v9xh

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6v9xh to ip-10-0-141-49.ec2.internal

openshift-ingress

e2e-migrate-ea7120c2-gw-openshift-default-58b6ff5668-t8qhz

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-ea7120c2-gw-openshift-default-58b6ff5668-t8qhz to ip-10-0-142-24.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-5d5f17-d578b8999-mzsnb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-5d5f17-d578b8999-mzsnb to ip-10-0-142-24.ec2.internal

openshift-ingress

e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz to ip-10-0-141-49.ec2.internal

openshift-ingress

e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr to ip-10-0-141-49.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-e04a57-67dbfd6794-jd7t7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-e04a57-67dbfd6794-jd7t7 to ip-10-0-137-250.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-32e859-99b7778f4-2vbvk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-32e859-99b7778f4-2vbvk to ip-10-0-137-250.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-5b1d24-7b97f774fd-rgbfb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-5b1d24-7b97f774fd-rgbfb to ip-10-0-141-49.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-a40054de-65f5d4bbf8-qqh87

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-a40054de-65f5d4bbf8-qqh87 to ip-10-0-137-250.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-a092eb-b98958fd6-5l68x

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-a092eb-b98958fd6-5l68x to ip-10-0-137-250.ec2.internal

openshift-ingress

e2e-shared-b-w3-5b1d24-openshift-default-66cdc54978-2rfzr

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-5b1d24-openshift-default-66cdc54978-2rfzr to ip-10-0-142-24.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-6efc3a-5d99d74854-67bq6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-6efc3a-5d99d74854-67bq6 to ip-10-0-137-250.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-kxf79

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-kxf79 to ip-10-0-137-250.ec2.internal

openshift-ingress

e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm to ip-10-0-141-49.ec2.internal

openshift-ingress

e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22 to ip-10-0-141-49.ec2.internal

openshift-ingress

e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd to ip-10-0-141-49.ec2.internal

openshift-ingress

e2e-derive-a40054de-openshift-default-5749884b64-pmt9k

Scheduled

Successfully assigned openshift-ingress/e2e-derive-a40054de-openshift-default-5749884b64-pmt9k to ip-10-0-141-49.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-d91c81-5d9ffd8dc8-xtd2b

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-d91c81-5d9ffd8dc8-xtd2b to ip-10-0-137-250.ec2.internal

openshift-ingress

payload-processing-e2e-ait-46fa710a-745df6ff4c-kpq2b

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-46fa710a-745df6ff4c-kpq2b to ip-10-0-137-250.ec2.internal

openshift-ingress

e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b to ip-10-0-137-250.ec2.internal

openshift-ingress

router-default-5885f47846-fxgw4

Scheduled

Successfully assigned openshift-ingress/router-default-5885f47846-fxgw4 to ip-10-0-141-49.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-73a747-5c9bc74799-2nlwc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-73a747-5c9bc74799-2nlwc to ip-10-0-137-250.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-5b1d24-858854d6d5-xp5pp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-5b1d24-858854d6d5-xp5pp to ip-10-0-141-49.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-32e859-6dd899b76c-g295f

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-32e859-6dd899b76c-g295f to ip-10-0-137-250.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-930288-5779cb7859-8fwlf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-930288-5779cb7859-8fwlf to ip-10-0-137-250.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-703730-779b45fd95-99bbv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-703730-779b45fd95-99bbv to ip-10-0-137-250.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-5d5f17-5d74866646-84lj8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-5d5f17-5d74866646-84lj8 to ip-10-0-137-250.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-ea7120c2-d86c6477d-hxpbq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-ea7120c2-d86c6477d-hxpbq to ip-10-0-137-250.ec2.internal

openshift-ingress

e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf

Scheduled

Successfully assigned openshift-ingress/e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf to ip-10-0-141-49.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-qghsb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-qghsb to ip-10-0-137-250.ec2.internal

openshift-ingress

e2e-explicit-a092eb-openshift-default-7c4b7d77dd-hspmw

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-a092eb-openshift-default-7c4b7d77dd-hspmw to ip-10-0-142-24.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-73c192-5656f579fd-22blv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-73c192-5656f579fd-22blv to ip-10-0-137-250.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-46fa710a-79f8d7d86b-pphhs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-46fa710a-79f8d7d86b-pphhs to ip-10-0-141-49.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-faf2bf41-59dd4df86-48g8f

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-faf2bf41-59dd4df86-48g8f to ip-10-0-137-250.ec2.internal

openshift-ingress

payload-processing-e2e-mt-c36aacf1-57558488cc-5d8gn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-c36aacf1-57558488cc-5d8gn to ip-10-0-137-250.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-eac764-79bf7f67bf-lp6sh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-eac764-79bf7f67bf-lp6sh to ip-10-0-141-49.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-ef54fd-78dc69c74c-z29dv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-ef54fd-78dc69c74c-z29dv to ip-10-0-137-250.ec2.internal

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-5885f47846 from 0 to 1

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer
(x8)

openshift-ingress

replicaset-controller

router-default-5885f47846

FailedCreate

Error creating: pods "router-default-5885f47846-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x16)

openshift-ingress

replicaset-controller

router-default-5885f47846

FailedCreate

Error creating: pods "router-default-5885f47846-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-5885f47846

SuccessfulCreate

Created pod: router-default-5885f47846-fxgw4
(x5)

openshift-ingress

kubelet

router-default-5885f47846-fxgw4

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x5)

openshift-ingress

kubelet

router-default-5885f47846-fxgw4

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found

openshift-ingress

multus

router-default-5885f47846-fxgw4

AddedInterface

Add eth0 [10.134.0.8/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-5885f47846-fxgw4

Started

Started container router

openshift-ingress

kubelet

router-default-5885f47846-fxgw4

Created

Created container: router

openshift-ingress

kubelet

router-default-5885f47846-fxgw4

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:da130d90f0bffd5c5876c94544c91b2a1be0d23ce2747ddfeafe88e03ee7d8d1" already present on machine
(x5)

openshift-ingress

replicaset-controller

kube-auth-proxy-6ff6468b6c

FailedCreate

Error creating: pods "kube-auth-proxy-6ff6468b6c-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-6ff6468b6c

SuccessfulCreate

Created pod: kube-auth-proxy-6ff6468b6c-lxdl9

openshift-ingress

replicaset-controller

kube-auth-proxy-6ff6468b6c

SuccessfulCreate

Created pod: kube-auth-proxy-6ff6468b6c-8k468

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-6ff6468b6c from 0 to 2

openshift-ingress

kubelet

kube-auth-proxy-6ff6468b6c-8k468

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

kubelet

kube-auth-proxy-6ff6468b6c-lxdl9

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-6ff6468b6c-lxdl9

AddedInterface

Add eth0 [10.132.0.16/23] from ovn-kubernetes

openshift-ingress

multus

kube-auth-proxy-6ff6468b6c-8k468

AddedInterface

Add eth0 [10.134.0.21/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-clxtk

openshift-ingress

kubelet

kube-auth-proxy-6ff6468b6c-lxdl9

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.668s (2.668s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-6ff6468b6c-lxdl9

Started

Started container kube-auth-proxy

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-clxtk

AddedInterface

Add eth0 [10.132.0.17/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-6ff6468b6c-lxdl9

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-6ff6468b6c-8k468

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-6ff6468b6c-8k468

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-6ff6468b6c-8k468

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.707s (2.707s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-clxtk

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-clxtk

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-clxtk

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.425s (2.425s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-clxtk

Started

Started container discovery

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-krgcz

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-krgcz

AddedInterface

Add eth0 [10.134.0.22/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-krgcz

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-krgcz

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.637s (2.637s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-krgcz

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-krgcz

Started

Started container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-g8pgk

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-g8pgk

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-g8pgk

AddedInterface

Add eth0 [10.133.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-g8pgk

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-g8pgk

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-g8pgk

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.048s (3.048s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-g8pgk

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-g8pgk

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-clxtk

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-clxtk

Killing

Stopping container discovery

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-6v9xh

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-6v9xh

AddedInterface

Add eth0 [10.134.0.25/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-kxf79

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-qghsb

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-qghsb

AddedInterface

Add eth0 [10.132.0.34/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-5b54b7fbb7-kxf79

AddedInterface

Add eth0 [10.132.0.33/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-qghsb

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-kxf79

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-qghsb

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-qghsb

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.75s (1.75s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-qghsb

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-kxf79

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.802s (1.802s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-kxf79

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-kxf79

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-6v9xh

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-6v9xh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-6v9xh

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-6v9xh

ProbeError

Startup probe error: Get "http://10.134.0.25:15021/healthz/ready": dial tcp 10.134.0.25:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-6v9xh

Unhealthy

Startup probe failed: Get "http://10.134.0.25:15021/healthz/ready": dial tcp 10.134.0.25:15021: connect: connection refused

openshift-ingress

GatewayAuthBootstrap

e2e-inf-a-6efc3a

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-inf-a-6efc3a-authn-ssl: envoyfilters.networking.istio.io "e2e-inf-a-6efc3a-authn-ssl" already exists

openshift-ingress

gateway_labeler_controller

e2e-inf-a-6efc3a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-6efc3a

openshift-ingress

deployment-controller

e2e-inf-a-6efc3a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-6efc3a-openshift-default-7764bfdffd from 0 to 1

openshift-ingress

multus

e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm

AddedInterface

Add eth0 [10.134.0.32/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-inf-a-6efc3a-openshift-default-7764bfdffd

SuccessfulCreate

Created pod: e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-6efc3a-5764b79d6f

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-6efc3a-5764b79d6f-g8zjt

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-6efc3a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-6efc3a-5d99d74854 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-6efc3a-5d99d74854

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-6efc3a-5d99d74854-67bq6

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-6efc3a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-6efc3a-5764b79d6f from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-6efc3a-5d99d74854

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-6efc3a-5d99d74854-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-6efc3a: serviceaccount "payload-processing-e2e-inf-a-6efc3a" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-6efc3a-5764b79d6f

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-6efc3a-5764b79d6f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-6efc3a: serviceaccount "payload-processing-e2e-inf-a-6efc3a" not found

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-6efc3a-5d99d74854-67bq6

AddedInterface

Add eth0 [10.132.0.39/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-inf-a-6efc3a-5764b79d6f-g8zjt

AddedInterface

Add eth0 [10.132.0.38/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-6efc3a-5764b79d6f-g8zjt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-6efc3a-5d99d74854-67bq6

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-6efc3a-5764b79d6f-g8zjt

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-6efc3a-5764b79d6f-g8zjt

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-6efc3a-5d99d74854-67bq6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-6efc3a-5d99d74854-67bq6

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-ait-faf2bf41-openshift-default-788b47cb8

SuccessfulCreate

Created pod: e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2

openshift-ingress

deployment-controller

e2e-ait-faf2bf41-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-faf2bf41-openshift-default-788b47cb8 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-faf2bf41

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-faf2bf41

openshift-ingress

replicaset-controller

e2e-autores-e04a57-openshift-default-677f6ddc6b

SuccessfulCreate

Created pod: e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf

openshift-ingress

multus

e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2

AddedInterface

Add eth0 [10.134.0.35/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-autores-e04a57-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-e04a57-openshift-default-677f6ddc6b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-autores-e04a57

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-e04a57

openshift-ingress

multus

e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf

AddedInterface

Add eth0 [10.134.0.36/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ait-faf2bf41

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-faf2bf41-ccd7c65f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-faf2bf41-59dd4df86

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-faf2bf41-59dd4df86-48g8f

openshift-ingress

multus

payload-processing-e2e-ait-faf2bf41-ccd7c65f-llj29

AddedInterface

Add eth0 [10.132.0.41/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-faf2bf41

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-faf2bf41-59dd4df86 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-faf2bf41-ccd7c65f-llj29

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-faf2bf41-59dd4df86-48g8f

AddedInterface

Add eth0 [10.132.0.40/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-faf2bf41-ccd7c65f

SuccessfulCreate

Created pod: payload-processing-e2e-ait-faf2bf41-ccd7c65f-llj29

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-faf2bf41-59dd4df86-48g8f

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-faf2bf41-59dd4df86-48g8f

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-faf2bf41-59dd4df86-48g8f

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-faf2bf41-ccd7c65f-llj29

Created

Created container: payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-faf2bf41-59dd4df86

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-faf2bf41-59dd4df86-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-faf2bf41: serviceaccount "payload-processing-e2e-ait-faf2bf41" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-faf2bf41-ccd7c65f

FailedCreate

Error creating: pods "payload-processing-e2e-ait-faf2bf41-ccd7c65f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-faf2bf41: serviceaccount "payload-processing-e2e-ait-faf2bf41" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-e04a57

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-e04a57-67dbfd6794 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-autores-e04a57

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-e04a57-587545b5f7 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-e04a57-587545b5f7

FailedCreate

Error creating: pods "payload-processing-e2e-autores-e04a57-587545b5f7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-e04a57: serviceaccount "payload-processing-e2e-autores-e04a57" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-e04a57-67dbfd6794

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-e04a57-67dbfd6794-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-e04a57: serviceaccount "payload-processing-e2e-autores-e04a57" not found

openshift-ingress

kubelet

payload-processing-e2e-ait-faf2bf41-ccd7c65f-llj29

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-autores-e04a57-587545b5f7-9kf8f

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-e04a57-67dbfd6794-jd7t7

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-e04a57-587545b5f7-9kf8f

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-autores-e04a57-587545b5f7-9kf8f

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-e04a57-67dbfd6794

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-e04a57-67dbfd6794-jd7t7

openshift-ingress

multus

payload-pre-processing-e2e-autores-e04a57-67dbfd6794-jd7t7

AddedInterface

Add eth0 [10.132.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-e04a57-67dbfd6794-jd7t7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-e04a57-587545b5f7

SuccessfulCreate

Created pod: payload-processing-e2e-autores-e04a57-587545b5f7-9kf8f

openshift-ingress

kubelet

payload-processing-e2e-autores-e04a57-587545b5f7-9kf8f

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-e04a57-67dbfd6794-jd7t7

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm

ProbeError

Readiness probe error: Get "http://10.134.0.32:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm

Unhealthy

Readiness probe failed: Get "http://10.134.0.32:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2

Unhealthy

Readiness probe failed: Get "http://10.134.0.35:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2

ProbeError

Readiness probe error: Get "http://10.134.0.35:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm

ProbeError

Startup probe error: Get "http://10.134.0.32:15021/healthz/ready": dial tcp 10.134.0.32:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm

Unhealthy

Startup probe failed: Get "http://10.134.0.32:15021/healthz/ready": dial tcp 10.134.0.32:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2

Started

Started container istio-proxy

openshift-ingress

replicaset-controller

e2e-inf-b-5d5f17-openshift-default-c968b5d48

SuccessfulCreate

Created pod: e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22

openshift-ingress

multus

e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22

AddedInterface

Add eth0 [10.134.0.38/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-inf-b-5d5f17

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-5d5f17

openshift-ingress

deployment-controller

e2e-inf-b-5d5f17-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-5d5f17-openshift-default-c968b5d48 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-5d5f17-5d74866646

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-5d5f17-5d74866646-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-5d5f17: serviceaccount "payload-processing-e2e-inf-b-5d5f17" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-5d5f17

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-5d5f17-5d74866646 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-5d5f17-d578b8999

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-5d5f17-d578b8999-mzsnb

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-5d5f17

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-5d5f17-d578b8999 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-5d5f17-d578b8999

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-5d5f17-d578b8999-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-5d5f17: serviceaccount "payload-processing-e2e-inf-b-5d5f17" not found
(x6)

openshift-ingress

kubelet

e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2

ProbeError

Startup probe error: Get "http://10.134.0.35:15021/healthz/ready": dial tcp 10.134.0.35:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2

Unhealthy

Startup probe failed: Get "http://10.134.0.35:15021/healthz/ready": dial tcp 10.134.0.35:15021: connect: connection refused

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-5d5f17-5d74866646

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-5d5f17-5d74866646-84lj8

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-5d5f17-5d74866646-84lj8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-5d5f17-5d74866646-84lj8

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-inf-b-5d5f17-d578b8999-mzsnb

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-5d5f17-5d74866646-84lj8

AddedInterface

Add eth0 [10.132.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-5d5f17-d578b8999-mzsnb

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-5d5f17-5d74866646-84lj8

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-b-5d5f17-d578b8999-mzsnb

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.701s (1.701s including waiting). Image size: 166449337 bytes.
(x2)

openshift-ingress

kubelet

e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf

Started

Started container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-inf-b-5d5f17-d578b8999-mzsnb

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-5d5f17-d578b8999-mzsnb

Created

Created container: payload-processing
(x6)

openshift-ingress

kubelet

e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf

Unhealthy

Startup probe failed: Get "http://10.134.0.36:15021/healthz/ready": dial tcp 10.134.0.36:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf

ProbeError

Startup probe error: Get "http://10.134.0.36:15021/healthz/ready": dial tcp 10.134.0.36:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-ait-faf2bf41-openshift-default-788b47cb8-s9jf2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-faf2bf41-59dd4df86-48g8f

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-faf2bf41-ccd7c65f-llj29

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-migrate-ea7120c2-gw-openshift-default-58b6ff5668

SuccessfulCreate

Created pod: e2e-migrate-ea7120c2-gw-openshift-default-58b6ff5668-t8qhz

openshift-ingress

deployment-controller

e2e-migrate-ea7120c2-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-ea7120c2-gw-openshift-default-58b6ff5668 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-migrate-ea7120c2-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-ea7120c2-gw

openshift-ingress

kubelet

e2e-migrate-ea7120c2-gw-openshift-default-58b6ff5668-t8qhz

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

e2e-migrate-ea7120c2-gw-openshift-default-58b6ff5668-t8qhz

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-migrate-ea7120c2-gw-openshift-default-58b6ff5668-t8qhz

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.698s (2.698s including waiting). Image size: 181318953 bytes.
(x5)

openshift-ingress

kubelet

e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22

Unhealthy

Startup probe failed: Get "http://10.134.0.38:15021/healthz/ready": dial tcp 10.134.0.38:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22

ProbeError

Startup probe error: Get "http://10.134.0.38:15021/healthz/ready": dial tcp 10.134.0.38:15021: connect: connection refused body:
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-ea7120c2-5b579c9cc4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-ea7120c2-5b579c9cc4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-ea7120c2: serviceaccount "payload-processing-e2e-migrate-ea7120c2" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-ea7120c2-d86c6477d

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-ea7120c2-d86c6477d-hxpbq
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-ea7120c2-d86c6477d

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-ea7120c2-d86c6477d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-ea7120c2: serviceaccount "payload-processing-e2e-migrate-ea7120c2" not found

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-ea7120c2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-ea7120c2-d86c6477d from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-ea7120c2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-ea7120c2-5b579c9cc4 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-ea7120c2-5b579c9cc4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-ea7120c2-5b579c9cc4-bwj8q

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-ea7120c2-5b579c9cc4-bwj8q

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-e2e-migrate-ea7120c2-5b579c9cc4-bwj8q

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-ea7120c2-d86c6477d-hxpbq

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-ea7120c2-d86c6477d-hxpbq

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-ea7120c2-d86c6477d-hxpbq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-migrate-ea7120c2-d86c6477d-hxpbq

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-ea7120c2-5b579c9cc4-bwj8q

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.205s (2.205s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-ea7120c2-5b579c9cc4-bwj8q

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-ea7120c2-5b579c9cc4-bwj8q

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-migrate-ea7120c2-gw-openshift-default-58b6ff5668-t8qhz

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-ea7120c2-gw-openshift-default-58b6ff5668-t8qhz

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-migrate-ea7120c2-gw-openshift-default-58b6ff5668-t8qhz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-migrate-ea7120c2-gw-openshift-default-58b6ff5668-t8qhz

Unhealthy

Startup probe failed: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-migrate-ea7120c2-gw-openshift-default-58b6ff5668-t8qhz

ProbeError

Startup probe error: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-e04a57-67dbfd6794-jd7t7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-e04a57-587545b5f7-9kf8f

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-autores-e04a57

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-autores-e04a57: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-autores-e04a57": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-autores-e04a57, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 4ec6d029-061b-4d30-a08c-6fd11a150842, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-ea7120c2-5b579c9cc4-bwj8q

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-ea7120c2-d86c6477d-hxpbq

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-migrate-ea7120c2

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-migrate-ea7120c2: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-migrate-ea7120c2": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-migrate-ea7120c2, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 21e097b3-aec1-4d01-99c9-fadf2d60ddaf, UID in object meta:

openshift-ingress

deployment-controller

e2e-ait-46fa710a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-46fa710a-openshift-default-57f46c4bd8 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-46fa710a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-46fa710a

openshift-ingress

kubelet

e2e-migrate-ea7120c2-gw-openshift-default-58b6ff5668-t8qhz

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-ait-46fa710a-openshift-default-57f46c4bd8

SuccessfulCreate

Created pod: e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4

openshift-ingress

kubelet

e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-autores-e04a57-openshift-default-677f6ddc6b-g9hkf

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-explicit-a092eb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-a092eb-openshift-default-7c4b7d77dd from 0 to 1

openshift-ingress

multus

e2e-explicit-a092eb-openshift-default-7c4b7d77dd-hspmw

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-explicit-a092eb-openshift-default-7c4b7d77dd

SuccessfulCreate

Created pod: e2e-explicit-a092eb-openshift-default-7c4b7d77dd-hspmw

openshift-ingress

gateway_labeler_controller

e2e-explicit-a092eb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-a092eb

openshift-ingress

deployment-controller

payload-processing-e2e-ait-46fa710a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-46fa710a-745df6ff4c from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-46fa710a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-46fa710a-79f8d7d86b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-46fa710a-79f8d7d86b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-46fa710a-79f8d7d86b-pphhs
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-46fa710a-79f8d7d86b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-46fa710a-79f8d7d86b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-46fa710a: serviceaccount "payload-processing-e2e-ait-46fa710a" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-46fa710a-745df6ff4c

SuccessfulCreate

Created pod: payload-processing-e2e-ait-46fa710a-745df6ff4c-kpq2b
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-46fa710a-745df6ff4c

FailedCreate

Error creating: pods "payload-processing-e2e-ait-46fa710a-745df6ff4c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-46fa710a: serviceaccount "payload-processing-e2e-ait-46fa710a" not found

openshift-ingress

multus

payload-pre-processing-e2e-ait-46fa710a-79f8d7d86b-pphhs

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-46fa710a-745df6ff4c-kpq2b

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-46fa710a-79f8d7d86b-pphhs

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-46fa710a-79f8d7d86b-pphhs

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-46fa710a-79f8d7d86b-pphhs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-46fa710a-745df6ff4c-kpq2b

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-ait-46fa710a-745df6ff4c-kpq2b

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-46fa710a-745df6ff4c-kpq2b

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-a092eb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-a092eb-68bc75587c from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-a092eb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-a092eb-b98958fd6 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-a092eb-68bc75587c

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-a092eb-68bc75587c-586bb

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-a092eb-b98958fd6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-a092eb-b98958fd6-5l68x
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-a092eb-68bc75587c

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-a092eb-68bc75587c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-a092eb: serviceaccount "payload-processing-e2e-explicit-a092eb" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-a092eb-b98958fd6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-a092eb-b98958fd6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-a092eb: serviceaccount "payload-processing-e2e-explicit-a092eb" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-a092eb-b98958fd6-5l68x

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-explicit-a092eb-b98958fd6-5l68x

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-a092eb-b98958fd6-5l68x

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-explicit-a092eb-68bc75587c-586bb

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-a092eb-b98958fd6-5l68x

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-a092eb-68bc75587c-586bb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-explicit-a092eb-68bc75587c-586bb

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-a092eb-68bc75587c-586bb

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4

Unhealthy

Readiness probe failed: Get "http://10.134.0.43:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4

ProbeError

Readiness probe error: Get "http://10.134.0.43:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4

Unhealthy

Startup probe failed: Get "http://10.134.0.43:15021/healthz/ready": dial tcp 10.134.0.43:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4

ProbeError

Startup probe error: Get "http://10.134.0.43:15021/healthz/ready": dial tcp 10.134.0.43:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-explicit-a092eb-openshift-default-7c4b7d77dd-hspmw

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-a092eb-openshift-default-7c4b7d77dd-hspmw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-a092eb-openshift-default-7c4b7d77dd-hspmw

Created

Created container: istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ait-46fa710a-745df6ff4c-kpq2b

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ait-46fa710a

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ait-46fa710a: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ait-46fa710a": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ait-46fa710a, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 3eaddade-425a-4447-8d11-5f19cc3d7b8c, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-46fa710a-79f8d7d86b-pphhs

Killing

Stopping container payload-pre-processing
(x6)

openshift-ingress

kubelet

e2e-explicit-a092eb-openshift-default-7c4b7d77dd-hspmw

ProbeError

Startup probe error: Get "http://10.133.0.59:15021/healthz/ready": dial tcp 10.133.0.59:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-explicit-a092eb-openshift-default-7c4b7d77dd-hspmw

Unhealthy

Startup probe failed: Get "http://10.133.0.59:15021/healthz/ready": dial tcp 10.133.0.59:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-derive-a40054de

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-a40054de

openshift-ingress

kubelet

e2e-ait-46fa710a-openshift-default-57f46c4bd8-xp6q4

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-derive-a40054de-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-a40054de-openshift-default-5749884b64 from 0 to 1

openshift-ingress

replicaset-controller

e2e-derive-a40054de-openshift-default-5749884b64

SuccessfulCreate

Created pod: e2e-derive-a40054de-openshift-default-5749884b64-pmt9k

openshift-ingress

multus

e2e-derive-a40054de-openshift-default-5749884b64-pmt9k

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-a40054de-65f5d4bbf8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-a40054de-65f5d4bbf8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-a40054de: serviceaccount "payload-processing-e2e-derive-a40054de" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-a40054de

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-a40054de-65f5d4bbf8 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-derive-a40054de

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-a40054de-6d449774d5 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-a40054de-65f5d4bbf8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-a40054de-65f5d4bbf8-qqh87

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-a40054de-6d449774d5

SuccessfulCreate

Created pod: payload-processing-e2e-derive-a40054de-6d449774d5-jvwdt
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-a40054de-6d449774d5

FailedCreate

Error creating: pods "payload-processing-e2e-derive-a40054de-6d449774d5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-a40054de: serviceaccount "payload-processing-e2e-derive-a40054de" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-a40054de-65f5d4bbf8-qqh87

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-a40054de-6d449774d5-jvwdt

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-a40054de-6d449774d5-jvwdt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-derive-a40054de-6d449774d5-jvwdt

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-a40054de-6d449774d5-jvwdt

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-derive-a40054de-65f5d4bbf8-qqh87

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-a40054de-65f5d4bbf8-qqh87

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-a40054de-65f5d4bbf8-qqh87

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-derive-a40054de-openshift-default-5749884b64-pmt9k

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-a40054de-openshift-default-5749884b64-pmt9k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-a40054de-openshift-default-5749884b64-pmt9k

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-derive-a40054de-openshift-default-5749884b64-pmt9k

ProbeError

Startup probe error: Get "http://10.134.0.48:15021/healthz/ready": dial tcp 10.134.0.48:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-derive-a40054de-openshift-default-5749884b64-pmt9k

Unhealthy

Startup probe failed: Get "http://10.134.0.48:15021/healthz/ready": dial tcp 10.134.0.48:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-a40054de-65f5d4bbf8-qqh87

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-derive-a40054de

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-derive-a40054de: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-derive-a40054de": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-derive-a40054de, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 9480450c-9497-48f7-8abd-9ee1f5b00c8e, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-derive-a40054de-6d449774d5-jvwdt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-derive-a40054de-openshift-default-5749884b64-pmt9k

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-explicit-a092eb-68bc75587c-586bb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-a092eb-b98958fd6-5l68x

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-explicit-a092eb-openshift-default-7c4b7d77dd-hspmw

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-noten-3f08e4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-3f08e4

openshift-ingress

kubelet

e2e-noten-3f08e4-openshift-default-78fc7784-vrsv6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

replicaset-controller

e2e-noten-3f08e4-openshift-default-78fc7784

SuccessfulCreate

Created pod: e2e-noten-3f08e4-openshift-default-78fc7784-vrsv6

openshift-ingress

multus

e2e-noten-3f08e4-openshift-default-78fc7784-vrsv6

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-noten-3f08e4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-3f08e4-openshift-default-78fc7784 from 0 to 1

openshift-ingress

kubelet

e2e-noten-3f08e4-openshift-default-78fc7784-vrsv6

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-noten-3f08e4-openshift-default-78fc7784-vrsv6

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-noten-3f08e4-openshift-default-78fc7784-vrsv6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-noten-3f08e4-openshift-default-78fc7784-vrsv6

Unhealthy

Readiness probe failed: Get "http://10.134.0.52:15021/healthz/ready": dial tcp 10.134.0.52:15021: connect: connection refused

openshift-ingress

kubelet

e2e-noten-3f08e4-openshift-default-78fc7784-vrsv6

ProbeError

Readiness probe error: Get "http://10.134.0.52:15021/healthz/ready": dial tcp 10.134.0.52:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-inf-a-6efc3a-5764b79d6f-g8zjt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-6efc3a-5d99d74854-67bq6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-a-6efc3a-openshift-default-7764bfdffd-qlxsm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-5d5f17-5d74866646-84lj8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-5d5f17-d578b8999-mzsnb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-b-5d5f17-openshift-default-c968b5d48-9lm22

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb

SuccessfulCreate

Created pod: e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg

openshift-ingress

deployment-controller

e2e-shared-a-w3-ef54fd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-ef54fd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-ef54fd

openshift-ingress

multus

e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-ef54fd-78dc69c74c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-ef54fd-78dc69c74c-z29dv

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-ef54fd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-ef54fd-78dc69c74c from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-ef54fd-7f9584dff4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-ef54fd-7f9584dff4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-ef54fd: serviceaccount "payload-processing-e2e-shared-a-w3-ef54fd" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-ef54fd-7f9584dff4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-ef54fd-7f9584dff4-c2dth

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-ef54fd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-ef54fd-7f9584dff4 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-ef54fd-78dc69c74c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-ef54fd-78dc69c74c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-ef54fd: serviceaccount "payload-processing-e2e-shared-a-w3-ef54fd" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-ef54fd-78dc69c74c-z29dv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-ef54fd-78dc69c74c-z29dv

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-ef54fd-7f9584dff4-c2dth

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-ef54fd-78dc69c74c-z29dv

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-ef54fd-7f9584dff4-c2dth

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-ef54fd-7f9584dff4-c2dth

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-ef54fd-7f9584dff4-c2dth

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-ef54fd-78dc69c74c-z29dv

Started

Started container payload-processing

openshift-ingress

replicaset-controller

e2e-mt-01e18c68-openshift-default-8c454b4d4

SuccessfulCreate

Created pod: e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2

openshift-ingress

multus

e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-mt-01e18c68-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-01e18c68-openshift-default-8c454b4d4 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-01e18c68

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-01e18c68

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-01e18c68-86694fbfb9

SuccessfulCreate

Created pod: payload-processing-e2e-mt-01e18c68-86694fbfb9-hnjxs

openshift-ingress

kubelet

payload-processing-e2e-mt-01e18c68-86694fbfb9-hnjxs

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-01e18c68-86694fbfb9-hnjxs

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-01e18c68-86694fbfb9-hnjxs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-01e18c68-86694fbfb9

FailedCreate

Error creating: pods "payload-processing-e2e-mt-01e18c68-86694fbfb9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-01e18c68: serviceaccount "payload-processing-e2e-mt-01e18c68" not found

openshift-ingress

multus

payload-processing-e2e-mt-01e18c68-86694fbfb9-hnjxs

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-mt-01e18c68

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-01e18c68-86694fbfb9 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-mt-01e18c68-69b469864b-qhqlv

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-01e18c68

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-01e18c68-69b469864b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-01e18c68-69b469864b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-01e18c68-69b469864b-qhqlv
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-01e18c68-69b469864b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-01e18c68-69b469864b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-01e18c68: serviceaccount "payload-processing-e2e-mt-01e18c68" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-01e18c68-69b469864b-qhqlv

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-01e18c68-69b469864b-qhqlv

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-01e18c68-69b469864b-qhqlv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg

ProbeError

Readiness probe error: Get "http://10.134.0.55:15021/healthz/ready": read tcp 10.134.0.2:45350->10.134.0.55:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg

Unhealthy

Readiness probe failed: Get "http://10.134.0.55:15021/healthz/ready": read tcp 10.134.0.2:45350->10.134.0.55:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg

ProbeError

Startup probe error: Get "http://10.134.0.55:15021/healthz/ready": dial tcp 10.134.0.55:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg

Unhealthy

Startup probe failed: Get "http://10.134.0.55:15021/healthz/ready": dial tcp 10.134.0.55:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-5b1d24

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-5b1d24

openshift-ingress

deployment-controller

e2e-shared-b-w3-5b1d24-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-5b1d24-openshift-default-66cdc54978 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w3-5b1d24-openshift-default-66cdc54978

SuccessfulCreate

Created pod: e2e-shared-b-w3-5b1d24-openshift-default-66cdc54978-2rfzr

openshift-ingress

multus

e2e-shared-b-w3-5b1d24-openshift-default-66cdc54978-2rfzr

AddedInterface

Add eth0 [10.133.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2

ProbeError

Readiness probe error: Get "http://10.134.0.57:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2

Unhealthy

Readiness probe failed: Get "http://10.134.0.57:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2

Created

Created container: istio-proxy

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-5b1d24

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-5b1d24-858854d6d5 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-5b1d24-7b97f774fd-rgbfb

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-5b1d24-858854d6d5-xp5pp

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-5b1d24-858854d6d5-xp5pp

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-5b1d24-7b97f774fd-rgbfb

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-5b1d24-7b97f774fd-rgbfb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-5b1d24

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-5b1d24-7b97f774fd from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-5b1d24-7b97f774fd-rgbfb

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-5b1d24-7b97f774fd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-5b1d24-7b97f774fd-rgbfb
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-5b1d24-7b97f774fd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-5b1d24-7b97f774fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-5b1d24: serviceaccount "payload-processing-e2e-shared-b-w3-5b1d24" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-5b1d24-858854d6d5

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-5b1d24-858854d6d5-xp5pp

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-5b1d24-858854d6d5-xp5pp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-5b1d24-858854d6d5

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-5b1d24-858854d6d5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-5b1d24: serviceaccount "payload-processing-e2e-shared-b-w3-5b1d24" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-5b1d24-858854d6d5-xp5pp

Started

Started container payload-processing
(x5)

openshift-ingress

kubelet

e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2

ProbeError

Startup probe error: Get "http://10.134.0.57:15021/healthz/ready": dial tcp 10.134.0.57:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2

Unhealthy

Startup probe failed: Get "http://10.134.0.57:15021/healthz/ready": dial tcp 10.134.0.57:15021: connect: connection refused

openshift-ingress

kubelet

e2e-shared-b-w3-5b1d24-openshift-default-66cdc54978-2rfzr

Unhealthy

Readiness probe failed: Get "http://10.133.0.65:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-b-w3-5b1d24-openshift-default-66cdc54978-2rfzr

ProbeError

Readiness probe error: Get "http://10.133.0.65:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-5b1d24-openshift-default-66cdc54978-2rfzr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-5b1d24-openshift-default-66cdc54978-2rfzr

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-5b1d24-openshift-default-66cdc54978-2rfzr

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-5b1d24-openshift-default-66cdc54978-2rfzr

Unhealthy

Startup probe failed: Get "http://10.133.0.65:15021/healthz/ready": dial tcp 10.133.0.65:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-5b1d24-openshift-default-66cdc54978-2rfzr

ProbeError

Startup probe error: Get "http://10.133.0.65:15021/healthz/ready": dial tcp 10.133.0.65:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-01e18c68-69b469864b-qhqlv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-01e18c68-86694fbfb9-hnjxs

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-01e18c68-openshift-default-8c454b4d4-p4qk2

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

e2e-shared-a-w2-eac764-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd

SuccessfulCreate

Created pod: e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-eac764

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-eac764

openshift-ingress

multus

e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-eac764

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-eac764-79bf7f67bf from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-eac764-574cd78f86

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-eac764-574cd78f86-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-eac764: serviceaccount "payload-processing-e2e-shared-a-w2-eac764" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-eac764-574cd78f86

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-eac764-574cd78f86-srh7c

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-eac764

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-eac764-574cd78f86 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-eac764-79bf7f67bf

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-eac764-79bf7f67bf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-eac764: serviceaccount "payload-processing-e2e-shared-a-w2-eac764" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-eac764-79bf7f67bf

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-eac764-79bf7f67bf-lp6sh

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-eac764-574cd78f86-srh7c

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-eac764-79bf7f67bf-lp6sh

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-eac764-574cd78f86-srh7c

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-eac764-574cd78f86-srh7c

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-eac764-79bf7f67bf-lp6sh

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-eac764-79bf7f67bf-lp6sh

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-eac764-79bf7f67bf-lp6sh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-eac764-574cd78f86-srh7c

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd

ProbeError

Readiness probe error: Get "http://10.134.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd

Unhealthy

Readiness probe failed: Get "http://10.134.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd

ProbeError

Startup probe error: Get "http://10.134.0.62:15021/healthz/ready": dial tcp 10.134.0.62:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd

Unhealthy

Startup probe failed: Get "http://10.134.0.62:15021/healthz/ready": dial tcp 10.134.0.62:15021: connect: connection refused

openshift-ingress

multus

e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-32e859

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-32e859

openshift-ingress

deployment-controller

e2e-shared-b-w2-32e859-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-32e859-openshift-default-766b6c755b from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w2-32e859-openshift-default-766b6c755b

SuccessfulCreate

Created pod: e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-32e859-99b7778f4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-32e859-99b7778f4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-32e859: serviceaccount "payload-processing-e2e-shared-b-w2-32e859" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-32e859-6dd899b76c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-32e859-6dd899b76c-g295f
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-32e859-6dd899b76c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-32e859-6dd899b76c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-32e859: serviceaccount "payload-processing-e2e-shared-b-w2-32e859" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-32e859

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-32e859-6dd899b76c from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-32e859

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-32e859-99b7778f4 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-32e859-99b7778f4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-32e859-99b7778f4-2vbvk

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-32e859-99b7778f4-2vbvk

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-32e859-6dd899b76c-g295f

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-32e859-6dd899b76c-g295f

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-32e859-6dd899b76c-g295f

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-32e859-99b7778f4-2vbvk

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-32e859-99b7778f4-2vbvk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-32e859-99b7778f4-2vbvk

AddedInterface

Add eth0 [10.132.0.62/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-32e859-6dd899b76c-g295f

AddedInterface

Add eth0 [10.132.0.63/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9

ProbeError

Startup probe error: Get "http://10.134.0.64:15021/healthz/ready": dial tcp 10.134.0.64:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9

Unhealthy

Startup probe failed: Get "http://10.134.0.64:15021/healthz/ready": dial tcp 10.134.0.64:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-mt-c36aacf1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-c36aacf1-openshift-default-789c94cc6 from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-c36aacf1-openshift-default-789c94cc6

SuccessfulCreate

Created pod: e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz

openshift-ingress

gateway_labeler_controller

e2e-mt-c36aacf1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-c36aacf1

openshift-ingress

multus

e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-c36aacf1-57558488cc

SuccessfulCreate

Created pod: payload-processing-e2e-mt-c36aacf1-57558488cc-5d8gn
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-c36aacf1-85cc79b9bb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-c36aacf1-85cc79b9bb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-c36aacf1: serviceaccount "payload-processing-e2e-mt-c36aacf1" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-c36aacf1-85cc79b9bb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-c36aacf1-85cc79b9bb-w4qhq

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-c36aacf1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-c36aacf1-85cc79b9bb from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-mt-c36aacf1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-c36aacf1-57558488cc from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-c36aacf1-57558488cc

FailedCreate

Error creating: pods "payload-processing-e2e-mt-c36aacf1-57558488cc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-c36aacf1: serviceaccount "payload-processing-e2e-mt-c36aacf1" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-c36aacf1-85cc79b9bb-w4qhq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-c36aacf1-57558488cc-5d8gn

AddedInterface

Add eth0 [10.132.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-c36aacf1-57558488cc-5d8gn

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-c36aacf1-57558488cc-5d8gn

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-c36aacf1-57558488cc-5d8gn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-c36aacf1-85cc79b9bb-w4qhq

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-c36aacf1-85cc79b9bb-w4qhq

AddedInterface

Add eth0 [10.132.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-c36aacf1-85cc79b9bb-w4qhq

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz

ProbeError

Startup probe error: Get "http://10.134.0.69:15021/healthz/ready": dial tcp 10.134.0.69:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz

Unhealthy

Startup probe failed: Get "http://10.134.0.69:15021/healthz/ready": dial tcp 10.134.0.69:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-c36aacf1-85cc79b9bb-w4qhq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-c36aacf1-57558488cc-5d8gn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-c36aacf1-openshift-default-789c94cc6-n4ngz

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-api-a-73c192

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-73c192

openshift-ingress

deployment-controller

e2e-api-a-73c192-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-73c192-openshift-default-7996b4f8db from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-73c192-openshift-default-7996b4f8db

SuccessfulCreate

Created pod: e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr

openshift-ingress

multus

e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr

AddedInterface

Add eth0 [10.134.0.71/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-73c192-5656f579fd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-73c192-5656f579fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-73c192: serviceaccount "payload-processing-e2e-api-a-73c192" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-73c192-5656f579fd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-73c192-5656f579fd-22blv

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-73c192

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-73c192-5656f579fd from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-73c192

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-73c192-856b5dcd4f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-73c192-856b5dcd4f

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-73c192-856b5dcd4f-p98jc
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-73c192-856b5dcd4f

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-73c192-856b5dcd4f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-73c192: serviceaccount "payload-processing-e2e-api-a-73c192" not found

openshift-ingress

kubelet

payload-processing-e2e-api-a-73c192-856b5dcd4f-p98jc

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-a-73c192-5656f579fd-22blv

AddedInterface

Add eth0 [10.132.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-73c192-856b5dcd4f-p98jc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-a-73c192-856b5dcd4f-p98jc

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-73c192-5656f579fd-22blv

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-73c192-5656f579fd-22blv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-api-a-73c192-856b5dcd4f-p98jc

AddedInterface

Add eth0 [10.132.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-73c192-5656f579fd-22blv

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

replicaset-controller

e2e-api-b-d91c81-openshift-default-569f76d9b6

SuccessfulCreate

Created pod: e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd
(x5)

openshift-ingress

kubelet

e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr

ProbeError

Startup probe error: Get "http://10.134.0.71:15021/healthz/ready": dial tcp 10.134.0.71:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr

Unhealthy

Startup probe failed: Get "http://10.134.0.71:15021/healthz/ready": dial tcp 10.134.0.71:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-api-b-d91c81-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-d91c81-openshift-default-569f76d9b6 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-d91c81

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-d91c81

openshift-ingress

multus

e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd

AddedInterface

Add eth0 [10.134.0.74/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-d91c81

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-d91c81-5fd5cb655c from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-d91c81-5fd5cb655c

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-d91c81-5fd5cb655c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-d91c81: serviceaccount "payload-processing-e2e-api-b-d91c81" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-d91c81

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-d91c81-5d9ffd8dc8 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-d91c81-5d9ffd8dc8-xtd2b

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-d91c81-5d9ffd8dc8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-d91c81-5d9ffd8dc8-xtd2b

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-d91c81-5fd5cb655c

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-d91c81-5fd5cb655c-9gpgx
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-d91c81-5d9ffd8dc8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-d91c81-5d9ffd8dc8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-d91c81: serviceaccount "payload-processing-e2e-api-b-d91c81" not found

openshift-ingress

kubelet

payload-processing-e2e-api-b-d91c81-5fd5cb655c-9gpgx

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-d91c81-5fd5cb655c-9gpgx

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-d91c81-5fd5cb655c-9gpgx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-d91c81-5d9ffd8dc8-xtd2b

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-api-b-d91c81-5fd5cb655c-9gpgx

AddedInterface

Add eth0 [10.132.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-d91c81-5d9ffd8dc8-xtd2b

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-b-d91c81-5d9ffd8dc8-xtd2b

AddedInterface

Add eth0 [10.132.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd

ProbeError

Readiness probe error: Get "http://10.134.0.74:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd

Unhealthy

Readiness probe failed: Get "http://10.134.0.74:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd

Unhealthy

Startup probe failed: Get "http://10.134.0.74:15021/healthz/ready": dial tcp 10.134.0.74:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd

ProbeError

Startup probe error: Get "http://10.134.0.74:15021/healthz/ready": dial tcp 10.134.0.74:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-api-a-73c192-856b5dcd4f-p98jc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-73c192-5656f579fd-22blv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-a-73c192-openshift-default-7996b4f8db-nnfxr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-d91c81-5d9ffd8dc8-xtd2b

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-d91c81-5fd5cb655c-9gpgx

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-api-b-d91c81

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-api-b-d91c81: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-api-b-d91c81": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-api-b-d91c81, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: bef1d18e-4821-484e-9a56-10cb3bfae929, UID in object meta:

openshift-ingress

kubelet

e2e-api-b-d91c81-openshift-default-569f76d9b6-jsbpd

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b

AddedInterface

Add eth0 [10.132.0.78/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-a-73a747-openshift-default-58f985f584

SuccessfulCreate

Created pod: e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b

openshift-ingress

deployment-controller

e2e-ipp-a-73a747-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-73a747-openshift-default-58f985f584 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-73a747

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-73a747

openshift-ingress

kubelet

e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.884s (2.884s including waiting). Image size: 181318953 bytes.

openshift-ingress

multus

payload-processing-e2e-ipp-a-73a747-5c9bc74799-2nlwc

AddedInterface

Add eth0 [10.132.0.80/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-73a747-5c9bc74799-2nlwc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-73a747-5c9bc74799

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-73a747-5c9bc74799-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-73a747: serviceaccount "payload-processing-e2e-ipp-a-73a747" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-73a747-5c9bc74799

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-73a747-5c9bc74799-2nlwc

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-73a747

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-73a747-5c9bc74799 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-eac764-574cd78f86-srh7c

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-73a747

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-73a747-78fb5559c8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-73a747-78fb5559c8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-73a747-78fb5559c8-445n2

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-73a747-78fb5559c8-445n2

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-73a747-78fb5559c8-445n2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-73a747-78fb5559c8-445n2

AddedInterface

Add eth0 [10.132.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-73a747-78fb5559c8-445n2

Started

Started container payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-73a747-78fb5559c8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-73a747-78fb5559c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-73a747: serviceaccount "payload-processing-e2e-ipp-a-73a747" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-eac764-79bf7f67bf-lp6sh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-73a747-5c9bc74799-2nlwc

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-73a747-5c9bc74799-2nlwc

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w2-eac764-openshift-default-ff86bc7fd-9r6wd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b

Unhealthy

Readiness probe failed: Get "http://10.132.0.78:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b

ProbeError

Readiness probe error: Get "http://10.132.0.78:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-32e859-99b7778f4-2vbvk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-32e859-6dd899b76c-g295f

Killing

Stopping container payload-processing
(x5)

openshift-ingress

kubelet

e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b

Unhealthy

Startup probe failed: Get "http://10.132.0.78:15021/healthz/ready": dial tcp 10.132.0.78:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b

ProbeError

Startup probe error: Get "http://10.132.0.78:15021/healthz/ready": dial tcp 10.132.0.78:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-ipp-b-930288-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-930288-openshift-default-674786887b from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-930288-openshift-default-674786887b

SuccessfulCreate

Created pod: e2e-ipp-b-930288-openshift-default-674786887b-4hthg

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-930288

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-930288

openshift-ingress

multus

e2e-ipp-b-930288-openshift-default-674786887b-4hthg

AddedInterface

Add eth0 [10.134.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w2-32e859-openshift-default-766b6c755b-t8qg9

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-930288-6f68f56fdb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-930288-6f68f56fdb-65q49
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-930288-6f68f56fdb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-930288-6f68f56fdb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-930288: serviceaccount "payload-processing-e2e-ipp-b-930288" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-930288

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-930288-5779cb7859 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-930288-5779cb7859

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-930288-5779cb7859-8fwlf
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-930288-5779cb7859

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-930288-5779cb7859-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-930288: serviceaccount "payload-processing-e2e-ipp-b-930288" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-930288

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-930288-6f68f56fdb from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-930288-5779cb7859-8fwlf

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-930288-6f68f56fdb-65q49

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-930288-5779cb7859-8fwlf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-b-930288-5779cb7859-8fwlf

AddedInterface

Add eth0 [10.132.0.81/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-930288-5779cb7859-8fwlf

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-930288-6f68f56fdb-65q49

AddedInterface

Add eth0 [10.134.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-930288-6f68f56fdb-65q49

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-930288-6f68f56fdb-65q49

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-930288-openshift-default-674786887b-4hthg

ProbeError

Readiness probe error: Get "http://10.134.0.77:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-b-930288-openshift-default-674786887b-4hthg

Unhealthy

Readiness probe failed: Get "http://10.134.0.77:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ipp-b-930288-openshift-default-674786887b-4hthg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-930288-openshift-default-674786887b-4hthg

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-930288-openshift-default-674786887b-4hthg

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-b-930288-openshift-default-674786887b-4hthg

ProbeError

Startup probe error: Get "http://10.134.0.77:15021/healthz/ready": dial tcp 10.134.0.77:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-b-930288-openshift-default-674786887b-4hthg

Unhealthy

Startup probe failed: Get "http://10.134.0.77:15021/healthz/ready": dial tcp 10.134.0.77:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-703730-openshift-default-7fb55946d8

SuccessfulCreate

Created pod: e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz

openshift-ingress

deployment-controller

e2e-ipp-cleanup-703730-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-703730-openshift-default-7fb55946d8 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-703730

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-703730

openshift-ingress

multus

e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz

AddedInterface

Add eth0 [10.134.0.80/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-703730-779b45fd95

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-703730-779b45fd95-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-703730: serviceaccount "payload-processing-e2e-ipp-cleanup-703730" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-703730

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-703730-5f45f69f78 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-703730

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-703730-779b45fd95 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-703730-5f45f69f78

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-703730-5f45f69f78-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-703730: serviceaccount "payload-processing-e2e-ipp-cleanup-703730" not found

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-703730-5f45f69f78-lwf8m

AddedInterface

Add eth0 [10.134.0.81/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-703730-5f45f69f78-lwf8m

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-703730-5f45f69f78

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-703730-5f45f69f78-lwf8m

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-703730-779b45fd95-99bbv

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-703730-779b45fd95-99bbv

AddedInterface

Add eth0 [10.132.0.82/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-703730-5f45f69f78-lwf8m

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-703730-779b45fd95-99bbv

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-703730-779b45fd95-99bbv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-703730-779b45fd95

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-703730-779b45fd95-99bbv

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-703730-5f45f69f78-lwf8m

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz

ProbeError

Startup probe error: Get "http://10.134.0.80:15021/healthz/ready": dial tcp 10.134.0.80:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz

Unhealthy

Startup probe failed: Get "http://10.134.0.80:15021/healthz/ready": dial tcp 10.134.0.80:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-703730-5f45f69f78-lwf8m

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-cleanup-703730

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-703730: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-cleanup-703730": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-703730, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 4cce8488-9816-4bbb-b2d4-23222fef6bbf, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-703730-779b45fd95-99bbv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-cleanup-703730-openshift-default-7fb55946d8-qlprz

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-73a747-5c9bc74799-2nlwc

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-a-73a747

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-a-73a747: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-a-73a747": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-a-73a747, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: ac17ab72-40ab-473e-86fa-f9b3cfa71377, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-73a747-78fb5559c8-445n2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-73a747-openshift-default-58f985f584-x7h2b

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-930288-5779cb7859-8fwlf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-930288-6f68f56fdb-65q49

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-930288-openshift-default-674786887b-4hthg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-ef54fd-78dc69c74c-z29dv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-ef54fd-7f9584dff4-c2dth

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w3-ef54fd-openshift-default-5ff54744cb-6dcsg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-5b1d24-858854d6d5-xp5pp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-5b1d24-7b97f774fd-rgbfb

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-b-w3-5b1d24

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-b-w3-5b1d24: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-b-w3-5b1d24": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-b-w3-5b1d24, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 4268edb1-942b-4c2b-9827-86174b93bd43, UID in object meta:

openshift-ingress

kubelet

e2e-shared-b-w3-5b1d24-openshift-default-66cdc54978-2rfzr

Killing

Stopping container istio-proxy