Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-processing-e2e-migrate-9900cabf-7f5664bc97-6mgf5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-9900cabf-7f5664bc97-6mgf5 to ip-10-0-137-160.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-a7e568-d76948c76-hhd2x

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-a7e568-d76948c76-hhd2x to ip-10-0-137-160.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-3b326f-56748b74fb-w9kw2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-3b326f-56748b74fb-w9kw2 to ip-10-0-135-229.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-f1022d1c-d86f47d96-55mz5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-f1022d1c-d86f47d96-55mz5 to ip-10-0-137-160.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-4d12bd-5c6687b888-b6q4b

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-4d12bd-5c6687b888-b6q4b to ip-10-0-137-160.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-60a3ea-f8f974c6d-59f7n

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-60a3ea-f8f974c6d-59f7n to ip-10-0-135-229.ec2.internal

openshift-ingress

e2e-ipp-a-f2f2fe-openshift-default-cf68b8f8d-rjqbr

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-f2f2fe-openshift-default-cf68b8f8d-rjqbr to ip-10-0-137-160.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-f2f2fe-7946db8768-2b28c

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-f2f2fe-7946db8768-2b28c to ip-10-0-135-229.ec2.internal

openshift-ingress

e2e-ait-dbfaf7e5-openshift-default-84cc9c4cc6-pcghg

Scheduled

Successfully assigned openshift-ingress/e2e-ait-dbfaf7e5-openshift-default-84cc9c4cc6-pcghg to ip-10-0-137-160.ec2.internal

openshift-ingress

kube-auth-proxy-68db9f4dd4-wjm28

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-68db9f4dd4-wjm28 to ip-10-0-136-64.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-00731e-865bcf8f56-vp6hd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-00731e-865bcf8f56-vp6hd to ip-10-0-135-229.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-50783d-5c8c79c688-zssdh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-50783d-5c8c79c688-zssdh to ip-10-0-135-229.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-9900cabf-598f5ff4dd-5rt95

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-9900cabf-598f5ff4dd-5rt95 to ip-10-0-137-160.ec2.internal

openshift-ingress

e2e-shared-a-eb3087-openshift-default-5c69fc9dfb-8xmms

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-eb3087-openshift-default-5c69fc9dfb-8xmms to ip-10-0-137-160.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-pnhjv

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-pnhjv to ip-10-0-135-229.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-e74c91e4-99fc99876-hq8c6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-e74c91e4-99fc99876-hq8c6 to ip-10-0-137-160.ec2.internal

openshift-ingress

e2e-ipp-b-00731e-openshift-default-6c9dd69568-99kjp

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-00731e-openshift-default-6c9dd69568-99kjp to ip-10-0-136-64.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-dbfaf7e5-545dbcc97b-sv8jh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-dbfaf7e5-545dbcc97b-sv8jh to ip-10-0-135-229.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-ac04a8f1-9ffcd5f9b-ll7t5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-ac04a8f1-9ffcd5f9b-ll7t5 to ip-10-0-137-160.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-ccbf66ba-67c5548bbd-4kj85

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-ccbf66ba-67c5548bbd-4kj85 to ip-10-0-137-160.ec2.internal

openshift-ingress

e2e-inf-b-60a3ea-openshift-default-7646f5b8-x6kv2

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-60a3ea-openshift-default-7646f5b8-x6kv2 to ip-10-0-137-160.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-eb3087-6787769688-fgpsd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-eb3087-6787769688-fgpsd to ip-10-0-137-160.ec2.internal

openshift-ingress

e2e-mt-ac04a8f1-openshift-default-5469cb4b48-k9m2h

Scheduled

Successfully assigned openshift-ingress/e2e-mt-ac04a8f1-openshift-default-5469cb4b48-k9m2h to ip-10-0-137-160.ec2.internal

openshift-ingress

e2e-ait-e74c91e4-openshift-default-79d46ff95b-cgr5f

Scheduled

Successfully assigned openshift-ingress/e2e-ait-e74c91e4-openshift-default-79d46ff95b-cgr5f to ip-10-0-137-160.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-46bb38-7c8b4b75c6-rjz52

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-46bb38-7c8b4b75c6-rjz52 to ip-10-0-137-160.ec2.internal

openshift-ingress

payload-processing-5cc6cd444b-lzqhr

Scheduled

Successfully assigned openshift-ingress/payload-processing-5cc6cd444b-lzqhr to ip-10-0-135-229.ec2.internal

openshift-ingress

payload-pre-processing-687dbb6cf6-mbw4b

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-687dbb6cf6-mbw4b to ip-10-0-135-229.ec2.internal

openshift-ingress

e2e-ipp-cleanup-50783d-openshift-default-5bf494f76b-4x7dc

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-50783d-openshift-default-5bf494f76b-4x7dc to ip-10-0-136-64.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-w5lvk

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-w5lvk to ip-10-0-137-160.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-qbhbs

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qbhbs to ip-10-0-137-160.ec2.internal

openshift-ingress

payload-processing-e2e-ait-dbfaf7e5-69b5d8d7d4-lgj64

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-dbfaf7e5-69b5d8d7d4-lgj64 to ip-10-0-137-160.ec2.internal

openshift-ingress

e2e-inf-a-4d12bd-openshift-default-6db567649b-scszv

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-4d12bd-openshift-default-6db567649b-scszv to ip-10-0-137-160.ec2.internal

openshift-ingress

e2e-shared-b-46bb38-openshift-default-859f8c9b84-dxf2n

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-46bb38-openshift-default-859f8c9b84-dxf2n to ip-10-0-137-160.ec2.internal

openshift-ingress

e2e-migrate-9900cabf-gw-openshift-default-6fd4d5c756-7brvx

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-9900cabf-gw-openshift-default-6fd4d5c756-7brvx to ip-10-0-137-160.ec2.internal

openshift-ingress

e2e-api-a-a7e568-openshift-default-844c68764d-mxxwz

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-a7e568-openshift-default-844c68764d-mxxwz to ip-10-0-137-160.ec2.internal

openshift-ingress

kube-auth-proxy-68db9f4dd4-lrl5x

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-68db9f4dd4-lrl5x to ip-10-0-137-160.ec2.internal

openshift-ingress

payload-processing-e2e-ait-e74c91e4-5ccd9b8d88-vmlpg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-e74c91e4-5ccd9b8d88-vmlpg to ip-10-0-137-160.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-a7e568-77fcf58988-5vkzv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-a7e568-77fcf58988-5vkzv to ip-10-0-137-160.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-3b326f-784bf5d4c4-p8nhk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-3b326f-784bf5d4c4-p8nhk to ip-10-0-137-160.ec2.internal

openshift-ingress

payload-processing-e2e-derive-f1022d1c-7cb67c7f54-cf4gj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-f1022d1c-7cb67c7f54-cf4gj to ip-10-0-135-229.ec2.internal

openshift-ingress

e2e-derive-f1022d1c-openshift-default-8b8669bf6-9dlhv

Scheduled

Successfully assigned openshift-ingress/e2e-derive-f1022d1c-openshift-default-8b8669bf6-9dlhv to ip-10-0-137-160.ec2.internal

openshift-ingress

router-default-5799b9b4f7-h2vnm

Scheduled

Successfully assigned openshift-ingress/router-default-5799b9b4f7-h2vnm to ip-10-0-135-229.ec2.internal

openshift-ingress

e2e-mt-ccbf66ba-openshift-default-65ff56f8d4-lxk58

Scheduled

Successfully assigned openshift-ingress/e2e-mt-ccbf66ba-openshift-default-65ff56f8d4-lxk58 to ip-10-0-137-160.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-46bb38-59849c9d86-t7zt5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-46bb38-59849c9d86-t7zt5 to ip-10-0-137-160.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-eb3087-8855c856b-m49p9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-eb3087-8855c856b-m49p9 to ip-10-0-137-160.ec2.internal

openshift-ingress

payload-processing-e2e-mt-ccbf66ba-65d7d4f458-hnpwp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-ccbf66ba-65d7d4f458-hnpwp to ip-10-0-137-160.ec2.internal

openshift-ingress

payload-processing-e2e-mt-ac04a8f1-8dcff56db-c7mnw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-ac04a8f1-8dcff56db-c7mnw to ip-10-0-137-160.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-4d12bd-6475c57fc6-w2bw9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-4d12bd-6475c57fc6-w2bw9 to ip-10-0-137-160.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-60a3ea-6594465676-5l676

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-60a3ea-6594465676-5l676 to ip-10-0-137-160.ec2.internal

openshift-ingress

e2e-api-b-3b326f-openshift-default-d865b58fd-bl85c

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-3b326f-openshift-default-d865b58fd-bl85c to ip-10-0-137-160.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-f2f2fe-585c8b8888-vjd9w

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-f2f2fe-585c8b8888-vjd9w to ip-10-0-135-229.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-00731e-67978cf968-fxfbx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-00731e-67978cf968-fxfbx to ip-10-0-137-160.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-n4wzx

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-n4wzx to ip-10-0-137-160.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-50783d-cf56d55c8-bdc9k

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-50783d-cf56d55c8-bdc9k to ip-10-0-137-160.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-5799b9b4f7 from 0 to 1
(x11)

openshift-ingress

replicaset-controller

router-default-5799b9b4f7

FailedCreate

Error creating: pods "router-default-5799b9b4f7-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x17)

openshift-ingress

replicaset-controller

router-default-5799b9b4f7

FailedCreate

Error creating: pods "router-default-5799b9b4f7-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-5799b9b4f7

SuccessfulCreate

Created pod: router-default-5799b9b4f7-h2vnm
(x5)

openshift-ingress

kubelet

router-default-5799b9b4f7-h2vnm

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x5)

openshift-ingress

kubelet

router-default-5799b9b4f7-h2vnm

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found

openshift-ingress

kubelet

router-default-5799b9b4f7-h2vnm

Started

Started container router

openshift-ingress

multus

router-default-5799b9b4f7-h2vnm

AddedInterface

Add eth0 [10.132.0.12/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-5799b9b4f7-h2vnm

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559" already present on machine

openshift-ingress

kubelet

router-default-5799b9b4f7-h2vnm

Created

Created container: router

openshift-ingress

kubelet

kube-auth-proxy-68db9f4dd4-wjm28

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-68db9f4dd4 from 0 to 2

openshift-ingress

replicaset-controller

kube-auth-proxy-68db9f4dd4

SuccessfulCreate

Created pod: kube-auth-proxy-68db9f4dd4-wjm28
(x2)

openshift-ingress

replicaset-controller

kube-auth-proxy-68db9f4dd4

FailedCreate

Error creating: pods "kube-auth-proxy-68db9f4dd4-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-68db9f4dd4

SuccessfulCreate

Created pod: kube-auth-proxy-68db9f4dd4-lrl5x

openshift-ingress

kubelet

kube-auth-proxy-68db9f4dd4-lrl5x

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

multus

kube-auth-proxy-68db9f4dd4-wjm28

AddedInterface

Add eth0 [10.133.0.29/23] from ovn-kubernetes

openshift-ingress

multus

kube-auth-proxy-68db9f4dd4-lrl5x

AddedInterface

Add eth0 [10.134.0.18/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-n4wzx

openshift-ingress

kubelet

kube-auth-proxy-68db9f4dd4-wjm28

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

kubelet

kube-auth-proxy-68db9f4dd4-lrl5x

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-n4wzx

AddedInterface

Add eth0 [10.134.0.21/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-n4wzx

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

kube-auth-proxy-68db9f4dd4-wjm28

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-68db9f4dd4-wjm28

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-68db9f4dd4-wjm28

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.291s (2.291s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-68db9f4dd4-lrl5x

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-68db9f4dd4-lrl5x

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-n4wzx

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-n4wzx

Started

Started container discovery

openshift-ingress

kubelet

kube-auth-proxy-68db9f4dd4-lrl5x

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 4.758s (4.758s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-n4wzx

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.857s (3.857s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-n4wzx

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-pnhjv

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-n4wzx

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-pnhjv

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-pnhjv

AddedInterface

Add eth0 [10.132.0.28/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-w5lvk

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-w5lvk

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-w5lvk

AddedInterface

Add eth0 [10.134.0.22/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-pnhjv

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.815s (2.815s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-pnhjv

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-pnhjv

Created

Created container: discovery

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-n4wzx

Killing

Stopping container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-n4wzx

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-w5lvk

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-w5lvk

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-w5lvk

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 17.862s (17.862s including waiting). Image size: 181318953 bytes.
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-qbhbs

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-qbhbs

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-687dbb6cf6

FailedCreate

Error creating: pods "payload-pre-processing-687dbb6cf6-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-pre-processing-687dbb6cf6

SuccessfulCreate

Created pod: payload-pre-processing-687dbb6cf6-mbw4b

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5cc6cd444b from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-5cc6cd444b

SuccessfulCreate

Created pod: payload-processing-5cc6cd444b-lzqhr
(x5)

openshift-ingress

replicaset-controller

payload-processing-5cc6cd444b

FailedCreate

Error creating: pods "payload-processing-5cc6cd444b-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-687dbb6cf6 from 0 to 1

openshift-ingress

kubelet

payload-processing-5cc6cd444b-lzqhr

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-5cc6cd444b-lzqhr

AddedInterface

Add eth0 [10.132.0.34/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-687dbb6cf6-mbw4b

AddedInterface

Add eth0 [10.132.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-mbw4b

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-mbw4b

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-5cc6cd444b-lzqhr

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5cc6cd444b-lzqhr

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-5cc6cd444b-lzqhr

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.894s (2.894s including waiting). Image size: 165907129 bytes.

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-mbw4b

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.912s (2.912s including waiting). Image size: 165907129 bytes.

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-mbw4b

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-qbhbs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-qbhbs

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-qbhbs

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-qbhbs

Unhealthy

Startup probe failed: Get "http://10.134.0.40:15021/healthz/ready": dial tcp 10.134.0.40:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-qbhbs

ProbeError

Startup probe error: Get "http://10.134.0.40:15021/healthz/ready": dial tcp 10.134.0.40:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-ait-dbfaf7e5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-dbfaf7e5-openshift-default-84cc9c4cc6 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-dbfaf7e5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-dbfaf7e5

openshift-ingress

replicaset-controller

e2e-ait-dbfaf7e5-openshift-default-84cc9c4cc6

SuccessfulCreate

Created pod: e2e-ait-dbfaf7e5-openshift-default-84cc9c4cc6-pcghg

openshift-ingress

multus

e2e-ait-dbfaf7e5-openshift-default-84cc9c4cc6-pcghg

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-dbfaf7e5-545dbcc97b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-dbfaf7e5-545dbcc97b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-dbfaf7e5: serviceaccount "payload-processing-e2e-ait-dbfaf7e5" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-dbfaf7e5-69b5d8d7d4

FailedCreate

Error creating: pods "payload-processing-e2e-ait-dbfaf7e5-69b5d8d7d4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-dbfaf7e5: serviceaccount "payload-processing-e2e-ait-dbfaf7e5" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-dbfaf7e5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-dbfaf7e5-545dbcc97b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-dbfaf7e5-545dbcc97b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-dbfaf7e5-545dbcc97b-sv8jh

openshift-ingress

deployment-controller

payload-processing-e2e-ait-dbfaf7e5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-dbfaf7e5-69b5d8d7d4 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-dbfaf7e5-69b5d8d7d4

SuccessfulCreate

Created pod: payload-processing-e2e-ait-dbfaf7e5-69b5d8d7d4-lgj64

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-dbfaf7e5-545dbcc97b-sv8jh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-dbfaf7e5-545dbcc97b-sv8jh

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-dbfaf7e5-545dbcc97b-sv8jh

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ait-dbfaf7e5-69b5d8d7d4-lgj64

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-dbfaf7e5-69b5d8d7d4-lgj64

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-e2e-ait-dbfaf7e5-545dbcc97b-sv8jh

AddedInterface

Add eth0 [10.132.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-dbfaf7e5-69b5d8d7d4-lgj64

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-dbfaf7e5-69b5d8d7d4-lgj64

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.493s (1.493s including waiting). Image size: 165907129 bytes.

openshift-ingress

kubelet

payload-processing-e2e-ait-dbfaf7e5-69b5d8d7d4-lgj64

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-dbfaf7e5-545dbcc97b-sv8jh

Unhealthy

Readiness probe failed: dial tcp 10.132.0.42:9004: connect: connection refused

openshift-ingress

kubelet

e2e-ait-dbfaf7e5-openshift-default-84cc9c4cc6-pcghg

ProbeError

Readiness probe error: Get "http://10.134.0.50:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ait-dbfaf7e5-openshift-default-84cc9c4cc6-pcghg

Unhealthy

Readiness probe failed: Get "http://10.134.0.50:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ait-dbfaf7e5-openshift-default-84cc9c4cc6-pcghg

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-dbfaf7e5-openshift-default-84cc9c4cc6-pcghg

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-dbfaf7e5-openshift-default-84cc9c4cc6-pcghg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-ait-dbfaf7e5-openshift-default-84cc9c4cc6-pcghg

ProbeError

Startup probe error: Get "http://10.134.0.50:15021/healthz/ready": dial tcp 10.134.0.50:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-ait-dbfaf7e5-openshift-default-84cc9c4cc6-pcghg

Unhealthy

Startup probe failed: Get "http://10.134.0.50:15021/healthz/ready": dial tcp 10.134.0.50:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ait-dbfaf7e5-openshift-default-84cc9c4cc6-pcghg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ait-dbfaf7e5-69b5d8d7d4-lgj64

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-dbfaf7e5-545dbcc97b-sv8jh

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-migrate-9900cabf-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-9900cabf-gw

openshift-ingress

deployment-controller

e2e-migrate-9900cabf-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-9900cabf-gw-openshift-default-6fd4d5c756 from 0 to 1

openshift-ingress

replicaset-controller

e2e-migrate-9900cabf-gw-openshift-default-6fd4d5c756

SuccessfulCreate

Created pod: e2e-migrate-9900cabf-gw-openshift-default-6fd4d5c756-7brvx

openshift-ingress

multus

e2e-migrate-9900cabf-gw-openshift-default-6fd4d5c756-7brvx

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-9900cabf-598f5ff4dd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-9900cabf-598f5ff4dd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-9900cabf: serviceaccount "payload-processing-e2e-migrate-9900cabf" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-9900cabf-598f5ff4dd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-9900cabf-598f5ff4dd-5rt95

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-9900cabf

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-9900cabf-7f5664bc97 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-9900cabf-7f5664bc97

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-9900cabf-7f5664bc97-6mgf5
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-9900cabf-7f5664bc97

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-9900cabf-7f5664bc97-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-9900cabf: serviceaccount "payload-processing-e2e-migrate-9900cabf" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-9900cabf

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-9900cabf-598f5ff4dd from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-9900cabf-598f5ff4dd-5rt95

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-migrate-9900cabf-7f5664bc97-6mgf5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-ait-dbfaf7e5-openshift-default-84cc9c4cc6-pcghg

ProbeError

Readiness probe error: Get "http://10.134.0.50:15021/healthz/ready": dial tcp 10.134.0.50:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ait-dbfaf7e5-openshift-default-84cc9c4cc6-pcghg

Unhealthy

Readiness probe failed: Get "http://10.134.0.50:15021/healthz/ready": dial tcp 10.134.0.50:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-migrate-9900cabf-7f5664bc97-6mgf5

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-9900cabf-7f5664bc97-6mgf5

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-migrate-9900cabf-7f5664bc97-6mgf5

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-9900cabf-598f5ff4dd-5rt95

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-9900cabf-598f5ff4dd-5rt95

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-migrate-9900cabf-598f5ff4dd-5rt95

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-migrate-9900cabf-gw-openshift-default-6fd4d5c756-7brvx

Unhealthy

Readiness probe failed: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-migrate-9900cabf-gw-openshift-default-6fd4d5c756-7brvx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-9900cabf-gw-openshift-default-6fd4d5c756-7brvx

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-9900cabf-gw-openshift-default-6fd4d5c756-7brvx

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-migrate-9900cabf-gw-openshift-default-6fd4d5c756-7brvx

ProbeError

Readiness probe error: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-migrate-9900cabf-gw-openshift-default-6fd4d5c756-7brvx

Unhealthy

Startup probe failed: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-migrate-9900cabf-gw-openshift-default-6fd4d5c756-7brvx

ProbeError

Startup probe error: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-migrate-9900cabf-7f5664bc97-6mgf5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-9900cabf-598f5ff4dd-5rt95

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-migrate-9900cabf-gw-openshift-default-6fd4d5c756-7brvx

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-ait-e74c91e4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-e74c91e4-openshift-default-79d46ff95b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-e74c91e4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-e74c91e4

openshift-ingress

replicaset-controller

e2e-ait-e74c91e4-openshift-default-79d46ff95b

SuccessfulCreate

Created pod: e2e-ait-e74c91e4-openshift-default-79d46ff95b-cgr5f

openshift-ingress

multus

e2e-ait-e74c91e4-openshift-default-79d46ff95b-cgr5f

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ait-e74c91e4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-e74c91e4-5ccd9b8d88 from 0 to 1

openshift-ingress

kubelet

e2e-migrate-9900cabf-gw-openshift-default-6fd4d5c756-7brvx

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-e74c91e4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-e74c91e4-99fc99876 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-e74c91e4-99fc99876

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-e74c91e4-99fc99876-hq8c6
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-e74c91e4-99fc99876

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-e74c91e4-99fc99876-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-e74c91e4: serviceaccount "payload-processing-e2e-ait-e74c91e4" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-e74c91e4-5ccd9b8d88

FailedCreate

Error creating: pods "payload-processing-e2e-ait-e74c91e4-5ccd9b8d88-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-e74c91e4: serviceaccount "payload-processing-e2e-ait-e74c91e4" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-e74c91e4-5ccd9b8d88

SuccessfulCreate

Created pod: payload-processing-e2e-ait-e74c91e4-5ccd9b8d88-vmlpg

openshift-ingress

kubelet

e2e-migrate-9900cabf-gw-openshift-default-6fd4d5c756-7brvx

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-e74c91e4-99fc99876-hq8c6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-e74c91e4-99fc99876-hq8c6

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-e74c91e4-5ccd9b8d88-vmlpg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-e74c91e4-5ccd9b8d88-vmlpg

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-e74c91e4-99fc99876-hq8c6

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ait-e74c91e4-5ccd9b8d88-vmlpg

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-e74c91e4-99fc99876-hq8c6

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-e74c91e4-5ccd9b8d88-vmlpg

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-ait-e74c91e4-openshift-default-79d46ff95b-cgr5f

ProbeError

Readiness probe error: Get "http://10.134.0.57:15021/healthz/ready": read tcp 10.134.0.2:43154->10.134.0.57:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-ait-e74c91e4-openshift-default-79d46ff95b-cgr5f

Unhealthy

Readiness probe failed: Get "http://10.134.0.57:15021/healthz/ready": read tcp 10.134.0.2:43154->10.134.0.57:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-ait-e74c91e4-openshift-default-79d46ff95b-cgr5f

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-e74c91e4-openshift-default-79d46ff95b-cgr5f

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-e74c91e4-openshift-default-79d46ff95b-cgr5f

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ait-e74c91e4-openshift-default-79d46ff95b-cgr5f

Unhealthy

Startup probe failed: Get "http://10.134.0.57:15021/healthz/ready": dial tcp 10.134.0.57:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-e74c91e4-openshift-default-79d46ff95b-cgr5f

ProbeError

Startup probe error: Get "http://10.134.0.57:15021/healthz/ready": dial tcp 10.134.0.57:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ait-e74c91e4-5ccd9b8d88-vmlpg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-e74c91e4-99fc99876-hq8c6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-e74c91e4-openshift-default-79d46ff95b-cgr5f

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-derive-f1022d1c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-f1022d1c-openshift-default-8b8669bf6 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-derive-f1022d1c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-f1022d1c

openshift-ingress

replicaset-controller

e2e-derive-f1022d1c-openshift-default-8b8669bf6

SuccessfulCreate

Created pod: e2e-derive-f1022d1c-openshift-default-8b8669bf6-9dlhv

openshift-ingress

multus

e2e-derive-f1022d1c-openshift-default-8b8669bf6-9dlhv

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-f1022d1c-d86f47d96

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-f1022d1c-d86f47d96-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-f1022d1c: serviceaccount "payload-processing-e2e-derive-f1022d1c" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-f1022d1c-7cb67c7f54

SuccessfulCreate

Created pod: payload-processing-e2e-derive-f1022d1c-7cb67c7f54-cf4gj
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-f1022d1c-7cb67c7f54

FailedCreate

Error creating: pods "payload-processing-e2e-derive-f1022d1c-7cb67c7f54-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-f1022d1c: serviceaccount "payload-processing-e2e-derive-f1022d1c" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-f1022d1c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-f1022d1c-d86f47d96 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-derive-f1022d1c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-f1022d1c-7cb67c7f54 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-f1022d1c-d86f47d96

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-f1022d1c-d86f47d96-55mz5

openshift-ingress

multus

payload-pre-processing-e2e-derive-f1022d1c-d86f47d96-55mz5

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-f1022d1c-7cb67c7f54-cf4gj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-f1022d1c-d86f47d96-55mz5

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-f1022d1c-d86f47d96-55mz5

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-f1022d1c-d86f47d96-55mz5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-derive-f1022d1c-7cb67c7f54-cf4gj

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-f1022d1c-7cb67c7f54-cf4gj

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-derive-f1022d1c-7cb67c7f54-cf4gj

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-derive-f1022d1c-openshift-default-8b8669bf6-9dlhv

Unhealthy

Readiness probe failed: Get "http://10.134.0.61:15021/healthz/ready": dial tcp 10.134.0.61:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-derive-f1022d1c-openshift-default-8b8669bf6-9dlhv

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-f1022d1c-openshift-default-8b8669bf6-9dlhv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-f1022d1c-openshift-default-8b8669bf6-9dlhv

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-derive-f1022d1c-openshift-default-8b8669bf6-9dlhv

ProbeError

Readiness probe error: Get "http://10.134.0.61:15021/healthz/ready": dial tcp 10.134.0.61:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-derive-f1022d1c-openshift-default-8b8669bf6-9dlhv

ProbeError

Startup probe error: Get "http://10.134.0.61:15021/healthz/ready": dial tcp 10.134.0.61:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-derive-f1022d1c-openshift-default-8b8669bf6-9dlhv

Unhealthy

Startup probe failed: Get "http://10.134.0.61:15021/healthz/ready": dial tcp 10.134.0.61:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-derive-f1022d1c-7cb67c7f54-cf4gj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-f1022d1c-d86f47d96-55mz5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-f1022d1c-openshift-default-8b8669bf6-9dlhv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-derive-f1022d1c-openshift-default-8b8669bf6-9dlhv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

kubelet

e2e-derive-f1022d1c-openshift-default-8b8669bf6-9dlhv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

e2e-mt-ccbf66ba-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-ccbf66ba-openshift-default-65ff56f8d4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-ccbf66ba-openshift-default-65ff56f8d4

SuccessfulCreate

Created pod: e2e-mt-ccbf66ba-openshift-default-65ff56f8d4-lxk58

openshift-ingress

gateway_labeler_controller

e2e-mt-ccbf66ba

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-ccbf66ba

openshift-ingress

multus

e2e-mt-ccbf66ba-openshift-default-65ff56f8d4-lxk58

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-ccbf66ba-65d7d4f458-hnpwp

Created

Created container: payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-ccbf66ba

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-ccbf66ba-67c5548bbd from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-mt-ccbf66ba-65d7d4f458-hnpwp

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-ccbf66ba-65d7d4f458

FailedCreate

Error creating: pods "payload-processing-e2e-mt-ccbf66ba-65d7d4f458-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-ccbf66ba: serviceaccount "payload-processing-e2e-mt-ccbf66ba" not found

openshift-ingress

multus

payload-pre-processing-e2e-mt-ccbf66ba-67c5548bbd-4kj85

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-ccbf66ba-67c5548bbd-4kj85

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-ccbf66ba-67c5548bbd-4kj85

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-ccbf66ba-67c5548bbd-4kj85

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-mt-ccbf66ba

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-ccbf66ba-65d7d4f458 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-ccbf66ba-67c5548bbd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-ccbf66ba-67c5548bbd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-ccbf66ba: serviceaccount "payload-processing-e2e-mt-ccbf66ba" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-ccbf66ba-67c5548bbd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-ccbf66ba-67c5548bbd-4kj85

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-ccbf66ba-65d7d4f458

SuccessfulCreate

Created pod: payload-processing-e2e-mt-ccbf66ba-65d7d4f458-hnpwp

openshift-ingress

kubelet

payload-processing-e2e-mt-ccbf66ba-65d7d4f458-hnpwp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-ccbf66ba-65d7d4f458-hnpwp

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-ccbf66ba-openshift-default-65ff56f8d4-lxk58

Unhealthy

Readiness probe failed: Get "http://10.134.0.64:15021/healthz/ready": read tcp 10.134.0.2:44718->10.134.0.64:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-mt-ccbf66ba-openshift-default-65ff56f8d4-lxk58

ProbeError

Readiness probe error: Get "http://10.134.0.64:15021/healthz/ready": read tcp 10.134.0.2:44718->10.134.0.64:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-mt-ccbf66ba-openshift-default-65ff56f8d4-lxk58

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-ccbf66ba-openshift-default-65ff56f8d4-lxk58

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-ccbf66ba-openshift-default-65ff56f8d4-lxk58

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-mt-ccbf66ba-openshift-default-65ff56f8d4-lxk58

Unhealthy

Startup probe failed: Get "http://10.134.0.64:15021/healthz/ready": dial tcp 10.134.0.64:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-mt-ccbf66ba-openshift-default-65ff56f8d4-lxk58

ProbeError

Startup probe error: Get "http://10.134.0.64:15021/healthz/ready": dial tcp 10.134.0.64:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-mt-ccbf66ba-65d7d4f458-hnpwp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-ccbf66ba-67c5548bbd-4kj85

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-ccbf66ba-openshift-default-65ff56f8d4-lxk58

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-mt-ac04a8f1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-ac04a8f1-openshift-default-5469cb4b48 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-ac04a8f1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-ac04a8f1

openshift-ingress

replicaset-controller

e2e-mt-ac04a8f1-openshift-default-5469cb4b48

SuccessfulCreate

Created pod: e2e-mt-ac04a8f1-openshift-default-5469cb4b48-k9m2h

openshift-ingress

multus

e2e-mt-ac04a8f1-openshift-default-5469cb4b48-k9m2h

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-ac04a8f1-9ffcd5f9b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-ac04a8f1-9ffcd5f9b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-ac04a8f1: serviceaccount "payload-processing-e2e-mt-ac04a8f1" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-ac04a8f1-9ffcd5f9b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-ac04a8f1-9ffcd5f9b-ll7t5

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-ac04a8f1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-ac04a8f1-9ffcd5f9b from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-mt-ac04a8f1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-ac04a8f1-8dcff56db from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-ac04a8f1-8dcff56db

SuccessfulCreate

Created pod: payload-processing-e2e-mt-ac04a8f1-8dcff56db-c7mnw
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-ac04a8f1-8dcff56db

FailedCreate

Error creating: pods "payload-processing-e2e-mt-ac04a8f1-8dcff56db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-ac04a8f1: serviceaccount "payload-processing-e2e-mt-ac04a8f1" not found

openshift-ingress

kubelet

payload-processing-e2e-mt-ac04a8f1-8dcff56db-c7mnw

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-ac04a8f1-9ffcd5f9b-ll7t5

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-ac04a8f1-8dcff56db-c7mnw

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-ac04a8f1-9ffcd5f9b-ll7t5

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-ac04a8f1-9ffcd5f9b-ll7t5

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-ac04a8f1-8dcff56db-c7mnw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-ac04a8f1-8dcff56db-c7mnw

AddedInterface

Add eth0 [10.134.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-ac04a8f1-9ffcd5f9b-ll7t5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-ac04a8f1-openshift-default-5469cb4b48-k9m2h

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-ac04a8f1-openshift-default-5469cb4b48-k9m2h

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-ac04a8f1-openshift-default-5469cb4b48-k9m2h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-mt-ac04a8f1-openshift-default-5469cb4b48-k9m2h

Unhealthy

Startup probe failed: Get "http://10.134.0.68:15021/healthz/ready": dial tcp 10.134.0.68:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-ac04a8f1-openshift-default-5469cb4b48-k9m2h

ProbeError

Startup probe error: Get "http://10.134.0.68:15021/healthz/ready": dial tcp 10.134.0.68:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-ac04a8f1-9ffcd5f9b-ll7t5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-ac04a8f1-8dcff56db-c7mnw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-ac04a8f1-openshift-default-5469cb4b48-k9m2h

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-ac04a8f1-openshift-default-5469cb4b48-k9m2h

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-ac04a8f1-openshift-default-5469cb4b48-k9m2h

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

gateway_labeler_controller

e2e-inf-a-4d12bd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-4d12bd

openshift-ingress

deployment-controller

e2e-inf-a-4d12bd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-4d12bd-openshift-default-6db567649b from 0 to 1

openshift-ingress

multus

e2e-inf-a-4d12bd-openshift-default-6db567649b-scszv

AddedInterface

Add eth0 [10.134.0.72/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-inf-a-4d12bd-openshift-default-6db567649b

SuccessfulCreate

Created pod: e2e-inf-a-4d12bd-openshift-default-6db567649b-scszv
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-4d12bd-6475c57fc6

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-4d12bd-6475c57fc6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-4d12bd: serviceaccount "payload-processing-e2e-inf-a-4d12bd" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-4d12bd-6475c57fc6

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-4d12bd-6475c57fc6-w2bw9

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-4d12bd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-4d12bd-6475c57fc6 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-4d12bd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-4d12bd-5c6687b888 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-4d12bd-5c6687b888

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-4d12bd-5c6687b888-b6q4b
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-4d12bd-5c6687b888

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-4d12bd-5c6687b888-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-4d12bd: serviceaccount "payload-processing-e2e-inf-a-4d12bd" not found

openshift-ingress

multus

payload-processing-e2e-inf-a-4d12bd-6475c57fc6-w2bw9

AddedInterface

Add eth0 [10.134.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-4d12bd-6475c57fc6-w2bw9

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-4d12bd-6475c57fc6-w2bw9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-4d12bd-5c6687b888-b6q4b

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-4d12bd-5c6687b888-b6q4b

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-4d12bd-5c6687b888-b6q4b

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-4d12bd-5c6687b888-b6q4b

AddedInterface

Add eth0 [10.134.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-4d12bd-6475c57fc6-w2bw9

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-inf-a-4d12bd-openshift-default-6db567649b-scszv

Unhealthy

Readiness probe failed: Get "http://10.134.0.72:15021/healthz/ready": read tcp 10.134.0.2:56058->10.134.0.72:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-inf-a-4d12bd-openshift-default-6db567649b-scszv

ProbeError

Readiness probe error: Get "http://10.134.0.72:15021/healthz/ready": read tcp 10.134.0.2:56058->10.134.0.72:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-inf-a-4d12bd-openshift-default-6db567649b-scszv

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-4d12bd-openshift-default-6db567649b-scszv

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-4d12bd-openshift-default-6db567649b-scszv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-inf-a-4d12bd-openshift-default-6db567649b-scszv

Unhealthy

Startup probe failed: Get "http://10.134.0.72:15021/healthz/ready": dial tcp 10.134.0.72:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-inf-a-4d12bd-openshift-default-6db567649b-scszv

ProbeError

Startup probe error: Get "http://10.134.0.72:15021/healthz/ready": dial tcp 10.134.0.72:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-inf-b-60a3ea

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-60a3ea

openshift-ingress

replicaset-controller

e2e-inf-b-60a3ea-openshift-default-7646f5b8

SuccessfulCreate

Created pod: e2e-inf-b-60a3ea-openshift-default-7646f5b8-x6kv2

openshift-ingress

deployment-controller

e2e-inf-b-60a3ea-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-60a3ea-openshift-default-7646f5b8 from 0 to 1

openshift-ingress

multus

e2e-inf-b-60a3ea-openshift-default-7646f5b8-x6kv2

AddedInterface

Add eth0 [10.134.0.75/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-60a3ea-f8f974c6d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-60a3ea-f8f974c6d-59f7n
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-60a3ea-f8f974c6d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-60a3ea-f8f974c6d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-60a3ea: serviceaccount "payload-processing-e2e-inf-b-60a3ea" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-60a3ea

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-60a3ea-6594465676 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-60a3ea-6594465676

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-60a3ea-6594465676-5l676
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-60a3ea-6594465676

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-60a3ea-6594465676-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-60a3ea: serviceaccount "payload-processing-e2e-inf-b-60a3ea" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-60a3ea

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-60a3ea-f8f974c6d from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-60a3ea-f8f974c6d-59f7n

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-60a3ea-f8f974c6d-59f7n

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-inf-b-60a3ea-6594465676-5l676

AddedInterface

Add eth0 [10.134.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-60a3ea-6594465676-5l676

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-b-60a3ea-6594465676-5l676

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-60a3ea-6594465676-5l676

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-60a3ea-f8f974c6d-59f7n

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-60a3ea-f8f974c6d-59f7n

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-b-60a3ea-openshift-default-7646f5b8-x6kv2

Unhealthy

Readiness probe failed: Get "http://10.134.0.75:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-inf-b-60a3ea-openshift-default-7646f5b8-x6kv2

ProbeError

Readiness probe error: Get "http://10.134.0.75:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-inf-b-60a3ea-openshift-default-7646f5b8-x6kv2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-60a3ea-openshift-default-7646f5b8-x6kv2

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-60a3ea-openshift-default-7646f5b8-x6kv2

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-inf-b-60a3ea-openshift-default-7646f5b8-x6kv2

Unhealthy

Startup probe failed: Get "http://10.134.0.75:15021/healthz/ready": dial tcp 10.134.0.75:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-inf-b-60a3ea-openshift-default-7646f5b8-x6kv2

ProbeError

Startup probe error: Get "http://10.134.0.75:15021/healthz/ready": dial tcp 10.134.0.75:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-4d12bd-5c6687b888-b6q4b

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-4d12bd-6475c57fc6-w2bw9

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-inf-a-4d12bd

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-inf-a-4d12bd: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-inf-a-4d12bd": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-inf-a-4d12bd, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 9bdd3131-ab0b-4381-8161-c586512a35c0, UID in object meta:

openshift-ingress

kubelet

e2e-inf-a-4d12bd-openshift-default-6db567649b-scszv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-4d12bd-openshift-default-6db567649b-scszv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-a-4d12bd-openshift-default-6db567649b-scszv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-inf-b-60a3ea-6594465676-5l676

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-60a3ea-f8f974c6d-59f7n

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-60a3ea-6594465676-5l676

Unhealthy

Readiness probe failed: dial tcp 10.134.0.76:9004: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-api-a-a7e568

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-a7e568

openshift-ingress

deployment-controller

e2e-api-a-a7e568-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-a7e568-openshift-default-844c68764d from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-a7e568-openshift-default-844c68764d

SuccessfulCreate

Created pod: e2e-api-a-a7e568-openshift-default-844c68764d-mxxwz

openshift-ingress

kubelet

e2e-inf-b-60a3ea-openshift-default-7646f5b8-x6kv2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-60a3ea-openshift-default-7646f5b8-x6kv2

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-b-60a3ea-openshift-default-7646f5b8-x6kv2

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

multus

e2e-api-a-a7e568-openshift-default-844c68764d-mxxwz

AddedInterface

Add eth0 [10.134.0.78/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-a7e568-77fcf58988

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-a7e568-77fcf58988-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-a7e568: serviceaccount "payload-processing-e2e-api-a-a7e568" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-a7e568

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-a7e568-d76948c76 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-a7e568-d76948c76

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-a7e568-d76948c76-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-a7e568: serviceaccount "payload-processing-e2e-api-a-a7e568" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-a7e568-77fcf58988

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-a7e568-77fcf58988-5vkzv

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-a7e568

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-a7e568-77fcf58988 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-a7e568-d76948c76

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-a7e568-d76948c76-hhd2x

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-a7e568-d76948c76-hhd2x

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-api-a-a7e568-77fcf58988-5vkzv

AddedInterface

Add eth0 [10.134.0.79/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-api-a-a7e568-d76948c76-hhd2x

AddedInterface

Add eth0 [10.134.0.80/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-a7e568-77fcf58988-5vkzv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-a-a7e568-77fcf58988-5vkzv

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-a7e568-d76948c76-hhd2x

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-a-a7e568-77fcf58988-5vkzv

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-a7e568-d76948c76-hhd2x

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-api-a-a7e568-openshift-default-844c68764d-mxxwz

ProbeError

Readiness probe error: Get "http://10.134.0.78:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-api-a-a7e568-openshift-default-844c68764d-mxxwz

Unhealthy

Readiness probe failed: Get "http://10.134.0.78:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-api-a-a7e568-openshift-default-844c68764d-mxxwz

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-a7e568-openshift-default-844c68764d-mxxwz

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-a7e568-openshift-default-844c68764d-mxxwz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-api-a-a7e568-openshift-default-844c68764d-mxxwz

Unhealthy

Startup probe failed: Get "http://10.134.0.78:15021/healthz/ready": dial tcp 10.134.0.78:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-a-a7e568-openshift-default-844c68764d-mxxwz

ProbeError

Startup probe error: Get "http://10.134.0.78:15021/healthz/ready": dial tcp 10.134.0.78:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-api-b-3b326f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-3b326f

openshift-ingress

deployment-controller

e2e-api-b-3b326f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-3b326f-openshift-default-d865b58fd from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-3b326f-openshift-default-d865b58fd

SuccessfulCreate

Created pod: e2e-api-b-3b326f-openshift-default-d865b58fd-bl85c

openshift-ingress

multus

e2e-api-b-3b326f-openshift-default-d865b58fd-bl85c

AddedInterface

Add eth0 [10.134.0.83/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-3b326f-56748b74fb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-3b326f-56748b74fb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-3b326f: serviceaccount "payload-processing-e2e-api-b-3b326f" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-3b326f-784bf5d4c4

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-3b326f-784bf5d4c4-p8nhk
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-3b326f-784bf5d4c4

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-3b326f-784bf5d4c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-3b326f: serviceaccount "payload-processing-e2e-api-b-3b326f" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-3b326f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-3b326f-784bf5d4c4 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-api-b-3b326f-56748b74fb-w9kw2

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-3b326f-56748b74fb-w9kw2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-3b326f-56748b74fb-w9kw2

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-3b326f-56748b74fb-w9kw2

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-3b326f-56748b74fb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-3b326f-56748b74fb-w9kw2

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-3b326f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-3b326f-56748b74fb from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-b-3b326f-784bf5d4c4-p8nhk

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-api-b-3b326f-784bf5d4c4-p8nhk

AddedInterface

Add eth0 [10.134.0.84/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-3b326f-784bf5d4c4-p8nhk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-b-3b326f-784bf5d4c4-p8nhk

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-api-b-3b326f-openshift-default-d865b58fd-bl85c

ProbeError

Readiness probe error: Get "http://10.134.0.83:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-api-b-3b326f-openshift-default-d865b58fd-bl85c

Unhealthy

Readiness probe failed: Get "http://10.134.0.83:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-api-b-3b326f-openshift-default-d865b58fd-bl85c

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-3b326f-openshift-default-d865b58fd-bl85c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-3b326f-openshift-default-d865b58fd-bl85c

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-api-b-3b326f-openshift-default-d865b58fd-bl85c

ProbeError

Startup probe error: Get "http://10.134.0.83:15021/healthz/ready": dial tcp 10.134.0.83:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-api-b-3b326f-openshift-default-d865b58fd-bl85c

Unhealthy

Startup probe failed: Get "http://10.134.0.83:15021/healthz/ready": dial tcp 10.134.0.83:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-api-a-a7e568-77fcf58988-5vkzv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-a7e568-d76948c76-hhd2x

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-a-a7e568-openshift-default-844c68764d-mxxwz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-a7e568-openshift-default-844c68764d-mxxwz

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-a-a7e568-openshift-default-844c68764d-mxxwz

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-api-b-3b326f-784bf5d4c4-p8nhk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-3b326f-56748b74fb-w9kw2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-3b326f-openshift-default-d865b58fd-bl85c

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-eb3087-openshift-default-5c69fc9dfb

SuccessfulCreate

Created pod: e2e-shared-a-eb3087-openshift-default-5c69fc9dfb-8xmms

openshift-ingress

deployment-controller

e2e-shared-a-eb3087-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-eb3087-openshift-default-5c69fc9dfb from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-eb3087

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-eb3087

openshift-ingress

multus

e2e-shared-a-eb3087-openshift-default-5c69fc9dfb-8xmms

AddedInterface

Add eth0 [10.134.0.85/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-eb3087-8855c856b

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-eb3087-8855c856b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-eb3087: serviceaccount "payload-processing-e2e-shared-a-eb3087" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-eb3087-6787769688

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-eb3087-6787769688-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-eb3087: serviceaccount "payload-processing-e2e-shared-a-eb3087" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-eb3087-6787769688

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-eb3087-6787769688-fgpsd

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-eb3087

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-eb3087-6787769688 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-a-eb3087-8855c856b-m49p9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-eb3087-8855c856b

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-eb3087-8855c856b-m49p9

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-eb3087

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-eb3087-8855c856b from 0 to 1

openshift-ingress

multus

payload-processing-e2e-shared-a-eb3087-8855c856b-m49p9

AddedInterface

Add eth0 [10.134.0.86/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-eb3087-6787769688-fgpsd

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-eb3087-6787769688-fgpsd

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-eb3087-6787769688-fgpsd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-eb3087-8855c856b-m49p9

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-eb3087-8855c856b-m49p9

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-eb3087-6787769688-fgpsd

AddedInterface

Add eth0 [10.134.0.87/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-eb3087-openshift-default-5c69fc9dfb-8xmms

ProbeError

Readiness probe error: Get "http://10.134.0.85:15021/healthz/ready": dial tcp 10.134.0.85:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-shared-a-eb3087-openshift-default-5c69fc9dfb-8xmms

Unhealthy

Readiness probe failed: Get "http://10.134.0.85:15021/healthz/ready": dial tcp 10.134.0.85:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-a-eb3087-openshift-default-5c69fc9dfb-8xmms

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-eb3087-openshift-default-5c69fc9dfb-8xmms

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-eb3087-openshift-default-5c69fc9dfb-8xmms

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-a-eb3087-openshift-default-5c69fc9dfb-8xmms

ProbeError

Startup probe error: Get "http://10.134.0.85:15021/healthz/ready": dial tcp 10.134.0.85:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-eb3087-openshift-default-5c69fc9dfb-8xmms

Unhealthy

Startup probe failed: Get "http://10.134.0.85:15021/healthz/ready": dial tcp 10.134.0.85:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-shared-b-46bb38-openshift-default-859f8c9b84

SuccessfulCreate

Created pod: e2e-shared-b-46bb38-openshift-default-859f8c9b84-dxf2n

openshift-ingress

deployment-controller

e2e-shared-b-46bb38-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-46bb38-openshift-default-859f8c9b84 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-46bb38

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-46bb38

openshift-ingress

multus

e2e-shared-b-46bb38-openshift-default-859f8c9b84-dxf2n

AddedInterface

Add eth0 [10.134.0.88/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-46bb38-7c8b4b75c6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-46bb38-7c8b4b75c6-rjz52
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-46bb38-7c8b4b75c6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-46bb38-7c8b4b75c6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-46bb38: serviceaccount "payload-processing-e2e-shared-b-46bb38" not found

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-46bb38-7c8b4b75c6-rjz52

AddedInterface

Add eth0 [10.134.0.89/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-46bb38-7c8b4b75c6-rjz52

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-46bb38

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-46bb38-7c8b4b75c6 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-46bb38

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-46bb38-59849c9d86 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-46bb38-59849c9d86

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-46bb38-59849c9d86-t7zt5

openshift-ingress

multus

payload-processing-e2e-shared-b-46bb38-59849c9d86-t7zt5

AddedInterface

Add eth0 [10.134.0.90/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-46bb38-59849c9d86-t7zt5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-46bb38-59849c9d86

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-46bb38-59849c9d86-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-46bb38: serviceaccount "payload-processing-e2e-shared-b-46bb38" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-46bb38-7c8b4b75c6-rjz52

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-46bb38-59849c9d86-t7zt5

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-46bb38-59849c9d86-t7zt5

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-46bb38-7c8b4b75c6-rjz52

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-46bb38-openshift-default-859f8c9b84-dxf2n

Unhealthy

Readiness probe failed: Get "http://10.134.0.88:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-b-46bb38-openshift-default-859f8c9b84-dxf2n

ProbeError

Readiness probe error: Get "http://10.134.0.88:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-46bb38-openshift-default-859f8c9b84-dxf2n

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-46bb38-openshift-default-859f8c9b84-dxf2n

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-46bb38-openshift-default-859f8c9b84-dxf2n

Created

Created container: istio-proxy
(x4)

openshift-ingress

kubelet

e2e-shared-b-46bb38-openshift-default-859f8c9b84-dxf2n

Unhealthy

Startup probe failed: Get "http://10.134.0.88:15021/healthz/ready": dial tcp 10.134.0.88:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-shared-b-46bb38-openshift-default-859f8c9b84-dxf2n

ProbeError

Startup probe error: Get "http://10.134.0.88:15021/healthz/ready": dial tcp 10.134.0.88:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-f2f2fe

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-f2f2fe

openshift-ingress

deployment-controller

e2e-ipp-a-f2f2fe-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-f2f2fe-openshift-default-cf68b8f8d from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-f2f2fe-openshift-default-cf68b8f8d

SuccessfulCreate

Created pod: e2e-ipp-a-f2f2fe-openshift-default-cf68b8f8d-rjqbr

openshift-ingress

multus

e2e-ipp-a-f2f2fe-openshift-default-cf68b8f8d-rjqbr

AddedInterface

Add eth0 [10.134.0.96/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-f2f2fe

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-f2f2fe-7946db8768 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-f2f2fe-7946db8768

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-f2f2fe-7946db8768-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-f2f2fe: serviceaccount "payload-processing-e2e-ipp-a-f2f2fe" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-f2f2fe-585c8b8888

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-f2f2fe-585c8b8888-vjd9w

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-f2f2fe

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-f2f2fe-585c8b8888 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-f2f2fe-7946db8768

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-f2f2fe-7946db8768-2b28c
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-f2f2fe-585c8b8888

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-f2f2fe-585c8b8888-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-f2f2fe: serviceaccount "payload-processing-e2e-ipp-a-f2f2fe" not found

openshift-ingress

multus

payload-processing-e2e-ipp-a-f2f2fe-585c8b8888-vjd9w

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-f2f2fe-7946db8768-2b28c

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f2f2fe-585c8b8888-vjd9w

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f2f2fe-585c8b8888-vjd9w

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f2f2fe-585c8b8888-vjd9w

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f2f2fe-7946db8768-2b28c

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f2f2fe-7946db8768-2b28c

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f2f2fe-7946db8768-2b28c

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f2f2fe-7946db8768-2b28c

Unhealthy

Readiness probe failed: dial tcp 10.132.0.58:9004: connect: connection refused

openshift-ingress

kubelet

e2e-ipp-a-f2f2fe-openshift-default-cf68b8f8d-rjqbr

Unhealthy

Readiness probe failed: Get "http://10.134.0.96:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-a-f2f2fe-openshift-default-cf68b8f8d-rjqbr

ProbeError

Readiness probe error: Get "http://10.134.0.96:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ipp-a-f2f2fe-openshift-default-cf68b8f8d-rjqbr

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-f2f2fe-openshift-default-cf68b8f8d-rjqbr

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-f2f2fe-openshift-default-cf68b8f8d-rjqbr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x3)

openshift-ingress

kubelet

e2e-ipp-a-f2f2fe-openshift-default-cf68b8f8d-rjqbr

Unhealthy

Startup probe failed: Get "http://10.134.0.96:15021/healthz/ready": dial tcp 10.134.0.96:15021: connect: connection refused
(x3)

openshift-ingress

kubelet

e2e-ipp-a-f2f2fe-openshift-default-cf68b8f8d-rjqbr

ProbeError

Startup probe error: Get "http://10.134.0.96:15021/healthz/ready": dial tcp 10.134.0.96:15021: connect: connection refused body:

openshift-ingress

multus

e2e-ipp-b-00731e-openshift-default-6c9dd69568-99kjp

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-00731e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-00731e

openshift-ingress

kubelet

e2e-ipp-b-00731e-openshift-default-6c9dd69568-99kjp

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

replicaset-controller

e2e-ipp-b-00731e-openshift-default-6c9dd69568

SuccessfulCreate

Created pod: e2e-ipp-b-00731e-openshift-default-6c9dd69568-99kjp

openshift-ingress

deployment-controller

e2e-ipp-b-00731e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-00731e-openshift-default-6c9dd69568 from 0 to 1

openshift-ingress

kubelet

e2e-ipp-b-00731e-openshift-default-6c9dd69568-99kjp

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 11.001s (11.001s including waiting). Image size: 181318953 bytes.

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-00731e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-00731e-67978cf968 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-00731e-865bcf8f56

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-00731e-865bcf8f56-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-00731e: serviceaccount "payload-processing-e2e-ipp-b-00731e" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-00731e-67978cf968

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-00731e-67978cf968-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-00731e: serviceaccount "payload-processing-e2e-ipp-b-00731e" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-00731e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-00731e-865bcf8f56 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ipp-b-00731e-67978cf968-fxfbx

AddedInterface

Add eth0 [10.134.0.97/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-00731e-67978cf968-fxfbx

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-00731e-67978cf968

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-00731e-67978cf968-fxfbx

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-00731e-865bcf8f56-vp6hd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-00731e-865bcf8f56-vp6hd

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-00731e-865bcf8f56-vp6hd

AddedInterface

Add eth0 [10.132.0.61/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-00731e-865bcf8f56

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-00731e-865bcf8f56-vp6hd

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-00731e-67978cf968-fxfbx

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-00731e-67978cf968-fxfbx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-00731e-865bcf8f56-vp6hd

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-00731e-openshift-default-6c9dd69568-99kjp

ProbeError

Readiness probe error: Get "http://10.133.0.51:15021/healthz/ready": read tcp 10.133.0.2:50426->10.133.0.51:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-ipp-b-00731e-openshift-default-6c9dd69568-99kjp

Unhealthy

Readiness probe failed: Get "http://10.133.0.51:15021/healthz/ready": read tcp 10.133.0.2:50426->10.133.0.51:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-ipp-b-00731e-openshift-default-6c9dd69568-99kjp

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-00731e-openshift-default-6c9dd69568-99kjp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-00731e-openshift-default-6c9dd69568-99kjp

Started

Started container istio-proxy
(x3)

openshift-ingress

kubelet

e2e-ipp-b-00731e-openshift-default-6c9dd69568-99kjp

Unhealthy

Startup probe failed: Get "http://10.133.0.51:15021/healthz/ready": dial tcp 10.133.0.51:15021: connect: connection refused
(x3)

openshift-ingress

kubelet

e2e-ipp-b-00731e-openshift-default-6c9dd69568-99kjp

ProbeError

Startup probe error: Get "http://10.133.0.51:15021/healthz/ready": dial tcp 10.133.0.51:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-50783d-openshift-default-5bf494f76b

SuccessfulCreate

Created pod: e2e-ipp-cleanup-50783d-openshift-default-5bf494f76b-4x7dc

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-50783d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-50783d

openshift-ingress

deployment-controller

e2e-ipp-cleanup-50783d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-50783d-openshift-default-5bf494f76b from 0 to 1

openshift-ingress

multus

e2e-ipp-cleanup-50783d-openshift-default-5bf494f76b-4x7dc

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-50783d-5c8c79c688-zssdh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-50783d-5c8c79c688-zssdh

AddedInterface

Add eth0 [10.132.0.63/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-50783d-cf56d55c8

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-50783d-cf56d55c8-bdc9k

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-50783d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-50783d-cf56d55c8 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-50783d-cf56d55c8

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-50783d-cf56d55c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-50783d: serviceaccount "payload-processing-e2e-ipp-cleanup-50783d" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-50783d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-50783d-5c8c79c688 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-50783d-5c8c79c688

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-50783d-5c8c79c688-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-50783d: serviceaccount "payload-processing-e2e-ipp-cleanup-50783d" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-50783d-5c8c79c688

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-50783d-5c8c79c688-zssdh

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-50783d-5c8c79c688-zssdh

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-50783d-5c8c79c688-zssdh

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-50783d-cf56d55c8-bdc9k

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-50783d-cf56d55c8-bdc9k

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-50783d-cf56d55c8-bdc9k

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-50783d-cf56d55c8-bdc9k

AddedInterface

Add eth0 [10.134.0.98/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-50783d-openshift-default-5bf494f76b-4x7dc

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-50783d-openshift-default-5bf494f76b-4x7dc

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-50783d-openshift-default-5bf494f76b-4x7dc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-ipp-cleanup-50783d-openshift-default-5bf494f76b-4x7dc

Unhealthy

Startup probe failed: Get "http://10.133.0.53:15021/healthz/ready": dial tcp 10.133.0.53:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-ipp-cleanup-50783d-openshift-default-5bf494f76b-4x7dc

ProbeError

Startup probe error: Get "http://10.133.0.53:15021/healthz/ready": dial tcp 10.133.0.53:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-50783d-5c8c79c688-zssdh

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-cleanup-50783d

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-50783d: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-cleanup-50783d": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-50783d, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 28a1f4d6-e556-4fc1-b7a2-3633465c8c9c, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-50783d-cf56d55c8-bdc9k

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-50783d-openshift-default-5bf494f76b-4x7dc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-cleanup-50783d-openshift-default-5bf494f76b-4x7dc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-cleanup-50783d-openshift-default-5bf494f76b-4x7dc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f2f2fe-7946db8768-2b28c

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f2f2fe-585c8b8888-vjd9w

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-f2f2fe-openshift-default-cf68b8f8d-rjqbr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-00731e-67978cf968-fxfbx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-00731e-865bcf8f56-vp6hd

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-b-00731e

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-b-00731e: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-b-00731e": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-b-00731e, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 0c693e2c-b60d-4aa9-b5ec-65783269e10e, UID in object meta:

openshift-ingress

kubelet

e2e-ipp-b-00731e-openshift-default-6c9dd69568-99kjp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-00731e-openshift-default-6c9dd69568-99kjp

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-b-00731e-openshift-default-6c9dd69568-99kjp

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-eb3087-6787769688-fgpsd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-eb3087-8855c856b-m49p9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-eb3087-openshift-default-5c69fc9dfb-8xmms

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-46bb38-59849c9d86-t7zt5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-46bb38-7c8b4b75c6-rjz52

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-46bb38-59849c9d86-t7zt5

Unhealthy

Readiness probe failed: dial tcp 10.134.0.90:9004: i/o timeout

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-46bb38-7c8b4b75c6-rjz52

Unhealthy

Readiness probe failed: dial tcp 10.134.0.89:9004: i/o timeout

openshift-ingress

kubelet

e2e-shared-b-46bb38-openshift-default-859f8c9b84-dxf2n

Killing

Stopping container istio-proxy