Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-pre-processing-e2e-shared-b-w1-da587f-6d788dc4f8-d2ppf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w1-da587f-6d788dc4f8-d2ppf to ip-10-0-141-0.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-88b9ff-5df6f7df6b-wfl84

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-88b9ff-5df6f7df6b-wfl84 to ip-10-0-141-0.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w1-c8e1cf-6848bf5687-4w2d4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w1-c8e1cf-6848bf5687-4w2d4 to ip-10-0-141-0.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-7cbcece2-5d67c65674-487kn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-7cbcece2-5d67c65674-487kn to ip-10-0-136-237.ec2.internal

openshift-ingress

e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7

Scheduled

Successfully assigned openshift-ingress/e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7 to ip-10-0-132-152.ec2.internal

openshift-ingress

payload-pre-processing-76f657cdc4-797pq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-76f657cdc4-797pq to ip-10-0-136-237.ec2.internal

openshift-ingress

e2e-mt-a5942927-openshift-default-6c596fb776-xc2ft

Scheduled

Successfully assigned openshift-ingress/e2e-mt-a5942927-openshift-default-6c596fb776-xc2ft to ip-10-0-136-237.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-63d8f735-c78df56c8-l9h9w

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-63d8f735-c78df56c8-l9h9w to ip-10-0-141-0.ec2.internal

openshift-ingress

e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8

Scheduled

Successfully assigned openshift-ingress/e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8 to ip-10-0-136-237.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-21d2a4-6f77bb7c58-lwjkm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-21d2a4-6f77bb7c58-lwjkm to ip-10-0-141-0.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-e86b6784-54d7dc56db-l2dbx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-e86b6784-54d7dc56db-l2dbx to ip-10-0-141-0.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-24d51017-8596956b98-6426x

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-24d51017-8596956b98-6426x to ip-10-0-141-0.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-a95f496f-6b499454fd-5h8zw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-a95f496f-6b499454fd-5h8zw to ip-10-0-141-0.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-88b9ff-5d964f9597-lgv59

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-88b9ff-5d964f9597-lgv59 to ip-10-0-141-0.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-26cbe6-6f86965f89-pkgrb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-26cbe6-6f86965f89-pkgrb to ip-10-0-141-0.ec2.internal

openshift-ingress

payload-processing-e2e-derive-24d51017-6b5b6d67df-ht92q

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-24d51017-6b5b6d67df-ht92q to ip-10-0-141-0.ec2.internal

openshift-ingress

payload-processing-85fd65c94c-d9qjb

Scheduled

Successfully assigned openshift-ingress/payload-processing-85fd65c94c-d9qjb to ip-10-0-136-237.ec2.internal

openshift-ingress

payload-processing-e2e-ait-63d8f735-7775688b7f-wg5kl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-63d8f735-7775688b7f-wg5kl to ip-10-0-141-0.ec2.internal

openshift-ingress

e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv to ip-10-0-132-152.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-50372a-8648d87bdf-g7hjz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-50372a-8648d87bdf-g7hjz to ip-10-0-136-237.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-26cbe6-689d748786-92mtw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-26cbe6-689d748786-92mtw to ip-10-0-136-237.ec2.internal

openshift-ingress

kube-auth-proxy-dc4565f8d-kgbgb

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-dc4565f8d-kgbgb to ip-10-0-136-237.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-a5942927-64649cd7bb-jz2h7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-a5942927-64649cd7bb-jz2h7 to ip-10-0-136-237.ec2.internal

openshift-ingress

e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr

Scheduled

Successfully assigned openshift-ingress/e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr to ip-10-0-132-152.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w1-c8e1cf-7488c79cf8-jplrj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w1-c8e1cf-7488c79cf8-jplrj to ip-10-0-141-0.ec2.internal

openshift-ingress

e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj to ip-10-0-132-152.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-zzvr5

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-zzvr5 to ip-10-0-141-0.ec2.internal

openshift-ingress

e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7 to ip-10-0-132-152.ec2.internal

openshift-ingress

kube-auth-proxy-dc4565f8d-dnjjq

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-dc4565f8d-dnjjq to ip-10-0-141-0.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w1-da587f-5cf56fcf5f-gn2sq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w1-da587f-5cf56fcf5f-gn2sq to ip-10-0-141-0.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-e93f57-85f4b9d55d-jfmqm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-e93f57-85f4b9d55d-jfmqm to ip-10-0-141-0.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-50372a-84d8f46cbb-xr47t

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-50372a-84d8f46cbb-xr47t to ip-10-0-136-237.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-21d2a4-58d9f9c75c-7nxbd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-21d2a4-58d9f9c75c-7nxbd to ip-10-0-136-237.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-f9c5c2-95f4d4d6c-vgqsp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-f9c5c2-95f4d4d6c-vgqsp to ip-10-0-141-0.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-fa8af0-58775ccdd6-pj78n

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fa8af0-58775ccdd6-pj78n to ip-10-0-141-0.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-wwcqx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-wwcqx to ip-10-0-136-237.ec2.internal

openshift-ingress

e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh to ip-10-0-132-152.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-x85zs

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x85zs to ip-10-0-132-152.ec2.internal

openshift-ingress

payload-processing-e2e-mt-a5942927-b5b9c4cc-rtq5n

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-a5942927-b5b9c4cc-rtq5n to ip-10-0-136-237.ec2.internal

openshift-ingress

payload-processing-e2e-mt-7cbcece2-69b868bd6f-48vl2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-7cbcece2-69b868bd6f-48vl2 to ip-10-0-141-0.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-15949d-5694879547-vbjrz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-15949d-5694879547-vbjrz to ip-10-0-141-0.ec2.internal

openshift-ingress

e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4 to ip-10-0-132-152.ec2.internal

openshift-ingress

e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb to ip-10-0-136-237.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w3-33737b-76cc56d95f-bbvrx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w3-33737b-76cc56d95f-bbvrx to ip-10-0-141-0.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-30ef69-778f7878d6-g9xnw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-30ef69-778f7878d6-g9xnw to ip-10-0-141-0.ec2.internal

openshift-ingress

e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r to ip-10-0-132-152.ec2.internal

openshift-ingress

payload-processing-e2e-ait-e86b6784-68f95d9f95-h5fkk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-e86b6784-68f95d9f95-h5fkk to ip-10-0-141-0.ec2.internal

openshift-ingress

e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c to ip-10-0-132-152.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-4xx67

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4xx67 to ip-10-0-132-152.ec2.internal

openshift-ingress

e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf to ip-10-0-132-152.ec2.internal

openshift-ingress

router-default-76d56ddb5b-flrvn

Scheduled

Successfully assigned openshift-ingress/router-default-76d56ddb5b-flrvn to ip-10-0-136-237.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-f9c5c2-74bc4fc88b-vl7bp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f9c5c2-74bc4fc88b-vl7bp to ip-10-0-141-0.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-a95f496f-64ccbf6798-nhpgh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-a95f496f-64ccbf6798-nhpgh to ip-10-0-141-0.ec2.internal

openshift-ingress

e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q to ip-10-0-132-152.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-fa8af0-6974cb684c-mrhcj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-fa8af0-6974cb684c-mrhcj to ip-10-0-141-0.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-30ef69-78b476ddb5-7qwr6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-30ef69-78b476ddb5-7qwr6 to ip-10-0-141-0.ec2.internal

openshift-ingress

e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6

Scheduled

Successfully assigned openshift-ingress/e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6 to ip-10-0-136-237.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-521326-79cf58d6c-9pkvv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-521326-79cf58d6c-9pkvv to ip-10-0-141-0.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-521326-7655f5868b-js2wn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-521326-7655f5868b-js2wn to ip-10-0-141-0.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-e93f57-5fff958f57-bkg7t

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-e93f57-5fff958f57-bkg7t to ip-10-0-141-0.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w3-33737b-94d6b7658-h597d

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w3-33737b-94d6b7658-h597d to ip-10-0-141-0.ec2.internal

openshift-ingress

e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h to ip-10-0-136-237.ec2.internal

openshift-ingress

e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf to ip-10-0-132-152.ec2.internal

openshift-ingress

e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9 to ip-10-0-132-152.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-v6k5d

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-v6k5d to ip-10-0-136-237.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-15949d-5dbdc577fd-9vfgp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-15949d-5dbdc577fd-9vfgp to ip-10-0-141-0.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-pcbnn

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-pcbnn to ip-10-0-136-237.ec2.internal

openshift-ingress

e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q to ip-10-0-132-152.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-76d56ddb5b from 0 to 1
(x6)

openshift-ingress

replicaset-controller

router-default-76d56ddb5b

FailedCreate

Error creating: pods "router-default-76d56ddb5b-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x17)

openshift-ingress

replicaset-controller

router-default-76d56ddb5b

FailedCreate

Error creating: pods "router-default-76d56ddb5b-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-76d56ddb5b

SuccessfulCreate

Created pod: router-default-76d56ddb5b-flrvn
(x5)

openshift-ingress

kubelet

router-default-76d56ddb5b-flrvn

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x6)

openshift-ingress

kubelet

router-default-76d56ddb5b-flrvn

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

kubelet

router-default-76d56ddb5b-flrvn

Created

Created container: router

openshift-ingress

kubelet

router-default-76d56ddb5b-flrvn

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eaa467bc105be2f7695ecfea0f0c53f4c5cd52f1f705da378c7a33d13f1d102f" already present on machine

openshift-ingress

multus

router-default-76d56ddb5b-flrvn

AddedInterface

Add eth0 [10.132.0.15/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-76d56ddb5b-flrvn

Started

Started container router

openshift-ingress

replicaset-controller

kube-auth-proxy-dc4565f8d

SuccessfulCreate

Created pod: kube-auth-proxy-dc4565f8d-kgbgb

openshift-ingress

replicaset-controller

kube-auth-proxy-dc4565f8d

SuccessfulCreate

Created pod: kube-auth-proxy-dc4565f8d-dnjjq
(x4)

openshift-ingress

replicaset-controller

kube-auth-proxy-dc4565f8d

FailedCreate

Error creating: pods "kube-auth-proxy-dc4565f8d-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-dc4565f8d from 0 to 2

openshift-ingress

kubelet

kube-auth-proxy-dc4565f8d-kgbgb

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-dc4565f8d-dnjjq

AddedInterface

Add eth0 [10.134.0.19/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-dc4565f8d-dnjjq

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-v6k5d

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

multus

kube-auth-proxy-dc4565f8d-kgbgb

AddedInterface

Add eth0 [10.132.0.28/23] from ovn-kubernetes

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-v6k5d

AddedInterface

Add eth0 [10.132.0.29/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-v6k5d

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

kube-auth-proxy-dc4565f8d-dnjjq

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.663s (2.663s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-dc4565f8d-dnjjq

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-dc4565f8d-kgbgb

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.765s (2.765s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-dc4565f8d-kgbgb

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-dc4565f8d-dnjjq

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-dc4565f8d-kgbgb

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-v6k5d

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-v6k5d

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.276s (3.276s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-v6k5d

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-v6k5d

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-v6k5d

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-x85zs

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-x85zs

AddedInterface

Add eth0 [10.133.0.29/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-x85zs

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-x85zs

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 5.263s (5.263s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-x85zs

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-x85zs

Created

Created container: istio-proxy

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-pcbnn

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-pcbnn

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-pcbnn

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-pcbnn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" already present on machine

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-pcbnn

AddedInterface

Add eth0 [10.132.0.30/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-v6k5d

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-v6k5d

Killing

Stopping container discovery

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-4xx67

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-4xx67

AddedInterface

Add eth0 [10.133.0.40/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-wwcqx

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-wwcqx

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-zzvr5

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-zzvr5

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-5b54b7fbb7-zzvr5

AddedInterface

Add eth0 [10.134.0.27/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-wwcqx

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-zzvr5

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-zzvr5

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-zzvr5

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.21s (1.21s including waiting). Image size: 166453408 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-wwcqx

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.605s (1.605s including waiting). Image size: 166453408 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-wwcqx

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-wwcqx

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-4xx67

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-4xx67

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-4xx67

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-4xx67

ProbeError

Startup probe error: Get "http://10.133.0.40:15021/healthz/ready": dial tcp 10.133.0.40:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-4xx67

Unhealthy

Startup probe failed: Get "http://10.133.0.40:15021/healthz/ready": dial tcp 10.133.0.40:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-zzvr5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-wwcqx

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-76f657cdc4

SuccessfulCreate

Created pod: payload-pre-processing-76f657cdc4-797pq

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-85fd65c94c from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-76f657cdc4 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-85fd65c94c

SuccessfulCreate

Created pod: payload-processing-85fd65c94c-d9qjb

openshift-ingress

multus

payload-pre-processing-76f657cdc4-797pq

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-76f657cdc4-797pq

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-processing-85fd65c94c-d9qjb

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-85fd65c94c-d9qjb

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-76f657cdc4-797pq

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-76f657cdc4-797pq

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-85fd65c94c-d9qjb

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 1.094s (1.094s including waiting). Image size: 141049838 bytes.

openshift-ingress

kubelet

payload-processing-85fd65c94c-d9qjb

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-85fd65c94c-d9qjb

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-76f657cdc4-797pq

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 1.049s (1.049s including waiting). Image size: 141049838 bytes.

openshift-ingress

deployment-controller

e2e-worker-w3-33737b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-33737b-openshift-default-58b799f4b4 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w3-33737b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w3-33737b

openshift-ingress

replicaset-controller

e2e-worker-w3-33737b-openshift-default-58b799f4b4

SuccessfulCreate

Created pod: e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf

openshift-ingress

deployment-controller

e2e-inf-a-21d2a4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-21d2a4-openshift-default-6447f5dd4b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-a-21d2a4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-21d2a4

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-15949d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-15949d

openshift-ingress

multus

e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w0-15949d-openshift-default-7b5f7fcf76

SuccessfulCreate

Created pod: e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7

openshift-ingress

deployment-controller

e2e-worker-w0-15949d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-15949d-openshift-default-7b5f7fcf76 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-21d2a4-openshift-default-6447f5dd4b

SuccessfulCreate

Created pod: e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q

openshift-ingress

multus

e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf

AddedInterface

Add eth0 [10.133.0.47/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-21d2a4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-21d2a4-58d9f9c75c from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-a-21d2a4-58d9f9c75c-7nxbd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-21d2a4-6f77bb7c58-lwjkm

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-21d2a4-58d9f9c75c-7nxbd

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-21d2a4-58d9f9c75c-7nxbd

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-21d2a4-58d9f9c75c

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-21d2a4-58d9f9c75c-7nxbd

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-21d2a4-6f77bb7c58-lwjkm

AddedInterface

Add eth0 [10.134.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-21d2a4-6f77bb7c58-lwjkm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-21d2a4-6f77bb7c58

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-21d2a4-6f77bb7c58-lwjkm

openshift-ingress

multus

payload-processing-e2e-inf-a-21d2a4-58d9f9c75c-7nxbd

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-21d2a4-6f77bb7c58-lwjkm

Started

Started container payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-21d2a4-6f77bb7c58

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-21d2a4-6f77bb7c58-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-21d2a4: serviceaccount "payload-processing-e2e-inf-a-21d2a4" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-21d2a4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-21d2a4-6f77bb7c58 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-21d2a4-58d9f9c75c

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-21d2a4-58d9f9c75c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-21d2a4: serviceaccount "payload-processing-e2e-inf-a-21d2a4" not found

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-15949d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-15949d-5694879547 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-15949d-5694879547

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-15949d-5694879547-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-15949d: serviceaccount "payload-processing-e2e-worker-w0-15949d" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-15949d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-15949d-5dbdc577fd from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-15949d-5dbdc577fd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-15949d-5dbdc577fd-9vfgp
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-15949d-5dbdc577fd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-15949d-5dbdc577fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-15949d: serviceaccount "payload-processing-e2e-worker-w0-15949d" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-15949d-5694879547

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-15949d-5694879547-vbjrz

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-15949d-5dbdc577fd-9vfgp

AddedInterface

Add eth0 [10.134.0.34/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-worker-w0-15949d-5694879547-vbjrz

AddedInterface

Add eth0 [10.134.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-15949d-5694879547-vbjrz

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-15949d-5dbdc577fd-9vfgp

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w3-33737b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w3-33737b-94d6b7658 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-worker-w3-33737b-94d6b7658-h597d

AddedInterface

Add eth0 [10.134.0.36/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-33737b-94d6b7658

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w3-33737b-94d6b7658-h597d
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-33737b-94d6b7658

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w3-33737b-94d6b7658-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-33737b: serviceaccount "payload-processing-e2e-worker-w3-33737b" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-33737b-94d6b7658-h597d

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-33737b-94d6b7658-h597d

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-33737b-94d6b7658-h597d

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-15949d-5dbdc577fd-9vfgp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-15949d-5dbdc577fd-9vfgp

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-33737b-76cc56d95f-bbvrx

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-15949d-5694879547-vbjrz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-33737b-76cc56d95f-bbvrx

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-33737b-76cc56d95f-bbvrx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-33737b-76cc56d95f

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w3-33737b-76cc56d95f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-33737b: serviceaccount "payload-processing-e2e-worker-w3-33737b" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-15949d-5694879547-vbjrz

Started

Started container payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w3-33737b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w3-33737b-76cc56d95f from 0 to 1

openshift-ingress

multus

payload-processing-e2e-worker-w3-33737b-76cc56d95f-bbvrx

AddedInterface

Add eth0 [10.134.0.37/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-33737b-76cc56d95f

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w3-33737b-76cc56d95f-bbvrx

openshift-ingress

gateway_labeler_controller

e2e-ait-e86b6784

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-e86b6784

openshift-ingress

deployment-controller

e2e-ait-e86b6784-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-e86b6784-openshift-default-fdcf56bd8 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-e86b6784-openshift-default-fdcf56bd8

SuccessfulCreate

Created pod: e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr

openshift-ingress

multus

e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr

AddedInterface

Add eth0 [10.133.0.49/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-e86b6784

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-e86b6784-54d7dc56db from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ait-e86b6784

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-e86b6784-68f95d9f95 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ait-e86b6784-54d7dc56db-l2dbx

AddedInterface

Add eth0 [10.134.0.38/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ait-e86b6784-68f95d9f95-h5fkk

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-e86b6784-54d7dc56db-l2dbx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-e86b6784-54d7dc56db-l2dbx

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-e86b6784-68f95d9f95-h5fkk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-e86b6784-68f95d9f95-h5fkk

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-e86b6784-68f95d9f95

SuccessfulCreate

Created pod: payload-processing-e2e-ait-e86b6784-68f95d9f95-h5fkk

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-e86b6784-54d7dc56db-l2dbx

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-e86b6784-68f95d9f95-h5fkk

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-e86b6784-54d7dc56db

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-e86b6784-54d7dc56db-l2dbx
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-e86b6784-68f95d9f95

FailedCreate

Error creating: pods "payload-processing-e2e-ait-e86b6784-68f95d9f95-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-e86b6784: serviceaccount "payload-processing-e2e-ait-e86b6784" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-e86b6784-54d7dc56db

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-e86b6784-54d7dc56db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-e86b6784: serviceaccount "payload-processing-e2e-ait-e86b6784" not found

openshift-ingress

replicaset-controller

e2e-inf-b-e93f57-openshift-default-744dd4d998

SuccessfulCreate

Created pod: e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q

openshift-ingress

gateway_labeler_controller

e2e-inf-b-e93f57

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-e93f57

openshift-ingress

kubelet

e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7

Unhealthy

Readiness probe failed: Get "http://10.133.0.45:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

multus

e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q

AddedInterface

Add eth0 [10.133.0.50/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-inf-b-e93f57-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-e93f57-openshift-default-744dd4d998 from 0 to 1

openshift-ingress

kubelet

e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7

ProbeError

Readiness probe error: Get "http://10.133.0.45:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q

ProbeError

Readiness probe error: Get "http://10.133.0.46:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q

Unhealthy

Readiness probe failed: Get "http://10.133.0.46:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q

Created

Created container: istio-proxy
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-e93f57-85f4b9d55d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-e93f57-85f4b9d55d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-e93f57: serviceaccount "payload-processing-e2e-inf-b-e93f57" not found
(x2)

openshift-ingress

kubelet

e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q

Started

Started container istio-proxy

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-e93f57

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-e93f57-85f4b9d55d from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-e93f57

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-e93f57-5fff958f57 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-e93f57-5fff958f57

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-e93f57-5fff958f57-bkg7t
(x2)

openshift-ingress

kubelet

e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-e93f57-5fff958f57

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-e93f57-5fff958f57-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-e93f57: serviceaccount "payload-processing-e2e-inf-b-e93f57" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-e93f57-85f4b9d55d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-e93f57-85f4b9d55d-jfmqm
(x2)

openshift-ingress

kubelet

e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-b-e93f57-5fff958f57-bkg7t

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-e93f57-85f4b9d55d-jfmqm

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-e93f57-85f4b9d55d-jfmqm

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-inf-b-e93f57-5fff958f57-bkg7t

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-e93f57-85f4b9d55d-jfmqm

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-e93f57-5fff958f57-bkg7t

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-e93f57-85f4b9d55d-jfmqm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-b-e93f57-5fff958f57-bkg7t

Created

Created container: payload-processing
(x6)

openshift-ingress

kubelet

e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf

Unhealthy

Startup probe failed: Get "http://10.133.0.47:15021/healthz/ready": dial tcp 10.133.0.47:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf

ProbeError

Startup probe error: Get "http://10.133.0.47:15021/healthz/ready": dial tcp 10.133.0.47:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q

ProbeError

Startup probe error: Get "http://10.133.0.46:15021/healthz/ready": dial tcp 10.133.0.46:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7

Unhealthy

Startup probe failed: Get "http://10.133.0.45:15021/healthz/ready": dial tcp 10.133.0.45:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q

Unhealthy

Startup probe failed: Get "http://10.133.0.46:15021/healthz/ready": dial tcp 10.133.0.46:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7

ProbeError

Startup probe error: Get "http://10.133.0.45:15021/healthz/ready": dial tcp 10.133.0.45:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr

ProbeError

Startup probe error: Get "http://10.133.0.49:15021/healthz/ready": dial tcp 10.133.0.49:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr

Unhealthy

Startup probe failed: Get "http://10.133.0.49:15021/healthz/ready": dial tcp 10.133.0.49:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q

Unhealthy

Startup probe failed: Get "http://10.133.0.50:15021/healthz/ready": dial tcp 10.133.0.50:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q

ProbeError

Startup probe error: Get "http://10.133.0.50:15021/healthz/ready": dial tcp 10.133.0.50:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ait-e86b6784-68f95d9f95-h5fkk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-e86b6784-54d7dc56db-l2dbx

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb

SuccessfulCreate

Created pod: e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv

openshift-ingress

deployment-controller

e2e-migrate-a95f496f-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-migrate-a95f496f-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-a95f496f-gw

openshift-ingress

multus

e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ait-e86b6784-openshift-default-fdcf56bd8-qznmr

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-a95f496f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-a95f496f-6b499454fd from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-a95f496f-6b499454fd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-a95f496f-6b499454fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-a95f496f: serviceaccount "payload-processing-e2e-migrate-a95f496f" not found

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-a95f496f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-a95f496f-64ccbf6798 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-a95f496f-64ccbf6798

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-a95f496f-64ccbf6798-nhpgh
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-a95f496f-64ccbf6798

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-a95f496f-64ccbf6798-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-a95f496f: serviceaccount "payload-processing-e2e-migrate-a95f496f" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-a95f496f-6b499454fd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-a95f496f-6b499454fd-5h8zw

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-a95f496f-6b499454fd-5h8zw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-a95f496f-6b499454fd-5h8zw

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-a95f496f-64ccbf6798-nhpgh

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-a95f496f-6b499454fd-5h8zw

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-migrate-a95f496f-6b499454fd-5h8zw

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-a95f496f-64ccbf6798-nhpgh

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-migrate-a95f496f-64ccbf6798-nhpgh

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-a95f496f-64ccbf6798-nhpgh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv

ProbeError

Readiness probe error: Get "http://10.133.0.52:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv

Unhealthy

Readiness probe failed: Get "http://10.133.0.52:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv

ProbeError

Startup probe error: Get "http://10.133.0.52:15021/healthz/ready": dial tcp 10.133.0.52:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv

Unhealthy

Startup probe failed: Get "http://10.133.0.52:15021/healthz/ready": dial tcp 10.133.0.52:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-migrate-a95f496f-64ccbf6798-nhpgh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-a95f496f-6b499454fd-5h8zw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-migrate-a95f496f-gw-openshift-default-856fbb8fcb-9rccv

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ait-63d8f735

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-63d8f735

openshift-ingress

deployment-controller

e2e-ait-63d8f735-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-63d8f735-openshift-default-554b98bc84 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-63d8f735-openshift-default-554b98bc84

SuccessfulCreate

Created pod: e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8

openshift-ingress

multus

e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.902s (2.902s including waiting). Image size: 181318953 bytes.
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-63d8f735-c78df56c8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-63d8f735-c78df56c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-63d8f735: serviceaccount "payload-processing-e2e-ait-63d8f735" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-63d8f735-c78df56c8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-63d8f735-c78df56c8-l9h9w

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-63d8f735

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-63d8f735-c78df56c8 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-63d8f735-7775688b7f

FailedCreate

Error creating: pods "payload-processing-e2e-ait-63d8f735-7775688b7f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-63d8f735: serviceaccount "payload-processing-e2e-ait-63d8f735" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-63d8f735

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-63d8f735-7775688b7f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-63d8f735-7775688b7f

SuccessfulCreate

Created pod: payload-processing-e2e-ait-63d8f735-7775688b7f-wg5kl

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-63d8f735-c78df56c8-l9h9w

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-63d8f735-c78df56c8-l9h9w

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-63d8f735-7775688b7f-wg5kl

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-63d8f735-7775688b7f-wg5kl

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-63d8f735-7775688b7f-wg5kl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-63d8f735-7775688b7f-wg5kl

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-63d8f735-c78df56c8-l9h9w

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-63d8f735-c78df56c8-l9h9w

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8

ProbeError

Startup probe error: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8

Unhealthy

Startup probe failed: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-63d8f735-c78df56c8-l9h9w

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-63d8f735-7775688b7f-wg5kl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-derive-24d51017

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-24d51017

openshift-ingress

multus

e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6

AddedInterface

Add eth0 [10.132.0.61/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-derive-24d51017-openshift-default-57c46d584d

SuccessfulCreate

Created pod: e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6

openshift-ingress

deployment-controller

e2e-derive-24d51017-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-24d51017-openshift-default-57c46d584d from 0 to 1

openshift-ingress

kubelet

e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ait-63d8f735-openshift-default-554b98bc84-mvxk8

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-24d51017-8596956b98

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-24d51017-8596956b98-6426x
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-24d51017-6b5b6d67df

FailedCreate

Error creating: pods "payload-processing-e2e-derive-24d51017-6b5b6d67df-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-24d51017: serviceaccount "payload-processing-e2e-derive-24d51017" not found

openshift-ingress

deployment-controller

payload-processing-e2e-derive-24d51017

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-24d51017-6b5b6d67df from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-24d51017-8596956b98

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-24d51017-8596956b98-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-24d51017: serviceaccount "payload-processing-e2e-derive-24d51017" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-24d51017-6b5b6d67df

SuccessfulCreate

Created pod: payload-processing-e2e-derive-24d51017-6b5b6d67df-ht92q

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-24d51017

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-24d51017-8596956b98 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-derive-24d51017-8596956b98-6426x

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-24d51017-8596956b98-6426x

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-derive-24d51017-6b5b6d67df-ht92q

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-24d51017-6b5b6d67df-ht92q

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-derive-24d51017-6b5b6d67df-ht92q

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-24d51017-8596956b98-6426x

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-24d51017-6b5b6d67df-ht92q

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-24d51017-8596956b98-6426x

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6

Unhealthy

Readiness probe failed: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused

openshift-ingress

kubelet

e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6

ProbeError

Readiness probe error: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6

ProbeError

Startup probe error: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6

Unhealthy

Startup probe failed: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-derive-24d51017-6b5b6d67df-ht92q

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-24d51017-8596956b98-6426x

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-24d51017-openshift-default-57c46d584d-9x6j6

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-mt-a5942927

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-a5942927

openshift-ingress

replicaset-controller

e2e-mt-a5942927-openshift-default-6c596fb776

SuccessfulCreate

Created pod: e2e-mt-a5942927-openshift-default-6c596fb776-xc2ft

openshift-ingress

deployment-controller

e2e-mt-a5942927-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-a5942927-openshift-default-6c596fb776 from 0 to 1

openshift-ingress

multus

e2e-mt-a5942927-openshift-default-6c596fb776-xc2ft

AddedInterface

Add eth0 [10.132.0.63/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-mt-a5942927

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-a5942927-b5b9c4cc from 0 to 1

openshift-ingress

multus

payload-processing-e2e-mt-a5942927-b5b9c4cc-rtq5n

AddedInterface

Add eth0 [10.132.0.66/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-a5942927

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-a5942927-64649cd7bb from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-a5942927-64649cd7bb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-a5942927-64649cd7bb-jz2h7
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-a5942927-64649cd7bb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-a5942927-64649cd7bb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-a5942927: serviceaccount "payload-processing-e2e-mt-a5942927" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-a5942927-64649cd7bb-jz2h7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-mt-a5942927-64649cd7bb-jz2h7

AddedInterface

Add eth0 [10.132.0.65/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-a5942927-b5b9c4cc

SuccessfulCreate

Created pod: payload-processing-e2e-mt-a5942927-b5b9c4cc-rtq5n
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-a5942927-b5b9c4cc

FailedCreate

Error creating: pods "payload-processing-e2e-mt-a5942927-b5b9c4cc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-a5942927: serviceaccount "payload-processing-e2e-mt-a5942927" not found

openshift-ingress

kubelet

payload-processing-e2e-mt-a5942927-b5b9c4cc-rtq5n

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-a5942927-b5b9c4cc-rtq5n

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-a5942927-64649cd7bb-jz2h7

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-a5942927-64649cd7bb-jz2h7

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-a5942927-b5b9c4cc-rtq5n

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-21d2a4-58d9f9c75c-7nxbd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-21d2a4-6f77bb7c58-lwjkm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-a-21d2a4-openshift-default-6447f5dd4b-p6c6q

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-inf-b-e93f57-5fff958f57-bkg7t

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-e93f57-85f4b9d55d-jfmqm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-a5942927-64649cd7bb-jz2h7

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-mt-a5942927

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-mt-a5942927: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-mt-a5942927": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-mt-a5942927, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: aff20bad-f62c-47d4-a18d-a870a356c023, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-mt-a5942927-b5b9c4cc-rtq5n

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-b-e93f57-openshift-default-744dd4d998-6qh4q

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-a5942927-openshift-default-6c596fb776-xc2ft

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-a5942927-openshift-default-6c596fb776-xc2ft

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-a5942927-openshift-default-6c596fb776-xc2ft

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

replicaset-controller

e2e-shared-a-w2-50372a-openshift-default-57b557d8b

SuccessfulCreate

Created pod: e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb

openshift-ingress

deployment-controller

e2e-shared-a-w2-50372a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-50372a-openshift-default-57b557d8b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-50372a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-50372a

openshift-ingress

multus

e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb

AddedInterface

Add eth0 [10.132.0.67/23] from ovn-kubernetes
(x4)

openshift-ingress

kubelet

e2e-mt-a5942927-openshift-default-6c596fb776-xc2ft

Unhealthy

Startup probe failed: Get "http://10.132.0.63:15021/healthz/ready": dial tcp 10.132.0.63:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-mt-a5942927-openshift-default-6c596fb776-xc2ft

ProbeError

Startup probe error: Get "http://10.132.0.63:15021/healthz/ready": dial tcp 10.132.0.63:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-mt-a5942927-openshift-default-6c596fb776-xc2ft

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-50372a-8648d87bdf

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-50372a-8648d87bdf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-50372a: serviceaccount "payload-processing-e2e-shared-a-w2-50372a" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-50372a-84d8f46cbb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-50372a-84d8f46cbb-xr47t
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-50372a-84d8f46cbb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-50372a-84d8f46cbb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-50372a: serviceaccount "payload-processing-e2e-shared-a-w2-50372a" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-50372a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-50372a-8648d87bdf from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-50372a-8648d87bdf

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-50372a-8648d87bdf-g7hjz

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-50372a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-50372a-84d8f46cbb from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-50372a-84d8f46cbb-xr47t

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-50372a-8648d87bdf-g7hjz

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-50372a-8648d87bdf-g7hjz

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-50372a-8648d87bdf-g7hjz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-50372a-8648d87bdf-g7hjz

AddedInterface

Add eth0 [10.132.0.70/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-50372a-84d8f46cbb-xr47t

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-50372a-84d8f46cbb-xr47t

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-50372a-84d8f46cbb-xr47t

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748

SuccessfulCreate

Created pod: e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w1-c8e1cf

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w1-c8e1cf

openshift-ingress

deployment-controller

e2e-shared-a-w1-c8e1cf-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748 from 0 to 1

openshift-ingress

multus

e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w1-c8e1cf-6848bf5687

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w1-c8e1cf-6848bf5687-4w2d4
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w1-c8e1cf-7488c79cf8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w1-c8e1cf-7488c79cf8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w1-c8e1cf: serviceaccount "payload-processing-e2e-shared-a-w1-c8e1cf" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w1-c8e1cf-6848bf5687

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w1-c8e1cf-6848bf5687-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w1-c8e1cf: serviceaccount "payload-processing-e2e-shared-a-w1-c8e1cf" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w1-c8e1cf

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w1-c8e1cf-7488c79cf8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w1-c8e1cf-7488c79cf8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w1-c8e1cf-7488c79cf8-jplrj

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w1-c8e1cf

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w1-c8e1cf-6848bf5687 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-c8e1cf-6848bf5687-4w2d4

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-w1-c8e1cf-6848bf5687-4w2d4

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-c8e1cf-7488c79cf8-jplrj

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-c8e1cf-7488c79cf8-jplrj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-c8e1cf-7488c79cf8-jplrj

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w1-c8e1cf-7488c79cf8-jplrj

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-c8e1cf-6848bf5687-4w2d4

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-c8e1cf-6848bf5687-4w2d4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-f9c5c2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-f9c5c2

openshift-ingress

deployment-controller

e2e-shared-b-w2-f9c5c2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb

SuccessfulCreate

Created pod: e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h

openshift-ingress

multus

e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h

AddedInterface

Add eth0 [10.132.0.72/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb

Started

Started container istio-proxy
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-f9c5c2-95f4d4d6c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-f9c5c2-95f4d4d6c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-f9c5c2: serviceaccount "payload-processing-e2e-shared-b-w2-f9c5c2" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-f9c5c2-74bc4fc88b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-f9c5c2-74bc4fc88b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-f9c5c2: serviceaccount "payload-processing-e2e-shared-b-w2-f9c5c2" not found

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w1-da587f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w1-da587f

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-f9c5c2-95f4d4d6c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-f9c5c2-95f4d4d6c-vgqsp

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-f9c5c2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-f9c5c2-95f4d4d6c from 0 to 1

openshift-ingress

deployment-controller

e2e-shared-b-w1-da587f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w1-da587f-openshift-default-7c48846ffb from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w1-da587f-openshift-default-7c48846ffb

SuccessfulCreate

Created pod: e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-f9c5c2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-f9c5c2-74bc4fc88b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-f9c5c2-74bc4fc88b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-f9c5c2-74bc4fc88b-vl7bp
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb

Unhealthy

Startup probe failed: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-f9c5c2-95f4d4d6c-vgqsp

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-f9c5c2-74bc4fc88b-vl7bp

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-f9c5c2-74bc4fc88b-vl7bp

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-f9c5c2-95f4d4d6c-vgqsp

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-f9c5c2-74bc4fc88b-vl7bp

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb

ProbeError

Startup probe error: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-f9c5c2-74bc4fc88b-vl7bp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf

AddedInterface

Add eth0 [10.133.0.61/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-f9c5c2-95f4d4d6c-vgqsp

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-f9c5c2-95f4d4d6c-vgqsp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w1-da587f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w1-da587f-6d788dc4f8 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w1-da587f-6d788dc4f8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w1-da587f-6d788dc4f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w1-da587f: serviceaccount "payload-processing-e2e-shared-b-w1-da587f" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w1-da587f-6d788dc4f8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w1-da587f-6d788dc4f8-d2ppf

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w1-da587f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w1-da587f-5cf56fcf5f from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w1-da587f-5cf56fcf5f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w1-da587f-5cf56fcf5f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w1-da587f: serviceaccount "payload-processing-e2e-shared-b-w1-da587f" not found
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9

Started

Started container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-da587f-5cf56fcf5f-gn2sq

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9

Created

Created container: istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-da587f-5cf56fcf5f-gn2sq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-da587f-6d788dc4f8-d2ppf

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-da587f-6d788dc4f8-d2ppf

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-da587f-6d788dc4f8-d2ppf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w1-da587f-6d788dc4f8-d2ppf

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-da587f-5cf56fcf5f-gn2sq

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w1-da587f-5cf56fcf5f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w1-da587f-5cf56fcf5f-gn2sq

openshift-ingress

multus

payload-processing-e2e-shared-b-w1-da587f-5cf56fcf5f-gn2sq

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9

Unhealthy

Startup probe failed: Get "http://10.133.0.60:15021/healthz/ready": dial tcp 10.133.0.60:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9

ProbeError

Startup probe error: Get "http://10.133.0.60:15021/healthz/ready": dial tcp 10.133.0.60:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-mt-7cbcece2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-7cbcece2

openshift-ingress

replicaset-controller

e2e-mt-7cbcece2-openshift-default-9d5789cc6

SuccessfulCreate

Created pod: e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7

openshift-ingress

multus

e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7

AddedInterface

Add eth0 [10.133.0.66/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-mt-7cbcece2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-7cbcece2-openshift-default-9d5789cc6 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h

ProbeError

Startup probe error: Get "http://10.132.0.72:15021/healthz/ready": dial tcp 10.132.0.72:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h

Unhealthy

Startup probe failed: Get "http://10.132.0.72:15021/healthz/ready": dial tcp 10.132.0.72:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf

Unhealthy

Startup probe failed: Get "http://10.133.0.61:15021/healthz/ready": dial tcp 10.133.0.61:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf

ProbeError

Startup probe error: Get "http://10.133.0.61:15021/healthz/ready": dial tcp 10.133.0.61:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-7cbcece2-5d67c65674

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-7cbcece2-5d67c65674-487kn

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-7cbcece2-5d67c65674-487kn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-7cbcece2-5d67c65674-487kn

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-7cbcece2-5d67c65674-487kn

AddedInterface

Add eth0 [10.132.0.76/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-7cbcece2-5d67c65674

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-7cbcece2-5d67c65674-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-7cbcece2: serviceaccount "payload-processing-e2e-mt-7cbcece2" not found

openshift-ingress

kubelet

payload-processing-e2e-mt-7cbcece2-69b868bd6f-48vl2

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-7cbcece2-69b868bd6f

SuccessfulCreate

Created pod: payload-processing-e2e-mt-7cbcece2-69b868bd6f-48vl2
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-7cbcece2-69b868bd6f

FailedCreate

Error creating: pods "payload-processing-e2e-mt-7cbcece2-69b868bd6f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-7cbcece2: serviceaccount "payload-processing-e2e-mt-7cbcece2" not found

openshift-ingress

multus

payload-processing-e2e-mt-7cbcece2-69b868bd6f-48vl2

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-7cbcece2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-7cbcece2-5d67c65674 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-mt-7cbcece2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-7cbcece2-69b868bd6f from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-mt-7cbcece2-69b868bd6f-48vl2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-7cbcece2-5d67c65674-487kn

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-7cbcece2-69b868bd6f-48vl2

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7

Unhealthy

Startup probe failed: Get "http://10.133.0.66:15021/healthz/ready": dial tcp 10.133.0.66:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7

ProbeError

Startup probe error: Get "http://10.133.0.66:15021/healthz/ready": dial tcp 10.133.0.66:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-33737b-76cc56d95f-bbvrx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-33737b-94d6b7658-h597d

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w3-33737b-openshift-default-58b799f4b4-lnxhf

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-15949d-5dbdc577fd-9vfgp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-15949d-5694879547-vbjrz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w0-15949d-openshift-default-7b5f7fcf76-p9zw7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-mt-7cbcece2-69b868bd6f-48vl2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-7cbcece2-5d67c65674-487kn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-7cbcece2-openshift-default-9d5789cc6-h4sd7

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-api-a-88b9ff-openshift-default-7c6f4c48cd

SuccessfulCreate

Created pod: e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh

openshift-ingress

gateway_labeler_controller

e2e-api-a-88b9ff

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-88b9ff

openshift-ingress

deployment-controller

e2e-api-a-88b9ff-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-88b9ff-openshift-default-7c6f4c48cd from 0 to 1

openshift-ingress

multus

e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh

AddedInterface

Add eth0 [10.133.0.74/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-88b9ff

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-88b9ff-5d964f9597 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-88b9ff-5df6f7df6b-wfl84

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-88b9ff-5d964f9597

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-88b9ff-5d964f9597-lgv59

openshift-ingress

multus

payload-processing-e2e-api-a-88b9ff-5d964f9597-lgv59

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-88b9ff-5d964f9597

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-88b9ff-5d964f9597-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-88b9ff: serviceaccount "payload-processing-e2e-api-a-88b9ff" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-88b9ff

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-88b9ff-5df6f7df6b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-88b9ff-5df6f7df6b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-88b9ff-5df6f7df6b-wfl84
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-88b9ff-5df6f7df6b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-88b9ff-5df6f7df6b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-88b9ff: serviceaccount "payload-processing-e2e-api-a-88b9ff" not found

openshift-ingress

kubelet

payload-processing-e2e-api-a-88b9ff-5d964f9597-lgv59

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-a-88b9ff-5d964f9597-lgv59

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-88b9ff-5df6f7df6b-wfl84

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-88b9ff-5df6f7df6b-wfl84

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-a-88b9ff-5df6f7df6b-wfl84

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-88b9ff-5d964f9597-lgv59

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh

ProbeError

Startup probe error: Get "http://10.133.0.74:15021/healthz/ready": dial tcp 10.133.0.74:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh

Unhealthy

Startup probe failed: Get "http://10.133.0.74:15021/healthz/ready": dial tcp 10.133.0.74:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-api-b-26cbe6-openshift-default-5d4d8895db

SuccessfulCreate

Created pod: e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r

openshift-ingress

deployment-controller

e2e-api-b-26cbe6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-26cbe6-openshift-default-5d4d8895db from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-26cbe6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-26cbe6

openshift-ingress

multus

e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r

AddedInterface

Add eth0 [10.133.0.76/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-26cbe6-6f86965f89

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-26cbe6-6f86965f89-pkgrb

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-26cbe6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-26cbe6-689d748786 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-26cbe6-689d748786

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-26cbe6-689d748786-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-26cbe6: serviceaccount "payload-processing-e2e-api-b-26cbe6" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-26cbe6-689d748786

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-26cbe6-689d748786-92mtw
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-26cbe6-6f86965f89

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-26cbe6-6f86965f89-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-26cbe6: serviceaccount "payload-processing-e2e-api-b-26cbe6" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-26cbe6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-26cbe6-6f86965f89 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-26cbe6-689d748786-92mtw

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-26cbe6-689d748786-92mtw

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-26cbe6-6f86965f89-pkgrb

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-26cbe6-6f86965f89-pkgrb

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-26cbe6-689d748786-92mtw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-b-26cbe6-6f86965f89-pkgrb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-api-b-26cbe6-6f86965f89-pkgrb

AddedInterface

Add eth0 [10.134.0.70/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-api-b-26cbe6-689d748786-92mtw

AddedInterface

Add eth0 [10.132.0.77/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r

ProbeError

Startup probe error: Get "http://10.133.0.76:15021/healthz/ready": dial tcp 10.133.0.76:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r

Unhealthy

Startup probe failed: Get "http://10.133.0.76:15021/healthz/ready": dial tcp 10.133.0.76:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-api-a-88b9ff-5d964f9597-lgv59

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-88b9ff-5df6f7df6b-wfl84

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-a-88b9ff-openshift-default-7c6f4c48cd-hjclh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-api-b-26cbe6-6f86965f89-pkgrb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-26cbe6-689d748786-92mtw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-26cbe6-openshift-default-5d4d8895db-5x85r

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-c8e1cf-6848bf5687-4w2d4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-c8e1cf-7488c79cf8-jplrj

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-a-w1-c8e1cf

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-a-w1-c8e1cf: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-a-w1-c8e1cf": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-a-w1-c8e1cf, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 20331135-8a43-448a-93d4-f0e7ce74f902, UID in object meta:

openshift-ingress

kubelet

e2e-shared-a-w1-c8e1cf-openshift-default-6dcbc66748-wf8l9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-da587f-5cf56fcf5f-gn2sq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-da587f-6d788dc4f8-d2ppf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf

Unhealthy

Readiness probe failed: Get "http://10.133.0.61:15021/healthz/ready": dial tcp 10.133.0.61:15021: connect: connection refused

openshift-ingress

kubelet

e2e-shared-b-w1-da587f-openshift-default-7c48846ffb-2ntqf

ProbeError

Readiness probe error: Get "http://10.133.0.61:15021/healthz/ready": dial tcp 10.133.0.61:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-521326

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-521326

openshift-ingress

deployment-controller

e2e-ipp-a-521326-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-521326-openshift-default-5ddc57db88 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-521326-openshift-default-5ddc57db88

SuccessfulCreate

Created pod: e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c

openshift-ingress

multus

e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c

AddedInterface

Add eth0 [10.133.0.84/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-521326

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-521326-79cf58d6c from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-521326

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-521326-7655f5868b from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-521326-7655f5868b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-521326-7655f5868b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-521326: serviceaccount "payload-processing-e2e-ipp-a-521326" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-521326-79cf58d6c

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-521326-79cf58d6c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-521326: serviceaccount "payload-processing-e2e-ipp-a-521326" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-521326-7655f5868b-js2wn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-521326-7655f5868b-js2wn

AddedInterface

Add eth0 [10.134.0.73/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-521326-7655f5868b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-521326-7655f5868b-js2wn

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-521326-79cf58d6c

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-521326-79cf58d6c-9pkvv

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-521326-7655f5868b-js2wn

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-521326-79cf58d6c-9pkvv

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-521326-79cf58d6c-9pkvv

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-521326-79cf58d6c-9pkvv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-a-521326-79cf58d6c-9pkvv

AddedInterface

Add eth0 [10.134.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-521326-7655f5868b-js2wn

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c

Unhealthy

Readiness probe failed: Get "http://10.133.0.84:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c

ProbeError

Readiness probe error: Get "http://10.133.0.84:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c

Unhealthy

Startup probe failed: Get "http://10.133.0.84:15021/healthz/ready": dial tcp 10.133.0.84:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c

ProbeError

Startup probe error: Get "http://10.133.0.84:15021/healthz/ready": dial tcp 10.133.0.84:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-ipp-b-30ef69-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-30ef69-openshift-default-74c757bf7d from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-30ef69-openshift-default-74c757bf7d

SuccessfulCreate

Created pod: e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-30ef69

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-30ef69

openshift-ingress

multus

e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4

AddedInterface

Add eth0 [10.133.0.85/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-30ef69-78b476ddb5

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-30ef69-78b476ddb5-7qwr6

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-30ef69-78b476ddb5-7qwr6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-30ef69

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-30ef69-78b476ddb5 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-30ef69

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-30ef69-778f7878d6 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-30ef69-778f7878d6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-30ef69-778f7878d6-g9xnw
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-30ef69-778f7878d6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-30ef69-778f7878d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-30ef69: serviceaccount "payload-processing-e2e-ipp-b-30ef69" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-30ef69-778f7878d6-g9xnw

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-30ef69-778f7878d6-g9xnw

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-30ef69-778f7878d6-g9xnw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-30ef69-778f7878d6-g9xnw

AddedInterface

Add eth0 [10.134.0.76/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-30ef69-78b476ddb5

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-30ef69-78b476ddb5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-30ef69: serviceaccount "payload-processing-e2e-ipp-b-30ef69" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-30ef69-78b476ddb5-7qwr6

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-ipp-b-30ef69-78b476ddb5-7qwr6

AddedInterface

Add eth0 [10.134.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-30ef69-78b476ddb5-7qwr6

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4

Unhealthy

Readiness probe failed: Get "http://10.133.0.85:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4

ProbeError

Readiness probe error: Get "http://10.133.0.85:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4

Unhealthy

Startup probe failed: Get "http://10.133.0.85:15021/healthz/ready": dial tcp 10.133.0.85:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4

ProbeError

Startup probe error: Get "http://10.133.0.85:15021/healthz/ready": dial tcp 10.133.0.85:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-fa8af0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-fa8af0

openshift-ingress

multus

e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj

AddedInterface

Add eth0 [10.133.0.91/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ipp-cleanup-fa8af0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-fa8af0-openshift-default-748c577596 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-fa8af0-openshift-default-748c577596

SuccessfulCreate

Created pod: e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-fa8af0-6974cb684c

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-fa8af0-6974cb684c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-fa8af0: serviceaccount "payload-processing-e2e-ipp-cleanup-fa8af0" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-fa8af0-58775ccdd6-pj78n

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-fa8af0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-fa8af0-58775ccdd6 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-fa8af0-58775ccdd6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-fa8af0-58775ccdd6-pj78n
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-fa8af0-58775ccdd6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-fa8af0-58775ccdd6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-fa8af0: serviceaccount "payload-processing-e2e-ipp-cleanup-fa8af0" not found

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-fa8af0-58775ccdd6-pj78n

AddedInterface

Add eth0 [10.134.0.79/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-fa8af0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-fa8af0-6974cb684c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-fa8af0-6974cb684c

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-fa8af0-6974cb684c-mrhcj

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-fa8af0-6974cb684c-mrhcj

AddedInterface

Add eth0 [10.134.0.80/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-fa8af0-6974cb684c-mrhcj

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-fa8af0-58775ccdd6-pj78n

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-fa8af0-6974cb684c-mrhcj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-fa8af0-58775ccdd6-pj78n

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-fa8af0-6974cb684c-mrhcj

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj

Unhealthy

Startup probe failed: Get "http://10.133.0.91:15021/healthz/ready": dial tcp 10.133.0.91:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj

ProbeError

Startup probe error: Get "http://10.133.0.91:15021/healthz/ready": dial tcp 10.133.0.91:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-fa8af0-6974cb684c-mrhcj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-fa8af0-58775ccdd6-pj78n

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-fa8af0-openshift-default-748c577596-w4nmj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-521326-7655f5868b-js2wn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-521326-79cf58d6c-9pkvv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-521326-openshift-default-5ddc57db88-b5w4c

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-30ef69-778f7878d6-g9xnw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-30ef69-78b476ddb5-7qwr6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-b-30ef69-openshift-default-74c757bf7d-mjpb4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-a-w2-50372a

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-a-w2-50372a: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-a-w2-50372a": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-a-w2-50372a, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 76ea6d61-ef66-4f91-ba7d-ff56e5c423db, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-50372a-84d8f46cbb-xr47t

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-50372a-8648d87bdf-g7hjz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w2-50372a-openshift-default-57b557d8b-65zcb

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-f9c5c2-95f4d4d6c-vgqsp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-f9c5c2-74bc4fc88b-vl7bp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w2-f9c5c2-openshift-default-7765c9c9fb-m997h

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503