Time Namespace Component RelatedObject Reason Message

openshift-ingress

kube-auth-proxy-86bbc588c6-8rmmb

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-86bbc588c6-8rmmb to ip-10-0-137-50.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-ec8b82-68fccb6c4-kcmwp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-ec8b82-68fccb6c4-kcmwp to ip-10-0-137-50.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-z42zz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-z42zz to ip-10-0-130-159.ec2.internal

openshift-ingress

e2e-shared-b-w3-317780-openshift-default-794cb8f58b-kw4t8

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-317780-openshift-default-794cb8f58b-kw4t8 to ip-10-0-137-50.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-4c51cf40-6946c695f4-jjnnv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-4c51cf40-6946c695f4-jjnnv to ip-10-0-135-222.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-c4557f0d-68f654dd78-9vj7w

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-c4557f0d-68f654dd78-9vj7w to ip-10-0-135-222.ec2.internal

openshift-ingress

e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj to ip-10-0-135-222.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-ed9f38-69956d6f-m8mbv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-ed9f38-69956d6f-m8mbv to ip-10-0-135-222.ec2.internal

openshift-ingress

e2e-ait-4c51cf40-openshift-default-78c989476d-9kzbt

Scheduled

Successfully assigned openshift-ingress/e2e-ait-4c51cf40-openshift-default-78c989476d-9kzbt to ip-10-0-137-50.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-725649-7c8f59bcc-c5vzm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-725649-7c8f59bcc-c5vzm to ip-10-0-135-222.ec2.internal

openshift-ingress

payload-processing-e2e-derive-066f62f9-859f6fc4bf-gsqw9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-066f62f9-859f6fc4bf-gsqw9 to ip-10-0-135-222.ec2.internal

openshift-ingress

e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c to ip-10-0-135-222.ec2.internal

openshift-ingress

e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn to ip-10-0-135-222.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-a66f8f-6689585994-b2gs7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-a66f8f-6689585994-b2gs7 to ip-10-0-135-222.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-dd1246-946648898-4hshm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-dd1246-946648898-4hshm to ip-10-0-137-50.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-8195ba-6fd597d499-cs4rg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-8195ba-6fd597d499-cs4rg to ip-10-0-135-222.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-4cfa5a-7c8c4fc9d6-dzsc7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-4cfa5a-7c8c4fc9d6-dzsc7 to ip-10-0-130-159.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-066f62f9-f59699474-t8vwr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-066f62f9-f59699474-t8vwr to ip-10-0-135-222.ec2.internal

openshift-ingress

payload-processing-e2e-autores-4cfa5a-75ddbf85cc-s7tkt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-4cfa5a-75ddbf85cc-s7tkt to ip-10-0-130-159.ec2.internal

openshift-ingress

e2e-ait-c4557f0d-openshift-default-76d4f8cd8d-2gbgc

Scheduled

Successfully assigned openshift-ingress/e2e-ait-c4557f0d-openshift-default-76d4f8cd8d-2gbgc to ip-10-0-137-50.ec2.internal

openshift-ingress

e2e-shared-a-w3-ed9f38-openshift-default-8dd7cf4-ps78x

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-ed9f38-openshift-default-8dd7cf4-ps78x to ip-10-0-137-50.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-725649-84b5fd947d-hszsn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-725649-84b5fd947d-hszsn to ip-10-0-135-222.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-04a2fd-8bf7d5dfd-f2cz2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-04a2fd-8bf7d5dfd-f2cz2 to ip-10-0-135-222.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-5vxjh

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-5vxjh to ip-10-0-135-222.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-703998-6fb87bb646-rk7tk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-703998-6fb87bb646-rk7tk to ip-10-0-135-222.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-5ccb968c66-7ncht

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7ncht to ip-10-0-135-222.ec2.internal

openshift-ingress

e2e-shared-a-w2-4559b3-openshift-default-7c5f85f54-w98fx

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-4559b3-openshift-default-7c5f85f54-w98fx to ip-10-0-137-50.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-l7zjx

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-l7zjx to ip-10-0-135-222.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-90811b-6d46c9954f-5xmpr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-90811b-6d46c9954f-5xmpr to ip-10-0-135-222.ec2.internal

openshift-ingress

payload-processing-e2e-mt-f5813346-5897d44497-fc64d

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-f5813346-5897d44497-fc64d to ip-10-0-130-159.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-6be25a-79689c49cd-xw7l5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-6be25a-79689c49cd-xw7l5 to ip-10-0-135-222.ec2.internal

openshift-ingress

payload-processing-e2e-mt-06367b84-548b974c4f-l2lbh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-06367b84-548b974c4f-l2lbh to ip-10-0-135-222.ec2.internal

openshift-ingress

e2e-noten-1750e4-openshift-default-65c9c9b5c6-glkmq

Scheduled

Successfully assigned openshift-ingress/e2e-noten-1750e4-openshift-default-65c9c9b5c6-glkmq to ip-10-0-137-50.ec2.internal

openshift-ingress

e2e-api-a-a66f8f-openshift-default-59d849dbcd-wggf6

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-a66f8f-openshift-default-59d849dbcd-wggf6 to ip-10-0-130-159.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-04a2fd-85fbff65d7-th4bz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-04a2fd-85fbff65d7-th4bz to ip-10-0-135-222.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-d26a0a-6f8cf8478-dh4qz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d26a0a-6f8cf8478-dh4qz to ip-10-0-135-222.ec2.internal

openshift-ingress

e2e-ipp-cleanup-d26a0a-openshift-default-65d567cc84-47lv9

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-d26a0a-openshift-default-65d567cc84-47lv9 to ip-10-0-130-159.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-4559b3-68747b868f-nn52f

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-4559b3-68747b868f-nn52f to ip-10-0-135-222.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-68cf4d799cxcjbs

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cxcjbs to ip-10-0-135-222.ec2.internal

openshift-ingress

e2e-explicit-725649-openshift-default-7b5b9999b4-6j6h2

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-725649-openshift-default-7b5b9999b4-6j6h2 to ip-10-0-137-50.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-ed9f38-76d9ffc7db-v7s5s

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ed9f38-76d9ffc7db-v7s5s to ip-10-0-135-222.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-34c720e3-66b8b59fd6-knhjt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-34c720e3-66b8b59fd6-knhjt to ip-10-0-135-222.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-d26a0a-7b4564fb79-5vm7j

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-d26a0a-7b4564fb79-5vm7j to ip-10-0-135-222.ec2.internal

openshift-ingress

e2e-api-b-dd1246-openshift-default-59969c48dd-87qlw

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-dd1246-openshift-default-59969c48dd-87qlw to ip-10-0-137-50.ec2.internal

openshift-ingress

e2e-inf-a-04a2fd-openshift-default-74d645d896-c89xp

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-04a2fd-openshift-default-74d645d896-c89xp to ip-10-0-130-159.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-a66f8f-64df657685-h64qp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-a66f8f-64df657685-h64qp to ip-10-0-135-222.ec2.internal

openshift-ingress

payload-processing-e2e-ait-4c51cf40-c54c89b79-xxwg4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-4c51cf40-c54c89b79-xxwg4 to ip-10-0-135-222.ec2.internal

openshift-ingress

payload-processing-e2e-ait-c4557f0d-6bb57cc447-xhdkc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-c4557f0d-6bb57cc447-xhdkc to ip-10-0-135-222.ec2.internal

openshift-ingress

e2e-inf-b-703998-openshift-default-78669cb68d-f479k

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-703998-openshift-default-78669cb68d-f479k to ip-10-0-137-50.ec2.internal

openshift-ingress

e2e-ipp-a-ec8b82-openshift-default-65cf789494-k4s5q

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-ec8b82-openshift-default-65cf789494-k4s5q to ip-10-0-130-159.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w4-b15051-554564495-2c89t

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-b15051-554564495-2c89t to ip-10-0-130-159.ec2.internal

openshift-ingress

kube-auth-proxy-86bbc588c6-zlhv2

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-86bbc588c6-zlhv2 to ip-10-0-130-159.ec2.internal

openshift-ingress

e2e-ipp-b-6be25a-openshift-default-6796dcdc8-zzwz6

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-6be25a-openshift-default-6796dcdc8-zzwz6 to ip-10-0-130-159.ec2.internal

openshift-ingress

router-default-95688946b-7rdfv

Scheduled

Successfully assigned openshift-ingress/router-default-95688946b-7rdfv to ip-10-0-130-159.ec2.internal

openshift-ingress

router-default-95688946b-7rdfv

FailedScheduling

0/3 nodes are available: 3 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/3 nodes are available: 3 Preemption is not helpful for scheduling.

openshift-ingress

e2e-autores-4cfa5a-openshift-default-76bf6fbdb-nbpxc

Scheduled

Successfully assigned openshift-ingress/e2e-autores-4cfa5a-openshift-default-76bf6fbdb-nbpxc to ip-10-0-137-50.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-6be25a-c6fb865df-txgvx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-6be25a-c6fb865df-txgvx to ip-10-0-137-50.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-ec8b82-797fbbc557-r2jtb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-ec8b82-797fbbc557-r2jtb to ip-10-0-135-222.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-34c720e3-56f85c746-kwmvh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-34c720e3-56f85c746-kwmvh to ip-10-0-135-222.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-06367b84-6cb7f9cfd6-vbmfv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-06367b84-6cb7f9cfd6-vbmfv to ip-10-0-135-222.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-f5813346-6ccc46b5f4-525xv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-f5813346-6ccc46b5f4-525xv to ip-10-0-135-222.ec2.internal

openshift-ingress

e2e-mt-f5813346-openshift-default-dcd586ff6-cvqn5

Scheduled

Successfully assigned openshift-ingress/e2e-mt-f5813346-openshift-default-dcd586ff6-cvqn5 to ip-10-0-130-159.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-4559b3-7f785986db-78drr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4559b3-7f785986db-78drr to ip-10-0-135-222.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-317780-f897765b5-667z6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-317780-f897765b5-667z6 to ip-10-0-135-222.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-90811b-579566d85d-h2vq2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-90811b-579566d85d-h2vq2 to ip-10-0-135-222.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-317780-6fb7cd7b66-h844t

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-317780-6fb7cd7b66-h844t to ip-10-0-135-222.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-8195ba-558c4899f8-fps5m

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-8195ba-558c4899f8-fps5m to ip-10-0-135-222.ec2.internal

openshift-ingress

e2e-mt-06367b84-openshift-default-69d5cc7568-448dr

Scheduled

Successfully assigned openshift-ingress/e2e-mt-06367b84-openshift-default-69d5cc7568-448dr to ip-10-0-137-50.ec2.internal

openshift-ingress

e2e-derive-066f62f9-openshift-default-68cf7b7b84-h7njd

Scheduled

Successfully assigned openshift-ingress/e2e-derive-066f62f9-openshift-default-68cf7b7b84-h7njd to ip-10-0-137-50.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-dd1246-6d64f7c7cf-ng692

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-dd1246-6d64f7c7cf-ng692 to ip-10-0-135-222.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-42hqf

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-42hqf to ip-10-0-130-159.ec2.internal

openshift-ingress

e2e-migrate-34c720e3-gw-openshift-default-7976458dbd-5ztqm

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-34c720e3-gw-openshift-default-7976458dbd-5ztqm to ip-10-0-137-50.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-b15051-75f77884c4-klpfp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-b15051-75f77884c4-klpfp to ip-10-0-130-159.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-703998-56676dd7-vhtqd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-703998-56676dd7-vhtqd to ip-10-0-130-159.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-95688946b from 0 to 1

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x13)

openshift-ingress

replicaset-controller

router-default-95688946b

FailedCreate

Error creating: pods "router-default-95688946b-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x16)

openshift-ingress

replicaset-controller

router-default-95688946b

FailedCreate

Error creating: pods "router-default-95688946b-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-95688946b

SuccessfulCreate

Created pod: router-default-95688946b-7rdfv
(x6)

openshift-ingress

kubelet

router-default-95688946b-7rdfv

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x6)

openshift-ingress

kubelet

router-default-95688946b-7rdfv

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found

openshift-ingress

multus

router-default-95688946b-7rdfv

AddedInterface

Add eth0 [10.132.0.14/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-95688946b-7rdfv

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eaa467bc105be2f7695ecfea0f0c53f4c5cd52f1f705da378c7a33d13f1d102f" already present on machine

openshift-ingress

kubelet

router-default-95688946b-7rdfv

Created

Created container: router

openshift-ingress

kubelet

router-default-95688946b-7rdfv

Started

Started container router

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-86bbc588c6 from 0 to 2

openshift-ingress

replicaset-controller

kube-auth-proxy-86bbc588c6

SuccessfulCreate

Created pod: kube-auth-proxy-86bbc588c6-zlhv2

openshift-ingress

kubelet

kube-auth-proxy-86bbc588c6-zlhv2

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-86bbc588c6-zlhv2

AddedInterface

Add eth0 [10.132.0.24/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-86bbc588c6-8rmmb

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-86bbc588c6-8rmmb

AddedInterface

Add eth0 [10.133.0.32/23] from ovn-kubernetes
(x3)

openshift-ingress

replicaset-controller

kube-auth-proxy-86bbc588c6

FailedCreate

Error creating: pods "kube-auth-proxy-86bbc588c6-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-86bbc588c6

SuccessfulCreate

Created pod: kube-auth-proxy-86bbc588c6-8rmmb

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-42hqf

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-42hqf

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-42hqf

AddedInterface

Add eth0 [10.132.0.25/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-86bbc588c6-8rmmb

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-86bbc588c6-zlhv2

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-86bbc588c6-zlhv2

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-86bbc588c6-zlhv2

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.845s (2.845s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-86bbc588c6-8rmmb

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.78s (2.78s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-86bbc588c6-8rmmb

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-42hqf

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-42hqf

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-42hqf

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.332s (3.332s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-42hqf

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-68cf4d799c from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-42hqf

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-68cf4d799cxcjbs

AddedInterface

Add eth0 [10.134.0.22/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-68cf4d799c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-68cf4d799cxcjbs

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cxcjbs

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cxcjbs

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 3.377s (3.377s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cxcjbs

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cxcjbs

Created

Created container: istio-proxy

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-l7zjx

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-l7zjx

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-l7zjx

AddedInterface

Add eth0 [10.134.0.25/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-l7zjx

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-l7zjx

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.77s (2.77s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-l7zjx

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-l7zjx

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-l7zjx

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-42hqf

Killing

Stopping container discovery

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-42hqf

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5ccb968c66

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5ccb968c66-7ncht

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

multus

maas-default-gateway-openshift-default-5ccb968c66-7ncht

AddedInterface

Add eth0 [10.134.0.26/23] from ovn-kubernetes

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-5ccb968c66 from 0 to 1

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-5vxjh

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-z42zz

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-z42zz

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-5vxjh

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-5b54b7fbb7-5vxjh

AddedInterface

Add eth0 [10.134.0.27/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-z42zz

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-5vxjh

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.435s (1.435s including waiting). Image size: 166453408 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-5vxjh

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-5vxjh

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-z42zz

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.565s (2.565s including waiting). Image size: 166453408 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-z42zz

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-z42zz

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-7ncht

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-7ncht

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-7ncht

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-7ncht

Unhealthy

Startup probe failed: Get "http://10.134.0.26:15021/healthz/ready": dial tcp 10.134.0.26:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-7ncht

ProbeError

Startup probe error: Get "http://10.134.0.26:15021/healthz/ready": dial tcp 10.134.0.26:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w4-b15051-openshift-default-76cc7dfb68

SuccessfulCreate

Created pod: e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c

openshift-ingress

kubelet

e2e-inf-a-04a2fd-openshift-default-74d645d896-c89xp

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-b15051

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-b15051

openshift-ingress

multus

e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c

AddedInterface

Add eth0 [10.134.0.31/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-inf-a-04a2fd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-04a2fd-openshift-default-74d645d896 from 0 to 1

openshift-ingress

deployment-controller

e2e-worker-w4-b15051-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-b15051-openshift-default-76cc7dfb68 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-a-04a2fd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-04a2fd

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-8195ba

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-8195ba

openshift-ingress

deployment-controller

e2e-worker-w0-8195ba-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-8195ba-openshift-default-6f5645f748 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w0-8195ba-openshift-default-6f5645f748

SuccessfulCreate

Created pod: e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj

openshift-ingress

multus

e2e-inf-a-04a2fd-openshift-default-74d645d896-c89xp

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-inf-a-04a2fd-openshift-default-74d645d896

SuccessfulCreate

Created pod: e2e-inf-a-04a2fd-openshift-default-74d645d896-c89xp

openshift-ingress

multus

e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj

AddedInterface

Add eth0 [10.134.0.32/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-04a2fd-openshift-default-74d645d896-c89xp

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 3.523s (3.523s including waiting). Image size: 181318953 bytes.

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-b15051

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-b15051-554564495 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-b15051-75f77884c4-klpfp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-b15051-75f77884c4-klpfp

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-b15051-75f77884c4-klpfp

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-b15051-554564495-2c89t

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-b15051-75f77884c4-klpfp

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-b15051-75f77884c4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-b15051-75f77884c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-b15051: serviceaccount "payload-processing-e2e-worker-w4-b15051" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-b15051-554564495

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-b15051-554564495-2c89t
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-b15051-554564495

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-b15051-554564495-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-b15051: serviceaccount "payload-processing-e2e-worker-w4-b15051" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-b15051-75f77884c4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-b15051-75f77884c4-klpfp

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-b15051-554564495-2c89t

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-worker-w4-b15051-554564495-2c89t

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-b15051-554564495-2c89t

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-b15051

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-b15051-75f77884c4 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-8195ba

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-8195ba-558c4899f8 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-8195ba-6fd597d499-cs4rg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-8195ba

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-8195ba-6fd597d499 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-8195ba-6fd597d499

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-8195ba-6fd597d499-cs4rg

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-8195ba-558c4899f8-fps5m

AddedInterface

Add eth0 [10.134.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-8195ba-558c4899f8-fps5m

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-8195ba-6fd597d499

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-8195ba-6fd597d499-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-8195ba: serviceaccount "payload-processing-e2e-worker-w0-8195ba" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-8195ba-6fd597d499-cs4rg

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-8195ba-6fd597d499-cs4rg

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-worker-w0-8195ba-6fd597d499-cs4rg

AddedInterface

Add eth0 [10.134.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-8195ba-558c4899f8-fps5m

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-8195ba-558c4899f8-fps5m

Started

Started container payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-8195ba-558c4899f8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-8195ba-558c4899f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-8195ba: serviceaccount "payload-processing-e2e-worker-w0-8195ba" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-8195ba-558c4899f8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-8195ba-558c4899f8-fps5m

openshift-ingress

replicaset-controller

e2e-ait-c4557f0d-openshift-default-76d4f8cd8d

SuccessfulCreate

Created pod: e2e-ait-c4557f0d-openshift-default-76d4f8cd8d-2gbgc

openshift-ingress

gateway_labeler_controller

e2e-ait-c4557f0d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-c4557f0d

openshift-ingress

deployment-controller

e2e-ait-c4557f0d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-c4557f0d-openshift-default-76d4f8cd8d from 0 to 1

openshift-ingress

kubelet

e2e-ait-c4557f0d-openshift-default-76d4f8cd8d-2gbgc

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

e2e-ait-c4557f0d-openshift-default-76d4f8cd8d-2gbgc

AddedInterface

Add eth0 [10.133.0.47/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-04a2fd-85fbff65d7

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-04a2fd-85fbff65d7-th4bz

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-04a2fd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-04a2fd-85fbff65d7 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-04a2fd-85fbff65d7

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-04a2fd-85fbff65d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-04a2fd: serviceaccount "payload-processing-e2e-inf-a-04a2fd" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-04a2fd-8bf7d5dfd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-04a2fd-8bf7d5dfd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-04a2fd: serviceaccount "payload-processing-e2e-inf-a-04a2fd" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-04a2fd-8bf7d5dfd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-04a2fd-8bf7d5dfd-f2cz2

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-04a2fd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-04a2fd-8bf7d5dfd from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-a-04a2fd-85fbff65d7-th4bz

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-04a2fd-8bf7d5dfd-f2cz2

AddedInterface

Add eth0 [10.134.0.35/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-autores-4cfa5a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-4cfa5a

openshift-ingress

deployment-controller

e2e-autores-4cfa5a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-4cfa5a-openshift-default-76bf6fbdb from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-a-04a2fd-85fbff65d7-th4bz

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-04a2fd-85fbff65d7-th4bz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-inf-a-04a2fd-85fbff65d7-th4bz

AddedInterface

Add eth0 [10.134.0.36/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-04a2fd-8bf7d5dfd-f2cz2

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-04a2fd-8bf7d5dfd-f2cz2

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-04a2fd-8bf7d5dfd-f2cz2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

e2e-autores-4cfa5a-openshift-default-76bf6fbdb

SuccessfulCreate

Created pod: e2e-autores-4cfa5a-openshift-default-76bf6fbdb-nbpxc

openshift-ingress

kubelet

e2e-autores-4cfa5a-openshift-default-76bf6fbdb-nbpxc

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

e2e-autores-4cfa5a-openshift-default-76bf6fbdb-nbpxc

AddedInterface

Add eth0 [10.133.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-c4557f0d-openshift-default-76d4f8cd8d-2gbgc

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 4.251s (4.251s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

e2e-autores-4cfa5a-openshift-default-76bf6fbdb-nbpxc

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 1.145s (1.145s including waiting). Image size: 181318953 bytes.

openshift-ingress

deployment-controller

payload-processing-e2e-autores-4cfa5a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-4cfa5a-75ddbf85cc from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-4cfa5a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-4cfa5a-7c8c4fc9d6 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-4cfa5a-7c8c4fc9d6-dzsc7

Created

Created container: payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-4cfa5a-7c8c4fc9d6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-4cfa5a-7c8c4fc9d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-4cfa5a: serviceaccount "payload-processing-e2e-autores-4cfa5a" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-4cfa5a-7c8c4fc9d6-dzsc7

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-autores-4cfa5a-75ddbf85cc-s7tkt

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-4cfa5a-7c8c4fc9d6-dzsc7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-4cfa5a-7c8c4fc9d6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-4cfa5a-7c8c4fc9d6-dzsc7

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-4cfa5a-75ddbf85cc

SuccessfulCreate

Created pod: payload-processing-e2e-autores-4cfa5a-75ddbf85cc-s7tkt

openshift-ingress

multus

payload-pre-processing-e2e-autores-4cfa5a-7c8c4fc9d6-dzsc7

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-4cfa5a-75ddbf85cc-s7tkt

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-4cfa5a-75ddbf85cc-s7tkt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-4cfa5a-75ddbf85cc

FailedCreate

Error creating: pods "payload-processing-e2e-autores-4cfa5a-75ddbf85cc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-4cfa5a: serviceaccount "payload-processing-e2e-autores-4cfa5a" not found

openshift-ingress

kubelet

payload-processing-e2e-autores-4cfa5a-75ddbf85cc-s7tkt

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-c4557f0d-6bb57cc447

SuccessfulCreate

Created pod: payload-processing-e2e-ait-c4557f0d-6bb57cc447-xhdkc

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-c4557f0d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-c4557f0d-68f654dd78 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-c4557f0d-68f654dd78-9vj7w

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

e2e-inf-b-703998-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-703998-openshift-default-78669cb68d from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-703998-openshift-default-78669cb68d

SuccessfulCreate

Created pod: e2e-inf-b-703998-openshift-default-78669cb68d-f479k

openshift-ingress

gateway_labeler_controller

e2e-inf-b-703998

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-703998

openshift-ingress

deployment-controller

payload-processing-e2e-ait-c4557f0d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-c4557f0d-6bb57cc447 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-c4557f0d-6bb57cc447

FailedCreate

Error creating: pods "payload-processing-e2e-ait-c4557f0d-6bb57cc447-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-c4557f0d: serviceaccount "payload-processing-e2e-ait-c4557f0d" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-c4557f0d-68f654dd78-9vj7w

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-c4557f0d-68f654dd78-9vj7w

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-c4557f0d-68f654dd78-9vj7w

AddedInterface

Add eth0 [10.134.0.37/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-c4557f0d-68f654dd78

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-c4557f0d-68f654dd78-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-c4557f0d: serviceaccount "payload-processing-e2e-ait-c4557f0d" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-c4557f0d-68f654dd78

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-c4557f0d-68f654dd78-9vj7w

openshift-ingress

multus

payload-processing-e2e-ait-c4557f0d-6bb57cc447-xhdkc

AddedInterface

Add eth0 [10.134.0.38/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-c4557f0d-6bb57cc447-xhdkc

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-c4557f0d-6bb57cc447-xhdkc

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-c4557f0d-6bb57cc447-xhdkc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

multus

e2e-inf-b-703998-openshift-default-78669cb68d-f479k

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c

Unhealthy

Startup probe failed: Get "http://10.134.0.31:15021/healthz/ready": dial tcp 10.134.0.31:15021: connect: connection refused

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-703998-6fb87bb646

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-703998-6fb87bb646-rk7tk

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-703998

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-703998-6fb87bb646 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-703998-6fb87bb646

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-703998-6fb87bb646-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-703998: serviceaccount "payload-processing-e2e-inf-b-703998" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-703998

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-703998-56676dd7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-703998-56676dd7

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-703998-56676dd7-vhtqd
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-703998-56676dd7

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-703998-56676dd7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-703998: serviceaccount "payload-processing-e2e-inf-b-703998" not found
(x5)

openshift-ingress

kubelet

e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c

ProbeError

Startup probe error: Get "http://10.134.0.31:15021/healthz/ready": dial tcp 10.134.0.31:15021: connect: connection refused body:

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-703998-6fb87bb646-rk7tk

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-703998-56676dd7-vhtqd

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-703998-6fb87bb646-rk7tk

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-703998-56676dd7-vhtqd

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-703998-6fb87bb646-rk7tk

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-703998-56676dd7-vhtqd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-inf-b-703998-56676dd7-vhtqd

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-703998-6fb87bb646-rk7tk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x6)

openshift-ingress

kubelet

e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj

Unhealthy

Startup probe failed: Get "http://10.134.0.32:15021/healthz/ready": dial tcp 10.134.0.32:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj

ProbeError

Startup probe error: Get "http://10.134.0.32:15021/healthz/ready": dial tcp 10.134.0.32:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-inf-a-04a2fd-openshift-default-74d645d896-c89xp

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-04a2fd-openshift-default-74d645d896-c89xp

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-04a2fd-openshift-default-74d645d896-c89xp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-inf-a-04a2fd-openshift-default-74d645d896-c89xp

ProbeError

Startup probe error: Get "http://10.132.0.46:15021/healthz/ready": dial tcp 10.132.0.46:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-a-04a2fd-openshift-default-74d645d896-c89xp

Unhealthy

Startup probe failed: Get "http://10.132.0.46:15021/healthz/ready": dial tcp 10.132.0.46:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-autores-4cfa5a-openshift-default-76bf6fbdb-nbpxc

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-autores-4cfa5a-openshift-default-76bf6fbdb-nbpxc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-autores-4cfa5a-openshift-default-76bf6fbdb-nbpxc

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-c4557f0d-openshift-default-76d4f8cd8d-2gbgc

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-c4557f0d-openshift-default-76d4f8cd8d-2gbgc

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-ait-c4557f0d-openshift-default-76d4f8cd8d-2gbgc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ait-c4557f0d-openshift-default-76d4f8cd8d-2gbgc

ProbeError

Startup probe error: Get "http://10.133.0.47:15021/healthz/ready": dial tcp 10.133.0.47:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-c4557f0d-openshift-default-76d4f8cd8d-2gbgc

Unhealthy

Startup probe failed: Get "http://10.133.0.47:15021/healthz/ready": dial tcp 10.133.0.47:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-autores-4cfa5a-openshift-default-76bf6fbdb-nbpxc

Unhealthy

Startup probe failed: Get "http://10.133.0.49:15021/healthz/ready": dial tcp 10.133.0.49:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-autores-4cfa5a-openshift-default-76bf6fbdb-nbpxc

ProbeError

Startup probe error: Get "http://10.133.0.49:15021/healthz/ready": dial tcp 10.133.0.49:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-inf-b-703998-openshift-default-78669cb68d-f479k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-703998-openshift-default-78669cb68d-f479k

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-703998-openshift-default-78669cb68d-f479k

Created

Created container: istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-c4557f0d-68f654dd78-9vj7w

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-c4557f0d-6bb57cc447-xhdkc

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ait-c4557f0d

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ait-c4557f0d: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ait-c4557f0d": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ait-c4557f0d, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 45958eae-34bf-4acb-8608-db01fce816c5, UID in object meta:

openshift-ingress

kubelet

e2e-ait-c4557f0d-openshift-default-76d4f8cd8d-2gbgc

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-migrate-34c720e3-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-34c720e3-gw

openshift-ingress

deployment-controller

e2e-migrate-34c720e3-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-34c720e3-gw-openshift-default-7976458dbd from 0 to 1

openshift-ingress

replicaset-controller

e2e-migrate-34c720e3-gw-openshift-default-7976458dbd

SuccessfulCreate

Created pod: e2e-migrate-34c720e3-gw-openshift-default-7976458dbd-5ztqm
(x6)

openshift-ingress

kubelet

e2e-inf-b-703998-openshift-default-78669cb68d-f479k

Unhealthy

Startup probe failed: Get "http://10.133.0.52:15021/healthz/ready": dial tcp 10.133.0.52:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-b-703998-openshift-default-78669cb68d-f479k

ProbeError

Startup probe error: Get "http://10.133.0.52:15021/healthz/ready": dial tcp 10.133.0.52:15021: connect: connection refused body:

openshift-ingress

multus

e2e-migrate-34c720e3-gw-openshift-default-7976458dbd-5ztqm

AddedInterface

Add eth0 [10.133.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-c4557f0d-openshift-default-76d4f8cd8d-2gbgc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ait-c4557f0d-openshift-default-76d4f8cd8d-2gbgc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-34c720e3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-34c720e3-66b8b59fd6 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-34c720e3-56f85c746-kwmvh

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-34c720e3-56f85c746-kwmvh

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-34c720e3-66b8b59fd6

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-34c720e3-66b8b59fd6-knhjt

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-34c720e3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-34c720e3-56f85c746 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-migrate-34c720e3-66b8b59fd6-knhjt

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-34c720e3-66b8b59fd6-knhjt

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-34c720e3-66b8b59fd6-knhjt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-34c720e3-56f85c746

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-34c720e3-56f85c746-kwmvh

openshift-ingress

multus

payload-processing-e2e-migrate-34c720e3-66b8b59fd6-knhjt

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-migrate-34c720e3-56f85c746-kwmvh

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-34c720e3-56f85c746-kwmvh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-34c720e3-66b8b59fd6

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-34c720e3-66b8b59fd6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-34c720e3: serviceaccount "payload-processing-e2e-migrate-34c720e3" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-34c720e3-56f85c746

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-34c720e3-56f85c746-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-34c720e3: serviceaccount "payload-processing-e2e-migrate-34c720e3" not found
(x2)

openshift-ingress

kubelet

e2e-migrate-34c720e3-gw-openshift-default-7976458dbd-5ztqm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-34c720e3-gw-openshift-default-7976458dbd-5ztqm

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-34c720e3-gw-openshift-default-7976458dbd-5ztqm

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-migrate-34c720e3-gw-openshift-default-7976458dbd-5ztqm

ProbeError

Startup probe error: Get "http://10.133.0.54:15021/healthz/ready": dial tcp 10.133.0.54:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-migrate-34c720e3-gw-openshift-default-7976458dbd-5ztqm

Unhealthy

Startup probe failed: Get "http://10.133.0.54:15021/healthz/ready": dial tcp 10.133.0.54:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-34c720e3-56f85c746-kwmvh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-34c720e3-66b8b59fd6-knhjt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-migrate-34c720e3-gw-openshift-default-7976458dbd-5ztqm

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-ait-4c51cf40-openshift-default-78c989476d

SuccessfulCreate

Created pod: e2e-ait-4c51cf40-openshift-default-78c989476d-9kzbt

openshift-ingress

multus

e2e-ait-4c51cf40-openshift-default-78c989476d-9kzbt

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ait-4c51cf40

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-4c51cf40

openshift-ingress

deployment-controller

e2e-ait-4c51cf40-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-4c51cf40-openshift-default-78c989476d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-4c51cf40-6946c695f4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-4c51cf40-6946c695f4-jjnnv

openshift-ingress

deployment-controller

payload-processing-e2e-ait-4c51cf40

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-4c51cf40-c54c89b79 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-4c51cf40-c54c89b79

SuccessfulCreate

Created pod: payload-processing-e2e-ait-4c51cf40-c54c89b79-xxwg4
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-4c51cf40-c54c89b79

FailedCreate

Error creating: pods "payload-processing-e2e-ait-4c51cf40-c54c89b79-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-4c51cf40: serviceaccount "payload-processing-e2e-ait-4c51cf40" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-4c51cf40-6946c695f4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-4c51cf40-6946c695f4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-4c51cf40: serviceaccount "payload-processing-e2e-ait-4c51cf40" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-4c51cf40

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-4c51cf40-6946c695f4 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-4c51cf40-6946c695f4-jjnnv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-4c51cf40-6946c695f4-jjnnv

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-4c51cf40-6946c695f4-jjnnv

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ait-4c51cf40-c54c89b79-xxwg4

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-4c51cf40-c54c89b79-xxwg4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-4c51cf40-c54c89b79-xxwg4

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-4c51cf40-c54c89b79-xxwg4

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-4c51cf40-6946c695f4-jjnnv

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ait-4c51cf40-openshift-default-78c989476d-9kzbt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-4c51cf40-openshift-default-78c989476d-9kzbt

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-4c51cf40-openshift-default-78c989476d-9kzbt

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-ait-4c51cf40-openshift-default-78c989476d-9kzbt

Unhealthy

Startup probe failed: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ait-4c51cf40-openshift-default-78c989476d-9kzbt

ProbeError

Startup probe error: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-autores-4cfa5a-75ddbf85cc-s7tkt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-4cfa5a-7c8c4fc9d6-dzsc7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-4c51cf40-c54c89b79-xxwg4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-4c51cf40-6946c695f4-jjnnv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-4c51cf40-openshift-default-78c989476d-9kzbt

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-derive-066f62f9-openshift-default-68cf7b7b84

SuccessfulCreate

Created pod: e2e-derive-066f62f9-openshift-default-68cf7b7b84-h7njd

openshift-ingress

gateway_labeler_controller

e2e-derive-066f62f9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-066f62f9

openshift-ingress

deployment-controller

e2e-derive-066f62f9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-066f62f9-openshift-default-68cf7b7b84 from 0 to 1

openshift-ingress

multus

e2e-derive-066f62f9-openshift-default-68cf7b7b84-h7njd

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-066f62f9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-066f62f9-f59699474 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-066f62f9-859f6fc4bf

SuccessfulCreate

Created pod: payload-processing-e2e-derive-066f62f9-859f6fc4bf-gsqw9

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-066f62f9-f59699474

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-066f62f9-f59699474-t8vwr

openshift-ingress

deployment-controller

payload-processing-e2e-derive-066f62f9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-066f62f9-859f6fc4bf from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-066f62f9-f59699474

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-066f62f9-f59699474-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-066f62f9: serviceaccount "payload-processing-e2e-derive-066f62f9" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-066f62f9-859f6fc4bf

FailedCreate

Error creating: pods "payload-processing-e2e-derive-066f62f9-859f6fc4bf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-066f62f9: serviceaccount "payload-processing-e2e-derive-066f62f9" not found

openshift-ingress

kubelet

payload-processing-e2e-derive-066f62f9-859f6fc4bf-gsqw9

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-derive-066f62f9-859f6fc4bf-gsqw9

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-066f62f9-859f6fc4bf-gsqw9

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-066f62f9-859f6fc4bf-gsqw9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-derive-066f62f9-f59699474-t8vwr

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-066f62f9-f59699474-t8vwr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-066f62f9-f59699474-t8vwr

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-066f62f9-f59699474-t8vwr

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-derive-066f62f9-openshift-default-68cf7b7b84-h7njd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-066f62f9-openshift-default-68cf7b7b84-h7njd

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-066f62f9-openshift-default-68cf7b7b84-h7njd

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-autores-4cfa5a-openshift-default-76bf6fbdb-nbpxc

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-explicit-725649-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-725649-openshift-default-7b5b9999b4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-explicit-725649-openshift-default-7b5b9999b4

SuccessfulCreate

Created pod: e2e-explicit-725649-openshift-default-7b5b9999b4-6j6h2

openshift-ingress

gateway_labeler_controller

e2e-explicit-725649

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-725649

openshift-ingress

multus

e2e-explicit-725649-openshift-default-7b5b9999b4-6j6h2

AddedInterface

Add eth0 [10.133.0.62/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-derive-066f62f9-openshift-default-68cf7b7b84-h7njd

Unhealthy

Startup probe failed: Get "http://10.133.0.60:15021/healthz/ready": dial tcp 10.133.0.60:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-derive-066f62f9-openshift-default-68cf7b7b84-h7njd

ProbeError

Startup probe error: Get "http://10.133.0.60:15021/healthz/ready": dial tcp 10.133.0.60:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-explicit-725649-7c8f59bcc-c5vzm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-explicit-725649-7c8f59bcc-c5vzm

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-725649-84b5fd947d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-725649-84b5fd947d-hszsn

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-725649

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-725649-84b5fd947d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-725649-7c8f59bcc

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-725649-7c8f59bcc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-725649: serviceaccount "payload-processing-e2e-explicit-725649" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-725649-84b5fd947d-hszsn

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-725649-84b5fd947d-hszsn

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-725649-84b5fd947d-hszsn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-725649

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-725649-7c8f59bcc from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-725649-7c8f59bcc

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-725649-7c8f59bcc-c5vzm

openshift-ingress

multus

payload-pre-processing-e2e-explicit-725649-84b5fd947d-hszsn

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-725649-84b5fd947d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-725649-84b5fd947d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-725649: serviceaccount "payload-processing-e2e-explicit-725649" not found

openshift-ingress

kubelet

payload-processing-e2e-explicit-725649-7c8f59bcc-c5vzm

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-725649-7c8f59bcc-c5vzm

Started

Started container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-derive-066f62f9

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-derive-066f62f9: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-derive-066f62f9": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-derive-066f62f9, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: f557e25f-f7c5-4a4d-9635-b4931c33ba68, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-derive-066f62f9-859f6fc4bf-gsqw9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-066f62f9-f59699474-t8vwr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-066f62f9-openshift-default-68cf7b7b84-h7njd

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-725649-openshift-default-7b5b9999b4-6j6h2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-725649-openshift-default-7b5b9999b4-6j6h2

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-725649-openshift-default-7b5b9999b4-6j6h2

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-explicit-725649-openshift-default-7b5b9999b4-6j6h2

Unhealthy

Startup probe failed: Get "http://10.133.0.62:15021/healthz/ready": dial tcp 10.133.0.62:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-explicit-725649-openshift-default-7b5b9999b4-6j6h2

ProbeError

Startup probe error: Get "http://10.133.0.62:15021/healthz/ready": dial tcp 10.133.0.62:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-explicit-725649-7c8f59bcc-c5vzm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-725649-84b5fd947d-hszsn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-explicit-725649-openshift-default-7b5b9999b4-6j6h2

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-noten-1750e4-openshift-default-65c9c9b5c6

SuccessfulCreate

Created pod: e2e-noten-1750e4-openshift-default-65c9c9b5c6-glkmq

openshift-ingress

deployment-controller

e2e-noten-1750e4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-1750e4-openshift-default-65c9c9b5c6 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-noten-1750e4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-1750e4

openshift-ingress

kubelet

e2e-noten-1750e4-openshift-default-65c9c9b5c6-glkmq

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-noten-1750e4-openshift-default-65c9c9b5c6-glkmq

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-noten-1750e4-openshift-default-65c9c9b5c6-glkmq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

multus

e2e-noten-1750e4-openshift-default-65c9c9b5c6-glkmq

AddedInterface

Add eth0 [10.133.0.67/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-mt-06367b84

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-06367b84

openshift-ingress

deployment-controller

e2e-mt-06367b84-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-06367b84-openshift-default-69d5cc7568 from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-06367b84-openshift-default-69d5cc7568

SuccessfulCreate

Created pod: e2e-mt-06367b84-openshift-default-69d5cc7568-448dr

openshift-ingress

multus

e2e-mt-06367b84-openshift-default-69d5cc7568-448dr

AddedInterface

Add eth0 [10.133.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-06367b84-6cb7f9cfd6-vbmfv

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-06367b84-6cb7f9cfd6-vbmfv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-06367b84-548b974c4f-l2lbh

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-mt-06367b84

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-06367b84-548b974c4f from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-mt-06367b84-548b974c4f-l2lbh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-06367b84-548b974c4f-l2lbh

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-06367b84-548b974c4f-l2lbh

Started

Started container payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-06367b84

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-06367b84-6cb7f9cfd6 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-06367b84-548b974c4f

SuccessfulCreate

Created pod: payload-processing-e2e-mt-06367b84-548b974c4f-l2lbh
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-06367b84-548b974c4f

FailedCreate

Error creating: pods "payload-processing-e2e-mt-06367b84-548b974c4f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-06367b84: serviceaccount "payload-processing-e2e-mt-06367b84" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-06367b84-6cb7f9cfd6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-06367b84-6cb7f9cfd6-vbmfv
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-06367b84-6cb7f9cfd6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-06367b84-6cb7f9cfd6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-06367b84: serviceaccount "payload-processing-e2e-mt-06367b84" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-06367b84-6cb7f9cfd6-vbmfv

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-06367b84-6cb7f9cfd6-vbmfv

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-mt-06367b84-openshift-default-69d5cc7568-448dr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-06367b84-openshift-default-69d5cc7568-448dr

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-06367b84-openshift-default-69d5cc7568-448dr

Started

Started container istio-proxy
(x7)

openshift-ingress

kubelet

e2e-mt-06367b84-openshift-default-69d5cc7568-448dr

ProbeError

Startup probe error: Get "http://10.133.0.68:15021/healthz/ready": dial tcp 10.133.0.68:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-mt-06367b84-openshift-default-69d5cc7568-448dr

Unhealthy

Startup probe failed: Get "http://10.133.0.68:15021/healthz/ready": dial tcp 10.133.0.68:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-mt-06367b84-548b974c4f-l2lbh

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-mt-06367b84

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-mt-06367b84: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-mt-06367b84": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-mt-06367b84, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: c4d65c40-509c-4b80-a4d3-5a0501376fb8, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-06367b84-6cb7f9cfd6-vbmfv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-06367b84-openshift-default-69d5cc7568-448dr

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-shared-a-w2-4559b3-openshift-default-7c5f85f54-w98fx

AddedInterface

Add eth0 [10.133.0.70/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-4559b3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-4559b3

openshift-ingress

replicaset-controller

e2e-shared-a-w2-4559b3-openshift-default-7c5f85f54

SuccessfulCreate

Created pod: e2e-shared-a-w2-4559b3-openshift-default-7c5f85f54-w98fx

openshift-ingress

deployment-controller

e2e-shared-a-w2-4559b3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-4559b3-openshift-default-7c5f85f54 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-4559b3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-4559b3-68747b868f from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-4559b3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-4559b3-7f785986db from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-4559b3-68747b868f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-4559b3-68747b868f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-4559b3: serviceaccount "payload-processing-e2e-shared-a-w2-4559b3" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-4559b3-68747b868f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-4559b3-68747b868f-nn52f
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-4559b3-7f785986db

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-4559b3-7f785986db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-4559b3: serviceaccount "payload-processing-e2e-shared-a-w2-4559b3" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-4559b3-7f785986db

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-4559b3-7f785986db-78drr

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-4559b3-68747b868f-nn52f

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-4559b3-7f785986db-78drr

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-4559b3-68747b868f-nn52f

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-4559b3-68747b868f-nn52f

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-4559b3-68747b868f-nn52f

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-4559b3-7f785986db-78drr

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-4559b3-7f785986db-78drr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-4559b3-7f785986db-78drr

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-noten-1750e4-openshift-default-65c9c9b5c6-glkmq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-noten-1750e4-openshift-default-65c9c9b5c6-glkmq

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-noten-1750e4-openshift-default-65c9c9b5c6-glkmq

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

e2e-shared-b-w2-90811b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-90811b-openshift-default-7976755798 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w2-90811b-openshift-default-7976755798

SuccessfulCreate

Created pod: e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn

openshift-ingress

multus

e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-90811b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-90811b
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-4559b3-openshift-default-7c5f85f54-w98fx

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-4559b3-openshift-default-7c5f85f54-w98fx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-4559b3-openshift-default-7c5f85f54-w98fx

Created

Created container: istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-inf-a-04a2fd-85fbff65d7-th4bz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-04a2fd-8bf7d5dfd-f2cz2

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-90811b-6d46c9954f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-90811b-6d46c9954f-5xmpr
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-90811b-579566d85d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-90811b-579566d85d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-90811b: serviceaccount "payload-processing-e2e-shared-b-w2-90811b" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-90811b-579566d85d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-90811b-579566d85d-h2vq2
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-90811b-6d46c9954f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-90811b-6d46c9954f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-90811b: serviceaccount "payload-processing-e2e-shared-b-w2-90811b" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-90811b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-90811b-579566d85d from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-90811b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-90811b-6d46c9954f from 0 to 1

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-90811b-6d46c9954f-5xmpr

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-90811b-579566d85d-h2vq2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-90811b-579566d85d-h2vq2

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-90811b-579566d85d-h2vq2

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-90811b-579566d85d-h2vq2

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-90811b-6d46c9954f-5xmpr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-90811b-6d46c9954f-5xmpr

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-90811b-6d46c9954f-5xmpr

Started

Started container payload-processing
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-4559b3-openshift-default-7c5f85f54-w98fx

ProbeError

Startup probe error: Get "http://10.133.0.70:15021/healthz/ready": dial tcp 10.133.0.70:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-4559b3-openshift-default-7c5f85f54-w98fx

Unhealthy

Startup probe failed: Get "http://10.133.0.70:15021/healthz/ready": dial tcp 10.133.0.70:15021: connect: connection refused

openshift-ingress

kubelet

e2e-inf-a-04a2fd-openshift-default-74d645d896-c89xp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-inf-b-703998-56676dd7-vhtqd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-703998-6fb87bb646-rk7tk

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn

ProbeError

Startup probe error: Get "http://10.134.0.60:15021/healthz/ready": dial tcp 10.134.0.60:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn

Unhealthy

Startup probe failed: Get "http://10.134.0.60:15021/healthz/ready": dial tcp 10.134.0.60:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-mt-f5813346-openshift-default-dcd586ff6

SuccessfulCreate

Created pod: e2e-mt-f5813346-openshift-default-dcd586ff6-cvqn5

openshift-ingress

multus

e2e-mt-f5813346-openshift-default-dcd586ff6-cvqn5

AddedInterface

Add eth0 [10.132.0.65/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-mt-f5813346-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-f5813346-openshift-default-dcd586ff6 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-f5813346

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-f5813346

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-f5813346-5897d44497

SuccessfulCreate

Created pod: payload-processing-e2e-mt-f5813346-5897d44497-fc64d

openshift-ingress

multus

payload-pre-processing-e2e-mt-f5813346-6ccc46b5f4-525xv

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-mt-f5813346-5897d44497-fc64d

AddedInterface

Add eth0 [10.132.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-f5813346-6ccc46b5f4-525xv

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-f5813346-6ccc46b5f4-525xv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-f5813346

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-f5813346-6ccc46b5f4 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-f5813346-6ccc46b5f4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-f5813346-6ccc46b5f4-525xv
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-f5813346-6ccc46b5f4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-f5813346-6ccc46b5f4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-f5813346: serviceaccount "payload-processing-e2e-mt-f5813346" not found

openshift-ingress

kubelet

payload-processing-e2e-mt-f5813346-5897d44497-fc64d

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-f5813346-5897d44497-fc64d

Created

Created container: payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-mt-f5813346

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-f5813346-5897d44497 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-f5813346-6ccc46b5f4-525xv

Started

Started container payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-f5813346-5897d44497

FailedCreate

Error creating: pods "payload-processing-e2e-mt-f5813346-5897d44497-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-f5813346: serviceaccount "payload-processing-e2e-mt-f5813346" not found

openshift-ingress

kubelet

payload-processing-e2e-mt-f5813346-5897d44497-fc64d

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-mt-f5813346-openshift-default-dcd586ff6-cvqn5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-f5813346-openshift-default-dcd586ff6-cvqn5

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-f5813346-openshift-default-dcd586ff6-cvqn5

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-f5813346-openshift-default-dcd586ff6-cvqn5

ProbeError

Startup probe error: Get "http://10.132.0.65:15021/healthz/ready": dial tcp 10.132.0.65:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-f5813346-openshift-default-dcd586ff6-cvqn5

Unhealthy

Startup probe failed: Get "http://10.132.0.65:15021/healthz/ready": dial tcp 10.132.0.65:15021: connect: connection refused

openshift-ingress

kubelet

e2e-inf-b-703998-openshift-default-78669cb68d-f479k

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-a-w3-ed9f38-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-ed9f38-openshift-default-8dd7cf4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w3-ed9f38-openshift-default-8dd7cf4

SuccessfulCreate

Created pod: e2e-shared-a-w3-ed9f38-openshift-default-8dd7cf4-ps78x

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-ed9f38

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-ed9f38

openshift-ingress

multus

e2e-shared-a-w3-ed9f38-openshift-default-8dd7cf4-ps78x

AddedInterface

Add eth0 [10.133.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-703998-openshift-default-78669cb68d-f479k

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-b-703998-openshift-default-78669cb68d-f479k

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-ed9f38-69956d6f-m8mbv

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-ed9f38-76d9ffc7db

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-ed9f38-76d9ffc7db-v7s5s

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-ed9f38-76d9ffc7db-v7s5s

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-ed9f38-76d9ffc7db-v7s5s

Started

Started container payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-ed9f38-76d9ffc7db

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-ed9f38-76d9ffc7db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-ed9f38: serviceaccount "payload-processing-e2e-shared-a-w3-ed9f38" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-ed9f38

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-ed9f38-69956d6f from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-ed9f38-76d9ffc7db-v7s5s

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-ed9f38-69956d6f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-ed9f38-69956d6f-m8mbv

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-ed9f38

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-ed9f38-76d9ffc7db from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-ed9f38-76d9ffc7db-v7s5s

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-ed9f38-69956d6f-m8mbv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-ed9f38-69956d6f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-ed9f38-69956d6f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-ed9f38: serviceaccount "payload-processing-e2e-shared-a-w3-ed9f38" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-ed9f38-69956d6f-m8mbv

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-ed9f38-69956d6f-m8mbv

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-ed9f38-openshift-default-8dd7cf4-ps78x

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-ed9f38-openshift-default-8dd7cf4-ps78x

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-ed9f38-openshift-default-8dd7cf4-ps78x

ProbeError

Readiness probe error: Get "http://10.133.0.73:15021/healthz/ready": dial tcp 10.133.0.73:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-ed9f38-openshift-default-8dd7cf4-ps78x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-shared-a-w3-ed9f38-openshift-default-8dd7cf4-ps78x

Unhealthy

Readiness probe failed: Get "http://10.133.0.73:15021/healthz/ready": dial tcp 10.133.0.73:15021: connect: connection refused

openshift-ingress

multus

e2e-shared-b-w3-317780-openshift-default-794cb8f58b-kw4t8

AddedInterface

Add eth0 [10.133.0.75/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-b-w3-317780-openshift-default-794cb8f58b

SuccessfulCreate

Created pod: e2e-shared-b-w3-317780-openshift-default-794cb8f58b-kw4t8

openshift-ingress

deployment-controller

e2e-shared-b-w3-317780-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-317780-openshift-default-794cb8f58b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-317780

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-317780
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-ed9f38-openshift-default-8dd7cf4-ps78x

Unhealthy

Startup probe failed: Get "http://10.133.0.73:15021/healthz/ready": dial tcp 10.133.0.73:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-ed9f38-openshift-default-8dd7cf4-ps78x

ProbeError

Startup probe error: Get "http://10.133.0.73:15021/healthz/ready": dial tcp 10.133.0.73:15021: connect: connection refused body:
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-317780-6fb7cd7b66

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-317780-6fb7cd7b66-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-317780: serviceaccount "payload-processing-e2e-shared-b-w3-317780" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-317780

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-317780-6fb7cd7b66 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-317780

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-317780-f897765b5 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-317780-f897765b5

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-317780-f897765b5-667z6
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-317780-f897765b5

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-317780-f897765b5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-317780: serviceaccount "payload-processing-e2e-shared-b-w3-317780" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-317780-6fb7cd7b66

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-317780-6fb7cd7b66-h844t

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-317780-6fb7cd7b66-h844t

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-317780-6fb7cd7b66-h844t

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-317780-6fb7cd7b66-h844t

AddedInterface

Add eth0 [10.134.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-317780-f897765b5-667z6

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-317780-f897765b5-667z6

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-317780-f897765b5-667z6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-317780-6fb7cd7b66-h844t

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-317780-f897765b5-667z6

AddedInterface

Add eth0 [10.134.0.72/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-317780-openshift-default-794cb8f58b-kw4t8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-317780-openshift-default-794cb8f58b-kw4t8

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-317780-openshift-default-794cb8f58b-kw4t8

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-317780-openshift-default-794cb8f58b-kw4t8

Unhealthy

Startup probe failed: Get "http://10.133.0.75:15021/healthz/ready": dial tcp 10.133.0.75:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-317780-openshift-default-794cb8f58b-kw4t8

ProbeError

Startup probe error: Get "http://10.133.0.75:15021/healthz/ready": dial tcp 10.133.0.75:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-f5813346-6ccc46b5f4-525xv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-f5813346-5897d44497-fc64d

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-f5813346-openshift-default-dcd586ff6-cvqn5

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-api-a-a66f8f-openshift-default-59d849dbcd-wggf6

AddedInterface

Add eth0 [10.132.0.75/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-api-a-a66f8f-openshift-default-59d849dbcd

SuccessfulCreate

Created pod: e2e-api-a-a66f8f-openshift-default-59d849dbcd-wggf6

openshift-ingress

deployment-controller

e2e-api-a-a66f8f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-a66f8f-openshift-default-59d849dbcd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-a66f8f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-a66f8f

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-a66f8f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-a66f8f-6689585994 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-a66f8f-64df657685

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-a66f8f-64df657685-h64qp

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-a66f8f-6689585994

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-a66f8f-6689585994-b2gs7

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-a66f8f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-a66f8f-64df657685 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-a66f8f-64df657685

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-a66f8f-64df657685-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-a66f8f: serviceaccount "payload-processing-e2e-api-a-a66f8f" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-a66f8f-6689585994

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-a66f8f-6689585994-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-a66f8f: serviceaccount "payload-processing-e2e-api-a-a66f8f" not found

openshift-ingress

multus

payload-processing-e2e-api-a-a66f8f-64df657685-h64qp

AddedInterface

Add eth0 [10.134.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-a66f8f-6689585994-b2gs7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-a66f8f-6689585994-b2gs7

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-a66f8f-6689585994-b2gs7

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-a-a66f8f-6689585994-b2gs7

AddedInterface

Add eth0 [10.134.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-a66f8f-64df657685-h64qp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-a-a66f8f-64df657685-h64qp

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-a66f8f-64df657685-h64qp

Started

Started container payload-processing

openshift-ingress

multus

e2e-api-b-dd1246-openshift-default-59969c48dd-87qlw

AddedInterface

Add eth0 [10.133.0.81/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-api-b-dd1246-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-dd1246-openshift-default-59969c48dd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-dd1246

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-dd1246

openshift-ingress

replicaset-controller

e2e-api-b-dd1246-openshift-default-59969c48dd

SuccessfulCreate

Created pod: e2e-api-b-dd1246-openshift-default-59969c48dd-87qlw
(x2)

openshift-ingress

kubelet

e2e-api-a-a66f8f-openshift-default-59d849dbcd-wggf6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-a66f8f-openshift-default-59d849dbcd-wggf6

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-a66f8f-openshift-default-59d849dbcd-wggf6

Created

Created container: istio-proxy
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-dd1246-946648898

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-dd1246-946648898-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-dd1246: serviceaccount "payload-processing-e2e-api-b-dd1246" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-dd1246-6d64f7c7cf

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-dd1246-6d64f7c7cf-ng692

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-dd1246

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-dd1246-6d64f7c7cf from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-dd1246

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-dd1246-946648898 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-dd1246-6d64f7c7cf

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-dd1246-6d64f7c7cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-dd1246: serviceaccount "payload-processing-e2e-api-b-dd1246" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-dd1246-946648898

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-dd1246-946648898-4hshm
(x5)

openshift-ingress

kubelet

e2e-api-a-a66f8f-openshift-default-59d849dbcd-wggf6

ProbeError

Startup probe error: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-api-b-dd1246-6d64f7c7cf-ng692

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-api-b-dd1246-6d64f7c7cf-ng692

AddedInterface

Add eth0 [10.134.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-dd1246-6d64f7c7cf-ng692

Created

Created container: payload-processing
(x5)

openshift-ingress

kubelet

e2e-api-a-a66f8f-openshift-default-59d849dbcd-wggf6

Unhealthy

Startup probe failed: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused

openshift-ingress

multus

payload-pre-processing-e2e-api-b-dd1246-946648898-4hshm

AddedInterface

Add eth0 [10.133.0.82/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-dd1246-946648898-4hshm

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-e2e-api-b-dd1246-6d64f7c7cf-ng692

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-dd1246-946648898-4hshm

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-dd1246-946648898-4hshm

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.9s (1.9s including waiting). Image size: 166453408 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-dd1246-946648898-4hshm

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-8195ba-558c4899f8-fps5m

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-8195ba-6fd597d499-cs4rg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w0-8195ba-openshift-default-6f5645f748-wfgvj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-api-a-a66f8f-64df657685-h64qp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-a66f8f-6689585994-b2gs7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-a-a66f8f-openshift-default-59d849dbcd-wggf6

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-dd1246-openshift-default-59969c48dd-87qlw

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-dd1246-openshift-default-59969c48dd-87qlw

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-dd1246-openshift-default-59969c48dd-87qlw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-b-dd1246-6d64f7c7cf-ng692

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-dd1246-946648898-4hshm

Killing

Stopping container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-api-b-dd1246-openshift-default-59969c48dd-87qlw

Unhealthy

Startup probe failed: Get "http://10.133.0.81:15021/healthz/ready": dial tcp 10.133.0.81:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-b-dd1246-openshift-default-59969c48dd-87qlw

ProbeError

Startup probe error: Get "http://10.133.0.81:15021/healthz/ready": dial tcp 10.133.0.81:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-api-b-dd1246-openshift-default-59969c48dd-87qlw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-4559b3-7f785986db-78drr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-4559b3-68747b868f-nn52f

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w2-4559b3-openshift-default-7c5f85f54-w98fx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-4559b3-openshift-default-7c5f85f54-w98fx

ProbeError

Readiness probe error: Get "http://10.133.0.70:15021/healthz/ready": dial tcp 10.133.0.70:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-shared-a-w2-4559b3-openshift-default-7c5f85f54-w98fx

Unhealthy

Readiness probe failed: Get "http://10.133.0.70:15021/healthz/ready": dial tcp 10.133.0.70:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-90811b-6d46c9954f-5xmpr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-90811b-579566d85d-h2vq2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w2-90811b-openshift-default-7976755798-jw4vn

Killing

Stopping container istio-proxy

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-worker-w4-b15051

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-worker-w4-b15051: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-worker-w4-b15051": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-worker-w4-b15051, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 2a54ce23-4550-448b-aff3-a171935b3060, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-b15051-75f77884c4-klpfp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-b15051-554564495-2c89t

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w4-b15051-openshift-default-76cc7dfb68-np24c

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-ipp-a-ec8b82-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-ec8b82-openshift-default-65cf789494 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-ec8b82

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-ec8b82

openshift-ingress

replicaset-controller

e2e-ipp-a-ec8b82-openshift-default-65cf789494

SuccessfulCreate

Created pod: e2e-ipp-a-ec8b82-openshift-default-65cf789494-k4s5q

openshift-ingress

multus

e2e-ipp-a-ec8b82-openshift-default-65cf789494-k4s5q

AddedInterface

Add eth0 [10.132.0.83/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-ec8b82

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-ec8b82-68fccb6c4 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-ec8b82-797fbbc557

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-ec8b82-797fbbc557-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-ec8b82: serviceaccount "payload-processing-e2e-ipp-a-ec8b82" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-ec8b82-797fbbc557

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-ec8b82-797fbbc557-r2jtb

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-ec8b82

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-ec8b82-797fbbc557 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-ec8b82-68fccb6c4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-ec8b82-68fccb6c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-ec8b82: serviceaccount "payload-processing-e2e-ipp-a-ec8b82" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-ec8b82-68fccb6c4-kcmwp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-ec8b82-797fbbc557-r2jtb

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-ipp-a-ec8b82-797fbbc557-r2jtb

AddedInterface

Add eth0 [10.134.0.83/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-ec8b82-797fbbc557-r2jtb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-ec8b82-797fbbc557-r2jtb

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-ec8b82-68fccb6c4-kcmwp

AddedInterface

Add eth0 [10.133.0.85/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-ec8b82-68fccb6c4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-ec8b82-68fccb6c4-kcmwp

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-ec8b82-68fccb6c4-kcmwp

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-ec8b82-68fccb6c4-kcmwp

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-a-ec8b82-openshift-default-65cf789494-k4s5q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-ec8b82-openshift-default-65cf789494-k4s5q

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-ec8b82-openshift-default-65cf789494-k4s5q

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-a-ec8b82-openshift-default-65cf789494-k4s5q

ProbeError

Startup probe error: Get "http://10.132.0.83:15021/healthz/ready": dial tcp 10.132.0.83:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-ec8b82-openshift-default-65cf789494-k4s5q

Unhealthy

Startup probe failed: Get "http://10.132.0.83:15021/healthz/ready": dial tcp 10.132.0.83:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-ipp-b-6be25a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-6be25a-openshift-default-6796dcdc8 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-6be25a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-6be25a

openshift-ingress

replicaset-controller

e2e-ipp-b-6be25a-openshift-default-6796dcdc8

SuccessfulCreate

Created pod: e2e-ipp-b-6be25a-openshift-default-6796dcdc8-zzwz6

openshift-ingress

multus

e2e-ipp-b-6be25a-openshift-default-6796dcdc8-zzwz6

AddedInterface

Add eth0 [10.132.0.85/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-6be25a-c6fb865df

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-6be25a-c6fb865df-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-6be25a: serviceaccount "payload-processing-e2e-ipp-b-6be25a" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-6be25a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-6be25a-79689c49cd from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-6be25a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-6be25a-c6fb865df from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-6be25a-c6fb865df-txgvx

Created

Created container: payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-6be25a-79689c49cd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-6be25a-79689c49cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-6be25a: serviceaccount "payload-processing-e2e-ipp-b-6be25a" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-6be25a-79689c49cd-xw7l5

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-6be25a-c6fb865df

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-6be25a-c6fb865df-txgvx

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-6be25a-c6fb865df-txgvx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-6be25a-79689c49cd-xw7l5

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-b-6be25a-c6fb865df-txgvx

AddedInterface

Add eth0 [10.133.0.86/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-6be25a-c6fb865df-txgvx

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-6be25a-79689c49cd-xw7l5

AddedInterface

Add eth0 [10.134.0.84/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-6be25a-79689c49cd-xw7l5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-6be25a-79689c49cd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-6be25a-79689c49cd-xw7l5
(x2)

openshift-ingress

kubelet

e2e-ipp-b-6be25a-openshift-default-6796dcdc8-zzwz6

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-6be25a-openshift-default-6796dcdc8-zzwz6

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-6be25a-openshift-default-6796dcdc8-zzwz6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-b-6be25a-openshift-default-6796dcdc8-zzwz6

ProbeError

Startup probe error: Get "http://10.132.0.85:15021/healthz/ready": dial tcp 10.132.0.85:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-b-6be25a-openshift-default-6796dcdc8-zzwz6

Unhealthy

Startup probe failed: Get "http://10.132.0.85:15021/healthz/ready": dial tcp 10.132.0.85:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-ipp-cleanup-d26a0a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-d26a0a-openshift-default-65d567cc84 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-d26a0a-openshift-default-65d567cc84

SuccessfulCreate

Created pod: e2e-ipp-cleanup-d26a0a-openshift-default-65d567cc84-47lv9

openshift-ingress

multus

e2e-ipp-cleanup-d26a0a-openshift-default-65d567cc84-47lv9

AddedInterface

Add eth0 [10.132.0.87/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-d26a0a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-d26a0a

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-d26a0a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-d26a0a-7b4564fb79 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-d26a0a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-d26a0a-6f8cf8478 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-d26a0a-7b4564fb79

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-d26a0a-7b4564fb79-5vm7j

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-d26a0a-7b4564fb79-5vm7j

AddedInterface

Add eth0 [10.134.0.86/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-d26a0a-7b4564fb79-5vm7j

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-d26a0a-7b4564fb79-5vm7j

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-d26a0a-7b4564fb79-5vm7j

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-d26a0a-7b4564fb79

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-d26a0a-7b4564fb79-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-d26a0a: serviceaccount "payload-processing-e2e-ipp-cleanup-d26a0a" not found

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-d26a0a-6f8cf8478-dh4qz

AddedInterface

Add eth0 [10.134.0.85/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-d26a0a-6f8cf8478

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-d26a0a-6f8cf8478-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-d26a0a: serviceaccount "payload-processing-e2e-ipp-cleanup-d26a0a" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-d26a0a-6f8cf8478-dh4qz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-d26a0a-6f8cf8478

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-d26a0a-6f8cf8478-dh4qz

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-d26a0a-6f8cf8478-dh4qz

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-d26a0a-6f8cf8478-dh4qz

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-d26a0a-openshift-default-65d567cc84-47lv9

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-d26a0a-openshift-default-65d567cc84-47lv9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-d26a0a-openshift-default-65d567cc84-47lv9

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-d26a0a-openshift-default-65d567cc84-47lv9

ProbeError

Startup probe error: Get "http://10.132.0.87:15021/healthz/ready": dial tcp 10.132.0.87:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-d26a0a-openshift-default-65d567cc84-47lv9

Unhealthy

Startup probe failed: Get "http://10.132.0.87:15021/healthz/ready": dial tcp 10.132.0.87:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-d26a0a-6f8cf8478-dh4qz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-d26a0a-7b4564fb79-5vm7j

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-d26a0a-openshift-default-65d567cc84-47lv9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-ec8b82-68fccb6c4-kcmwp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-ec8b82-797fbbc557-r2jtb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-ec8b82-openshift-default-65cf789494-k4s5q

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-6be25a-79689c49cd-xw7l5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-6be25a-c6fb865df-txgvx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-6be25a-openshift-default-6796dcdc8-zzwz6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-ed9f38-76d9ffc7db-v7s5s

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-ed9f38-69956d6f-m8mbv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w3-ed9f38-openshift-default-8dd7cf4-ps78x

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-ed9f38-openshift-default-8dd7cf4-ps78x

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w3-ed9f38-openshift-default-8dd7cf4-ps78x

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-317780-f897765b5-667z6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-317780-6fb7cd7b66-h844t

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w3-317780-openshift-default-794cb8f58b-kw4t8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w3-317780-openshift-default-794cb8f58b-kw4t8

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w3-317780-openshift-default-794cb8f58b-kw4t8

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: