Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-pre-processing-e2e-worker-w3-766cc3-859f9c8f8b-rnj8c

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w3-766cc3-859f9c8f8b-rnj8c to ip-10-0-129-205.ec2.internal

openshift-ingress

e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d to ip-10-0-138-123.ec2.internal

openshift-ingress

payload-processing-e2e-derive-15f9c946-6c477bb5d5-8h47v

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-15f9c946-6c477bb5d5-8h47v to ip-10-0-139-204.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-9f97d7-55f6f6fd4f-v2w9z

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-9f97d7-55f6f6fd4f-v2w9z to ip-10-0-138-123.ec2.internal

openshift-ingress

e2e-mt-d078f791-openshift-default-b9668b796-8mnd5

Scheduled

Successfully assigned openshift-ingress/e2e-mt-d078f791-openshift-default-b9668b796-8mnd5 to ip-10-0-129-205.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-c6abf3-748645869c-8dqws

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-c6abf3-748645869c-8dqws to ip-10-0-138-123.ec2.internal

openshift-ingress

e2e-shared-a-w1-7751cd-openshift-default-5b9dfd974-hktsj

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w1-7751cd-openshift-default-5b9dfd974-hktsj to ip-10-0-129-205.ec2.internal

openshift-ingress

payload-processing-e2e-ait-dfe3d913-57fb84ddc7-pgdl6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-dfe3d913-57fb84ddc7-pgdl6 to ip-10-0-129-205.ec2.internal

openshift-ingress

payload-processing-e2e-ait-15da354a-8469b6cfdc-n5b9v

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-15da354a-8469b6cfdc-n5b9v to ip-10-0-139-204.ec2.internal

openshift-ingress

e2e-shared-a-w2-026f86-openshift-default-5f9b6dfb86-dbjml

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-026f86-openshift-default-5f9b6dfb86-dbjml to ip-10-0-129-205.ec2.internal

openshift-ingress

e2e-ait-15da354a-openshift-default-5f7499488-4jfc8

Scheduled

Successfully assigned openshift-ingress/e2e-ait-15da354a-openshift-default-5f7499488-4jfc8 to ip-10-0-129-205.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-c10e0b-7c5677b8d6-fsmcc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-c10e0b-7c5677b8d6-fsmcc to ip-10-0-139-204.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-79a70a-5fb9b6b9fd-vppr4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-79a70a-5fb9b6b9fd-vppr4 to ip-10-0-139-204.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-15f9c946-86bd45bbf4-4m6m4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-15f9c946-86bd45bbf4-4m6m4 to ip-10-0-129-205.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-31fca0-7879894f7d-lnj46

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-31fca0-7879894f7d-lnj46 to ip-10-0-138-123.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-23a45b-844fd746d6-2pm8f

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-23a45b-844fd746d6-2pm8f to ip-10-0-138-123.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-9f97d7-84c94f876b-flfmf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-9f97d7-84c94f876b-flfmf to ip-10-0-138-123.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-fd3842-78748b5598-fmln6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fd3842-78748b5598-fmln6 to ip-10-0-138-123.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-76b12dde-75997ffb5d-zrvph

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-76b12dde-75997ffb5d-zrvph to ip-10-0-129-205.ec2.internal

openshift-ingress

e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc to ip-10-0-138-123.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-c6abf3-786464d986-psths

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-c6abf3-786464d986-psths to ip-10-0-129-205.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-dfe3d913-5c99b5587d-wxpr4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-dfe3d913-5c99b5587d-wxpr4 to ip-10-0-129-205.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-15da354a-5444c7d666-5pvv9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-15da354a-5444c7d666-5pvv9 to ip-10-0-129-205.ec2.internal

openshift-ingress

payload-pre-processing-6cd864bc95-4l7wg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-6cd864bc95-4l7wg to ip-10-0-129-205.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-c2txd

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-c2txd to ip-10-0-129-205.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-frfj9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-frfj9 to ip-10-0-129-205.ec2.internal

openshift-ingress

payload-processing-5d7dbbd56b-rl88q

Scheduled

Successfully assigned openshift-ingress/payload-processing-5d7dbbd56b-rl88q to ip-10-0-129-205.ec2.internal

openshift-ingress

e2e-migrate-76b12dde-gw-openshift-default-7b4949c988-p85dn

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-76b12dde-gw-openshift-default-7b4949c988-p85dn to ip-10-0-129-205.ec2.internal

openshift-ingress

e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz to ip-10-0-138-123.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-c10e0b-85b55dc9b5-cx2qq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-c10e0b-85b55dc9b5-cx2qq to ip-10-0-139-204.ec2.internal

openshift-ingress

e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6 to ip-10-0-138-123.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w1-947f83-5f86f66f99-kxljw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w1-947f83-5f86f66f99-kxljw to ip-10-0-129-205.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-b8287f-668d744c97-hz99m

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-b8287f-668d744c97-hz99m to ip-10-0-129-205.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-d7b97f-6c47b7d997-lwvsx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-d7b97f-6c47b7d997-lwvsx to ip-10-0-129-205.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w1-7751cd-84c79cb4bf-444xt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w1-7751cd-84c79cb4bf-444xt to ip-10-0-129-205.ec2.internal

openshift-ingress

payload-processing-e2e-mt-d727624f-f946f8585-6fr4g

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-d727624f-f946f8585-6fr4g to ip-10-0-138-123.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-lxnqd

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-lxnqd to ip-10-0-129-205.ec2.internal

openshift-ingress

payload-processing-e2e-mt-d078f791-5cbb8464b5-x4h97

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-d078f791-5cbb8464b5-x4h97 to ip-10-0-138-123.ec2.internal

openshift-ingress

e2e-ipp-a-31fca0-openshift-default-b7bb4bc8-rp6ng

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-31fca0-openshift-default-b7bb4bc8-rp6ng to ip-10-0-129-205.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-026f86-86cd76fb97-h9858

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-026f86-86cd76fb97-h9858 to ip-10-0-129-205.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-fx69x

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fx69x to ip-10-0-138-123.ec2.internal

openshift-ingress

e2e-api-b-9f97d7-openshift-default-5fdf996d6-zr94x

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-9f97d7-openshift-default-5fdf996d6-zr94x to ip-10-0-129-205.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-dqjkh

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-dqjkh to ip-10-0-129-205.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-d078f791-668f96ccfd-7z2pj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-d078f791-668f96ccfd-7z2pj to ip-10-0-138-123.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-d727624f-744ffb78f4-zn58h

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-d727624f-744ffb78f4-zn58h to ip-10-0-138-123.ec2.internal

openshift-ingress

e2e-worker-w3-766cc3-openshift-default-8684c98854-r6bpv

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-766cc3-openshift-default-8684c98854-r6bpv to ip-10-0-129-205.ec2.internal

openshift-ingress

router-default-7fc56fb846-t46f7

Scheduled

Successfully assigned openshift-ingress/router-default-7fc56fb846-t46f7 to ip-10-0-139-204.ec2.internal

openshift-ingress

router-default-7fc56fb846-t46f7

FailedScheduling

0/3 nodes are available: 3 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/3 nodes are available: 3 Preemption is not helpful for scheduling.

openshift-ingress

payload-pre-processing-e2e-shared-a-w1-7751cd-66fc974cb6-4td42

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w1-7751cd-66fc974cb6-4td42 to ip-10-0-129-205.ec2.internal

openshift-ingress

e2e-ait-dfe3d913-openshift-default-9c74c78cd-fpzgq

Scheduled

Successfully assigned openshift-ingress/e2e-ait-dfe3d913-openshift-default-9c74c78cd-fpzgq to ip-10-0-129-205.ec2.internal

openshift-ingress

e2e-mt-d727624f-openshift-default-5ff84dbd76-qdtcl

Scheduled

Successfully assigned openshift-ingress/e2e-mt-d727624f-openshift-default-5ff84dbd76-qdtcl to ip-10-0-129-205.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-pgmjq

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pgmjq to ip-10-0-138-123.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-d7b97f-5c67fccd8b-97nxs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-d7b97f-5c67fccd8b-97nxs to ip-10-0-139-204.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-b8287f-7b77d67cb6-qrzdr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-b8287f-7b77d67cb6-qrzdr to ip-10-0-138-123.ec2.internal

openshift-ingress

e2e-derive-15f9c946-openshift-default-5ddcd5565b-tvhxn

Scheduled

Successfully assigned openshift-ingress/e2e-derive-15f9c946-openshift-default-5ddcd5565b-tvhxn to ip-10-0-129-205.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-026f86-649c65f74-85x4x

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-026f86-649c65f74-85x4x to ip-10-0-138-123.ec2.internal

openshift-ingress

e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf to ip-10-0-138-123.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-76b12dde-5f6576689d-w5xf2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-76b12dde-5f6576689d-w5xf2 to ip-10-0-129-205.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-fd3842-77f66db76f-jrpmc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-fd3842-77f66db76f-jrpmc to ip-10-0-129-205.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w3-766cc3-7949cbb557-wk99p

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w3-766cc3-7949cbb557-wk99p to ip-10-0-129-205.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-23a45b-69c69b9769-6dllx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-23a45b-69c69b9769-6dllx to ip-10-0-138-123.ec2.internal

openshift-ingress

e2e-ipp-cleanup-fd3842-openshift-default-74c45b894-cttt2

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-fd3842-openshift-default-74c45b894-cttt2 to ip-10-0-129-205.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-31fca0-85b785c4fc-r4s9n

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-31fca0-85b785c4fc-r4s9n to ip-10-0-129-205.ec2.internal

openshift-ingress

kube-auth-proxy-8665f874d8-5fz7h

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-8665f874d8-5fz7h to ip-10-0-138-123.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w1-947f83-7cbd46c66-d6744

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w1-947f83-7cbd46c66-d6744 to ip-10-0-138-123.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-79a70a-6c6f4b7955-8rxcs

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-79a70a-6c6f4b7955-8rxcs to ip-10-0-129-205.ec2.internal

openshift-ingress

kube-auth-proxy-8665f874d8-p5sj7

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-8665f874d8-p5sj7 to ip-10-0-139-204.ec2.internal

openshift-ingress

e2e-inf-a-79a70a-openshift-default-6c6b698c68-ghb68

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-79a70a-openshift-default-6c6b698c68-ghb68 to ip-10-0-129-205.ec2.internal

openshift-ingress

e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z to ip-10-0-138-123.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-7fc56fb846 from 0 to 1
(x11)

openshift-ingress

replicaset-controller

router-default-7fc56fb846

FailedCreate

Error creating: pods "router-default-7fc56fb846-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x16)

openshift-ingress

replicaset-controller

router-default-7fc56fb846

FailedCreate

Error creating: pods "router-default-7fc56fb846-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-7fc56fb846

SuccessfulCreate

Created pod: router-default-7fc56fb846-t46f7
(x6)

openshift-ingress

kubelet

router-default-7fc56fb846-t46f7

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x6)

openshift-ingress

kubelet

router-default-7fc56fb846-t46f7

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

kubelet

router-default-7fc56fb846-t46f7

Started

Started container router

openshift-ingress

kubelet

router-default-7fc56fb846-t46f7

Created

Created container: router

openshift-ingress

kubelet

router-default-7fc56fb846-t46f7

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:48526e08a2a06d05806dbcf3ddb069e5182371667d9e9f7d2cf09f60cd247d20" already present on machine

openshift-ingress

multus

router-default-7fc56fb846-t46f7

AddedInterface

Add eth0 [10.133.0.14/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

kube-auth-proxy-8665f874d8

SuccessfulCreate

Created pod: kube-auth-proxy-8665f874d8-p5sj7

openshift-ingress

replicaset-controller

kube-auth-proxy-8665f874d8

SuccessfulCreate

Created pod: kube-auth-proxy-8665f874d8-5fz7h

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-8665f874d8 from 0 to 2
(x3)

openshift-ingress

replicaset-controller

kube-auth-proxy-8665f874d8

FailedCreate

Error creating: pods "kube-auth-proxy-8665f874d8-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

kubelet

kube-auth-proxy-8665f874d8-p5sj7

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

kubelet

kube-auth-proxy-8665f874d8-5fz7h

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-fx69x

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

kubelet

kube-auth-proxy-8665f874d8-p5sj7

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-8665f874d8-5fz7h

AddedInterface

Add eth0 [10.134.0.16/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-8665f874d8-5fz7h

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-8665f874d8-p5sj7

AddedInterface

Add eth0 [10.133.0.31/23] from ovn-kubernetes

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-fx69x

AddedInterface

Add eth0 [10.134.0.17/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-fx69x

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

kube-auth-proxy-8665f874d8-p5sj7

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-8665f874d8-p5sj7

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 3.065s (3.065s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-8665f874d8-p5sj7

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-8665f874d8-5fz7h

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-8665f874d8-5fz7h

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-8665f874d8-5fz7h

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 4.27s (4.27s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-fx69x

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.319s (3.319s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-fx69x

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-fx69x

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-fx69x

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-fx69x

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-c2txd

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-c2txd

FailedMount

MountVolume.SetUp failed for volume "istiod-ca-cert" : failed to sync configmap cache: timed out waiting for the condition

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-c2txd

FailedMount

MountVolume.SetUp failed for volume "kube-api-access-kwhxf" : failed to sync configmap cache: timed out waiting for the condition

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-c2txd

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-c2txd

AddedInterface

Add eth0 [10.132.0.29/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-c2txd

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-c2txd

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-c2txd

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 5.198s (5.198s including waiting). Image size: 181318953 bytes.

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-dqjkh

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-dqjkh

AddedInterface

Add eth0 [10.132.0.32/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-dqjkh

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-dqjkh

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.837s (2.837s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-dqjkh

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-dqjkh

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-fx69x

Killing

Stopping container discovery

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-fx69x
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-pgmjq

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-pgmjq

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-pgmjq

AddedInterface

Add eth0 [10.134.0.27/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-pgmjq

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 3.25s (3.25s including waiting). Image size: 181318953 bytes.
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-lxnqd

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-frfj9

AddedInterface

Add eth0 [10.132.0.37/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-frfj9

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-5b54b7fbb7-lxnqd

AddedInterface

Add eth0 [10.132.0.38/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-lxnqd

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-frfj9

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-lxnqd

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.538s (1.538s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-lxnqd

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-lxnqd

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-frfj9

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.574s (1.574s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-frfj9

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-frfj9

Started

Started container payload-pre-processing

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-pgmjq

Unhealthy

Readiness probe failed: Get "http://10.134.0.27:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-pgmjq

ProbeError

Readiness probe error: Get "http://10.134.0.27:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-pgmjq

Started

Started container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-pgmjq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-pgmjq

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-pgmjq

ProbeError

Startup probe error: Get "http://10.134.0.27:15021/healthz/ready": dial tcp 10.134.0.27:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-pgmjq

Unhealthy

Startup probe failed: Get "http://10.134.0.27:15021/healthz/ready": dial tcp 10.134.0.27:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-lxnqd

Unhealthy

Readiness probe failed: dial tcp 10.132.0.38:9004: connect: connection refused

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-lxnqd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-frfj9

Unhealthy

Readiness probe failed: dial tcp 10.132.0.37:9004: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-frfj9

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-5d7dbbd56b

SuccessfulCreate

Created pod: payload-processing-5d7dbbd56b-rl88q

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5d7dbbd56b from 0 to 1

openshift-ingress

multus

payload-pre-processing-6cd864bc95-4l7wg

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-6cd864bc95

SuccessfulCreate

Created pod: payload-pre-processing-6cd864bc95-4l7wg

openshift-ingress

kubelet

payload-processing-5d7dbbd56b-rl88q

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-processing-5d7dbbd56b-rl88q

AddedInterface

Add eth0 [10.132.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-6cd864bc95-4l7wg

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-6cd864bc95 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-6cd864bc95-4l7wg

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 1.257s (1.257s including waiting). Image size: 141094894 bytes.

openshift-ingress

kubelet

payload-processing-5d7dbbd56b-rl88q

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 1.333s (1.333s including waiting). Image size: 141094894 bytes.

openshift-ingress

kubelet

payload-processing-5d7dbbd56b-rl88q

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-6cd864bc95-4l7wg

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-6cd864bc95-4l7wg

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-5d7dbbd56b-rl88q

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

e2e-inf-a-79a70a-openshift-default-6c6b698c68

SuccessfulCreate

Created pod: e2e-inf-a-79a70a-openshift-default-6c6b698c68-ghb68

openshift-ingress

deployment-controller

e2e-inf-a-79a70a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-79a70a-openshift-default-6c6b698c68 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-a-79a70a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-79a70a

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-d7b97f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-d7b97f

openshift-ingress

gateway_labeler_controller

e2e-worker-w3-766cc3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w3-766cc3

openshift-ingress

deployment-controller

e2e-worker-w0-d7b97f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-d7b97f-openshift-default-67447b7f4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w3-766cc3-openshift-default-8684c98854

SuccessfulCreate

Created pod: e2e-worker-w3-766cc3-openshift-default-8684c98854-r6bpv

openshift-ingress

deployment-controller

e2e-worker-w3-766cc3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-766cc3-openshift-default-8684c98854 from 0 to 1

openshift-ingress

multus

e2e-worker-w3-766cc3-openshift-default-8684c98854-r6bpv

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w0-d7b97f-openshift-default-67447b7f4

SuccessfulCreate

Created pod: e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z

openshift-ingress

multus

e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes

openshift-ingress

multus

e2e-inf-a-79a70a-openshift-default-6c6b698c68-ghb68

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-d7b97f-5c67fccd8b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-d7b97f-5c67fccd8b-97nxs
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-d7b97f-5c67fccd8b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-d7b97f-5c67fccd8b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-d7b97f: serviceaccount "payload-processing-e2e-worker-w0-d7b97f" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-d7b97f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-d7b97f-5c67fccd8b from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-d7b97f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-d7b97f-6c47b7d997 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-d7b97f-6c47b7d997

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-d7b97f-6c47b7d997-lwvsx
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-d7b97f-6c47b7d997

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-d7b97f-6c47b7d997-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-d7b97f: serviceaccount "payload-processing-e2e-worker-w0-d7b97f" not found

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-d7b97f-5c67fccd8b-97nxs

AddedInterface

Add eth0 [10.133.0.38/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-79a70a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-79a70a-6c6f4b7955 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-79a70a-5fb9b6b9fd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-79a70a-5fb9b6b9fd-vppr4
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-79a70a-6c6f4b7955

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-79a70a-6c6f4b7955-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-79a70a: serviceaccount "payload-processing-e2e-inf-a-79a70a" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-d7b97f-5c67fccd8b-97nxs

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-d7b97f-6c47b7d997-lwvsx

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-d7b97f-6c47b7d997-lwvsx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-worker-w0-d7b97f-6c47b7d997-lwvsx

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-d7b97f-6c47b7d997-lwvsx

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-79a70a-5fb9b6b9fd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-79a70a-5fb9b6b9fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-79a70a: serviceaccount "payload-processing-e2e-inf-a-79a70a" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-79a70a-6c6f4b7955

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-79a70a-6c6f4b7955-8rxcs

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-79a70a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-79a70a-5fb9b6b9fd from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-79a70a-5fb9b6b9fd-vppr4

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-79a70a-5fb9b6b9fd-vppr4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-d7b97f-5c67fccd8b-97nxs

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-d7b97f-5c67fccd8b-97nxs

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-d7b97f-5c67fccd8b-97nxs

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.36s (1.36s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-processing-e2e-inf-a-79a70a-6c6f4b7955-8rxcs

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-79a70a-5fb9b6b9fd-vppr4

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-79a70a-5fb9b6b9fd-vppr4

AddedInterface

Add eth0 [10.133.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-79a70a-6c6f4b7955-8rxcs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-inf-a-79a70a-6c6f4b7955-8rxcs

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-79a70a-6c6f4b7955-8rxcs

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-766cc3-859f9c8f8b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w3-766cc3-859f9c8f8b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-766cc3: serviceaccount "payload-processing-e2e-worker-w3-766cc3" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-766cc3-7949cbb557

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w3-766cc3-7949cbb557-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-766cc3: serviceaccount "payload-processing-e2e-worker-w3-766cc3" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-766cc3-859f9c8f8b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w3-766cc3-859f9c8f8b-rnj8c

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w3-766cc3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w3-766cc3-859f9c8f8b from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w3-766cc3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w3-766cc3-7949cbb557 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-766cc3-7949cbb557

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w3-766cc3-7949cbb557-wk99p

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-766cc3-7949cbb557-wk99p

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-766cc3-7949cbb557-wk99p

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-766cc3-7949cbb557-wk99p

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-worker-w3-766cc3-7949cbb557-wk99p

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-766cc3-859f9c8f8b-rnj8c

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-766cc3-859f9c8f8b-rnj8c

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-worker-w3-766cc3-859f9c8f8b-rnj8c

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-766cc3-859f9c8f8b-rnj8c

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z

ProbeError

Readiness probe error: Get "http://10.134.0.42:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z

Unhealthy

Readiness probe failed: Get "http://10.134.0.42:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-inf-a-79a70a-openshift-default-6c6b698c68-ghb68

ProbeError

Readiness probe error: Get "http://10.132.0.45:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-inf-a-79a70a-openshift-default-6c6b698c68-ghb68

Unhealthy

Readiness probe failed: Get "http://10.132.0.45:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-inf-a-79a70a-openshift-default-6c6b698c68-ghb68

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-79a70a-openshift-default-6c6b698c68-ghb68

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-79a70a-openshift-default-6c6b698c68-ghb68

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-inf-a-79a70a-openshift-default-6c6b698c68-ghb68

Unhealthy

Startup probe failed: Get "http://10.132.0.45:15021/healthz/ready": dial tcp 10.132.0.45:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z

Unhealthy

Startup probe failed: Get "http://10.134.0.42:15021/healthz/ready": dial tcp 10.134.0.42:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z

ProbeError

Startup probe error: Get "http://10.134.0.42:15021/healthz/ready": dial tcp 10.134.0.42:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-a-79a70a-openshift-default-6c6b698c68-ghb68

ProbeError

Startup probe error: Get "http://10.132.0.45:15021/healthz/ready": dial tcp 10.132.0.45:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-worker-w3-766cc3-openshift-default-8684c98854-r6bpv

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w3-766cc3-openshift-default-8684c98854-r6bpv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w3-766cc3-openshift-default-8684c98854-r6bpv

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-worker-w3-766cc3-openshift-default-8684c98854-r6bpv

ProbeError

Startup probe error: Get "http://10.132.0.46:15021/healthz/ready": dial tcp 10.132.0.46:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-inf-b-c10e0b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-c10e0b

openshift-ingress

deployment-controller

e2e-inf-b-c10e0b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8

SuccessfulCreate

Created pod: e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf
(x5)

openshift-ingress

kubelet

e2e-worker-w3-766cc3-openshift-default-8684c98854-r6bpv

Unhealthy

Startup probe failed: Get "http://10.132.0.46:15021/healthz/ready": dial tcp 10.132.0.46:15021: connect: connection refused

openshift-ingress

multus

e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-c10e0b-7c5677b8d6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-c10e0b-7c5677b8d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-c10e0b: serviceaccount "payload-processing-e2e-inf-b-c10e0b" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-c10e0b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-c10e0b-85b55dc9b5 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-inf-b-c10e0b-85b55dc9b5-cx2qq

AddedInterface

Add eth0 [10.133.0.41/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-c10e0b-85b55dc9b5

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-c10e0b-85b55dc9b5-cx2qq

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-c10e0b-7c5677b8d6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-c10e0b-7c5677b8d6-fsmcc

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-c10e0b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-c10e0b-7c5677b8d6 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-c10e0b-85b55dc9b5

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-c10e0b-85b55dc9b5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-c10e0b: serviceaccount "payload-processing-e2e-inf-b-c10e0b" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-c10e0b-7c5677b8d6-fsmcc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-b-c10e0b-85b55dc9b5-cx2qq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-c10e0b-7c5677b8d6-fsmcc

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-c10e0b-7c5677b8d6-fsmcc

AddedInterface

Add eth0 [10.133.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-c10e0b-85b55dc9b5-cx2qq

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-c10e0b-7c5677b8d6-fsmcc

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-c10e0b-85b55dc9b5-cx2qq

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf

ProbeError

Startup probe error: Get "http://10.134.0.46:15021/healthz/ready": dial tcp 10.134.0.46:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf

Unhealthy

Startup probe failed: Get "http://10.134.0.46:15021/healthz/ready": dial tcp 10.134.0.46:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-ait-dfe3d913-openshift-default-9c74c78cd

SuccessfulCreate

Created pod: e2e-ait-dfe3d913-openshift-default-9c74c78cd-fpzgq

openshift-ingress

deployment-controller

e2e-ait-dfe3d913-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-dfe3d913-openshift-default-9c74c78cd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-dfe3d913

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-dfe3d913

openshift-ingress

multus

e2e-ait-dfe3d913-openshift-default-9c74c78cd-fpzgq

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-dfe3d913-5c99b5587d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-dfe3d913-5c99b5587d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-dfe3d913: serviceaccount "payload-processing-e2e-ait-dfe3d913" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-dfe3d913-57fb84ddc7

FailedCreate

Error creating: pods "payload-processing-e2e-ait-dfe3d913-57fb84ddc7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-dfe3d913: serviceaccount "payload-processing-e2e-ait-dfe3d913" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-dfe3d913-57fb84ddc7

SuccessfulCreate

Created pod: payload-processing-e2e-ait-dfe3d913-57fb84ddc7-pgdl6

openshift-ingress

deployment-controller

payload-processing-e2e-ait-dfe3d913

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-dfe3d913-57fb84ddc7 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-dfe3d913

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-dfe3d913-5c99b5587d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-dfe3d913-5c99b5587d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-dfe3d913-5c99b5587d-wxpr4

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-dfe3d913-5c99b5587d-wxpr4

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-dfe3d913-5c99b5587d-wxpr4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-dfe3d913-5c99b5587d-wxpr4

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-dfe3d913-5c99b5587d-wxpr4

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-dfe3d913-57fb84ddc7-pgdl6

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-dfe3d913-57fb84ddc7-pgdl6

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-dfe3d913-57fb84ddc7-pgdl6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-dfe3d913-57fb84ddc7-pgdl6

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ait-dfe3d913-openshift-default-9c74c78cd-fpzgq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-dfe3d913-openshift-default-9c74c78cd-fpzgq

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-dfe3d913-openshift-default-9c74c78cd-fpzgq

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-ait-dfe3d913-openshift-default-9c74c78cd-fpzgq

Unhealthy

Startup probe failed: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ait-dfe3d913-openshift-default-9c74c78cd-fpzgq

ProbeError

Startup probe error: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ait-dfe3d913-57fb84ddc7-pgdl6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-dfe3d913-5c99b5587d-wxpr4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-dfe3d913-openshift-default-9c74c78cd-fpzgq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-migrate-76b12dde-gw-openshift-default-7b4949c988-p85dn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

gateway_labeler_controller

e2e-migrate-76b12dde-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-76b12dde-gw

openshift-ingress

multus

e2e-migrate-76b12dde-gw-openshift-default-7b4949c988-p85dn

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-migrate-76b12dde-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-76b12dde-gw-openshift-default-7b4949c988 from 0 to 1

openshift-ingress

replicaset-controller

e2e-migrate-76b12dde-gw-openshift-default-7b4949c988

SuccessfulCreate

Created pod: e2e-migrate-76b12dde-gw-openshift-default-7b4949c988-p85dn

openshift-ingress

kubelet

e2e-migrate-76b12dde-gw-openshift-default-7b4949c988-p85dn

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-migrate-76b12dde-gw-openshift-default-7b4949c988-p85dn

Started

Started container istio-proxy

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-76b12dde-75997ffb5d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-76b12dde-75997ffb5d-zrvph

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-76b12dde-5f6576689d

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-76b12dde-5f6576689d-w5xf2
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-76b12dde-5f6576689d

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-76b12dde-5f6576689d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-76b12dde: serviceaccount "payload-processing-e2e-migrate-76b12dde" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-76b12dde

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-76b12dde-75997ffb5d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-76b12dde-75997ffb5d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-76b12dde-75997ffb5d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-76b12dde: serviceaccount "payload-processing-e2e-migrate-76b12dde" not found

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-76b12dde

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-76b12dde-5f6576689d from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-76b12dde-75997ffb5d-zrvph

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-migrate-76b12dde-75997ffb5d-zrvph

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-76b12dde-5f6576689d-w5xf2

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-76b12dde-5f6576689d-w5xf2

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-76b12dde-75997ffb5d-zrvph

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-76b12dde-5f6576689d-w5xf2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-76b12dde-75997ffb5d-zrvph

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-migrate-76b12dde-5f6576689d-w5xf2

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-76b12dde-5f6576689d-w5xf2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-76b12dde-75997ffb5d-zrvph

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-migrate-76b12dde-gw-openshift-default-7b4949c988-p85dn

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ait-15da354a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-15da354a

openshift-ingress

deployment-controller

e2e-ait-15da354a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-15da354a-openshift-default-5f7499488 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-15da354a-openshift-default-5f7499488

SuccessfulCreate

Created pod: e2e-ait-15da354a-openshift-default-5f7499488-4jfc8

openshift-ingress

kubelet

e2e-ait-15da354a-openshift-default-5f7499488-4jfc8

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-ait-15da354a-openshift-default-5f7499488-4jfc8

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-ait-15da354a-openshift-default-5f7499488-4jfc8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

multus

e2e-ait-15da354a-openshift-default-5f7499488-4jfc8

AddedInterface

Add eth0 [10.132.0.62/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ait-15da354a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-15da354a-8469b6cfdc from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-15da354a-5444c7d666-5pvv9

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-15da354a-8469b6cfdc-n5b9v

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-15da354a-8469b6cfdc

SuccessfulCreate

Created pod: payload-processing-e2e-ait-15da354a-8469b6cfdc-n5b9v

openshift-ingress

multus

payload-processing-e2e-ait-15da354a-8469b6cfdc-n5b9v

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-15da354a-8469b6cfdc

FailedCreate

Error creating: pods "payload-processing-e2e-ait-15da354a-8469b6cfdc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-15da354a: serviceaccount "payload-processing-e2e-ait-15da354a" not found

openshift-ingress

kubelet

payload-processing-e2e-ait-15da354a-8469b6cfdc-n5b9v

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-15da354a-8469b6cfdc-n5b9v

Started

Started container payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-15da354a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-15da354a-5444c7d666 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-15da354a-5444c7d666

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-15da354a-5444c7d666-5pvv9
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-15da354a-5444c7d666

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-15da354a-5444c7d666-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-15da354a: serviceaccount "payload-processing-e2e-ait-15da354a" not found

openshift-ingress

multus

payload-pre-processing-e2e-ait-15da354a-5444c7d666-5pvv9

AddedInterface

Add eth0 [10.132.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-15da354a-5444c7d666-5pvv9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-15da354a-5444c7d666-5pvv9

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-79a70a-5fb9b6b9fd-vppr4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-79a70a-6c6f4b7955-8rxcs

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-a-79a70a-openshift-default-6c6b698c68-ghb68

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-79a70a-openshift-default-6c6b698c68-ghb68

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-a-79a70a-openshift-default-6c6b698c68-ghb68

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-15da354a-5444c7d666-5pvv9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-15da354a-8469b6cfdc-n5b9v

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-c10e0b-85b55dc9b5-cx2qq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-c10e0b-7c5677b8d6-fsmcc

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-derive-15f9c946-openshift-default-5ddcd5565b

SuccessfulCreate

Created pod: e2e-derive-15f9c946-openshift-default-5ddcd5565b-tvhxn

openshift-ingress

kubelet

e2e-ait-15da354a-openshift-default-5f7499488-4jfc8

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-derive-15f9c946-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-15f9c946-openshift-default-5ddcd5565b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-derive-15f9c946

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-15f9c946

openshift-ingress

multus

e2e-derive-15f9c946-openshift-default-5ddcd5565b-tvhxn

AddedInterface

Add eth0 [10.132.0.67/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-15f9c946-6c477bb5d5

FailedCreate

Error creating: pods "payload-processing-e2e-derive-15f9c946-6c477bb5d5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-15f9c946: serviceaccount "payload-processing-e2e-derive-15f9c946" not found

openshift-ingress

deployment-controller

payload-processing-e2e-derive-15f9c946

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-15f9c946-6c477bb5d5 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-15f9c946-6c477bb5d5

SuccessfulCreate

Created pod: payload-processing-e2e-derive-15f9c946-6c477bb5d5-8h47v
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-15f9c946-86bd45bbf4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-15f9c946-86bd45bbf4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-15f9c946: serviceaccount "payload-processing-e2e-derive-15f9c946" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-15f9c946-86bd45bbf4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-15f9c946-86bd45bbf4-4m6m4

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-15f9c946

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-15f9c946-86bd45bbf4 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-15f9c946-86bd45bbf4-4m6m4

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-15f9c946-6c477bb5d5-8h47v

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-15f9c946-6c477bb5d5-8h47v

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-15f9c946-6c477bb5d5-8h47v

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-derive-15f9c946-6c477bb5d5-8h47v

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-15f9c946-86bd45bbf4-4m6m4

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-15f9c946-86bd45bbf4-4m6m4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-derive-15f9c946-86bd45bbf4-4m6m4

AddedInterface

Add eth0 [10.132.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-shared-a-w2-026f86-openshift-default-5f9b6dfb86-dbjml

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-a-w2-026f86-openshift-default-5f9b6dfb86

SuccessfulCreate

Created pod: e2e-shared-a-w2-026f86-openshift-default-5f9b6dfb86-dbjml

openshift-ingress

deployment-controller

e2e-shared-a-w2-026f86-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-026f86-openshift-default-5f9b6dfb86 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-026f86

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-026f86

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-026f86

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-026f86-86cd76fb97 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-026f86-649c65f74

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-026f86-649c65f74-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-026f86: serviceaccount "payload-processing-e2e-shared-a-w2-026f86" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-026f86

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-026f86-649c65f74 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-026f86-86cd76fb97

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-026f86-86cd76fb97-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-026f86: serviceaccount "payload-processing-e2e-shared-a-w2-026f86" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-026f86-86cd76fb97

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-026f86-86cd76fb97-h9858

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-026f86-649c65f74-85x4x

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-026f86-86cd76fb97-h9858

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-026f86-649c65f74-85x4x

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-026f86-649c65f74

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-026f86-649c65f74-85x4x

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-026f86-86cd76fb97-h9858

AddedInterface

Add eth0 [10.132.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-026f86-86cd76fb97-h9858

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-026f86-86cd76fb97-h9858

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-026f86-649c65f74-85x4x

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.398s (2.398s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-026f86-649c65f74-85x4x

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-026f86-649c65f74-85x4x

Started

Started container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-b8287f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-b8287f

openshift-ingress

replicaset-controller

e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8

SuccessfulCreate

Created pod: e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc

openshift-ingress

deployment-controller

e2e-shared-b-w2-b8287f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8 from 0 to 1

openshift-ingress

kubelet

e2e-derive-15f9c946-openshift-default-5ddcd5565b-tvhxn

ProbeError

Readiness probe error: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused body:

openshift-ingress

multus

e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-derive-15f9c946-openshift-default-5ddcd5565b-tvhxn

Unhealthy

Readiness probe failed: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-derive-15f9c946-openshift-default-5ddcd5565b-tvhxn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-026f86-openshift-default-5f9b6dfb86-dbjml

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-15f9c946-openshift-default-5ddcd5565b-tvhxn

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-026f86-openshift-default-5f9b6dfb86-dbjml

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-15f9c946-openshift-default-5ddcd5565b-tvhxn

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-026f86-openshift-default-5f9b6dfb86-dbjml

Started

Started container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-15f9c946-86bd45bbf4-4m6m4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-15f9c946-6c477bb5d5-8h47v

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-derive-15f9c946-openshift-default-5ddcd5565b-tvhxn

Unhealthy

Startup probe failed: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused

openshift-ingress

kubelet

e2e-derive-15f9c946-openshift-default-5ddcd5565b-tvhxn

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-15f9c946-openshift-default-5ddcd5565b-tvhxn

ProbeError

Startup probe error: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-026f86-openshift-default-5f9b6dfb86-dbjml

Unhealthy

Startup probe failed: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-026f86-openshift-default-5f9b6dfb86-dbjml

ProbeError

Startup probe error: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-b8287f-7b77d67cb6-qrzdr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-b8287f-668d744c97-hz99m

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-b8287f-668d744c97

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-b8287f-668d744c97-hz99m

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-b8287f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-b8287f-668d744c97 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-b8287f-668d744c97

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-b8287f-668d744c97-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-b8287f: serviceaccount "payload-processing-e2e-shared-b-w2-b8287f" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-b8287f-7b77d67cb6-qrzdr

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-b8287f-668d744c97-hz99m

Created

Created container: payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-b8287f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-b8287f-7b77d67cb6 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-b8287f-7b77d67cb6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-b8287f-7b77d67cb6-qrzdr

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-b8287f-668d744c97-hz99m

AddedInterface

Add eth0 [10.132.0.72/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-b8287f-7b77d67cb6-qrzdr

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-b8287f-7b77d67cb6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-b8287f-7b77d67cb6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-b8287f: serviceaccount "payload-processing-e2e-shared-b-w2-b8287f" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-b8287f-7b77d67cb6-qrzdr

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-b8287f-668d744c97-hz99m

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc

Unhealthy

Readiness probe failed: Get "http://10.134.0.52:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc

ProbeError

Readiness probe error: Get "http://10.134.0.52:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc

Unhealthy

Startup probe failed: Get "http://10.134.0.52:15021/healthz/ready": dial tcp 10.134.0.52:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc

ProbeError

Startup probe error: Get "http://10.134.0.52:15021/healthz/ready": dial tcp 10.134.0.52:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-766cc3-7949cbb557-wk99p

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-766cc3-859f9c8f8b-rnj8c

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w3-766cc3-openshift-default-8684c98854-r6bpv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-766cc3-openshift-default-8684c98854-r6bpv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w3-766cc3-openshift-default-8684c98854-r6bpv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

gateway_labeler_controller

e2e-mt-d078f791

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-d078f791

openshift-ingress

deployment-controller

e2e-mt-d078f791-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-d078f791-openshift-default-b9668b796 from 0 to 1

openshift-ingress

multus

e2e-mt-d078f791-openshift-default-b9668b796-8mnd5

AddedInterface

Add eth0 [10.132.0.74/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-mt-d078f791-openshift-default-b9668b796

SuccessfulCreate

Created pod: e2e-mt-d078f791-openshift-default-b9668b796-8mnd5

openshift-ingress

deployment-controller

payload-processing-e2e-mt-d078f791

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-d078f791-5cbb8464b5 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-d078f791-5cbb8464b5

FailedCreate

Error creating: pods "payload-processing-e2e-mt-d078f791-5cbb8464b5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-d078f791: serviceaccount "payload-processing-e2e-mt-d078f791" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-d078f791-668f96ccfd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-d078f791-668f96ccfd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-d078f791: serviceaccount "payload-processing-e2e-mt-d078f791" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-d078f791

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-d078f791-668f96ccfd from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-mt-d078f791-5cbb8464b5-x4h97

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-d078f791-5cbb8464b5

SuccessfulCreate

Created pod: payload-processing-e2e-mt-d078f791-5cbb8464b5-x4h97

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-d078f791-668f96ccfd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-d078f791-668f96ccfd-7z2pj

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-d078f791-668f96ccfd-7z2pj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-d078f791-668f96ccfd-7z2pj

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-d078f791-668f96ccfd-7z2pj

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-d078f791-5cbb8464b5-x4h97

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-d078f791-668f96ccfd-7z2pj

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-mt-d078f791-5cbb8464b5-x4h97

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-d078f791-5cbb8464b5-x4h97

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-d078f791-openshift-default-b9668b796-8mnd5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-d078f791-openshift-default-b9668b796-8mnd5

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-d078f791-openshift-default-b9668b796-8mnd5

Started

Started container istio-proxy
(x7)

openshift-ingress

kubelet

e2e-mt-d078f791-openshift-default-b9668b796-8mnd5

ProbeError

Startup probe error: Get "http://10.132.0.74:15021/healthz/ready": dial tcp 10.132.0.74:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-mt-d078f791-openshift-default-b9668b796-8mnd5

Unhealthy

Startup probe failed: Get "http://10.132.0.74:15021/healthz/ready": dial tcp 10.132.0.74:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-d7b97f-5c67fccd8b-97nxs

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-d7b97f-6c47b7d997-lwvsx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-d078f791-668f96ccfd-7z2pj

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-mt-d078f791

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-mt-d078f791: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-mt-d078f791": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-mt-d078f791, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: b7299150-7b2d-4a11-9ccc-26b87dd2a35c, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-mt-d078f791-5cbb8464b5-x4h97

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-d078f791-openshift-default-b9668b796-8mnd5

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-a-w1-7751cd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w1-7751cd-openshift-default-5b9dfd974 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w1-7751cd-openshift-default-5b9dfd974

SuccessfulCreate

Created pod: e2e-shared-a-w1-7751cd-openshift-default-5b9dfd974-hktsj

openshift-ingress

multus

e2e-shared-a-w1-7751cd-openshift-default-5b9dfd974-hktsj

AddedInterface

Add eth0 [10.132.0.79/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w1-7751cd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w1-7751cd

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w1-7751cd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w1-7751cd-66fc974cb6 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-7751cd-66fc974cb6-4td42

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-w1-7751cd-84c79cb4bf-444xt

AddedInterface

Add eth0 [10.132.0.80/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w1-7751cd-66fc974cb6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w1-7751cd-66fc974cb6-4td42

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-7751cd-84c79cb4bf-444xt

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-7751cd-84c79cb4bf-444xt

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w1-7751cd-84c79cb4bf

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w1-7751cd-84c79cb4bf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w1-7751cd: serviceaccount "payload-processing-e2e-shared-a-w1-7751cd" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w1-7751cd-66fc974cb6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w1-7751cd-66fc974cb6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w1-7751cd: serviceaccount "payload-processing-e2e-shared-a-w1-7751cd" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w1-7751cd-84c79cb4bf

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w1-7751cd-84c79cb4bf-444xt

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-7751cd-84c79cb4bf-444xt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w1-7751cd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w1-7751cd-84c79cb4bf from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w1-7751cd-66fc974cb6-4td42

AddedInterface

Add eth0 [10.132.0.81/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-7751cd-66fc974cb6-4td42

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-7751cd-66fc974cb6-4td42

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w1-7751cd-openshift-default-5b9dfd974-hktsj

Unhealthy

Readiness probe failed: Get "http://10.132.0.79:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-a-w1-7751cd-openshift-default-5b9dfd974-hktsj

ProbeError

Readiness probe error: Get "http://10.132.0.79:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-7751cd-openshift-default-5b9dfd974-hktsj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-7751cd-openshift-default-5b9dfd974-hktsj

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-7751cd-openshift-default-5b9dfd974-hktsj

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-a-w1-7751cd-openshift-default-5b9dfd974-hktsj

Unhealthy

Startup probe failed: Get "http://10.132.0.79:15021/healthz/ready": dial tcp 10.132.0.79:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w1-7751cd-openshift-default-5b9dfd974-hktsj

ProbeError

Startup probe error: Get "http://10.132.0.79:15021/healthz/ready": dial tcp 10.132.0.79:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-shared-b-w1-947f83-openshift-default-58f85bb848

SuccessfulCreate

Created pod: e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w1-947f83

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w1-947f83

openshift-ingress

deployment-controller

e2e-shared-b-w1-947f83-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w1-947f83-openshift-default-58f85bb848 from 0 to 1

openshift-ingress

multus

e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w1-947f83-5f86f66f99

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w1-947f83-5f86f66f99-kxljw

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w1-947f83

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w1-947f83-5f86f66f99 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w1-947f83-7cbd46c66

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w1-947f83-7cbd46c66-d6744
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w1-947f83-5f86f66f99

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w1-947f83-5f86f66f99-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w1-947f83: serviceaccount "payload-processing-e2e-shared-b-w1-947f83" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w1-947f83

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w1-947f83-7cbd46c66 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w1-947f83-7cbd46c66

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w1-947f83-7cbd46c66-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w1-947f83: serviceaccount "payload-processing-e2e-shared-b-w1-947f83" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-947f83-7cbd46c66-d6744

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-947f83-5f86f66f99-kxljw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-b-w1-947f83-5f86f66f99-kxljw

AddedInterface

Add eth0 [10.132.0.82/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w1-947f83-7cbd46c66-d6744

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-947f83-7cbd46c66-d6744

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-947f83-7cbd46c66-d6744

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-947f83-5f86f66f99-kxljw

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-947f83-5f86f66f99-kxljw

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz

ProbeError

Readiness probe error: Get "http://10.134.0.59:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz

Unhealthy

Readiness probe failed: Get "http://10.134.0.59:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz

ProbeError

Startup probe error: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz

Unhealthy

Startup probe failed: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-mt-d727624f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-d727624f

openshift-ingress

multus

e2e-mt-d727624f-openshift-default-5ff84dbd76-qdtcl

AddedInterface

Add eth0 [10.132.0.83/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-mt-d727624f-openshift-default-5ff84dbd76

SuccessfulCreate

Created pod: e2e-mt-d727624f-openshift-default-5ff84dbd76-qdtcl

openshift-ingress

deployment-controller

e2e-mt-d727624f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-d727624f-openshift-default-5ff84dbd76 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-d727624f-744ffb78f4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-d727624f-744ffb78f4-zn58h
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-d727624f-744ffb78f4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-d727624f-744ffb78f4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-d727624f: serviceaccount "payload-processing-e2e-mt-d727624f" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-d727624f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-d727624f-744ffb78f4 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-d727624f-f946f8585

FailedCreate

Error creating: pods "payload-processing-e2e-mt-d727624f-f946f8585-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-d727624f: serviceaccount "payload-processing-e2e-mt-d727624f" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-d727624f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-d727624f-f946f8585 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-d727624f-f946f8585

SuccessfulCreate

Created pod: payload-processing-e2e-mt-d727624f-f946f8585-6fr4g

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-d727624f-744ffb78f4-zn58h

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-d727624f-f946f8585-6fr4g

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-d727624f-744ffb78f4-zn58h

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-d727624f-f946f8585-6fr4g

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-d727624f-f946f8585-6fr4g

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-d727624f-744ffb78f4-zn58h

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-mt-d727624f-744ffb78f4-zn58h

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-mt-d727624f-f946f8585-6fr4g

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-mt-d727624f-openshift-default-5ff84dbd76-qdtcl

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-d727624f-openshift-default-5ff84dbd76-qdtcl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-d727624f-openshift-default-5ff84dbd76-qdtcl

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-d727624f-openshift-default-5ff84dbd76-qdtcl

Unhealthy

Startup probe failed: Get "http://10.132.0.83:15021/healthz/ready": dial tcp 10.132.0.83:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-d727624f-openshift-default-5ff84dbd76-qdtcl

ProbeError

Startup probe error: Get "http://10.132.0.83:15021/healthz/ready": dial tcp 10.132.0.83:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-d727624f-744ffb78f4-zn58h

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-d727624f-f946f8585-6fr4g

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-d727624f-openshift-default-5ff84dbd76-qdtcl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-d727624f-openshift-default-5ff84dbd76-qdtcl

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-d727624f-openshift-default-5ff84dbd76-qdtcl

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

e2e-api-a-c6abf3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-c6abf3-openshift-default-6989fd5b4b from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-c6abf3-openshift-default-6989fd5b4b

SuccessfulCreate

Created pod: e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6

openshift-ingress

gateway_labeler_controller

e2e-api-a-c6abf3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-c6abf3

openshift-ingress

multus

e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-c6abf3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-c6abf3-748645869c from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-c6abf3-748645869c

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-c6abf3-748645869c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-c6abf3: serviceaccount "payload-processing-e2e-api-a-c6abf3" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-c6abf3-748645869c

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-c6abf3-748645869c-8dqws

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-c6abf3-786464d986

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-c6abf3-786464d986-psths

openshift-ingress

multus

payload-pre-processing-e2e-api-a-c6abf3-786464d986-psths

AddedInterface

Add eth0 [10.132.0.85/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-api-a-c6abf3-748645869c-8dqws

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-c6abf3-786464d986-psths

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-c6abf3-786464d986-psths

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-c6abf3-786464d986-psths

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-c6abf3-748645869c-8dqws

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-c6abf3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-c6abf3-786464d986 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-c6abf3-786464d986

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-c6abf3-786464d986-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-c6abf3: serviceaccount "payload-processing-e2e-api-a-c6abf3" not found

openshift-ingress

kubelet

payload-processing-e2e-api-a-c6abf3-748645869c-8dqws

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-c6abf3-748645869c-8dqws

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6

Unhealthy

Startup probe failed: Get "http://10.134.0.63:15021/healthz/ready": dial tcp 10.134.0.63:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6

ProbeError

Startup probe error: Get "http://10.134.0.63:15021/healthz/ready": dial tcp 10.134.0.63:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-api-b-9f97d7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-9f97d7-openshift-default-5fdf996d6 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-9f97d7-openshift-default-5fdf996d6

SuccessfulCreate

Created pod: e2e-api-b-9f97d7-openshift-default-5fdf996d6-zr94x

openshift-ingress

gateway_labeler_controller

e2e-api-b-9f97d7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-9f97d7

openshift-ingress

multus

e2e-api-b-9f97d7-openshift-default-5fdf996d6-zr94x

AddedInterface

Add eth0 [10.132.0.86/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-9f97d7-55f6f6fd4f

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-9f97d7-55f6f6fd4f-v2w9z

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-9f97d7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-9f97d7-55f6f6fd4f from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-9f97d7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-9f97d7-84c94f876b from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-9f97d7-55f6f6fd4f

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-9f97d7-55f6f6fd4f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-9f97d7: serviceaccount "payload-processing-e2e-api-b-9f97d7" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-9f97d7-84c94f876b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-9f97d7-84c94f876b-flfmf
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-9f97d7-84c94f876b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-9f97d7-84c94f876b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-9f97d7: serviceaccount "payload-processing-e2e-api-b-9f97d7" not found

openshift-ingress

kubelet

payload-processing-e2e-api-b-9f97d7-55f6f6fd4f-v2w9z

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-9f97d7-84c94f876b-flfmf

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-9f97d7-55f6f6fd4f-v2w9z

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-9f97d7-84c94f876b-flfmf

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-b-9f97d7-84c94f876b-flfmf

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-9f97d7-84c94f876b-flfmf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-b-9f97d7-55f6f6fd4f-v2w9z

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-api-b-9f97d7-55f6f6fd4f-v2w9z

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-31fca0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-31fca0

openshift-ingress

replicaset-controller

e2e-ipp-a-31fca0-openshift-default-b7bb4bc8

SuccessfulCreate

Created pod: e2e-ipp-a-31fca0-openshift-default-b7bb4bc8-rp6ng

openshift-ingress

deployment-controller

e2e-ipp-a-31fca0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-31fca0-openshift-default-b7bb4bc8 from 0 to 1

openshift-ingress

multus

e2e-ipp-a-31fca0-openshift-default-b7bb4bc8-rp6ng

AddedInterface

Add eth0 [10.132.0.87/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-31fca0-85b785c4fc

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-31fca0-85b785c4fc-r4s9n

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-31fca0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-31fca0-7879894f7d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-31fca0-85b785c4fc

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-31fca0-85b785c4fc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-31fca0: serviceaccount "payload-processing-e2e-ipp-a-31fca0" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-31fca0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-31fca0-85b785c4fc from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-31fca0-7879894f7d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-31fca0-7879894f7d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-31fca0: serviceaccount "payload-processing-e2e-ipp-a-31fca0" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-31fca0-7879894f7d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-31fca0-7879894f7d-lnj46

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-31fca0-85b785c4fc-r4s9n

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-31fca0-85b785c4fc-r4s9n

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-31fca0-7879894f7d-lnj46

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-a-31fca0-85b785c4fc-r4s9n

AddedInterface

Add eth0 [10.132.0.88/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-31fca0-7879894f7d-lnj46

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-31fca0-7879894f7d-lnj46

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-31fca0-7879894f7d-lnj46

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-31fca0-85b785c4fc-r4s9n

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-api-b-9f97d7-openshift-default-5fdf996d6-zr94x

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-9f97d7-openshift-default-5fdf996d6-zr94x

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-9f97d7-openshift-default-5fdf996d6-zr94x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-api-b-9f97d7-openshift-default-5fdf996d6-zr94x

Unhealthy

Startup probe failed: Get "http://10.132.0.86:15021/healthz/ready": dial tcp 10.132.0.86:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-b-9f97d7-openshift-default-5fdf996d6-zr94x

ProbeError

Startup probe error: Get "http://10.132.0.86:15021/healthz/ready": dial tcp 10.132.0.86:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-c6abf3-786464d986-psths

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-c6abf3-748645869c-8dqws

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-a-31fca0-openshift-default-b7bb4bc8-rp6ng

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-31fca0-openshift-default-b7bb4bc8-rp6ng

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-31fca0-openshift-default-b7bb4bc8-rp6ng

Started

Started container istio-proxy

openshift-ingress

deployment-controller

e2e-ipp-b-23a45b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-23a45b-openshift-default-6b7879456b from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-23a45b-openshift-default-6b7879456b

SuccessfulCreate

Created pod: e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d
(x5)

openshift-ingress

kubelet

e2e-ipp-a-31fca0-openshift-default-b7bb4bc8-rp6ng

ProbeError

Startup probe error: Get "http://10.132.0.87:15021/healthz/ready": dial tcp 10.132.0.87:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-31fca0-openshift-default-b7bb4bc8-rp6ng

Unhealthy

Startup probe failed: Get "http://10.132.0.87:15021/healthz/ready": dial tcp 10.132.0.87:15021: connect: connection refused

openshift-ingress

multus

e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes

openshift-ingress

GatewayAuthBootstrap

e2e-ipp-b-23a45b

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-ipp-b-23a45b-authn-ssl: envoyfilters.networking.istio.io "e2e-ipp-b-23a45b-authn-ssl" already exists

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-23a45b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-23a45b

openshift-ingress

kubelet

e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6

Killing

Stopping container istio-proxy
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-23a45b-844fd746d6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-23a45b-844fd746d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-23a45b: serviceaccount "payload-processing-e2e-ipp-b-23a45b" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-23a45b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-23a45b-844fd746d6 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-23a45b-69c69b9769

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-23a45b-69c69b9769-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-23a45b: serviceaccount "payload-processing-e2e-ipp-b-23a45b" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-23a45b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-23a45b-69c69b9769 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-23a45b-844fd746d6-2pm8f

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-23a45b-69c69b9769

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-23a45b-69c69b9769-6dllx

openshift-ingress

multus

payload-processing-e2e-ipp-b-23a45b-69c69b9769-6dllx

AddedInterface

Add eth0 [10.134.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-23a45b-69c69b9769-6dllx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-23a45b-69c69b9769-6dllx

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-23a45b-844fd746d6-2pm8f

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-23a45b-844fd746d6-2pm8f

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-23a45b-844fd746d6-2pm8f

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-23a45b-844fd746d6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-23a45b-844fd746d6-2pm8f

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-23a45b-69c69b9769-6dllx

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-9f97d7-55f6f6fd4f-v2w9z

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-9f97d7-84c94f876b-flfmf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-9f97d7-openshift-default-5fdf996d6-zr94x

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-api-b-9f97d7-openshift-default-5fdf996d6-zr94x

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-b-9f97d7-openshift-default-5fdf996d6-zr94x

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x5)

openshift-ingress

kubelet

e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d

Unhealthy

Startup probe failed: Get "http://10.134.0.68:15021/healthz/ready": dial tcp 10.134.0.68:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d

ProbeError

Startup probe error: Get "http://10.134.0.68:15021/healthz/ready": dial tcp 10.134.0.68:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-7751cd-84c79cb4bf-444xt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-7751cd-66fc974cb6-4td42

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w1-7751cd-openshift-default-5b9dfd974-hktsj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w1-7751cd-openshift-default-5b9dfd974-hktsj

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w1-7751cd-openshift-default-5b9dfd974-hktsj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-947f83-5f86f66f99-kxljw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-947f83-7cbd46c66-d6744

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-ipp-cleanup-fd3842-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-fd3842-openshift-default-74c45b894 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-fd3842

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-fd3842

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-fd3842-openshift-default-74c45b894

SuccessfulCreate

Created pod: e2e-ipp-cleanup-fd3842-openshift-default-74c45b894-cttt2

openshift-ingress

GatewayAuthBootstrap

e2e-ipp-cleanup-fd3842

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-ipp-cleanup-fd3842-authn-ssl: envoyfilters.networking.istio.io "e2e-ipp-cleanup-fd3842-authn-ssl" already exists

openshift-ingress

multus

e2e-ipp-cleanup-fd3842-openshift-default-74c45b894-cttt2

AddedInterface

Add eth0 [10.132.0.93/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-fd3842-78748b5598

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-fd3842-78748b5598-fmln6

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-fd3842-77f66db76f

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-fd3842-77f66db76f-jrpmc

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-fd3842

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-fd3842-77f66db76f from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-fd3842

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-fd3842-78748b5598 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-fd3842-77f66db76f

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-fd3842-77f66db76f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-fd3842: serviceaccount "payload-processing-e2e-ipp-cleanup-fd3842" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-fd3842-78748b5598

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-fd3842-78748b5598-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-fd3842: serviceaccount "payload-processing-e2e-ipp-cleanup-fd3842" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-fd3842-78748b5598-fmln6

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-fd3842-77f66db76f-jrpmc

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-fd3842-78748b5598-fmln6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-fd3842-77f66db76f-jrpmc

AddedInterface

Add eth0 [10.132.0.94/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-fd3842-78748b5598-fmln6

AddedInterface

Add eth0 [10.134.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-fd3842-78748b5598-fmln6

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-fd3842-77f66db76f-jrpmc

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-fd3842-77f66db76f-jrpmc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-fd3842-openshift-default-74c45b894-cttt2

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-fd3842-openshift-default-74c45b894-cttt2

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-fd3842-openshift-default-74c45b894-cttt2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-fd3842-openshift-default-74c45b894-cttt2

Unhealthy

Startup probe failed: Get "http://10.132.0.93:15021/healthz/ready": dial tcp 10.132.0.93:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-fd3842-openshift-default-74c45b894-cttt2

ProbeError

Startup probe error: Get "http://10.132.0.93:15021/healthz/ready": dial tcp 10.132.0.93:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-fd3842-78748b5598-fmln6

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-cleanup-fd3842

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fd3842: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-cleanup-fd3842": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fd3842, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 544b64ac-02ea-4e0c-8b4b-45bed7fb0b53, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-fd3842-77f66db76f-jrpmc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-fd3842-openshift-default-74c45b894-cttt2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-31fca0-85b785c4fc-r4s9n

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-31fca0-7879894f7d-lnj46

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-31fca0-openshift-default-b7bb4bc8-rp6ng

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-23a45b-69c69b9769-6dllx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-23a45b-844fd746d6-2pm8f

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-026f86-86cd76fb97-h9858

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-026f86-649c65f74-85x4x

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w2-026f86-openshift-default-5f9b6dfb86-dbjml

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-026f86-openshift-default-5f9b6dfb86-dbjml

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w2-026f86-openshift-default-5f9b6dfb86-dbjml

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-b-w2-b8287f

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-b-w2-b8287f: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-b-w2-b8287f": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-b-w2-b8287f, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: d32bb772-e884-4557-b510-a87c0286243f, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-b8287f-668d744c97-hz99m

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-b8287f-7b77d67cb6-qrzdr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x24)

openshift-ingress

kubelet

payload-processing-5d7dbbd56b-rl88q

FailedToRetrieveImagePullSecret

Unable to retrieve some image pull secrets (payload-processing-dockercfg-rklfc); attempting to pull the image may not succeed.
(x24)

openshift-ingress

kubelet

payload-pre-processing-6cd864bc95-4l7wg

FailedToRetrieveImagePullSecret

Unable to retrieve some image pull secrets (payload-processing-dockercfg-rklfc); attempting to pull the image may not succeed.