Time Namespace Component RelatedObject Reason Message

openshift-ingress

e2e-inf-b-90d6f5-openshift-default-77b48b5f6d-r9pp6

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-90d6f5-openshift-default-77b48b5f6d-r9pp6 to ip-10-0-135-39.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-54b7f9-5b4bdccd54-bs9vf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-54b7f9-5b4bdccd54-bs9vf to ip-10-0-133-126.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-90d6f5-6cb8d447d7-hm69v

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-90d6f5-6cb8d447d7-hm69v to ip-10-0-133-126.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-48898f-f4db79966-rsv9j

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-48898f-f4db79966-rsv9j to ip-10-0-135-39.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-362f7a-849fb7b974-tplmj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-362f7a-849fb7b974-tplmj to ip-10-0-135-39.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-e7ca56-6954cfc9f7-ld4cv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-e7ca56-6954cfc9f7-ld4cv to ip-10-0-133-126.ec2.internal

openshift-ingress

e2e-ipp-b-4ee29a-openshift-default-7c9dfbccd4-n7b7r

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-4ee29a-openshift-default-7c9dfbccd4-n7b7r to ip-10-0-133-126.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-87d086-6598797bf4-ccnqx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-87d086-6598797bf4-ccnqx to ip-10-0-135-39.ec2.internal

openshift-ingress

e2e-ait-c0b7dbbd-openshift-default-55f9585ddd-6z62g

Scheduled

Successfully assigned openshift-ingress/e2e-ait-c0b7dbbd-openshift-default-55f9585ddd-6z62g to ip-10-0-128-223.ec2.internal

openshift-ingress

payload-processing-e2e-derive-58b751e1-768ddf86f-vq98l

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-58b751e1-768ddf86f-vq98l to ip-10-0-135-39.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-x8fxp

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-x8fxp to ip-10-0-133-126.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-58b751e1-6f4b5ccd-7zvfx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-58b751e1-6f4b5ccd-7zvfx to ip-10-0-135-39.ec2.internal

openshift-ingress

e2e-mt-577852b1-openshift-default-6c6fd5f5b4-zb6j6

Scheduled

Successfully assigned openshift-ingress/e2e-mt-577852b1-openshift-default-6c6fd5f5b4-zb6j6 to ip-10-0-133-126.ec2.internal

openshift-ingress

e2e-worker-w4-837632-openshift-default-7588449dc8-vh7f7

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-837632-openshift-default-7588449dc8-vh7f7 to ip-10-0-135-39.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-3219e3-ffbbfbb86-xdblq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-3219e3-ffbbfbb86-xdblq to ip-10-0-135-39.ec2.internal

openshift-ingress

e2e-worker-w0-e7ca56-openshift-default-78999d97db-5n8h9

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-e7ca56-openshift-default-78999d97db-5n8h9 to ip-10-0-135-39.ec2.internal

openshift-ingress

payload-processing-e2e-mt-a843ae03-5887db69b9-jw82h

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-a843ae03-5887db69b9-jw82h to ip-10-0-133-126.ec2.internal

openshift-ingress

payload-processing-e2e-autores-3219e3-7bd986c4ff-rkqqx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-3219e3-7bd986c4ff-rkqqx to ip-10-0-133-126.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-87d086-76c8ddffb5-5rrbl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-87d086-76c8ddffb5-5rrbl to ip-10-0-135-39.ec2.internal

openshift-ingress

e2e-ait-f722bf59-openshift-default-d8b977858-fcsxd

Scheduled

Successfully assigned openshift-ingress/e2e-ait-f722bf59-openshift-default-d8b977858-fcsxd to ip-10-0-128-223.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-14a808-55b84f5486-24zv5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-14a808-55b84f5486-24zv5 to ip-10-0-133-126.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-c4e39b-7c845f5685-8lr4w

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-c4e39b-7c845f5685-8lr4w to ip-10-0-135-39.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w4-837632-5fddcb76c7-njvt4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-837632-5fddcb76c7-njvt4 to ip-10-0-133-126.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-14a808-7b686594df-tvg2r

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-14a808-7b686594df-tvg2r to ip-10-0-133-126.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-362f7a-6b475b4b95-xwprc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-362f7a-6b475b4b95-xwprc to ip-10-0-135-39.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-svzvx

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-svzvx to ip-10-0-133-126.ec2.internal

openshift-ingress

e2e-mt-a843ae03-openshift-default-7c48d8b9cb-lpqb9

Scheduled

Successfully assigned openshift-ingress/e2e-mt-a843ae03-openshift-default-7c48d8b9cb-lpqb9 to ip-10-0-133-126.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-54b7f9-74df86bfc-4cphh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-54b7f9-74df86bfc-4cphh to ip-10-0-135-39.ec2.internal

openshift-ingress

e2e-ipp-a-177c81-openshift-default-69c9bdcf6-6gl8l

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-177c81-openshift-default-69c9bdcf6-6gl8l to ip-10-0-133-126.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-f722bf59-7fcc65f7d6-6v88v

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-f722bf59-7fcc65f7d6-6v88v to ip-10-0-133-126.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-c0b7dbbd-666c445f58-9b575

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-c0b7dbbd-666c445f58-9b575 to ip-10-0-135-39.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-a843ae03-6d7c45b9c4-6vwhp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-a843ae03-6d7c45b9c4-6vwhp to ip-10-0-133-126.ec2.internal

openshift-ingress

e2e-api-a-54b7f9-openshift-default-77688d4cd-hwv8m

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-54b7f9-openshift-default-77688d4cd-hwv8m to ip-10-0-133-126.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-577852b1-c559688c4-4vb94

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-577852b1-c559688c4-4vb94 to ip-10-0-135-39.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-c4e39b-6c76f7f8-9t6nr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-c4e39b-6c76f7f8-9t6nr to ip-10-0-133-126.ec2.internal

openshift-ingress

e2e-explicit-87d086-openshift-default-7ff69c69b-4dwsm

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-87d086-openshift-default-7ff69c69b-4dwsm to ip-10-0-128-223.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-4ee29a-68f45bf967-z6lhf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-4ee29a-68f45bf967-z6lhf to ip-10-0-135-39.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-rwvw4

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-rwvw4 to ip-10-0-133-126.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-68cf4d799ctkm7h

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ctkm7h to ip-10-0-135-39.ec2.internal

openshift-ingress

e2e-migrate-4408ba1c-gw-openshift-default-7ddf46ddb4-ws7q9

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-4408ba1c-gw-openshift-default-7ddf46ddb4-ws7q9 to ip-10-0-128-223.ec2.internal

openshift-ingress

kube-auth-proxy-789999dc4-rh6hh

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-789999dc4-rh6hh to ip-10-0-133-126.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-e04dee-546cb95c69-pwbwp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-e04dee-546cb95c69-pwbwp to ip-10-0-133-126.ec2.internal

openshift-ingress

e2e-noten-cd2cc1-openshift-default-5d8b876f7b-fxfv9

Scheduled

Successfully assigned openshift-ingress/e2e-noten-cd2cc1-openshift-default-5d8b876f7b-fxfv9 to ip-10-0-128-223.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-4408ba1c-b9bd4d94-jnc4k

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-4408ba1c-b9bd4d94-jnc4k to ip-10-0-135-39.ec2.internal

openshift-ingress

e2e-shared-b-w3-928943-openshift-default-58b4db468d-6xh78

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-928943-openshift-default-58b4db468d-6xh78 to ip-10-0-128-223.ec2.internal

openshift-ingress

e2e-api-b-14a808-openshift-default-767dc55cdb-52h28

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-14a808-openshift-default-767dc55cdb-52h28 to ip-10-0-133-126.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-928943-5f8c7db995-snll6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-928943-5f8c7db995-snll6 to ip-10-0-135-39.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-c0e28e-7b995c7458-zrvkl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-c0e28e-7b995c7458-zrvkl to ip-10-0-135-39.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-e04dee-7b7d4886b-2srmc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e04dee-7b7d4886b-2srmc to ip-10-0-135-39.ec2.internal

openshift-ingress

e2e-ipp-cleanup-e04dee-openshift-default-6b5c749998-xp6mr

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-e04dee-openshift-default-6b5c749998-xp6mr to ip-10-0-128-223.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-928943-656956f754-zj6v5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-928943-656956f754-zj6v5 to ip-10-0-135-39.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-e7ca56-69c6dcc98b-lzc2f

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-e7ca56-69c6dcc98b-lzc2f to ip-10-0-135-39.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-177c81-576f87d755-l27ww

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-177c81-576f87d755-l27ww to ip-10-0-135-39.ec2.internal

openshift-ingress

router-default-6dbb8d47db-qzqwf

Scheduled

Successfully assigned openshift-ingress/router-default-6dbb8d47db-qzqwf to ip-10-0-133-126.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-90d6f5-6869fb7566-qw7rk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-90d6f5-6869fb7566-qw7rk to ip-10-0-133-126.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-xc4hx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-xc4hx to ip-10-0-135-39.ec2.internal

openshift-ingress

e2e-autores-3219e3-openshift-default-587759d66d-9zqzf

Scheduled

Successfully assigned openshift-ingress/e2e-autores-3219e3-openshift-default-587759d66d-9zqzf to ip-10-0-135-39.ec2.internal

openshift-ingress

e2e-shared-b-w2-c0e28e-openshift-default-56897975d6-bfw55

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-c0e28e-openshift-default-56897975d6-bfw55 to ip-10-0-128-223.ec2.internal

openshift-ingress

e2e-shared-a-w2-c4e39b-openshift-default-65d76db66b-fxxph

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-c4e39b-openshift-default-65d76db66b-fxxph to ip-10-0-133-126.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-5ccb968c66-rp6sn

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-rp6sn to ip-10-0-135-39.ec2.internal

openshift-ingress

e2e-derive-58b751e1-openshift-default-67b877b996-zvx8h

Scheduled

Successfully assigned openshift-ingress/e2e-derive-58b751e1-openshift-default-67b877b996-zvx8h to ip-10-0-128-223.ec2.internal

openshift-ingress

e2e-inf-a-362f7a-openshift-default-6ff595f56-ft5p4

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-362f7a-openshift-default-6ff595f56-ft5p4 to ip-10-0-133-126.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-837632-77765b66db-st47n

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-837632-77765b66db-st47n to ip-10-0-133-126.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-4408ba1c-b9665474b-54zz8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-4408ba1c-b9665474b-54zz8 to ip-10-0-133-126.ec2.internal

openshift-ingress

payload-processing-e2e-ait-c0b7dbbd-7dd99f844c-gc24l

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-c0b7dbbd-7dd99f844c-gc24l to ip-10-0-133-126.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-177c81-567fbdcbd6-kts6j

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-177c81-567fbdcbd6-kts6j to ip-10-0-133-126.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-48898f-797669c7bf-ql6l2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-48898f-797669c7bf-ql6l2 to ip-10-0-133-126.ec2.internal

openshift-ingress

payload-processing-e2e-ait-f722bf59-79c869485-hdk7v

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-f722bf59-79c869485-hdk7v to ip-10-0-135-39.ec2.internal

openshift-ingress

kube-auth-proxy-789999dc4-tcljc

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-789999dc4-tcljc to ip-10-0-128-223.ec2.internal

openshift-ingress

e2e-shared-a-w3-48898f-openshift-default-c6c9586f8-4kxk5

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-48898f-openshift-default-c6c9586f8-4kxk5 to ip-10-0-135-39.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-c0e28e-f4c8fc48f-krfwt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-c0e28e-f4c8fc48f-krfwt to ip-10-0-135-39.ec2.internal

openshift-ingress

payload-processing-e2e-mt-577852b1-6585fb4f97-rhqsc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-577852b1-6585fb4f97-rhqsc to ip-10-0-135-39.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-4ee29a-5c48cbf4b-dc75t

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-4ee29a-5c48cbf4b-dc75t to ip-10-0-133-126.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-6dbb8d47db from 0 to 1
(x13)

openshift-ingress

replicaset-controller

router-default-6dbb8d47db

FailedCreate

Error creating: pods "router-default-6dbb8d47db-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x16)

openshift-ingress

replicaset-controller

router-default-6dbb8d47db

FailedCreate

Error creating: pods "router-default-6dbb8d47db-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-6dbb8d47db

SuccessfulCreate

Created pod: router-default-6dbb8d47db-qzqwf

openshift-ingress

taint-eviction-controller

router-default-6dbb8d47db-qzqwf

TaintManagerEviction

Cancelling deletion of Pod openshift-ingress/router-default-6dbb8d47db-qzqwf
(x5)

openshift-ingress

kubelet

router-default-6dbb8d47db-qzqwf

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x6)

openshift-ingress

kubelet

router-default-6dbb8d47db-qzqwf

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

kubelet

router-default-6dbb8d47db-qzqwf

Started

Started container router

openshift-ingress

kubelet

router-default-6dbb8d47db-qzqwf

Created

Created container: router

openshift-ingress

kubelet

router-default-6dbb8d47db-qzqwf

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:48526e08a2a06d05806dbcf3ddb069e5182371667d9e9f7d2cf09f60cd247d20" already present on machine

openshift-ingress

multus

router-default-6dbb8d47db-qzqwf

AddedInterface

Add eth0 [10.134.0.10/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

kube-auth-proxy-789999dc4

FailedCreate

Error creating: pods "kube-auth-proxy-789999dc4-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-789999dc4 from 0 to 2

openshift-ingress

replicaset-controller

kube-auth-proxy-789999dc4

SuccessfulCreate

Created pod: kube-auth-proxy-789999dc4-tcljc

openshift-ingress

replicaset-controller

kube-auth-proxy-789999dc4

SuccessfulCreate

Created pod: kube-auth-proxy-789999dc4-rh6hh

openshift-ingress

multus

kube-auth-proxy-789999dc4-rh6hh

AddedInterface

Add eth0 [10.134.0.24/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-789999dc4-tcljc

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-789999dc4-tcljc

AddedInterface

Add eth0 [10.132.0.26/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-789999dc4-rh6hh

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-svzvx

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-svzvx

AddedInterface

Add eth0 [10.134.0.25/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-789999dc4-rh6hh

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-789999dc4-rh6hh

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.717s (2.717s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-svzvx

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

kube-auth-proxy-789999dc4-rh6hh

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-789999dc4-tcljc

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 3.345s (3.345s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-789999dc4-tcljc

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-789999dc4-tcljc

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-svzvx

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.508s (2.508s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-svzvx

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-svzvx

Started

Started container discovery
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-svzvx

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-68cf4d799c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-68cf4d799ctkm7h

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-68cf4d799c from 0 to 1
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-svzvx

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-68cf4d799ctkm7h

AddedInterface

Add eth0 [10.133.0.25/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799ctkm7h

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799ctkm7h

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799ctkm7h

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.933s (2.933s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799ctkm7h

Created

Created container: istio-proxy

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-x8fxp

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-x8fxp

Started

Started container discovery

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-x8fxp

AddedInterface

Add eth0 [10.134.0.26/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-x8fxp

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-x8fxp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" already present on machine

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-x8fxp

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-x8fxp

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-svzvx

Killing

Stopping container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-svzvx
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-5ccb968c66 from 0 to 1

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5ccb968c66

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5ccb968c66-rp6sn

openshift-ingress

multus

maas-default-gateway-openshift-default-5ccb968c66-rp6sn

AddedInterface

Add eth0 [10.133.0.37/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-5b54b7fbb7-rwvw4

AddedInterface

Add eth0 [10.134.0.36/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-xc4hx
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-rwvw4
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-rwvw4

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-xc4hx

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-xc4hx

AddedInterface

Add eth0 [10.133.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-rwvw4

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.854s (1.854s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-rwvw4

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-rwvw4

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-xc4hx

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.647s (2.647s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-xc4hx

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-xc4hx

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-rp6sn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-rp6sn

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-rp6sn

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-rp6sn

Unhealthy

Startup probe failed: Get "http://10.133.0.37:15021/healthz/ready": dial tcp 10.133.0.37:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-rp6sn

ProbeError

Startup probe error: Get "http://10.133.0.37:15021/healthz/ready": dial tcp 10.133.0.37:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-837632

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-837632

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-e7ca56

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-e7ca56

openshift-ingress

gateway_labeler_controller

e2e-inf-a-362f7a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-362f7a

openshift-ingress

replicaset-controller

e2e-worker-w4-837632-openshift-default-7588449dc8

SuccessfulCreate

Created pod: e2e-worker-w4-837632-openshift-default-7588449dc8-vh7f7

openshift-ingress

deployment-controller

e2e-inf-a-362f7a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-362f7a-openshift-default-6ff595f56 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-362f7a-openshift-default-6ff595f56

SuccessfulCreate

Created pod: e2e-inf-a-362f7a-openshift-default-6ff595f56-ft5p4

openshift-ingress

deployment-controller

e2e-worker-w4-837632-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-837632-openshift-default-7588449dc8 from 0 to 1

openshift-ingress

multus

e2e-inf-a-362f7a-openshift-default-6ff595f56-ft5p4

AddedInterface

Add eth0 [10.134.0.38/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-362f7a-openshift-default-6ff595f56-ft5p4

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

e2e-worker-w4-837632-openshift-default-7588449dc8-vh7f7

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w0-e7ca56-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-e7ca56-openshift-default-78999d97db from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w0-e7ca56-openshift-default-78999d97db

SuccessfulCreate

Created pod: e2e-worker-w0-e7ca56-openshift-default-78999d97db-5n8h9

openshift-ingress

multus

e2e-worker-w0-e7ca56-openshift-default-78999d97db-5n8h9

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-362f7a-openshift-default-6ff595f56-ft5p4

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 3.025s (3.025s including waiting). Image size: 181318953 bytes.

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-837632-5fddcb76c7

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-837632-5fddcb76c7-njvt4

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-837632-77765b66db

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-837632-77765b66db-st47n

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-837632-77765b66db-st47n

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-837632-77765b66db-st47n

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-worker-w4-837632-5fddcb76c7-njvt4

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-837632-5fddcb76c7-njvt4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-837632-77765b66db-st47n

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-837632-77765b66db-st47n

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-837632

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-837632-77765b66db from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-837632

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-837632-5fddcb76c7 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-837632-77765b66db

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-837632-77765b66db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-837632: serviceaccount "payload-processing-e2e-worker-w4-837632" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-837632-5fddcb76c7

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-837632-5fddcb76c7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-837632: serviceaccount "payload-processing-e2e-worker-w4-837632" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-837632-5fddcb76c7-njvt4

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-837632-5fddcb76c7-njvt4

Created

Created container: payload-processing
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-e7ca56-6954cfc9f7

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-e7ca56-6954cfc9f7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-e7ca56: serviceaccount "payload-processing-e2e-worker-w0-e7ca56" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-e7ca56

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-e7ca56-69c6dcc98b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-e7ca56-69c6dcc98b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-e7ca56-69c6dcc98b-lzc2f

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-e7ca56-6954cfc9f7

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-e7ca56-6954cfc9f7-ld4cv
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-e7ca56-69c6dcc98b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-e7ca56-69c6dcc98b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-e7ca56: serviceaccount "payload-processing-e2e-worker-w0-e7ca56" not found

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-e7ca56

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-e7ca56-6954cfc9f7 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-e7ca56-6954cfc9f7-ld4cv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-worker-w0-e7ca56-6954cfc9f7-ld4cv

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-e7ca56-69c6dcc98b-lzc2f

AddedInterface

Add eth0 [10.133.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-e7ca56-69c6dcc98b-lzc2f

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-e7ca56-6954cfc9f7-ld4cv

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-e7ca56-6954cfc9f7-ld4cv

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-e7ca56-69c6dcc98b-lzc2f

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-e7ca56-69c6dcc98b-lzc2f

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

gateway_labeler_controller

e2e-autores-3219e3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-3219e3

openshift-ingress

deployment-controller

e2e-autores-3219e3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-3219e3-openshift-default-587759d66d from 0 to 1

openshift-ingress

replicaset-controller

e2e-autores-3219e3-openshift-default-587759d66d

SuccessfulCreate

Created pod: e2e-autores-3219e3-openshift-default-587759d66d-9zqzf

openshift-ingress

multus

e2e-autores-3219e3-openshift-default-587759d66d-9zqzf

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes

openshift-ingress

multus

e2e-ait-f722bf59-openshift-default-d8b977858-fcsxd

AddedInterface

Add eth0 [10.132.0.40/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ait-f722bf59

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-f722bf59

openshift-ingress

kubelet

e2e-ait-f722bf59-openshift-default-d8b977858-fcsxd

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-362f7a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-362f7a-6b475b4b95 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-f722bf59-openshift-default-d8b977858

SuccessfulCreate

Created pod: e2e-ait-f722bf59-openshift-default-d8b977858-fcsxd

openshift-ingress

deployment-controller

e2e-ait-f722bf59-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-f722bf59-openshift-default-d8b977858 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-362f7a-6b475b4b95

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-362f7a-6b475b4b95-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-362f7a: serviceaccount "payload-processing-e2e-inf-a-362f7a" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-362f7a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-362f7a-849fb7b974 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-362f7a-6b475b4b95

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-362f7a-6b475b4b95-xwprc

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-362f7a-849fb7b974-tplmj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-362f7a-849fb7b974

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-362f7a-849fb7b974-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-362f7a: serviceaccount "payload-processing-e2e-inf-a-362f7a" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-362f7a-849fb7b974

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-362f7a-849fb7b974-tplmj

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-362f7a-849fb7b974-tplmj

AddedInterface

Add eth0 [10.133.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-362f7a-849fb7b974-tplmj

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-362f7a-6b475b4b95-xwprc

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-362f7a-6b475b4b95-xwprc

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-362f7a-849fb7b974-tplmj

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-inf-a-362f7a-6b475b4b95-xwprc

AddedInterface

Add eth0 [10.133.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-362f7a-6b475b4b95-xwprc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-ait-f722bf59-openshift-default-d8b977858-fcsxd

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.65s (2.65s including waiting). Image size: 181318953 bytes.
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-3219e3-ffbbfbb86

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-3219e3-ffbbfbb86-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-3219e3: serviceaccount "payload-processing-e2e-autores-3219e3" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-3219e3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-3219e3-ffbbfbb86 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-3219e3-ffbbfbb86

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-3219e3-ffbbfbb86-xdblq

openshift-ingress

deployment-controller

payload-processing-e2e-autores-3219e3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-3219e3-7bd986c4ff from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-3219e3-7bd986c4ff

SuccessfulCreate

Created pod: payload-processing-e2e-autores-3219e3-7bd986c4ff-rkqqx
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-3219e3-7bd986c4ff

FailedCreate

Error creating: pods "payload-processing-e2e-autores-3219e3-7bd986c4ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-3219e3: serviceaccount "payload-processing-e2e-autores-3219e3" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-3219e3-ffbbfbb86-xdblq

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-3219e3-7bd986c4ff-rkqqx

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-autores-3219e3-7bd986c4ff-rkqqx

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-3219e3-7bd986c4ff-rkqqx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-autores-3219e3-7bd986c4ff-rkqqx

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-3219e3-ffbbfbb86-xdblq

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-3219e3-ffbbfbb86-xdblq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-autores-3219e3-ffbbfbb86-xdblq

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-f722bf59-79c869485

FailedCreate

Error creating: pods "payload-processing-e2e-ait-f722bf59-79c869485-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-f722bf59: serviceaccount "payload-processing-e2e-ait-f722bf59" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-f722bf59-79c869485

SuccessfulCreate

Created pod: payload-processing-e2e-ait-f722bf59-79c869485-hdk7v

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-f722bf59-7fcc65f7d6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-f722bf59-7fcc65f7d6-6v88v

openshift-ingress

kubelet

e2e-worker-w4-837632-openshift-default-7588449dc8-vh7f7

ProbeError

Readiness probe error: Get "http://10.133.0.45:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w4-837632-openshift-default-7588449dc8-vh7f7

Unhealthy

Readiness probe failed: Get "http://10.133.0.45:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

deployment-controller

payload-processing-e2e-ait-f722bf59

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-f722bf59-79c869485 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-f722bf59

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-f722bf59-7fcc65f7d6 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-f722bf59-7fcc65f7d6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-f722bf59-7fcc65f7d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-f722bf59: serviceaccount "payload-processing-e2e-ait-f722bf59" not found

openshift-ingress

kubelet

payload-processing-e2e-ait-f722bf59-79c869485-hdk7v

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f722bf59-7fcc65f7d6-6v88v

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f722bf59-7fcc65f7d6-6v88v

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f722bf59-7fcc65f7d6-6v88v

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-f722bf59-7fcc65f7d6-6v88v

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-f722bf59-79c869485-hdk7v

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-f722bf59-79c869485-hdk7v

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-ait-f722bf59-79c869485-hdk7v

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-worker-w0-e7ca56-openshift-default-78999d97db-5n8h9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w0-e7ca56-openshift-default-78999d97db-5n8h9

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-e7ca56-openshift-default-78999d97db-5n8h9

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-837632-openshift-default-7588449dc8-vh7f7

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-837632-openshift-default-7588449dc8-vh7f7

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-837632-openshift-default-7588449dc8-vh7f7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

gateway_labeler_controller

e2e-inf-b-90d6f5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-90d6f5

openshift-ingress

deployment-controller

e2e-inf-b-90d6f5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-90d6f5-openshift-default-77b48b5f6d from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-90d6f5-openshift-default-77b48b5f6d

SuccessfulCreate

Created pod: e2e-inf-b-90d6f5-openshift-default-77b48b5f6d-r9pp6
(x6)

openshift-ingress

kubelet

e2e-worker-w0-e7ca56-openshift-default-78999d97db-5n8h9

Unhealthy

Startup probe failed: Get "http://10.133.0.46:15021/healthz/ready": dial tcp 10.133.0.46:15021: connect: connection refused

openshift-ingress

multus

e2e-inf-b-90d6f5-openshift-default-77b48b5f6d-r9pp6

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w0-e7ca56-openshift-default-78999d97db-5n8h9

ProbeError

Startup probe error: Get "http://10.133.0.46:15021/healthz/ready": dial tcp 10.133.0.46:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w4-837632-openshift-default-7588449dc8-vh7f7

ProbeError

Startup probe error: Get "http://10.133.0.45:15021/healthz/ready": dial tcp 10.133.0.45:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w4-837632-openshift-default-7588449dc8-vh7f7

Unhealthy

Startup probe failed: Get "http://10.133.0.45:15021/healthz/ready": dial tcp 10.133.0.45:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-inf-a-362f7a-openshift-default-6ff595f56-ft5p4

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-inf-a-362f7a-openshift-default-6ff595f56-ft5p4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-362f7a-openshift-default-6ff595f56-ft5p4

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-3219e3-openshift-default-587759d66d-9zqzf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-autores-3219e3-openshift-default-587759d66d-9zqzf

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-3219e3-openshift-default-587759d66d-9zqzf

Started

Started container istio-proxy
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-90d6f5-6cb8d447d7

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-90d6f5-6cb8d447d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-90d6f5: serviceaccount "payload-processing-e2e-inf-b-90d6f5" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-90d6f5-6869fb7566

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-90d6f5-6869fb7566-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-90d6f5: serviceaccount "payload-processing-e2e-inf-b-90d6f5" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-90d6f5-6cb8d447d7

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-90d6f5-6cb8d447d7-hm69v

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-90d6f5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-90d6f5-6cb8d447d7 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-90d6f5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-90d6f5-6869fb7566 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-90d6f5-6869fb7566

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-90d6f5-6869fb7566-qw7rk
(x5)

openshift-ingress

kubelet

e2e-inf-a-362f7a-openshift-default-6ff595f56-ft5p4

Unhealthy

Startup probe failed: Get "http://10.134.0.38:15021/healthz/ready": dial tcp 10.134.0.38:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-inf-b-90d6f5-6cb8d447d7-hm69v

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

kubelet

e2e-inf-a-362f7a-openshift-default-6ff595f56-ft5p4

ProbeError

Startup probe error: Get "http://10.134.0.38:15021/healthz/ready": dial tcp 10.134.0.38:15021: connect: connection refused body:

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-90d6f5-6869fb7566-qw7rk

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-90d6f5-6869fb7566-qw7rk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-90d6f5-6869fb7566-qw7rk

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-90d6f5-6869fb7566-qw7rk

Started

Started container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-autores-3219e3-openshift-default-587759d66d-9zqzf

ProbeError

Startup probe error: Get "http://10.133.0.48:15021/healthz/ready": dial tcp 10.133.0.48:15021: connect: connection refused body:

openshift-ingress

multus

payload-processing-e2e-inf-b-90d6f5-6cb8d447d7-hm69v

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-autores-3219e3-openshift-default-587759d66d-9zqzf

Unhealthy

Startup probe failed: Get "http://10.133.0.48:15021/healthz/ready": dial tcp 10.133.0.48:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-inf-b-90d6f5-6cb8d447d7-hm69v

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-90d6f5-6cb8d447d7-hm69v

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-ait-f722bf59-openshift-default-d8b977858-fcsxd

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-f722bf59-openshift-default-d8b977858-fcsxd

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-ait-f722bf59-openshift-default-d8b977858-fcsxd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ait-f722bf59-openshift-default-d8b977858-fcsxd

ProbeError

Startup probe error: Get "http://10.132.0.40:15021/healthz/ready": dial tcp 10.132.0.40:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-f722bf59-openshift-default-d8b977858-fcsxd

Unhealthy

Startup probe failed: Get "http://10.132.0.40:15021/healthz/ready": dial tcp 10.132.0.40:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ait-f722bf59-79c869485-hdk7v

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f722bf59-7fcc65f7d6-6v88v

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-f722bf59-openshift-default-d8b977858-fcsxd

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-migrate-4408ba1c-gw-openshift-default-7ddf46ddb4

SuccessfulCreate

Created pod: e2e-migrate-4408ba1c-gw-openshift-default-7ddf46ddb4-ws7q9

openshift-ingress

deployment-controller

e2e-migrate-4408ba1c-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-4408ba1c-gw-openshift-default-7ddf46ddb4 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-migrate-4408ba1c-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-4408ba1c-gw

openshift-ingress

multus

e2e-migrate-4408ba1c-gw-openshift-default-7ddf46ddb4-ws7q9

AddedInterface

Add eth0 [10.132.0.44/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-4408ba1c-b9665474b

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-4408ba1c-b9665474b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-4408ba1c: serviceaccount "payload-processing-e2e-migrate-4408ba1c" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-4408ba1c-b9665474b

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-4408ba1c-b9665474b-54zz8

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-4408ba1c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-4408ba1c-b9665474b from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-4408ba1c-b9bd4d94

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-4408ba1c-b9bd4d94-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-4408ba1c: serviceaccount "payload-processing-e2e-migrate-4408ba1c" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-4408ba1c-b9bd4d94

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-4408ba1c-b9bd4d94-jnc4k

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-4408ba1c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-4408ba1c-b9bd4d94 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-4408ba1c-b9bd4d94-jnc4k

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-migrate-4408ba1c-b9665474b-54zz8

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-migrate-4408ba1c-b9bd4d94-jnc4k

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-4408ba1c-b9bd4d94-jnc4k

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-4408ba1c-b9bd4d94-jnc4k

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-inf-b-90d6f5-openshift-default-77b48b5f6d-r9pp6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-90d6f5-openshift-default-77b48b5f6d-r9pp6

Created

Created container: istio-proxy

openshift-ingress

multus

payload-processing-e2e-migrate-4408ba1c-b9665474b-54zz8

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-inf-b-90d6f5-openshift-default-77b48b5f6d-r9pp6

Started

Started container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-migrate-4408ba1c-b9665474b-54zz8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-migrate-4408ba1c-b9665474b-54zz8

Created

Created container: payload-processing
(x6)

openshift-ingress

kubelet

e2e-inf-b-90d6f5-openshift-default-77b48b5f6d-r9pp6

Unhealthy

Startup probe failed: Get "http://10.133.0.53:15021/healthz/ready": dial tcp 10.133.0.53:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-b-90d6f5-openshift-default-77b48b5f6d-r9pp6

ProbeError

Startup probe error: Get "http://10.133.0.53:15021/healthz/ready": dial tcp 10.133.0.53:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-migrate-4408ba1c-gw-openshift-default-7ddf46ddb4-ws7q9

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-4408ba1c-gw-openshift-default-7ddf46ddb4-ws7q9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-4408ba1c-gw-openshift-default-7ddf46ddb4-ws7q9

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-migrate-4408ba1c-gw-openshift-default-7ddf46ddb4-ws7q9

ProbeError

Startup probe error: Get "http://10.132.0.44:15021/healthz/ready": dial tcp 10.132.0.44:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-migrate-4408ba1c-gw-openshift-default-7ddf46ddb4-ws7q9

Unhealthy

Startup probe failed: Get "http://10.132.0.44:15021/healthz/ready": dial tcp 10.132.0.44:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-migrate-4408ba1c-b9665474b-54zz8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-4408ba1c-b9bd4d94-jnc4k

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-migrate-4408ba1c-gw-openshift-default-7ddf46ddb4-ws7q9

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-ait-c0b7dbbd-openshift-default-55f9585ddd

SuccessfulCreate

Created pod: e2e-ait-c0b7dbbd-openshift-default-55f9585ddd-6z62g

openshift-ingress

deployment-controller

e2e-ait-c0b7dbbd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-c0b7dbbd-openshift-default-55f9585ddd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-c0b7dbbd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-c0b7dbbd

openshift-ingress

multus

e2e-ait-c0b7dbbd-openshift-default-55f9585ddd-6z62g

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-c0b7dbbd-666c445f58

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-c0b7dbbd-666c445f58-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-c0b7dbbd: serviceaccount "payload-processing-e2e-ait-c0b7dbbd" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-c0b7dbbd-7dd99f844c

SuccessfulCreate

Created pod: payload-processing-e2e-ait-c0b7dbbd-7dd99f844c-gc24l
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-c0b7dbbd-7dd99f844c

FailedCreate

Error creating: pods "payload-processing-e2e-ait-c0b7dbbd-7dd99f844c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-c0b7dbbd: serviceaccount "payload-processing-e2e-ait-c0b7dbbd" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-c0b7dbbd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-c0b7dbbd-666c445f58 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-c0b7dbbd-666c445f58

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-c0b7dbbd-666c445f58-9b575

openshift-ingress

deployment-controller

payload-processing-e2e-ait-c0b7dbbd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-c0b7dbbd-7dd99f844c from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ait-c0b7dbbd-7dd99f844c-gc24l

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-c0b7dbbd-666c445f58-9b575

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-c0b7dbbd-666c445f58-9b575

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-c0b7dbbd-666c445f58-9b575

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-c0b7dbbd-7dd99f844c-gc24l

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-c0b7dbbd-666c445f58-9b575

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-c0b7dbbd-7dd99f844c-gc24l

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-c0b7dbbd-7dd99f844c-gc24l

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-ait-c0b7dbbd-openshift-default-55f9585ddd-6z62g

Unhealthy

Readiness probe failed: Get "http://10.132.0.47:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ait-c0b7dbbd-openshift-default-55f9585ddd-6z62g

ProbeError

Readiness probe error: Get "http://10.132.0.47:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

payload-processing-e2e-ait-c0b7dbbd-7dd99f844c-gc24l

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-c0b7dbbd-666c445f58-9b575

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ait-c0b7dbbd-openshift-default-55f9585ddd-6z62g

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-c0b7dbbd-openshift-default-55f9585ddd-6z62g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-c0b7dbbd-openshift-default-55f9585ddd-6z62g

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-ait-c0b7dbbd-openshift-default-55f9585ddd-6z62g

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-derive-58b751e1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-58b751e1-openshift-default-67b877b996 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-derive-58b751e1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-58b751e1

openshift-ingress

replicaset-controller

e2e-derive-58b751e1-openshift-default-67b877b996

SuccessfulCreate

Created pod: e2e-derive-58b751e1-openshift-default-67b877b996-zvx8h

openshift-ingress

multus

e2e-derive-58b751e1-openshift-default-67b877b996-zvx8h

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-58b751e1-6f4b5ccd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-58b751e1-6f4b5ccd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-58b751e1: serviceaccount "payload-processing-e2e-derive-58b751e1" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-58b751e1-6f4b5ccd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-58b751e1-6f4b5ccd-7zvfx
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-58b751e1-768ddf86f

FailedCreate

Error creating: pods "payload-processing-e2e-derive-58b751e1-768ddf86f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-58b751e1: serviceaccount "payload-processing-e2e-derive-58b751e1" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-58b751e1-768ddf86f

SuccessfulCreate

Created pod: payload-processing-e2e-derive-58b751e1-768ddf86f-vq98l

openshift-ingress

deployment-controller

payload-processing-e2e-derive-58b751e1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-58b751e1-768ddf86f from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-58b751e1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-58b751e1-6f4b5ccd from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-derive-58b751e1-768ddf86f-vq98l

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-58b751e1-6f4b5ccd-7zvfx

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-58b751e1-6f4b5ccd-7zvfx

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-58b751e1-6f4b5ccd-7zvfx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-derive-58b751e1-6f4b5ccd-7zvfx

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-58b751e1-768ddf86f-vq98l

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-derive-58b751e1-768ddf86f-vq98l

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-58b751e1-768ddf86f-vq98l

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-derive-58b751e1-openshift-default-67b877b996-zvx8h

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-58b751e1-openshift-default-67b877b996-zvx8h

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-58b751e1-openshift-default-67b877b996-zvx8h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-derive-58b751e1-openshift-default-67b877b996-zvx8h

Unhealthy

Startup probe failed: Get "http://10.132.0.50:15021/healthz/ready": dial tcp 10.132.0.50:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-derive-58b751e1-openshift-default-67b877b996-zvx8h

ProbeError

Startup probe error: Get "http://10.132.0.50:15021/healthz/ready": dial tcp 10.132.0.50:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-derive-58b751e1-openshift-default-67b877b996-zvx8h

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-58b751e1-6f4b5ccd-7zvfx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-58b751e1-768ddf86f-vq98l

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-derive-58b751e1-openshift-default-67b877b996-zvx8h

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-derive-58b751e1-openshift-default-67b877b996-zvx8h

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-autores-3219e3-7bd986c4ff-rkqqx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-3219e3-ffbbfbb86-xdblq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-autores-3219e3-openshift-default-587759d66d-9zqzf

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-explicit-87d086-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-87d086-openshift-default-7ff69c69b from 0 to 1

openshift-ingress

replicaset-controller

e2e-explicit-87d086-openshift-default-7ff69c69b

SuccessfulCreate

Created pod: e2e-explicit-87d086-openshift-default-7ff69c69b-4dwsm

openshift-ingress

gateway_labeler_controller

e2e-explicit-87d086

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-87d086

openshift-ingress

multus

e2e-explicit-87d086-openshift-default-7ff69c69b-4dwsm

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-autores-3219e3-openshift-default-587759d66d-9zqzf

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-autores-3219e3-openshift-default-587759d66d-9zqzf

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-87d086-6598797bf4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-87d086-6598797bf4-ccnqx
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-87d086-6598797bf4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-87d086-6598797bf4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-87d086: serviceaccount "payload-processing-e2e-explicit-87d086" not found

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-87d086

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-87d086-76c8ddffb5 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-87d086

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-87d086-6598797bf4 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-87d086-76c8ddffb5

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-87d086-76c8ddffb5-5rrbl
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-87d086-76c8ddffb5

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-87d086-76c8ddffb5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-87d086: serviceaccount "payload-processing-e2e-explicit-87d086" not found

openshift-ingress

kubelet

payload-processing-e2e-explicit-87d086-76c8ddffb5-5rrbl

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-87d086-76c8ddffb5-5rrbl

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-explicit-87d086-6598797bf4-ccnqx

AddedInterface

Add eth0 [10.133.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-87d086-6598797bf4-ccnqx

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-87d086-6598797bf4-ccnqx

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-87d086-76c8ddffb5-5rrbl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-87d086-6598797bf4-ccnqx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-explicit-87d086-76c8ddffb5-5rrbl

AddedInterface

Add eth0 [10.133.0.65/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-mt-577852b1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-577852b1

openshift-ingress

deployment-controller

e2e-mt-577852b1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-577852b1-openshift-default-6c6fd5f5b4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-577852b1-openshift-default-6c6fd5f5b4

SuccessfulCreate

Created pod: e2e-mt-577852b1-openshift-default-6c6fd5f5b4-zb6j6

openshift-ingress

multus

e2e-mt-577852b1-openshift-default-6c6fd5f5b4-zb6j6

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-explicit-87d086-openshift-default-7ff69c69b-4dwsm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-87d086-openshift-default-7ff69c69b-4dwsm

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-87d086-openshift-default-7ff69c69b-4dwsm

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-explicit-87d086-openshift-default-7ff69c69b-4dwsm

Unhealthy

Startup probe failed: Get "http://10.132.0.55:15021/healthz/ready": dial tcp 10.132.0.55:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-explicit-87d086-openshift-default-7ff69c69b-4dwsm

ProbeError

Startup probe error: Get "http://10.132.0.55:15021/healthz/ready": dial tcp 10.132.0.55:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-processing-e2e-mt-577852b1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-577852b1-6585fb4f97 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-577852b1-c559688c4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-577852b1-c559688c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-577852b1: serviceaccount "payload-processing-e2e-mt-577852b1" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-577852b1-6585fb4f97

SuccessfulCreate

Created pod: payload-processing-e2e-mt-577852b1-6585fb4f97-rhqsc
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-577852b1-6585fb4f97

FailedCreate

Error creating: pods "payload-processing-e2e-mt-577852b1-6585fb4f97-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-577852b1: serviceaccount "payload-processing-e2e-mt-577852b1" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-577852b1-c559688c4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-577852b1-c559688c4-4vb94

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-577852b1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-577852b1-c559688c4 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-577852b1-c559688c4-4vb94

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-577852b1-c559688c4-4vb94

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-577852b1-6585fb4f97-rhqsc

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-mt-577852b1-6585fb4f97-rhqsc

AddedInterface

Add eth0 [10.133.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-577852b1-6585fb4f97-rhqsc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-577852b1-6585fb4f97-rhqsc

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-577852b1-c559688c4-4vb94

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-577852b1-c559688c4-4vb94

AddedInterface

Add eth0 [10.133.0.66/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-mt-577852b1-openshift-default-6c6fd5f5b4-zb6j6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-577852b1-openshift-default-6c6fd5f5b4-zb6j6

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-577852b1-openshift-default-6c6fd5f5b4-zb6j6

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-577852b1-openshift-default-6c6fd5f5b4-zb6j6

ProbeError

Startup probe error: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-577852b1-openshift-default-6c6fd5f5b4-zb6j6

Unhealthy

Startup probe failed: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-577852b1-c559688c4-4vb94

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-577852b1-6585fb4f97-rhqsc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-577852b1-openshift-default-6c6fd5f5b4-zb6j6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-explicit-87d086-76c8ddffb5-5rrbl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-87d086-6598797bf4-ccnqx

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-shared-a-w2-c4e39b-openshift-default-65d76db66b

SuccessfulCreate

Created pod: e2e-shared-a-w2-c4e39b-openshift-default-65d76db66b-fxxph

openshift-ingress

deployment-controller

e2e-shared-a-w2-c4e39b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-c4e39b-openshift-default-65d76db66b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-c4e39b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-c4e39b

openshift-ingress

multus

e2e-shared-a-w2-c4e39b-openshift-default-65d76db66b-fxxph

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-explicit-87d086-openshift-default-7ff69c69b-4dwsm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-noten-cd2cc1-openshift-default-5d8b876f7b-fxfv9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

multus

e2e-noten-cd2cc1-openshift-default-5d8b876f7b-fxfv9

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-noten-cd2cc1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-cd2cc1

openshift-ingress

kubelet

e2e-noten-cd2cc1-openshift-default-5d8b876f7b-fxfv9

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-noten-cd2cc1-openshift-default-5d8b876f7b-fxfv9

Started

Started container istio-proxy

openshift-ingress

replicaset-controller

e2e-noten-cd2cc1-openshift-default-5d8b876f7b

SuccessfulCreate

Created pod: e2e-noten-cd2cc1-openshift-default-5d8b876f7b-fxfv9

openshift-ingress

deployment-controller

e2e-noten-cd2cc1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-cd2cc1-openshift-default-5d8b876f7b from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-c4e39b-6c76f7f8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-c4e39b-6c76f7f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-c4e39b: serviceaccount "payload-processing-e2e-shared-a-w2-c4e39b" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-c4e39b-6c76f7f8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-c4e39b-6c76f7f8-9t6nr

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-c4e39b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-c4e39b-6c76f7f8 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-c4e39b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-c4e39b-7c845f5685 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-c4e39b-7c845f5685

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-c4e39b-7c845f5685-8lr4w
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-c4e39b-7c845f5685

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-c4e39b-7c845f5685-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-c4e39b: serviceaccount "payload-processing-e2e-shared-a-w2-c4e39b" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-c4e39b-6c76f7f8-9t6nr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-c4e39b-6c76f7f8-9t6nr

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-c4e39b-7c845f5685-8lr4w

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-c4e39b-7c845f5685-8lr4w

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-c4e39b-7c845f5685-8lr4w

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-c4e39b-7c845f5685-8lr4w

AddedInterface

Add eth0 [10.133.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-c4e39b-6c76f7f8-9t6nr

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-c4e39b-6c76f7f8-9t6nr

Created

Created container: payload-pre-processing

openshift-ingress

GatewayAuthBootstrap

e2e-shared-b-w2-c0e28e

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-shared-b-w2-c0e28e-authn-ssl: envoyfilters.networking.istio.io "e2e-shared-b-w2-c0e28e-authn-ssl" already exists

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-c0e28e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-c0e28e

openshift-ingress

deployment-controller

e2e-shared-b-w2-c0e28e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-c0e28e-openshift-default-56897975d6 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w2-c0e28e-openshift-default-56897975d6

SuccessfulCreate

Created pod: e2e-shared-b-w2-c0e28e-openshift-default-56897975d6-bfw55

openshift-ingress

multus

e2e-shared-b-w2-c0e28e-openshift-default-56897975d6-bfw55

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-c0e28e-7b995c7458-zrvkl

AddedInterface

Add eth0 [10.133.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-c0e28e-f4c8fc48f-krfwt

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-c0e28e-f4c8fc48f-krfwt

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-c0e28e-f4c8fc48f-krfwt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-c0e28e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-c0e28e-7b995c7458 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-c0e28e-f4c8fc48f-krfwt

AddedInterface

Add eth0 [10.133.0.75/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-c0e28e-7b995c7458

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-c0e28e-7b995c7458-zrvkl
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-c0e28e-7b995c7458

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-c0e28e-7b995c7458-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-c0e28e: serviceaccount "payload-processing-e2e-shared-b-w2-c0e28e" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-c0e28e-7b995c7458-zrvkl

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-c0e28e-7b995c7458-zrvkl

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-c0e28e-7b995c7458-zrvkl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-c0e28e-f4c8fc48f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-c0e28e-f4c8fc48f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-c0e28e: serviceaccount "payload-processing-e2e-shared-b-w2-c0e28e" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-c0e28e-f4c8fc48f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-c0e28e-f4c8fc48f-krfwt

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-c0e28e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-c0e28e-f4c8fc48f from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-362f7a-849fb7b974-tplmj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-362f7a-6b475b4b95-xwprc

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-c4e39b-openshift-default-65d76db66b-fxxph

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-c4e39b-openshift-default-65d76db66b-fxxph

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-c4e39b-openshift-default-65d76db66b-fxxph

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-362f7a-openshift-default-6ff595f56-ft5p4

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-c4e39b-openshift-default-65d76db66b-fxxph

Unhealthy

Startup probe failed: Get "http://10.134.0.54:15021/healthz/ready": dial tcp 10.134.0.54:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-c4e39b-openshift-default-65d76db66b-fxxph

ProbeError

Startup probe error: Get "http://10.134.0.54:15021/healthz/ready": dial tcp 10.134.0.54:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-c0e28e-openshift-default-56897975d6-bfw55

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-c0e28e-openshift-default-56897975d6-bfw55

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-c0e28e-openshift-default-56897975d6-bfw55

Created

Created container: istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-90d6f5-6869fb7566-qw7rk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-90d6f5-6cb8d447d7-hm69v

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-mt-a843ae03

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-a843ae03

openshift-ingress

replicaset-controller

e2e-mt-a843ae03-openshift-default-7c48d8b9cb

SuccessfulCreate

Created pod: e2e-mt-a843ae03-openshift-default-7c48d8b9cb-lpqb9

openshift-ingress

deployment-controller

e2e-mt-a843ae03-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-a843ae03-openshift-default-7c48d8b9cb from 0 to 1

openshift-ingress

multus

e2e-mt-a843ae03-openshift-default-7c48d8b9cb-lpqb9

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-c0e28e-openshift-default-56897975d6-bfw55

ProbeError

Startup probe error: Get "http://10.132.0.60:15021/healthz/ready": dial tcp 10.132.0.60:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-c0e28e-openshift-default-56897975d6-bfw55

Unhealthy

Startup probe failed: Get "http://10.132.0.60:15021/healthz/ready": dial tcp 10.132.0.60:15021: connect: connection refused
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-a843ae03-6d7c45b9c4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-a843ae03-6d7c45b9c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-a843ae03: serviceaccount "payload-processing-e2e-mt-a843ae03" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-a843ae03

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-a843ae03-5887db69b9 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-a843ae03

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-a843ae03-6d7c45b9c4 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-a843ae03-5887db69b9

FailedCreate

Error creating: pods "payload-processing-e2e-mt-a843ae03-5887db69b9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-a843ae03: serviceaccount "payload-processing-e2e-mt-a843ae03" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-a843ae03-6d7c45b9c4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-a843ae03-6d7c45b9c4-6vwhp

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-a843ae03-5887db69b9

SuccessfulCreate

Created pod: payload-processing-e2e-mt-a843ae03-5887db69b9-jw82h

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-a843ae03-6d7c45b9c4-6vwhp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-a843ae03-5887db69b9-jw82h

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-a843ae03-6d7c45b9c4-6vwhp

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-a843ae03-6d7c45b9c4-6vwhp

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-a843ae03-6d7c45b9c4-6vwhp

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-a843ae03-5887db69b9-jw82h

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-a843ae03-5887db69b9-jw82h

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-a843ae03-5887db69b9-jw82h

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-a843ae03-openshift-default-7c48d8b9cb-lpqb9

ProbeError

Readiness probe error: Get "http://10.134.0.58:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-mt-a843ae03-openshift-default-7c48d8b9cb-lpqb9

Unhealthy

Readiness probe failed: Get "http://10.134.0.58:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-mt-a843ae03-openshift-default-7c48d8b9cb-lpqb9

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-a843ae03-openshift-default-7c48d8b9cb-lpqb9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-a843ae03-openshift-default-7c48d8b9cb-lpqb9

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-mt-a843ae03-openshift-default-7c48d8b9cb-lpqb9

ProbeError

Startup probe error: Get "http://10.134.0.58:15021/healthz/ready": dial tcp 10.134.0.58:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-a843ae03-openshift-default-7c48d8b9cb-lpqb9

Unhealthy

Startup probe failed: Get "http://10.134.0.58:15021/healthz/ready": dial tcp 10.134.0.58:15021: connect: connection refused

openshift-ingress

kubelet

e2e-inf-b-90d6f5-openshift-default-77b48b5f6d-r9pp6

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-48898f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-48898f

openshift-ingress

deployment-controller

e2e-shared-a-w3-48898f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-48898f-openshift-default-c6c9586f8 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w3-48898f-openshift-default-c6c9586f8

SuccessfulCreate

Created pod: e2e-shared-a-w3-48898f-openshift-default-c6c9586f8-4kxk5

openshift-ingress

multus

e2e-shared-a-w3-48898f-openshift-default-c6c9586f8-4kxk5

AddedInterface

Add eth0 [10.133.0.81/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-48898f-797669c7bf

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-48898f-797669c7bf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-48898f: serviceaccount "payload-processing-e2e-shared-a-w3-48898f" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-48898f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-48898f-f4db79966 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-48898f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-48898f-797669c7bf from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-48898f-f4db79966

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-48898f-f4db79966-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-48898f: serviceaccount "payload-processing-e2e-shared-a-w3-48898f" not found

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-48898f-797669c7bf-ql6l2

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-48898f-797669c7bf-ql6l2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-48898f-f4db79966-rsv9j

AddedInterface

Add eth0 [10.133.0.82/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-48898f-f4db79966-rsv9j

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-48898f-797669c7bf-ql6l2

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-48898f-797669c7bf-ql6l2

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-48898f-f4db79966-rsv9j

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-48898f-797669c7bf

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-48898f-797669c7bf-ql6l2

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-48898f-f4db79966

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-48898f-f4db79966-rsv9j

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-48898f-f4db79966-rsv9j

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-noten-cd2cc1-openshift-default-5d8b876f7b-fxfv9

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-48898f-openshift-default-c6c9586f8-4kxk5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-48898f-openshift-default-c6c9586f8-4kxk5

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-48898f-openshift-default-c6c9586f8-4kxk5

Started

Started container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-b-w3-928943-openshift-default-58b4db468d

SuccessfulCreate

Created pod: e2e-shared-b-w3-928943-openshift-default-58b4db468d-6xh78

openshift-ingress

deployment-controller

e2e-shared-b-w3-928943-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-928943-openshift-default-58b4db468d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-928943

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-928943

openshift-ingress

multus

e2e-shared-b-w3-928943-openshift-default-58b4db468d-6xh78

AddedInterface

Add eth0 [10.132.0.70/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-48898f-openshift-default-c6c9586f8-4kxk5

ProbeError

Startup probe error: Get "http://10.133.0.81:15021/healthz/ready": dial tcp 10.133.0.81:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-48898f-openshift-default-c6c9586f8-4kxk5

Unhealthy

Startup probe failed: Get "http://10.133.0.81:15021/healthz/ready": dial tcp 10.133.0.81:15021: connect: connection refused

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-928943-5f8c7db995

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-928943-5f8c7db995-snll6

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-928943-656956f754-zj6v5

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-928943-656956f754

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-928943-656956f754-zj6v5
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-928943-656956f754

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-928943-656956f754-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-928943: serviceaccount "payload-processing-e2e-shared-b-w3-928943" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-928943-656956f754-zj6v5

Started

Started container payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-928943-5f8c7db995

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-928943-5f8c7db995-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-928943: serviceaccount "payload-processing-e2e-shared-b-w3-928943" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-928943-5f8c7db995-snll6

Started

Started container payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-928943

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-928943-656956f754 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-928943-656956f754-zj6v5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-928943-656956f754-zj6v5

AddedInterface

Add eth0 [10.133.0.83/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-928943-5f8c7db995-snll6

AddedInterface

Add eth0 [10.133.0.84/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-928943-5f8c7db995-snll6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-928943-5f8c7db995-snll6

Created

Created container: payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-928943

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-928943-5f8c7db995 from 0 to 1

openshift-ingress

kubelet

e2e-shared-b-w3-928943-openshift-default-58b4db468d-6xh78

ProbeError

Readiness probe error: Get "http://10.132.0.70:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-b-w3-928943-openshift-default-58b4db468d-6xh78

Unhealthy

Readiness probe failed: Get "http://10.132.0.70:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-928943-openshift-default-58b4db468d-6xh78

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-928943-openshift-default-58b4db468d-6xh78

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-928943-openshift-default-58b4db468d-6xh78

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-928943-openshift-default-58b4db468d-6xh78

ProbeError

Startup probe error: Get "http://10.132.0.70:15021/healthz/ready": dial tcp 10.132.0.70:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-928943-openshift-default-58b4db468d-6xh78

Unhealthy

Startup probe failed: Get "http://10.132.0.70:15021/healthz/ready": dial tcp 10.132.0.70:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-mt-a843ae03-5887db69b9-jw82h

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-a843ae03-6d7c45b9c4-6vwhp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-a843ae03-openshift-default-7c48d8b9cb-lpqb9

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-api-a-54b7f9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-54b7f9-openshift-default-77688d4cd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-54b7f9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-54b7f9

openshift-ingress

replicaset-controller

e2e-api-a-54b7f9-openshift-default-77688d4cd

SuccessfulCreate

Created pod: e2e-api-a-54b7f9-openshift-default-77688d4cd-hwv8m

openshift-ingress

multus

e2e-api-a-54b7f9-openshift-default-77688d4cd-hwv8m

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-54b7f9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-54b7f9-74df86bfc from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-54b7f9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-54b7f9-5b4bdccd54 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-54b7f9-5b4bdccd54

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-54b7f9-5b4bdccd54-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-54b7f9: serviceaccount "payload-processing-e2e-api-a-54b7f9" not found

openshift-ingress

multus

payload-processing-e2e-api-a-54b7f9-74df86bfc-4cphh

AddedInterface

Add eth0 [10.133.0.87/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-54b7f9-74df86bfc-4cphh

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-54b7f9-5b4bdccd54

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-54b7f9-5b4bdccd54-bs9vf

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-54b7f9-5b4bdccd54-bs9vf

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-54b7f9-5b4bdccd54-bs9vf

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-54b7f9-74df86bfc-4cphh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-a-54b7f9-5b4bdccd54-bs9vf

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-54b7f9-5b4bdccd54-bs9vf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-a-54b7f9-74df86bfc-4cphh

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-54b7f9-74df86bfc

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-54b7f9-74df86bfc-4cphh
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-54b7f9-74df86bfc

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-54b7f9-74df86bfc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-54b7f9: serviceaccount "payload-processing-e2e-api-a-54b7f9" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-e7ca56-6954cfc9f7-ld4cv

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-worker-w0-e7ca56

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-worker-w0-e7ca56: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-worker-w0-e7ca56": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-worker-w0-e7ca56, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: fd754aba-657b-45e8-89b3-68fb4452b9d0, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-e7ca56-69c6dcc98b-lzc2f

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-api-a-54b7f9-openshift-default-77688d4cd-hwv8m

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-54b7f9-openshift-default-77688d4cd-hwv8m

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-54b7f9-openshift-default-77688d4cd-hwv8m

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-a-54b7f9-openshift-default-77688d4cd-hwv8m

ProbeError

Startup probe error: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused body:

openshift-ingress

multus

e2e-api-b-14a808-openshift-default-767dc55cdb-52h28

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-api-b-14a808-openshift-default-767dc55cdb

SuccessfulCreate

Created pod: e2e-api-b-14a808-openshift-default-767dc55cdb-52h28

openshift-ingress

deployment-controller

e2e-api-b-14a808-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-14a808-openshift-default-767dc55cdb from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-14a808

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-14a808
(x5)

openshift-ingress

kubelet

e2e-api-a-54b7f9-openshift-default-77688d4cd-hwv8m

Unhealthy

Startup probe failed: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w0-e7ca56-openshift-default-78999d97db-5n8h9

Killing

Stopping container istio-proxy
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-14a808-55b84f5486

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-14a808-55b84f5486-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-14a808: serviceaccount "payload-processing-e2e-api-b-14a808" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-14a808

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-14a808-55b84f5486 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-14a808

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-14a808-7b686594df from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-14a808-7b686594df

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-14a808-7b686594df-tvg2r
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-14a808-7b686594df

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-14a808-7b686594df-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-14a808: serviceaccount "payload-processing-e2e-api-b-14a808" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-14a808-55b84f5486

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-14a808-55b84f5486-24zv5

openshift-ingress

multus

payload-processing-e2e-api-b-14a808-7b686594df-tvg2r

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-14a808-7b686594df-tvg2r

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-b-14a808-7b686594df-tvg2r

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-14a808-7b686594df-tvg2r

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-b-14a808-55b84f5486-24zv5

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-14a808-55b84f5486-24zv5

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-14a808-55b84f5486-24zv5

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-14a808-55b84f5486-24zv5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-14a808-openshift-default-767dc55cdb-52h28

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-14a808-openshift-default-767dc55cdb-52h28

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-14a808-openshift-default-767dc55cdb-52h28

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-api-b-14a808-openshift-default-767dc55cdb-52h28

Unhealthy

Startup probe failed: Get "http://10.134.0.67:15021/healthz/ready": dial tcp 10.134.0.67:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-b-14a808-openshift-default-767dc55cdb-52h28

ProbeError

Startup probe error: Get "http://10.134.0.67:15021/healthz/ready": dial tcp 10.134.0.67:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-api-a-54b7f9-74df86bfc-4cphh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-54b7f9-5b4bdccd54-bs9vf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-a-54b7f9-openshift-default-77688d4cd-hwv8m

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-54b7f9-openshift-default-77688d4cd-hwv8m

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-a-54b7f9-openshift-default-77688d4cd-hwv8m

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-837632-77765b66db-st47n

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-837632-5fddcb76c7-njvt4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w4-837632-openshift-default-7588449dc8-vh7f7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-837632-openshift-default-7588449dc8-vh7f7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w4-837632-openshift-default-7588449dc8-vh7f7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-api-b-14a808-7b686594df-tvg2r

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-14a808-55b84f5486-24zv5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-14a808-openshift-default-767dc55cdb-52h28

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-c4e39b-6c76f7f8-9t6nr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-c4e39b-7c845f5685-8lr4w

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w2-c4e39b-openshift-default-65d76db66b-fxxph

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-c4e39b-openshift-default-65d76db66b-fxxph

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w2-c4e39b-openshift-default-65d76db66b-fxxph

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-c0e28e-f4c8fc48f-krfwt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-c0e28e-7b995c7458-zrvkl

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-b-w2-c0e28e

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-b-w2-c0e28e: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-b-w2-c0e28e": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-b-w2-c0e28e, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 752e3650-93ef-49d8-a18f-1aa20cf0aab3, UID in object meta:

openshift-ingress

kubelet

e2e-shared-b-w2-c0e28e-openshift-default-56897975d6-bfw55

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-177c81

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-177c81

openshift-ingress

deployment-controller

e2e-ipp-a-177c81-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-177c81-openshift-default-69c9bdcf6 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-177c81-openshift-default-69c9bdcf6

SuccessfulCreate

Created pod: e2e-ipp-a-177c81-openshift-default-69c9bdcf6-6gl8l

openshift-ingress

multus

e2e-ipp-a-177c81-openshift-default-69c9bdcf6-6gl8l

AddedInterface

Add eth0 [10.134.0.72/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-177c81

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-177c81-576f87d755 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-177c81-567fbdcbd6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-177c81-567fbdcbd6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-177c81: serviceaccount "payload-processing-e2e-ipp-a-177c81" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-177c81-576f87d755

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-177c81-576f87d755-l27ww
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-177c81-576f87d755

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-177c81-576f87d755-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-177c81: serviceaccount "payload-processing-e2e-ipp-a-177c81" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-177c81

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-177c81-567fbdcbd6 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-177c81-567fbdcbd6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-177c81-567fbdcbd6-kts6j

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-177c81-576f87d755-l27ww

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-177c81-567fbdcbd6-kts6j

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-177c81-567fbdcbd6-kts6j

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-177c81-576f87d755-l27ww

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-177c81-576f87d755-l27ww

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-177c81-567fbdcbd6-kts6j

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-177c81-567fbdcbd6-kts6j

AddedInterface

Add eth0 [10.134.0.74/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-a-177c81-576f87d755-l27ww

AddedInterface

Add eth0 [10.133.0.94/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-177c81-openshift-default-69c9bdcf6-6gl8l

ProbeError

Readiness probe error: Get "http://10.134.0.72:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-a-177c81-openshift-default-69c9bdcf6-6gl8l

Unhealthy

Readiness probe failed: Get "http://10.134.0.72:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ipp-a-177c81-openshift-default-69c9bdcf6-6gl8l

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-177c81-openshift-default-69c9bdcf6-6gl8l

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-177c81-openshift-default-69c9bdcf6-6gl8l

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-ipp-a-177c81-openshift-default-69c9bdcf6-6gl8l

ProbeError

Startup probe error: Get "http://10.134.0.72:15021/healthz/ready": dial tcp 10.134.0.72:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-a-177c81-openshift-default-69c9bdcf6-6gl8l

Unhealthy

Startup probe failed: Get "http://10.134.0.72:15021/healthz/ready": dial tcp 10.134.0.72:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-ipp-b-4ee29a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-4ee29a-openshift-default-7c9dfbccd4 from 0 to 1

openshift-ingress

multus

e2e-ipp-b-4ee29a-openshift-default-7c9dfbccd4-n7b7r

AddedInterface

Add eth0 [10.134.0.75/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-4ee29a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-4ee29a

openshift-ingress

replicaset-controller

e2e-ipp-b-4ee29a-openshift-default-7c9dfbccd4

SuccessfulCreate

Created pod: e2e-ipp-b-4ee29a-openshift-default-7c9dfbccd4-n7b7r

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-4ee29a-5c48cbf4b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-4ee29a-5c48cbf4b-dc75t
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-4ee29a-5c48cbf4b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-4ee29a-5c48cbf4b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-4ee29a: serviceaccount "payload-processing-e2e-ipp-b-4ee29a" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-4ee29a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-4ee29a-5c48cbf4b from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-4ee29a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-4ee29a-68f45bf967 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-4ee29a-68f45bf967

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-4ee29a-68f45bf967-z6lhf
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-4ee29a-68f45bf967

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-4ee29a-68f45bf967-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-4ee29a: serviceaccount "payload-processing-e2e-ipp-b-4ee29a" not found

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-4ee29a-5c48cbf4b-dc75t

AddedInterface

Add eth0 [10.134.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-4ee29a-68f45bf967-z6lhf

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-4ee29a-68f45bf967-z6lhf

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-4ee29a-5c48cbf4b-dc75t

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-4ee29a-5c48cbf4b-dc75t

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-4ee29a-5c48cbf4b-dc75t

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-4ee29a-68f45bf967-z6lhf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-b-4ee29a-68f45bf967-z6lhf

AddedInterface

Add eth0 [10.133.0.95/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-b-4ee29a-openshift-default-7c9dfbccd4-n7b7r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-4ee29a-openshift-default-7c9dfbccd4-n7b7r

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-4ee29a-openshift-default-7c9dfbccd4-n7b7r

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-b-4ee29a-openshift-default-7c9dfbccd4-n7b7r

ProbeError

Startup probe error: Get "http://10.134.0.75:15021/healthz/ready": dial tcp 10.134.0.75:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-b-4ee29a-openshift-default-7c9dfbccd4-n7b7r

Unhealthy

Startup probe failed: Get "http://10.134.0.75:15021/healthz/ready": dial tcp 10.134.0.75:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-e04dee

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-e04dee

openshift-ingress

multus

e2e-ipp-cleanup-e04dee-openshift-default-6b5c749998-xp6mr

AddedInterface

Add eth0 [10.132.0.84/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-e04dee-openshift-default-6b5c749998

SuccessfulCreate

Created pod: e2e-ipp-cleanup-e04dee-openshift-default-6b5c749998-xp6mr

openshift-ingress

deployment-controller

e2e-ipp-cleanup-e04dee-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-e04dee-openshift-default-6b5c749998 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-e04dee-7b7d4886b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-e04dee-7b7d4886b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-e04dee: serviceaccount "payload-processing-e2e-ipp-cleanup-e04dee" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-e04dee-546cb95c69

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-e04dee-546cb95c69-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-e04dee: serviceaccount "payload-processing-e2e-ipp-cleanup-e04dee" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-e04dee-546cb95c69

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-e04dee-546cb95c69-pwbwp

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-e04dee

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-e04dee-7b7d4886b from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-e04dee

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-e04dee-546cb95c69 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-e04dee-7b7d4886b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-e04dee-7b7d4886b-2srmc

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-e04dee-7b7d4886b-2srmc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-e04dee-7b7d4886b-2srmc

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-e04dee-7b7d4886b-2srmc

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-e04dee-546cb95c69-pwbwp

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-e04dee-546cb95c69-pwbwp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-e04dee-7b7d4886b-2srmc

AddedInterface

Add eth0 [10.133.0.96/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-e04dee-546cb95c69-pwbwp

AddedInterface

Add eth0 [10.134.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-e04dee-546cb95c69-pwbwp

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-e04dee-openshift-default-6b5c749998-xp6mr

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-e04dee-openshift-default-6b5c749998-xp6mr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-e04dee-openshift-default-6b5c749998-xp6mr

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-e04dee-openshift-default-6b5c749998-xp6mr

ProbeError

Startup probe error: Get "http://10.132.0.84:15021/healthz/ready": dial tcp 10.132.0.84:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-e04dee-openshift-default-6b5c749998-xp6mr

Unhealthy

Startup probe failed: Get "http://10.132.0.84:15021/healthz/ready": dial tcp 10.132.0.84:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-e04dee-7b7d4886b-2srmc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-e04dee-546cb95c69-pwbwp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-e04dee-openshift-default-6b5c749998-xp6mr

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-177c81-576f87d755-l27ww

FailedMount

MountVolume.SetUp failed for volume "plugins-config-volume" : configmap "payload-processing-plugins-e2e-ipp-a-177c81" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-177c81-576f87d755-l27ww

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-177c81-567fbdcbd6-kts6j

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-177c81-openshift-default-69c9bdcf6-6gl8l

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-177c81-openshift-default-69c9bdcf6-6gl8l

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-a-177c81-openshift-default-69c9bdcf6-6gl8l

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-4ee29a-5c48cbf4b-dc75t

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-b-4ee29a

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-b-4ee29a: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-b-4ee29a": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-b-4ee29a, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 079ff374-2f09-453f-be6e-ac01142bf9bb, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-4ee29a-68f45bf967-z6lhf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-4ee29a-openshift-default-7c9dfbccd4-n7b7r

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-48898f-797669c7bf-ql6l2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-48898f-f4db79966-rsv9j

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w3-48898f-openshift-default-c6c9586f8-4kxk5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-48898f-openshift-default-c6c9586f8-4kxk5

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w3-48898f-openshift-default-c6c9586f8-4kxk5

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-928943-5f8c7db995-snll6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-928943-656956f754-zj6v5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w3-928943-openshift-default-58b4db468d-6xh78

Killing

Stopping container istio-proxy