Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-cec446-5cb9c958f4-lxq9r

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-cec446-5cb9c958f4-lxq9r to ip-10-0-143-184.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-48a4b5-74698f9fc7-tkgjp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-48a4b5-74698f9fc7-tkgjp to ip-10-0-143-184.ec2.internal

openshift-ingress

payload-processing-e2e-derive-46865726-dcb6f7d6f-zb5jh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-46865726-dcb6f7d6f-zb5jh to ip-10-0-143-184.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-7dd976de-7649848fdb-gp9q5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-7dd976de-7649848fdb-gp9q5 to ip-10-0-143-184.ec2.internal

openshift-ingress

e2e-mt-66998bbc-openshift-default-6569645764-gczhs

Scheduled

Successfully assigned openshift-ingress/e2e-mt-66998bbc-openshift-default-6569645764-gczhs to ip-10-0-140-64.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-d9d46f-75994f9c-fvc9v

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-d9d46f-75994f9c-fvc9v to ip-10-0-143-184.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-n4gxw

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-n4gxw to ip-10-0-133-14.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-7dd976de-566c5bffc8-8f9ws

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-7dd976de-566c5bffc8-8f9ws to ip-10-0-143-184.ec2.internal

openshift-ingress

e2e-ait-29f90b97-openshift-default-5d887486bd-2ssz2

Scheduled

Successfully assigned openshift-ingress/e2e-ait-29f90b97-openshift-default-5d887486bd-2ssz2 to ip-10-0-140-64.ec2.internal

openshift-ingress

kube-auth-proxy-74c76cbcf8-f2jsh

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-74c76cbcf8-f2jsh to ip-10-0-133-14.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-61f3ac-77d5c57fc5-pvjfx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-61f3ac-77d5c57fc5-pvjfx to ip-10-0-143-184.ec2.internal

openshift-ingress

e2e-mt-4b62745d-openshift-default-d99f9d5b4-w6hh5

Scheduled

Successfully assigned openshift-ingress/e2e-mt-4b62745d-openshift-default-d99f9d5b4-w6hh5 to ip-10-0-133-14.ec2.internal

openshift-ingress

kube-auth-proxy-74c76cbcf8-6mjdg

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-74c76cbcf8-6mjdg to ip-10-0-143-184.ec2.internal

openshift-ingress

e2e-noten-ecd628-openshift-default-5bc8c5cb84-47rrf

Scheduled

Successfully assigned openshift-ingress/e2e-noten-ecd628-openshift-default-5bc8c5cb84-47rrf to ip-10-0-140-64.ec2.internal

openshift-ingress

e2e-migrate-7dd976de-gw-openshift-default-7cbbc5cd8-gf2gj

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-7dd976de-gw-openshift-default-7cbbc5cd8-gf2gj to ip-10-0-140-64.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-d850e3-685859947d-v2jln

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-d850e3-685859947d-v2jln to ip-10-0-133-14.ec2.internal

openshift-ingress

payload-processing-e2e-mt-4b62745d-69fc6f6f5c-thkhg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-4b62745d-69fc6f6f5c-thkhg to ip-10-0-133-14.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-e171e4-8dd49c65d-srsv2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-e171e4-8dd49c65d-srsv2 to ip-10-0-133-14.ec2.internal

openshift-ingress

payload-processing-e2e-mt-66998bbc-7fccb85889-4tv98

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-66998bbc-7fccb85889-4tv98 to ip-10-0-143-184.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-bzs86

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-bzs86 to ip-10-0-140-64.ec2.internal

openshift-ingress

e2e-ait-73e112cd-openshift-default-644d6c49cb-4vxg6

Scheduled

Successfully assigned openshift-ingress/e2e-ait-73e112cd-openshift-default-644d6c49cb-4vxg6 to ip-10-0-140-64.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-8b6928-586675ddf9-mfhcx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-8b6928-586675ddf9-mfhcx to ip-10-0-143-184.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-v8mm4

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-v8mm4 to ip-10-0-143-184.ec2.internal

openshift-ingress

e2e-ipp-cleanup-d9d46f-openshift-default-589755b94b-6ffsh

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-d9d46f-openshift-default-589755b94b-6ffsh to ip-10-0-140-64.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-4b62745d-7f49c69494-l4x5n

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-4b62745d-7f49c69494-l4x5n to ip-10-0-143-184.ec2.internal

openshift-ingress

payload-processing-e2e-autores-4faf97-5c77597d99-df92p

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-4faf97-5c77597d99-df92p to ip-10-0-143-184.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-d850e3-64c6f78799-rkl29

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-d850e3-64c6f78799-rkl29 to ip-10-0-143-184.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-e171e4-68c7fd9bf-2nllk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-e171e4-68c7fd9bf-2nllk to ip-10-0-143-184.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-8c2e20-69b657c959-6cf22

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-8c2e20-69b657c959-6cf22 to ip-10-0-143-184.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-e7c0ff-6c9d7d5799-v84gd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-e7c0ff-6c9d7d5799-v84gd to ip-10-0-143-184.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-d14aea-5c4975697d-h6q7p

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-d14aea-5c4975697d-h6q7p to ip-10-0-133-14.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-lvpvq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-lvpvq to ip-10-0-140-64.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-66998bbc-78d8cc858b-scf62

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-66998bbc-78d8cc858b-scf62 to ip-10-0-143-184.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-8b6928-784b6f6b58-nndml

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-8b6928-784b6f6b58-nndml to ip-10-0-143-184.ec2.internal

openshift-ingress

e2e-api-a-e171e4-openshift-default-5df4c946b6-qp9f8

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-e171e4-openshift-default-5df4c946b6-qp9f8 to ip-10-0-133-14.ec2.internal

openshift-ingress

payload-processing-e2e-ait-29f90b97-6cc6c5ff-5sghl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-29f90b97-6cc6c5ff-5sghl to ip-10-0-143-184.ec2.internal

openshift-ingress

e2e-inf-a-e7c0ff-openshift-default-6cd6c4cc68-sf2hg

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-e7c0ff-openshift-default-6cd6c4cc68-sf2hg to ip-10-0-140-64.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-48a4b5-6f8b8ccc4-sx9mv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-48a4b5-6f8b8ccc4-sx9mv to ip-10-0-143-184.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-d9d46f-7df8998-x7jzc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d9d46f-7df8998-x7jzc to ip-10-0-133-14.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-e7c0ff-5bb64874c4-ggmb5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-e7c0ff-5bb64874c4-ggmb5 to ip-10-0-143-184.ec2.internal

openshift-ingress

e2e-api-b-d850e3-openshift-default-6489bbd5c6-dtxm7

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-d850e3-openshift-default-6489bbd5c6-dtxm7 to ip-10-0-133-14.ec2.internal

openshift-ingress

e2e-inf-b-61f3ac-openshift-default-76bdb6cdb4-zbt8t

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-61f3ac-openshift-default-76bdb6cdb4-zbt8t to ip-10-0-133-14.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-29f90b97-588cc7d586-mhbk9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-29f90b97-588cc7d586-mhbk9 to ip-10-0-143-184.ec2.internal

openshift-ingress

e2e-ipp-b-d14aea-openshift-default-6b4c475cd4-9gzsp

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-d14aea-openshift-default-6b4c475cd4-9gzsp to ip-10-0-140-64.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-3d4dc1-695fb45fbb-m6k4t

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-3d4dc1-695fb45fbb-m6k4t to ip-10-0-143-184.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-73e112cd-794d78bc8b-dw47x

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-73e112cd-794d78bc8b-dw47x to ip-10-0-143-184.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-8c2e20-9f8c79846-djcpk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-8c2e20-9f8c79846-djcpk to ip-10-0-143-184.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-cec446-6bbdc87865-c4srn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-cec446-6bbdc87865-c4srn to ip-10-0-143-184.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-3d4dc1-7b46775b99-chnwq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-3d4dc1-7b46775b99-chnwq to ip-10-0-143-184.ec2.internal

openshift-ingress

e2e-derive-46865726-openshift-default-5d65d49f68-s5ztp

Scheduled

Successfully assigned openshift-ingress/e2e-derive-46865726-openshift-default-5d65d49f68-s5ztp to ip-10-0-140-64.ec2.internal

openshift-ingress

router-default-8557f77dd-lw4qb

Scheduled

Successfully assigned openshift-ingress/router-default-8557f77dd-lw4qb to ip-10-0-133-14.ec2.internal

openshift-ingress

e2e-shared-a-w2-8b6928-openshift-default-7d8b466968-k4h4t

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-8b6928-openshift-default-7d8b466968-k4h4t to ip-10-0-140-64.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-4faf97-865f757746-wqw7p

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-4faf97-865f757746-wqw7p to ip-10-0-143-184.ec2.internal

openshift-ingress

e2e-shared-b-w3-5ef325-openshift-default-78d9c848db-cjq2t

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-5ef325-openshift-default-78d9c848db-cjq2t to ip-10-0-133-14.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-61f3ac-75c99f6dfd-hgnvv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-61f3ac-75c99f6dfd-hgnvv to ip-10-0-143-184.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-46865726-69df8d474-fh2hn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-46865726-69df8d474-fh2hn to ip-10-0-143-184.ec2.internal

openshift-ingress

e2e-autores-4faf97-openshift-default-6b946d97c6-mggcc

Scheduled

Successfully assigned openshift-ingress/e2e-autores-4faf97-openshift-default-6b946d97c6-mggcc to ip-10-0-133-14.ec2.internal

openshift-ingress

e2e-explicit-48a4b5-openshift-default-7999b9486d-zp7hc

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-48a4b5-openshift-default-7999b9486d-zp7hc to ip-10-0-140-64.ec2.internal

openshift-ingress

payload-processing-e2e-ait-73e112cd-7df759d875-8hw74

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-73e112cd-7df759d875-8hw74 to ip-10-0-143-184.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-5ef325-5cc47d8bfd-c9nqp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-5ef325-5cc47d8bfd-c9nqp to ip-10-0-143-184.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-5ef325-7dc8b66945-x2lcf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-5ef325-7dc8b66945-x2lcf to ip-10-0-143-184.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-fxvvn

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-fxvvn to ip-10-0-140-64.ec2.internal

openshift-ingress

e2e-shared-b-w2-cec446-openshift-default-5dd5bb76f8-262pr

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-cec446-openshift-default-5dd5bb76f8-262pr to ip-10-0-140-64.ec2.internal

openshift-ingress

e2e-ipp-a-3d4dc1-openshift-default-694fd9d968-clndt

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-3d4dc1-openshift-default-694fd9d968-clndt to ip-10-0-140-64.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-d14aea-79fb454499-4sb89

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-d14aea-79fb454499-4sb89 to ip-10-0-133-14.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-ktgjp

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ktgjp to ip-10-0-143-184.ec2.internal

openshift-ingress

e2e-shared-a-w3-8c2e20-openshift-default-69495bf976-jxlsj

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-8c2e20-openshift-default-69495bf976-jxlsj to ip-10-0-140-64.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-8557f77dd from 0 to 1
(x13)

openshift-ingress

replicaset-controller

router-default-8557f77dd

FailedCreate

Error creating: pods "router-default-8557f77dd-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x16)

openshift-ingress

replicaset-controller

router-default-8557f77dd

FailedCreate

Error creating: pods "router-default-8557f77dd-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-8557f77dd

SuccessfulCreate

Created pod: router-default-8557f77dd-lw4qb
(x5)

openshift-ingress

kubelet

router-default-8557f77dd-lw4qb

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x6)

openshift-ingress

kubelet

router-default-8557f77dd-lw4qb

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

kubelet

router-default-8557f77dd-lw4qb

Created

Created container: router

openshift-ingress

kubelet

router-default-8557f77dd-lw4qb

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:da130d90f0bffd5c5876c94544c91b2a1be0d23ce2747ddfeafe88e03ee7d8d1" already present on machine

openshift-ingress

kubelet

router-default-8557f77dd-lw4qb

Started

Started container router

openshift-ingress

multus

router-default-8557f77dd-lw4qb

AddedInterface

Add eth0 [10.132.0.12/23] from ovn-kubernetes

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-74c76cbcf8 from 0 to 2

openshift-ingress

replicaset-controller

kube-auth-proxy-74c76cbcf8

SuccessfulCreate

Created pod: kube-auth-proxy-74c76cbcf8-f2jsh
(x4)

openshift-ingress

replicaset-controller

kube-auth-proxy-74c76cbcf8

FailedCreate

Error creating: pods "kube-auth-proxy-74c76cbcf8-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-74c76cbcf8

SuccessfulCreate

Created pod: kube-auth-proxy-74c76cbcf8-6mjdg

openshift-ingress

kubelet

kube-auth-proxy-74c76cbcf8-f2jsh

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-74c76cbcf8-f2jsh

AddedInterface

Add eth0 [10.132.0.23/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-ktgjp

openshift-ingress

kubelet

kube-auth-proxy-74c76cbcf8-6mjdg

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-74c76cbcf8-6mjdg

AddedInterface

Add eth0 [10.133.0.23/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-ktgjp

AddedInterface

Add eth0 [10.133.0.24/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-ktgjp

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

kube-auth-proxy-74c76cbcf8-f2jsh

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.586s (2.586s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-74c76cbcf8-6mjdg

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.767s (2.767s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-74c76cbcf8-6mjdg

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-74c76cbcf8-6mjdg

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-74c76cbcf8-f2jsh

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-74c76cbcf8-f2jsh

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-ktgjp

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.555s (2.555s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-ktgjp

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-ktgjp

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-ktgjp

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-ktgjp

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-n4gxw

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-n4gxw

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-n4gxw

AddedInterface

Add eth0 [10.132.0.24/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-n4gxw

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.873s (2.873s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-n4gxw

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-n4gxw

Started

Started container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-v8mm4

Created

Created container: discovery

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-v8mm4

AddedInterface

Add eth0 [10.133.0.25/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-v8mm4

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-v8mm4

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-v8mm4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" already present on machine

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-v8mm4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-v8mm4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-ktgjp

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-ktgjp

Killing

Stopping container discovery

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-bzs86

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-bzs86

AddedInterface

Add eth0 [10.134.0.36/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-bzs86

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-bzs86

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.63s (2.63s including waiting). Image size: 181318953 bytes.

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-lvpvq

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-lvpvq

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-fxvvn
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-lvpvq

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-fxvvn

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-5b54b7fbb7-fxvvn

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-fxvvn

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-fxvvn

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.873s (2.873s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-lvpvq

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.92s (2.92s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-lvpvq

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-lvpvq

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-fxvvn

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-bzs86

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-bzs86

Created

Created container: istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-bzs86

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-bzs86

ProbeError

Startup probe error: Get "http://10.134.0.36:15021/healthz/ready": dial tcp 10.134.0.36:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-bzs86

Unhealthy

Startup probe failed: Get "http://10.134.0.36:15021/healthz/ready": dial tcp 10.134.0.36:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-inf-a-e7c0ff-openshift-default-6cd6c4cc68

SuccessfulCreate

Created pod: e2e-inf-a-e7c0ff-openshift-default-6cd6c4cc68-sf2hg

openshift-ingress

deployment-controller

e2e-inf-a-e7c0ff-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-e7c0ff-openshift-default-6cd6c4cc68 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-a-e7c0ff

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-e7c0ff

openshift-ingress

multus

e2e-inf-a-e7c0ff-openshift-default-6cd6c4cc68-sf2hg

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-e7c0ff

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-e7c0ff-6c9d7d5799 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-e7c0ff-5bb64874c4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-e7c0ff-5bb64874c4-ggmb5

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-e7c0ff-5bb64874c4-ggmb5

AddedInterface

Add eth0 [10.133.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-e7c0ff-5bb64874c4-ggmb5

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-e7c0ff-5bb64874c4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-e7c0ff-5bb64874c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-e7c0ff: serviceaccount "payload-processing-e2e-inf-a-e7c0ff" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-e7c0ff-6c9d7d5799

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-e7c0ff-6c9d7d5799-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-e7c0ff: serviceaccount "payload-processing-e2e-inf-a-e7c0ff" not found

openshift-ingress

kubelet

payload-processing-e2e-inf-a-e7c0ff-6c9d7d5799-v84gd

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-e7c0ff

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-e7c0ff-5bb64874c4 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-inf-a-e7c0ff-6c9d7d5799-v84gd

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-e7c0ff-6c9d7d5799

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-e7c0ff-6c9d7d5799-v84gd

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-e7c0ff-5bb64874c4-ggmb5

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.247s (2.247s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-processing-e2e-inf-a-e7c0ff-6c9d7d5799-v84gd

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.218s (2.218s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-e7c0ff-5bb64874c4-ggmb5

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-e7c0ff-6c9d7d5799-v84gd

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-e7c0ff-6c9d7d5799-v84gd

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

e2e-ait-73e112cd-openshift-default-644d6c49cb

SuccessfulCreate

Created pod: e2e-ait-73e112cd-openshift-default-644d6c49cb-4vxg6

openshift-ingress

deployment-controller

e2e-ait-73e112cd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-73e112cd-openshift-default-644d6c49cb from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-73e112cd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-73e112cd

openshift-ingress

GatewayAuthBootstrap

e2e-ait-73e112cd

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-ait-73e112cd-authn-ssl: envoyfilters.networking.istio.io "e2e-ait-73e112cd-authn-ssl" already exists

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-e7c0ff-5bb64874c4-ggmb5

Started

Started container payload-pre-processing

openshift-ingress

multus

e2e-ait-73e112cd-openshift-default-644d6c49cb-4vxg6

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-autores-4faf97-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-4faf97-openshift-default-6b946d97c6 from 0 to 1

openshift-ingress

multus

e2e-autores-4faf97-openshift-default-6b946d97c6-mggcc

AddedInterface

Add eth0 [10.132.0.37/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-autores-4faf97

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-4faf97

openshift-ingress

replicaset-controller

e2e-autores-4faf97-openshift-default-6b946d97c6

SuccessfulCreate

Created pod: e2e-autores-4faf97-openshift-default-6b946d97c6-mggcc
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-73e112cd-7df759d875

FailedCreate

Error creating: pods "payload-processing-e2e-ait-73e112cd-7df759d875-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-73e112cd: serviceaccount "payload-processing-e2e-ait-73e112cd" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-73e112cd-7df759d875

SuccessfulCreate

Created pod: payload-processing-e2e-ait-73e112cd-7df759d875-8hw74

openshift-ingress

deployment-controller

payload-processing-e2e-ait-73e112cd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-73e112cd-7df759d875 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-73e112cd-794d78bc8b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-73e112cd-794d78bc8b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-73e112cd: serviceaccount "payload-processing-e2e-ait-73e112cd" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-73e112cd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-73e112cd-794d78bc8b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-73e112cd-794d78bc8b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-73e112cd-794d78bc8b-dw47x

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-73e112cd-794d78bc8b-dw47x

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-73e112cd-7df759d875-8hw74

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ait-73e112cd-794d78bc8b-dw47x

AddedInterface

Add eth0 [10.133.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-73e112cd-7df759d875-8hw74

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-73e112cd-794d78bc8b-dw47x

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-73e112cd-794d78bc8b-dw47x

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-73e112cd-7df759d875-8hw74

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-73e112cd-7df759d875-8hw74

Created

Created container: payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-autores-4faf97

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-4faf97-5c77597d99 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-autores-4faf97-865f757746-wqw7p

AddedInterface

Add eth0 [10.133.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-4faf97-865f757746-wqw7p

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-4faf97-865f757746-wqw7p

Created

Created container: payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-4faf97-865f757746

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-4faf97-865f757746-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-4faf97: serviceaccount "payload-processing-e2e-autores-4faf97" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-4faf97-865f757746

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-4faf97-865f757746-wqw7p

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-4faf97

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-4faf97-865f757746 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-autores-4faf97-5c77597d99-df92p

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-4faf97-865f757746-wqw7p

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-autores-4faf97-5c77597d99-df92p

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-autores-4faf97-5c77597d99-df92p

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-4faf97-5c77597d99

SuccessfulCreate

Created pod: payload-processing-e2e-autores-4faf97-5c77597d99-df92p
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-4faf97-5c77597d99

FailedCreate

Error creating: pods "payload-processing-e2e-autores-4faf97-5c77597d99-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-4faf97: serviceaccount "payload-processing-e2e-autores-4faf97" not found

openshift-ingress

kubelet

payload-processing-e2e-autores-4faf97-5c77597d99-df92p

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-e7c0ff-openshift-default-6cd6c4cc68-sf2hg

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-e7c0ff-openshift-default-6cd6c4cc68-sf2hg

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-e7c0ff-openshift-default-6cd6c4cc68-sf2hg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-ait-73e112cd-openshift-default-644d6c49cb-4vxg6

ProbeError

Readiness probe error: Get "http://10.134.0.48:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ait-73e112cd-openshift-default-644d6c49cb-4vxg6

Unhealthy

Readiness probe failed: Get "http://10.134.0.48:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x5)

openshift-ingress

kubelet

e2e-inf-a-e7c0ff-openshift-default-6cd6c4cc68-sf2hg

Unhealthy

Startup probe failed: Get "http://10.134.0.47:15021/healthz/ready": dial tcp 10.134.0.47:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-a-e7c0ff-openshift-default-6cd6c4cc68-sf2hg

ProbeError

Startup probe error: Get "http://10.134.0.47:15021/healthz/ready": dial tcp 10.134.0.47:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-inf-b-61f3ac-openshift-default-76bdb6cdb4

SuccessfulCreate

Created pod: e2e-inf-b-61f3ac-openshift-default-76bdb6cdb4-zbt8t

openshift-ingress

deployment-controller

e2e-inf-b-61f3ac-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-61f3ac-openshift-default-76bdb6cdb4 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-b-61f3ac

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-61f3ac

openshift-ingress

multus

e2e-inf-b-61f3ac-openshift-default-76bdb6cdb4-zbt8t

AddedInterface

Add eth0 [10.132.0.38/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ait-73e112cd-openshift-default-644d6c49cb-4vxg6

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-73e112cd-openshift-default-644d6c49cb-4vxg6

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-73e112cd-openshift-default-644d6c49cb-4vxg6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-61f3ac

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-61f3ac-77d5c57fc5 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-61f3ac-75c99f6dfd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-61f3ac-75c99f6dfd-hgnvv

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-61f3ac-77d5c57fc5

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-61f3ac-77d5c57fc5-pvjfx
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-61f3ac-77d5c57fc5

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-61f3ac-77d5c57fc5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-61f3ac: serviceaccount "payload-processing-e2e-inf-b-61f3ac" not found

openshift-ingress

kubelet

payload-processing-e2e-inf-b-61f3ac-77d5c57fc5-pvjfx

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-61f3ac-75c99f6dfd-hgnvv

AddedInterface

Add eth0 [10.133.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-61f3ac-75c99f6dfd-hgnvv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-b-61f3ac-77d5c57fc5-pvjfx

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-61f3ac-77d5c57fc5-pvjfx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-inf-b-61f3ac-77d5c57fc5-pvjfx

AddedInterface

Add eth0 [10.133.0.49/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-61f3ac-75c99f6dfd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-61f3ac-75c99f6dfd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-61f3ac: serviceaccount "payload-processing-e2e-inf-b-61f3ac" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-61f3ac

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-61f3ac-75c99f6dfd from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-61f3ac-75c99f6dfd-hgnvv

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-61f3ac-75c99f6dfd-hgnvv

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-autores-4faf97-openshift-default-6b946d97c6-mggcc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-autores-4faf97-openshift-default-6b946d97c6-mggcc

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-4faf97-openshift-default-6b946d97c6-mggcc

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ait-73e112cd-openshift-default-644d6c49cb-4vxg6

Unhealthy

Startup probe failed: Get "http://10.134.0.48:15021/healthz/ready": dial tcp 10.134.0.48:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-73e112cd-openshift-default-644d6c49cb-4vxg6

ProbeError

Startup probe error: Get "http://10.134.0.48:15021/healthz/ready": dial tcp 10.134.0.48:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-autores-4faf97-openshift-default-6b946d97c6-mggcc

Unhealthy

Startup probe failed: Get "http://10.132.0.37:15021/healthz/ready": dial tcp 10.132.0.37:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-autores-4faf97-openshift-default-6b946d97c6-mggcc

ProbeError

Startup probe error: Get "http://10.132.0.37:15021/healthz/ready": dial tcp 10.132.0.37:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-inf-b-61f3ac-openshift-default-76bdb6cdb4-zbt8t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-61f3ac-openshift-default-76bdb6cdb4-zbt8t

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-61f3ac-openshift-default-76bdb6cdb4-zbt8t

Started

Started container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ait-73e112cd-7df759d875-8hw74

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-73e112cd-794d78bc8b-dw47x

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-73e112cd-openshift-default-644d6c49cb-4vxg6

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-migrate-7dd976de-gw-openshift-default-7cbbc5cd8

SuccessfulCreate

Created pod: e2e-migrate-7dd976de-gw-openshift-default-7cbbc5cd8-gf2gj

openshift-ingress

deployment-controller

e2e-migrate-7dd976de-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-7dd976de-gw-openshift-default-7cbbc5cd8 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-migrate-7dd976de-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-7dd976de-gw

openshift-ingress

multus

e2e-migrate-7dd976de-gw-openshift-default-7cbbc5cd8-gf2gj

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-inf-b-61f3ac-openshift-default-76bdb6cdb4-zbt8t

Unhealthy

Startup probe failed: Get "http://10.132.0.38:15021/healthz/ready": dial tcp 10.132.0.38:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-b-61f3ac-openshift-default-76bdb6cdb4-zbt8t

ProbeError

Startup probe error: Get "http://10.132.0.38:15021/healthz/ready": dial tcp 10.132.0.38:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-7dd976de

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-7dd976de-566c5bffc8 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-migrate-7dd976de-566c5bffc8-8f9ws

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-migrate-7dd976de-566c5bffc8-8f9ws

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-7dd976de

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-7dd976de-7649848fdb from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-7dd976de-7649848fdb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-7dd976de-7649848fdb-gp9q5
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-7dd976de-7649848fdb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-7dd976de-7649848fdb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-7dd976de: serviceaccount "payload-processing-e2e-migrate-7dd976de" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-7dd976de-7649848fdb-gp9q5

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-7dd976de-7649848fdb-gp9q5

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-7dd976de-7649848fdb-gp9q5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-migrate-7dd976de-7649848fdb-gp9q5

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-7dd976de-566c5bffc8-8f9ws

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-7dd976de-566c5bffc8-8f9ws

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-7dd976de-566c5bffc8

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-7dd976de-566c5bffc8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-7dd976de: serviceaccount "payload-processing-e2e-migrate-7dd976de" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-7dd976de-566c5bffc8

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-7dd976de-566c5bffc8-8f9ws

openshift-ingress

kubelet

e2e-migrate-7dd976de-gw-openshift-default-7cbbc5cd8-gf2gj

Unhealthy

Readiness probe failed: Get "http://10.134.0.51:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-migrate-7dd976de-gw-openshift-default-7cbbc5cd8-gf2gj

ProbeError

Readiness probe error: Get "http://10.134.0.51:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-migrate-7dd976de-gw-openshift-default-7cbbc5cd8-gf2gj

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-7dd976de-gw-openshift-default-7cbbc5cd8-gf2gj

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-7dd976de-gw-openshift-default-7cbbc5cd8-gf2gj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-migrate-7dd976de-gw-openshift-default-7cbbc5cd8-gf2gj

ProbeError

Startup probe error: Get "http://10.134.0.51:15021/healthz/ready": dial tcp 10.134.0.51:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-migrate-7dd976de-gw-openshift-default-7cbbc5cd8-gf2gj

Unhealthy

Startup probe failed: Get "http://10.134.0.51:15021/healthz/ready": dial tcp 10.134.0.51:15021: connect: connection refused

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-migrate-7dd976de

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-migrate-7dd976de: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-migrate-7dd976de": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-migrate-7dd976de, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: b005b642-b302-4d2e-afbd-7d206124d879, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-migrate-7dd976de-566c5bffc8-8f9ws

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-7dd976de-7649848fdb-gp9q5

Killing

Stopping container payload-pre-processing

openshift-ingress

GatewayAuthBootstrap

e2e-ait-29f90b97

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-ait-29f90b97-authn-ssl: envoyfilters.networking.istio.io "e2e-ait-29f90b97-authn-ssl" already exists

openshift-ingress

kubelet

e2e-migrate-7dd976de-gw-openshift-default-7cbbc5cd8-gf2gj

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ait-29f90b97

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-29f90b97

openshift-ingress

replicaset-controller

e2e-ait-29f90b97-openshift-default-5d887486bd

SuccessfulCreate

Created pod: e2e-ait-29f90b97-openshift-default-5d887486bd-2ssz2

openshift-ingress

multus

e2e-ait-29f90b97-openshift-default-5d887486bd-2ssz2

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ait-29f90b97-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-29f90b97-openshift-default-5d887486bd from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ait-29f90b97

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-29f90b97-6cc6c5ff from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-29f90b97-588cc7d586

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-29f90b97-588cc7d586-mhbk9

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-29f90b97

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-29f90b97-588cc7d586 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-29f90b97-6cc6c5ff

SuccessfulCreate

Created pod: payload-processing-e2e-ait-29f90b97-6cc6c5ff-5sghl

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-29f90b97-588cc7d586-mhbk9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-29f90b97-6cc6c5ff-5sghl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-29f90b97-6cc6c5ff-5sghl

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-29f90b97-6cc6c5ff

FailedCreate

Error creating: pods "payload-processing-e2e-ait-29f90b97-6cc6c5ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-29f90b97: serviceaccount "payload-processing-e2e-ait-29f90b97" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-29f90b97-588cc7d586-mhbk9

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-29f90b97-6cc6c5ff-5sghl

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-29f90b97-588cc7d586-mhbk9

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-29f90b97-6cc6c5ff-5sghl

Created

Created container: payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-29f90b97-588cc7d586

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-29f90b97-588cc7d586-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-29f90b97: serviceaccount "payload-processing-e2e-ait-29f90b97" not found

openshift-ingress

multus

payload-pre-processing-e2e-ait-29f90b97-588cc7d586-mhbk9

AddedInterface

Add eth0 [10.133.0.54/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ait-29f90b97-openshift-default-5d887486bd-2ssz2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-29f90b97-openshift-default-5d887486bd-2ssz2

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-29f90b97-openshift-default-5d887486bd-2ssz2

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ait-29f90b97-openshift-default-5d887486bd-2ssz2

ProbeError

Startup probe error: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-29f90b97-openshift-default-5d887486bd-2ssz2

Unhealthy

Startup probe failed: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-29f90b97-588cc7d586-mhbk9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-29f90b97-6cc6c5ff-5sghl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-29f90b97-openshift-default-5d887486bd-2ssz2

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-derive-46865726-openshift-default-5d65d49f68-s5ztp

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-derive-46865726

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-46865726

openshift-ingress

replicaset-controller

e2e-derive-46865726-openshift-default-5d65d49f68

SuccessfulCreate

Created pod: e2e-derive-46865726-openshift-default-5d65d49f68-s5ztp

openshift-ingress

deployment-controller

e2e-derive-46865726-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-46865726-openshift-default-5d65d49f68 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-46865726-69df8d474

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-46865726-69df8d474-fh2hn

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-46865726-dcb6f7d6f

SuccessfulCreate

Created pod: payload-processing-e2e-derive-46865726-dcb6f7d6f-zb5jh
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-46865726-69df8d474

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-46865726-69df8d474-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-46865726: serviceaccount "payload-processing-e2e-derive-46865726" not found

openshift-ingress

deployment-controller

payload-processing-e2e-derive-46865726

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-46865726-dcb6f7d6f from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-46865726

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-46865726-69df8d474 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-46865726-dcb6f7d6f

FailedCreate

Error creating: pods "payload-processing-e2e-derive-46865726-dcb6f7d6f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-46865726: serviceaccount "payload-processing-e2e-derive-46865726" not found

openshift-ingress

kubelet

payload-processing-e2e-derive-46865726-dcb6f7d6f-zb5jh

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-46865726-dcb6f7d6f-zb5jh

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-46865726-dcb6f7d6f-zb5jh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-derive-46865726-dcb6f7d6f-zb5jh

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-derive-46865726-69df8d474-fh2hn

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-46865726-69df8d474-fh2hn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-46865726-69df8d474-fh2hn

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-46865726-69df8d474-fh2hn

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-4faf97-865f757746-wqw7p

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-4faf97-5c77597d99-df92p

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-derive-46865726-openshift-default-5d65d49f68-s5ztp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-46865726-openshift-default-5d65d49f68-s5ztp

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-46865726-openshift-default-5d65d49f68-s5ztp

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-derive-46865726-openshift-default-5d65d49f68-s5ztp

ProbeError

Startup probe error: Get "http://10.134.0.55:15021/healthz/ready": dial tcp 10.134.0.55:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-derive-46865726-openshift-default-5d65d49f68-s5ztp

Unhealthy

Startup probe failed: Get "http://10.134.0.55:15021/healthz/ready": dial tcp 10.134.0.55:15021: connect: connection refused

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-derive-46865726

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-derive-46865726: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-derive-46865726": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-derive-46865726, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 890612f9-81af-432d-9018-5ef58c8ca5d7, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-46865726-69df8d474-fh2hn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-46865726-dcb6f7d6f-zb5jh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-derive-46865726-openshift-default-5d65d49f68-s5ztp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-autores-4faf97-openshift-default-6b946d97c6-mggcc

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-explicit-48a4b5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-48a4b5

openshift-ingress

deployment-controller

e2e-explicit-48a4b5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-48a4b5-openshift-default-7999b9486d from 0 to 1

openshift-ingress

replicaset-controller

e2e-explicit-48a4b5-openshift-default-7999b9486d

SuccessfulCreate

Created pod: e2e-explicit-48a4b5-openshift-default-7999b9486d-zp7hc

openshift-ingress

multus

e2e-explicit-48a4b5-openshift-default-7999b9486d-zp7hc

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-48a4b5-6f8b8ccc4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-48a4b5-6f8b8ccc4-sx9mv

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-48a4b5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-48a4b5-6f8b8ccc4 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-48a4b5-6f8b8ccc4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-48a4b5-6f8b8ccc4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-48a4b5: serviceaccount "payload-processing-e2e-explicit-48a4b5" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-48a4b5-74698f9fc7

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-48a4b5-74698f9fc7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-48a4b5: serviceaccount "payload-processing-e2e-explicit-48a4b5" not found

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-48a4b5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-48a4b5-74698f9fc7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-48a4b5-74698f9fc7

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-48a4b5-74698f9fc7-tkgjp

openshift-ingress

kubelet

payload-processing-e2e-explicit-48a4b5-74698f9fc7-tkgjp

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-48a4b5-6f8b8ccc4-sx9mv

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-explicit-48a4b5-6f8b8ccc4-sx9mv

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-48a4b5-6f8b8ccc4-sx9mv

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-explicit-48a4b5-74698f9fc7-tkgjp

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-48a4b5-6f8b8ccc4-sx9mv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-explicit-48a4b5-74698f9fc7-tkgjp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-explicit-48a4b5-74698f9fc7-tkgjp

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-explicit-48a4b5-openshift-default-7999b9486d-zp7hc

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-48a4b5-openshift-default-7999b9486d-zp7hc

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-48a4b5-openshift-default-7999b9486d-zp7hc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-explicit-48a4b5-openshift-default-7999b9486d-zp7hc

ProbeError

Startup probe error: Get "http://10.134.0.58:15021/healthz/ready": dial tcp 10.134.0.58:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-explicit-48a4b5-openshift-default-7999b9486d-zp7hc

Unhealthy

Startup probe failed: Get "http://10.134.0.58:15021/healthz/ready": dial tcp 10.134.0.58:15021: connect: connection refused
(x2)

openshift-ingress

GatewayAuthBootstrap

e2e-mt-66998bbc

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-mt-66998bbc-authn-ssl: envoyfilters.networking.istio.io "e2e-mt-66998bbc-authn-ssl" already exists

openshift-ingress

replicaset-controller

e2e-mt-66998bbc-openshift-default-6569645764

SuccessfulCreate

Created pod: e2e-mt-66998bbc-openshift-default-6569645764-gczhs

openshift-ingress

deployment-controller

e2e-mt-66998bbc-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-66998bbc-openshift-default-6569645764 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-66998bbc

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-66998bbc

openshift-ingress

multus

e2e-mt-66998bbc-openshift-default-6569645764-gczhs

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-66998bbc-7fccb85889

FailedCreate

Error creating: pods "payload-processing-e2e-mt-66998bbc-7fccb85889-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-66998bbc: serviceaccount "payload-processing-e2e-mt-66998bbc" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-66998bbc-78d8cc858b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-66998bbc-78d8cc858b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-66998bbc: serviceaccount "payload-processing-e2e-mt-66998bbc" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-66998bbc-78d8cc858b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-66998bbc-78d8cc858b-scf62

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-66998bbc

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-66998bbc-78d8cc858b from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-mt-66998bbc

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-66998bbc-7fccb85889 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-66998bbc-7fccb85889

SuccessfulCreate

Created pod: payload-processing-e2e-mt-66998bbc-7fccb85889-4tv98

openshift-ingress

multus

payload-pre-processing-e2e-mt-66998bbc-78d8cc858b-scf62

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-mt-66998bbc-7fccb85889-4tv98

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-66998bbc-78d8cc858b-scf62

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-66998bbc-7fccb85889-4tv98

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-66998bbc-7fccb85889-4tv98

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-66998bbc-78d8cc858b-scf62

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-66998bbc-78d8cc858b-scf62

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-66998bbc-7fccb85889-4tv98

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-48a4b5-6f8b8ccc4-sx9mv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-48a4b5-74698f9fc7-tkgjp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-66998bbc-openshift-default-6569645764-gczhs

ProbeError

Readiness probe error: Get "http://10.134.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-mt-66998bbc-openshift-default-6569645764-gczhs

Unhealthy

Readiness probe failed: Get "http://10.134.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-mt-66998bbc-openshift-default-6569645764-gczhs

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-66998bbc-openshift-default-6569645764-gczhs

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-66998bbc-openshift-default-6569645764-gczhs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-explicit-48a4b5-openshift-default-7999b9486d-zp7hc

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-noten-ecd628-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-ecd628-openshift-default-5bc8c5cb84 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-noten-ecd628

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-ecd628

openshift-ingress

replicaset-controller

e2e-noten-ecd628-openshift-default-5bc8c5cb84

SuccessfulCreate

Created pod: e2e-noten-ecd628-openshift-default-5bc8c5cb84-47rrf

openshift-ingress

kubelet

e2e-noten-ecd628-openshift-default-5bc8c5cb84-47rrf

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-noten-ecd628-openshift-default-5bc8c5cb84-47rrf

Created

Created container: istio-proxy

openshift-ingress

multus

e2e-noten-ecd628-openshift-default-5bc8c5cb84-47rrf

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-ecd628-openshift-default-5bc8c5cb84-47rrf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-mt-66998bbc-openshift-default-6569645764-gczhs

ProbeError

Startup probe error: Get "http://10.134.0.60:15021/healthz/ready": dial tcp 10.134.0.60:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-66998bbc-openshift-default-6569645764-gczhs

Unhealthy

Startup probe failed: Get "http://10.134.0.60:15021/healthz/ready": dial tcp 10.134.0.60:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-mt-66998bbc-7fccb85889-4tv98

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-66998bbc-78d8cc858b-scf62

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-mt-66998bbc

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-mt-66998bbc: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-mt-66998bbc": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-mt-66998bbc, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 9594cc37-cf6c-4bf1-bbb0-ec02b9608778, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-e7c0ff-5bb64874c4-ggmb5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-e7c0ff-6c9d7d5799-v84gd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-66998bbc-openshift-default-6569645764-gczhs

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-66998bbc-openshift-default-6569645764-gczhs

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-66998bbc-openshift-default-6569645764-gczhs

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-a-e7c0ff-openshift-default-6cd6c4cc68-sf2hg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-noten-ecd628-openshift-default-5bc8c5cb84-47rrf

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-8b6928

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-8b6928

openshift-ingress

deployment-controller

e2e-shared-a-w2-8b6928-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-8b6928-openshift-default-7d8b466968 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w2-8b6928-openshift-default-7d8b466968

SuccessfulCreate

Created pod: e2e-shared-a-w2-8b6928-openshift-default-7d8b466968-k4h4t

openshift-ingress

multus

e2e-shared-a-w2-8b6928-openshift-default-7d8b466968-k4h4t

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-61f3ac-77d5c57fc5-pvjfx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-61f3ac-75c99f6dfd-hgnvv

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-8b6928

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-8b6928-586675ddf9 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-8b6928-586675ddf9

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-8b6928-586675ddf9-mfhcx

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-8b6928

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-8b6928-784b6f6b58 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-8b6928-784b6f6b58-nndml

AddedInterface

Add eth0 [10.133.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-8b6928-784b6f6b58-nndml

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-8b6928-586675ddf9-mfhcx

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-8b6928-586675ddf9

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-8b6928-586675ddf9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-8b6928: serviceaccount "payload-processing-e2e-shared-a-w2-8b6928" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-8b6928-586675ddf9-mfhcx

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-8b6928-586675ddf9-mfhcx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-8b6928-586675ddf9-mfhcx

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-8b6928-784b6f6b58-nndml

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-8b6928-784b6f6b58-nndml

Started

Started container payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-8b6928-784b6f6b58

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-8b6928-784b6f6b58-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-8b6928: serviceaccount "payload-processing-e2e-shared-a-w2-8b6928" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-8b6928-784b6f6b58

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-8b6928-784b6f6b58-nndml

openshift-ingress

kubelet

e2e-inf-b-61f3ac-openshift-default-76bdb6cdb4-zbt8t

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-8c2e20

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-8c2e20

openshift-ingress

replicaset-controller

e2e-shared-a-w3-8c2e20-openshift-default-69495bf976

SuccessfulCreate

Created pod: e2e-shared-a-w3-8c2e20-openshift-default-69495bf976-jxlsj

openshift-ingress

deployment-controller

e2e-shared-a-w3-8c2e20-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-8c2e20-openshift-default-69495bf976 from 0 to 1

openshift-ingress

multus

e2e-shared-a-w3-8c2e20-openshift-default-69495bf976-jxlsj

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-8c2e20

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-8c2e20-69b657c959 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-8c2e20-69b657c959-6cf22

AddedInterface

Add eth0 [10.133.0.65/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-8c2e20

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-8c2e20-9f8c79846 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-8c2e20-9f8c79846

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-8c2e20-9f8c79846-djcpk
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-8c2e20-9f8c79846

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-8c2e20-9f8c79846-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-8c2e20: serviceaccount "payload-processing-e2e-shared-a-w3-8c2e20" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-8c2e20-69b657c959

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-8c2e20-69b657c959-6cf22
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-8c2e20-69b657c959

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-8c2e20-69b657c959-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-8c2e20: serviceaccount "payload-processing-e2e-shared-a-w3-8c2e20" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-8c2e20-69b657c959-6cf22

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-8c2e20-9f8c79846-djcpk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-8c2e20-9f8c79846-djcpk

AddedInterface

Add eth0 [10.133.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-8c2e20-9f8c79846-djcpk

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-8c2e20-69b657c959-6cf22

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-8c2e20-69b657c959-6cf22

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-8c2e20-9f8c79846-djcpk

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w2-8b6928-openshift-default-7d8b466968-k4h4t

ProbeError

Readiness probe error: Get "http://10.134.0.63:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-a-w2-8b6928-openshift-default-7d8b466968-k4h4t

Unhealthy

Readiness probe failed: Get "http://10.134.0.63:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-8b6928-openshift-default-7d8b466968-k4h4t

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-8b6928-openshift-default-7d8b466968-k4h4t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-8b6928-openshift-default-7d8b466968-k4h4t

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-8b6928-openshift-default-7d8b466968-k4h4t

Unhealthy

Startup probe failed: Get "http://10.134.0.63:15021/healthz/ready": dial tcp 10.134.0.63:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-8b6928-openshift-default-7d8b466968-k4h4t

ProbeError

Startup probe error: Get "http://10.134.0.63:15021/healthz/ready": dial tcp 10.134.0.63:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-shared-b-w2-cec446-openshift-default-5dd5bb76f8

SuccessfulCreate

Created pod: e2e-shared-b-w2-cec446-openshift-default-5dd5bb76f8-262pr

openshift-ingress

deployment-controller

e2e-shared-b-w2-cec446-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-cec446-openshift-default-5dd5bb76f8 from 0 to 1

openshift-ingress

kubelet

e2e-shared-a-w3-8c2e20-openshift-default-69495bf976-jxlsj

ProbeError

Readiness probe error: Get "http://10.134.0.64:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-cec446

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-cec446

openshift-ingress

kubelet

e2e-shared-a-w3-8c2e20-openshift-default-69495bf976-jxlsj

Unhealthy

Readiness probe failed: Get "http://10.134.0.64:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-8c2e20-openshift-default-69495bf976-jxlsj

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-8c2e20-openshift-default-69495bf976-jxlsj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

multus

e2e-shared-b-w2-cec446-openshift-default-5dd5bb76f8-262pr

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-8c2e20-openshift-default-69495bf976-jxlsj

Created

Created container: istio-proxy
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-cec446-6bbdc87865

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-cec446-6bbdc87865-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-cec446: serviceaccount "payload-processing-e2e-shared-b-w2-cec446" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-cec446-6bbdc87865

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-cec446-6bbdc87865-c4srn

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-cec446

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-cec446-6bbdc87865 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-cec446

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-cec446-5cb9c958f4 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-cec446-5cb9c958f4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-cec446-5cb9c958f4-lxq9r
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-cec446-5cb9c958f4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-cec446-5cb9c958f4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-cec446: serviceaccount "payload-processing-e2e-shared-b-w2-cec446" not found
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-8c2e20-openshift-default-69495bf976-jxlsj

ProbeError

Startup probe error: Get "http://10.134.0.64:15021/healthz/ready": dial tcp 10.134.0.64:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-cec446-5cb9c958f4-lxq9r

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-8c2e20-openshift-default-69495bf976-jxlsj

Unhealthy

Startup probe failed: Get "http://10.134.0.64:15021/healthz/ready": dial tcp 10.134.0.64:15021: connect: connection refused

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-cec446-6bbdc87865-c4srn

AddedInterface

Add eth0 [10.133.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-cec446-6bbdc87865-c4srn

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-cec446-5cb9c958f4-lxq9r

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-cec446-5cb9c958f4-lxq9r

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-cec446-6bbdc87865-c4srn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-cec446-6bbdc87865-c4srn

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-cec446-5cb9c958f4-lxq9r

AddedInterface

Add eth0 [10.133.0.67/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-b-w3-5ef325-openshift-default-78d9c848db

SuccessfulCreate

Created pod: e2e-shared-b-w3-5ef325-openshift-default-78d9c848db-cjq2t

openshift-ingress

deployment-controller

e2e-shared-b-w3-5ef325-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-5ef325-openshift-default-78d9c848db from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-5ef325

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-5ef325

openshift-ingress

multus

e2e-shared-b-w3-5ef325-openshift-default-78d9c848db-cjq2t

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-5ef325-5cc47d8bfd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-5ef325-5cc47d8bfd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-5ef325: serviceaccount "payload-processing-e2e-shared-b-w3-5ef325" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-5ef325-5cc47d8bfd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-5ef325-5cc47d8bfd-c9nqp

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-5ef325

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-5ef325-7dc8b66945 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-5ef325-7dc8b66945

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-5ef325-7dc8b66945-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-5ef325: serviceaccount "payload-processing-e2e-shared-b-w3-5ef325" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-5ef325

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-5ef325-5cc47d8bfd from 0 to 1

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-5ef325-7dc8b66945-x2lcf

AddedInterface

Add eth0 [10.133.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-5ef325-5cc47d8bfd-c9nqp

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-5ef325-5cc47d8bfd-c9nqp

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-5ef325-7dc8b66945

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-5ef325-7dc8b66945-x2lcf

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-5ef325-5cc47d8bfd-c9nqp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-5ef325-5cc47d8bfd-c9nqp

AddedInterface

Add eth0 [10.133.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-5ef325-7dc8b66945-x2lcf

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-5ef325-7dc8b66945-x2lcf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-5ef325-7dc8b66945-x2lcf

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-shared-b-w2-cec446-openshift-default-5dd5bb76f8-262pr

Unhealthy

Readiness probe failed: Get "http://10.134.0.65:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-b-w2-cec446-openshift-default-5dd5bb76f8-262pr

ProbeError

Readiness probe error: Get "http://10.134.0.65:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-cec446-openshift-default-5dd5bb76f8-262pr

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-cec446-openshift-default-5dd5bb76f8-262pr

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-cec446-openshift-default-5dd5bb76f8-262pr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-cec446-openshift-default-5dd5bb76f8-262pr

Unhealthy

Startup probe failed: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-cec446-openshift-default-5dd5bb76f8-262pr

ProbeError

Startup probe error: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-shared-b-w3-5ef325-openshift-default-78d9c848db-cjq2t

ProbeError

Readiness probe error: Get "http://10.132.0.54:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-b-w3-5ef325-openshift-default-78d9c848db-cjq2t

Unhealthy

Readiness probe failed: Get "http://10.132.0.54:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-5ef325-openshift-default-78d9c848db-cjq2t

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-5ef325-openshift-default-78d9c848db-cjq2t

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-5ef325-openshift-default-78d9c848db-cjq2t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-5ef325-openshift-default-78d9c848db-cjq2t

ProbeError

Startup probe error: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-5ef325-openshift-default-78d9c848db-cjq2t

Unhealthy

Startup probe failed: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-mt-4b62745d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-4b62745d-openshift-default-d99f9d5b4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-4b62745d-openshift-default-d99f9d5b4

SuccessfulCreate

Created pod: e2e-mt-4b62745d-openshift-default-d99f9d5b4-w6hh5

openshift-ingress

multus

e2e-mt-4b62745d-openshift-default-d99f9d5b4-w6hh5

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-mt-4b62745d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-4b62745d
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-4b62745d-69fc6f6f5c

FailedCreate

Error creating: pods "payload-processing-e2e-mt-4b62745d-69fc6f6f5c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-4b62745d: serviceaccount "payload-processing-e2e-mt-4b62745d" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-4b62745d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-4b62745d-69fc6f6f5c from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-4b62745d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-4b62745d-7f49c69494 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-4b62745d-7f49c69494

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-4b62745d-7f49c69494-l4x5n
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-4b62745d-7f49c69494

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-4b62745d-7f49c69494-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-4b62745d: serviceaccount "payload-processing-e2e-mt-4b62745d" not found

openshift-ingress

multus

payload-processing-e2e-mt-4b62745d-69fc6f6f5c-thkhg

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-4b62745d-7f49c69494-l4x5n

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-4b62745d-7f49c69494-l4x5n

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-4b62745d-7f49c69494-l4x5n

AddedInterface

Add eth0 [10.133.0.71/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-4b62745d-69fc6f6f5c

SuccessfulCreate

Created pod: payload-processing-e2e-mt-4b62745d-69fc6f6f5c-thkhg

openshift-ingress

kubelet

payload-processing-e2e-mt-4b62745d-69fc6f6f5c-thkhg

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-4b62745d-7f49c69494-l4x5n

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-4b62745d-69fc6f6f5c-thkhg

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-4b62745d-69fc6f6f5c-thkhg

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.655s (1.655s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-processing-e2e-mt-4b62745d-69fc6f6f5c-thkhg

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-mt-4b62745d-openshift-default-d99f9d5b4-w6hh5

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-4b62745d-openshift-default-d99f9d5b4-w6hh5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-4b62745d-openshift-default-d99f9d5b4-w6hh5

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-4b62745d-openshift-default-d99f9d5b4-w6hh5

Unhealthy

Startup probe failed: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-4b62745d-openshift-default-d99f9d5b4-w6hh5

ProbeError

Startup probe error: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-4b62745d-7f49c69494-l4x5n

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-4b62745d-69fc6f6f5c-thkhg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-4b62745d-openshift-default-d99f9d5b4-w6hh5

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-api-a-e171e4-openshift-default-5df4c946b6-qp9f8

AddedInterface

Add eth0 [10.132.0.67/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-api-a-e171e4-openshift-default-5df4c946b6

SuccessfulCreate

Created pod: e2e-api-a-e171e4-openshift-default-5df4c946b6-qp9f8

openshift-ingress

gateway_labeler_controller

e2e-api-a-e171e4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-e171e4

openshift-ingress

deployment-controller

e2e-api-a-e171e4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-e171e4-openshift-default-5df4c946b6 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-e171e4-8dd49c65d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-e171e4-8dd49c65d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-e171e4: serviceaccount "payload-processing-e2e-api-a-e171e4" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-e171e4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-e171e4-68c7fd9bf from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-e171e4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-e171e4-8dd49c65d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-e171e4-68c7fd9bf

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-e171e4-68c7fd9bf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-e171e4: serviceaccount "payload-processing-e2e-api-a-e171e4" not found

openshift-ingress

multus

payload-processing-e2e-api-a-e171e4-68c7fd9bf-2nllk

AddedInterface

Add eth0 [10.133.0.72/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-api-a-e171e4-8dd49c65d-srsv2

AddedInterface

Add eth0 [10.132.0.68/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-e171e4-8dd49c65d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-e171e4-8dd49c65d-srsv2

openshift-ingress

kubelet

payload-processing-e2e-api-a-e171e4-68c7fd9bf-2nllk

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-e171e4-68c7fd9bf-2nllk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-a-e171e4-68c7fd9bf-2nllk

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-e171e4-8dd49c65d-srsv2

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-e171e4-68c7fd9bf

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-e171e4-68c7fd9bf-2nllk

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-e171e4-8dd49c65d-srsv2

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-e171e4-8dd49c65d-srsv2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-e171e4-openshift-default-5df4c946b6-qp9f8

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-e171e4-openshift-default-5df4c946b6-qp9f8

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-e171e4-openshift-default-5df4c946b6-qp9f8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

deployment-controller

e2e-api-b-d850e3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-d850e3-openshift-default-6489bbd5c6 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-d850e3-openshift-default-6489bbd5c6

SuccessfulCreate

Created pod: e2e-api-b-d850e3-openshift-default-6489bbd5c6-dtxm7

openshift-ingress

gateway_labeler_controller

e2e-api-b-d850e3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-d850e3
(x6)

openshift-ingress

kubelet

e2e-api-a-e171e4-openshift-default-5df4c946b6-qp9f8

ProbeError

Startup probe error: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-a-e171e4-openshift-default-5df4c946b6-qp9f8

Unhealthy

Startup probe failed: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused

openshift-ingress

multus

e2e-api-b-d850e3-openshift-default-6489bbd5c6-dtxm7

AddedInterface

Add eth0 [10.132.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-d850e3-685859947d-v2jln

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-d850e3-64c6f78799-rkl29

Created

Created container: payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-d850e3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-d850e3-685859947d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-d850e3-685859947d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-d850e3-685859947d-v2jln
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-d850e3-685859947d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-d850e3-685859947d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-d850e3: serviceaccount "payload-processing-e2e-api-b-d850e3" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-d850e3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-d850e3-64c6f78799 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-d850e3-685859947d-v2jln

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-d850e3-64c6f78799-rkl29

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-d850e3-685859947d-v2jln

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-b-d850e3-685859947d-v2jln

AddedInterface

Add eth0 [10.132.0.71/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-api-b-d850e3-64c6f78799-rkl29

AddedInterface

Add eth0 [10.133.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-d850e3-64c6f78799-rkl29

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-d850e3-64c6f78799

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-d850e3-64c6f78799-rkl29
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-d850e3-64c6f78799

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-d850e3-64c6f78799-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-d850e3: serviceaccount "payload-processing-e2e-api-b-d850e3" not found
(x2)

openshift-ingress

kubelet

e2e-api-b-d850e3-openshift-default-6489bbd5c6-dtxm7

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-d850e3-openshift-default-6489bbd5c6-dtxm7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-d850e3-openshift-default-6489bbd5c6-dtxm7

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-b-d850e3-openshift-default-6489bbd5c6-dtxm7

Unhealthy

Startup probe failed: Get "http://10.132.0.70:15021/healthz/ready": dial tcp 10.132.0.70:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-b-d850e3-openshift-default-6489bbd5c6-dtxm7

ProbeError

Startup probe error: Get "http://10.132.0.70:15021/healthz/ready": dial tcp 10.132.0.70:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-e171e4-8dd49c65d-srsv2

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-api-a-e171e4

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-api-a-e171e4: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-api-a-e171e4": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-api-a-e171e4, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 6161648a-8eaf-449f-b6c2-996d89ab5dd1, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-api-a-e171e4-68c7fd9bf-2nllk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-a-e171e4-openshift-default-5df4c946b6-qp9f8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-api-b-d850e3-64c6f78799-rkl29

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-d850e3-685859947d-v2jln

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-api-b-d850e3

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-api-b-d850e3: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-api-b-d850e3": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-api-b-d850e3, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 00bf3c4e-1e67-4c9f-82d9-6c1e883fef04, UID in object meta:

openshift-ingress

kubelet

e2e-api-b-d850e3-openshift-default-6489bbd5c6-dtxm7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-8b6928-784b6f6b58-nndml

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-8b6928-586675ddf9-mfhcx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w2-8b6928-openshift-default-7d8b466968-k4h4t

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-cec446-6bbdc87865-c4srn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-cec446-5cb9c958f4-lxq9r

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w2-cec446-openshift-default-5dd5bb76f8-262pr

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-3d4dc1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-3d4dc1

openshift-ingress

replicaset-controller

e2e-ipp-a-3d4dc1-openshift-default-694fd9d968

SuccessfulCreate

Created pod: e2e-ipp-a-3d4dc1-openshift-default-694fd9d968-clndt

openshift-ingress

multus

e2e-ipp-a-3d4dc1-openshift-default-694fd9d968-clndt

AddedInterface

Add eth0 [10.134.0.71/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ipp-a-3d4dc1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-3d4dc1-openshift-default-694fd9d968 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-3d4dc1-7b46775b99

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-3d4dc1-7b46775b99-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-3d4dc1: serviceaccount "payload-processing-e2e-ipp-a-3d4dc1" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-3d4dc1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-3d4dc1-695fb45fbb from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-3d4dc1-695fb45fbb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-3d4dc1-695fb45fbb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-3d4dc1: serviceaccount "payload-processing-e2e-ipp-a-3d4dc1" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-3d4dc1-695fb45fbb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-3d4dc1-695fb45fbb-m6k4t

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-3d4dc1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-3d4dc1-7b46775b99 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-3d4dc1-7b46775b99

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-3d4dc1-7b46775b99-chnwq

openshift-ingress

multus

payload-processing-e2e-ipp-a-3d4dc1-7b46775b99-chnwq

AddedInterface

Add eth0 [10.133.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-3d4dc1-7b46775b99-chnwq

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-3d4dc1-7b46775b99-chnwq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-3d4dc1-7b46775b99-chnwq

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-3d4dc1-695fb45fbb-m6k4t

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-3d4dc1-695fb45fbb-m6k4t

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-3d4dc1-695fb45fbb-m6k4t

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-3d4dc1-695fb45fbb-m6k4t

AddedInterface

Add eth0 [10.133.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-3d4dc1-openshift-default-694fd9d968-clndt

ProbeError

Readiness probe error: Get "http://10.134.0.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-a-3d4dc1-openshift-default-694fd9d968-clndt

Unhealthy

Readiness probe failed: Get "http://10.134.0.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ipp-a-3d4dc1-openshift-default-694fd9d968-clndt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-3d4dc1-openshift-default-694fd9d968-clndt

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-3d4dc1-openshift-default-694fd9d968-clndt

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-a-3d4dc1-openshift-default-694fd9d968-clndt

Unhealthy

Startup probe failed: Get "http://10.134.0.71:15021/healthz/ready": dial tcp 10.134.0.71:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-3d4dc1-openshift-default-694fd9d968-clndt

ProbeError

Startup probe error: Get "http://10.134.0.71:15021/healthz/ready": dial tcp 10.134.0.71:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-d14aea

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-d14aea

openshift-ingress

replicaset-controller

e2e-ipp-b-d14aea-openshift-default-6b4c475cd4

SuccessfulCreate

Created pod: e2e-ipp-b-d14aea-openshift-default-6b4c475cd4-9gzsp

openshift-ingress

deployment-controller

e2e-ipp-b-d14aea-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-d14aea-openshift-default-6b4c475cd4 from 0 to 1

openshift-ingress

GatewayAuthBootstrap

e2e-ipp-b-d14aea

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-ipp-b-d14aea-authn-ssl: envoyfilters.networking.istio.io "e2e-ipp-b-d14aea-authn-ssl" already exists

openshift-ingress

multus

e2e-ipp-b-d14aea-openshift-default-6b4c475cd4-9gzsp

AddedInterface

Add eth0 [10.134.0.72/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-d14aea-5c4975697d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-d14aea-5c4975697d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-d14aea: serviceaccount "payload-processing-e2e-ipp-b-d14aea" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-d14aea-79fb454499

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-d14aea-79fb454499-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-d14aea: serviceaccount "payload-processing-e2e-ipp-b-d14aea" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-d14aea-79fb454499

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-d14aea-79fb454499-4sb89

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-d14aea

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-d14aea-79fb454499 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-d14aea

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-d14aea-5c4975697d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-d14aea-5c4975697d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-d14aea-5c4975697d-h6q7p

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-d14aea-5c4975697d-h6q7p

AddedInterface

Add eth0 [10.132.0.81/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-d14aea-5c4975697d-h6q7p

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-d14aea-79fb454499-4sb89

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-d14aea-79fb454499-4sb89

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-d14aea-79fb454499-4sb89

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-b-d14aea-79fb454499-4sb89

AddedInterface

Add eth0 [10.132.0.80/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-d14aea-5c4975697d-h6q7p

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-d14aea-5c4975697d-h6q7p

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-d14aea-openshift-default-6b4c475cd4-9gzsp

Unhealthy

Readiness probe failed: Get "http://10.134.0.72:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-b-d14aea-openshift-default-6b4c475cd4-9gzsp

ProbeError

Readiness probe error: Get "http://10.134.0.72:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ipp-b-d14aea-openshift-default-6b4c475cd4-9gzsp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-d14aea-openshift-default-6b4c475cd4-9gzsp

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-d14aea-openshift-default-6b4c475cd4-9gzsp

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-ipp-b-d14aea-openshift-default-6b4c475cd4-9gzsp

Unhealthy

Startup probe failed: Get "http://10.134.0.72:15021/healthz/ready": dial tcp 10.134.0.72:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-b-d14aea-openshift-default-6b4c475cd4-9gzsp

ProbeError

Startup probe error: Get "http://10.134.0.72:15021/healthz/ready": dial tcp 10.134.0.72:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-d9d46f-openshift-default-589755b94b

SuccessfulCreate

Created pod: e2e-ipp-cleanup-d9d46f-openshift-default-589755b94b-6ffsh

openshift-ingress

deployment-controller

e2e-ipp-cleanup-d9d46f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-d9d46f-openshift-default-589755b94b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-d9d46f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-d9d46f

openshift-ingress

multus

e2e-ipp-cleanup-d9d46f-openshift-default-589755b94b-6ffsh

AddedInterface

Add eth0 [10.134.0.74/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-d9d46f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-d9d46f-75994f9c from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-d9d46f-7df8998-x7jzc

AddedInterface

Add eth0 [10.132.0.86/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-d9d46f-7df8998-x7jzc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-d9d46f-75994f9c-fvc9v

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-d9d46f-75994f9c

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-d9d46f-75994f9c-fvc9v
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-d9d46f-75994f9c

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-d9d46f-75994f9c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-d9d46f: serviceaccount "payload-processing-e2e-ipp-cleanup-d9d46f" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-d9d46f-7df8998-x7jzc

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-d9d46f-7df8998-x7jzc

Started

Started container payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-d9d46f-7df8998

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-d9d46f-7df8998-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-d9d46f: serviceaccount "payload-processing-e2e-ipp-cleanup-d9d46f" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-d9d46f-7df8998

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-d9d46f-7df8998-x7jzc

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-d9d46f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-d9d46f-7df8998 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-d9d46f-75994f9c-fvc9v

AddedInterface

Add eth0 [10.133.0.80/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-d9d46f-75994f9c-fvc9v

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-d9d46f-75994f9c-fvc9v

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-d9d46f-openshift-default-589755b94b-6ffsh

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-d9d46f-openshift-default-589755b94b-6ffsh

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-d9d46f-openshift-default-589755b94b-6ffsh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-d9d46f-openshift-default-589755b94b-6ffsh

Unhealthy

Startup probe failed: Get "http://10.134.0.74:15021/healthz/ready": dial tcp 10.134.0.74:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-d9d46f-openshift-default-589755b94b-6ffsh

ProbeError

Startup probe error: Get "http://10.134.0.74:15021/healthz/ready": dial tcp 10.134.0.74:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-d9d46f-75994f9c-fvc9v

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-d9d46f-7df8998-x7jzc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-d9d46f-openshift-default-589755b94b-6ffsh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-cleanup-d9d46f-openshift-default-589755b94b-6ffsh

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-cleanup-d9d46f-openshift-default-589755b94b-6ffsh

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-3d4dc1-7b46775b99-chnwq

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-a-3d4dc1

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-a-3d4dc1: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-a-3d4dc1": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-a-3d4dc1, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 2a206599-8477-43fd-9ffe-fa5a414896d9, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-3d4dc1-695fb45fbb-m6k4t

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-3d4dc1-openshift-default-694fd9d968-clndt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-3d4dc1-openshift-default-694fd9d968-clndt

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-a-3d4dc1-openshift-default-694fd9d968-clndt

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-d14aea-79fb454499-4sb89

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-d14aea-5c4975697d-h6q7p

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-d14aea-openshift-default-6b4c475cd4-9gzsp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-8c2e20-69b657c959-6cf22

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-8c2e20-9f8c79846-djcpk

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-a-w3-8c2e20

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-a-w3-8c2e20: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-a-w3-8c2e20": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-a-w3-8c2e20, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: b6020c57-d381-4c4a-91f8-c8aeee30b1f3, UID in object meta:

openshift-ingress

kubelet

e2e-shared-a-w3-8c2e20-openshift-default-69495bf976-jxlsj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-5ef325-7dc8b66945-x2lcf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-5ef325-5cc47d8bfd-c9nqp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w3-5ef325-openshift-default-78d9c848db-cjq2t

Killing

Stopping container istio-proxy