Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-processing-e2e-inf-b-2f1093-6f9dd76bf-xhj97

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-2f1093-6f9dd76bf-xhj97 to ip-10-0-131-138.ec2.internal

openshift-ingress

e2e-noten-085b3b-openshift-default-6567d88cfb-txngj

Scheduled

Successfully assigned openshift-ingress/e2e-noten-085b3b-openshift-default-6567d88cfb-txngj to ip-10-0-131-138.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-64df4d9a-5b79cc988b-q6h5d

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-64df4d9a-5b79cc988b-q6h5d to ip-10-0-142-242.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-s27sr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-s27sr to ip-10-0-142-242.ec2.internal

openshift-ingress

e2e-mt-1407ad96-openshift-default-6c86bb8856-fbv69

Scheduled

Successfully assigned openshift-ingress/e2e-mt-1407ad96-openshift-default-6c86bb8856-fbv69 to ip-10-0-129-90.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-c990a5-6b6958b96c-t2dtw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-c990a5-6b6958b96c-t2dtw to ip-10-0-142-242.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-b0b7bb86-786bd857b6-kmpw7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-b0b7bb86-786bd857b6-kmpw7 to ip-10-0-142-242.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-b32e7b-68f97fd686-x2ltb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-b32e7b-68f97fd686-x2ltb to ip-10-0-131-138.ec2.internal

openshift-ingress

e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f

Scheduled

Successfully assigned openshift-ingress/e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f to ip-10-0-131-138.ec2.internal

openshift-ingress

payload-processing-e2e-mt-1407ad96-585588cf9c-64tqn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-1407ad96-585588cf9c-64tqn to ip-10-0-131-138.ec2.internal

openshift-ingress

e2e-shared-b-w3-4f14bf-openshift-default-6489b97b4d-k8jhs

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-4f14bf-openshift-default-6489b97b4d-k8jhs to ip-10-0-129-90.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-d7dqd

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-d7dqd to ip-10-0-131-138.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-fb3998b8-b4d4dbd5d-x4zdh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-fb3998b8-b4d4dbd5d-x4zdh to ip-10-0-142-242.ec2.internal

openshift-ingress

payload-processing-e2e-autores-794622-b6745797-2s8kf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-794622-b6745797-2s8kf to ip-10-0-131-138.ec2.internal

openshift-ingress

e2e-ipp-cleanup-8e4477-openshift-default-5b95bcc846-xx4x4

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-8e4477-openshift-default-5b95bcc846-xx4x4 to ip-10-0-129-90.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-8e4477-75f5688f65-2qvqg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-8e4477-75f5688f65-2qvqg to ip-10-0-142-242.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-912593-546857d58b-tzfkg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-912593-546857d58b-tzfkg to ip-10-0-142-242.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-7621a1-5c7f44bd95-xfmdq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-7621a1-5c7f44bd95-xfmdq to ip-10-0-142-242.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-dc47cd-9ff48c65f-lbnhl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-dc47cd-9ff48c65f-lbnhl to ip-10-0-131-138.ec2.internal

openshift-ingress

e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464

Scheduled

Successfully assigned openshift-ingress/e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464 to ip-10-0-131-138.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-l9wz9

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-l9wz9 to ip-10-0-142-242.ec2.internal

openshift-ingress

e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc to ip-10-0-131-138.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-058069-9d7c49f9f-xjpzc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-058069-9d7c49f9f-xjpzc to ip-10-0-131-138.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-b32e7b-fbdcb7869-dj6f7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-b32e7b-fbdcb7869-dj6f7 to ip-10-0-131-138.ec2.internal

openshift-ingress

payload-processing-e2e-ait-b0b7bb86-56b977d665-rtp7k

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-b0b7bb86-56b977d665-rtp7k to ip-10-0-142-242.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-794622-b7cbcf4cd-p96t8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-794622-b7cbcf4cd-p96t8 to ip-10-0-142-242.ec2.internal

openshift-ingress

e2e-ipp-b-7621a1-openshift-default-8574db548-nvdkn

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-7621a1-openshift-default-8574db548-nvdkn to ip-10-0-129-90.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-762738-5f6c6c4f77-s85h7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-762738-5f6c6c4f77-s85h7 to ip-10-0-142-242.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-e67dcae3-856d94b8cd-gcpbr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-e67dcae3-856d94b8cd-gcpbr to ip-10-0-142-242.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-14b3e7-58cc55d6cd-7qlfx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-14b3e7-58cc55d6cd-7qlfx to ip-10-0-142-242.ec2.internal

openshift-ingress

e2e-api-a-b32e7b-openshift-default-574bf5c46-998xm

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-b32e7b-openshift-default-574bf5c46-998xm to ip-10-0-129-90.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-0d25fa-88fc4ccbb-mh9t4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-0d25fa-88fc4ccbb-mh9t4 to ip-10-0-131-138.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-058069-5c94c696d6-p47pg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-058069-5c94c696d6-p47pg to ip-10-0-131-138.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-762738-7f7bd79dd6-52hph

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-762738-7f7bd79dd6-52hph to ip-10-0-131-138.ec2.internal

openshift-ingress

payload-processing-e2e-derive-e67dcae3-6d8cf57497-qgb68

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-e67dcae3-6d8cf57497-qgb68 to ip-10-0-142-242.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-4f14bf-dcb955d86-92sdw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-4f14bf-dcb955d86-92sdw to ip-10-0-131-138.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-aee2c26d-6fd9f94bb6-mjhh9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-aee2c26d-6fd9f94bb6-mjhh9 to ip-10-0-142-242.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-1407ad96-6cd97c7cf4-bxjsw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-1407ad96-6cd97c7cf4-bxjsw to ip-10-0-131-138.ec2.internal

openshift-ingress

e2e-migrate-fb3998b8-gw-openshift-default-74d65bbc76-bbfgs

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-fb3998b8-gw-openshift-default-74d65bbc76-bbfgs to ip-10-0-129-90.ec2.internal

openshift-ingress

e2e-explicit-14b3e7-openshift-default-7784fccbb4-sdhvl

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-14b3e7-openshift-default-7784fccbb4-sdhvl to ip-10-0-129-90.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-2f4pf

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-2f4pf to ip-10-0-131-138.ec2.internal

openshift-ingress

e2e-api-b-912593-openshift-default-7c76d7f464-www7c

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-912593-openshift-default-7c76d7f464-www7c to ip-10-0-129-90.ec2.internal

openshift-ingress

payload-processing-e2e-mt-aee2c26d-6b9f644f4f-45pm5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-aee2c26d-6b9f644f4f-45pm5 to ip-10-0-142-242.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-nbdb5

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nbdb5 to ip-10-0-131-138.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-fb3998b8-5f8cccc6b-7wjbz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-fb3998b8-5f8cccc6b-7wjbz to ip-10-0-142-242.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-qbv42

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qbv42 to ip-10-0-131-138.ec2.internal

openshift-ingress

router-default-9d87c44-k7klw

Scheduled

Successfully assigned openshift-ingress/router-default-9d87c44-k7klw to ip-10-0-131-138.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-4f14bf-7ff9b9f9c5-xwwtj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-4f14bf-7ff9b9f9c5-xwwtj to ip-10-0-131-138.ec2.internal

openshift-ingress

e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn to ip-10-0-131-138.ec2.internal

openshift-ingress

e2e-mt-aee2c26d-openshift-default-597955567b-jjhsn

Scheduled

Successfully assigned openshift-ingress/e2e-mt-aee2c26d-openshift-default-597955567b-jjhsn to ip-10-0-129-90.ec2.internal

openshift-ingress

payload-processing-e2e-ait-64df4d9a-8559c8b7f9-xd72n

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-64df4d9a-8559c8b7f9-xd72n to ip-10-0-142-242.ec2.internal

openshift-ingress

e2e-shared-b-w2-762738-openshift-default-699567cb6-rp2jw

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-762738-openshift-default-699567cb6-rp2jw to ip-10-0-129-90.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-2f1093-64d787b846-c9bls

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-2f1093-64d787b846-c9bls to ip-10-0-142-242.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-912593-678c6f7f67-9cnnc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-912593-678c6f7f67-9cnnc to ip-10-0-131-138.ec2.internal

openshift-ingress

e2e-autores-794622-openshift-default-846d6d74-v8xsr

Scheduled

Successfully assigned openshift-ingress/e2e-autores-794622-openshift-default-846d6d74-v8xsr to ip-10-0-131-138.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-dc47cd-f8b445f6b-d9q5q

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-dc47cd-f8b445f6b-d9q5q to ip-10-0-131-138.ec2.internal

openshift-ingress

e2e-inf-b-2f1093-openshift-default-858454c7cd-hg2kb

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-2f1093-openshift-default-858454c7cd-hg2kb to ip-10-0-129-90.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-c990a5-658fd9c97d-xsmvl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-c990a5-658fd9c97d-xsmvl to ip-10-0-142-242.ec2.internal

openshift-ingress

e2e-derive-e67dcae3-openshift-default-6f77ddf8b4-9d77c

Scheduled

Successfully assigned openshift-ingress/e2e-derive-e67dcae3-openshift-default-6f77ddf8b4-9d77c to ip-10-0-129-90.ec2.internal

openshift-ingress

e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f to ip-10-0-131-138.ec2.internal

openshift-ingress

kube-auth-proxy-7bf54bbc88-h467l

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-7bf54bbc88-h467l to ip-10-0-142-242.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-7621a1-bfd4597cd-h2wrg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-7621a1-bfd4597cd-h2wrg to ip-10-0-142-242.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-0d25fa-7466d57c65-jxw6k

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-0d25fa-7466d57c65-jxw6k to ip-10-0-131-138.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-8e4477-5c67889474-grlh7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8e4477-5c67889474-grlh7 to ip-10-0-131-138.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-14b3e7-68bfcd444f-brssc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-14b3e7-68bfcd444f-brssc to ip-10-0-131-138.ec2.internal

openshift-ingress

e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k to ip-10-0-131-138.ec2.internal

openshift-ingress

kube-auth-proxy-7bf54bbc88-gb5nr

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-7bf54bbc88-gb5nr to ip-10-0-129-90.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-9d87c44 from 0 to 1

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer
(x8)

openshift-ingress

replicaset-controller

router-default-9d87c44

FailedCreate

Error creating: pods "router-default-9d87c44-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x16)

openshift-ingress

replicaset-controller

router-default-9d87c44

FailedCreate

Error creating: pods "router-default-9d87c44-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-9d87c44

SuccessfulCreate

Created pod: router-default-9d87c44-k7klw
(x5)

openshift-ingress

kubelet

router-default-9d87c44-k7klw

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x6)

openshift-ingress

kubelet

router-default-9d87c44-k7klw

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

kubelet

router-default-9d87c44-k7klw

Started

Started container router

openshift-ingress

multus

router-default-9d87c44-k7klw

AddedInterface

Add eth0 [10.134.0.9/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-9d87c44-k7klw

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:da130d90f0bffd5c5876c94544c91b2a1be0d23ce2747ddfeafe88e03ee7d8d1" already present on machine

openshift-ingress

kubelet

router-default-9d87c44-k7klw

Created

Created container: router

openshift-ingress

kubelet

kube-auth-proxy-7bf54bbc88-h467l

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

kubelet

kube-auth-proxy-7bf54bbc88-gb5nr

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-7bf54bbc88 from 0 to 2

openshift-ingress

replicaset-controller

kube-auth-proxy-7bf54bbc88

SuccessfulCreate

Created pod: kube-auth-proxy-7bf54bbc88-gb5nr

openshift-ingress

replicaset-controller

kube-auth-proxy-7bf54bbc88

SuccessfulCreate

Created pod: kube-auth-proxy-7bf54bbc88-h467l
(x3)

openshift-ingress

replicaset-controller

kube-auth-proxy-7bf54bbc88

FailedCreate

Error creating: pods "kube-auth-proxy-7bf54bbc88-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

kubelet

kube-auth-proxy-7bf54bbc88-h467l

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-7bf54bbc88-gb5nr

AddedInterface

Add eth0 [10.132.0.28/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

multus

kube-auth-proxy-7bf54bbc88-h467l

AddedInterface

Add eth0 [10.133.0.20/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-l9wz9

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-l9wz9

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

kube-auth-proxy-7bf54bbc88-gb5nr

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-l9wz9

AddedInterface

Add eth0 [10.133.0.21/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-7bf54bbc88-gb5nr

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.528s (2.528s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-7bf54bbc88-gb5nr

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-7bf54bbc88-h467l

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 3.292s (3.292s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-7bf54bbc88-h467l

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-7bf54bbc88-h467l

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-7bf54bbc88-gb5nr

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-l9wz9

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 4.215s (4.215s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-l9wz9

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-l9wz9

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-l9wz9

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-qbv42

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-l9wz9

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-qbv42

AddedInterface

Add eth0 [10.134.0.29/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-qbv42

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-qbv42

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-qbv42

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-qbv42

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.733s (2.733s including waiting). Image size: 181318953 bytes.

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-d7dqd

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-d7dqd

AddedInterface

Add eth0 [10.134.0.31/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-d7dqd

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-d7dqd

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-d7dqd

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-d7dqd

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.212s (2.212s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-l9wz9

Killing

Stopping container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-l9wz9

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-nbdb5

AddedInterface

Add eth0 [10.134.0.36/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-nbdb5

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-2f4pf
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-s27sr

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1

openshift-ingress

multus

payload-processing-5b54b7fbb7-2f4pf

AddedInterface

Add eth0 [10.134.0.37/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-s27sr

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-2f4pf

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-s27sr

AddedInterface

Add eth0 [10.133.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-s27sr

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.765s (1.765s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-s27sr

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-s27sr

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-2f4pf

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-2f4pf

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.947s (1.947s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-2f4pf

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-nbdb5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-nbdb5

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-nbdb5

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-nbdb5

Unhealthy

Startup probe failed: Get "http://10.134.0.36:15021/healthz/ready": dial tcp 10.134.0.36:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-nbdb5

ProbeError

Startup probe error: Get "http://10.134.0.36:15021/healthz/ready": dial tcp 10.134.0.36:15021: connect: connection refused body:

openshift-ingress

multus

e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-inf-a-0d25fa-openshift-default-69b8dd7d94

SuccessfulCreate

Created pod: e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f

openshift-ingress

deployment-controller

e2e-inf-a-0d25fa-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-0d25fa-openshift-default-69b8dd7d94 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-a-0d25fa

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-0d25fa

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-0d25fa-88fc4ccbb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-0d25fa-88fc4ccbb-mh9t4
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-0d25fa-88fc4ccbb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-0d25fa-88fc4ccbb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-0d25fa: serviceaccount "payload-processing-e2e-inf-a-0d25fa" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-0d25fa-7466d57c65

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-0d25fa-7466d57c65-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-0d25fa: serviceaccount "payload-processing-e2e-inf-a-0d25fa" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-0d25fa-7466d57c65

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-0d25fa-7466d57c65-jxw6k

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-0d25fa

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-0d25fa-7466d57c65 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-0d25fa

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-0d25fa-88fc4ccbb from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-a-0d25fa-7466d57c65-jxw6k

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-0d25fa-88fc4ccbb-mh9t4

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-inf-a-0d25fa-7466d57c65-jxw6k

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-0d25fa-7466d57c65-jxw6k

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-0d25fa-88fc4ccbb-mh9t4

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-0d25fa-7466d57c65-jxw6k

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-0d25fa-88fc4ccbb-mh9t4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-0d25fa-88fc4ccbb-mh9t4

Created

Created container: payload-pre-processing

openshift-ingress

deployment-controller

e2e-ait-64df4d9a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-64df4d9a-openshift-default-68dfcdd96 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-64df4d9a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-64df4d9a

openshift-ingress

replicaset-controller

e2e-ait-64df4d9a-openshift-default-68dfcdd96

SuccessfulCreate

Created pod: e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f

openshift-ingress

multus

e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-autores-794622-openshift-default-846d6d74

SuccessfulCreate

Created pod: e2e-autores-794622-openshift-default-846d6d74-v8xsr

openshift-ingress

deployment-controller

e2e-autores-794622-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-794622-openshift-default-846d6d74 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-autores-794622

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-794622

openshift-ingress

multus

e2e-autores-794622-openshift-default-846d6d74-v8xsr

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-64df4d9a-8559c8b7f9-xd72n

Created

Created container: payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-ait-64df4d9a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-64df4d9a-8559c8b7f9 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-64df4d9a-5b79cc988b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-64df4d9a-5b79cc988b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-64df4d9a: serviceaccount "payload-processing-e2e-ait-64df4d9a" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-64df4d9a-8559c8b7f9

SuccessfulCreate

Created pod: payload-processing-e2e-ait-64df4d9a-8559c8b7f9-xd72n
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-64df4d9a-8559c8b7f9

FailedCreate

Error creating: pods "payload-processing-e2e-ait-64df4d9a-8559c8b7f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-64df4d9a: serviceaccount "payload-processing-e2e-ait-64df4d9a" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-64df4d9a-5b79cc988b-q6h5d

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-64df4d9a-5b79cc988b-q6h5d

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-64df4d9a-8559c8b7f9-xd72n

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-64df4d9a-8559c8b7f9-xd72n

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-64df4d9a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-64df4d9a-5b79cc988b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-64df4d9a-5b79cc988b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-64df4d9a-5b79cc988b-q6h5d

openshift-ingress

multus

payload-pre-processing-e2e-ait-64df4d9a-5b79cc988b-q6h5d

AddedInterface

Add eth0 [10.133.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-64df4d9a-8559c8b7f9-xd72n

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-64df4d9a-5b79cc988b-q6h5d

Started

Started container payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-794622-b7cbcf4cd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-794622-b7cbcf4cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-794622: serviceaccount "payload-processing-e2e-autores-794622" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-794622-b6745797

SuccessfulCreate

Created pod: payload-processing-e2e-autores-794622-b6745797-2s8kf

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-794622-b7cbcf4cd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-794622-b7cbcf4cd-p96t8

openshift-ingress

deployment-controller

payload-processing-e2e-autores-794622

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-794622-b6745797 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-794622

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-794622-b7cbcf4cd from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-794622-b6745797

FailedCreate

Error creating: pods "payload-processing-e2e-autores-794622-b6745797-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-794622: serviceaccount "payload-processing-e2e-autores-794622" not found

openshift-ingress

kubelet

payload-processing-e2e-autores-794622-b6745797-2s8kf

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-794622-b7cbcf4cd-p96t8

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-autores-794622-b6745797-2s8kf

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-794622-b6745797-2s8kf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-autores-794622-b6745797-2s8kf

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-794622-b7cbcf4cd-p96t8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-autores-794622-b7cbcf4cd-p96t8

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-794622-b7cbcf4cd-p96t8

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f

ProbeError

Startup probe error: Get "http://10.134.0.39:15021/healthz/ready": dial tcp 10.134.0.39:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f

Unhealthy

Startup probe failed: Get "http://10.134.0.39:15021/healthz/ready": dial tcp 10.134.0.39:15021: connect: connection refused

openshift-ingress

kubelet

e2e-inf-b-2f1093-openshift-default-858454c7cd-hg2kb

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

e2e-autores-794622-openshift-default-846d6d74-v8xsr

ProbeError

Readiness probe error: Get "http://10.134.0.43:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

gateway_labeler_controller

e2e-inf-b-2f1093

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-2f1093

openshift-ingress

multus

e2e-inf-b-2f1093-openshift-default-858454c7cd-hg2kb

AddedInterface

Add eth0 [10.132.0.36/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-autores-794622-openshift-default-846d6d74-v8xsr

Unhealthy

Readiness probe failed: Get "http://10.134.0.43:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

deployment-controller

e2e-inf-b-2f1093-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-2f1093-openshift-default-858454c7cd from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-2f1093-openshift-default-858454c7cd

SuccessfulCreate

Created pod: e2e-inf-b-2f1093-openshift-default-858454c7cd-hg2kb
(x2)

openshift-ingress

kubelet

e2e-autores-794622-openshift-default-846d6d74-v8xsr

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-794622-openshift-default-846d6d74-v8xsr

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-2f1093-openshift-default-858454c7cd-hg2kb

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.696s (2.696s including waiting). Image size: 181318953 bytes.
(x2)

openshift-ingress

kubelet

e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-autores-794622-openshift-default-846d6d74-v8xsr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-2f1093-64d787b846

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-2f1093-64d787b846-c9bls
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-2f1093-6f9dd76bf

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-2f1093-6f9dd76bf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-2f1093: serviceaccount "payload-processing-e2e-inf-b-2f1093" not found
(x5)

openshift-ingress

kubelet

e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f

ProbeError

Startup probe error: Get "http://10.134.0.42:15021/healthz/ready": dial tcp 10.134.0.42:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f

Unhealthy

Startup probe failed: Get "http://10.134.0.42:15021/healthz/ready": dial tcp 10.134.0.42:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-2f1093

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-2f1093-64d787b846 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-2f1093-64d787b846

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-2f1093-64d787b846-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-2f1093: serviceaccount "payload-processing-e2e-inf-b-2f1093" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-2f1093-6f9dd76bf

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-2f1093-6f9dd76bf-xhj97

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-2f1093

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-2f1093-6f9dd76bf from 0 to 1
(x5)

openshift-ingress

kubelet

e2e-autores-794622-openshift-default-846d6d74-v8xsr

Unhealthy

Startup probe failed: Get "http://10.134.0.43:15021/healthz/ready": dial tcp 10.134.0.43:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-autores-794622-openshift-default-846d6d74-v8xsr

ProbeError

Startup probe error: Get "http://10.134.0.43:15021/healthz/ready": dial tcp 10.134.0.43:15021: connect: connection refused body:

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-2f1093-64d787b846-c9bls

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-2f1093-64d787b846-c9bls

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-2f1093-64d787b846-c9bls

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-2f1093-6f9dd76bf-xhj97

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-2f1093-64d787b846-c9bls

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-2f1093-6f9dd76bf-xhj97

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-inf-b-2f1093-6f9dd76bf-xhj97

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-2f1093-6f9dd76bf-xhj97

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-64df4d9a-8559c8b7f9-xd72n

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-64df4d9a-5b79cc988b-q6h5d

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-64df4d9a-openshift-default-68dfcdd96-6k58f

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-migrate-fb3998b8-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-fb3998b8-gw

openshift-ingress

deployment-controller

e2e-migrate-fb3998b8-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-fb3998b8-gw-openshift-default-74d65bbc76 from 0 to 1

openshift-ingress

replicaset-controller

e2e-migrate-fb3998b8-gw-openshift-default-74d65bbc76

SuccessfulCreate

Created pod: e2e-migrate-fb3998b8-gw-openshift-default-74d65bbc76-bbfgs

openshift-ingress

multus

e2e-migrate-fb3998b8-gw-openshift-default-74d65bbc76-bbfgs

AddedInterface

Add eth0 [10.132.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-2f1093-openshift-default-858454c7cd-hg2kb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-2f1093-openshift-default-858454c7cd-hg2kb

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-2f1093-openshift-default-858454c7cd-hg2kb

Created

Created container: istio-proxy

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-fb3998b8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-fb3998b8-5f8cccc6b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-fb3998b8-5f8cccc6b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-fb3998b8-5f8cccc6b-7wjbz
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-fb3998b8-5f8cccc6b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-fb3998b8-5f8cccc6b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-fb3998b8: serviceaccount "payload-processing-e2e-migrate-fb3998b8" not found

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-fb3998b8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-fb3998b8-b4d4dbd5d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-fb3998b8-b4d4dbd5d

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-fb3998b8-b4d4dbd5d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-fb3998b8: serviceaccount "payload-processing-e2e-migrate-fb3998b8" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-fb3998b8-b4d4dbd5d

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-fb3998b8-b4d4dbd5d-x4zdh

openshift-ingress

kubelet

payload-processing-e2e-migrate-fb3998b8-b4d4dbd5d-x4zdh

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-migrate-fb3998b8-b4d4dbd5d-x4zdh

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-fb3998b8-b4d4dbd5d-x4zdh

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-migrate-fb3998b8-5f8cccc6b-7wjbz

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-fb3998b8-5f8cccc6b-7wjbz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-fb3998b8-5f8cccc6b-7wjbz

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-fb3998b8-5f8cccc6b-7wjbz

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-fb3998b8-b4d4dbd5d-x4zdh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

kubelet

e2e-inf-b-2f1093-openshift-default-858454c7cd-hg2kb

Unhealthy

Startup probe failed: Get "http://10.132.0.36:15021/healthz/ready": dial tcp 10.132.0.36:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-b-2f1093-openshift-default-858454c7cd-hg2kb

ProbeError

Startup probe error: Get "http://10.132.0.36:15021/healthz/ready": dial tcp 10.132.0.36:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-migrate-fb3998b8-gw-openshift-default-74d65bbc76-bbfgs

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-fb3998b8-gw-openshift-default-74d65bbc76-bbfgs

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-fb3998b8-gw-openshift-default-74d65bbc76-bbfgs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x7)

openshift-ingress

kubelet

e2e-migrate-fb3998b8-gw-openshift-default-74d65bbc76-bbfgs

ProbeError

Startup probe error: Get "http://10.132.0.39:15021/healthz/ready": dial tcp 10.132.0.39:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-migrate-fb3998b8-gw-openshift-default-74d65bbc76-bbfgs

Unhealthy

Startup probe failed: Get "http://10.132.0.39:15021/healthz/ready": dial tcp 10.132.0.39:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-migrate-fb3998b8-b4d4dbd5d-x4zdh

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-migrate-fb3998b8

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-migrate-fb3998b8: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-migrate-fb3998b8": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-migrate-fb3998b8, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 20fdec3e-6afc-49f6-9c8e-178efe0e8423, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-fb3998b8-5f8cccc6b-7wjbz

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-ait-b0b7bb86

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-b0b7bb86

openshift-ingress

replicaset-controller

e2e-ait-b0b7bb86-openshift-default-5b57949cf8

SuccessfulCreate

Created pod: e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464

openshift-ingress

deployment-controller

e2e-ait-b0b7bb86-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-b0b7bb86-openshift-default-5b57949cf8 from 0 to 1

openshift-ingress

kubelet

e2e-migrate-fb3998b8-gw-openshift-default-74d65bbc76-bbfgs

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ait-b0b7bb86

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-b0b7bb86-56b977d665 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-b0b7bb86-56b977d665

SuccessfulCreate

Created pod: payload-processing-e2e-ait-b0b7bb86-56b977d665-rtp7k
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-b0b7bb86-56b977d665

FailedCreate

Error creating: pods "payload-processing-e2e-ait-b0b7bb86-56b977d665-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-b0b7bb86: serviceaccount "payload-processing-e2e-ait-b0b7bb86" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-b0b7bb86-786bd857b6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-b0b7bb86-786bd857b6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-b0b7bb86: serviceaccount "payload-processing-e2e-ait-b0b7bb86" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-b0b7bb86-786bd857b6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-b0b7bb86-786bd857b6-kmpw7

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-b0b7bb86

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-b0b7bb86-786bd857b6 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-b0b7bb86-786bd857b6-kmpw7

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-b0b7bb86-786bd857b6-kmpw7

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-b0b7bb86-786bd857b6-kmpw7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-b0b7bb86-786bd857b6-kmpw7

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ait-b0b7bb86-56b977d665-rtp7k

AddedInterface

Add eth0 [10.133.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-b0b7bb86-56b977d665-rtp7k

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-b0b7bb86-56b977d665-rtp7k

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-b0b7bb86-56b977d665-rtp7k

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464

ProbeError

Startup probe error: Get "http://10.134.0.46:15021/healthz/ready": dial tcp 10.134.0.46:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464

Unhealthy

Startup probe failed: Get "http://10.134.0.46:15021/healthz/ready": dial tcp 10.134.0.46:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-b0b7bb86-786bd857b6-kmpw7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-b0b7bb86-56b977d665-rtp7k

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ait-b0b7bb86

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ait-b0b7bb86: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ait-b0b7bb86": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ait-b0b7bb86, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 35cf52d0-514b-4873-a2d1-f71ed2055b5d, UID in object meta:

openshift-ingress

kubelet

e2e-ait-b0b7bb86-openshift-default-5b57949cf8-x9464

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-derive-e67dcae3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-e67dcae3

openshift-ingress

replicaset-controller

e2e-derive-e67dcae3-openshift-default-6f77ddf8b4

SuccessfulCreate

Created pod: e2e-derive-e67dcae3-openshift-default-6f77ddf8b4-9d77c

openshift-ingress

deployment-controller

e2e-derive-e67dcae3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-e67dcae3-openshift-default-6f77ddf8b4 from 0 to 1

openshift-ingress

multus

e2e-derive-e67dcae3-openshift-default-6f77ddf8b4-9d77c

AddedInterface

Add eth0 [10.132.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-e67dcae3-856d94b8cd-gcpbr

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-derive-e67dcae3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-e67dcae3-6d8cf57497 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-derive-e67dcae3-6d8cf57497-qgb68

AddedInterface

Add eth0 [10.133.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-e67dcae3-6d8cf57497-qgb68

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-e67dcae3-6d8cf57497-qgb68

Started

Started container payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-e67dcae3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-e67dcae3-856d94b8cd from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-e67dcae3-856d94b8cd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-e67dcae3-856d94b8cd-gcpbr

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-e67dcae3-856d94b8cd-gcpbr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-e67dcae3-856d94b8cd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-e67dcae3-856d94b8cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-e67dcae3: serviceaccount "payload-processing-e2e-derive-e67dcae3" not found

openshift-ingress

multus

payload-pre-processing-e2e-derive-e67dcae3-856d94b8cd-gcpbr

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-e67dcae3-6d8cf57497

FailedCreate

Error creating: pods "payload-processing-e2e-derive-e67dcae3-6d8cf57497-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-e67dcae3: serviceaccount "payload-processing-e2e-derive-e67dcae3" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-e67dcae3-6d8cf57497

SuccessfulCreate

Created pod: payload-processing-e2e-derive-e67dcae3-6d8cf57497-qgb68

openshift-ingress

kubelet

payload-processing-e2e-derive-e67dcae3-6d8cf57497-qgb68

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-e67dcae3-856d94b8cd-gcpbr

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-derive-e67dcae3-openshift-default-6f77ddf8b4-9d77c

ProbeError

Readiness probe error: Get "http://10.132.0.44:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-derive-e67dcae3-openshift-default-6f77ddf8b4-9d77c

Unhealthy

Readiness probe failed: Get "http://10.132.0.44:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-derive-e67dcae3-openshift-default-6f77ddf8b4-9d77c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-e67dcae3-openshift-default-6f77ddf8b4-9d77c

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-e67dcae3-openshift-default-6f77ddf8b4-9d77c

Started

Started container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-794622-b7cbcf4cd-p96t8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-794622-b6745797-2s8kf

Killing

Stopping container payload-processing
(x5)

openshift-ingress

kubelet

e2e-derive-e67dcae3-openshift-default-6f77ddf8b4-9d77c

ProbeError

Startup probe error: Get "http://10.132.0.44:15021/healthz/ready": dial tcp 10.132.0.44:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-derive-e67dcae3-openshift-default-6f77ddf8b4-9d77c

Unhealthy

Startup probe failed: Get "http://10.132.0.44:15021/healthz/ready": dial tcp 10.132.0.44:15021: connect: connection refused

openshift-ingress

kubelet

e2e-autores-794622-openshift-default-846d6d74-v8xsr

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-explicit-14b3e7-openshift-default-7784fccbb4-sdhvl

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-explicit-14b3e7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-14b3e7-openshift-default-7784fccbb4 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-explicit-14b3e7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-14b3e7

openshift-ingress

replicaset-controller

e2e-explicit-14b3e7-openshift-default-7784fccbb4

SuccessfulCreate

Created pod: e2e-explicit-14b3e7-openshift-default-7784fccbb4-sdhvl

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-e67dcae3-856d94b8cd-gcpbr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-e67dcae3-openshift-default-6f77ddf8b4-9d77c

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-derive-e67dcae3-6d8cf57497-qgb68

Killing

Stopping container payload-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-14b3e7-58cc55d6cd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-14b3e7-58cc55d6cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-14b3e7: serviceaccount "payload-processing-e2e-explicit-14b3e7" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-14b3e7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-14b3e7-58cc55d6cd from 0 to 1

openshift-ingress

multus

payload-processing-e2e-explicit-14b3e7-68bfcd444f-brssc

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-14b3e7-68bfcd444f-brssc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-explicit-14b3e7-68bfcd444f-brssc

Created

Created container: payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-14b3e7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-14b3e7-68bfcd444f from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-explicit-14b3e7-68bfcd444f-brssc

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-14b3e7-68bfcd444f

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-14b3e7-68bfcd444f-brssc

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-14b3e7-58cc55d6cd-7qlfx

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-14b3e7-58cc55d6cd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-14b3e7-58cc55d6cd-7qlfx
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-14b3e7-68bfcd444f

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-14b3e7-68bfcd444f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-14b3e7: serviceaccount "payload-processing-e2e-explicit-14b3e7" not found

openshift-ingress

multus

payload-pre-processing-e2e-explicit-14b3e7-58cc55d6cd-7qlfx

AddedInterface

Add eth0 [10.133.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-14b3e7-58cc55d6cd-7qlfx

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-14b3e7-58cc55d6cd-7qlfx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-14b3e7-openshift-default-7784fccbb4-sdhvl

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-14b3e7-openshift-default-7784fccbb4-sdhvl

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-14b3e7-openshift-default-7784fccbb4-sdhvl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-explicit-14b3e7-openshift-default-7784fccbb4-sdhvl

ProbeError

Startup probe error: Get "http://10.132.0.48:15021/healthz/ready": dial tcp 10.132.0.48:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-explicit-14b3e7-openshift-default-7784fccbb4-sdhvl

Unhealthy

Startup probe failed: Get "http://10.132.0.48:15021/healthz/ready": dial tcp 10.132.0.48:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-explicit-14b3e7-68bfcd444f-brssc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-14b3e7-58cc55d6cd-7qlfx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-explicit-14b3e7-openshift-default-7784fccbb4-sdhvl

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-noten-085b3b-openshift-default-6567d88cfb-txngj

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-085b3b-openshift-default-6567d88cfb-txngj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-noten-085b3b-openshift-default-6567d88cfb-txngj

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-noten-085b3b-openshift-default-6567d88cfb-txngj

Started

Started container istio-proxy

openshift-ingress

replicaset-controller

e2e-noten-085b3b-openshift-default-6567d88cfb

SuccessfulCreate

Created pod: e2e-noten-085b3b-openshift-default-6567d88cfb-txngj

openshift-ingress

deployment-controller

e2e-noten-085b3b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-085b3b-openshift-default-6567d88cfb from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-noten-085b3b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-085b3b

openshift-ingress

replicaset-controller

e2e-mt-aee2c26d-openshift-default-597955567b

SuccessfulCreate

Created pod: e2e-mt-aee2c26d-openshift-default-597955567b-jjhsn

openshift-ingress

deployment-controller

e2e-mt-aee2c26d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-aee2c26d-openshift-default-597955567b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-aee2c26d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-aee2c26d

openshift-ingress

multus

e2e-mt-aee2c26d-openshift-default-597955567b-jjhsn

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-aee2c26d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-aee2c26d-6fd9f94bb6 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-aee2c26d-6fd9f94bb6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-aee2c26d-6fd9f94bb6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-aee2c26d: serviceaccount "payload-processing-e2e-mt-aee2c26d" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-aee2c26d-6b9f644f4f

SuccessfulCreate

Created pod: payload-processing-e2e-mt-aee2c26d-6b9f644f4f-45pm5
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-aee2c26d-6b9f644f4f

FailedCreate

Error creating: pods "payload-processing-e2e-mt-aee2c26d-6b9f644f4f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-aee2c26d: serviceaccount "payload-processing-e2e-mt-aee2c26d" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-aee2c26d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-aee2c26d-6b9f644f4f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-aee2c26d-6fd9f94bb6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-aee2c26d-6fd9f94bb6-mjhh9

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-aee2c26d-6fd9f94bb6-mjhh9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-aee2c26d-6b9f644f4f-45pm5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-aee2c26d-6fd9f94bb6-mjhh9

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-aee2c26d-6b9f644f4f-45pm5

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-mt-aee2c26d-6b9f644f4f-45pm5

AddedInterface

Add eth0 [10.133.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-aee2c26d-6b9f644f4f-45pm5

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-aee2c26d-6fd9f94bb6-mjhh9

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-aee2c26d-6fd9f94bb6-mjhh9

AddedInterface

Add eth0 [10.133.0.68/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-mt-aee2c26d-openshift-default-597955567b-jjhsn

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-aee2c26d-openshift-default-597955567b-jjhsn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-aee2c26d-openshift-default-597955567b-jjhsn

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-mt-aee2c26d-openshift-default-597955567b-jjhsn

Unhealthy

Startup probe failed: Get "http://10.132.0.51:15021/healthz/ready": dial tcp 10.132.0.51:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-mt-aee2c26d-openshift-default-597955567b-jjhsn

ProbeError

Startup probe error: Get "http://10.132.0.51:15021/healthz/ready": dial tcp 10.132.0.51:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-0d25fa-88fc4ccbb-mh9t4

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-inf-a-0d25fa

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-inf-a-0d25fa: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-inf-a-0d25fa": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-inf-a-0d25fa, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 71aed396-ff3e-4288-9f5a-3c5018c39b91, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-inf-a-0d25fa-7466d57c65-jxw6k

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-aee2c26d-6fd9f94bb6-mjhh9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-aee2c26d-6b9f644f4f-45pm5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-aee2c26d-6fd9f94bb6-mjhh9

Unhealthy

Readiness probe failed: dial tcp 10.133.0.68:9004: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-mt-aee2c26d-6b9f644f4f-45pm5

Unhealthy

Readiness probe failed: dial tcp 10.133.0.69:9004: i/o timeout

openshift-ingress

kubelet

e2e-noten-085b3b-openshift-default-6567d88cfb-txngj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-aee2c26d-openshift-default-597955567b-jjhsn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-a-0d25fa-openshift-default-69b8dd7d94-29z6f

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-inf-b-2f1093-6f9dd76bf-xhj97

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-inf-b-2f1093

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-inf-b-2f1093: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-inf-b-2f1093": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-inf-b-2f1093, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 6d22480c-6e84-4417-b61e-febc414ee4da, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-2f1093-64d787b846-c9bls

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-shared-a-w2-c990a5-openshift-default-6f8896c488

SuccessfulCreate

Created pod: e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k

openshift-ingress

deployment-controller

e2e-shared-a-w2-c990a5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-c990a5-openshift-default-6f8896c488 from 0 to 1

openshift-ingress

GatewayAuthBootstrap

e2e-shared-a-w2-c990a5

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-shared-a-w2-c990a5-authn-ssl: envoyfilters.networking.istio.io "e2e-shared-a-w2-c990a5-authn-ssl" already exists

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-c990a5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-c990a5

openshift-ingress

kubelet

e2e-inf-b-2f1093-openshift-default-858454c7cd-hg2kb

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-a-w3-058069-openshift-default-667ddfc568

SuccessfulCreate

Created pod: e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-058069

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-058069

openshift-ingress

deployment-controller

e2e-shared-a-w3-058069-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-058069-openshift-default-667ddfc568 from 0 to 1

openshift-ingress

multus

e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-c990a5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-c990a5-658fd9c97d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-c990a5-658fd9c97d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-c990a5-658fd9c97d-xsmvl

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-c990a5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-c990a5-6b6958b96c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-c990a5-6b6958b96c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-c990a5-6b6958b96c-t2dtw
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-c990a5-6b6958b96c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-c990a5-6b6958b96c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-c990a5: serviceaccount "payload-processing-e2e-shared-a-w2-c990a5" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-c990a5-658fd9c97d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-c990a5-658fd9c97d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-c990a5: serviceaccount "payload-processing-e2e-shared-a-w2-c990a5" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-c990a5-6b6958b96c-t2dtw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-c990a5-6b6958b96c-t2dtw

AddedInterface

Add eth0 [10.133.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-c990a5-6b6958b96c-t2dtw

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-c990a5-6b6958b96c-t2dtw

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-c990a5-658fd9c97d-xsmvl

AddedInterface

Add eth0 [10.133.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-c990a5-658fd9c97d-xsmvl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-c990a5-658fd9c97d-xsmvl

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-c990a5-658fd9c97d-xsmvl

Started

Started container payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-058069-9d7c49f9f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-058069-9d7c49f9f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-058069: serviceaccount "payload-processing-e2e-shared-a-w3-058069" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-058069-9d7c49f9f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-058069-9d7c49f9f-xjpzc

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-058069

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-058069-5c94c696d6 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-058069-5c94c696d6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-058069-5c94c696d6-p47pg
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-058069-5c94c696d6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-058069-5c94c696d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-058069: serviceaccount "payload-processing-e2e-shared-a-w3-058069" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-058069

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-058069-9d7c49f9f from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-058069-9d7c49f9f-xjpzc

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-058069-5c94c696d6-p47pg

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-058069-5c94c696d6-p47pg

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-058069-9d7c49f9f-xjpzc

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-058069-5c94c696d6-p47pg

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-058069-5c94c696d6-p47pg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-058069-9d7c49f9f-xjpzc

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-058069-9d7c49f9f-xjpzc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k

ProbeError

Readiness probe error: Get "http://10.134.0.53:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k

Unhealthy

Readiness probe failed: Get "http://10.134.0.53:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc

ProbeError

Readiness probe error: Get "http://10.134.0.54:15021/healthz/ready": dial tcp 10.134.0.54:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc

Unhealthy

Readiness probe failed: Get "http://10.134.0.54:15021/healthz/ready": dial tcp 10.134.0.54:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k

ProbeError

Startup probe error: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k

Unhealthy

Startup probe failed: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc

ProbeError

Startup probe error: Get "http://10.134.0.54:15021/healthz/ready": dial tcp 10.134.0.54:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc

Unhealthy

Startup probe failed: Get "http://10.134.0.54:15021/healthz/ready": dial tcp 10.134.0.54:15021: connect: connection refused

openshift-ingress

multus

e2e-shared-b-w2-762738-openshift-default-699567cb6-rp2jw

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-b-w2-762738-openshift-default-699567cb6

SuccessfulCreate

Created pod: e2e-shared-b-w2-762738-openshift-default-699567cb6-rp2jw

openshift-ingress

deployment-controller

e2e-shared-b-w2-762738-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-762738-openshift-default-699567cb6 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-762738

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-762738

openshift-ingress

replicaset-controller

e2e-shared-b-w3-4f14bf-openshift-default-6489b97b4d

SuccessfulCreate

Created pod: e2e-shared-b-w3-4f14bf-openshift-default-6489b97b4d-k8jhs

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-4f14bf

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-4f14bf

openshift-ingress

deployment-controller

e2e-shared-b-w3-4f14bf-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-4f14bf-openshift-default-6489b97b4d from 0 to 1

openshift-ingress

multus

e2e-shared-b-w3-4f14bf-openshift-default-6489b97b4d-k8jhs

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-762738

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-762738-5f6c6c4f77 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-762738-5f6c6c4f77-s85h7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-762738-5f6c6c4f77-s85h7

AddedInterface

Add eth0 [10.133.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-762738-5f6c6c4f77-s85h7

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-762738-5f6c6c4f77-s85h7

Created

Created container: payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-762738

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-762738-7f7bd79dd6 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-762738-7f7bd79dd6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-762738-7f7bd79dd6-52hph
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-762738-7f7bd79dd6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-762738-7f7bd79dd6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-762738: serviceaccount "payload-processing-e2e-shared-b-w2-762738" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-762738-5f6c6c4f77

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-762738-5f6c6c4f77-s85h7
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-762738-5f6c6c4f77

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-762738-5f6c6c4f77-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-762738: serviceaccount "payload-processing-e2e-shared-b-w2-762738" not found

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-762738-7f7bd79dd6-52hph

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-762738-7f7bd79dd6-52hph

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-762738-7f7bd79dd6-52hph

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-762738-7f7bd79dd6-52hph

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-4f14bf-dcb955d86-92sdw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-4f14bf

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-4f14bf-dcb955d86 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-4f14bf-7ff9b9f9c5

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-4f14bf-7ff9b9f9c5-xwwtj
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-4f14bf-7ff9b9f9c5

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-4f14bf-7ff9b9f9c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-4f14bf: serviceaccount "payload-processing-e2e-shared-b-w3-4f14bf" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-4f14bf

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-4f14bf-7ff9b9f9c5 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-4f14bf-dcb955d86-92sdw

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-4f14bf-dcb955d86

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-4f14bf-dcb955d86-92sdw
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-4f14bf-dcb955d86

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-4f14bf-dcb955d86-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-4f14bf: serviceaccount "payload-processing-e2e-shared-b-w3-4f14bf" not found

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-4f14bf-7ff9b9f9c5-xwwtj

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-4f14bf-7ff9b9f9c5-xwwtj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-4f14bf-7ff9b9f9c5-xwwtj

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-4f14bf-dcb955d86-92sdw

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-4f14bf-dcb955d86-92sdw

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-4f14bf-7ff9b9f9c5-xwwtj

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-shared-b-w3-4f14bf-openshift-default-6489b97b4d-k8jhs

ProbeError

Readiness probe error: Get "http://10.132.0.53:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-b-w3-4f14bf-openshift-default-6489b97b4d-k8jhs

Unhealthy

Readiness probe failed: Get "http://10.132.0.53:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-4f14bf-openshift-default-6489b97b4d-k8jhs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-4f14bf-openshift-default-6489b97b4d-k8jhs

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-762738-openshift-default-699567cb6-rp2jw

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-4f14bf-openshift-default-6489b97b4d-k8jhs

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-762738-openshift-default-699567cb6-rp2jw

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-762738-openshift-default-699567cb6-rp2jw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-762738-openshift-default-699567cb6-rp2jw

Unhealthy

Startup probe failed: Get "http://10.132.0.52:15021/healthz/ready": dial tcp 10.132.0.52:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-762738-openshift-default-699567cb6-rp2jw

ProbeError

Startup probe error: Get "http://10.132.0.52:15021/healthz/ready": dial tcp 10.132.0.52:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-4f14bf-openshift-default-6489b97b4d-k8jhs

Unhealthy

Startup probe failed: Get "http://10.132.0.53:15021/healthz/ready": dial tcp 10.132.0.53:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-4f14bf-openshift-default-6489b97b4d-k8jhs

ProbeError

Startup probe error: Get "http://10.132.0.53:15021/healthz/ready": dial tcp 10.132.0.53:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-mt-1407ad96

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-1407ad96

openshift-ingress

replicaset-controller

e2e-mt-1407ad96-openshift-default-6c86bb8856

SuccessfulCreate

Created pod: e2e-mt-1407ad96-openshift-default-6c86bb8856-fbv69

openshift-ingress

deployment-controller

e2e-mt-1407ad96-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-1407ad96-openshift-default-6c86bb8856 from 0 to 1

openshift-ingress

multus

e2e-mt-1407ad96-openshift-default-6c86bb8856-fbv69

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-1407ad96

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-1407ad96-6cd97c7cf4 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-1407ad96-6cd97c7cf4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-1407ad96-6cd97c7cf4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-1407ad96: serviceaccount "payload-processing-e2e-mt-1407ad96" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-1407ad96-585588cf9c

FailedCreate

Error creating: pods "payload-processing-e2e-mt-1407ad96-585588cf9c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-1407ad96: serviceaccount "payload-processing-e2e-mt-1407ad96" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-1407ad96-585588cf9c

SuccessfulCreate

Created pod: payload-processing-e2e-mt-1407ad96-585588cf9c-64tqn

openshift-ingress

deployment-controller

payload-processing-e2e-mt-1407ad96

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-1407ad96-585588cf9c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-1407ad96-6cd97c7cf4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-1407ad96-6cd97c7cf4-bxjsw

openshift-ingress

kubelet

payload-processing-e2e-mt-1407ad96-585588cf9c-64tqn

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-1407ad96-6cd97c7cf4-bxjsw

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-1407ad96-6cd97c7cf4-bxjsw

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-1407ad96-585588cf9c-64tqn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-1407ad96-6cd97c7cf4-bxjsw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-1407ad96-585588cf9c-64tqn

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-1407ad96-585588cf9c-64tqn

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-1407ad96-6cd97c7cf4-bxjsw

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-1407ad96-openshift-default-6c86bb8856-fbv69

Unhealthy

Readiness probe failed: Get "http://10.132.0.59:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-mt-1407ad96-openshift-default-6c86bb8856-fbv69

ProbeError

Readiness probe error: Get "http://10.132.0.59:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-mt-1407ad96-openshift-default-6c86bb8856-fbv69

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-1407ad96-openshift-default-6c86bb8856-fbv69

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-1407ad96-openshift-default-6c86bb8856-fbv69

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x7)

openshift-ingress

kubelet

e2e-mt-1407ad96-openshift-default-6c86bb8856-fbv69

Unhealthy

Startup probe failed: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-mt-1407ad96-openshift-default-6c86bb8856-fbv69

ProbeError

Startup probe error: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused body:

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-mt-1407ad96

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-mt-1407ad96: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-mt-1407ad96": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-mt-1407ad96, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 44208970-2d31-4ae6-84f8-7020ba478fac, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-1407ad96-6cd97c7cf4-bxjsw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-1407ad96-585588cf9c-64tqn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-1407ad96-openshift-default-6c86bb8856-fbv69

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-1407ad96-openshift-default-6c86bb8856-fbv69

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-1407ad96-openshift-default-6c86bb8856-fbv69

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

gateway_labeler_controller

e2e-api-a-b32e7b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-b32e7b

openshift-ingress

deployment-controller

e2e-api-a-b32e7b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-b32e7b-openshift-default-574bf5c46 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-b32e7b-openshift-default-574bf5c46

SuccessfulCreate

Created pod: e2e-api-a-b32e7b-openshift-default-574bf5c46-998xm

openshift-ingress

multus

e2e-api-a-b32e7b-openshift-default-574bf5c46-998xm

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-b32e7b-68f97fd686

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-b32e7b-68f97fd686-x2ltb

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-b32e7b-fbdcb7869

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-b32e7b-fbdcb7869-dj6f7
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-b32e7b-fbdcb7869

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-b32e7b-fbdcb7869-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-b32e7b: serviceaccount "payload-processing-e2e-api-a-b32e7b" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-b32e7b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-b32e7b-68f97fd686 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-b32e7b-68f97fd686

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-b32e7b-68f97fd686-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-b32e7b: serviceaccount "payload-processing-e2e-api-a-b32e7b" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-b32e7b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-b32e7b-fbdcb7869 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-b32e7b-68f97fd686-x2ltb

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-b32e7b-68f97fd686-x2ltb

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-b32e7b-68f97fd686-x2ltb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-a-b32e7b-fbdcb7869-dj6f7

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-a-b32e7b-68f97fd686-x2ltb

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-api-a-b32e7b-fbdcb7869-dj6f7

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-b32e7b-fbdcb7869-dj6f7

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-b32e7b-fbdcb7869-dj6f7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-b32e7b-openshift-default-574bf5c46-998xm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-b32e7b-openshift-default-574bf5c46-998xm

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-b32e7b-openshift-default-574bf5c46-998xm

Created

Created container: istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-api-b-912593

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-912593

openshift-ingress

deployment-controller

e2e-api-b-912593-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-912593-openshift-default-7c76d7f464 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-912593-openshift-default-7c76d7f464

SuccessfulCreate

Created pod: e2e-api-b-912593-openshift-default-7c76d7f464-www7c

openshift-ingress

multus

e2e-api-b-912593-openshift-default-7c76d7f464-www7c

AddedInterface

Add eth0 [10.132.0.71/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-api-a-b32e7b-openshift-default-574bf5c46-998xm

Unhealthy

Startup probe failed: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-a-b32e7b-openshift-default-574bf5c46-998xm

ProbeError

Startup probe error: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-912593-678c6f7f67

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-912593-678c6f7f67-9cnnc
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-912593-546857d58b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-912593-546857d58b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-912593: serviceaccount "payload-processing-e2e-api-b-912593" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-912593-546857d58b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-912593-546857d58b-tzfkg
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-912593-678c6f7f67

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-912593-678c6f7f67-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-912593: serviceaccount "payload-processing-e2e-api-b-912593" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-912593

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-912593-546857d58b from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-912593

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-912593-678c6f7f67 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-912593-546857d58b-tzfkg

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-b-912593-546857d58b-tzfkg

AddedInterface

Add eth0 [10.133.0.83/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-912593-546857d58b-tzfkg

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-912593-678c6f7f67-9cnnc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-b-912593-678c6f7f67-9cnnc

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-912593-546857d58b-tzfkg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-b-912593-678c6f7f67-9cnnc

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-api-b-912593-678c6f7f67-9cnnc

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-api-b-912593-openshift-default-7c76d7f464-www7c

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-912593-openshift-default-7c76d7f464-www7c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-912593-openshift-default-7c76d7f464-www7c

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-b-912593-openshift-default-7c76d7f464-www7c

Unhealthy

Startup probe failed: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-b-912593-openshift-default-7c76d7f464-www7c

ProbeError

Startup probe error: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-b32e7b-68f97fd686-x2ltb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-b32e7b-fbdcb7869-dj6f7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-a-b32e7b-openshift-default-574bf5c46-998xm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-912593-546857d58b-tzfkg

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-api-b-912593

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-api-b-912593: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-api-b-912593": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-api-b-912593, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 609b8055-bdd7-4d05-a460-0581fb2fb73f, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-api-b-912593-678c6f7f67-9cnnc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-b-912593-openshift-default-7c76d7f464-www7c

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-b-912593-openshift-default-7c76d7f464-www7c

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-b-912593-openshift-default-7c76d7f464-www7c

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-ipp-a-dc47cd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-dc47cd-openshift-default-67fc64cb56 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-dc47cd-openshift-default-67fc64cb56

SuccessfulCreate

Created pod: e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-dc47cd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-dc47cd

openshift-ingress

multus

e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-dc47cd-f8b445f6b-d9q5q

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-dc47cd-f8b445f6b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-dc47cd-f8b445f6b-d9q5q

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-dc47cd-9ff48c65f

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-dc47cd-9ff48c65f-lbnhl
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-dc47cd-f8b445f6b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-dc47cd-f8b445f6b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-dc47cd: serviceaccount "payload-processing-e2e-ipp-a-dc47cd" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-dc47cd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-dc47cd-f8b445f6b from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-dc47cd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-dc47cd-9ff48c65f from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-dc47cd-9ff48c65f

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-dc47cd-9ff48c65f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-dc47cd: serviceaccount "payload-processing-e2e-ipp-a-dc47cd" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-dc47cd-9ff48c65f-lbnhl

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-dc47cd-9ff48c65f-lbnhl

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-dc47cd-9ff48c65f-lbnhl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-a-dc47cd-9ff48c65f-lbnhl

AddedInterface

Add eth0 [10.134.0.70/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-dc47cd-f8b445f6b-d9q5q

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-dc47cd-f8b445f6b-d9q5q

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-dc47cd-f8b445f6b-d9q5q

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-c990a5-658fd9c97d-xsmvl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-c990a5-6b6958b96c-t2dtw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn

Unhealthy

Readiness probe failed: Get "http://10.134.0.68:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn

ProbeError

Readiness probe error: Get "http://10.134.0.68:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k

ProbeError

Readiness probe error: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-shared-a-w2-c990a5-openshift-default-6f8896c488-pwx7k

Unhealthy

Readiness probe failed: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn

Created

Created container: istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-762738-7f7bd79dd6-52hph

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-762738-5f6c6c4f77-s85h7

Killing

Stopping container payload-processing
(x5)

openshift-ingress

kubelet

e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn

ProbeError

Startup probe error: Get "http://10.134.0.68:15021/healthz/ready": dial tcp 10.134.0.68:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn

Unhealthy

Startup probe failed: Get "http://10.134.0.68:15021/healthz/ready": dial tcp 10.134.0.68:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-ipp-b-7621a1-openshift-default-8574db548

SuccessfulCreate

Created pod: e2e-ipp-b-7621a1-openshift-default-8574db548-nvdkn

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-7621a1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-7621a1

openshift-ingress

deployment-controller

e2e-ipp-b-7621a1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-7621a1-openshift-default-8574db548 from 0 to 1

openshift-ingress

multus

e2e-ipp-b-7621a1-openshift-default-8574db548-nvdkn

AddedInterface

Add eth0 [10.132.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w2-762738-openshift-default-699567cb6-rp2jw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-762738-openshift-default-699567cb6-rp2jw

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w2-762738-openshift-default-699567cb6-rp2jw

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-7621a1-bfd4597cd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-7621a1-bfd4597cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-7621a1: serviceaccount "payload-processing-e2e-ipp-b-7621a1" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-7621a1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-7621a1-5c7f44bd95 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-7621a1-5c7f44bd95

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-7621a1-5c7f44bd95-xfmdq
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-7621a1-5c7f44bd95

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-7621a1-5c7f44bd95-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-7621a1: serviceaccount "payload-processing-e2e-ipp-b-7621a1" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-7621a1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-7621a1-bfd4597cd from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-7621a1-bfd4597cd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-7621a1-bfd4597cd-h2wrg

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-7621a1-5c7f44bd95-xfmdq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-7621a1-bfd4597cd-h2wrg

AddedInterface

Add eth0 [10.133.0.86/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-7621a1-bfd4597cd-h2wrg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-7621a1-bfd4597cd-h2wrg

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-7621a1-bfd4597cd-h2wrg

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-b-7621a1-5c7f44bd95-xfmdq

AddedInterface

Add eth0 [10.133.0.87/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-7621a1-5c7f44bd95-xfmdq

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-7621a1-5c7f44bd95-xfmdq

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-b-7621a1-openshift-default-8574db548-nvdkn

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-7621a1-openshift-default-8574db548-nvdkn

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-7621a1-openshift-default-8574db548-nvdkn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-b-7621a1-openshift-default-8574db548-nvdkn

Unhealthy

Startup probe failed: Get "http://10.132.0.76:15021/healthz/ready": dial tcp 10.132.0.76:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-7621a1-openshift-default-8574db548-nvdkn

ProbeError

Startup probe error: Get "http://10.132.0.76:15021/healthz/ready": dial tcp 10.132.0.76:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-8e4477

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-8e4477

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-8e4477-openshift-default-5b95bcc846

SuccessfulCreate

Created pod: e2e-ipp-cleanup-8e4477-openshift-default-5b95bcc846-xx4x4

openshift-ingress

deployment-controller

e2e-ipp-cleanup-8e4477-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-8e4477-openshift-default-5b95bcc846 from 0 to 1

openshift-ingress

multus

e2e-ipp-cleanup-8e4477-openshift-default-5b95bcc846-xx4x4

AddedInterface

Add eth0 [10.132.0.78/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-8e4477

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-8e4477-5c67889474 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-8e4477-5c67889474

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-8e4477-5c67889474-grlh7
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-8e4477-75f5688f65

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-8e4477-75f5688f65-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-8e4477: serviceaccount "payload-processing-e2e-ipp-cleanup-8e4477" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-8e4477-75f5688f65

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-8e4477-75f5688f65-2qvqg
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-8e4477-5c67889474

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-8e4477-5c67889474-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-8e4477: serviceaccount "payload-processing-e2e-ipp-cleanup-8e4477" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-8e4477

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-8e4477-75f5688f65 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-8e4477-5c67889474-grlh7

AddedInterface

Add eth0 [10.134.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-8e4477-5c67889474-grlh7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-8e4477-5c67889474-grlh7

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-8e4477-75f5688f65-2qvqg

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-8e4477-75f5688f65-2qvqg

AddedInterface

Add eth0 [10.133.0.89/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-8e4477-75f5688f65-2qvqg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-8e4477-5c67889474-grlh7

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-8e4477-75f5688f65-2qvqg

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-8e4477-openshift-default-5b95bcc846-xx4x4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-8e4477-openshift-default-5b95bcc846-xx4x4

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-8e4477-openshift-default-5b95bcc846-xx4x4

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-8e4477-openshift-default-5b95bcc846-xx4x4

Unhealthy

Startup probe failed: Get "http://10.132.0.78:15021/healthz/ready": dial tcp 10.132.0.78:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-8e4477-openshift-default-5b95bcc846-xx4x4

ProbeError

Startup probe error: Get "http://10.132.0.78:15021/healthz/ready": dial tcp 10.132.0.78:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-8e4477-75f5688f65-2qvqg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-8e4477-5c67889474-grlh7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-8e4477-openshift-default-5b95bcc846-xx4x4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-cleanup-8e4477-openshift-default-5b95bcc846-xx4x4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-cleanup-8e4477-openshift-default-5b95bcc846-xx4x4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-dc47cd-9ff48c65f-lbnhl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-dc47cd-f8b445f6b-d9q5q

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-dc47cd-openshift-default-67fc64cb56-p74qn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-7621a1-bfd4597cd-h2wrg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-7621a1-5c7f44bd95-xfmdq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-7621a1-openshift-default-8574db548-nvdkn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-058069-9d7c49f9f-xjpzc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-058069-5c94c696d6-p47pg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w3-058069-openshift-default-667ddfc568-thkfc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-4f14bf-7ff9b9f9c5-xwwtj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-4f14bf-dcb955d86-92sdw

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-b-w3-4f14bf

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-b-w3-4f14bf: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-b-w3-4f14bf": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-b-w3-4f14bf, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 0373b3b2-15bd-4a16-9487-418f7dec826b, UID in object meta:

openshift-ingress

kubelet

e2e-shared-b-w3-4f14bf-openshift-default-6489b97b4d-k8jhs

Killing

Stopping container istio-proxy