Time Namespace Component RelatedObject Reason Message

openshift-ingress

e2e-mt-61660fd5-openshift-default-75cf76b6d8-jcfmh

Scheduled

Successfully assigned openshift-ingress/e2e-mt-61660fd5-openshift-default-75cf76b6d8-jcfmh to ip-10-0-134-225.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-644ff039-6d756dfb58-xsh5l

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-644ff039-6d756dfb58-xsh5l to ip-10-0-128-101.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-b0f4da-77f559485f-2qpw7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-b0f4da-77f559485f-2qpw7 to ip-10-0-128-101.ec2.internal

openshift-ingress

e2e-mt-842ba8c2-openshift-default-557f5fc9d4-pf9d6

Scheduled

Successfully assigned openshift-ingress/e2e-mt-842ba8c2-openshift-default-557f5fc9d4-pf9d6 to ip-10-0-134-225.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-af329f-6c6c696665-f6x99

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-af329f-6c6c696665-f6x99 to ip-10-0-142-156.ec2.internal

openshift-ingress

e2e-noten-9b8682-openshift-default-568bf6c65d-2dj5n

Scheduled

Successfully assigned openshift-ingress/e2e-noten-9b8682-openshift-default-568bf6c65d-2dj5n to ip-10-0-142-156.ec2.internal

openshift-ingress

payload-processing-e2e-derive-08482c4c-5cbcb75765-r6h2h

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-08482c4c-5cbcb75765-r6h2h to ip-10-0-128-101.ec2.internal

openshift-ingress

e2e-shared-a-w2-1e0789-openshift-default-56fd556994-m6g5v

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-1e0789-openshift-default-56fd556994-m6g5v to ip-10-0-134-225.ec2.internal

openshift-ingress

e2e-ait-30dae5eb-openshift-default-5475dbf994-fj642

Scheduled

Successfully assigned openshift-ingress/e2e-ait-30dae5eb-openshift-default-5475dbf994-fj642 to ip-10-0-142-156.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-ce5f9d-5974c8dc74-4jdjh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-ce5f9d-5974c8dc74-4jdjh to ip-10-0-142-156.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-b0f4da-856f79778-8zd5g

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-b0f4da-856f79778-8zd5g to ip-10-0-128-101.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-c9cef5-5bb46b7fb6-gc2m8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-c9cef5-5bb46b7fb6-gc2m8 to ip-10-0-128-101.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-af329f-66bfc59fc8-5tg4w

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-af329f-66bfc59fc8-5tg4w to ip-10-0-142-156.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-08482c4c-679998bcb6-c64z5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-08482c4c-679998bcb6-c64z5 to ip-10-0-128-101.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-5ab28b-f84ffd694-5kv6p

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-5ab28b-f84ffd694-5kv6p to ip-10-0-142-156.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-c970f3-6bf9c9c56b-74cb9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-c970f3-6bf9c9c56b-74cb9 to ip-10-0-128-101.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-be281e-c69d79cfd-t8h62

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-be281e-c69d79cfd-t8h62 to ip-10-0-142-156.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-387ddcaa-55ff99db6-jrxbs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-387ddcaa-55ff99db6-jrxbs to ip-10-0-128-101.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-f23388-d7cbdc78-9pcsk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-f23388-d7cbdc78-9pcsk to ip-10-0-142-156.ec2.internal

openshift-ingress

e2e-ait-644ff039-openshift-default-649997fd76-gdvfv

Scheduled

Successfully assigned openshift-ingress/e2e-ait-644ff039-openshift-default-649997fd76-gdvfv to ip-10-0-142-156.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-61660fd5-77cccfc78b-r69c5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-61660fd5-77cccfc78b-r69c5 to ip-10-0-128-101.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-842ba8c2-6cdf879494-pmjfc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-842ba8c2-6cdf879494-pmjfc to ip-10-0-128-101.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-1e0789-77bbc99758-4fsxv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-1e0789-77bbc99758-4fsxv to ip-10-0-128-101.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-af7727-7dbbddd5d-mh874

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-af7727-7dbbddd5d-mh874 to ip-10-0-128-101.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-c3058d-7d6bb5b54-5gnfs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-c3058d-7d6bb5b54-5gnfs to ip-10-0-142-156.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-7daa14-84f97f9c66-tcwmr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7daa14-84f97f9c66-tcwmr to ip-10-0-142-156.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-097e16-546949c98-csmxk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-097e16-546949c98-csmxk to ip-10-0-128-101.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-f0a342-cfbfbb758-2m28m

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-f0a342-cfbfbb758-2m28m to ip-10-0-128-101.ec2.internal

openshift-ingress

kube-auth-proxy-759bbcf6c6-xgrqq

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-759bbcf6c6-xgrqq to ip-10-0-128-101.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-30dae5eb-7c88f68dc4-45qtp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-30dae5eb-7c88f68dc4-45qtp to ip-10-0-142-156.ec2.internal

openshift-ingress

payload-processing-e2e-autores-5ab28b-c7d5fcf85-svr5v

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-5ab28b-c7d5fcf85-svr5v to ip-10-0-128-101.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-f23388-6f684696d5-4phh8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-f23388-6f684696d5-4phh8 to ip-10-0-128-101.ec2.internal

openshift-ingress

e2e-api-a-f0a342-openshift-default-5d964f588d-dzqdj

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-f0a342-openshift-default-5d964f588d-dzqdj to ip-10-0-134-225.ec2.internal

openshift-ingress

e2e-migrate-387ddcaa-gw-openshift-default-85f5bbcbb8-hs8h5

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-387ddcaa-gw-openshift-default-85f5bbcbb8-hs8h5 to ip-10-0-134-225.ec2.internal

openshift-ingress

e2e-explicit-af329f-openshift-default-7f5d768f8d-4d7bq

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-af329f-openshift-default-7f5d768f8d-4d7bq to ip-10-0-134-225.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w4-e6e6b8-b8cf98d95-dtvhn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-e6e6b8-b8cf98d95-dtvhn to ip-10-0-128-101.ec2.internal

openshift-ingress

kube-auth-proxy-759bbcf6c6-mpp57

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-759bbcf6c6-mpp57 to ip-10-0-142-156.ec2.internal

openshift-ingress

e2e-inf-a-b0f4da-openshift-default-775fb84548-q6s7n

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-b0f4da-openshift-default-775fb84548-q6s7n to ip-10-0-134-225.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-68cf4d799c4xnsf

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c4xnsf to ip-10-0-134-225.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-f0a342-79c5677d67-bjtwm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-f0a342-79c5677d67-bjtwm to ip-10-0-128-101.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-af7727-6794fb697f-8mmdr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-af7727-6794fb697f-8mmdr to ip-10-0-142-156.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-ce5f9d-6fd6ddbf5f-j9jvb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-ce5f9d-6fd6ddbf5f-j9jvb to ip-10-0-142-156.ec2.internal

openshift-ingress

e2e-shared-a-w3-af7727-openshift-default-86dd8b9564-9qbcn

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-af7727-openshift-default-86dd8b9564-9qbcn to ip-10-0-134-225.ec2.internal

openshift-ingress

e2e-api-b-f23388-openshift-default-58ff587994-rl257

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-f23388-openshift-default-58ff587994-rl257 to ip-10-0-142-156.ec2.internal

openshift-ingress

payload-processing-e2e-ait-644ff039-5b957d9799-qcxcn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-644ff039-5b957d9799-qcxcn to ip-10-0-128-101.ec2.internal

openshift-ingress

payload-processing-e2e-ait-30dae5eb-674555df7c-lv2q2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-30dae5eb-674555df7c-lv2q2 to ip-10-0-128-101.ec2.internal

openshift-ingress

e2e-shared-b-w2-c3058d-openshift-default-565b4fb5f8-hdt4h

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-c3058d-openshift-default-565b4fb5f8-hdt4h to ip-10-0-134-225.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-c9cef5-d578999ff-7h2vd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-c9cef5-d578999ff-7h2vd to ip-10-0-128-101.ec2.internal

openshift-ingress

router-default-ff84dbc68-p77s6

Scheduled

Successfully assigned openshift-ingress/router-default-ff84dbc68-p77s6 to ip-10-0-134-225.ec2.internal

openshift-ingress

router-default-ff84dbc68-p77s6

FailedScheduling

0/3 nodes are available: 3 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/3 nodes are available: 3 Preemption is not helpful for scheduling.

openshift-ingress

e2e-ipp-cleanup-be281e-openshift-default-5c4dbb5d5d-pzxjh

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-be281e-openshift-default-5c4dbb5d5d-pzxjh to ip-10-0-134-225.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-c970f3-b65b4747-jfc28

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-c970f3-b65b4747-jfc28 to ip-10-0-142-156.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-be281e-78bcb8d77-8wlz2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-be281e-78bcb8d77-8wlz2 to ip-10-0-128-101.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-387ddcaa-8596dcf594-mwxvf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-387ddcaa-8596dcf594-mwxvf to ip-10-0-128-101.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-twvbt

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-twvbt to ip-10-0-128-101.ec2.internal

openshift-ingress

e2e-shared-b-w3-7daa14-openshift-default-787b96ccf4-bx96x

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-7daa14-openshift-default-787b96ccf4-bx96x to ip-10-0-142-156.ec2.internal

openshift-ingress

e2e-autores-5ab28b-openshift-default-766bdbdcfd-45xrf

Scheduled

Successfully assigned openshift-ingress/e2e-autores-5ab28b-openshift-default-766bdbdcfd-45xrf to ip-10-0-142-156.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-tv2l8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-tv2l8 to ip-10-0-128-101.ec2.internal

openshift-ingress

e2e-ipp-b-c970f3-openshift-default-585c599b84-kqb2m

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-c970f3-openshift-default-585c599b84-kqb2m to ip-10-0-142-156.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-e6e6b8-7978b8f866-wxwzs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-e6e6b8-7978b8f866-wxwzs to ip-10-0-128-101.ec2.internal

openshift-ingress

payload-processing-e2e-mt-61660fd5-5d75b5f79c-fxgbc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-61660fd5-5d75b5f79c-fxgbc to ip-10-0-128-101.ec2.internal

openshift-ingress

payload-processing-e2e-mt-842ba8c2-c577fdbf-ftjm4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-842ba8c2-c577fdbf-ftjm4 to ip-10-0-128-101.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-1e0789-6595f797b5-wr8p8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-1e0789-6595f797b5-wr8p8 to ip-10-0-128-101.ec2.internal

openshift-ingress

e2e-inf-b-ce5f9d-openshift-default-7557c9bb5b-7bcfj

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-ce5f9d-openshift-default-7557c9bb5b-7bcfj to ip-10-0-142-156.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-c3058d-6fd8b65645-6b592

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-c3058d-6fd8b65645-6b592 to ip-10-0-142-156.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-7daa14-5767b64bf7-fplrv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-7daa14-5767b64bf7-fplrv to ip-10-0-142-156.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-097e16-65ddd76cdc-nrwtx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-097e16-65ddd76cdc-nrwtx to ip-10-0-128-101.ec2.internal

openshift-ingress

e2e-derive-08482c4c-openshift-default-85f494fcbd-kn5dp

Scheduled

Successfully assigned openshift-ingress/e2e-derive-08482c4c-openshift-default-85f494fcbd-kn5dp to ip-10-0-134-225.ec2.internal

openshift-ingress

e2e-worker-w0-097e16-openshift-default-7b675487dd-rvsqv

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-097e16-openshift-default-7b675487dd-rvsqv to ip-10-0-142-156.ec2.internal

openshift-ingress

e2e-worker-w4-e6e6b8-openshift-default-68d99bd7b4-b5jt2

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-e6e6b8-openshift-default-68d99bd7b4-b5jt2 to ip-10-0-142-156.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-5ccb968c66-7z5m6

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7z5m6 to ip-10-0-142-156.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-sw9nh

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-sw9nh to ip-10-0-134-225.ec2.internal

openshift-ingress

e2e-ipp-a-c9cef5-openshift-default-8dbf59dc6-jtscw

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-c9cef5-openshift-default-8dbf59dc6-jtscw to ip-10-0-134-225.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-82qfg

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-82qfg to ip-10-0-128-101.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-ff84dbc68 from 0 to 1
(x11)

openshift-ingress

replicaset-controller

router-default-ff84dbc68

FailedCreate

Error creating: pods "router-default-ff84dbc68-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x16)

openshift-ingress

replicaset-controller

router-default-ff84dbc68

FailedCreate

Error creating: pods "router-default-ff84dbc68-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-ff84dbc68

SuccessfulCreate

Created pod: router-default-ff84dbc68-p77s6
(x6)

openshift-ingress

kubelet

router-default-ff84dbc68-p77s6

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x6)

openshift-ingress

kubelet

router-default-ff84dbc68-p77s6

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

kubelet

router-default-ff84dbc68-p77s6

Started

Started container router

openshift-ingress

kubelet

router-default-ff84dbc68-p77s6

Created

Created container: router

openshift-ingress

kubelet

router-default-ff84dbc68-p77s6

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:da130d90f0bffd5c5876c94544c91b2a1be0d23ce2747ddfeafe88e03ee7d8d1" already present on machine

openshift-ingress

multus

router-default-ff84dbc68-p77s6

AddedInterface

Add eth0 [10.132.0.11/23] from ovn-kubernetes

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-759bbcf6c6 from 0 to 2

openshift-ingress

replicaset-controller

kube-auth-proxy-759bbcf6c6

SuccessfulCreate

Created pod: kube-auth-proxy-759bbcf6c6-mpp57
(x3)

openshift-ingress

replicaset-controller

kube-auth-proxy-759bbcf6c6

FailedCreate

Error creating: pods "kube-auth-proxy-759bbcf6c6-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-759bbcf6c6

SuccessfulCreate

Created pod: kube-auth-proxy-759bbcf6c6-xgrqq

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

kubelet

kube-auth-proxy-759bbcf6c6-mpp57

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

kubelet

kube-auth-proxy-759bbcf6c6-xgrqq

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-759bbcf6c6-xgrqq

AddedInterface

Add eth0 [10.134.0.18/23] from ovn-kubernetes

openshift-ingress

multus

kube-auth-proxy-759bbcf6c6-mpp57

AddedInterface

Add eth0 [10.133.0.25/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-82qfg

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-82qfg

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-82qfg

AddedInterface

Add eth0 [10.134.0.19/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-759bbcf6c6-xgrqq

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-759bbcf6c6-mpp57

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-759bbcf6c6-mpp57

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-759bbcf6c6-mpp57

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.687s (2.687s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-759bbcf6c6-xgrqq

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.714s (2.714s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-759bbcf6c6-xgrqq

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-82qfg

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-82qfg

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-82qfg

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.194s (3.194s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-82qfg

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-82qfg

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-68cf4d799c from 0 to 1

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-68cf4d799c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-68cf4d799c4xnsf

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799c4xnsf

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-68cf4d799c4xnsf

AddedInterface

Add eth0 [10.132.0.32/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799c4xnsf

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.54s (2.54s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799c4xnsf

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799c4xnsf

Started

Started container istio-proxy

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-sw9nh

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-sw9nh

AddedInterface

Add eth0 [10.132.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-sw9nh

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-sw9nh

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-sw9nh

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-sw9nh

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.457s (2.457s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-82qfg

Killing

Stopping container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-82qfg

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5ccb968c66

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5ccb968c66-7z5m6

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-5ccb968c66 from 0 to 1

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-7z5m6

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

maas-default-gateway-openshift-default-5ccb968c66-7z5m6

AddedInterface

Add eth0 [10.133.0.28/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-7z5m6

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.69s (2.69s including waiting). Image size: 181318953 bytes.

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-twvbt

openshift-ingress

multus

payload-processing-5b54b7fbb7-twvbt

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-tv2l8

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-twvbt

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-tv2l8

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-tv2l8

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-twvbt

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-twvbt

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-twvbt

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.559s (2.559s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-tv2l8

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-tv2l8

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.502s (2.502s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-tv2l8

Started

Started container payload-pre-processing

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-7z5m6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-7z5m6

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-7z5m6

Created

Created container: istio-proxy
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-7z5m6

Unhealthy

Startup probe failed: Get "http://10.133.0.28:15021/healthz/ready": dial tcp 10.133.0.28:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-7z5m6

ProbeError

Startup probe error: Get "http://10.133.0.28:15021/healthz/ready": dial tcp 10.133.0.28:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-inf-a-b0f4da

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-b0f4da

openshift-ingress

deployment-controller

e2e-inf-a-b0f4da-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-b0f4da-openshift-default-775fb84548 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-b0f4da-openshift-default-775fb84548

SuccessfulCreate

Created pod: e2e-inf-a-b0f4da-openshift-default-775fb84548-q6s7n

openshift-ingress

replicaset-controller

e2e-worker-w0-097e16-openshift-default-7b675487dd

SuccessfulCreate

Created pod: e2e-worker-w0-097e16-openshift-default-7b675487dd-rvsqv

openshift-ingress

deployment-controller

e2e-worker-w0-097e16-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-097e16-openshift-default-7b675487dd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-097e16

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-097e16

openshift-ingress

replicaset-controller

e2e-worker-w4-e6e6b8-openshift-default-68d99bd7b4

SuccessfulCreate

Created pod: e2e-worker-w4-e6e6b8-openshift-default-68d99bd7b4-b5jt2

openshift-ingress

deployment-controller

e2e-worker-w4-e6e6b8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-e6e6b8-openshift-default-68d99bd7b4 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-e6e6b8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-e6e6b8

openshift-ingress

multus

e2e-inf-a-b0f4da-openshift-default-775fb84548-q6s7n

AddedInterface

Add eth0 [10.132.0.41/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w0-097e16-openshift-default-7b675487dd-rvsqv

AddedInterface

Add eth0 [10.133.0.37/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w4-e6e6b8-openshift-default-68d99bd7b4-b5jt2

AddedInterface

Add eth0 [10.133.0.36/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-097e16-65ddd76cdc

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-097e16-65ddd76cdc-nrwtx

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-097e16

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-097e16-65ddd76cdc from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-097e16-546949c98

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-097e16-546949c98-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-097e16: serviceaccount "payload-processing-e2e-worker-w0-097e16" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-097e16-546949c98

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-097e16-546949c98-csmxk

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-097e16

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-097e16-546949c98 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-097e16-65ddd76cdc

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-097e16-65ddd76cdc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-097e16: serviceaccount "payload-processing-e2e-worker-w0-097e16" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-e6e6b8-7978b8f866

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-e6e6b8-7978b8f866-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-e6e6b8: serviceaccount "payload-processing-e2e-worker-w4-e6e6b8" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-097e16-65ddd76cdc-nrwtx

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-e6e6b8-7978b8f866

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-e6e6b8-7978b8f866-wxwzs

openshift-ingress

multus

payload-processing-e2e-worker-w0-097e16-65ddd76cdc-nrwtx

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-097e16-65ddd76cdc-nrwtx

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-097e16-546949c98-csmxk

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-e6e6b8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-e6e6b8-7978b8f866 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-097e16-65ddd76cdc-nrwtx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-e6e6b8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-e6e6b8-b8cf98d95 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-e6e6b8-b8cf98d95

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-e6e6b8-b8cf98d95-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-e6e6b8: serviceaccount "payload-processing-e2e-worker-w4-e6e6b8" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-097e16-546949c98-csmxk

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-097e16-546949c98-csmxk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-097e16-546949c98-csmxk

Created

Created container: payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-b0f4da

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-b0f4da-856f79778 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-b0f4da-856f79778

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-b0f4da-856f79778-8zd5g

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-e6e6b8-b8cf98d95-dtvhn

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-e6e6b8-b8cf98d95-dtvhn

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-e6e6b8-b8cf98d95

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-e6e6b8-b8cf98d95-dtvhn

openshift-ingress

multus

payload-processing-e2e-worker-w4-e6e6b8-b8cf98d95-dtvhn

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-b0f4da-77f559485f

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-b0f4da-77f559485f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-b0f4da: serviceaccount "payload-processing-e2e-inf-a-b0f4da" not found

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-e6e6b8-7978b8f866-wxwzs

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-e6e6b8-7978b8f866-wxwzs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-e6e6b8-7978b8f866-wxwzs

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-b0f4da-77f559485f

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-b0f4da-77f559485f-2qpw7

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-b0f4da

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-b0f4da-77f559485f from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-e6e6b8-7978b8f866-wxwzs

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-e6e6b8-b8cf98d95-dtvhn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-b0f4da-856f79778

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-b0f4da-856f79778-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-b0f4da: serviceaccount "payload-processing-e2e-inf-a-b0f4da" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-b0f4da-856f79778-8zd5g

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-b0f4da-77f559485f-2qpw7

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-b0f4da-856f79778-8zd5g

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-b0f4da-856f79778-8zd5g

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-inf-a-b0f4da-77f559485f-2qpw7

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-b0f4da-856f79778-8zd5g

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-b0f4da-77f559485f-2qpw7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-a-b0f4da-77f559485f-2qpw7

Created

Created container: payload-processing

openshift-ingress

deployment-controller

e2e-ait-644ff039-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-644ff039-openshift-default-649997fd76 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-644ff039

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-644ff039

openshift-ingress

replicaset-controller

e2e-ait-644ff039-openshift-default-649997fd76

SuccessfulCreate

Created pod: e2e-ait-644ff039-openshift-default-649997fd76-gdvfv

openshift-ingress

multus

e2e-autores-5ab28b-openshift-default-766bdbdcfd-45xrf

AddedInterface

Add eth0 [10.133.0.41/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-autores-5ab28b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-5ab28b

openshift-ingress

multus

e2e-ait-644ff039-openshift-default-649997fd76-gdvfv

AddedInterface

Add eth0 [10.133.0.40/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-autores-5ab28b-openshift-default-766bdbdcfd

SuccessfulCreate

Created pod: e2e-autores-5ab28b-openshift-default-766bdbdcfd-45xrf

openshift-ingress

deployment-controller

e2e-autores-5ab28b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-5ab28b-openshift-default-766bdbdcfd from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ait-644ff039

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-644ff039-5b957d9799 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-644ff039-5b957d9799-qcxcn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-644ff039-6d756dfb58

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-644ff039-6d756dfb58-xsh5l

openshift-ingress

multus

payload-processing-e2e-ait-644ff039-5b957d9799-qcxcn

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-644ff039

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-644ff039-6d756dfb58 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-644ff039-6d756dfb58

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-644ff039-6d756dfb58-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-644ff039: serviceaccount "payload-processing-e2e-ait-644ff039" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-644ff039-6d756dfb58-xsh5l

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-644ff039-6d756dfb58-xsh5l

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-644ff039-6d756dfb58-xsh5l

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-644ff039-6d756dfb58-xsh5l

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-644ff039-5b957d9799-qcxcn

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-644ff039-5b957d9799-qcxcn

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-644ff039-5b957d9799

FailedCreate

Error creating: pods "payload-processing-e2e-ait-644ff039-5b957d9799-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-644ff039: serviceaccount "payload-processing-e2e-ait-644ff039" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-644ff039-5b957d9799

SuccessfulCreate

Created pod: payload-processing-e2e-ait-644ff039-5b957d9799-qcxcn

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-5ab28b-c7d5fcf85

SuccessfulCreate

Created pod: payload-processing-e2e-autores-5ab28b-c7d5fcf85-svr5v
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-5ab28b-c7d5fcf85

FailedCreate

Error creating: pods "payload-processing-e2e-autores-5ab28b-c7d5fcf85-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-5ab28b: serviceaccount "payload-processing-e2e-autores-5ab28b" not found

openshift-ingress

deployment-controller

payload-processing-e2e-autores-5ab28b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-5ab28b-c7d5fcf85 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-5ab28b-f84ffd694

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-5ab28b-f84ffd694-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-5ab28b: serviceaccount "payload-processing-e2e-autores-5ab28b" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-5ab28b-f84ffd694

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-5ab28b-f84ffd694-5kv6p

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-5ab28b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-5ab28b-f84ffd694 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-autores-5ab28b-c7d5fcf85-svr5v

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-autores-5ab28b-c7d5fcf85-svr5v

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-5ab28b-c7d5fcf85-svr5v

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-autores-5ab28b-c7d5fcf85-svr5v

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-5ab28b-f84ffd694-5kv6p

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-e2e-autores-5ab28b-f84ffd694-5kv6p

AddedInterface

Add eth0 [10.133.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-5ab28b-f84ffd694-5kv6p

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-5ab28b-f84ffd694-5kv6p

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-5ab28b-f84ffd694-5kv6p

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.661s (2.661s including waiting). Image size: 166449337 bytes.
(x2)

openshift-ingress

kubelet

e2e-inf-a-b0f4da-openshift-default-775fb84548-q6s7n

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w0-097e16-openshift-default-7b675487dd-rvsqv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w4-e6e6b8-openshift-default-68d99bd7b4-b5jt2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w0-097e16-openshift-default-7b675487dd-rvsqv

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-b0f4da-openshift-default-775fb84548-q6s7n

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-b0f4da-openshift-default-775fb84548-q6s7n

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-097e16-openshift-default-7b675487dd-rvsqv

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-e6e6b8-openshift-default-68d99bd7b4-b5jt2

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-e6e6b8-openshift-default-68d99bd7b4-b5jt2

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-inf-a-b0f4da-openshift-default-775fb84548-q6s7n

ProbeError

Startup probe error: Get "http://10.132.0.41:15021/healthz/ready": dial tcp 10.132.0.41:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-a-b0f4da-openshift-default-775fb84548-q6s7n

Unhealthy

Startup probe failed: Get "http://10.132.0.41:15021/healthz/ready": dial tcp 10.132.0.41:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-e6e6b8-openshift-default-68d99bd7b4-b5jt2

ProbeError

Startup probe error: Get "http://10.133.0.36:15021/healthz/ready": dial tcp 10.133.0.36:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-e6e6b8-openshift-default-68d99bd7b4-b5jt2

Unhealthy

Startup probe failed: Get "http://10.133.0.36:15021/healthz/ready": dial tcp 10.133.0.36:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-097e16-openshift-default-7b675487dd-rvsqv

Unhealthy

Startup probe failed: Get "http://10.133.0.37:15021/healthz/ready": dial tcp 10.133.0.37:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-097e16-openshift-default-7b675487dd-rvsqv

ProbeError

Startup probe error: Get "http://10.133.0.37:15021/healthz/ready": dial tcp 10.133.0.37:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-ait-644ff039-openshift-default-649997fd76-gdvfv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

replicaset-controller

e2e-inf-b-ce5f9d-openshift-default-7557c9bb5b

SuccessfulCreate

Created pod: e2e-inf-b-ce5f9d-openshift-default-7557c9bb5b-7bcfj
(x2)

openshift-ingress

kubelet

e2e-ait-644ff039-openshift-default-649997fd76-gdvfv

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-644ff039-openshift-default-649997fd76-gdvfv

Started

Started container istio-proxy

openshift-ingress

deployment-controller

e2e-inf-b-ce5f9d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-ce5f9d-openshift-default-7557c9bb5b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-b-ce5f9d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-ce5f9d
(x2)

openshift-ingress

kubelet

e2e-autores-5ab28b-openshift-default-766bdbdcfd-45xrf

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-5ab28b-openshift-default-766bdbdcfd-45xrf

Created

Created container: istio-proxy

openshift-ingress

multus

e2e-inf-b-ce5f9d-openshift-default-7557c9bb5b-7bcfj

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-autores-5ab28b-openshift-default-766bdbdcfd-45xrf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-ce5f9d-6fd6ddbf5f

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-ce5f9d-6fd6ddbf5f-j9jvb
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-ce5f9d-6fd6ddbf5f

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-ce5f9d-6fd6ddbf5f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-ce5f9d: serviceaccount "payload-processing-e2e-inf-b-ce5f9d" not found
(x5)

openshift-ingress

kubelet

e2e-ait-644ff039-openshift-default-649997fd76-gdvfv

ProbeError

Startup probe error: Get "http://10.133.0.40:15021/healthz/ready": dial tcp 10.133.0.40:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-644ff039-openshift-default-649997fd76-gdvfv

Unhealthy

Startup probe failed: Get "http://10.133.0.40:15021/healthz/ready": dial tcp 10.133.0.40:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-ce5f9d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-ce5f9d-5974c8dc74 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-ce5f9d-5974c8dc74

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-ce5f9d-5974c8dc74-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-ce5f9d: serviceaccount "payload-processing-e2e-inf-b-ce5f9d" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-ce5f9d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-ce5f9d-6fd6ddbf5f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-ce5f9d-5974c8dc74

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-ce5f9d-5974c8dc74-4jdjh

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-ce5f9d-5974c8dc74-4jdjh

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-ce5f9d-6fd6ddbf5f-j9jvb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

kubelet

e2e-autores-5ab28b-openshift-default-766bdbdcfd-45xrf

ProbeError

Startup probe error: Get "http://10.133.0.41:15021/healthz/ready": dial tcp 10.133.0.41:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-autores-5ab28b-openshift-default-766bdbdcfd-45xrf

Unhealthy

Startup probe failed: Get "http://10.133.0.41:15021/healthz/ready": dial tcp 10.133.0.41:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-inf-b-ce5f9d-6fd6ddbf5f-j9jvb

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-ce5f9d-6fd6ddbf5f-j9jvb

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-inf-b-ce5f9d-6fd6ddbf5f-j9jvb

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-ce5f9d-5974c8dc74-4jdjh

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-ce5f9d-5974c8dc74-4jdjh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-ce5f9d-5974c8dc74-4jdjh

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-644ff039-5b957d9799-qcxcn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-644ff039-6d756dfb58-xsh5l

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-644ff039-openshift-default-649997fd76-gdvfv

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-migrate-387ddcaa-gw-openshift-default-85f5bbcbb8

SuccessfulCreate

Created pod: e2e-migrate-387ddcaa-gw-openshift-default-85f5bbcbb8-hs8h5

openshift-ingress

kubelet

e2e-ait-644ff039-openshift-default-649997fd76-gdvfv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

e2e-migrate-387ddcaa-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-387ddcaa-gw-openshift-default-85f5bbcbb8 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-migrate-387ddcaa-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-387ddcaa-gw

openshift-ingress

kubelet

e2e-ait-644ff039-openshift-default-649997fd76-gdvfv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

multus

e2e-migrate-387ddcaa-gw-openshift-default-85f5bbcbb8-hs8h5

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-inf-b-ce5f9d-openshift-default-7557c9bb5b-7bcfj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-ce5f9d-openshift-default-7557c9bb5b-7bcfj

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-ce5f9d-openshift-default-7557c9bb5b-7bcfj

Created

Created container: istio-proxy
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-387ddcaa-8596dcf594

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-387ddcaa-8596dcf594-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-387ddcaa: serviceaccount "payload-processing-e2e-migrate-387ddcaa" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-387ddcaa

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-387ddcaa-55ff99db6 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-387ddcaa-55ff99db6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-387ddcaa-55ff99db6-jrxbs
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-387ddcaa-55ff99db6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-387ddcaa-55ff99db6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-387ddcaa: serviceaccount "payload-processing-e2e-migrate-387ddcaa" not found

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-387ddcaa

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-387ddcaa-8596dcf594 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-migrate-387ddcaa-55ff99db6-jrxbs

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-387ddcaa-8596dcf594

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-387ddcaa-8596dcf594-mwxvf

openshift-ingress

multus

payload-processing-e2e-migrate-387ddcaa-8596dcf594-mwxvf

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-387ddcaa-55ff99db6-jrxbs

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-387ddcaa-8596dcf594-mwxvf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-migrate-387ddcaa-8596dcf594-mwxvf

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-387ddcaa-55ff99db6-jrxbs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-migrate-387ddcaa-8596dcf594-mwxvf

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-387ddcaa-55ff99db6-jrxbs

Created

Created container: payload-pre-processing
(x6)

openshift-ingress

kubelet

e2e-inf-b-ce5f9d-openshift-default-7557c9bb5b-7bcfj

ProbeError

Startup probe error: Get "http://10.133.0.43:15021/healthz/ready": dial tcp 10.133.0.43:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-b-ce5f9d-openshift-default-7557c9bb5b-7bcfj

Unhealthy

Startup probe failed: Get "http://10.133.0.43:15021/healthz/ready": dial tcp 10.133.0.43:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-migrate-387ddcaa-gw-openshift-default-85f5bbcbb8-hs8h5

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-387ddcaa-gw-openshift-default-85f5bbcbb8-hs8h5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-387ddcaa-gw-openshift-default-85f5bbcbb8-hs8h5

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-migrate-387ddcaa-gw-openshift-default-85f5bbcbb8-hs8h5

Unhealthy

Startup probe failed: Get "http://10.132.0.48:15021/healthz/ready": dial tcp 10.132.0.48:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-migrate-387ddcaa-gw-openshift-default-85f5bbcbb8-hs8h5

ProbeError

Startup probe error: Get "http://10.132.0.48:15021/healthz/ready": dial tcp 10.132.0.48:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-migrate-387ddcaa-8596dcf594-mwxvf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-387ddcaa-55ff99db6-jrxbs

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-migrate-387ddcaa-gw-openshift-default-85f5bbcbb8-hs8h5

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-ait-30dae5eb-openshift-default-5475dbf994

SuccessfulCreate

Created pod: e2e-ait-30dae5eb-openshift-default-5475dbf994-fj642

openshift-ingress

gateway_labeler_controller

e2e-ait-30dae5eb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-30dae5eb

openshift-ingress

multus

e2e-ait-30dae5eb-openshift-default-5475dbf994-fj642

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ait-30dae5eb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-30dae5eb-openshift-default-5475dbf994 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-30dae5eb-7c88f68dc4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-30dae5eb-7c88f68dc4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-30dae5eb: serviceaccount "payload-processing-e2e-ait-30dae5eb" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-30dae5eb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-30dae5eb-674555df7c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-30dae5eb-7c88f68dc4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-30dae5eb-7c88f68dc4-45qtp

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-30dae5eb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-30dae5eb-7c88f68dc4 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-30dae5eb-674555df7c

FailedCreate

Error creating: pods "payload-processing-e2e-ait-30dae5eb-674555df7c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-30dae5eb: serviceaccount "payload-processing-e2e-ait-30dae5eb" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-30dae5eb-674555df7c

SuccessfulCreate

Created pod: payload-processing-e2e-ait-30dae5eb-674555df7c-lv2q2

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-30dae5eb-7c88f68dc4-45qtp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-30dae5eb-7c88f68dc4-45qtp

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-30dae5eb-674555df7c-lv2q2

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-30dae5eb-674555df7c-lv2q2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-30dae5eb-674555df7c-lv2q2

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ait-30dae5eb-7c88f68dc4-45qtp

AddedInterface

Add eth0 [10.133.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-30dae5eb-674555df7c-lv2q2

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-30dae5eb-7c88f68dc4-45qtp

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ait-30dae5eb-openshift-default-5475dbf994-fj642

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-30dae5eb-openshift-default-5475dbf994-fj642

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-30dae5eb-openshift-default-5475dbf994-fj642

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ait-30dae5eb-openshift-default-5475dbf994-fj642

ProbeError

Startup probe error: Get "http://10.133.0.53:15021/healthz/ready": dial tcp 10.133.0.53:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-30dae5eb-openshift-default-5475dbf994-fj642

Unhealthy

Startup probe failed: Get "http://10.133.0.53:15021/healthz/ready": dial tcp 10.133.0.53:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-30dae5eb-7c88f68dc4-45qtp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-30dae5eb-674555df7c-lv2q2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-30dae5eb-openshift-default-5475dbf994-fj642

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-derive-08482c4c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-08482c4c

openshift-ingress

replicaset-controller

e2e-derive-08482c4c-openshift-default-85f494fcbd

SuccessfulCreate

Created pod: e2e-derive-08482c4c-openshift-default-85f494fcbd-kn5dp

openshift-ingress

deployment-controller

e2e-derive-08482c4c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-08482c4c-openshift-default-85f494fcbd from 0 to 1

openshift-ingress

multus

e2e-derive-08482c4c-openshift-default-85f494fcbd-kn5dp

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-08482c4c-5cbcb75765

FailedCreate

Error creating: pods "payload-processing-e2e-derive-08482c4c-5cbcb75765-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-08482c4c: serviceaccount "payload-processing-e2e-derive-08482c4c" not found

openshift-ingress

deployment-controller

payload-processing-e2e-derive-08482c4c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-08482c4c-5cbcb75765 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-08482c4c-5cbcb75765

SuccessfulCreate

Created pod: payload-processing-e2e-derive-08482c4c-5cbcb75765-r6h2h

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-08482c4c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-08482c4c-679998bcb6 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-08482c4c-679998bcb6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-08482c4c-679998bcb6-c64z5
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-08482c4c-679998bcb6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-08482c4c-679998bcb6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-08482c4c: serviceaccount "payload-processing-e2e-derive-08482c4c" not found

openshift-ingress

multus

payload-processing-e2e-derive-08482c4c-5cbcb75765-r6h2h

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-08482c4c-679998bcb6-c64z5

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-08482c4c-5cbcb75765-r6h2h

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-derive-08482c4c-679998bcb6-c64z5

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-08482c4c-679998bcb6-c64z5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-derive-08482c4c-5cbcb75765-r6h2h

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-08482c4c-5cbcb75765-r6h2h

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-08482c4c-679998bcb6-c64z5

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-derive-08482c4c-openshift-default-85f494fcbd-kn5dp

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-08482c4c-openshift-default-85f494fcbd-kn5dp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-08482c4c-openshift-default-85f494fcbd-kn5dp

Started

Started container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-autores-5ab28b-c7d5fcf85-svr5v

Killing

Stopping container payload-processing
(x5)

openshift-ingress

kubelet

e2e-derive-08482c4c-openshift-default-85f494fcbd-kn5dp

Unhealthy

Startup probe failed: Get "http://10.132.0.51:15021/healthz/ready": dial tcp 10.132.0.51:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-5ab28b-f84ffd694-5kv6p

Killing

Stopping container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-derive-08482c4c-openshift-default-85f494fcbd-kn5dp

ProbeError

Startup probe error: Get "http://10.132.0.51:15021/healthz/ready": dial tcp 10.132.0.51:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-derive-08482c4c-5cbcb75765-r6h2h

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-08482c4c-679998bcb6-c64z5

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-derive-08482c4c

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-derive-08482c4c: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-derive-08482c4c": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-derive-08482c4c, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: f617eb27-1667-433e-9c58-52c89b619f7f, UID in object meta:

openshift-ingress

kubelet

e2e-derive-08482c4c-openshift-default-85f494fcbd-kn5dp

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-explicit-af329f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-af329f-openshift-default-7f5d768f8d from 0 to 1

openshift-ingress

replicaset-controller

e2e-explicit-af329f-openshift-default-7f5d768f8d

SuccessfulCreate

Created pod: e2e-explicit-af329f-openshift-default-7f5d768f8d-4d7bq

openshift-ingress

kubelet

e2e-autores-5ab28b-openshift-default-766bdbdcfd-45xrf

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-explicit-af329f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-af329f

openshift-ingress

multus

e2e-explicit-af329f-openshift-default-7f5d768f8d-4d7bq

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-af329f-66bfc59fc8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-af329f-66bfc59fc8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-af329f: serviceaccount "payload-processing-e2e-explicit-af329f" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-af329f-6c6c696665

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-af329f-6c6c696665-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-af329f: serviceaccount "payload-processing-e2e-explicit-af329f" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-af329f-6c6c696665

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-af329f-6c6c696665-f6x99

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-af329f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-af329f-6c6c696665 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-af329f-66bfc59fc8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-af329f-66bfc59fc8-5tg4w

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-af329f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-af329f-66bfc59fc8 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-af329f-66bfc59fc8-5tg4w

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-explicit-af329f-66bfc59fc8-5tg4w

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-af329f-6c6c696665-f6x99

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-af329f-6c6c696665-f6x99

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-explicit-af329f-6c6c696665-f6x99

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-af329f-66bfc59fc8-5tg4w

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-af329f-6c6c696665-f6x99

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-af329f-66bfc59fc8-5tg4w

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-explicit-af329f-openshift-default-7f5d768f8d-4d7bq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-af329f-openshift-default-7f5d768f8d-4d7bq

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-af329f-openshift-default-7f5d768f8d-4d7bq

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-explicit-af329f-openshift-default-7f5d768f8d-4d7bq

ProbeError

Startup probe error: Get "http://10.132.0.53:15021/healthz/ready": dial tcp 10.132.0.53:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-explicit-af329f-openshift-default-7f5d768f8d-4d7bq

Unhealthy

Startup probe failed: Get "http://10.132.0.53:15021/healthz/ready": dial tcp 10.132.0.53:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-mt-842ba8c2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-842ba8c2

openshift-ingress

deployment-controller

e2e-mt-842ba8c2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-842ba8c2-openshift-default-557f5fc9d4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-842ba8c2-openshift-default-557f5fc9d4

SuccessfulCreate

Created pod: e2e-mt-842ba8c2-openshift-default-557f5fc9d4-pf9d6

openshift-ingress

multus

e2e-mt-842ba8c2-openshift-default-557f5fc9d4-pf9d6

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-842ba8c2-6cdf879494-pmjfc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-842ba8c2-6cdf879494-pmjfc

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-842ba8c2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-842ba8c2-6cdf879494 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-842ba8c2-6cdf879494

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-842ba8c2-6cdf879494-pmjfc
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-842ba8c2-6cdf879494

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-842ba8c2-6cdf879494-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-842ba8c2: serviceaccount "payload-processing-e2e-mt-842ba8c2" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-842ba8c2-6cdf879494-pmjfc

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-842ba8c2-6cdf879494-pmjfc

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-mt-842ba8c2-c577fdbf-ftjm4

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-842ba8c2-c577fdbf-ftjm4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-842ba8c2-c577fdbf-ftjm4

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-842ba8c2-c577fdbf-ftjm4

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-842ba8c2-c577fdbf

FailedCreate

Error creating: pods "payload-processing-e2e-mt-842ba8c2-c577fdbf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-842ba8c2: serviceaccount "payload-processing-e2e-mt-842ba8c2" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-842ba8c2-c577fdbf

SuccessfulCreate

Created pod: payload-processing-e2e-mt-842ba8c2-c577fdbf-ftjm4

openshift-ingress

deployment-controller

payload-processing-e2e-mt-842ba8c2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-842ba8c2-c577fdbf from 0 to 1

openshift-ingress

kubelet

e2e-mt-842ba8c2-openshift-default-557f5fc9d4-pf9d6

Unhealthy

Readiness probe failed: Get "http://10.132.0.55:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-mt-842ba8c2-openshift-default-557f5fc9d4-pf9d6

ProbeError

Readiness probe error: Get "http://10.132.0.55:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-mt-842ba8c2-openshift-default-557f5fc9d4-pf9d6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-842ba8c2-openshift-default-557f5fc9d4-pf9d6

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-842ba8c2-openshift-default-557f5fc9d4-pf9d6

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-842ba8c2-openshift-default-557f5fc9d4-pf9d6

Unhealthy

Startup probe failed: Get "http://10.132.0.55:15021/healthz/ready": dial tcp 10.132.0.55:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-842ba8c2-openshift-default-557f5fc9d4-pf9d6

ProbeError

Startup probe error: Get "http://10.132.0.55:15021/healthz/ready": dial tcp 10.132.0.55:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-mt-842ba8c2-c577fdbf-ftjm4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-842ba8c2-6cdf879494-pmjfc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-842ba8c2-openshift-default-557f5fc9d4-pf9d6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-842ba8c2-openshift-default-557f5fc9d4-pf9d6

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-842ba8c2-openshift-default-557f5fc9d4-pf9d6

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-explicit-af329f-6c6c696665-f6x99

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-af329f-66bfc59fc8-5tg4w

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-shared-a-w2-1e0789-openshift-default-56fd556994

SuccessfulCreate

Created pod: e2e-shared-a-w2-1e0789-openshift-default-56fd556994-m6g5v

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-1e0789

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-1e0789

openshift-ingress

multus

e2e-shared-a-w2-1e0789-openshift-default-56fd556994-m6g5v

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-a-w2-1e0789-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-1e0789-openshift-default-56fd556994 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-1e0789-6595f797b5

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-1e0789-6595f797b5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-1e0789: serviceaccount "payload-processing-e2e-shared-a-w2-1e0789" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-1e0789-77bbc99758

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-1e0789-77bbc99758-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-1e0789: serviceaccount "payload-processing-e2e-shared-a-w2-1e0789" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-1e0789-77bbc99758

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-1e0789-77bbc99758-4fsxv

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-1e0789

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-1e0789-77bbc99758 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-1e0789-6595f797b5

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-1e0789-6595f797b5-wr8p8

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-1e0789

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-1e0789-6595f797b5 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-1e0789-6595f797b5-wr8p8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-1e0789-77bbc99758-4fsxv

AddedInterface

Add eth0 [10.134.0.70/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-1e0789-6595f797b5-wr8p8

AddedInterface

Add eth0 [10.134.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-1e0789-6595f797b5-wr8p8

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-1e0789-6595f797b5-wr8p8

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-1e0789-77bbc99758-4fsxv

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-1e0789-77bbc99758-4fsxv

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-1e0789-77bbc99758-4fsxv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

e2e-shared-b-w2-c3058d-openshift-default-565b4fb5f8

SuccessfulCreate

Created pod: e2e-shared-b-w2-c3058d-openshift-default-565b4fb5f8-hdt4h

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-c3058d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-c3058d

openshift-ingress

deployment-controller

e2e-shared-b-w2-c3058d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-c3058d-openshift-default-565b4fb5f8 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-1e0789-openshift-default-56fd556994-m6g5v

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

multus

e2e-shared-b-w2-c3058d-openshift-default-565b4fb5f8-hdt4h

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-1e0789-openshift-default-56fd556994-m6g5v

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-1e0789-openshift-default-56fd556994-m6g5v

Created

Created container: istio-proxy

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-c3058d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-c3058d-7d6bb5b54 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-c3058d-7d6bb5b54

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-c3058d-7d6bb5b54-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-c3058d: serviceaccount "payload-processing-e2e-shared-b-w2-c3058d" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-c3058d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-c3058d-6fd8b65645 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-c3058d-6fd8b65645

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-c3058d-6fd8b65645-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-c3058d: serviceaccount "payload-processing-e2e-shared-b-w2-c3058d" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-c3058d-6fd8b65645

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-c3058d-6fd8b65645-6b592

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-c3058d-7d6bb5b54

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-c3058d-7d6bb5b54-5gnfs

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-c3058d-6fd8b65645-6b592

AddedInterface

Add eth0 [10.133.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-c3058d-6fd8b65645-6b592

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-c3058d-6fd8b65645-6b592

Created

Created container: payload-processing
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-1e0789-openshift-default-56fd556994-m6g5v

Unhealthy

Startup probe failed: Get "http://10.132.0.57:15021/healthz/ready": dial tcp 10.132.0.57:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-c3058d-6fd8b65645-6b592

Started

Started container payload-processing
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-1e0789-openshift-default-56fd556994-m6g5v

ProbeError

Startup probe error: Get "http://10.132.0.57:15021/healthz/ready": dial tcp 10.132.0.57:15021: connect: connection refused body:

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-c3058d-7d6bb5b54-5gnfs

AddedInterface

Add eth0 [10.133.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-c3058d-7d6bb5b54-5gnfs

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-c3058d-7d6bb5b54-5gnfs

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-c3058d-7d6bb5b54-5gnfs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-explicit-af329f-openshift-default-7f5d768f8d-4d7bq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-noten-9b8682-openshift-default-568bf6c65d-2dj5n

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-noten-9b8682-openshift-default-568bf6c65d-2dj5n

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

deployment-controller

e2e-noten-9b8682-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-9b8682-openshift-default-568bf6c65d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-noten-9b8682

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-9b8682

openshift-ingress

replicaset-controller

e2e-noten-9b8682-openshift-default-568bf6c65d

SuccessfulCreate

Created pod: e2e-noten-9b8682-openshift-default-568bf6c65d-2dj5n

openshift-ingress

kubelet

e2e-noten-9b8682-openshift-default-568bf6c65d-2dj5n

Started

Started container istio-proxy

openshift-ingress

multus

e2e-noten-9b8682-openshift-default-568bf6c65d-2dj5n

AddedInterface

Add eth0 [10.133.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-explicit-af329f-openshift-default-7f5d768f8d-4d7bq

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-explicit-af329f-openshift-default-7f5d768f8d-4d7bq

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-c3058d-openshift-default-565b4fb5f8-hdt4h

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-c3058d-openshift-default-565b4fb5f8-hdt4h

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-c3058d-openshift-default-565b4fb5f8-hdt4h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-c3058d-openshift-default-565b4fb5f8-hdt4h

Unhealthy

Startup probe failed: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-c3058d-openshift-default-565b4fb5f8-hdt4h

ProbeError

Startup probe error: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-mt-61660fd5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-61660fd5-openshift-default-75cf76b6d8 from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-61660fd5-openshift-default-75cf76b6d8

SuccessfulCreate

Created pod: e2e-mt-61660fd5-openshift-default-75cf76b6d8-jcfmh

openshift-ingress

gateway_labeler_controller

e2e-mt-61660fd5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-61660fd5

openshift-ingress

multus

e2e-mt-61660fd5-openshift-default-75cf76b6d8-jcfmh

AddedInterface

Add eth0 [10.132.0.61/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-61660fd5-5d75b5f79c

SuccessfulCreate

Created pod: payload-processing-e2e-mt-61660fd5-5d75b5f79c-fxgbc
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-61660fd5-5d75b5f79c

FailedCreate

Error creating: pods "payload-processing-e2e-mt-61660fd5-5d75b5f79c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-61660fd5: serviceaccount "payload-processing-e2e-mt-61660fd5" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-61660fd5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-61660fd5-77cccfc78b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-61660fd5-77cccfc78b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-61660fd5-77cccfc78b-r69c5
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-61660fd5-77cccfc78b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-61660fd5-77cccfc78b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-61660fd5: serviceaccount "payload-processing-e2e-mt-61660fd5" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-61660fd5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-61660fd5-5d75b5f79c from 0 to 1

openshift-ingress

multus

payload-processing-e2e-mt-61660fd5-5d75b5f79c-fxgbc

AddedInterface

Add eth0 [10.134.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-61660fd5-77cccfc78b-r69c5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-61660fd5-77cccfc78b-r69c5

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-61660fd5-5d75b5f79c-fxgbc

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-61660fd5-77cccfc78b-r69c5

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-61660fd5-77cccfc78b-r69c5

AddedInterface

Add eth0 [10.134.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-61660fd5-5d75b5f79c-fxgbc

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-61660fd5-5d75b5f79c-fxgbc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-61660fd5-openshift-default-75cf76b6d8-jcfmh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-61660fd5-openshift-default-75cf76b6d8-jcfmh

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-61660fd5-openshift-default-75cf76b6d8-jcfmh

Created

Created container: istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-b0f4da-856f79778-8zd5g

Unhealthy

Readiness probe failed: dial tcp 10.134.0.49:9004: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-inf-a-b0f4da-77f559485f-2qpw7

Unhealthy

Readiness probe failed: dial tcp 10.134.0.50:9004: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-b0f4da-856f79778-8zd5g

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-b0f4da-77f559485f-2qpw7

Killing

Stopping container payload-processing
(x6)

openshift-ingress

kubelet

e2e-mt-61660fd5-openshift-default-75cf76b6d8-jcfmh

ProbeError

Startup probe error: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-61660fd5-openshift-default-75cf76b6d8-jcfmh

Unhealthy

Startup probe failed: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused

openshift-ingress

kubelet

e2e-inf-a-b0f4da-openshift-default-775fb84548-q6s7n

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-ce5f9d-5974c8dc74-4jdjh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-ce5f9d-6fd6ddbf5f-j9jvb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-b-ce5f9d-openshift-default-7557c9bb5b-7bcfj

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-af7727

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-af7727

openshift-ingress

deployment-controller

e2e-shared-a-w3-af7727-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-af7727-openshift-default-86dd8b9564 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w3-af7727-openshift-default-86dd8b9564

SuccessfulCreate

Created pod: e2e-shared-a-w3-af7727-openshift-default-86dd8b9564-9qbcn

openshift-ingress

multus

e2e-shared-a-w3-af7727-openshift-default-86dd8b9564-9qbcn

AddedInterface

Add eth0 [10.132.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-9b8682-openshift-default-568bf6c65d-2dj5n

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-af7727-6794fb697f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-af7727-6794fb697f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-af7727: serviceaccount "payload-processing-e2e-shared-a-w3-af7727" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-af7727

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-af7727-7dbbddd5d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-af7727-7dbbddd5d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-af7727-7dbbddd5d-mh874
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-af7727-7dbbddd5d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-af7727-7dbbddd5d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-af7727: serviceaccount "payload-processing-e2e-shared-a-w3-af7727" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-af7727-6794fb697f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-af7727-6794fb697f-8mmdr

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-af7727

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-af7727-6794fb697f from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-af7727-7dbbddd5d-mh874

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-af7727-7dbbddd5d-mh874

AddedInterface

Add eth0 [10.134.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-af7727-6794fb697f-8mmdr

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-af7727-6794fb697f-8mmdr

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-af7727-6794fb697f-8mmdr

AddedInterface

Add eth0 [10.133.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-af7727-7dbbddd5d-mh874

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-af7727-6794fb697f-8mmdr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-af7727-7dbbddd5d-mh874

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

e2e-shared-b-w3-7daa14-openshift-default-787b96ccf4

SuccessfulCreate

Created pod: e2e-shared-b-w3-7daa14-openshift-default-787b96ccf4-bx96x

openshift-ingress

deployment-controller

e2e-shared-b-w3-7daa14-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-7daa14-openshift-default-787b96ccf4 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-7daa14

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-7daa14

openshift-ingress

multus

e2e-shared-b-w3-7daa14-openshift-default-787b96ccf4-bx96x

AddedInterface

Add eth0 [10.133.0.73/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-7daa14-5767b64bf7

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-7daa14-5767b64bf7-fplrv
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-7daa14-84f97f9c66

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-7daa14-84f97f9c66-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-7daa14: serviceaccount "payload-processing-e2e-shared-b-w3-7daa14" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-7daa14-84f97f9c66

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-7daa14-84f97f9c66-tcwmr

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-7daa14

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-7daa14-84f97f9c66 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-7daa14

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-7daa14-5767b64bf7 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-7daa14-5767b64bf7

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-7daa14-5767b64bf7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-7daa14: serviceaccount "payload-processing-e2e-shared-b-w3-7daa14" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-7daa14-5767b64bf7-fplrv

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-7daa14-5767b64bf7-fplrv

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-7daa14-84f97f9c66-tcwmr

AddedInterface

Add eth0 [10.133.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-7daa14-84f97f9c66-tcwmr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-7daa14-84f97f9c66-tcwmr

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-7daa14-84f97f9c66-tcwmr

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-7daa14-5767b64bf7-fplrv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-7daa14-5767b64bf7-fplrv

AddedInterface

Add eth0 [10.133.0.75/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-af7727-openshift-default-86dd8b9564-9qbcn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-af7727-openshift-default-86dd8b9564-9qbcn

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-af7727-openshift-default-86dd8b9564-9qbcn

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-af7727-openshift-default-86dd8b9564-9qbcn

ProbeError

Startup probe error: Get "http://10.132.0.63:15021/healthz/ready": dial tcp 10.132.0.63:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-af7727-openshift-default-86dd8b9564-9qbcn

Unhealthy

Startup probe failed: Get "http://10.132.0.63:15021/healthz/ready": dial tcp 10.132.0.63:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-7daa14-openshift-default-787b96ccf4-bx96x

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-7daa14-openshift-default-787b96ccf4-bx96x

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-7daa14-openshift-default-787b96ccf4-bx96x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-7daa14-openshift-default-787b96ccf4-bx96x

Unhealthy

Startup probe failed: Get "http://10.133.0.73:15021/healthz/ready": dial tcp 10.133.0.73:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-7daa14-openshift-default-787b96ccf4-bx96x

ProbeError

Startup probe error: Get "http://10.133.0.73:15021/healthz/ready": dial tcp 10.133.0.73:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-61660fd5-77cccfc78b-r69c5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-61660fd5-5d75b5f79c-fxgbc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-61660fd5-openshift-default-75cf76b6d8-jcfmh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-61660fd5-openshift-default-75cf76b6d8-jcfmh

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-61660fd5-openshift-default-75cf76b6d8-jcfmh

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

e2e-api-a-f0a342-openshift-default-5d964f588d

SuccessfulCreate

Created pod: e2e-api-a-f0a342-openshift-default-5d964f588d-dzqdj

openshift-ingress

gateway_labeler_controller

e2e-api-a-f0a342

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-f0a342

openshift-ingress

deployment-controller

e2e-api-a-f0a342-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-f0a342-openshift-default-5d964f588d from 0 to 1

openshift-ingress

multus

e2e-api-a-f0a342-openshift-default-5d964f588d-dzqdj

AddedInterface

Add eth0 [10.132.0.67/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-f0a342-cfbfbb758

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-f0a342-cfbfbb758-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-f0a342: serviceaccount "payload-processing-e2e-api-a-f0a342" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-f0a342

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-f0a342-79c5677d67 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-f0a342

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-f0a342-cfbfbb758 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-f0a342-79c5677d67

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-f0a342-79c5677d67-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-f0a342: serviceaccount "payload-processing-e2e-api-a-f0a342" not found

openshift-ingress

multus

payload-processing-e2e-api-a-f0a342-79c5677d67-bjtwm

AddedInterface

Add eth0 [10.134.0.87/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-f0a342-cfbfbb758-2m28m

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-f0a342-cfbfbb758

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-f0a342-cfbfbb758-2m28m

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-f0a342-cfbfbb758-2m28m

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-f0a342-cfbfbb758-2m28m

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-097e16-65ddd76cdc-nrwtx

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-f0a342-79c5677d67

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-f0a342-79c5677d67-bjtwm

openshift-ingress

kubelet

payload-processing-e2e-api-a-f0a342-79c5677d67-bjtwm

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-f0a342-79c5677d67-bjtwm

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-a-f0a342-cfbfbb758-2m28m

AddedInterface

Add eth0 [10.134.0.86/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-097e16-546949c98-csmxk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-f0a342-79c5677d67-bjtwm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-worker-w0-097e16-openshift-default-7b675487dd-rvsqv

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-api-b-f23388-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-f23388-openshift-default-58ff587994 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-f23388-openshift-default-58ff587994

SuccessfulCreate

Created pod: e2e-api-b-f23388-openshift-default-58ff587994-rl257

openshift-ingress

gateway_labeler_controller

e2e-api-b-f23388

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-f23388
(x2)

openshift-ingress

kubelet

e2e-api-a-f0a342-openshift-default-5d964f588d-dzqdj

Created

Created container: istio-proxy

openshift-ingress

multus

e2e-api-b-f23388-openshift-default-58ff587994-rl257

AddedInterface

Add eth0 [10.133.0.78/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-api-a-f0a342-openshift-default-5d964f588d-dzqdj

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-f0a342-openshift-default-5d964f588d-dzqdj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-f23388-d7cbdc78

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-f23388-d7cbdc78-9pcsk
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-f23388-6f684696d5

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-f23388-6f684696d5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-f23388: serviceaccount "payload-processing-e2e-api-b-f23388" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-f23388-d7cbdc78

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-f23388-d7cbdc78-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-f23388: serviceaccount "payload-processing-e2e-api-b-f23388" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-f23388-6f684696d5

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-f23388-6f684696d5-4phh8

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-f23388

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-f23388-6f684696d5 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-f23388

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-f23388-d7cbdc78 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-api-b-f23388-d7cbdc78-9pcsk

AddedInterface

Add eth0 [10.133.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-f23388-d7cbdc78-9pcsk

Started

Started container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-api-a-f0a342-openshift-default-5d964f588d-dzqdj

ProbeError

Startup probe error: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-a-f0a342-openshift-default-5d964f588d-dzqdj

Unhealthy

Startup probe failed: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused

openshift-ingress

multus

payload-processing-e2e-api-b-f23388-6f684696d5-4phh8

AddedInterface

Add eth0 [10.134.0.89/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-f23388-6f684696d5-4phh8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-b-f23388-6f684696d5-4phh8

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-f23388-6f684696d5-4phh8

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-f23388-d7cbdc78-9pcsk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-f23388-d7cbdc78-9pcsk

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-api-b-f23388-openshift-default-58ff587994-rl257

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-f23388-openshift-default-58ff587994-rl257

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-f23388-openshift-default-58ff587994-rl257

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-b-f23388-openshift-default-58ff587994-rl257

Unhealthy

Startup probe failed: Get "http://10.133.0.78:15021/healthz/ready": dial tcp 10.133.0.78:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-b-f23388-openshift-default-58ff587994-rl257

ProbeError

Startup probe error: Get "http://10.133.0.78:15021/healthz/ready": dial tcp 10.133.0.78:15021: connect: connection refused body:

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-api-a-f0a342

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-api-a-f0a342: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-api-a-f0a342": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-api-a-f0a342, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 847bf66c-e1c0-429f-8289-34ad95bde287, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-f0a342-cfbfbb758-2m28m

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-f0a342-79c5677d67-bjtwm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-a-f0a342-openshift-default-5d964f588d-dzqdj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-api-b-f23388-6f684696d5-4phh8

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-api-b-f23388

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-api-b-f23388: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-api-b-f23388": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-api-b-f23388, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 15eec2d7-78e0-46f5-a3f2-ef68f1b7f005, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-f23388-d7cbdc78-9pcsk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-f23388-openshift-default-58ff587994-rl257

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-f23388-openshift-default-58ff587994-rl257

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-b-f23388-openshift-default-58ff587994-rl257

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-1e0789-77bbc99758-4fsxv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-1e0789-6595f797b5-wr8p8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w2-1e0789-openshift-default-56fd556994-m6g5v

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-c3058d-6fd8b65645-6b592

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-c3058d-7d6bb5b54-5gnfs

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w2-c3058d-openshift-default-565b4fb5f8-hdt4h

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-c3058d-openshift-default-565b4fb5f8-hdt4h

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w2-c3058d-openshift-default-565b4fb5f8-hdt4h

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-e6e6b8-b8cf98d95-dtvhn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-e6e6b8-7978b8f866-wxwzs

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w4-e6e6b8-openshift-default-68d99bd7b4-b5jt2

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-ipp-a-c9cef5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-c9cef5-openshift-default-8dbf59dc6 from 0 to 1

openshift-ingress

GatewayAuthBootstrap

e2e-ipp-a-c9cef5

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-ipp-a-c9cef5-authn-ssl: envoyfilters.networking.istio.io "e2e-ipp-a-c9cef5-authn-ssl" already exists

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-c9cef5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-c9cef5

openshift-ingress

multus

e2e-ipp-a-c9cef5-openshift-default-8dbf59dc6-jtscw

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-a-c9cef5-openshift-default-8dbf59dc6

SuccessfulCreate

Created pod: e2e-ipp-a-c9cef5-openshift-default-8dbf59dc6-jtscw

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-c9cef5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-c9cef5-d578999ff from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-c9cef5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-c9cef5-5bb46b7fb6 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-c9cef5-d578999ff

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-c9cef5-d578999ff-7h2vd

openshift-ingress

multus

payload-processing-e2e-ipp-a-c9cef5-d578999ff-7h2vd

AddedInterface

Add eth0 [10.134.0.102/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-c9cef5-5bb46b7fb6-gc2m8

AddedInterface

Add eth0 [10.134.0.101/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-c9cef5-5bb46b7fb6-gc2m8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-c9cef5-5bb46b7fb6-gc2m8

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-c9cef5-5bb46b7fb6-gc2m8

Started

Started container payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-c9cef5-5bb46b7fb6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-c9cef5-5bb46b7fb6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-c9cef5: serviceaccount "payload-processing-e2e-ipp-a-c9cef5" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-c9cef5-d578999ff-7h2vd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-c9cef5-5bb46b7fb6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-c9cef5-5bb46b7fb6-gc2m8
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-c9cef5-d578999ff

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-c9cef5-d578999ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-c9cef5: serviceaccount "payload-processing-e2e-ipp-a-c9cef5" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-c9cef5-d578999ff-7h2vd

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-c9cef5-d578999ff-7h2vd

Started

Started container payload-processing

openshift-ingress

replicaset-controller

e2e-ipp-b-c970f3-openshift-default-585c599b84

SuccessfulCreate

Created pod: e2e-ipp-b-c970f3-openshift-default-585c599b84-kqb2m

openshift-ingress

multus

e2e-ipp-b-c970f3-openshift-default-585c599b84-kqb2m

AddedInterface

Add eth0 [10.133.0.88/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ipp-b-c970f3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-c970f3-openshift-default-585c599b84 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-c970f3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-c970f3

openshift-ingress

kubelet

e2e-ipp-a-c9cef5-openshift-default-8dbf59dc6-jtscw

Unhealthy

Readiness probe failed: Get "http://10.132.0.69:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-a-c9cef5-openshift-default-8dbf59dc6-jtscw

ProbeError

Readiness probe error: Get "http://10.132.0.69:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-c970f3-b65b4747

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-c970f3-b65b4747-jfc28
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-c970f3-b65b4747

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-c970f3-b65b4747-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-c970f3: serviceaccount "payload-processing-e2e-ipp-b-c970f3" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-c970f3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-c970f3-b65b4747 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-c970f3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-c970f3-6bf9c9c56b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-c970f3-6bf9c9c56b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-c970f3-6bf9c9c56b-74cb9
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-c970f3-6bf9c9c56b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-c970f3-6bf9c9c56b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-c970f3: serviceaccount "payload-processing-e2e-ipp-b-c970f3" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-c970f3-b65b4747-jfc28

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-c970f3-6bf9c9c56b-74cb9

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-a-c9cef5-openshift-default-8dbf59dc6-jtscw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-c9cef5-openshift-default-8dbf59dc6-jtscw

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-c9cef5-openshift-default-8dbf59dc6-jtscw

Started

Started container istio-proxy

openshift-ingress

multus

payload-processing-e2e-ipp-b-c970f3-b65b4747-jfc28

AddedInterface

Add eth0 [10.133.0.89/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-c970f3-b65b4747-jfc28

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-c970f3-6bf9c9c56b-74cb9

AddedInterface

Add eth0 [10.134.0.104/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-c970f3-6bf9c9c56b-74cb9

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-c970f3-b65b4747-jfc28

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-c970f3-6bf9c9c56b-74cb9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x6)

openshift-ingress

kubelet

e2e-ipp-a-c9cef5-openshift-default-8dbf59dc6-jtscw

Unhealthy

Startup probe failed: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-a-c9cef5-openshift-default-8dbf59dc6-jtscw

ProbeError

Startup probe error: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-ipp-b-c970f3-openshift-default-585c599b84-kqb2m

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-c970f3-openshift-default-585c599b84-kqb2m

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-c970f3-openshift-default-585c599b84-kqb2m

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-b-c970f3-openshift-default-585c599b84-kqb2m

ProbeError

Startup probe error: Get "http://10.133.0.88:15021/healthz/ready": dial tcp 10.133.0.88:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-b-c970f3-openshift-default-585c599b84-kqb2m

Unhealthy

Startup probe failed: Get "http://10.133.0.88:15021/healthz/ready": dial tcp 10.133.0.88:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-be281e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-be281e

openshift-ingress

deployment-controller

e2e-ipp-cleanup-be281e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-be281e-openshift-default-5c4dbb5d5d from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-be281e-openshift-default-5c4dbb5d5d

SuccessfulCreate

Created pod: e2e-ipp-cleanup-be281e-openshift-default-5c4dbb5d5d-pzxjh

openshift-ingress

multus

e2e-ipp-cleanup-be281e-openshift-default-5c4dbb5d5d-pzxjh

AddedInterface

Add eth0 [10.132.0.70/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-be281e-78bcb8d77

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-be281e-78bcb8d77-8wlz2
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-be281e-c69d79cfd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-be281e-c69d79cfd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-be281e: serviceaccount "payload-processing-e2e-ipp-cleanup-be281e" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-be281e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-be281e-c69d79cfd from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-be281e-c69d79cfd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-be281e-c69d79cfd-t8h62

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-be281e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-be281e-78bcb8d77 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-be281e-78bcb8d77

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-be281e-78bcb8d77-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-be281e: serviceaccount "payload-processing-e2e-ipp-cleanup-be281e" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-be281e-c69d79cfd-t8h62

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-be281e-78bcb8d77-8wlz2

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-be281e-78bcb8d77-8wlz2

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-be281e-c69d79cfd-t8h62

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-be281e-78bcb8d77-8wlz2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-be281e-c69d79cfd-t8h62

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-be281e-c69d79cfd-t8h62

AddedInterface

Add eth0 [10.133.0.91/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-be281e-78bcb8d77-8wlz2

AddedInterface

Add eth0 [10.134.0.106/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-be281e-openshift-default-5c4dbb5d5d-pzxjh

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-be281e-openshift-default-5c4dbb5d5d-pzxjh

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-be281e-openshift-default-5c4dbb5d5d-pzxjh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-be281e-openshift-default-5c4dbb5d5d-pzxjh

ProbeError

Startup probe error: Get "http://10.132.0.70:15021/healthz/ready": dial tcp 10.132.0.70:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-be281e-openshift-default-5c4dbb5d5d-pzxjh

Unhealthy

Startup probe failed: Get "http://10.132.0.70:15021/healthz/ready": dial tcp 10.132.0.70:15021: connect: connection refused

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-cleanup-be281e

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-be281e: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-cleanup-be281e": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-be281e, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: b4554807-58d2-4f00-8ef5-edcaa0156f2b, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-be281e-78bcb8d77-8wlz2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-be281e-c69d79cfd-t8h62

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-be281e-openshift-default-5c4dbb5d5d-pzxjh

Killing

Stopping container istio-proxy

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-a-c9cef5

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-a-c9cef5: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-a-c9cef5": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-a-c9cef5, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 861c735a-ea90-454b-b547-cad65319ad8f, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-c9cef5-d578999ff-7h2vd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-c9cef5-5bb46b7fb6-gc2m8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-c9cef5-openshift-default-8dbf59dc6-jtscw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-c970f3-b65b4747-jfc28

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-c970f3-6bf9c9c56b-74cb9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-c970f3-openshift-default-585c599b84-kqb2m

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-af7727-6794fb697f-8mmdr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-af7727-7dbbddd5d-mh874

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w3-af7727-openshift-default-86dd8b9564-9qbcn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-af7727-openshift-default-86dd8b9564-9qbcn

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w3-af7727-openshift-default-86dd8b9564-9qbcn

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-7daa14-5767b64bf7-fplrv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-7daa14-84f97f9c66-tcwmr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w3-7daa14-openshift-default-787b96ccf4-bx96x

Killing

Stopping container istio-proxy