Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-pre-processing-e2e-mt-8acdf03d-7cdbc775f4-wxvbg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-8acdf03d-7cdbc775f4-wxvbg to ip-10-0-128-19.ec2.internal

openshift-ingress

payload-processing-e2e-ait-ecef8168-85ccc57df5-qn8zb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-ecef8168-85ccc57df5-qn8zb to ip-10-0-128-19.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-ecef8168-65fb4cc54-jlsn5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-ecef8168-65fb4cc54-jlsn5 to ip-10-0-128-19.ec2.internal

openshift-ingress

kube-auth-proxy-565756cbb6-tp4jn

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-565756cbb6-tp4jn to ip-10-0-134-180.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-cgp6q

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-cgp6q to ip-10-0-128-19.ec2.internal

openshift-ingress

e2e-mt-8acdf03d-openshift-default-654576b76-72fqm

Scheduled

Successfully assigned openshift-ingress/e2e-mt-8acdf03d-openshift-default-654576b76-72fqm to ip-10-0-129-54.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-08794c-7f77d5c99d-zjxw6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-08794c-7f77d5c99d-zjxw6 to ip-10-0-128-19.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-fddd6c88c-xg58q

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-xg58q to ip-10-0-128-19.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-0e34cd-55bc7bf58b-k967j

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-0e34cd-55bc7bf58b-k967j to ip-10-0-128-19.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-98d03a-9b9b49c5d-hrvnw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-98d03a-9b9b49c5d-hrvnw to ip-10-0-128-19.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-vrgbs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-vrgbs to ip-10-0-128-19.ec2.internal

openshift-ingress

e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t

Scheduled

Successfully assigned openshift-ingress/e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t to ip-10-0-128-19.ec2.internal

openshift-ingress

e2e-noten-e8425d-openshift-default-8d67b9ddd-z5lck

Scheduled

Successfully assigned openshift-ingress/e2e-noten-e8425d-openshift-default-8d67b9ddd-z5lck to ip-10-0-128-19.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-b5aeacc1-6c76745c94-jvt4d

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-b5aeacc1-6c76745c94-jvt4d to ip-10-0-134-180.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-0c2253-6896c76dc4-46q8g

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-0c2253-6896c76dc4-46q8g to ip-10-0-128-19.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-60b543-5f64f4dc4b-f55c7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-60b543-5f64f4dc4b-f55c7 to ip-10-0-128-19.ec2.internal

openshift-ingress

e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm to ip-10-0-129-54.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-b75273-9c79cfd94-vxzr4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-b75273-9c79cfd94-vxzr4 to ip-10-0-134-180.ec2.internal

openshift-ingress

e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx to ip-10-0-129-54.ec2.internal

openshift-ingress

e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4

Scheduled

Successfully assigned openshift-ingress/e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4 to ip-10-0-129-54.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-0c2253-d4d7cdd6f-84jb7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-0c2253-d4d7cdd6f-84jb7 to ip-10-0-128-19.ec2.internal

openshift-ingress

payload-processing-e2e-derive-b5aeacc1-6c44f5994f-8s8nl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-b5aeacc1-6c44f5994f-8s8nl to ip-10-0-128-19.ec2.internal

openshift-ingress

e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd to ip-10-0-129-54.ec2.internal

openshift-ingress

e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z to ip-10-0-128-19.ec2.internal

openshift-ingress

router-default-845c498454-fdsb6

Scheduled

Successfully assigned openshift-ingress/router-default-845c498454-fdsb6 to ip-10-0-134-180.ec2.internal

openshift-ingress

payload-processing-e2e-autores-98d03a-6c76d88d79-f4d4r

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-98d03a-6c76d88d79-f4d4r to ip-10-0-128-19.ec2.internal

openshift-ingress

e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26

Scheduled

Successfully assigned openshift-ingress/e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26 to ip-10-0-128-19.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-0e34cd-c8c9956f9-4pf2n

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-0e34cd-c8c9956f9-4pf2n to ip-10-0-128-19.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-08794c-577f47cb4f-2mlnk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-08794c-577f47cb4f-2mlnk to ip-10-0-128-19.ec2.internal

openshift-ingress

e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m to ip-10-0-128-19.ec2.internal

openshift-ingress

e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz

Scheduled

Successfully assigned openshift-ingress/e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz to ip-10-0-129-54.ec2.internal

openshift-ingress

e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6 to ip-10-0-128-19.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-014f36-54bfc4666-xs9x9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-014f36-54bfc4666-xs9x9 to ip-10-0-128-19.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-30cc8d-5dccb54486-p45br

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-30cc8d-5dccb54486-p45br to ip-10-0-128-19.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-6f830d-6446c64c6b-bl5w9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-6f830d-6446c64c6b-bl5w9 to ip-10-0-128-19.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-c69c6364-6bc4c6b978-d85ll

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-c69c6364-6bc4c6b978-d85ll to ip-10-0-128-19.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-26dbe7df-654c85fd5d-sb48k

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-26dbe7df-654c85fd5d-sb48k to ip-10-0-128-19.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-eed32982-6475d6c54b-5rv9t

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-eed32982-6475d6c54b-5rv9t to ip-10-0-128-19.ec2.internal

openshift-ingress

e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv to ip-10-0-129-54.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-zhwv7

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zhwv7 to ip-10-0-134-180.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-020a18-b95fcfc8b-n8sgp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-020a18-b95fcfc8b-n8sgp to ip-10-0-128-19.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-fc867c-6b5d84dbc4-76qcz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-fc867c-6b5d84dbc4-76qcz to ip-10-0-134-180.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-d62b4e-5dd7b869cd-cxsjh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-d62b4e-5dd7b869cd-cxsjh to ip-10-0-128-19.ec2.internal

openshift-ingress

e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8 to ip-10-0-129-54.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-b75273-7cb76bcfbc-hm2nw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-b75273-7cb76bcfbc-hm2nw to ip-10-0-128-19.ec2.internal

openshift-ingress

kube-auth-proxy-565756cbb6-tw8jg

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-565756cbb6-tw8jg to ip-10-0-128-19.ec2.internal

openshift-ingress

e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq to ip-10-0-129-54.ec2.internal

openshift-ingress

e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l to ip-10-0-128-19.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-68cf4d799cwr6qr

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwr6qr to ip-10-0-129-54.ec2.internal

openshift-ingress

router-default-845c498454-fdsb6

FailedScheduling

0/3 nodes are available: 3 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/3 nodes are available: 3 Preemption is not helpful for scheduling.

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-565cd7-76cd6f664b-gjf77

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-565cd7-76cd6f664b-gjf77 to ip-10-0-134-180.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-565cd7-756fb557c-drpjm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-565cd7-756fb557c-drpjm to ip-10-0-128-19.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-d62b4e-58456dd66f-98slg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-d62b4e-58456dd66f-98slg to ip-10-0-134-180.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-fc867c-77f7d8ff57-vgprw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-fc867c-77f7d8ff57-vgprw to ip-10-0-128-19.ec2.internal

openshift-ingress

e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd to ip-10-0-128-19.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-020a18-77db95b885-9cfvk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-020a18-77db95b885-9cfvk to ip-10-0-134-180.ec2.internal

openshift-ingress

payload-processing-e2e-mt-8acdf03d-6cff7686df-v29k7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-8acdf03d-6cff7686df-v29k7 to ip-10-0-128-19.ec2.internal

openshift-ingress

payload-processing-e2e-mt-26dbe7df-5fff6c948f-5hglk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-26dbe7df-5fff6c948f-5hglk to ip-10-0-128-19.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-c69c6364-7fccdbb854-8c6zk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-c69c6364-7fccdbb854-8c6zk to ip-10-0-128-19.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-6f830d-5fb9fffddf-959ff

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-6f830d-5fb9fffddf-959ff to ip-10-0-134-180.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-30cc8d-75748f4f-72nx4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-30cc8d-75748f4f-72nx4 to ip-10-0-134-180.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-014f36-86c65c6d5-v9mn6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-014f36-86c65c6d5-v9mn6 to ip-10-0-128-19.ec2.internal

openshift-ingress

e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st to ip-10-0-129-54.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-5w58s

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-5w58s to ip-10-0-129-54.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-60b543-7fcb5db85-8wmlg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-60b543-7fcb5db85-8wmlg to ip-10-0-128-19.ec2.internal

openshift-ingress

payload-processing-e2e-ait-eed32982-b6bb5c56c-ghzv6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-eed32982-b6bb5c56c-ghzv6 to ip-10-0-128-19.ec2.internal

openshift-ingress

e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm to ip-10-0-129-54.ec2.internal

openshift-ingress

e2e-autores-98d03a-openshift-default-799cd777cb-xbggv

Scheduled

Successfully assigned openshift-ingress/e2e-autores-98d03a-openshift-default-799cd777cb-xbggv to ip-10-0-129-54.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-5ccb968c66-gr8lt

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-gr8lt to ip-10-0-129-54.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-845c498454 from 0 to 1

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x13)

openshift-ingress

replicaset-controller

router-default-845c498454

FailedCreate

Error creating: pods "router-default-845c498454-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x16)

openshift-ingress

replicaset-controller

router-default-845c498454

FailedCreate

Error creating: pods "router-default-845c498454-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-845c498454

SuccessfulCreate

Created pod: router-default-845c498454-fdsb6
(x6)

openshift-ingress

kubelet

router-default-845c498454-fdsb6

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x6)

openshift-ingress

kubelet

router-default-845c498454-fdsb6

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found

openshift-ingress

kubelet

router-default-845c498454-fdsb6

Started

Started container router

openshift-ingress

kubelet

router-default-845c498454-fdsb6

Created

Created container: router

openshift-ingress

kubelet

router-default-845c498454-fdsb6

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:da130d90f0bffd5c5876c94544c91b2a1be0d23ce2747ddfeafe88e03ee7d8d1" already present on machine

openshift-ingress

multus

router-default-845c498454-fdsb6

AddedInterface

Add eth0 [10.132.0.14/23] from ovn-kubernetes

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-565756cbb6 from 0 to 2
(x5)

openshift-ingress

replicaset-controller

kube-auth-proxy-565756cbb6

FailedCreate

Error creating: pods "kube-auth-proxy-565756cbb6-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-565756cbb6

SuccessfulCreate

Created pod: kube-auth-proxy-565756cbb6-tp4jn

openshift-ingress

replicaset-controller

kube-auth-proxy-565756cbb6

SuccessfulCreate

Created pod: kube-auth-proxy-565756cbb6-tw8jg

openshift-ingress

kubelet

kube-auth-proxy-565756cbb6-tp4jn

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

kubelet

kube-auth-proxy-565756cbb6-tw8jg

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-565756cbb6-tw8jg

AddedInterface

Add eth0 [10.133.0.16/23] from ovn-kubernetes

openshift-ingress

multus

kube-auth-proxy-565756cbb6-tp4jn

AddedInterface

Add eth0 [10.132.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-zhwv7

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-zhwv7

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-zhwv7

AddedInterface

Add eth0 [10.132.0.36/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-565756cbb6-tw8jg

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-565756cbb6-tw8jg

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 3.868s (3.868s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-565756cbb6-tw8jg

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-565756cbb6-tp4jn

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-565756cbb6-tp4jn

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-zhwv7

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.374s (3.374s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

kube-auth-proxy-565756cbb6-tp4jn

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 4.507s (4.507s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-zhwv7

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-zhwv7

Started

Started container discovery

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-fddd6c88c-xg58q

AddedInterface

Add eth0 [10.133.0.17/23] from ovn-kubernetes

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-68cf4d799c from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-zhwv7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-zhwv7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-fddd6c88c-xg58q

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-68cf4d799c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-68cf4d799cwr6qr

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-fddd6c88c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-fddd6c88c-xg58q

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-fddd6c88c from 0 to 1

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cwr6qr

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-68cf4d799cwr6qr

AddedInterface

Add eth0 [10.134.0.22/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cwr6qr

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.828s (2.828s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cwr6qr

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cwr6qr

Started

Started container istio-proxy

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled down replica set data-science-gateway-data-science-gateway-class-fddd6c88c from 1 to 0

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-fddd6c88c

SuccessfulDelete

Deleted pod: data-science-gateway-data-science-gateway-class-fddd6c88c-xg58q

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-fddd6c88c-xg58q

Created

Created container: istio-proxy

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-fddd6c88c-xg58q

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 10.131s (10.131s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-fddd6c88c-xg58q

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-fddd6c88c-xg58q

Started

Started container istio-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-cgp6q

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-cgp6q

AddedInterface

Add eth0 [10.133.0.19/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-cgp6q

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-cgp6q

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 4.047s (4.047s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-cgp6q

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-cgp6q

Created

Created container: discovery

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-zhwv7

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-zhwv7

Killing

Stopping container discovery
(x4)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5ccb968c66

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5ccb968c66-gr8lt

openshift-ingress

multus

maas-default-gateway-openshift-default-5ccb968c66-gr8lt

AddedInterface

Add eth0 [10.134.0.32/23] from ovn-kubernetes

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-5ccb968c66 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-5w58s
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-vrgbs

openshift-ingress

multus

payload-processing-5b54b7fbb7-5w58s

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-5w58s

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-vrgbs

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-vrgbs

AddedInterface

Add eth0 [10.133.0.26/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-vrgbs

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.317s (2.317s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-vrgbs

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-vrgbs

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-5w58s

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 3.593s (3.593s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-5w58s

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-5w58s

Started

Started container payload-processing

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-gr8lt

ProbeError

Readiness probe error: Get "http://10.134.0.32:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-gr8lt

Unhealthy

Readiness probe failed: Get "http://10.134.0.32:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-gr8lt

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-gr8lt

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-gr8lt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-gr8lt

ProbeError

Startup probe error: Get "http://10.134.0.32:15021/healthz/ready": dial tcp 10.134.0.32:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-gr8lt

Unhealthy

Startup probe failed: Get "http://10.134.0.32:15021/healthz/ready": dial tcp 10.134.0.32:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-inf-a-60b543-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-60b543-openshift-default-7455bfc6fd from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-60b543-openshift-default-7455bfc6fd

SuccessfulCreate

Created pod: e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m

openshift-ingress

gateway_labeler_controller

e2e-inf-a-60b543

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-60b543

openshift-ingress

multus

e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m

AddedInterface

Add eth0 [10.133.0.29/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-60b543-5f64f4dc4b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-60b543-5f64f4dc4b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-60b543: serviceaccount "payload-processing-e2e-inf-a-60b543" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-60b543-7fcb5db85

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-60b543-7fcb5db85-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-60b543: serviceaccount "payload-processing-e2e-inf-a-60b543" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-60b543

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-60b543-7fcb5db85 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-60b543

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-60b543-5f64f4dc4b from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-a-60b543-7fcb5db85-8wmlg

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-60b543-7fcb5db85-8wmlg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-60b543-5f64f4dc4b-f55c7

AddedInterface

Add eth0 [10.133.0.30/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-inf-a-60b543-7fcb5db85-8wmlg

AddedInterface

Add eth0 [10.133.0.31/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-60b543-5f64f4dc4b-f55c7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-60b543-5f64f4dc4b-f55c7

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-60b543-5f64f4dc4b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-60b543-5f64f4dc4b-f55c7

openshift-ingress

kubelet

payload-processing-e2e-inf-a-60b543-7fcb5db85-8wmlg

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-60b543-5f64f4dc4b-f55c7

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-60b543-7fcb5db85

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-60b543-7fcb5db85-8wmlg

openshift-ingress

replicaset-controller

e2e-ait-eed32982-openshift-default-7f8fccff56

SuccessfulCreate

Created pod: e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz

openshift-ingress

deployment-controller

e2e-ait-eed32982-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-eed32982-openshift-default-7f8fccff56 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-eed32982

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-eed32982

openshift-ingress

multus

e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-autores-98d03a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-98d03a

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-eed32982

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-eed32982-6475d6c54b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-eed32982-6475d6c54b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-eed32982-6475d6c54b-5rv9t
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-eed32982-6475d6c54b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-eed32982-6475d6c54b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-eed32982: serviceaccount "payload-processing-e2e-ait-eed32982" not found

openshift-ingress

deployment-controller

e2e-autores-98d03a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-98d03a-openshift-default-799cd777cb from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ait-eed32982

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-eed32982-b6bb5c56c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-eed32982-b6bb5c56c

SuccessfulCreate

Created pod: payload-processing-e2e-ait-eed32982-b6bb5c56c-ghzv6

openshift-ingress

replicaset-controller

e2e-autores-98d03a-openshift-default-799cd777cb

SuccessfulCreate

Created pod: e2e-autores-98d03a-openshift-default-799cd777cb-xbggv
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-eed32982-b6bb5c56c

FailedCreate

Error creating: pods "payload-processing-e2e-ait-eed32982-b6bb5c56c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-eed32982: serviceaccount "payload-processing-e2e-ait-eed32982" not found

openshift-ingress

multus

e2e-autores-98d03a-openshift-default-799cd777cb-xbggv

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-eed32982-6475d6c54b-5rv9t

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-eed32982-6475d6c54b-5rv9t

AddedInterface

Add eth0 [10.133.0.32/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-eed32982-6475d6c54b-5rv9t

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-eed32982-6475d6c54b-5rv9t

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-eed32982-b6bb5c56c-ghzv6

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-eed32982-b6bb5c56c-ghzv6

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-eed32982-b6bb5c56c-ghzv6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-eed32982-b6bb5c56c-ghzv6

AddedInterface

Add eth0 [10.133.0.33/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-autores-98d03a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-98d03a-6c76d88d79 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-98d03a-9b9b49c5d-hrvnw

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-98d03a-9b9b49c5d-hrvnw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-98d03a-9b9b49c5d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-98d03a-9b9b49c5d-hrvnw

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-98d03a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-98d03a-9b9b49c5d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-98d03a-6c76d88d79

FailedCreate

Error creating: pods "payload-processing-e2e-autores-98d03a-6c76d88d79-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-98d03a: serviceaccount "payload-processing-e2e-autores-98d03a" not found

openshift-ingress

kubelet

payload-processing-e2e-autores-98d03a-6c76d88d79-f4d4r

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-98d03a-6c76d88d79-f4d4r

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-98d03a-9b9b49c5d-hrvnw

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-98d03a-6c76d88d79

SuccessfulCreate

Created pod: payload-processing-e2e-autores-98d03a-6c76d88d79-f4d4r

openshift-ingress

kubelet

payload-processing-e2e-autores-98d03a-6c76d88d79-f4d4r

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-autores-98d03a-6c76d88d79-f4d4r

AddedInterface

Add eth0 [10.133.0.35/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-autores-98d03a-9b9b49c5d-hrvnw

AddedInterface

Add eth0 [10.133.0.34/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-98d03a-9b9b49c5d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-98d03a-9b9b49c5d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-98d03a: serviceaccount "payload-processing-e2e-autores-98d03a" not found

openshift-ingress

kubelet

e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m

ProbeError

Readiness probe error: Get "http://10.133.0.29:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m

Unhealthy

Readiness probe failed: Get "http://10.133.0.29:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m

Unhealthy

Startup probe failed: Get "http://10.133.0.29:15021/healthz/ready": dial tcp 10.133.0.29:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz

ProbeError

Readiness probe error: Get "http://10.134.0.46:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz

Unhealthy

Readiness probe failed: Get "http://10.134.0.46:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x5)

openshift-ingress

kubelet

e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m

ProbeError

Startup probe error: Get "http://10.133.0.29:15021/healthz/ready": dial tcp 10.133.0.29:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-inf-b-b75273-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-b75273-openshift-default-566fcd546d from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz

Created

Created container: istio-proxy

openshift-ingress

replicaset-controller

e2e-inf-b-b75273-openshift-default-566fcd546d

SuccessfulCreate

Created pod: e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq

openshift-ingress

gateway_labeler_controller

e2e-inf-b-b75273

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-b75273
(x2)

openshift-ingress

kubelet

e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

multus

e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-b75273

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-b75273-7cb76bcfbc from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-b75273-7cb76bcfbc

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-b75273-7cb76bcfbc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-b75273: serviceaccount "payload-processing-e2e-inf-b-b75273" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-b75273-7cb76bcfbc

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-b75273-7cb76bcfbc-hm2nw

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-b75273

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-b75273-9c79cfd94 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-b75273-9c79cfd94

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-b75273-9c79cfd94-vxzr4
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-b75273-9c79cfd94

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-b75273-9c79cfd94-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-b75273: serviceaccount "payload-processing-e2e-inf-b-b75273" not found

openshift-ingress

kubelet

payload-processing-e2e-inf-b-b75273-7cb76bcfbc-hm2nw

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-b75273-9c79cfd94-vxzr4

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-b75273-9c79cfd94-vxzr4

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-e2e-inf-b-b75273-7cb76bcfbc-hm2nw

AddedInterface

Add eth0 [10.133.0.36/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-b75273-7cb76bcfbc-hm2nw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-b-b75273-7cb76bcfbc-hm2nw

Started

Started container payload-processing
(x6)

openshift-ingress

kubelet

e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz

ProbeError

Startup probe error: Get "http://10.134.0.46:15021/healthz/ready": dial tcp 10.134.0.46:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz

Unhealthy

Startup probe failed: Get "http://10.134.0.46:15021/healthz/ready": dial tcp 10.134.0.46:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-b75273-9c79cfd94-vxzr4

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-b75273-9c79cfd94-vxzr4

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-b75273-9c79cfd94-vxzr4

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.834s (1.834s including waiting). Image size: 166449337 bytes.
(x2)

openshift-ingress

kubelet

e2e-autores-98d03a-openshift-default-799cd777cb-xbggv

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-98d03a-openshift-default-799cd777cb-xbggv

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-98d03a-openshift-default-799cd777cb-xbggv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-autores-98d03a-openshift-default-799cd777cb-xbggv

ProbeError

Startup probe error: Get "http://10.134.0.48:15021/healthz/ready": dial tcp 10.134.0.48:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-autores-98d03a-openshift-default-799cd777cb-xbggv

Unhealthy

Startup probe failed: Get "http://10.134.0.48:15021/healthz/ready": dial tcp 10.134.0.48:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-ait-eed32982-openshift-default-7f8fccff56-k5vbz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ait-eed32982-b6bb5c56c-ghzv6

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ait-eed32982

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ait-eed32982: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ait-eed32982": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ait-eed32982, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: b059b19f-c2e0-4b43-be23-551d224d610b, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-eed32982-6475d6c54b-5rv9t

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

e2e-migrate-c69c6364-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-migrate-c69c6364-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-c69c6364-gw

openshift-ingress

replicaset-controller

e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6

SuccessfulCreate

Created pod: e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm

openshift-ingress

multus

e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-c69c6364-7fccdbb854-8c6zk

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-c69c6364-6bc4c6b978-d85ll

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-migrate-c69c6364-6bc4c6b978-d85ll

AddedInterface

Add eth0 [10.133.0.38/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-c69c6364

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-c69c6364-7fccdbb854 from 0 to 1
(x6)

openshift-ingress

kubelet

e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq

ProbeError

Startup probe error: Get "http://10.134.0.49:15021/healthz/ready": dial tcp 10.134.0.49:15021: connect: connection refused body:

openshift-ingress

multus

payload-processing-e2e-migrate-c69c6364-7fccdbb854-8c6zk

AddedInterface

Add eth0 [10.133.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-c69c6364-7fccdbb854-8c6zk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-c69c6364-7fccdbb854

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-c69c6364-7fccdbb854-8c6zk

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-c69c6364-6bc4c6b978-d85ll

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x6)

openshift-ingress

kubelet

e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq

Unhealthy

Startup probe failed: Get "http://10.134.0.49:15021/healthz/ready": dial tcp 10.134.0.49:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-c69c6364-6bc4c6b978-d85ll

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-c69c6364-7fccdbb854-8c6zk

Started

Started container payload-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-c69c6364-6bc4c6b978

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-c69c6364-6bc4c6b978-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-c69c6364: serviceaccount "payload-processing-e2e-migrate-c69c6364" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-c69c6364-6bc4c6b978

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-c69c6364-6bc4c6b978-d85ll

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-c69c6364

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-c69c6364-6bc4c6b978 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-c69c6364-7fccdbb854

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-c69c6364-7fccdbb854-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-c69c6364: serviceaccount "payload-processing-e2e-migrate-c69c6364" not found
(x2)

openshift-ingress

kubelet

e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm

Unhealthy

Startup probe failed: Get "http://10.134.0.50:15021/healthz/ready": dial tcp 10.134.0.50:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm

ProbeError

Startup probe error: Get "http://10.134.0.50:15021/healthz/ready": dial tcp 10.134.0.50:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-migrate-c69c6364-7fccdbb854-8c6zk

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-migrate-c69c6364

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-migrate-c69c6364: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-migrate-c69c6364": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-migrate-c69c6364, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 9ff8e097-29f6-49b1-8572-06d9f4e135d8, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-c69c6364-6bc4c6b978-d85ll

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-ait-ecef8168

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-ecef8168

openshift-ingress

deployment-controller

e2e-ait-ecef8168-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-ecef8168-openshift-default-5574c75bd4 from 0 to 1

openshift-ingress

kubelet

e2e-migrate-c69c6364-gw-openshift-default-7d5d5d55f6-j6dnm

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-ait-ecef8168-openshift-default-5574c75bd4

SuccessfulCreate

Created pod: e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4

openshift-ingress

multus

e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-ecef8168-85ccc57df5

FailedCreate

Error creating: pods "payload-processing-e2e-ait-ecef8168-85ccc57df5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-ecef8168: serviceaccount "payload-processing-e2e-ait-ecef8168" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-ecef8168-65fb4cc54-jlsn5

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ait-ecef8168-85ccc57df5-qn8zb

AddedInterface

Add eth0 [10.133.0.42/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ait-ecef8168

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-ecef8168-85ccc57df5 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-ecef8168

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-ecef8168-65fb4cc54 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-ecef8168-85ccc57df5

SuccessfulCreate

Created pod: payload-processing-e2e-ait-ecef8168-85ccc57df5-qn8zb

openshift-ingress

kubelet

payload-processing-e2e-ait-ecef8168-85ccc57df5-qn8zb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-ecef8168-65fb4cc54

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-ecef8168-65fb4cc54-jlsn5

openshift-ingress

kubelet

payload-processing-e2e-ait-ecef8168-85ccc57df5-qn8zb

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-ecef8168-65fb4cc54-jlsn5

AddedInterface

Add eth0 [10.133.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-ecef8168-65fb4cc54-jlsn5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-ecef8168-65fb4cc54-jlsn5

Created

Created container: payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-ecef8168-65fb4cc54

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-ecef8168-65fb4cc54-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-ecef8168: serviceaccount "payload-processing-e2e-ait-ecef8168" not found

openshift-ingress

kubelet

payload-processing-e2e-ait-ecef8168-85ccc57df5-qn8zb

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4

Unhealthy

Startup probe failed: Get "http://10.134.0.51:15021/healthz/ready": dial tcp 10.134.0.51:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4

ProbeError

Startup probe error: Get "http://10.134.0.51:15021/healthz/ready": dial tcp 10.134.0.51:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-98d03a-9b9b49c5d-hrvnw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-98d03a-6c76d88d79-f4d4r

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-ecef8168-85ccc57df5-qn8zb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-ecef8168-65fb4cc54-jlsn5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-ecef8168-openshift-default-5574c75bd4-z8fm4

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-derive-b5aeacc1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-b5aeacc1

openshift-ingress

deployment-controller

e2e-derive-b5aeacc1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd from 0 to 1

openshift-ingress

replicaset-controller

e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd

SuccessfulCreate

Created pod: e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26

openshift-ingress

multus

e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-derive-b5aeacc1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-b5aeacc1-6c44f5994f from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-derive-b5aeacc1-6c44f5994f-8s8nl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-b5aeacc1-6c76745c94-jvt4d

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-derive-b5aeacc1-6c76745c94-jvt4d

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-b5aeacc1-6c44f5994f-8s8nl

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-b5aeacc1-6c44f5994f-8s8nl

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-b5aeacc1-6c44f5994f

FailedCreate

Error creating: pods "payload-processing-e2e-derive-b5aeacc1-6c44f5994f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-b5aeacc1: serviceaccount "payload-processing-e2e-derive-b5aeacc1" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-b5aeacc1-6c76745c94-jvt4d

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-derive-b5aeacc1-6c44f5994f-8s8nl

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-b5aeacc1-6c76745c94-jvt4d

Started

Started container payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-b5aeacc1-6c76745c94

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-b5aeacc1-6c76745c94-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-b5aeacc1: serviceaccount "payload-processing-e2e-derive-b5aeacc1" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-b5aeacc1-6c76745c94

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-b5aeacc1-6c76745c94-jvt4d

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-b5aeacc1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-b5aeacc1-6c76745c94 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-b5aeacc1-6c44f5994f

SuccessfulCreate

Created pod: payload-processing-e2e-derive-b5aeacc1-6c44f5994f-8s8nl
(x2)

openshift-ingress

kubelet

e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26

ProbeError

Startup probe error: Get "http://10.133.0.45:15021/healthz/ready": dial tcp 10.133.0.45:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26

Unhealthy

Startup probe failed: Get "http://10.133.0.45:15021/healthz/ready": dial tcp 10.133.0.45:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-b5aeacc1-6c76745c94-jvt4d

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-b5aeacc1-6c44f5994f-8s8nl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-autores-98d03a-openshift-default-799cd777cb-xbggv

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-explicit-0c2253

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-0c2253

openshift-ingress

multus

e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-explicit-0c2253-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-0c2253-openshift-default-f85fdffdd from 0 to 1

openshift-ingress

replicaset-controller

e2e-explicit-0c2253-openshift-default-f85fdffdd

SuccessfulCreate

Created pod: e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd

openshift-ingress

kubelet

e2e-autores-98d03a-openshift-default-799cd777cb-xbggv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-autores-98d03a-openshift-default-799cd777cb-xbggv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-0c2253-6896c76dc4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-0c2253-6896c76dc4-46q8g

openshift-ingress

kubelet

payload-processing-e2e-explicit-0c2253-d4d7cdd6f-84jb7

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-0c2253-d4d7cdd6f-84jb7

Started

Started container payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-0c2253

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-0c2253-6896c76dc4 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-0c2253-6896c76dc4-46q8g

Created

Created container: payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-0c2253-d4d7cdd6f

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-0c2253-d4d7cdd6f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-0c2253: serviceaccount "payload-processing-e2e-explicit-0c2253" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-0c2253-d4d7cdd6f

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-0c2253-d4d7cdd6f-84jb7

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-0c2253

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-0c2253-d4d7cdd6f from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-0c2253-6896c76dc4-46q8g

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-explicit-0c2253-6896c76dc4-46q8g

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-explicit-0c2253-d4d7cdd6f-84jb7

AddedInterface

Add eth0 [10.133.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-0c2253-6896c76dc4-46q8g

Started

Started container payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-0c2253-6896c76dc4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-0c2253-6896c76dc4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-0c2253: serviceaccount "payload-processing-e2e-explicit-0c2253" not found

openshift-ingress

kubelet

payload-processing-e2e-explicit-0c2253-d4d7cdd6f-84jb7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd

Unhealthy

Readiness probe failed: Get "http://10.134.0.54:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd

ProbeError

Readiness probe error: Get "http://10.134.0.54:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd

Unhealthy

Startup probe failed: Get "http://10.134.0.54:15021/healthz/ready": dial tcp 10.134.0.54:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd

ProbeError

Startup probe error: Get "http://10.134.0.54:15021/healthz/ready": dial tcp 10.134.0.54:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-explicit-0c2253-d4d7cdd6f-84jb7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-0c2253-6896c76dc4-46q8g

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

e2e-noten-e8425d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-e8425d-openshift-default-8d67b9ddd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-noten-e8425d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-e8425d

openshift-ingress

replicaset-controller

e2e-noten-e8425d-openshift-default-8d67b9ddd

SuccessfulCreate

Created pod: e2e-noten-e8425d-openshift-default-8d67b9ddd-z5lck

openshift-ingress

kubelet

e2e-explicit-0c2253-openshift-default-f85fdffdd-ch9vd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-noten-e8425d-openshift-default-8d67b9ddd-z5lck

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

multus

e2e-noten-e8425d-openshift-default-8d67b9ddd-z5lck

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-e8425d-openshift-default-8d67b9ddd-z5lck

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-noten-e8425d-openshift-default-8d67b9ddd-z5lck

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-noten-e8425d-openshift-default-8d67b9ddd-z5lck

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-mt-8acdf03d-openshift-default-654576b76

SuccessfulCreate

Created pod: e2e-mt-8acdf03d-openshift-default-654576b76-72fqm

openshift-ingress

multus

e2e-mt-8acdf03d-openshift-default-654576b76-72fqm

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-mt-8acdf03d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-8acdf03d

openshift-ingress

deployment-controller

e2e-mt-8acdf03d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-8acdf03d-openshift-default-654576b76 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-mt-8acdf03d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-8acdf03d-6cff7686df from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-8acdf03d-6cff7686df

SuccessfulCreate

Created pod: payload-processing-e2e-mt-8acdf03d-6cff7686df-v29k7
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-8acdf03d-7cdbc775f4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-8acdf03d-7cdbc775f4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-8acdf03d: serviceaccount "payload-processing-e2e-mt-8acdf03d" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-8acdf03d-7cdbc775f4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-8acdf03d-7cdbc775f4-wxvbg

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-8acdf03d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-8acdf03d-7cdbc775f4 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-8acdf03d-6cff7686df

FailedCreate

Error creating: pods "payload-processing-e2e-mt-8acdf03d-6cff7686df-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-8acdf03d: serviceaccount "payload-processing-e2e-mt-8acdf03d" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-8acdf03d-7cdbc775f4-wxvbg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-8acdf03d-6cff7686df-v29k7

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-8acdf03d-6cff7686df-v29k7

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-8acdf03d-7cdbc775f4-wxvbg

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-8acdf03d-7cdbc775f4-wxvbg

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-8acdf03d-6cff7686df-v29k7

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-8acdf03d-7cdbc775f4-wxvbg

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-8acdf03d-6cff7686df-v29k7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-mt-8acdf03d-openshift-default-654576b76-72fqm

Unhealthy

Readiness probe failed: Get "http://10.134.0.55:15021/healthz/ready": read tcp 10.134.0.2:56812->10.134.0.55:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-mt-8acdf03d-openshift-default-654576b76-72fqm

ProbeError

Readiness probe error: Get "http://10.134.0.55:15021/healthz/ready": read tcp 10.134.0.2:56812->10.134.0.55:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-mt-8acdf03d-openshift-default-654576b76-72fqm

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-8acdf03d-openshift-default-654576b76-72fqm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-8acdf03d-openshift-default-654576b76-72fqm

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-8acdf03d-openshift-default-654576b76-72fqm

ProbeError

Startup probe error: Get "http://10.134.0.55:15021/healthz/ready": dial tcp 10.134.0.55:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-8acdf03d-openshift-default-654576b76-72fqm

Unhealthy

Startup probe failed: Get "http://10.134.0.55:15021/healthz/ready": dial tcp 10.134.0.55:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-inf-a-60b543-7fcb5db85-8wmlg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-60b543-5f64f4dc4b-f55c7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-b75273-9c79cfd94-vxzr4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-b75273-7cb76bcfbc-hm2nw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-8acdf03d-7cdbc775f4-wxvbg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-8acdf03d-6cff7686df-v29k7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-b-b75273-openshift-default-566fcd546d-5rvcq

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-fc867c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-fc867c

openshift-ingress

deployment-controller

e2e-shared-a-w3-fc867c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74

SuccessfulCreate

Created pod: e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l

openshift-ingress

multus

e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-8acdf03d-openshift-default-654576b76-72fqm

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-fc867c-6b5d84dbc4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-fc867c-6b5d84dbc4-76qcz

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-fc867c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-fc867c-6b5d84dbc4 from 0 to 1

openshift-ingress

kubelet

e2e-mt-8acdf03d-openshift-default-654576b76-72fqm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-8acdf03d-openshift-default-654576b76-72fqm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-fc867c-77f7d8ff57

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-fc867c-77f7d8ff57-vgprw
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-fc867c-77f7d8ff57

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-fc867c-77f7d8ff57-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-fc867c: serviceaccount "payload-processing-e2e-shared-a-w3-fc867c" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-fc867c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-fc867c-77f7d8ff57 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-fc867c-6b5d84dbc4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-fc867c-6b5d84dbc4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-fc867c: serviceaccount "payload-processing-e2e-shared-a-w3-fc867c" not found

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-fc867c-77f7d8ff57-vgprw

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-fc867c-77f7d8ff57-vgprw

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-fc867c-77f7d8ff57-vgprw

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-fc867c-77f7d8ff57-vgprw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-fc867c-6b5d84dbc4-76qcz

AddedInterface

Add eth0 [10.132.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-fc867c-6b5d84dbc4-76qcz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-fc867c-6b5d84dbc4-76qcz

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-fc867c-6b5d84dbc4-76qcz

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l

Unhealthy

Readiness probe failed: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused

openshift-ingress

kubelet

e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l

ProbeError

Readiness probe error: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-020a18

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-020a18

openshift-ingress

deployment-controller

e2e-shared-a-w2-020a18-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-020a18-openshift-default-dd86b5f78 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l

Started

Started container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-w2-020a18-openshift-default-dd86b5f78

SuccessfulCreate

Created pod: e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx

openshift-ingress

multus

e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-020a18-b95fcfc8b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-020a18-b95fcfc8b-n8sgp
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-020a18-b95fcfc8b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-020a18-b95fcfc8b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-020a18: serviceaccount "payload-processing-e2e-shared-a-w2-020a18" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-020a18-77db95b885

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-020a18-77db95b885-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-020a18: serviceaccount "payload-processing-e2e-shared-a-w2-020a18" not found
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l

ProbeError

Startup probe error: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-020a18-77db95b885

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-020a18-77db95b885-9cfvk

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-020a18

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-020a18-b95fcfc8b from 0 to 1
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l

Unhealthy

Startup probe failed: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-020a18

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-020a18-77db95b885 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-020a18-b95fcfc8b-n8sgp

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-020a18-b95fcfc8b-n8sgp

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-020a18-77db95b885-9cfvk

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-020a18-77db95b885-9cfvk

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-020a18-77db95b885-9cfvk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-020a18-77db95b885-9cfvk

AddedInterface

Add eth0 [10.132.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-020a18-b95fcfc8b-n8sgp

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-020a18-b95fcfc8b-n8sgp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-565cd7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-565cd7

openshift-ingress

deployment-controller

e2e-shared-b-w3-565cd7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8

SuccessfulCreate

Created pod: e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv

openshift-ingress

multus

e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-565cd7-76cd6f664b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-565cd7-76cd6f664b-gjf77

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-565cd7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-565cd7-76cd6f664b from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-565cd7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-565cd7-756fb557c from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-565cd7-756fb557c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-565cd7-756fb557c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-565cd7: serviceaccount "payload-processing-e2e-shared-b-w3-565cd7" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-565cd7-756fb557c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-565cd7-756fb557c-drpjm
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-565cd7-76cd6f664b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-565cd7-76cd6f664b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-565cd7: serviceaccount "payload-processing-e2e-shared-b-w3-565cd7" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-565cd7-756fb557c-drpjm

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-565cd7-756fb557c-drpjm

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-565cd7-76cd6f664b-gjf77

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-565cd7-76cd6f664b-gjf77

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-565cd7-76cd6f664b-gjf77

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-565cd7-76cd6f664b-gjf77

AddedInterface

Add eth0 [10.132.0.67/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-565cd7-756fb557c-drpjm

AddedInterface

Add eth0 [10.133.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-565cd7-756fb557c-drpjm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx

ProbeError

Readiness probe error: Get "http://10.134.0.57:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx

Unhealthy

Readiness probe failed: Get "http://10.134.0.57:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx

ProbeError

Startup probe error: Get "http://10.134.0.57:15021/healthz/ready": dial tcp 10.134.0.57:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx

Unhealthy

Startup probe failed: Get "http://10.134.0.57:15021/healthz/ready": dial tcp 10.134.0.57:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6

SuccessfulCreate

Created pod: e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z

openshift-ingress

deployment-controller

e2e-shared-b-w2-d62b4e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-d62b4e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-d62b4e

openshift-ingress

multus

e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z

AddedInterface

Add eth0 [10.133.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv

Unhealthy

Readiness probe failed: Get "http://10.134.0.59:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv

ProbeError

Readiness probe error: Get "http://10.134.0.59:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-d62b4e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-d62b4e-58456dd66f from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-d62b4e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-d62b4e-5dd7b869cd from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-d62b4e-58456dd66f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-d62b4e-58456dd66f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-d62b4e: serviceaccount "payload-processing-e2e-shared-b-w2-d62b4e" not found

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-d62b4e-58456dd66f-98slg

AddedInterface

Add eth0 [10.132.0.68/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-d62b4e-5dd7b869cd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-d62b4e-5dd7b869cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-d62b4e: serviceaccount "payload-processing-e2e-shared-b-w2-d62b4e" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-d62b4e-58456dd66f-98slg

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-d62b4e-5dd7b869cd-cxsjh

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-d62b4e-58456dd66f-98slg

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-d62b4e-5dd7b869cd-cxsjh

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-d62b4e-58456dd66f-98slg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-d62b4e-5dd7b869cd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-d62b4e-5dd7b869cd-cxsjh

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-d62b4e-58456dd66f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-d62b4e-58456dd66f-98slg

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-d62b4e-5dd7b869cd-cxsjh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-d62b4e-5dd7b869cd-cxsjh

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv

ProbeError

Startup probe error: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv

Unhealthy

Startup probe failed: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused

openshift-ingress

kubelet

e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z

Unhealthy

Readiness probe failed: Get "http://10.133.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z

ProbeError

Readiness probe error: Get "http://10.133.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z

Unhealthy

Startup probe failed: Get "http://10.133.0.62:15021/healthz/ready": dial tcp 10.133.0.62:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z

ProbeError

Startup probe error: Get "http://10.133.0.62:15021/healthz/ready": dial tcp 10.133.0.62:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-mt-26dbe7df-openshift-default-59558c9fcb

SuccessfulCreate

Created pod: e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t

openshift-ingress

gateway_labeler_controller

e2e-mt-26dbe7df

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-26dbe7df

openshift-ingress

deployment-controller

e2e-mt-26dbe7df-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-26dbe7df-openshift-default-59558c9fcb from 0 to 1

openshift-ingress

multus

e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t

AddedInterface

Add eth0 [10.133.0.64/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-26dbe7df

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-26dbe7df-654c85fd5d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-26dbe7df-654c85fd5d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-26dbe7df-654c85fd5d-sb48k
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-26dbe7df-654c85fd5d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-26dbe7df-654c85fd5d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-26dbe7df: serviceaccount "payload-processing-e2e-mt-26dbe7df" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-26dbe7df

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-26dbe7df-5fff6c948f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-26dbe7df-5fff6c948f

SuccessfulCreate

Created pod: payload-processing-e2e-mt-26dbe7df-5fff6c948f-5hglk
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-26dbe7df-5fff6c948f

FailedCreate

Error creating: pods "payload-processing-e2e-mt-26dbe7df-5fff6c948f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-26dbe7df: serviceaccount "payload-processing-e2e-mt-26dbe7df" not found

openshift-ingress

kubelet

payload-processing-e2e-mt-26dbe7df-5fff6c948f-5hglk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-26dbe7df-5fff6c948f-5hglk

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-26dbe7df-5fff6c948f-5hglk

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-mt-26dbe7df-5fff6c948f-5hglk

AddedInterface

Add eth0 [10.133.0.66/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-mt-26dbe7df-654c85fd5d-sb48k

AddedInterface

Add eth0 [10.133.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-26dbe7df-654c85fd5d-sb48k

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-26dbe7df-654c85fd5d-sb48k

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-26dbe7df-654c85fd5d-sb48k

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t

Unhealthy

Startup probe failed: Get "http://10.133.0.64:15021/healthz/ready": dial tcp 10.133.0.64:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t

ProbeError

Startup probe error: Get "http://10.133.0.64:15021/healthz/ready": dial tcp 10.133.0.64:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-mt-26dbe7df-5fff6c948f-5hglk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-26dbe7df-654c85fd5d-sb48k

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-api-a-08794c-openshift-default-77479c6bc4

SuccessfulCreate

Created pod: e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8

openshift-ingress

deployment-controller

e2e-api-a-08794c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-08794c-openshift-default-77479c6bc4 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-08794c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-08794c

openshift-ingress

multus

e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-08794c-7f77d5c99d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-08794c-7f77d5c99d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-08794c: serviceaccount "payload-processing-e2e-api-a-08794c" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-08794c-577f47cb4f

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-08794c-577f47cb4f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-08794c: serviceaccount "payload-processing-e2e-api-a-08794c" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-08794c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-08794c-577f47cb4f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-08794c-577f47cb4f

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-08794c-577f47cb4f-2mlnk

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-08794c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-08794c-7f77d5c99d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-08794c-7f77d5c99d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-08794c-7f77d5c99d-zjxw6

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-08794c-7f77d5c99d-zjxw6

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-api-a-08794c-577f47cb4f-2mlnk

AddedInterface

Add eth0 [10.133.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-08794c-577f47cb4f-2mlnk

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-08794c-7f77d5c99d-zjxw6

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-08794c-7f77d5c99d-zjxw6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-a-08794c-7f77d5c99d-zjxw6

AddedInterface

Add eth0 [10.133.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-08794c-577f47cb4f-2mlnk

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-08794c-577f47cb4f-2mlnk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

deployment-controller

e2e-api-b-0e34cd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-0e34cd-openshift-default-557dd656d from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-0e34cd-openshift-default-557dd656d

SuccessfulCreate

Created pod: e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd

openshift-ingress

gateway_labeler_controller

e2e-api-b-0e34cd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-0e34cd

openshift-ingress

multus

e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd

AddedInterface

Add eth0 [10.133.0.71/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8

ProbeError

Startup probe error: Get "http://10.134.0.63:15021/healthz/ready": dial tcp 10.134.0.63:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8

Unhealthy

Startup probe failed: Get "http://10.134.0.63:15021/healthz/ready": dial tcp 10.134.0.63:15021: connect: connection refused
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-0e34cd-c8c9956f9

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-0e34cd-c8c9956f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-0e34cd: serviceaccount "payload-processing-e2e-api-b-0e34cd" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-0e34cd-55bc7bf58b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-0e34cd-55bc7bf58b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-0e34cd: serviceaccount "payload-processing-e2e-api-b-0e34cd" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-0e34cd-c8c9956f9

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-0e34cd-c8c9956f9-4pf2n

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-0e34cd-55bc7bf58b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-0e34cd-55bc7bf58b-k967j

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-0e34cd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-0e34cd-c8c9956f9 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-0e34cd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-0e34cd-55bc7bf58b from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-0e34cd-55bc7bf58b-k967j

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-0e34cd-55bc7bf58b-k967j

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-api-b-0e34cd-c8c9956f9-4pf2n

AddedInterface

Add eth0 [10.133.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-0e34cd-c8c9956f9-4pf2n

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-b-0e34cd-c8c9956f9-4pf2n

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-0e34cd-c8c9956f9-4pf2n

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-0e34cd-55bc7bf58b-k967j

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-b-0e34cd-55bc7bf58b-k967j

AddedInterface

Add eth0 [10.133.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd

Unhealthy

Readiness probe failed: Get "http://10.133.0.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd

ProbeError

Readiness probe error: Get "http://10.133.0.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd

ProbeError

Startup probe error: Get "http://10.133.0.71:15021/healthz/ready": dial tcp 10.133.0.71:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd

Unhealthy

Startup probe failed: Get "http://10.133.0.71:15021/healthz/ready": dial tcp 10.133.0.71:15021: connect: connection refused

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-api-a-08794c

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-api-a-08794c: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-api-a-08794c": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-api-a-08794c, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 850186af-b2ed-4825-bd9d-27c93e25ac2d, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-api-a-08794c-577f47cb4f-2mlnk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-08794c-7f77d5c99d-zjxw6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-a-08794c-openshift-default-77479c6bc4-d7bm8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-0e34cd-55bc7bf58b-k967j

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-0e34cd-c8c9956f9-4pf2n

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-020a18-77db95b885-9cfvk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-020a18-b95fcfc8b-n8sgp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w2-020a18-openshift-default-dd86b5f78-jdjwx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-d62b4e-58456dd66f-98slg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-d62b4e-5dd7b869cd-cxsjh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

multus

e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ipp-a-014f36-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-014f36-openshift-default-696f458594 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-014f36

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-014f36

openshift-ingress

replicaset-controller

e2e-ipp-a-014f36-openshift-default-696f458594

SuccessfulCreate

Created pod: e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-014f36

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-014f36-86c65c6d5 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-014f36

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-014f36-54bfc4666 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-014f36-86c65c6d5

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-014f36-86c65c6d5-v9mn6
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-014f36-86c65c6d5

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-014f36-86c65c6d5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-014f36: serviceaccount "payload-processing-e2e-ipp-a-014f36" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-014f36-54bfc4666

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-014f36-54bfc4666-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-014f36: serviceaccount "payload-processing-e2e-ipp-a-014f36" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-014f36-54bfc4666

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-014f36-54bfc4666-xs9x9

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-014f36-86c65c6d5-v9mn6

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-014f36-54bfc4666-xs9x9

AddedInterface

Add eth0 [10.133.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-014f36-54bfc4666-xs9x9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-014f36-54bfc4666-xs9x9

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-014f36-54bfc4666-xs9x9

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-014f36-86c65c6d5-v9mn6

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-014f36-86c65c6d5-v9mn6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-a-014f36-86c65c6d5-v9mn6

AddedInterface

Add eth0 [10.133.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm

ProbeError

Readiness probe error: Get "http://10.134.0.65:15021/healthz/ready": read tcp 10.134.0.2:49000->10.134.0.65:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm

Unhealthy

Readiness probe failed: Get "http://10.134.0.65:15021/healthz/ready": read tcp 10.134.0.2:49000->10.134.0.65:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm

Unhealthy

Startup probe failed: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm

ProbeError

Startup probe error: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-ipp-b-30cc8d-openshift-default-66c7d8967d

SuccessfulCreate

Created pod: e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st

openshift-ingress

deployment-controller

e2e-ipp-b-30cc8d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-30cc8d-openshift-default-66c7d8967d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-30cc8d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-30cc8d

openshift-ingress

multus

e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-30cc8d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-30cc8d-5dccb54486 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-30cc8d-75748f4f

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-30cc8d-75748f4f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-30cc8d: serviceaccount "payload-processing-e2e-ipp-b-30cc8d" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-30cc8d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-30cc8d-75748f4f from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-30cc8d-5dccb54486

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-30cc8d-5dccb54486-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-30cc8d: serviceaccount "payload-processing-e2e-ipp-b-30cc8d" not found

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-30cc8d-5dccb54486-p45br

AddedInterface

Add eth0 [10.133.0.80/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-30cc8d-75748f4f-72nx4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-30cc8d-5dccb54486

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-30cc8d-5dccb54486-p45br

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-30cc8d-75748f4f-72nx4

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-30cc8d-75748f4f-72nx4

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-30cc8d-5dccb54486-p45br

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-30cc8d-5dccb54486-p45br

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-30cc8d-75748f4f

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-30cc8d-75748f4f-72nx4

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-30cc8d-5dccb54486-p45br

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-b-30cc8d-75748f4f-72nx4

AddedInterface

Add eth0 [10.132.0.84/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st

Unhealthy

Startup probe failed: Get "http://10.134.0.67:15021/healthz/ready": dial tcp 10.134.0.67:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st

ProbeError

Startup probe error: Get "http://10.134.0.67:15021/healthz/ready": dial tcp 10.134.0.67:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-6f830d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-6f830d

openshift-ingress

multus

e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6

AddedInterface

Add eth0 [10.133.0.81/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-6f830d-openshift-default-66df667b74

SuccessfulCreate

Created pod: e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6

openshift-ingress

deployment-controller

e2e-ipp-cleanup-6f830d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-6f830d-openshift-default-66df667b74 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-6f830d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-6f830d-6446c64c6b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-6f830d-6446c64c6b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-6f830d-6446c64c6b-bl5w9

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-6f830d-5fb9fffddf

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-6f830d-5fb9fffddf-959ff
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-6f830d-6446c64c6b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-6f830d-6446c64c6b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-6f830d: serviceaccount "payload-processing-e2e-ipp-cleanup-6f830d" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-6f830d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-6f830d-5fb9fffddf from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-6f830d-5fb9fffddf

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-6f830d-5fb9fffddf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-6f830d: serviceaccount "payload-processing-e2e-ipp-cleanup-6f830d" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-6f830d-6446c64c6b-bl5w9

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-6f830d-5fb9fffddf-959ff

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-6f830d-6446c64c6b-bl5w9

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-6f830d-5fb9fffddf-959ff

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-6f830d-6446c64c6b-bl5w9

AddedInterface

Add eth0 [10.133.0.82/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-6f830d-6446c64c6b-bl5w9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-6f830d-5fb9fffddf-959ff

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-6f830d-5fb9fffddf-959ff

AddedInterface

Add eth0 [10.132.0.86/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6

ProbeError

Startup probe error: Get "http://10.133.0.81:15021/healthz/ready": dial tcp 10.133.0.81:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6

Unhealthy

Startup probe failed: Get "http://10.133.0.81:15021/healthz/ready": dial tcp 10.133.0.81:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-6f830d-5fb9fffddf-959ff

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-6f830d-6446c64c6b-bl5w9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-014f36-54bfc4666-xs9x9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-014f36-86c65c6d5-v9mn6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-014f36-openshift-default-696f458594-lpsnm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-30cc8d-75748f4f-72nx4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-30cc8d-5dccb54486-p45br

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-b-30cc8d-openshift-default-66c7d8967d-xj4st

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-fc867c-77f7d8ff57-vgprw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-fc867c-6b5d84dbc4-76qcz

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-a-w3-fc867c

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-a-w3-fc867c: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-a-w3-fc867c": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-a-w3-fc867c, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: d36f720f-271a-49de-8463-34c3283ffa5e, UID in object meta:

openshift-ingress

kubelet

e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-565cd7-756fb557c-drpjm

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-b-w3-565cd7

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-b-w3-565cd7: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-b-w3-565cd7": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-b-w3-565cd7, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 6a130fb0-7d70-4f9a-8810-9675f63a6886, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-565cd7-76cd6f664b-gjf77

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w3-565cd7-openshift-default-54f7f79bc8-9hjhv

Killing

Stopping container istio-proxy