Time Namespace Component RelatedObject Reason Message

openshift-ingress

e2e-migrate-8a8c53fa-gw-openshift-default-5f67bbddbd-kmnpr

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-8a8c53fa-gw-openshift-default-5f67bbddbd-kmnpr to ip-10-0-142-236.ec2.internal

openshift-ingress

e2e-ipp-cleanup-b3c355-openshift-default-cdbf9b574-vcjxq

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-b3c355-openshift-default-cdbf9b574-vcjxq to ip-10-0-142-236.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-j2lqk

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-j2lqk to ip-10-0-142-236.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-88828d-98786f4c4-zlpkt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-88828d-98786f4c4-zlpkt to ip-10-0-142-236.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-f7eb8e-7b5cb6b9bb-77mtf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f7eb8e-7b5cb6b9bb-77mtf to ip-10-0-139-127.ec2.internal

openshift-ingress

e2e-ipp-a-bea561-openshift-default-7785699846-9k2vz

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-bea561-openshift-default-7785699846-9k2vz to ip-10-0-138-66.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-5245c1-8f77bfb98-s95n6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-5245c1-8f77bfb98-s95n6 to ip-10-0-142-236.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-e35897-7bcb865898-cx965

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-e35897-7bcb865898-cx965 to ip-10-0-142-236.ec2.internal

openshift-ingress

e2e-ait-b52c7b74-openshift-default-6ff75bdb48-v44r2

Scheduled

Successfully assigned openshift-ingress/e2e-ait-b52c7b74-openshift-default-6ff75bdb48-v44r2 to ip-10-0-138-66.ec2.internal

openshift-ingress

e2e-shared-a-w2-e35897-openshift-default-6b65cb4b76-l8sj8

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-e35897-openshift-default-6b65cb4b76-l8sj8 to ip-10-0-142-236.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-8cff3b-7b9457cd97-44blx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-8cff3b-7b9457cd97-44blx to ip-10-0-142-236.ec2.internal

openshift-ingress

payload-processing-e2e-ait-b52c7b74-599dcd5db7-bzwnt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-b52c7b74-599dcd5db7-bzwnt to ip-10-0-142-236.ec2.internal

openshift-ingress

e2e-explicit-6fa8d6-openshift-default-fbb756f44-5hwn9

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-6fa8d6-openshift-default-fbb756f44-5hwn9 to ip-10-0-142-236.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-87b0d1-6bf8ff5575-tl85j

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-87b0d1-6bf8ff5575-tl85j to ip-10-0-139-127.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-4r6np

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-4r6np to ip-10-0-139-127.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-5ccb968c66-ln8g4

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-ln8g4 to ip-10-0-138-66.ec2.internal

openshift-ingress

e2e-noten-ffeb50-openshift-default-6fc657db8d-hsxmx

Scheduled

Successfully assigned openshift-ingress/e2e-noten-ffeb50-openshift-default-6fc657db8d-hsxmx to ip-10-0-138-66.ec2.internal

openshift-ingress

payload-processing-e2e-derive-58fce2d8-54dcd8dc57-bqm8k

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-58fce2d8-54dcd8dc57-bqm8k to ip-10-0-142-236.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-6fa8d6-85b657f95c-zv8tq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-6fa8d6-85b657f95c-zv8tq to ip-10-0-142-236.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-d8b443-6c5559fcbc-drngf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-d8b443-6c5559fcbc-drngf to ip-10-0-139-127.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-b52c7b74-78577d474b-ksx42

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-b52c7b74-78577d474b-ksx42 to ip-10-0-139-127.ec2.internal

openshift-ingress

router-default-76b88fd7dd-5knhq

Scheduled

Successfully assigned openshift-ingress/router-default-76b88fd7dd-5knhq to ip-10-0-138-66.ec2.internal

openshift-ingress

e2e-ait-eef2d470-openshift-default-5f799c9bbb-ffrb6

Scheduled

Successfully assigned openshift-ingress/e2e-ait-eef2d470-openshift-default-5f799c9bbb-ffrb6 to ip-10-0-142-236.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-f4c99d38-84bd4dd558-tgf9m

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-f4c99d38-84bd4dd558-tgf9m to ip-10-0-142-236.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-ede0daf1-55b7487d66-hskgj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-ede0daf1-55b7487d66-hskgj to ip-10-0-139-127.ec2.internal

openshift-ingress

e2e-ipp-b-64702c-openshift-default-5fc78b848d-vhhsv

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-64702c-openshift-default-5fc78b848d-vhhsv to ip-10-0-142-236.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-8a8c53fa-7c799d655d-gq9tn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-8a8c53fa-7c799d655d-gq9tn to ip-10-0-139-127.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-b3c355-794b978dbb-zmpqm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-b3c355-794b978dbb-zmpqm to ip-10-0-139-127.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-64702c-6c55c6c894-qlk27

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-64702c-6c55c6c894-qlk27 to ip-10-0-139-127.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-bea561-5cf94c685d-5hdxz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-bea561-5cf94c685d-5hdxz to ip-10-0-142-236.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-d8b443-6fc54688db-jd8bc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-d8b443-6fc54688db-jd8bc to ip-10-0-139-127.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-89fb4

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-89fb4 to ip-10-0-138-66.ec2.internal

openshift-ingress

e2e-shared-b-w3-88828d-openshift-default-76f9bf6678-cmvmm

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-88828d-openshift-default-76f9bf6678-cmvmm to ip-10-0-142-236.ec2.internal

openshift-ingress

e2e-api-a-87b0d1-openshift-default-6b785cf79b-khrmr

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-87b0d1-openshift-default-6b785cf79b-khrmr to ip-10-0-142-236.ec2.internal

openshift-ingress

e2e-inf-b-724e1f-openshift-default-58cd7f5c78-pbhd7

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-724e1f-openshift-default-58cd7f5c78-pbhd7 to ip-10-0-142-236.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-88828d-9c4b5b877-wwlzr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-88828d-9c4b5b877-wwlzr to ip-10-0-139-127.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-f7eb8e-964ffb85c-9zg2z

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-f7eb8e-964ffb85c-9zg2z to ip-10-0-139-127.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-5245c1-67f8cdf75-ln4vs

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-5245c1-67f8cdf75-ln4vs to ip-10-0-139-127.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-e35897-cbffdc47f-n2sqp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-e35897-cbffdc47f-n2sqp to ip-10-0-139-127.ec2.internal

openshift-ingress

payload-processing-e2e-mt-f4c99d38-7599899f57-67j7q

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-f4c99d38-7599899f57-67j7q to ip-10-0-142-236.ec2.internal

openshift-ingress

payload-processing-e2e-mt-ede0daf1-858f7dcdb5-dt458

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-ede0daf1-858f7dcdb5-dt458 to ip-10-0-142-236.ec2.internal

openshift-ingress

e2e-derive-58fce2d8-openshift-default-7d4f48894d-xx6pz

Scheduled

Successfully assigned openshift-ingress/e2e-derive-58fce2d8-openshift-default-7d4f48894d-xx6pz to ip-10-0-142-236.ec2.internal

openshift-ingress

e2e-inf-a-d8b443-openshift-default-559b659988-js6mt

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-d8b443-openshift-default-559b659988-js6mt to ip-10-0-142-236.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-724e1f-67c89bd94-wb96n

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-724e1f-67c89bd94-wb96n to ip-10-0-139-127.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-68cf4d799cf6x8z

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cf6x8z to ip-10-0-142-236.ec2.internal

openshift-ingress

payload-processing-e2e-autores-3c6688-76957d48c7-xj9l8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-3c6688-76957d48c7-xj9l8 to ip-10-0-139-127.ec2.internal

openshift-ingress

e2e-shared-a-w3-5245c1-openshift-default-67df576c88-hhlpf

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-5245c1-openshift-default-67df576c88-hhlpf to ip-10-0-138-66.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-eef2d470-76954fc8db-gqgwb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-eef2d470-76954fc8db-gqgwb to ip-10-0-139-127.ec2.internal

openshift-ingress

e2e-api-b-8cff3b-openshift-default-648bfb6d98-rfmhp

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-8cff3b-openshift-default-648bfb6d98-rfmhp to ip-10-0-138-66.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-8a8c53fa-56877f4674-mw5jh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-8a8c53fa-56877f4674-mw5jh to ip-10-0-139-127.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-b3c355-bd9f8978f-8fw6h

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-b3c355-bd9f8978f-8fw6h to ip-10-0-142-236.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-64702c-7d8c8f8d87-rpmpd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-64702c-7d8c8f8d87-rpmpd to ip-10-0-139-127.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-bea561-d95ffd8cc-kblhr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-bea561-d95ffd8cc-kblhr to ip-10-0-142-236.ec2.internal

openshift-ingress

payload-processing-e2e-ait-eef2d470-7b8b88b4fc-vgfph

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-eef2d470-7b8b88b4fc-vgfph to ip-10-0-139-127.ec2.internal

openshift-ingress

e2e-mt-f4c99d38-openshift-default-5c4b6955b4-5gfwl

Scheduled

Successfully assigned openshift-ingress/e2e-mt-f4c99d38-openshift-default-5c4b6955b4-5gfwl to ip-10-0-142-236.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-6fa8d6-56b5c776fd-mqx6q

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-6fa8d6-56b5c776fd-mqx6q to ip-10-0-142-236.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-58fce2d8-5d8ffd4cf8-ppsnv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-58fce2d8-5d8ffd4cf8-ppsnv to ip-10-0-139-127.ec2.internal

openshift-ingress

e2e-mt-ede0daf1-openshift-default-7bc97d95bd-zhbbc

Scheduled

Successfully assigned openshift-ingress/e2e-mt-ede0daf1-openshift-default-7bc97d95bd-zhbbc to ip-10-0-142-236.ec2.internal

openshift-ingress

e2e-shared-b-w2-f7eb8e-openshift-default-64dbd55df8-xmmwq

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-f7eb8e-openshift-default-64dbd55df8-xmmwq to ip-10-0-142-236.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-3c6688-845684cff4-562qv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-3c6688-845684cff4-562qv to ip-10-0-142-236.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-724e1f-6d648c7fc-52sgk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-724e1f-6d648c7fc-52sgk to ip-10-0-139-127.ec2.internal

openshift-ingress

e2e-autores-3c6688-openshift-default-595dfc6494-fgsdn

Scheduled

Successfully assigned openshift-ingress/e2e-autores-3c6688-openshift-default-595dfc6494-fgsdn to ip-10-0-138-66.ec2.internal

openshift-ingress

kube-auth-proxy-5d989d9b5-46mnh

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-5d989d9b5-46mnh to ip-10-0-138-66.ec2.internal

openshift-ingress

kube-auth-proxy-5d989d9b5-nppzf

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-5d989d9b5-nppzf to ip-10-0-139-127.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-87b0d1-7c47989878-bkhx8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-87b0d1-7c47989878-bkhx8 to ip-10-0-139-127.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-8cff3b-5658fc69db-sddhs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-8cff3b-5658fc69db-sddhs to ip-10-0-142-236.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-7nvhm

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-7nvhm to ip-10-0-138-66.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-76b88fd7dd from 0 to 1
(x8)

openshift-ingress

replicaset-controller

router-default-76b88fd7dd

FailedCreate

Error creating: pods "router-default-76b88fd7dd-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x17)

openshift-ingress

replicaset-controller

router-default-76b88fd7dd

FailedCreate

Error creating: pods "router-default-76b88fd7dd-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

kubelet

router-default-76b88fd7dd-5knhq

Created

Created container: router

openshift-ingress

multus

router-default-76b88fd7dd-5knhq

AddedInterface

Add eth0 [10.132.0.23/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

router-default-76b88fd7dd

SuccessfulCreate

Created pod: router-default-76b88fd7dd-5knhq

openshift-ingress

kubelet

router-default-76b88fd7dd-5knhq

Started

Started container router

openshift-ingress

kubelet

router-default-76b88fd7dd-5knhq

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:da130d90f0bffd5c5876c94544c91b2a1be0d23ce2747ddfeafe88e03ee7d8d1" already present on machine

openshift-ingress

replicaset-controller

kube-auth-proxy-5d989d9b5

FailedCreate

Error creating: pods "kube-auth-proxy-5d989d9b5-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-5d989d9b5

SuccessfulCreate

Created pod: kube-auth-proxy-5d989d9b5-nppzf

openshift-ingress

kubelet

kube-auth-proxy-5d989d9b5-46mnh

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

replicaset-controller

kube-auth-proxy-5d989d9b5

SuccessfulCreate

Created pod: kube-auth-proxy-5d989d9b5-46mnh

openshift-ingress

multus

kube-auth-proxy-5d989d9b5-46mnh

AddedInterface

Add eth0 [10.132.0.27/23] from ovn-kubernetes

openshift-ingress

multus

kube-auth-proxy-5d989d9b5-nppzf

AddedInterface

Add eth0 [10.133.0.22/23] from ovn-kubernetes

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-5d989d9b5 from 0 to 2

openshift-ingress

kubelet

kube-auth-proxy-5d989d9b5-nppzf

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-89fb4

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-89fb4

AddedInterface

Add eth0 [10.132.0.28/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-89fb4

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

kube-auth-proxy-5d989d9b5-46mnh

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-5d989d9b5-nppzf

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.732s (2.732s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-5d989d9b5-46mnh

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.727s (2.727s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-5d989d9b5-46mnh

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-5d989d9b5-nppzf

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-5d989d9b5-nppzf

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-89fb4

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-89fb4

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.248s (3.248s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-89fb4

Started

Started container discovery

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-68cf4d799c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-68cf4d799cf6x8z

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-68cf4d799c from 0 to 1

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-68cf4d799cf6x8z

AddedInterface

Add eth0 [10.134.0.25/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cf6x8z

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cf6x8z

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cf6x8z

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cf6x8z

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 3.507s (3.507s including waiting). Image size: 181318953 bytes.

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-j2lqk

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-j2lqk

AddedInterface

Add eth0 [10.134.0.28/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-j2lqk

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-j2lqk

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-j2lqk

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.011s (3.011s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-j2lqk

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-j2lqk

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-j2lqk

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-89fb4

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-89fb4

Killing

Stopping container discovery

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0
(x4)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

maas-default-gateway-openshift-default-5ccb968c66-ln8g4

AddedInterface

Add eth0 [10.132.0.37/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5ccb968c66

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5ccb968c66-ln8g4

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-5ccb968c66 from 0 to 1

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-ln8g4

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-ln8g4

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.462s (2.462s including waiting). Image size: 181318953 bytes.

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-7nvhm
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-4r6np
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-7nvhm

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-4r6np

AddedInterface

Add eth0 [10.133.0.28/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-5b54b7fbb7-7nvhm

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-4r6np

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-4r6np

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-4r6np

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-4r6np

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.91s (1.91s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-7nvhm

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-7nvhm

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-7nvhm

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 3.674s (3.674s including waiting). Image size: 166449337 bytes.
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-ln8g4

Started

Started container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-ln8g4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-ln8g4

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-ln8g4

ProbeError

Startup probe error: Get "http://10.132.0.37:15021/healthz/ready": dial tcp 10.132.0.37:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-ln8g4

Unhealthy

Startup probe failed: Get "http://10.132.0.37:15021/healthz/ready": dial tcp 10.132.0.37:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-inf-a-d8b443-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-d8b443-openshift-default-559b659988 from 0 to 1

openshift-ingress

multus

e2e-inf-a-d8b443-openshift-default-559b659988-js6mt

AddedInterface

Add eth0 [10.134.0.35/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-inf-a-d8b443-openshift-default-559b659988

SuccessfulCreate

Created pod: e2e-inf-a-d8b443-openshift-default-559b659988-js6mt

openshift-ingress

gateway_labeler_controller

e2e-inf-a-d8b443

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-d8b443

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-d8b443

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-d8b443-6c5559fcbc from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-d8b443-6c5559fcbc

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-d8b443-6c5559fcbc-drngf
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-d8b443-6c5559fcbc

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-d8b443-6c5559fcbc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-d8b443: serviceaccount "payload-processing-e2e-inf-a-d8b443" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-d8b443-6fc54688db

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-d8b443-6fc54688db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-d8b443: serviceaccount "payload-processing-e2e-inf-a-d8b443" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-d8b443-6fc54688db

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-d8b443-6fc54688db-jd8bc

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-d8b443

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-d8b443-6fc54688db from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-d8b443-6fc54688db-jd8bc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-a-d8b443-6c5559fcbc-drngf

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-inf-a-d8b443-6c5559fcbc-drngf

AddedInterface

Add eth0 [10.133.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-d8b443-6c5559fcbc-drngf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-a-d8b443-6c5559fcbc-drngf

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-d8b443-6fc54688db-jd8bc

AddedInterface

Add eth0 [10.133.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-d8b443-6fc54688db-jd8bc

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-d8b443-6fc54688db-jd8bc

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-ait-eef2d470-openshift-default-5f799c9bbb

SuccessfulCreate

Created pod: e2e-ait-eef2d470-openshift-default-5f799c9bbb-ffrb6

openshift-ingress

gateway_labeler_controller

e2e-ait-eef2d470

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-eef2d470

openshift-ingress

deployment-controller

e2e-ait-eef2d470-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-eef2d470-openshift-default-5f799c9bbb from 0 to 1

openshift-ingress

replicaset-controller

e2e-autores-3c6688-openshift-default-595dfc6494

SuccessfulCreate

Created pod: e2e-autores-3c6688-openshift-default-595dfc6494-fgsdn

openshift-ingress

deployment-controller

e2e-autores-3c6688-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-3c6688-openshift-default-595dfc6494 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-autores-3c6688

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-3c6688

openshift-ingress

multus

e2e-ait-eef2d470-openshift-default-5f799c9bbb-ffrb6

AddedInterface

Add eth0 [10.134.0.36/23] from ovn-kubernetes

openshift-ingress

multus

e2e-autores-3c6688-openshift-default-595dfc6494-fgsdn

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ait-eef2d470

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-eef2d470-7b8b88b4fc from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-eef2d470

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-eef2d470-76954fc8db from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-eef2d470-76954fc8db

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-eef2d470-76954fc8db-gqgwb

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-eef2d470-7b8b88b4fc

SuccessfulCreate

Created pod: payload-processing-e2e-ait-eef2d470-7b8b88b4fc-vgfph
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-eef2d470-7b8b88b4fc

FailedCreate

Error creating: pods "payload-processing-e2e-ait-eef2d470-7b8b88b4fc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-eef2d470: serviceaccount "payload-processing-e2e-ait-eef2d470" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-eef2d470-76954fc8db

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-eef2d470-76954fc8db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-eef2d470: serviceaccount "payload-processing-e2e-ait-eef2d470" not found

openshift-ingress

kubelet

payload-processing-e2e-ait-eef2d470-7b8b88b4fc-vgfph

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-eef2d470-7b8b88b4fc-vgfph

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-eef2d470-76954fc8db-gqgwb

AddedInterface

Add eth0 [10.133.0.37/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-eef2d470-76954fc8db-gqgwb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-eef2d470-76954fc8db-gqgwb

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-eef2d470-76954fc8db-gqgwb

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-eef2d470-7b8b88b4fc-vgfph

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-ait-eef2d470-7b8b88b4fc-vgfph

AddedInterface

Add eth0 [10.133.0.38/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-autores-3c6688-845684cff4-562qv

AddedInterface

Add eth0 [10.134.0.37/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-3c6688-845684cff4-562qv

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-e2e-autores-3c6688-76957d48c7-xj9l8

AddedInterface

Add eth0 [10.133.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-3c6688-76957d48c7-xj9l8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-autores-3c6688-76957d48c7-xj9l8

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-3c6688-76957d48c7-xj9l8

Started

Started container payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-3c6688

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-3c6688-845684cff4 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-3c6688-76957d48c7

FailedCreate

Error creating: pods "payload-processing-e2e-autores-3c6688-76957d48c7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-3c6688: serviceaccount "payload-processing-e2e-autores-3c6688" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-3c6688-76957d48c7

SuccessfulCreate

Created pod: payload-processing-e2e-autores-3c6688-76957d48c7-xj9l8

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-3c6688-845684cff4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-3c6688-845684cff4-562qv
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-3c6688-845684cff4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-3c6688-845684cff4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-3c6688: serviceaccount "payload-processing-e2e-autores-3c6688" not found

openshift-ingress

deployment-controller

payload-processing-e2e-autores-3c6688

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-3c6688-76957d48c7 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-3c6688-845684cff4-562qv

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-3c6688-845684cff4-562qv

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-3c6688-845684cff4-562qv

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.659s (2.659s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

e2e-inf-a-d8b443-openshift-default-559b659988-js6mt

Unhealthy

Readiness probe failed: Get "http://10.134.0.35:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-inf-a-d8b443-openshift-default-559b659988-js6mt

ProbeError

Readiness probe error: Get "http://10.134.0.35:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-inf-a-d8b443-openshift-default-559b659988-js6mt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-d8b443-openshift-default-559b659988-js6mt

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-d8b443-openshift-default-559b659988-js6mt

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-inf-a-d8b443-openshift-default-559b659988-js6mt

ProbeError

Startup probe error: Get "http://10.134.0.35:15021/healthz/ready": dial tcp 10.134.0.35:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-a-d8b443-openshift-default-559b659988-js6mt

Unhealthy

Startup probe failed: Get "http://10.134.0.35:15021/healthz/ready": dial tcp 10.134.0.35:15021: connect: connection refused

openshift-ingress

kubelet

e2e-autores-3c6688-openshift-default-595dfc6494-fgsdn

ProbeError

Readiness probe error: Get "http://10.132.0.51:15021/healthz/ready": read tcp 10.132.0.2:47254->10.132.0.51:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-autores-3c6688-openshift-default-595dfc6494-fgsdn

Unhealthy

Readiness probe failed: Get "http://10.132.0.51:15021/healthz/ready": read tcp 10.132.0.2:47254->10.132.0.51:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-autores-3c6688-openshift-default-595dfc6494-fgsdn

Started

Started container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-inf-b-724e1f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-724e1f

openshift-ingress

deployment-controller

e2e-inf-b-724e1f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-724e1f-openshift-default-58cd7f5c78 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-724e1f-openshift-default-58cd7f5c78

SuccessfulCreate

Created pod: e2e-inf-b-724e1f-openshift-default-58cd7f5c78-pbhd7
(x2)

openshift-ingress

kubelet

e2e-autores-3c6688-openshift-default-595dfc6494-fgsdn

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-3c6688-openshift-default-595dfc6494-fgsdn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-eef2d470-openshift-default-5f799c9bbb-ffrb6

Created

Created container: istio-proxy

openshift-ingress

multus

e2e-inf-b-724e1f-openshift-default-58cd7f5c78-pbhd7

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ait-eef2d470-openshift-default-5f799c9bbb-ffrb6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-eef2d470-openshift-default-5f799c9bbb-ffrb6

Started

Started container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-inf-b-724e1f-6d648c7fc-52sgk

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-724e1f-6d648c7fc-52sgk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-724e1f-67c89bd94-wb96n

AddedInterface

Add eth0 [10.133.0.40/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-724e1f-6d648c7fc

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-724e1f-6d648c7fc-52sgk

openshift-ingress

multus

payload-processing-e2e-inf-b-724e1f-6d648c7fc-52sgk

AddedInterface

Add eth0 [10.133.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-724e1f-67c89bd94-wb96n

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-724e1f-67c89bd94

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-724e1f-67c89bd94-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-724e1f: serviceaccount "payload-processing-e2e-inf-b-724e1f" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-724e1f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-724e1f-67c89bd94 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-724e1f-67c89bd94

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-724e1f-67c89bd94-wb96n

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-724e1f-67c89bd94-wb96n

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-724e1f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-724e1f-6d648c7fc from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-724e1f-67c89bd94-wb96n

Created

Created container: payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-autores-3c6688-openshift-default-595dfc6494-fgsdn

Unhealthy

Startup probe failed: Get "http://10.132.0.51:15021/healthz/ready": dial tcp 10.132.0.51:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-autores-3c6688-openshift-default-595dfc6494-fgsdn

ProbeError

Startup probe error: Get "http://10.132.0.51:15021/healthz/ready": dial tcp 10.132.0.51:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-inf-b-724e1f-6d648c7fc-52sgk

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-724e1f-6d648c7fc

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-724e1f-6d648c7fc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-724e1f: serviceaccount "payload-processing-e2e-inf-b-724e1f" not found
(x5)

openshift-ingress

kubelet

e2e-ait-eef2d470-openshift-default-5f799c9bbb-ffrb6

ProbeError

Startup probe error: Get "http://10.134.0.36:15021/healthz/ready": dial tcp 10.134.0.36:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-eef2d470-openshift-default-5f799c9bbb-ffrb6

Unhealthy

Startup probe failed: Get "http://10.134.0.36:15021/healthz/ready": dial tcp 10.134.0.36:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-inf-b-724e1f-openshift-default-58cd7f5c78-pbhd7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-724e1f-openshift-default-58cd7f5c78-pbhd7

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-724e1f-openshift-default-58cd7f5c78-pbhd7

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-ait-eef2d470-openshift-default-5f799c9bbb-ffrb6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-eef2d470-76954fc8db-gqgwb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-eef2d470-7b8b88b4fc-vgfph

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-migrate-8a8c53fa-gw-openshift-default-5f67bbddbd

SuccessfulCreate

Created pod: e2e-migrate-8a8c53fa-gw-openshift-default-5f67bbddbd-kmnpr

openshift-ingress

deployment-controller

e2e-migrate-8a8c53fa-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-8a8c53fa-gw-openshift-default-5f67bbddbd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-migrate-8a8c53fa-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-8a8c53fa-gw

openshift-ingress

multus

e2e-migrate-8a8c53fa-gw-openshift-default-5f67bbddbd-kmnpr

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-inf-b-724e1f-openshift-default-58cd7f5c78-pbhd7

ProbeError

Startup probe error: Get "http://10.134.0.39:15021/healthz/ready": dial tcp 10.134.0.39:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-8a8c53fa

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-8a8c53fa-7c799d655d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-8a8c53fa-7c799d655d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-8a8c53fa-7c799d655d-gq9tn
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-8a8c53fa-56877f4674

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-8a8c53fa-56877f4674-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-8a8c53fa: serviceaccount "payload-processing-e2e-migrate-8a8c53fa" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-8a8c53fa-56877f4674

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-8a8c53fa-56877f4674-mw5jh

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-8a8c53fa

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-8a8c53fa-56877f4674 from 0 to 1
(x6)

openshift-ingress

kubelet

e2e-inf-b-724e1f-openshift-default-58cd7f5c78-pbhd7

Unhealthy

Startup probe failed: Get "http://10.134.0.39:15021/healthz/ready": dial tcp 10.134.0.39:15021: connect: connection refused
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-8a8c53fa-7c799d655d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-8a8c53fa-7c799d655d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-8a8c53fa: serviceaccount "payload-processing-e2e-migrate-8a8c53fa" not found

openshift-ingress

kubelet

payload-processing-e2e-migrate-8a8c53fa-56877f4674-mw5jh

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-8a8c53fa-7c799d655d-gq9tn

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-migrate-8a8c53fa-7c799d655d-gq9tn

AddedInterface

Add eth0 [10.133.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-8a8c53fa-7c799d655d-gq9tn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-8a8c53fa-7c799d655d-gq9tn

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-8a8c53fa-56877f4674-mw5jh

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-8a8c53fa-56877f4674-mw5jh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-migrate-8a8c53fa-56877f4674-mw5jh

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-migrate-8a8c53fa-gw-openshift-default-5f67bbddbd-kmnpr

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-8a8c53fa-gw-openshift-default-5f67bbddbd-kmnpr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-8a8c53fa-gw-openshift-default-5f67bbddbd-kmnpr

Created

Created container: istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-8a8c53fa-7c799d655d-gq9tn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-8a8c53fa-56877f4674-mw5jh

Killing

Stopping container payload-processing
(x3)

openshift-ingress

kubelet

e2e-migrate-8a8c53fa-gw-openshift-default-5f67bbddbd-kmnpr

ProbeError

Startup probe error: Get "http://10.134.0.41:15021/healthz/ready": dial tcp 10.134.0.41:15021: connect: connection refused body:
(x3)

openshift-ingress

kubelet

e2e-migrate-8a8c53fa-gw-openshift-default-5f67bbddbd-kmnpr

Unhealthy

Startup probe failed: Get "http://10.134.0.41:15021/healthz/ready": dial tcp 10.134.0.41:15021: connect: connection refused

openshift-ingress

kubelet

e2e-migrate-8a8c53fa-gw-openshift-default-5f67bbddbd-kmnpr

Killing

Stopping container istio-proxy

openshift-ingress

GatewayAuthBootstrap

e2e-ait-b52c7b74

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-ait-b52c7b74-authn-ssl: envoyfilters.networking.istio.io "e2e-ait-b52c7b74-authn-ssl" already exists

openshift-ingress

gateway_labeler_controller

e2e-ait-b52c7b74

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-b52c7b74

openshift-ingress

deployment-controller

e2e-ait-b52c7b74-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-b52c7b74-openshift-default-6ff75bdb48 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-b52c7b74-openshift-default-6ff75bdb48

SuccessfulCreate

Created pod: e2e-ait-b52c7b74-openshift-default-6ff75bdb48-v44r2

openshift-ingress

multus

e2e-ait-b52c7b74-openshift-default-6ff75bdb48-v44r2

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ait-b52c7b74

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-b52c7b74-599dcd5db7 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-b52c7b74-78577d474b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-b52c7b74-78577d474b-ksx42
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-b52c7b74-78577d474b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-b52c7b74-78577d474b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-b52c7b74: serviceaccount "payload-processing-e2e-ait-b52c7b74" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-b52c7b74-599dcd5db7

FailedCreate

Error creating: pods "payload-processing-e2e-ait-b52c7b74-599dcd5db7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-b52c7b74: serviceaccount "payload-processing-e2e-ait-b52c7b74" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-b52c7b74-599dcd5db7

SuccessfulCreate

Created pod: payload-processing-e2e-ait-b52c7b74-599dcd5db7-bzwnt

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-b52c7b74

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-b52c7b74-78577d474b from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-b52c7b74-78577d474b-ksx42

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-b52c7b74-599dcd5db7-bzwnt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-b52c7b74-599dcd5db7-bzwnt

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-ait-b52c7b74-599dcd5db7-bzwnt

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-b52c7b74-78577d474b-ksx42

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-b52c7b74-78577d474b-ksx42

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-b52c7b74-78577d474b-ksx42

AddedInterface

Add eth0 [10.133.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-b52c7b74-599dcd5db7-bzwnt

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-ait-b52c7b74-openshift-default-6ff75bdb48-v44r2

ProbeError

Readiness probe error: Get "http://10.132.0.56:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ait-b52c7b74-openshift-default-6ff75bdb48-v44r2

Unhealthy

Readiness probe failed: Get "http://10.132.0.56:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ait-b52c7b74-openshift-default-6ff75bdb48-v44r2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-b52c7b74-openshift-default-6ff75bdb48-v44r2

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-b52c7b74-openshift-default-6ff75bdb48-v44r2

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ait-b52c7b74-openshift-default-6ff75bdb48-v44r2

Unhealthy

Startup probe failed: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-b52c7b74-openshift-default-6ff75bdb48-v44r2

ProbeError

Startup probe error: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ait-b52c7b74-599dcd5db7-bzwnt

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ait-b52c7b74

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ait-b52c7b74: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ait-b52c7b74": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ait-b52c7b74, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 2f23c898-020c-4bab-9a2a-0ca48d59aa2a, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-b52c7b74-78577d474b-ksx42

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-b52c7b74-openshift-default-6ff75bdb48-v44r2

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-derive-58fce2d8-openshift-default-7d4f48894d

SuccessfulCreate

Created pod: e2e-derive-58fce2d8-openshift-default-7d4f48894d-xx6pz

openshift-ingress

deployment-controller

e2e-derive-58fce2d8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-58fce2d8-openshift-default-7d4f48894d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-derive-58fce2d8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-58fce2d8

openshift-ingress

multus

e2e-derive-58fce2d8-openshift-default-7d4f48894d-xx6pz

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-58fce2d8-5d8ffd4cf8-ppsnv

Created

Created container: payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-derive-58fce2d8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-58fce2d8-54dcd8dc57 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-derive-58fce2d8-54dcd8dc57-bqm8k

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-58fce2d8-54dcd8dc57-bqm8k

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-58fce2d8-54dcd8dc57

FailedCreate

Error creating: pods "payload-processing-e2e-derive-58fce2d8-54dcd8dc57-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-58fce2d8: serviceaccount "payload-processing-e2e-derive-58fce2d8" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-58fce2d8-54dcd8dc57

SuccessfulCreate

Created pod: payload-processing-e2e-derive-58fce2d8-54dcd8dc57-bqm8k

openshift-ingress

multus

payload-pre-processing-e2e-derive-58fce2d8-5d8ffd4cf8-ppsnv

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-58fce2d8-5d8ffd4cf8-ppsnv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-58fce2d8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-58fce2d8-5d8ffd4cf8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-58fce2d8-5d8ffd4cf8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-58fce2d8-5d8ffd4cf8-ppsnv
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-58fce2d8-5d8ffd4cf8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-58fce2d8-5d8ffd4cf8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-58fce2d8: serviceaccount "payload-processing-e2e-derive-58fce2d8" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-58fce2d8-5d8ffd4cf8-ppsnv

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-58fce2d8-54dcd8dc57-bqm8k

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-58fce2d8-54dcd8dc57-bqm8k

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-derive-58fce2d8-openshift-default-7d4f48894d-xx6pz

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-58fce2d8-openshift-default-7d4f48894d-xx6pz

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-58fce2d8-openshift-default-7d4f48894d-xx6pz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-derive-58fce2d8-openshift-default-7d4f48894d-xx6pz

ProbeError

Startup probe error: Get "http://10.134.0.46:15021/healthz/ready": dial tcp 10.134.0.46:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-derive-58fce2d8-openshift-default-7d4f48894d-xx6pz

Unhealthy

Startup probe failed: Get "http://10.134.0.46:15021/healthz/ready": dial tcp 10.134.0.46:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-derive-58fce2d8-54dcd8dc57-bqm8k

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-58fce2d8-5d8ffd4cf8-ppsnv

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-derive-58fce2d8

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-derive-58fce2d8: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-derive-58fce2d8": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-derive-58fce2d8, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 1effb1c2-1ca8-4ce9-a2b0-56952ee21dc3, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-3c6688-845684cff4-562qv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-58fce2d8-openshift-default-7d4f48894d-xx6pz

FailedToRetrieveImagePullSecret

Unable to retrieve some image pull secrets (e2e-derive-58fce2d8-openshift-default-dockercfg-bzdtq); attempting to pull the image may not succeed.

openshift-ingress

kubelet

payload-processing-e2e-autores-3c6688-76957d48c7-xj9l8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-derive-58fce2d8-openshift-default-7d4f48894d-xx6pz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-autores-3c6688-openshift-default-595dfc6494-fgsdn

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-explicit-6fa8d6-openshift-default-fbb756f44-5hwn9

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-explicit-6fa8d6-openshift-default-fbb756f44

SuccessfulCreate

Created pod: e2e-explicit-6fa8d6-openshift-default-fbb756f44-5hwn9

openshift-ingress

deployment-controller

e2e-explicit-6fa8d6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-6fa8d6-openshift-default-fbb756f44 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-explicit-6fa8d6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-6fa8d6

openshift-ingress

GatewayAuthBootstrap

e2e-explicit-6fa8d6

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-explicit-6fa8d6-authn-ssl: envoyfilters.networking.istio.io "e2e-explicit-6fa8d6-authn-ssl" already exists

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-6fa8d6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-6fa8d6-56b5c776fd from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-6fa8d6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-6fa8d6-85b657f95c from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-6fa8d6-56b5c776fd-mqx6q

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-6fa8d6-56b5c776fd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-6fa8d6-56b5c776fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-6fa8d6: serviceaccount "payload-processing-e2e-explicit-6fa8d6" not found

openshift-ingress

multus

payload-processing-e2e-explicit-6fa8d6-85b657f95c-zv8tq

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-6fa8d6-85b657f95c-zv8tq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-explicit-6fa8d6-85b657f95c-zv8tq

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-explicit-6fa8d6-56b5c776fd-mqx6q

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-6fa8d6-85b657f95c-zv8tq

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-6fa8d6-56b5c776fd-mqx6q

Created

Created container: payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-6fa8d6-85b657f95c

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-6fa8d6-85b657f95c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-6fa8d6: serviceaccount "payload-processing-e2e-explicit-6fa8d6" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-6fa8d6-85b657f95c

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-6fa8d6-85b657f95c-zv8tq

openshift-ingress

kubelet

e2e-autores-3c6688-openshift-default-595dfc6494-fgsdn

Unhealthy

Readiness probe failed: Get "http://10.132.0.51:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-6fa8d6-56b5c776fd-mqx6q

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-6fa8d6-56b5c776fd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-6fa8d6-56b5c776fd-mqx6q

openshift-ingress

kubelet

e2e-autores-3c6688-openshift-default-595dfc6494-fgsdn

ProbeError

Readiness probe error: Get "http://10.132.0.51:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-explicit-6fa8d6-openshift-default-fbb756f44-5hwn9

ProbeError

Readiness probe error: Get "http://10.134.0.50:15021/healthz/ready": read tcp 10.134.0.2:39842->10.134.0.50:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-explicit-6fa8d6-openshift-default-fbb756f44-5hwn9

Unhealthy

Readiness probe failed: Get "http://10.134.0.50:15021/healthz/ready": read tcp 10.134.0.2:39842->10.134.0.50:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-explicit-6fa8d6-openshift-default-fbb756f44-5hwn9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-6fa8d6-openshift-default-fbb756f44-5hwn9

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-6fa8d6-openshift-default-fbb756f44-5hwn9

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-explicit-6fa8d6-openshift-default-fbb756f44-5hwn9

Unhealthy

Startup probe failed: Get "http://10.134.0.50:15021/healthz/ready": dial tcp 10.134.0.50:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-explicit-6fa8d6-openshift-default-fbb756f44-5hwn9

ProbeError

Startup probe error: Get "http://10.134.0.50:15021/healthz/ready": dial tcp 10.134.0.50:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-6fa8d6-56b5c776fd-mqx6q

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-6fa8d6-85b657f95c-zv8tq

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

e2e-noten-ffeb50-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-ffeb50-openshift-default-6fc657db8d from 0 to 1

openshift-ingress

kubelet

e2e-explicit-6fa8d6-openshift-default-fbb756f44-5hwn9

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-noten-ffeb50-openshift-default-6fc657db8d

SuccessfulCreate

Created pod: e2e-noten-ffeb50-openshift-default-6fc657db8d-hsxmx

openshift-ingress

gateway_labeler_controller

e2e-noten-ffeb50

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-ffeb50

openshift-ingress

kubelet

e2e-noten-ffeb50-openshift-default-6fc657db8d-hsxmx

Started

Started container istio-proxy

openshift-ingress

multus

e2e-noten-ffeb50-openshift-default-6fc657db8d-hsxmx

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-ffeb50-openshift-default-6fc657db8d-hsxmx

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-noten-ffeb50-openshift-default-6fc657db8d-hsxmx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

deployment-controller

e2e-mt-f4c99d38-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-f4c99d38-openshift-default-5c4b6955b4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-f4c99d38-openshift-default-5c4b6955b4

SuccessfulCreate

Created pod: e2e-mt-f4c99d38-openshift-default-5c4b6955b4-5gfwl

openshift-ingress

gateway_labeler_controller

e2e-mt-f4c99d38

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-f4c99d38

openshift-ingress

multus

e2e-mt-f4c99d38-openshift-default-5c4b6955b4-5gfwl

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-f4c99d38-84bd4dd558

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-f4c99d38-84bd4dd558-tgf9m
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-f4c99d38-7599899f57

FailedCreate

Error creating: pods "payload-processing-e2e-mt-f4c99d38-7599899f57-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-f4c99d38: serviceaccount "payload-processing-e2e-mt-f4c99d38" not found

openshift-ingress

kubelet

e2e-noten-ffeb50-openshift-default-6fc657db8d-hsxmx

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-f4c99d38

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-f4c99d38-84bd4dd558 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-f4c99d38-84bd4dd558

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-f4c99d38-84bd4dd558-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-f4c99d38: serviceaccount "payload-processing-e2e-mt-f4c99d38" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-f4c99d38

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-f4c99d38-7599899f57 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-f4c99d38-7599899f57

SuccessfulCreate

Created pod: payload-processing-e2e-mt-f4c99d38-7599899f57-67j7q

openshift-ingress

kubelet

payload-processing-e2e-mt-f4c99d38-7599899f57-67j7q

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-f4c99d38-84bd4dd558-tgf9m

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-f4c99d38-84bd4dd558-tgf9m

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-f4c99d38-84bd4dd558-tgf9m

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-f4c99d38-7599899f57-67j7q

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-f4c99d38-84bd4dd558-tgf9m

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-mt-f4c99d38-7599899f57-67j7q

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-f4c99d38-7599899f57-67j7q

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-noten-ffeb50-openshift-default-6fc657db8d-hsxmx

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-noten-ffeb50-openshift-default-6fc657db8d-hsxmx

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-d8b443-6fc54688db-jd8bc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-d8b443-6c5559fcbc-drngf

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-mt-f4c99d38-openshift-default-5c4b6955b4-5gfwl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-f4c99d38-openshift-default-5c4b6955b4-5gfwl

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-f4c99d38-openshift-default-5c4b6955b4-5gfwl

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-d8b443-openshift-default-559b659988-js6mt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-d8b443-openshift-default-559b659988-js6mt

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-a-d8b443-openshift-default-559b659988-js6mt

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x5)

openshift-ingress

kubelet

e2e-mt-f4c99d38-openshift-default-5c4b6955b4-5gfwl

ProbeError

Startup probe error: Get "http://10.134.0.55:15021/healthz/ready": dial tcp 10.134.0.55:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-f4c99d38-openshift-default-5c4b6955b4-5gfwl

Unhealthy

Startup probe failed: Get "http://10.134.0.55:15021/healthz/ready": dial tcp 10.134.0.55:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-724e1f-67c89bd94-wb96n

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-724e1f-6d648c7fc-52sgk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-b-724e1f-openshift-default-58cd7f5c78-pbhd7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-724e1f-openshift-default-58cd7f5c78-pbhd7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-b-724e1f-openshift-default-58cd7f5c78-pbhd7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

e2e-shared-a-w3-5245c1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-5245c1-openshift-default-67df576c88 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w3-5245c1-openshift-default-67df576c88

SuccessfulCreate

Created pod: e2e-shared-a-w3-5245c1-openshift-default-67df576c88-hhlpf

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-5245c1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-5245c1

openshift-ingress

kubelet

payload-processing-e2e-mt-f4c99d38-7599899f57-67j7q

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-f4c99d38-84bd4dd558-tgf9m

Killing

Stopping container payload-pre-processing

openshift-ingress

multus

e2e-shared-a-w3-5245c1-openshift-default-67df576c88-hhlpf

AddedInterface

Add eth0 [10.132.0.62/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-5245c1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-5245c1-8f77bfb98 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-5245c1-8f77bfb98

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-5245c1-8f77bfb98-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-5245c1: serviceaccount "payload-processing-e2e-shared-a-w3-5245c1" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-5245c1-67f8cdf75

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-5245c1-67f8cdf75-ln4vs

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-5245c1-8f77bfb98

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-5245c1-8f77bfb98-s95n6

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-5245c1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-5245c1-67f8cdf75 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-5245c1-67f8cdf75

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-5245c1-67f8cdf75-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-5245c1: serviceaccount "payload-processing-e2e-shared-a-w3-5245c1" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-5245c1-67f8cdf75-ln4vs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-5245c1-67f8cdf75-ln4vs

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-5245c1-8f77bfb98-s95n6

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-5245c1-8f77bfb98-s95n6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-5245c1-67f8cdf75-ln4vs

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-5245c1-67f8cdf75-ln4vs

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-5245c1-8f77bfb98-s95n6

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-5245c1-8f77bfb98-s95n6

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-f4c99d38-openshift-default-5c4b6955b4-5gfwl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-5245c1-openshift-default-67df576c88-hhlpf

Unhealthy

Readiness probe failed: Get "http://10.132.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-a-w3-5245c1-openshift-default-67df576c88-hhlpf

ProbeError

Readiness probe error: Get "http://10.132.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-5245c1-openshift-default-67df576c88-hhlpf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-5245c1-openshift-default-67df576c88-hhlpf

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-5245c1-openshift-default-67df576c88-hhlpf

Created

Created container: istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-e35897

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-e35897

openshift-ingress

deployment-controller

e2e-shared-a-w2-e35897-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-e35897-openshift-default-6b65cb4b76 from 0 to 1

openshift-ingress

multus

e2e-shared-a-w2-e35897-openshift-default-6b65cb4b76-l8sj8

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-a-w2-e35897-openshift-default-6b65cb4b76

SuccessfulCreate

Created pod: e2e-shared-a-w2-e35897-openshift-default-6b65cb4b76-l8sj8

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-e35897

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-e35897-cbffdc47f from 0 to 1
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-5245c1-openshift-default-67df576c88-hhlpf

ProbeError

Startup probe error: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-5245c1-openshift-default-67df576c88-hhlpf

Unhealthy

Startup probe failed: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-e35897

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-e35897-7bcb865898 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-e35897-7bcb865898-cx965

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-e35897-cbffdc47f-n2sqp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-e35897-7bcb865898-cx965

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-e35897-7bcb865898-cx965

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-e35897-cbffdc47f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-e35897-cbffdc47f-n2sqp
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-e35897-cbffdc47f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-e35897-cbffdc47f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-e35897: serviceaccount "payload-processing-e2e-shared-a-w2-e35897" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-e35897-cbffdc47f-n2sqp

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-e35897-7bcb865898

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-e35897-7bcb865898-cx965

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-e35897-cbffdc47f-n2sqp

Created

Created container: payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-e35897-7bcb865898

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-e35897-7bcb865898-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-e35897: serviceaccount "payload-processing-e2e-shared-a-w2-e35897" not found

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-e35897-cbffdc47f-n2sqp

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-e35897-7bcb865898-cx965

Started

Started container payload-pre-processing

openshift-ingress

multus

e2e-shared-b-w3-88828d-openshift-default-76f9bf6678-cmvmm

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-88828d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-88828d

openshift-ingress

deployment-controller

e2e-shared-b-w3-88828d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-88828d-openshift-default-76f9bf6678 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w3-88828d-openshift-default-76f9bf6678

SuccessfulCreate

Created pod: e2e-shared-b-w3-88828d-openshift-default-76f9bf6678-cmvmm

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-88828d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-88828d-9c4b5b877 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-88828d-98786f4c4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-88828d-98786f4c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-88828d: serviceaccount "payload-processing-e2e-shared-b-w3-88828d" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-88828d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-88828d-98786f4c4 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-88828d-9c4b5b877

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-88828d-9c4b5b877-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-88828d: serviceaccount "payload-processing-e2e-shared-b-w3-88828d" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-88828d-98786f4c4-zlpkt

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-88828d-9c4b5b877

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-88828d-9c4b5b877-wwlzr

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-88828d-9c4b5b877-wwlzr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-88828d-9c4b5b877-wwlzr

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-88828d-98786f4c4-zlpkt

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-88828d-98786f4c4-zlpkt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-88828d-98786f4c4-zlpkt

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-88828d-9c4b5b877-wwlzr

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-88828d-98786f4c4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-88828d-98786f4c4-zlpkt

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-88828d-9c4b5b877-wwlzr

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w2-e35897-openshift-default-6b65cb4b76-l8sj8

ProbeError

Readiness probe error: Get "http://10.134.0.61:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-a-w2-e35897-openshift-default-6b65cb4b76-l8sj8

Unhealthy

Readiness probe failed: Get "http://10.134.0.61:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-e35897-openshift-default-6b65cb4b76-l8sj8

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-e35897-openshift-default-6b65cb4b76-l8sj8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-e35897-openshift-default-6b65cb4b76-l8sj8

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w3-88828d-openshift-default-76f9bf6678-cmvmm

ProbeError

Readiness probe error: Get "http://10.134.0.63:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-e35897-openshift-default-6b65cb4b76-l8sj8

Unhealthy

Startup probe failed: Get "http://10.134.0.61:15021/healthz/ready": dial tcp 10.134.0.61:15021: connect: connection refused

openshift-ingress

kubelet

e2e-shared-b-w3-88828d-openshift-default-76f9bf6678-cmvmm

Unhealthy

Readiness probe failed: Get "http://10.134.0.63:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-e35897-openshift-default-6b65cb4b76-l8sj8

ProbeError

Startup probe error: Get "http://10.134.0.61:15021/healthz/ready": dial tcp 10.134.0.61:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-88828d-openshift-default-76f9bf6678-cmvmm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-88828d-openshift-default-76f9bf6678-cmvmm

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-88828d-openshift-default-76f9bf6678-cmvmm

Started

Started container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-f7eb8e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-f7eb8e

openshift-ingress

replicaset-controller

e2e-shared-b-w2-f7eb8e-openshift-default-64dbd55df8

SuccessfulCreate

Created pod: e2e-shared-b-w2-f7eb8e-openshift-default-64dbd55df8-xmmwq

openshift-ingress

deployment-controller

e2e-shared-b-w2-f7eb8e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-f7eb8e-openshift-default-64dbd55df8 from 0 to 1

openshift-ingress

multus

e2e-shared-b-w2-f7eb8e-openshift-default-64dbd55df8-xmmwq

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-88828d-openshift-default-76f9bf6678-cmvmm

Unhealthy

Startup probe failed: Get "http://10.134.0.63:15021/healthz/ready": dial tcp 10.134.0.63:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-88828d-openshift-default-76f9bf6678-cmvmm

ProbeError

Startup probe error: Get "http://10.134.0.63:15021/healthz/ready": dial tcp 10.134.0.63:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-f7eb8e-7b5cb6b9bb-77mtf

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-f7eb8e-964ffb85c-9zg2z

Started

Started container payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-f7eb8e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-f7eb8e-964ffb85c from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-f7eb8e-7b5cb6b9bb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-f7eb8e-7b5cb6b9bb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-f7eb8e: serviceaccount "payload-processing-e2e-shared-b-w2-f7eb8e" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-f7eb8e-7b5cb6b9bb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-f7eb8e-7b5cb6b9bb-77mtf

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-f7eb8e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-f7eb8e-7b5cb6b9bb from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-f7eb8e-7b5cb6b9bb-77mtf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-f7eb8e-964ffb85c-9zg2z

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-f7eb8e-964ffb85c-9zg2z

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-f7eb8e-964ffb85c-9zg2z

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-f7eb8e-7b5cb6b9bb-77mtf

AddedInterface

Add eth0 [10.133.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-f7eb8e-7b5cb6b9bb-77mtf

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-f7eb8e-964ffb85c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-f7eb8e-964ffb85c-9zg2z
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-f7eb8e-964ffb85c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-f7eb8e-964ffb85c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-f7eb8e: serviceaccount "payload-processing-e2e-shared-b-w2-f7eb8e" not found

openshift-ingress

kubelet

e2e-shared-b-w2-f7eb8e-openshift-default-64dbd55df8-xmmwq

ProbeError

Readiness probe error: Get "http://10.134.0.65:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-b-w2-f7eb8e-openshift-default-64dbd55df8-xmmwq

Unhealthy

Readiness probe failed: Get "http://10.134.0.65:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-f7eb8e-openshift-default-64dbd55df8-xmmwq

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-f7eb8e-openshift-default-64dbd55df8-xmmwq

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-f7eb8e-openshift-default-64dbd55df8-xmmwq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-f7eb8e-openshift-default-64dbd55df8-xmmwq

Unhealthy

Startup probe failed: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-f7eb8e-openshift-default-64dbd55df8-xmmwq

ProbeError

Startup probe error: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-mt-ede0daf1-openshift-default-7bc97d95bd

SuccessfulCreate

Created pod: e2e-mt-ede0daf1-openshift-default-7bc97d95bd-zhbbc

openshift-ingress

deployment-controller

e2e-mt-ede0daf1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-ede0daf1-openshift-default-7bc97d95bd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-ede0daf1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-ede0daf1

openshift-ingress

multus

e2e-mt-ede0daf1-openshift-default-7bc97d95bd-zhbbc

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-ede0daf1-858f7dcdb5

FailedCreate

Error creating: pods "payload-processing-e2e-mt-ede0daf1-858f7dcdb5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-ede0daf1: serviceaccount "payload-processing-e2e-mt-ede0daf1" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-ede0daf1-55b7487d66

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-ede0daf1-55b7487d66-hskgj

openshift-ingress

deployment-controller

payload-processing-e2e-mt-ede0daf1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-ede0daf1-858f7dcdb5 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-ede0daf1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-ede0daf1-55b7487d66 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-ede0daf1-55b7487d66

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-ede0daf1-55b7487d66-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-ede0daf1: serviceaccount "payload-processing-e2e-mt-ede0daf1" not found

openshift-ingress

multus

payload-pre-processing-e2e-mt-ede0daf1-55b7487d66-hskgj

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-ede0daf1-858f7dcdb5

SuccessfulCreate

Created pod: payload-processing-e2e-mt-ede0daf1-858f7dcdb5-dt458

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-ede0daf1-55b7487d66-hskgj

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-mt-ede0daf1-858f7dcdb5-dt458

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-ede0daf1-55b7487d66-hskgj

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-ede0daf1-858f7dcdb5-dt458

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-ede0daf1-858f7dcdb5-dt458

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-ede0daf1-858f7dcdb5-dt458

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-ede0daf1-55b7487d66-hskgj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-ede0daf1-openshift-default-7bc97d95bd-zhbbc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-ede0daf1-openshift-default-7bc97d95bd-zhbbc

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-ede0daf1-openshift-default-7bc97d95bd-zhbbc

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-ede0daf1-openshift-default-7bc97d95bd-zhbbc

ProbeError

Startup probe error: Get "http://10.134.0.67:15021/healthz/ready": dial tcp 10.134.0.67:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-ede0daf1-openshift-default-7bc97d95bd-zhbbc

Unhealthy

Startup probe failed: Get "http://10.134.0.67:15021/healthz/ready": dial tcp 10.134.0.67:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-mt-ede0daf1-858f7dcdb5-dt458

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-ede0daf1-55b7487d66-hskgj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-ede0daf1-openshift-default-7bc97d95bd-zhbbc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-ede0daf1-openshift-default-7bc97d95bd-zhbbc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-ede0daf1-openshift-default-7bc97d95bd-zhbbc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

e2e-api-a-87b0d1-openshift-default-6b785cf79b

SuccessfulCreate

Created pod: e2e-api-a-87b0d1-openshift-default-6b785cf79b-khrmr

openshift-ingress

deployment-controller

e2e-api-a-87b0d1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-87b0d1-openshift-default-6b785cf79b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-87b0d1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-87b0d1

openshift-ingress

multus

e2e-api-a-87b0d1-openshift-default-6b785cf79b-khrmr

AddedInterface

Add eth0 [10.134.0.71/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-87b0d1-6bf8ff5575

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-87b0d1-6bf8ff5575-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-87b0d1: serviceaccount "payload-processing-e2e-api-a-87b0d1" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-87b0d1-7c47989878

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-87b0d1-7c47989878-bkhx8

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-87b0d1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-87b0d1-7c47989878 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-87b0d1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-87b0d1-6bf8ff5575 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-87b0d1-6bf8ff5575

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-87b0d1-6bf8ff5575-tl85j
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-87b0d1-7c47989878

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-87b0d1-7c47989878-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-87b0d1: serviceaccount "payload-processing-e2e-api-a-87b0d1" not found

openshift-ingress

kubelet

payload-processing-e2e-api-a-87b0d1-6bf8ff5575-tl85j

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-a-87b0d1-6bf8ff5575-tl85j

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-api-a-87b0d1-6bf8ff5575-tl85j

AddedInterface

Add eth0 [10.133.0.66/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-api-a-87b0d1-7c47989878-bkhx8

AddedInterface

Add eth0 [10.133.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-87b0d1-6bf8ff5575-tl85j

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-87b0d1-7c47989878-bkhx8

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-87b0d1-7c47989878-bkhx8

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-87b0d1-7c47989878-bkhx8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-api-a-87b0d1-openshift-default-6b785cf79b-khrmr

Unhealthy

Readiness probe failed: Get "http://10.134.0.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-api-a-87b0d1-openshift-default-6b785cf79b-khrmr

ProbeError

Readiness probe error: Get "http://10.134.0.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-api-a-87b0d1-openshift-default-6b785cf79b-khrmr

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-87b0d1-openshift-default-6b785cf79b-khrmr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-87b0d1-openshift-default-6b785cf79b-khrmr

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-api-a-87b0d1-openshift-default-6b785cf79b-khrmr

ProbeError

Startup probe error: Get "http://10.134.0.71:15021/healthz/ready": dial tcp 10.134.0.71:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-a-87b0d1-openshift-default-6b785cf79b-khrmr

Unhealthy

Startup probe failed: Get "http://10.134.0.71:15021/healthz/ready": dial tcp 10.134.0.71:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-api-b-8cff3b-openshift-default-648bfb6d98

SuccessfulCreate

Created pod: e2e-api-b-8cff3b-openshift-default-648bfb6d98-rfmhp

openshift-ingress

gateway_labeler_controller

e2e-api-b-8cff3b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-8cff3b

openshift-ingress

deployment-controller

e2e-api-b-8cff3b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-8cff3b-openshift-default-648bfb6d98 from 0 to 1

openshift-ingress

multus

e2e-api-b-8cff3b-openshift-default-648bfb6d98-rfmhp

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-8cff3b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-8cff3b-7b9457cd97 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-8cff3b-7b9457cd97

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-8cff3b-7b9457cd97-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-8cff3b: serviceaccount "payload-processing-e2e-api-b-8cff3b" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-8cff3b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-8cff3b-5658fc69db from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-8cff3b-5658fc69db

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-8cff3b-5658fc69db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-8cff3b: serviceaccount "payload-processing-e2e-api-b-8cff3b" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-8cff3b-5658fc69db

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-8cff3b-5658fc69db-sddhs

openshift-ingress

kubelet

payload-processing-e2e-api-b-8cff3b-7b9457cd97-44blx

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-8cff3b-5658fc69db-sddhs

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-b-8cff3b-5658fc69db-sddhs

AddedInterface

Add eth0 [10.134.0.72/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-api-b-8cff3b-7b9457cd97-44blx

AddedInterface

Add eth0 [10.134.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-8cff3b-7b9457cd97-44blx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-8cff3b-7b9457cd97

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-8cff3b-7b9457cd97-44blx

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-8cff3b-5658fc69db-sddhs

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-8cff3b-5658fc69db-sddhs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-b-8cff3b-7b9457cd97-44blx

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-api-b-8cff3b-openshift-default-648bfb6d98-rfmhp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-8cff3b-openshift-default-648bfb6d98-rfmhp

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-8cff3b-openshift-default-648bfb6d98-rfmhp

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-api-b-8cff3b-openshift-default-648bfb6d98-rfmhp

ProbeError

Startup probe error: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-b-8cff3b-openshift-default-648bfb6d98-rfmhp

Unhealthy

Startup probe failed: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-87b0d1-7c47989878-bkhx8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-87b0d1-6bf8ff5575-tl85j

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-a-87b0d1-openshift-default-6b785cf79b-khrmr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-87b0d1-openshift-default-6b785cf79b-khrmr

Unhealthy

Readiness probe failed: Get "http://10.134.0.71:15021/healthz/ready": dial tcp 10.134.0.71:15021: connect: connection refused

openshift-ingress

kubelet

e2e-api-a-87b0d1-openshift-default-6b785cf79b-khrmr

ProbeError

Readiness probe error: Get "http://10.134.0.71:15021/healthz/ready": dial tcp 10.134.0.71:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-api-b-8cff3b-7b9457cd97-44blx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-8cff3b-5658fc69db-sddhs

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-8cff3b-openshift-default-648bfb6d98-rfmhp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-8cff3b-openshift-default-648bfb6d98-rfmhp

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-b-8cff3b-openshift-default-648bfb6d98-rfmhp

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-e35897-7bcb865898-cx965

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-e35897-cbffdc47f-n2sqp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w2-e35897-openshift-default-6b65cb4b76-l8sj8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-e35897-openshift-default-6b65cb4b76-l8sj8

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w2-e35897-openshift-default-6b65cb4b76-l8sj8

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

e2e-ipp-a-bea561-openshift-default-7785699846

SuccessfulCreate

Created pod: e2e-ipp-a-bea561-openshift-default-7785699846-9k2vz

openshift-ingress

multus

e2e-ipp-a-bea561-openshift-default-7785699846-9k2vz

AddedInterface

Add eth0 [10.132.0.71/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ipp-a-bea561-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-bea561-openshift-default-7785699846 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-bea561

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-bea561

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-bea561

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-bea561-d95ffd8cc from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-bea561-5cf94c685d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-bea561-5cf94c685d-5hdxz

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-bea561-d95ffd8cc

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-bea561-d95ffd8cc-kblhr
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-bea561-5cf94c685d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-bea561-5cf94c685d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-bea561: serviceaccount "payload-processing-e2e-ipp-a-bea561" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-bea561-d95ffd8cc

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-bea561-d95ffd8cc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-bea561: serviceaccount "payload-processing-e2e-ipp-a-bea561" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-bea561

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-bea561-5cf94c685d from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-bea561-5cf94c685d-5hdxz

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-bea561-d95ffd8cc-kblhr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-bea561-5cf94c685d-5hdxz

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-bea561-5cf94c685d-5hdxz

AddedInterface

Add eth0 [10.134.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-bea561-d95ffd8cc-kblhr

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-bea561-d95ffd8cc-kblhr

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-bea561-5cf94c685d-5hdxz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-a-bea561-d95ffd8cc-kblhr

AddedInterface

Add eth0 [10.134.0.80/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-f7eb8e-964ffb85c-9zg2z

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-f7eb8e-7b5cb6b9bb-77mtf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w2-f7eb8e-openshift-default-64dbd55df8-xmmwq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-bea561-openshift-default-7785699846-9k2vz

ProbeError

Readiness probe error: Get "http://10.132.0.71:15021/healthz/ready": read tcp 10.132.0.2:35666->10.132.0.71:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-ipp-a-bea561-openshift-default-7785699846-9k2vz

Unhealthy

Readiness probe failed: Get "http://10.132.0.71:15021/healthz/ready": read tcp 10.132.0.2:35666->10.132.0.71:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-ipp-a-bea561-openshift-default-7785699846-9k2vz

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-bea561-openshift-default-7785699846-9k2vz

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-bea561-openshift-default-7785699846-9k2vz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-a-bea561-openshift-default-7785699846-9k2vz

Unhealthy

Startup probe failed: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-bea561-openshift-default-7785699846-9k2vz

ProbeError

Startup probe error: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-64702c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-64702c

openshift-ingress

replicaset-controller

e2e-ipp-b-64702c-openshift-default-5fc78b848d

SuccessfulCreate

Created pod: e2e-ipp-b-64702c-openshift-default-5fc78b848d-vhhsv

openshift-ingress

deployment-controller

e2e-ipp-b-64702c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-64702c-openshift-default-5fc78b848d from 0 to 1

openshift-ingress

multus

e2e-ipp-b-64702c-openshift-default-5fc78b848d-vhhsv

AddedInterface

Add eth0 [10.134.0.81/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-64702c-6c55c6c894

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-64702c-6c55c6c894-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-64702c: serviceaccount "payload-processing-e2e-ipp-b-64702c" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-64702c-6c55c6c894

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-64702c-6c55c6c894-qlk27

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-64702c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-64702c-6c55c6c894 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-64702c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-64702c-7d8c8f8d87 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-64702c-7d8c8f8d87

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-64702c-7d8c8f8d87-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-64702c: serviceaccount "payload-processing-e2e-ipp-b-64702c" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-64702c-7d8c8f8d87

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-64702c-7d8c8f8d87-rpmpd

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-64702c-7d8c8f8d87-rpmpd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-64702c-6c55c6c894-qlk27

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-64702c-6c55c6c894-qlk27

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-64702c-6c55c6c894-qlk27

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-64702c-6c55c6c894-qlk27

AddedInterface

Add eth0 [10.133.0.76/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-b-64702c-7d8c8f8d87-rpmpd

AddedInterface

Add eth0 [10.133.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-64702c-7d8c8f8d87-rpmpd

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-64702c-7d8c8f8d87-rpmpd

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-b-64702c-openshift-default-5fc78b848d-vhhsv

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-64702c-openshift-default-5fc78b848d-vhhsv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-64702c-openshift-default-5fc78b848d-vhhsv

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-b-64702c-openshift-default-5fc78b848d-vhhsv

ProbeError

Startup probe error: Get "http://10.134.0.81:15021/healthz/ready": dial tcp 10.134.0.81:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-b-64702c-openshift-default-5fc78b848d-vhhsv

Unhealthy

Startup probe failed: Get "http://10.134.0.81:15021/healthz/ready": dial tcp 10.134.0.81:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-b3c355-openshift-default-cdbf9b574

SuccessfulCreate

Created pod: e2e-ipp-cleanup-b3c355-openshift-default-cdbf9b574-vcjxq

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-b3c355

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-b3c355

openshift-ingress

deployment-controller

e2e-ipp-cleanup-b3c355-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-b3c355-openshift-default-cdbf9b574 from 0 to 1

openshift-ingress

multus

e2e-ipp-cleanup-b3c355-openshift-default-cdbf9b574-vcjxq

AddedInterface

Add eth0 [10.134.0.83/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-b3c355

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-b3c355-bd9f8978f from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-b3c355-bd9f8978f-8fw6h

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-b3c355-bd9f8978f

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-b3c355-bd9f8978f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-b3c355: serviceaccount "payload-processing-e2e-ipp-cleanup-b3c355" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-b3c355-794b978dbb-zmpqm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-b3c355-794b978dbb-zmpqm

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-b3c355-794b978dbb-zmpqm

Started

Started container payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-b3c355-794b978dbb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-b3c355-794b978dbb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-b3c355: serviceaccount "payload-processing-e2e-ipp-cleanup-b3c355" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-b3c355

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-b3c355-794b978dbb from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-b3c355-bd9f8978f-8fw6h

AddedInterface

Add eth0 [10.134.0.84/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-b3c355-794b978dbb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-b3c355-794b978dbb-zmpqm

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-b3c355-794b978dbb-zmpqm

AddedInterface

Add eth0 [10.133.0.79/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-b3c355-bd9f8978f

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-b3c355-bd9f8978f-8fw6h

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-b3c355-bd9f8978f-8fw6h

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-b3c355-bd9f8978f-8fw6h

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-b3c355-openshift-default-cdbf9b574-vcjxq

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-ipp-cleanup-b3c355-openshift-default-cdbf9b574-vcjxq

Unhealthy

Readiness probe failed: Get "http://10.134.0.83:15021/healthz/ready": read tcp 10.134.0.2:44220->10.134.0.83:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-b3c355-openshift-default-cdbf9b574-vcjxq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-ipp-cleanup-b3c355-openshift-default-cdbf9b574-vcjxq

ProbeError

Readiness probe error: Get "http://10.134.0.83:15021/healthz/ready": read tcp 10.134.0.2:44220->10.134.0.83:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-b3c355-openshift-default-cdbf9b574-vcjxq

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-b3c355-openshift-default-cdbf9b574-vcjxq

ProbeError

Startup probe error: Get "http://10.134.0.83:15021/healthz/ready": dial tcp 10.134.0.83:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-b3c355-openshift-default-cdbf9b574-vcjxq

Unhealthy

Startup probe failed: Get "http://10.134.0.83:15021/healthz/ready": dial tcp 10.134.0.83:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-b3c355-bd9f8978f-8fw6h

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-b3c355-794b978dbb-zmpqm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-b3c355-openshift-default-cdbf9b574-vcjxq

Killing

Stopping container istio-proxy

openshift-ingress

endpoint-controller

payload-processing-e2e-ipp-a-bea561

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-processing-e2e-ipp-a-bea561: Operation cannot be fulfilled on endpoints "payload-processing-e2e-ipp-a-bea561": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-processing-e2e-ipp-a-bea561, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 69d15b82-e456-4a3d-b7f2-1821a22f0878, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-bea561-5cf94c685d-5hdxz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-bea561-d95ffd8cc-kblhr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-bea561-openshift-default-7785699846-9k2vz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-bea561-openshift-default-7785699846-9k2vz

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-a-bea561-openshift-default-7785699846-9k2vz

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-64702c-6c55c6c894-qlk27

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-64702c-7d8c8f8d87-rpmpd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-64702c-openshift-default-5fc78b848d-vhhsv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-64702c-openshift-default-5fc78b848d-vhhsv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-b-64702c-openshift-default-5fc78b848d-vhhsv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-5245c1-8f77bfb98-s95n6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-5245c1-67f8cdf75-ln4vs

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w3-5245c1-openshift-default-67df576c88-hhlpf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-88828d-9c4b5b877-wwlzr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-88828d-98786f4c4-zlpkt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w3-88828d-openshift-default-76f9bf6678-cmvmm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w3-88828d-openshift-default-76f9bf6678-cmvmm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w3-88828d-openshift-default-76f9bf6678-cmvmm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: