Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-29fd7d-77b7d44c7d-vqnjp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-29fd7d-77b7d44c7d-vqnjp to ip-10-0-132-43.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-219fd6-64dcd7f4c4-68j6c

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-219fd6-64dcd7f4c4-68j6c to ip-10-0-132-43.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-e22c72-768765654f-sbn8m

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-e22c72-768765654f-sbn8m to ip-10-0-137-172.ec2.internal

openshift-ingress

e2e-ipp-cleanup-68ca72-openshift-default-5f7f6bfc4b-sf5wq

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-68ca72-openshift-default-5f7f6bfc4b-sf5wq to ip-10-0-137-172.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-814d40-6bf8656cff-pc94f

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-814d40-6bf8656cff-pc94f to ip-10-0-132-43.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-275a06-77cf85fc57-h7x85

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-275a06-77cf85fc57-h7x85 to ip-10-0-132-43.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-68ca72-fff8d7dd9-dsn2z

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-68ca72-fff8d7dd9-dsn2z to ip-10-0-132-43.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-b7764c7d-765dbc6966-phfpj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-b7764c7d-765dbc6966-phfpj to ip-10-0-137-172.ec2.internal

openshift-ingress

e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc

Scheduled

Successfully assigned openshift-ingress/e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc to ip-10-0-132-43.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-68ca72-54bb68d854-mgf75

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-68ca72-54bb68d854-mgf75 to ip-10-0-132-43.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-b7764c7d-595d9bf76b-62n7f

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-b7764c7d-595d9bf76b-62n7f to ip-10-0-132-43.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-814d40-7d6f469754-n5tpb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-814d40-7d6f469754-n5tpb to ip-10-0-132-43.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-e22c72-67c684d9c4-k5lcn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-e22c72-67c684d9c4-k5lcn to ip-10-0-137-172.ec2.internal

openshift-ingress

payload-processing-e2e-derive-0e28e849-76fd5756fc-4zsk4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-0e28e849-76fd5756fc-4zsk4 to ip-10-0-132-43.ec2.internal

openshift-ingress

e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn to ip-10-0-132-43.ec2.internal

openshift-ingress

payload-processing-e2e-autores-1596ac-5bcdb8f96c-lgkhl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-1596ac-5bcdb8f96c-lgkhl to ip-10-0-137-172.ec2.internal

openshift-ingress

e2e-shared-a-w3-219fd6-openshift-default-56dc8b44d8-tkv4f

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-219fd6-openshift-default-56dc8b44d8-tkv4f to ip-10-0-137-172.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-cde4a2-5cd4f67587-w4kjx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-cde4a2-5cd4f67587-w4kjx to ip-10-0-132-43.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-ab677e-55d8f57747-t69ls

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-ab677e-55d8f57747-t69ls to ip-10-0-132-43.ec2.internal

openshift-ingress

e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z

Scheduled

Successfully assigned openshift-ingress/e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z to ip-10-0-132-43.ec2.internal

openshift-ingress

e2e-noten-664dc8-openshift-default-c494fd898-tzbjk

Scheduled

Successfully assigned openshift-ingress/e2e-noten-664dc8-openshift-default-c494fd898-tzbjk to ip-10-0-132-43.ec2.internal

openshift-ingress

e2e-shared-b-w2-90bd7e-openshift-default-68f8797466-5bzg4

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-90bd7e-openshift-default-68f8797466-5bzg4 to ip-10-0-137-172.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-37c805-597f5f9cf8-frjwf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-37c805-597f5f9cf8-frjwf to ip-10-0-132-43.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-555853-5b946d749d-cng4j

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-555853-5b946d749d-cng4j to ip-10-0-132-43.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-0e28e849-7bbcc49586-4vfbq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-0e28e849-7bbcc49586-4vfbq to ip-10-0-132-43.ec2.internal

openshift-ingress

payload-processing-e2e-ait-fefaa7ab-d5cf75977-5s5vj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-fefaa7ab-d5cf75977-5s5vj to ip-10-0-132-43.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-555853-7d9875c5c7-chsmd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-555853-7d9875c5c7-chsmd to ip-10-0-132-43.ec2.internal

openshift-ingress

e2e-shared-b-w3-b73303-openshift-default-68688bdd7d-vfncp

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-b73303-openshift-default-68688bdd7d-vfncp to ip-10-0-137-172.ec2.internal

openshift-ingress

e2e-mt-7dabb3eb-openshift-default-5d7b99f69b-m695j

Scheduled

Successfully assigned openshift-ingress/e2e-mt-7dabb3eb-openshift-default-5d7b99f69b-m695j to ip-10-0-137-172.ec2.internal

openshift-ingress

payload-processing-e2e-ait-7a64cdb4-667f7c6c8f-xtnr2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-7a64cdb4-667f7c6c8f-xtnr2 to ip-10-0-132-43.ec2.internal

openshift-ingress

e2e-ipp-b-275a06-openshift-default-5c4b879898-mjctk

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-275a06-openshift-default-5c4b879898-mjctk to ip-10-0-137-172.ec2.internal

openshift-ingress

kube-auth-proxy-74797cb87b-brnlx

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-74797cb87b-brnlx to ip-10-0-137-172.ec2.internal

openshift-ingress

e2e-api-a-ab677e-openshift-default-56d9b6cb5b-nwppt

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-ab677e-openshift-default-56d9b6cb5b-nwppt to ip-10-0-137-172.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-7a64cdb4-65b86cdc7d-btl5c

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-7a64cdb4-65b86cdc7d-btl5c to ip-10-0-132-43.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-fefaa7ab-58f8d84c8-k7zrc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-fefaa7ab-58f8d84c8-k7zrc to ip-10-0-137-172.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-qc9mc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-qc9mc to ip-10-0-132-43.ec2.internal

openshift-ingress

e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57 to ip-10-0-132-43.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-zrb26

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zrb26 to ip-10-0-137-172.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-275a06-79d8f75dc4-2pgnc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-275a06-79d8f75dc4-2pgnc to ip-10-0-137-172.ec2.internal

openshift-ingress

e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp

Scheduled

Successfully assigned openshift-ingress/e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp to ip-10-0-132-43.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-6cbcdcfccc8vfgn

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfccc8vfgn to ip-10-0-132-43.ec2.internal

openshift-ingress

e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf to ip-10-0-132-43.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-37c805-59bd77f68f-klcd5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-37c805-59bd77f68f-klcd5 to ip-10-0-137-172.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-ab677e-64b6448854-gsk45

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-ab677e-64b6448854-gsk45 to ip-10-0-132-43.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-85d2w

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-85d2w to ip-10-0-137-172.ec2.internal

openshift-ingress

e2e-api-b-cde4a2-openshift-default-df8984f44-kcqgh

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-cde4a2-openshift-default-df8984f44-kcqgh to ip-10-0-137-172.ec2.internal

openshift-ingress

e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z

Scheduled

Successfully assigned openshift-ingress/e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z to ip-10-0-132-43.ec2.internal

openshift-ingress

router-default-7f48d5849b-h27lv

Scheduled

Successfully assigned openshift-ingress/router-default-7f48d5849b-h27lv to ip-10-0-137-172.ec2.internal

openshift-ingress

router-default-7f48d5849b-h27lv

FailedScheduling

0/3 nodes are available: 3 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/3 nodes are available: 3 Preemption is not helpful for scheduling.

openshift-ingress

payload-processing-e2e-mt-37c368a6-57cdf8649-zdd5l

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-37c368a6-57cdf8649-zdd5l to ip-10-0-132-43.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-b73303-988f4dc69-9xs5f

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-b73303-988f4dc69-9xs5f to ip-10-0-132-43.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-90bd7e-5575747ff7-jrl6s

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-90bd7e-5575747ff7-jrl6s to ip-10-0-132-43.ec2.internal

openshift-ingress

payload-processing-e2e-mt-7dabb3eb-5596c69c6f-ws9nd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-7dabb3eb-5596c69c6f-ws9nd to ip-10-0-132-43.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-29fd7d-b767fbf7c-dndpp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-29fd7d-b767fbf7c-dndpp to ip-10-0-132-43.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-219fd6-59c79dc69f-pf4vn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-219fd6-59c79dc69f-pf4vn to ip-10-0-132-43.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-1596ac-58ddd5f96b-thgn4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-1596ac-58ddd5f96b-thgn4 to ip-10-0-137-172.ec2.internal

openshift-ingress

e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4

Scheduled

Successfully assigned openshift-ingress/e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4 to ip-10-0-132-43.ec2.internal

openshift-ingress

kube-auth-proxy-74797cb87b-xmjxn

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-74797cb87b-xmjxn to ip-10-0-143-169.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-37c368a6-7595d9b56b-rv28s

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-37c368a6-7595d9b56b-rv28s to ip-10-0-132-43.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-7dabb3eb-84d45cd878-5k94d

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-7dabb3eb-84d45cd878-5k94d to ip-10-0-132-43.ec2.internal

openshift-ingress

e2e-explicit-555853-openshift-default-6bdf47bfb8-7r4q6

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-555853-openshift-default-6bdf47bfb8-7r4q6 to ip-10-0-137-172.ec2.internal

openshift-ingress

e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c to ip-10-0-132-43.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-cde4a2-686d45b87d-bwqnn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-cde4a2-686d45b87d-bwqnn to ip-10-0-132-43.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-90bd7e-b4c88455d-r277g

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-90bd7e-b4c88455d-r277g to ip-10-0-137-172.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-b73303-ddbd4cff8-9tf97

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-b73303-ddbd4cff8-9tf97 to ip-10-0-132-43.ec2.internal

openshift-ingress

e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74 to ip-10-0-132-43.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-c747fcbf8-mgrr2

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-mgrr2 to ip-10-0-132-43.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-6bbs2

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-6bbs2 to ip-10-0-137-172.ec2.internal

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-7f48d5849b from 0 to 1
(x15)

openshift-ingress

replicaset-controller

router-default-7f48d5849b

FailedCreate

Error creating: pods "router-default-7f48d5849b-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-7f48d5849b

SuccessfulCreate

Created pod: router-default-7f48d5849b-h27lv
(x6)

openshift-ingress

kubelet

router-default-7f48d5849b-h27lv

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x6)

openshift-ingress

kubelet

router-default-7f48d5849b-h27lv

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

kubelet

router-default-7f48d5849b-h27lv

Started

Started container router

openshift-ingress

kubelet

router-default-7f48d5849b-h27lv

Created

Created container: router

openshift-ingress

kubelet

router-default-7f48d5849b-h27lv

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:da130d90f0bffd5c5876c94544c91b2a1be0d23ce2747ddfeafe88e03ee7d8d1" already present on machine

openshift-ingress

multus

router-default-7f48d5849b-h27lv

AddedInterface

Add eth0 [10.132.0.10/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

kube-auth-proxy-74797cb87b

SuccessfulCreate

Created pod: kube-auth-proxy-74797cb87b-xmjxn

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-74797cb87b from 0 to 2

openshift-ingress

kubelet

kube-auth-proxy-74797cb87b-brnlx

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-74797cb87b

FailedCreate

Error creating: pods "kube-auth-proxy-74797cb87b-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-74797cb87b

SuccessfulCreate

Created pod: kube-auth-proxy-74797cb87b-brnlx

openshift-ingress

multus

kube-auth-proxy-74797cb87b-brnlx

AddedInterface

Add eth0 [10.132.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-74797cb87b-xmjxn

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

kubelet

kube-auth-proxy-74797cb87b-brnlx

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-74797cb87b-xmjxn

AddedInterface

Add eth0 [10.133.0.20/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-74797cb87b-xmjxn

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-zrb26

AddedInterface

Add eth0 [10.132.0.34/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-zrb26

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-zrb26

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

kube-auth-proxy-74797cb87b-xmjxn

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-74797cb87b-xmjxn

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-74797cb87b-xmjxn

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 3.16s (3.16s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-74797cb87b-brnlx

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-74797cb87b-brnlx

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-74797cb87b-brnlx

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 3.357s (3.357s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-zrb26

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-zrb26

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-zrb26

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.156s (3.156s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-zrb26

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-zrb26

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-6cbcdcfccc from 0 to 1

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-6cbcdcfccc8vfgn

AddedInterface

Add eth0 [10.134.0.22/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6cbcdcfccc8vfgn

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-6cbcdcfccc

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-6cbcdcfccc8vfgn

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6cbcdcfccc8vfgn

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 3.581s (3.581s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6cbcdcfccc8vfgn

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6cbcdcfccc8vfgn

Created

Created container: istio-proxy

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-6bbs2

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-6bbs2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" already present on machine

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-6bbs2

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-6bbs2

Created

Created container: discovery

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-6bbs2

AddedInterface

Add eth0 [10.132.0.36/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-zrb26

Killing

Stopping container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-zrb26

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-c747fcbf8

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-c747fcbf8-mgrr2

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-c747fcbf8 from 0 to 1

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

multus

maas-default-gateway-openshift-default-c747fcbf8-mgrr2

AddedInterface

Add eth0 [10.134.0.30/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-qc9mc
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-85d2w

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-qc9mc

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-qc9mc

AddedInterface

Add eth0 [10.134.0.34/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-5b54b7fbb7-85d2w

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-85d2w

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-85d2w

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-85d2w

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.617s (1.617s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-85d2w

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-qc9mc

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-qc9mc

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-qc9mc

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.828s (2.828s including waiting). Image size: 166449337 bytes.
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c747fcbf8-mgrr2

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c747fcbf8-mgrr2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c747fcbf8-mgrr2

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c747fcbf8-mgrr2

ProbeError

Startup probe error: Get "http://10.134.0.30:15021/healthz/ready": dial tcp 10.134.0.30:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c747fcbf8-mgrr2

Unhealthy

Startup probe failed: Get "http://10.134.0.30:15021/healthz/ready": dial tcp 10.134.0.30:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-inf-a-37c805-openshift-default-599cdfb67d

SuccessfulCreate

Created pod: e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57

openshift-ingress

gateway_labeler_controller

e2e-inf-a-37c805

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-37c805

openshift-ingress

deployment-controller

e2e-inf-a-37c805-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-37c805-openshift-default-599cdfb67d from 0 to 1

openshift-ingress

multus

e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57

AddedInterface

Add eth0 [10.134.0.37/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-37c805-597f5f9cf8-frjwf

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-37c805-59bd77f68f

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-37c805-59bd77f68f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-37c805: serviceaccount "payload-processing-e2e-inf-a-37c805" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-37c805

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-37c805-59bd77f68f from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-37c805-597f5f9cf8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-37c805-597f5f9cf8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-37c805: serviceaccount "payload-processing-e2e-inf-a-37c805" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-37c805-59bd77f68f

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-37c805-59bd77f68f-klcd5

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-37c805-597f5f9cf8-frjwf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-37c805

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-37c805-597f5f9cf8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-37c805-597f5f9cf8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-37c805-597f5f9cf8-frjwf

openshift-ingress

multus

payload-processing-e2e-inf-a-37c805-59bd77f68f-klcd5

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-37c805-59bd77f68f-klcd5

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-37c805-59bd77f68f-klcd5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-a-37c805-59bd77f68f-klcd5

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-37c805-597f5f9cf8-frjwf

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-37c805-597f5f9cf8-frjwf

Created

Created container: payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-autores-1596ac

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-1596ac

openshift-ingress

deployment-controller

e2e-autores-1596ac-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-1596ac-openshift-default-66bf86db88 from 0 to 1

openshift-ingress

replicaset-controller

e2e-autores-1596ac-openshift-default-66bf86db88

SuccessfulCreate

Created pod: e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4

openshift-ingress

multus

e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ait-fefaa7ab-openshift-default-5b47bb44f8

SuccessfulCreate

Created pod: e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z

openshift-ingress

deployment-controller

e2e-ait-fefaa7ab-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-fefaa7ab-openshift-default-5b47bb44f8 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-fefaa7ab

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-fefaa7ab

openshift-ingress

multus

e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-1596ac-5bcdb8f96c

FailedCreate

Error creating: pods "payload-processing-e2e-autores-1596ac-5bcdb8f96c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-1596ac: serviceaccount "payload-processing-e2e-autores-1596ac" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-1596ac-58ddd5f96b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-1596ac-58ddd5f96b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-1596ac: serviceaccount "payload-processing-e2e-autores-1596ac" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-1596ac-5bcdb8f96c

SuccessfulCreate

Created pod: payload-processing-e2e-autores-1596ac-5bcdb8f96c-lgkhl

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-1596ac

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-1596ac-58ddd5f96b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-1596ac-58ddd5f96b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-1596ac-58ddd5f96b-thgn4

openshift-ingress

deployment-controller

payload-processing-e2e-autores-1596ac

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-1596ac-5bcdb8f96c from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-autores-1596ac-5bcdb8f96c-lgkhl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-autores-1596ac-5bcdb8f96c-lgkhl

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-fefaa7ab-d5cf75977

FailedCreate

Error creating: pods "payload-processing-e2e-ait-fefaa7ab-d5cf75977-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-fefaa7ab: serviceaccount "payload-processing-e2e-ait-fefaa7ab" not found

openshift-ingress

kubelet

payload-processing-e2e-autores-1596ac-5bcdb8f96c-lgkhl

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-1596ac-58ddd5f96b-thgn4

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-1596ac-58ddd5f96b-thgn4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-autores-1596ac-5bcdb8f96c-lgkhl

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-1596ac-58ddd5f96b-thgn4

Started

Started container payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-fefaa7ab-58f8d84c8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-fefaa7ab-58f8d84c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-fefaa7ab: serviceaccount "payload-processing-e2e-ait-fefaa7ab" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-fefaa7ab

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-fefaa7ab-d5cf75977 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-autores-1596ac-58ddd5f96b-thgn4

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-fefaa7ab-d5cf75977

SuccessfulCreate

Created pod: payload-processing-e2e-ait-fefaa7ab-d5cf75977-5s5vj

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-fefaa7ab

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-fefaa7ab-58f8d84c8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-fefaa7ab-58f8d84c8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-fefaa7ab-58f8d84c8-k7zrc

openshift-ingress

kubelet

payload-processing-e2e-ait-fefaa7ab-d5cf75977-5s5vj

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-fefaa7ab-58f8d84c8-k7zrc

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-fefaa7ab-58f8d84c8-k7zrc

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-fefaa7ab-58f8d84c8-k7zrc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-fefaa7ab-58f8d84c8-k7zrc

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-fefaa7ab-d5cf75977-5s5vj

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-fefaa7ab-d5cf75977-5s5vj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-fefaa7ab-d5cf75977-5s5vj

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57

ProbeError

Readiness probe error: Get "http://10.134.0.37:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57

Unhealthy

Readiness probe failed: Get "http://10.134.0.37:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57

Unhealthy

Startup probe failed: Get "http://10.134.0.37:15021/healthz/ready": dial tcp 10.134.0.37:15021: connect: connection refused

openshift-ingress

kubelet

e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4

Unhealthy

Readiness probe failed: Get "http://10.134.0.40:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4

ProbeError

Readiness probe error: Get "http://10.134.0.40:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x6)

openshift-ingress

kubelet

e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57

ProbeError

Startup probe error: Get "http://10.134.0.37:15021/healthz/ready": dial tcp 10.134.0.37:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z

ProbeError

Readiness probe error: Get "http://10.134.0.41:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

replicaset-controller

e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b

SuccessfulCreate

Created pod: e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c

openshift-ingress

deployment-controller

e2e-inf-b-e22c72-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-b-e22c72

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-e22c72

openshift-ingress

kubelet

e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z

Unhealthy

Readiness probe failed: Get "http://10.134.0.41:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

multus

e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z

Started

Started container istio-proxy

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-e22c72-67c684d9c4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-e22c72-67c684d9c4-k5lcn

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-e22c72-768765654f

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-e22c72-768765654f-sbn8m
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-e22c72-67c684d9c4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-e22c72-67c684d9c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-e22c72: serviceaccount "payload-processing-e2e-inf-b-e22c72" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-e22c72-768765654f

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-e22c72-768765654f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-e22c72: serviceaccount "payload-processing-e2e-inf-b-e22c72" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-e22c72

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-e22c72-67c684d9c4 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-e22c72

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-e22c72-768765654f from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-b-e22c72-768765654f-sbn8m

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-e22c72-768765654f-sbn8m

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-b-e22c72-768765654f-sbn8m

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-e22c72-67c684d9c4-k5lcn

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-e22c72-67c684d9c4-k5lcn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-e22c72-67c684d9c4-k5lcn

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-inf-b-e22c72-768765654f-sbn8m

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-e22c72-67c684d9c4-k5lcn

Started

Started container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z

Unhealthy

Startup probe failed: Get "http://10.134.0.41:15021/healthz/ready": dial tcp 10.134.0.41:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4

Unhealthy

Startup probe failed: Get "http://10.134.0.40:15021/healthz/ready": dial tcp 10.134.0.40:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4

ProbeError

Startup probe error: Get "http://10.134.0.40:15021/healthz/ready": dial tcp 10.134.0.40:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z

ProbeError

Startup probe error: Get "http://10.134.0.41:15021/healthz/ready": dial tcp 10.134.0.41:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c

ProbeError

Readiness probe error: Get "http://10.134.0.43:15021/healthz/ready": read tcp 10.134.0.2:40178->10.134.0.43:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c

Unhealthy

Readiness probe failed: Get "http://10.134.0.43:15021/healthz/ready": read tcp 10.134.0.2:40178->10.134.0.43:15021: read: connection reset by peer
(x5)

openshift-ingress

kubelet

e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c

Unhealthy

Startup probe failed: Get "http://10.134.0.43:15021/healthz/ready": dial tcp 10.134.0.43:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c

ProbeError

Startup probe error: Get "http://10.134.0.43:15021/healthz/ready": dial tcp 10.134.0.43:15021: connect: connection refused body:

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ait-fefaa7ab

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ait-fefaa7ab: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ait-fefaa7ab": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ait-fefaa7ab, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: d8a1fbcf-fbd3-4bd6-a8c0-538c47621187, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-ait-fefaa7ab-d5cf75977-5s5vj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-fefaa7ab-58f8d84c8-k7zrc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-migrate-b7764c7d-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-b7764c7d-gw

openshift-ingress

replicaset-controller

e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4

SuccessfulCreate

Created pod: e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf

openshift-ingress

deployment-controller

e2e-migrate-b7764c7d-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4 from 0 to 1

openshift-ingress

multus

e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-b7764c7d-765dbc6966

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-b7764c7d-765dbc6966-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-b7764c7d: serviceaccount "payload-processing-e2e-migrate-b7764c7d" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-b7764c7d-595d9bf76b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-b7764c7d-595d9bf76b-62n7f

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-b7764c7d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-b7764c7d-765dbc6966 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-migrate-b7764c7d-595d9bf76b-62n7f

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-b7764c7d-595d9bf76b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-b7764c7d-595d9bf76b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-b7764c7d: serviceaccount "payload-processing-e2e-migrate-b7764c7d" not found

openshift-ingress

kubelet

payload-processing-e2e-migrate-b7764c7d-765dbc6966-phfpj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-b7764c7d-765dbc6966

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-b7764c7d-765dbc6966-phfpj

openshift-ingress

multus

payload-processing-e2e-migrate-b7764c7d-765dbc6966-phfpj

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-b7764c7d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-b7764c7d-595d9bf76b from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-migrate-b7764c7d-765dbc6966-phfpj

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-b7764c7d-595d9bf76b-62n7f

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-b7764c7d-595d9bf76b-62n7f

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-b7764c7d-595d9bf76b-62n7f

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-migrate-b7764c7d-765dbc6966-phfpj

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf

ProbeError

Readiness probe error: Get "http://10.134.0.45:15021/healthz/ready": read tcp 10.134.0.2:53770->10.134.0.45:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf

Unhealthy

Readiness probe failed: Get "http://10.134.0.45:15021/healthz/ready": read tcp 10.134.0.2:53770->10.134.0.45:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf

Unhealthy

Startup probe failed: Get "http://10.134.0.45:15021/healthz/ready": dial tcp 10.134.0.45:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf

ProbeError

Startup probe error: Get "http://10.134.0.45:15021/healthz/ready": dial tcp 10.134.0.45:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-b7764c7d-595d9bf76b-62n7f

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-migrate-b7764c7d-765dbc6966-phfpj

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-ait-7a64cdb4-openshift-default-7fb75798b6

SuccessfulCreate

Created pod: e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc

openshift-ingress

deployment-controller

e2e-ait-7a64cdb4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-7a64cdb4-openshift-default-7fb75798b6 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-7a64cdb4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-7a64cdb4

openshift-ingress

multus

e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-7a64cdb4-65b86cdc7d-btl5c

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-7a64cdb4-667f7c6c8f

FailedCreate

Error creating: pods "payload-processing-e2e-ait-7a64cdb4-667f7c6c8f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-7a64cdb4: serviceaccount "payload-processing-e2e-ait-7a64cdb4" not found

openshift-ingress

multus

payload-processing-e2e-ait-7a64cdb4-667f7c6c8f-xtnr2

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ait-7a64cdb4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-7a64cdb4-667f7c6c8f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-7a64cdb4-65b86cdc7d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-7a64cdb4-65b86cdc7d-btl5c
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-7a64cdb4-65b86cdc7d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-7a64cdb4-65b86cdc7d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-7a64cdb4: serviceaccount "payload-processing-e2e-ait-7a64cdb4" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-7a64cdb4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-7a64cdb4-65b86cdc7d from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ait-7a64cdb4-65b86cdc7d-btl5c

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-7a64cdb4-667f7c6c8f

SuccessfulCreate

Created pod: payload-processing-e2e-ait-7a64cdb4-667f7c6c8f-xtnr2

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-7a64cdb4-65b86cdc7d-btl5c

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-7a64cdb4-667f7c6c8f-xtnr2

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-7a64cdb4-65b86cdc7d-btl5c

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-7a64cdb4-667f7c6c8f-xtnr2

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-7a64cdb4-667f7c6c8f-xtnr2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc

Unhealthy

Startup probe failed: Get "http://10.134.0.49:15021/healthz/ready": dial tcp 10.134.0.49:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc

ProbeError

Startup probe error: Get "http://10.134.0.49:15021/healthz/ready": dial tcp 10.134.0.49:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-1596ac-58ddd5f96b-thgn4

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-autores-1596ac

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-autores-1596ac: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-autores-1596ac": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-autores-1596ac, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: cd061260-b189-4684-8f5a-61a122816224, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-autores-1596ac-5bcdb8f96c-lgkhl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-explicit-555853-openshift-default-6bdf47bfb8-7r4q6

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

e2e-explicit-555853-openshift-default-6bdf47bfb8-7r4q6

AddedInterface

Add eth0 [10.132.0.62/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-explicit-555853

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-555853

openshift-ingress

deployment-controller

e2e-explicit-555853-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-555853-openshift-default-6bdf47bfb8 from 0 to 1

openshift-ingress

replicaset-controller

e2e-explicit-555853-openshift-default-6bdf47bfb8

SuccessfulCreate

Created pod: e2e-explicit-555853-openshift-default-6bdf47bfb8-7r4q6

openshift-ingress

kubelet

payload-processing-e2e-ait-7a64cdb4-667f7c6c8f-xtnr2

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ait-7a64cdb4

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ait-7a64cdb4: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ait-7a64cdb4": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ait-7a64cdb4, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 651fe63e-2853-44c3-8da9-639d6968cfd3, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-7a64cdb4-65b86cdc7d-btl5c

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc

Killing

Stopping container istio-proxy

openshift-ingress

GatewayAuthBootstrap

e2e-derive-0e28e849

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-derive-0e28e849-authn-ssl: envoyfilters.networking.istio.io "e2e-derive-0e28e849-authn-ssl" already exists

openshift-ingress

gateway_labeler_controller

e2e-derive-0e28e849

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-0e28e849

openshift-ingress

deployment-controller

e2e-derive-0e28e849-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-0e28e849-openshift-default-55fc46fc8d from 0 to 1

openshift-ingress

multus

e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-derive-0e28e849-openshift-default-55fc46fc8d

SuccessfulCreate

Created pod: e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-0e28e849

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-0e28e849-7bbcc49586 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-0e28e849-76fd5756fc

FailedCreate

Error creating: pods "payload-processing-e2e-derive-0e28e849-76fd5756fc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-0e28e849: serviceaccount "payload-processing-e2e-derive-0e28e849" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-0e28e849-76fd5756fc

SuccessfulCreate

Created pod: payload-processing-e2e-derive-0e28e849-76fd5756fc-4zsk4

openshift-ingress

deployment-controller

payload-processing-e2e-derive-0e28e849

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-0e28e849-76fd5756fc from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-0e28e849-7bbcc49586

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-0e28e849-7bbcc49586-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-0e28e849: serviceaccount "payload-processing-e2e-derive-0e28e849" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-0e28e849-7bbcc49586

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-0e28e849-7bbcc49586-4vfbq

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-0e28e849-7bbcc49586-4vfbq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-derive-0e28e849-76fd5756fc-4zsk4

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-0e28e849-76fd5756fc-4zsk4

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-0e28e849-76fd5756fc-4zsk4

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-0e28e849-76fd5756fc-4zsk4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-derive-0e28e849-7bbcc49586-4vfbq

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-0e28e849-7bbcc49586-4vfbq

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-0e28e849-7bbcc49586-4vfbq

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-explicit-555853-openshift-default-6bdf47bfb8-7r4q6

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 11.392s (11.392s including waiting). Image size: 181318953 bytes.

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-555853-5b946d749d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-555853-5b946d749d-cng4j
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-555853-5b946d749d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-555853-5b946d749d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-555853: serviceaccount "payload-processing-e2e-explicit-555853" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-555853

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-555853-5b946d749d from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-555853

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-555853-7d9875c5c7 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-555853-7d9875c5c7

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-555853-7d9875c5c7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-555853: serviceaccount "payload-processing-e2e-explicit-555853" not found

openshift-ingress

kubelet

payload-processing-e2e-explicit-555853-7d9875c5c7-chsmd

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-555853-7d9875c5c7

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-555853-7d9875c5c7-chsmd

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-555853-5b946d749d-cng4j

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-555853-7d9875c5c7-chsmd

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-555853-5b946d749d-cng4j

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-explicit-555853-7d9875c5c7-chsmd

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-555853-5b946d749d-cng4j

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-555853-7d9875c5c7-chsmd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-explicit-555853-5b946d749d-cng4j

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-explicit-555853-openshift-default-6bdf47bfb8-7r4q6

ProbeError

Readiness probe error: Get "http://10.132.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-explicit-555853-openshift-default-6bdf47bfb8-7r4q6

Unhealthy

Readiness probe failed: Get "http://10.132.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-explicit-555853-openshift-default-6bdf47bfb8-7r4q6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-555853-openshift-default-6bdf47bfb8-7r4q6

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-555853-openshift-default-6bdf47bfb8-7r4q6

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-explicit-555853-openshift-default-6bdf47bfb8-7r4q6

ProbeError

Startup probe error: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-explicit-555853-openshift-default-6bdf47bfb8-7r4q6

Unhealthy

Startup probe failed: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z

Unhealthy

Startup probe failed: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z

ProbeError

Startup probe error: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused body:

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-derive-0e28e849

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-derive-0e28e849: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-derive-0e28e849": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-derive-0e28e849, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: aefe41f6-bff6-4408-8619-792e57eebf23, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-derive-0e28e849-76fd5756fc-4zsk4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-0e28e849-7bbcc49586-4vfbq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-555853-5b946d749d-cng4j

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-555853-7d9875c5c7-chsmd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-37c805-597f5f9cf8-frjwf

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-inf-a-37c805

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-inf-a-37c805: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-inf-a-37c805": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-inf-a-37c805, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: dfd57bb9-63cc-4497-9d50-9ced8995f5bb, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-inf-a-37c805-59bd77f68f-klcd5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-explicit-555853-openshift-default-6bdf47bfb8-7r4q6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-noten-664dc8-openshift-default-c494fd898-tzbjk

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-noten-664dc8-openshift-default-c494fd898-tzbjk

Started

Started container istio-proxy

openshift-ingress

multus

e2e-noten-664dc8-openshift-default-c494fd898-tzbjk

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-noten-664dc8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-664dc8

openshift-ingress

deployment-controller

e2e-noten-664dc8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-664dc8-openshift-default-c494fd898 from 0 to 1

openshift-ingress

kubelet

e2e-noten-664dc8-openshift-default-c494fd898-tzbjk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

replicaset-controller

e2e-noten-664dc8-openshift-default-c494fd898

SuccessfulCreate

Created pod: e2e-noten-664dc8-openshift-default-c494fd898-tzbjk

openshift-ingress

kubelet

e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-e22c72-67c684d9c4-k5lcn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-e22c72-768765654f-sbn8m

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-219fd6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-219fd6

openshift-ingress

deployment-controller

e2e-shared-a-w3-219fd6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-219fd6-openshift-default-56dc8b44d8 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w3-219fd6-openshift-default-56dc8b44d8

SuccessfulCreate

Created pod: e2e-shared-a-w3-219fd6-openshift-default-56dc8b44d8-tkv4f

openshift-ingress

multus

e2e-shared-a-w3-219fd6-openshift-default-56dc8b44d8-tkv4f

AddedInterface

Add eth0 [10.132.0.64/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-219fd6-59c79dc69f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-219fd6-59c79dc69f-pf4vn

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-219fd6-64dcd7f4c4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-219fd6-64dcd7f4c4-68j6c
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-219fd6-64dcd7f4c4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-219fd6-64dcd7f4c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-219fd6: serviceaccount "payload-processing-e2e-shared-a-w3-219fd6" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-219fd6-59c79dc69f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-219fd6-59c79dc69f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-219fd6: serviceaccount "payload-processing-e2e-shared-a-w3-219fd6" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-219fd6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-219fd6-59c79dc69f from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-219fd6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-219fd6-64dcd7f4c4 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-219fd6-59c79dc69f-pf4vn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-219fd6-59c79dc69f-pf4vn

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-219fd6-59c79dc69f-pf4vn

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-219fd6-59c79dc69f-pf4vn

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-219fd6-64dcd7f4c4-68j6c

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-219fd6-64dcd7f4c4-68j6c

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-219fd6-64dcd7f4c4-68j6c

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-219fd6-64dcd7f4c4-68j6c

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-noten-664dc8-openshift-default-c494fd898-tzbjk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-noten-664dc8-openshift-default-c494fd898-tzbjk

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-noten-664dc8-openshift-default-c494fd898-tzbjk

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-219fd6-openshift-default-56dc8b44d8-tkv4f

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-shared-a-w3-219fd6-openshift-default-56dc8b44d8-tkv4f

Unhealthy

Readiness probe failed: Get "http://10.132.0.64:15021/healthz/ready": dial tcp 10.132.0.64:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-219fd6-openshift-default-56dc8b44d8-tkv4f

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-219fd6-openshift-default-56dc8b44d8-tkv4f

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-219fd6-openshift-default-56dc8b44d8-tkv4f

ProbeError

Readiness probe error: Get "http://10.132.0.64:15021/healthz/ready": dial tcp 10.132.0.64:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-mt-37c368a6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-37c368a6

openshift-ingress

replicaset-controller

e2e-mt-37c368a6-openshift-default-74cbd696d8

SuccessfulCreate

Created pod: e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp

openshift-ingress

deployment-controller

e2e-mt-37c368a6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-37c368a6-openshift-default-74cbd696d8 from 0 to 1

openshift-ingress

multus

e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-219fd6-openshift-default-56dc8b44d8-tkv4f

Unhealthy

Startup probe failed: Get "http://10.132.0.64:15021/healthz/ready": dial tcp 10.132.0.64:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-219fd6-openshift-default-56dc8b44d8-tkv4f

ProbeError

Startup probe error: Get "http://10.132.0.64:15021/healthz/ready": dial tcp 10.132.0.64:15021: connect: connection refused body:
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-37c368a6-57cdf8649

FailedCreate

Error creating: pods "payload-processing-e2e-mt-37c368a6-57cdf8649-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-37c368a6: serviceaccount "payload-processing-e2e-mt-37c368a6" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-37c368a6-57cdf8649

SuccessfulCreate

Created pod: payload-processing-e2e-mt-37c368a6-57cdf8649-zdd5l

openshift-ingress

deployment-controller

payload-processing-e2e-mt-37c368a6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-37c368a6-57cdf8649 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-37c368a6-7595d9b56b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-37c368a6-7595d9b56b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-37c368a6: serviceaccount "payload-processing-e2e-mt-37c368a6" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-37c368a6-7595d9b56b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-37c368a6-7595d9b56b-rv28s

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-37c368a6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-37c368a6-7595d9b56b from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-37c368a6-7595d9b56b-rv28s

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-37c368a6-7595d9b56b-rv28s

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-37c368a6-7595d9b56b-rv28s

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-37c368a6-7595d9b56b-rv28s

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-mt-37c368a6-57cdf8649-zdd5l

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-37c368a6-57cdf8649-zdd5l

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-37c368a6-57cdf8649-zdd5l

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-37c368a6-57cdf8649-zdd5l

Started

Started container payload-processing

openshift-ingress

deployment-controller

e2e-shared-b-w3-b73303-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-b73303-openshift-default-68688bdd7d from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w3-b73303-openshift-default-68688bdd7d

SuccessfulCreate

Created pod: e2e-shared-b-w3-b73303-openshift-default-68688bdd7d-vfncp

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-b73303

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-b73303

openshift-ingress

multus

e2e-shared-b-w3-b73303-openshift-default-68688bdd7d-vfncp

AddedInterface

Add eth0 [10.132.0.65/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-b73303

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-b73303-ddbd4cff8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-b73303-ddbd4cff8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-b73303-ddbd4cff8-9tf97
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-b73303-ddbd4cff8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-b73303-ddbd4cff8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-b73303: serviceaccount "payload-processing-e2e-shared-b-w3-b73303" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-b73303-988f4dc69

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-b73303-988f4dc69-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-b73303: serviceaccount "payload-processing-e2e-shared-b-w3-b73303" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-b73303

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-b73303-988f4dc69 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-b73303-ddbd4cff8-9tf97

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-b73303-988f4dc69-9xs5f

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-b73303-988f4dc69

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-b73303-988f4dc69-9xs5f

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-b73303-ddbd4cff8-9tf97

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-b73303-ddbd4cff8-9tf97

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-b73303-ddbd4cff8-9tf97

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-b73303-988f4dc69-9xs5f

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-b73303-988f4dc69-9xs5f

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-b73303-988f4dc69-9xs5f

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp

ProbeError

Readiness probe error: Get "http://10.134.0.65:15021/healthz/ready": read tcp 10.134.0.2:47474->10.134.0.65:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp

Unhealthy

Readiness probe failed: Get "http://10.134.0.65:15021/healthz/ready": read tcp 10.134.0.2:47474->10.134.0.65:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp

Unhealthy

Startup probe failed: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp

ProbeError

Startup probe error: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-shared-b-w3-b73303-openshift-default-68688bdd7d-vfncp

Unhealthy

Readiness probe failed: Get "http://10.132.0.65:15021/healthz/ready": read tcp 10.132.0.2:56518->10.132.0.65:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-b73303-openshift-default-68688bdd7d-vfncp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-shared-b-w3-b73303-openshift-default-68688bdd7d-vfncp

ProbeError

Readiness probe error: Get "http://10.132.0.65:15021/healthz/ready": read tcp 10.132.0.2:56518->10.132.0.65:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-b73303-openshift-default-68688bdd7d-vfncp

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-b73303-openshift-default-68688bdd7d-vfncp

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-b73303-openshift-default-68688bdd7d-vfncp

ProbeError

Startup probe error: Get "http://10.132.0.65:15021/healthz/ready": dial tcp 10.132.0.65:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-b73303-openshift-default-68688bdd7d-vfncp

Unhealthy

Startup probe failed: Get "http://10.132.0.65:15021/healthz/ready": dial tcp 10.132.0.65:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-37c368a6-7595d9b56b-rv28s

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-37c368a6-57cdf8649-zdd5l

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

kubelet

e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

e2e-shared-a-w2-29fd7d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-29fd7d-openshift-default-747486d658 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-29fd7d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-29fd7d

openshift-ingress

replicaset-controller

e2e-shared-a-w2-29fd7d-openshift-default-747486d658

SuccessfulCreate

Created pod: e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn

openshift-ingress

multus

e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn

AddedInterface

Add eth0 [10.134.0.70/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-29fd7d-b767fbf7c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-29fd7d-b767fbf7c-dndpp
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-29fd7d-b767fbf7c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-29fd7d-b767fbf7c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-29fd7d: serviceaccount "payload-processing-e2e-shared-a-w2-29fd7d" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-29fd7d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-29fd7d-77b7d44c7d from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-29fd7d-77b7d44c7d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-29fd7d-77b7d44c7d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-29fd7d: serviceaccount "payload-processing-e2e-shared-a-w2-29fd7d" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-29fd7d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-29fd7d-b767fbf7c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-29fd7d-77b7d44c7d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-29fd7d-77b7d44c7d-vqnjp

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-29fd7d-77b7d44c7d-vqnjp

AddedInterface

Add eth0 [10.134.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-29fd7d-77b7d44c7d-vqnjp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-29fd7d-77b7d44c7d-vqnjp

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-29fd7d-b767fbf7c-dndpp

AddedInterface

Add eth0 [10.134.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-29fd7d-b767fbf7c-dndpp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-29fd7d-b767fbf7c-dndpp

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-29fd7d-b767fbf7c-dndpp

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-29fd7d-77b7d44c7d-vqnjp

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn

Unhealthy

Startup probe failed: Get "http://10.134.0.70:15021/healthz/ready": dial tcp 10.134.0.70:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn

ProbeError

Startup probe error: Get "http://10.134.0.70:15021/healthz/ready": dial tcp 10.134.0.70:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-shared-b-w2-90bd7e-openshift-default-68f8797466

SuccessfulCreate

Created pod: e2e-shared-b-w2-90bd7e-openshift-default-68f8797466-5bzg4

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-90bd7e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-90bd7e

openshift-ingress

deployment-controller

e2e-shared-b-w2-90bd7e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-90bd7e-openshift-default-68f8797466 from 0 to 1

openshift-ingress

multus

e2e-shared-b-w2-90bd7e-openshift-default-68f8797466-5bzg4

AddedInterface

Add eth0 [10.132.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-90bd7e-b4c88455d-r277g

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-90bd7e-5575747ff7-jrl6s

AddedInterface

Add eth0 [10.134.0.73/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-90bd7e-b4c88455d-r277g

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-90bd7e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-90bd7e-5575747ff7 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-90bd7e-5575747ff7-jrl6s

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-90bd7e-5575747ff7-jrl6s

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-90bd7e-5575747ff7-jrl6s

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-90bd7e-b4c88455d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-90bd7e-b4c88455d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-90bd7e: serviceaccount "payload-processing-e2e-shared-b-w2-90bd7e" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-90bd7e-b4c88455d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-90bd7e-b4c88455d-r277g

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-90bd7e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-90bd7e-b4c88455d from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-90bd7e-5575747ff7

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-90bd7e-5575747ff7-jrl6s
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-90bd7e-5575747ff7

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-90bd7e-5575747ff7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-90bd7e: serviceaccount "payload-processing-e2e-shared-b-w2-90bd7e" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-90bd7e-b4c88455d-r277g

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-90bd7e-b4c88455d-r277g

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-90bd7e-openshift-default-68f8797466-5bzg4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-90bd7e-openshift-default-68f8797466-5bzg4

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-90bd7e-openshift-default-68f8797466-5bzg4

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-90bd7e-openshift-default-68f8797466-5bzg4

Unhealthy

Startup probe failed: Get "http://10.132.0.68:15021/healthz/ready": dial tcp 10.132.0.68:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-90bd7e-openshift-default-68f8797466-5bzg4

ProbeError

Startup probe error: Get "http://10.132.0.68:15021/healthz/ready": dial tcp 10.132.0.68:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-mt-7dabb3eb-openshift-default-5d7b99f69b

SuccessfulCreate

Created pod: e2e-mt-7dabb3eb-openshift-default-5d7b99f69b-m695j

openshift-ingress

deployment-controller

e2e-mt-7dabb3eb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-7dabb3eb-openshift-default-5d7b99f69b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-7dabb3eb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-7dabb3eb

openshift-ingress

multus

e2e-mt-7dabb3eb-openshift-default-5d7b99f69b-m695j

AddedInterface

Add eth0 [10.132.0.70/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-7dabb3eb-84d45cd878

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-7dabb3eb-84d45cd878-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-7dabb3eb: serviceaccount "payload-processing-e2e-mt-7dabb3eb" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-7dabb3eb-5596c69c6f

FailedCreate

Error creating: pods "payload-processing-e2e-mt-7dabb3eb-5596c69c6f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-7dabb3eb: serviceaccount "payload-processing-e2e-mt-7dabb3eb" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-7dabb3eb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-7dabb3eb-5596c69c6f from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-7dabb3eb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-7dabb3eb-84d45cd878 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-7dabb3eb-84d45cd878

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-7dabb3eb-84d45cd878-5k94d

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-7dabb3eb-5596c69c6f

SuccessfulCreate

Created pod: payload-processing-e2e-mt-7dabb3eb-5596c69c6f-ws9nd

openshift-ingress

kubelet

payload-processing-e2e-mt-7dabb3eb-5596c69c6f-ws9nd

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-7dabb3eb-5596c69c6f-ws9nd

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-mt-7dabb3eb-5596c69c6f-ws9nd

AddedInterface

Add eth0 [10.134.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-7dabb3eb-84d45cd878-5k94d

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-7dabb3eb-84d45cd878-5k94d

AddedInterface

Add eth0 [10.134.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-7dabb3eb-84d45cd878-5k94d

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-7dabb3eb-84d45cd878-5k94d

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-7dabb3eb-5596c69c6f-ws9nd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-7dabb3eb-openshift-default-5d7b99f69b-m695j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-7dabb3eb-openshift-default-5d7b99f69b-m695j

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-7dabb3eb-openshift-default-5d7b99f69b-m695j

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-7dabb3eb-openshift-default-5d7b99f69b-m695j

ProbeError

Startup probe error: Get "http://10.132.0.70:15021/healthz/ready": dial tcp 10.132.0.70:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-7dabb3eb-openshift-default-5d7b99f69b-m695j

Unhealthy

Startup probe failed: Get "http://10.132.0.70:15021/healthz/ready": dial tcp 10.132.0.70:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-mt-7dabb3eb-5596c69c6f-ws9nd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-7dabb3eb-84d45cd878-5k94d

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-7dabb3eb-openshift-default-5d7b99f69b-m695j

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-api-a-ab677e-openshift-default-56d9b6cb5b

SuccessfulCreate

Created pod: e2e-api-a-ab677e-openshift-default-56d9b6cb5b-nwppt

openshift-ingress

gateway_labeler_controller

e2e-api-a-ab677e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-ab677e

openshift-ingress

deployment-controller

e2e-api-a-ab677e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-ab677e-openshift-default-56d9b6cb5b from 0 to 1

openshift-ingress

multus

e2e-api-a-ab677e-openshift-default-56d9b6cb5b-nwppt

AddedInterface

Add eth0 [10.132.0.73/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-ab677e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-ab677e-64b6448854 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-ab677e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-ab677e-55d8f57747 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-ab677e-64b6448854

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-ab677e-64b6448854-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-ab677e: serviceaccount "payload-processing-e2e-api-a-ab677e" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-ab677e-55d8f57747

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-ab677e-55d8f57747-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-ab677e: serviceaccount "payload-processing-e2e-api-a-ab677e" not found

openshift-ingress

kubelet

payload-processing-e2e-api-a-ab677e-55d8f57747-t69ls

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-ab677e-55d8f57747

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-ab677e-55d8f57747-t69ls

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-ab677e-64b6448854-gsk45

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-ab677e-55d8f57747-t69ls

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-ab677e-55d8f57747-t69ls

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-ab677e-64b6448854

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-ab677e-64b6448854-gsk45

openshift-ingress

multus

payload-processing-e2e-api-a-ab677e-55d8f57747-t69ls

AddedInterface

Add eth0 [10.134.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-ab677e-64b6448854-gsk45

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-ab677e-64b6448854-gsk45

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-a-ab677e-64b6448854-gsk45

AddedInterface

Add eth0 [10.134.0.78/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-api-a-ab677e-openshift-default-56d9b6cb5b-nwppt

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-ab677e-openshift-default-56d9b6cb5b-nwppt

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-ab677e-openshift-default-56d9b6cb5b-nwppt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-api-a-ab677e-openshift-default-56d9b6cb5b-nwppt

Unhealthy

Startup probe failed: Get "http://10.132.0.73:15021/healthz/ready": dial tcp 10.132.0.73:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-a-ab677e-openshift-default-56d9b6cb5b-nwppt

ProbeError

Startup probe error: Get "http://10.132.0.73:15021/healthz/ready": dial tcp 10.132.0.73:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-api-b-cde4a2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-cde4a2

openshift-ingress

deployment-controller

e2e-api-b-cde4a2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-cde4a2-openshift-default-df8984f44 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-cde4a2-openshift-default-df8984f44

SuccessfulCreate

Created pod: e2e-api-b-cde4a2-openshift-default-df8984f44-kcqgh

openshift-ingress

multus

e2e-api-b-cde4a2-openshift-default-df8984f44-kcqgh

AddedInterface

Add eth0 [10.132.0.75/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-cde4a2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-cde4a2-5cd4f67587 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-cde4a2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-cde4a2-686d45b87d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-cde4a2-686d45b87d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-cde4a2-686d45b87d-bwqnn

openshift-ingress

kubelet

payload-processing-e2e-api-b-cde4a2-5cd4f67587-w4kjx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-cde4a2-5cd4f67587

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-cde4a2-5cd4f67587-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-cde4a2: serviceaccount "payload-processing-e2e-api-b-cde4a2" not found

openshift-ingress

kubelet

payload-processing-e2e-api-b-cde4a2-5cd4f67587-w4kjx

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-cde4a2-686d45b87d-bwqnn

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-cde4a2-5cd4f67587

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-cde4a2-5cd4f67587-w4kjx

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-cde4a2-686d45b87d-bwqnn

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-cde4a2-686d45b87d-bwqnn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-b-cde4a2-686d45b87d-bwqnn

AddedInterface

Add eth0 [10.134.0.79/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-api-b-cde4a2-5cd4f67587-w4kjx

AddedInterface

Add eth0 [10.134.0.80/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-cde4a2-5cd4f67587-w4kjx

Created

Created container: payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-cde4a2-686d45b87d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-cde4a2-686d45b87d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-cde4a2: serviceaccount "payload-processing-e2e-api-b-cde4a2" not found
(x2)

openshift-ingress

kubelet

e2e-api-b-cde4a2-openshift-default-df8984f44-kcqgh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-cde4a2-openshift-default-df8984f44-kcqgh

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-cde4a2-openshift-default-df8984f44-kcqgh

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-b-cde4a2-openshift-default-df8984f44-kcqgh

Unhealthy

Startup probe failed: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-b-cde4a2-openshift-default-df8984f44-kcqgh

ProbeError

Startup probe error: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-ab677e-64b6448854-gsk45

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-ab677e-55d8f57747-t69ls

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-ipp-a-814d40-openshift-default-64cd9cb8d8

SuccessfulCreate

Created pod: e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-814d40

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-814d40

openshift-ingress

deployment-controller

e2e-ipp-a-814d40-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-814d40-openshift-default-64cd9cb8d8 from 0 to 1

openshift-ingress

multus

e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74

AddedInterface

Add eth0 [10.134.0.85/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-a-ab677e-openshift-default-56d9b6cb5b-nwppt

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-814d40-6bf8656cff

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-814d40-6bf8656cff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-814d40: serviceaccount "payload-processing-e2e-ipp-a-814d40" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-814d40-7d6f469754

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-814d40-7d6f469754-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-814d40: serviceaccount "payload-processing-e2e-ipp-a-814d40" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-814d40-6bf8656cff

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-814d40-6bf8656cff-pc94f

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-814d40

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-814d40-6bf8656cff from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-814d40

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-814d40-7d6f469754 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-814d40-7d6f469754

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-814d40-7d6f469754-n5tpb

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-814d40-7d6f469754-n5tpb

AddedInterface

Add eth0 [10.134.0.86/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-814d40-7d6f469754-n5tpb

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-814d40-6bf8656cff-pc94f

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-814d40-6bf8656cff-pc94f

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-814d40-6bf8656cff-pc94f

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-a-814d40-6bf8656cff-pc94f

AddedInterface

Add eth0 [10.134.0.87/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-814d40-7d6f469754-n5tpb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-814d40-7d6f469754-n5tpb

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-api-a-ab677e-openshift-default-56d9b6cb5b-nwppt

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-a-ab677e-openshift-default-56d9b6cb5b-nwppt

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74

Unhealthy

Readiness probe failed: Get "http://10.134.0.85:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-cde4a2-686d45b87d-bwqnn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-cde4a2-5cd4f67587-w4kjx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74

ProbeError

Readiness probe error: Get "http://10.134.0.85:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74

Unhealthy

Startup probe failed: Get "http://10.134.0.85:15021/healthz/ready": dial tcp 10.134.0.85:15021: connect: connection refused

openshift-ingress

kubelet

e2e-api-b-cde4a2-openshift-default-df8984f44-kcqgh

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74

ProbeError

Startup probe error: Get "http://10.134.0.85:15021/healthz/ready": dial tcp 10.134.0.85:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-ipp-b-275a06-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-275a06-openshift-default-5c4b879898 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-275a06

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-275a06

openshift-ingress

replicaset-controller

e2e-ipp-b-275a06-openshift-default-5c4b879898

SuccessfulCreate

Created pod: e2e-ipp-b-275a06-openshift-default-5c4b879898-mjctk

openshift-ingress

multus

e2e-ipp-b-275a06-openshift-default-5c4b879898-mjctk

AddedInterface

Add eth0 [10.132.0.82/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-29fd7d-77b7d44c7d-vqnjp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-29fd7d-b767fbf7c-dndpp

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-275a06

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-275a06-77cf85fc57 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-275a06-79d8f75dc4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-275a06-79d8f75dc4-2pgnc
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-275a06-77cf85fc57

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-275a06-77cf85fc57-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-275a06: serviceaccount "payload-processing-e2e-ipp-b-275a06" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-275a06-77cf85fc57

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-275a06-77cf85fc57-h7x85

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-275a06

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-275a06-79d8f75dc4 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-275a06-79d8f75dc4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-275a06-79d8f75dc4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-275a06: serviceaccount "payload-processing-e2e-ipp-b-275a06" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-275a06-77cf85fc57-h7x85

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-275a06-77cf85fc57-h7x85

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-275a06-79d8f75dc4-2pgnc

AddedInterface

Add eth0 [10.132.0.83/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-275a06-79d8f75dc4-2pgnc

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-b-275a06-77cf85fc57-h7x85

AddedInterface

Add eth0 [10.134.0.88/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-275a06-79d8f75dc4-2pgnc

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-275a06-79d8f75dc4-2pgnc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-275a06-77cf85fc57-h7x85

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-90bd7e-5575747ff7-jrl6s

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-90bd7e-b4c88455d-r277g

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-b-275a06-openshift-default-5c4b879898-mjctk

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-275a06-openshift-default-5c4b879898-mjctk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-275a06-openshift-default-5c4b879898-mjctk

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-90bd7e-openshift-default-68f8797466-5bzg4

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-ipp-b-275a06-openshift-default-5c4b879898-mjctk

Unhealthy

Startup probe failed: Get "http://10.132.0.82:15021/healthz/ready": dial tcp 10.132.0.82:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-b-275a06-openshift-default-5c4b879898-mjctk

ProbeError

Startup probe error: Get "http://10.132.0.82:15021/healthz/ready": dial tcp 10.132.0.82:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-68ca72

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-68ca72

openshift-ingress

deployment-controller

e2e-ipp-cleanup-68ca72-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-68ca72-openshift-default-5f7f6bfc4b from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-68ca72-openshift-default-5f7f6bfc4b

SuccessfulCreate

Created pod: e2e-ipp-cleanup-68ca72-openshift-default-5f7f6bfc4b-sf5wq

openshift-ingress

multus

e2e-ipp-cleanup-68ca72-openshift-default-5f7f6bfc4b-sf5wq

AddedInterface

Add eth0 [10.132.0.85/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-68ca72-54bb68d854

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-68ca72-54bb68d854-mgf75

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-68ca72

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-68ca72-54bb68d854 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-68ca72-fff8d7dd9-dsn2z

AddedInterface

Add eth0 [10.134.0.89/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-68ca72-fff8d7dd9-dsn2z

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-68ca72-fff8d7dd9-dsn2z

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-68ca72-fff8d7dd9-dsn2z

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-68ca72-fff8d7dd9

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-68ca72-fff8d7dd9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-68ca72: serviceaccount "payload-processing-e2e-ipp-cleanup-68ca72" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-68ca72-54bb68d854

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-68ca72-54bb68d854-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-68ca72: serviceaccount "payload-processing-e2e-ipp-cleanup-68ca72" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-68ca72-fff8d7dd9

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-68ca72-fff8d7dd9-dsn2z

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-68ca72-54bb68d854-mgf75

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-68ca72-54bb68d854-mgf75

Created

Created container: payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-68ca72

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-68ca72-fff8d7dd9 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-68ca72-54bb68d854-mgf75

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-68ca72-54bb68d854-mgf75

AddedInterface

Add eth0 [10.134.0.90/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-68ca72-openshift-default-5f7f6bfc4b-sf5wq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-68ca72-openshift-default-5f7f6bfc4b-sf5wq

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-68ca72-openshift-default-5f7f6bfc4b-sf5wq

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-ipp-cleanup-68ca72-openshift-default-5f7f6bfc4b-sf5wq

Unhealthy

Startup probe failed: Get "http://10.132.0.85:15021/healthz/ready": dial tcp 10.132.0.85:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-cleanup-68ca72-openshift-default-5f7f6bfc4b-sf5wq

ProbeError

Startup probe error: Get "http://10.132.0.85:15021/healthz/ready": dial tcp 10.132.0.85:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-68ca72-54bb68d854-mgf75

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-68ca72-fff8d7dd9-dsn2z

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-68ca72-openshift-default-5f7f6bfc4b-sf5wq

Killing

Stopping container istio-proxy

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-a-814d40

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-a-814d40: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-a-814d40": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-a-814d40, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 22e6fa14-223b-402f-a676-1e552a7effd5, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-814d40-7d6f469754-n5tpb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-814d40-6bf8656cff-pc94f

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-275a06-77cf85fc57-h7x85

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-275a06-79d8f75dc4-2pgnc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-275a06-openshift-default-5c4b879898-mjctk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-219fd6-59c79dc69f-pf4vn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-219fd6-64dcd7f4c4-68j6c

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-a-w3-219fd6

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-a-w3-219fd6: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-a-w3-219fd6": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-a-w3-219fd6, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: edc020d4-6eee-4a83-99b8-9160e3e8fdfe, UID in object meta:

openshift-ingress

kubelet

e2e-shared-a-w3-219fd6-openshift-default-56dc8b44d8-tkv4f

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-b73303-988f4dc69-9xs5f

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-b73303-ddbd4cff8-9tf97

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w3-b73303-openshift-default-68688bdd7d-vfncp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w3-b73303-openshift-default-68688bdd7d-vfncp

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w3-b73303-openshift-default-68688bdd7d-vfncp

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: