Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-processing-e2e-ait-b27eb4af-7676cd8bdf-jkphd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-b27eb4af-7676cd8bdf-jkphd to ip-10-0-133-204.ec2.internal

openshift-ingress

e2e-worker-w4-3fa986-openshift-default-d7f4fdfd6-n8f7m

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-3fa986-openshift-default-d7f4fdfd6-n8f7m to ip-10-0-140-157.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-390abc-59b465557f-nvtg4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-390abc-59b465557f-nvtg4 to ip-10-0-133-204.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-64fec6-866767cccc-szm94

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-64fec6-866767cccc-szm94 to ip-10-0-133-204.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-9e275c-64575c7d97-ttmb9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-9e275c-64575c7d97-ttmb9 to ip-10-0-128-94.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-2d3bc8-c768b769f-8t5xb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-2d3bc8-c768b769f-8t5xb to ip-10-0-133-204.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-d99c83-86bf9975d9-8cnl2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-d99c83-86bf9975d9-8cnl2 to ip-10-0-128-94.ec2.internal

openshift-ingress

e2e-ipp-b-855e86-openshift-default-787f847fc8-vggg5

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-855e86-openshift-default-787f847fc8-vggg5 to ip-10-0-140-157.ec2.internal

openshift-ingress

e2e-ait-04d63732-openshift-default-5455bb5f4b-gkmgg

Scheduled

Successfully assigned openshift-ingress/e2e-ait-04d63732-openshift-default-5455bb5f4b-gkmgg to ip-10-0-140-157.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-bcb351-6b677f6658-79b9g

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-bcb351-6b677f6658-79b9g to ip-10-0-133-204.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-98c7fb47-d7cccc7db-mp8xv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-98c7fb47-d7cccc7db-mp8xv to ip-10-0-133-204.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-100032-6d8467f586-g45qb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-100032-6d8467f586-g45qb to ip-10-0-128-94.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-da0a18-5bf6777478-g5mqw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-da0a18-5bf6777478-g5mqw to ip-10-0-133-204.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-2aaab1-c64d77d5d-9vv8g

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-2aaab1-c64d77d5d-9vv8g to ip-10-0-133-204.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-331c9d-64f4495494-qxll2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-331c9d-64f4495494-qxll2 to ip-10-0-128-94.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-ef9b2234-85f8b7bf86-nh2cp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-ef9b2234-85f8b7bf86-nh2cp to ip-10-0-133-204.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-66cedd-74bccd9db-bhprn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-66cedd-74bccd9db-bhprn to ip-10-0-128-94.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-4883373b-77b9d687bb-lwlzx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-4883373b-77b9d687bb-lwlzx to ip-10-0-128-94.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-65d42a05-966449566-9mfd5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-65d42a05-966449566-9mfd5 to ip-10-0-128-94.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-9dedad-d569b978-vnq65

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-9dedad-d569b978-vnq65 to ip-10-0-128-94.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-d99c83-6988bf498-v2dqf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-d99c83-6988bf498-v2dqf to ip-10-0-128-94.ec2.internal

openshift-ingress

e2e-ait-b27eb4af-openshift-default-978c8d498-sh9vj

Scheduled

Successfully assigned openshift-ingress/e2e-ait-b27eb4af-openshift-default-978c8d498-sh9vj to ip-10-0-140-157.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-2d3bc8-54b8c58546-l2vl6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-2d3bc8-54b8c58546-l2vl6 to ip-10-0-133-204.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-9e275c-7994c94758-9ksr2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-9e275c-7994c94758-9ksr2 to ip-10-0-128-94.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-64fec6-84dff8b554-kpb64

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-64fec6-84dff8b554-kpb64 to ip-10-0-133-204.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-390abc-57cfb4f7f8-2hdvj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-390abc-57cfb4f7f8-2hdvj to ip-10-0-128-94.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-5d8401-559dd65bf8-524vr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-5d8401-559dd65bf8-524vr to ip-10-0-128-94.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-b27eb4af-676599659d-zwx95

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-b27eb4af-676599659d-zwx95 to ip-10-0-133-204.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-04d63732-8865dc7c8-c6kvq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-04d63732-8865dc7c8-c6kvq to ip-10-0-133-204.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-6wpd7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-6wpd7 to ip-10-0-128-94.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-5ccb968c66-vxvgt

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vxvgt to ip-10-0-140-157.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-855e86-5879d78cd-hcqzh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-855e86-5879d78cd-hcqzh to ip-10-0-128-94.ec2.internal

openshift-ingress

e2e-api-a-5d8401-openshift-default-6b7665bfd8-wbbs4

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-5d8401-openshift-default-6b7665bfd8-wbbs4 to ip-10-0-140-157.ec2.internal

openshift-ingress

payload-processing-e2e-mt-65d42a05-5b84498bf7-9n2bh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-65d42a05-5b84498bf7-9n2bh to ip-10-0-128-94.ec2.internal

openshift-ingress

payload-processing-e2e-mt-4883373b-7cfd55c54f-rqfkp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-4883373b-7cfd55c54f-rqfkp to ip-10-0-128-94.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-98c7fb47-549cbfd9d6-rlwr9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-98c7fb47-549cbfd9d6-rlwr9 to ip-10-0-133-204.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-bcb351-7fccbcb875-dsj5h

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-bcb351-7fccbcb875-dsj5h to ip-10-0-133-204.ec2.internal

openshift-ingress

e2e-inf-b-da0a18-openshift-default-75799b96b-bjpl5

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-da0a18-openshift-default-75799b96b-bjpl5 to ip-10-0-140-157.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-855e86-546d9bc677-s6lxc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-855e86-546d9bc677-s6lxc to ip-10-0-128-94.ec2.internal

openshift-ingress

e2e-ipp-cleanup-bcb351-openshift-default-6586f4bc6d-lpncr

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-bcb351-openshift-default-6586f4bc6d-lpncr to ip-10-0-140-157.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-100032-847c459c7c-v2t42

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-100032-847c459c7c-v2t42 to ip-10-0-128-94.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-da0a18-6fc78c9597-27mdl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-da0a18-6fc78c9597-27mdl to ip-10-0-133-204.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w4-3fa986-7767558c7c-vstt2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-3fa986-7767558c7c-vstt2 to ip-10-0-128-94.ec2.internal

openshift-ingress

e2e-api-b-9dedad-openshift-default-ccb56564-mppvx

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-9dedad-openshift-default-ccb56564-mppvx to ip-10-0-140-157.ec2.internal

openshift-ingress

e2e-mt-4883373b-openshift-default-56585b57fb-k2q5r

Scheduled

Successfully assigned openshift-ingress/e2e-mt-4883373b-openshift-default-56585b57fb-k2q5r to ip-10-0-140-157.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-2aaab1-68b5dd8b7c-xqvkg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-2aaab1-68b5dd8b7c-xqvkg to ip-10-0-133-204.ec2.internal

openshift-ingress

e2e-mt-65d42a05-openshift-default-657799b5b4-7rmn5

Scheduled

Successfully assigned openshift-ingress/e2e-mt-65d42a05-openshift-default-657799b5b4-7rmn5 to ip-10-0-140-157.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-331c9d-b5d7767c-mmtf5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-331c9d-b5d7767c-mmtf5 to ip-10-0-128-94.ec2.internal

openshift-ingress

router-default-7685746588-wcx7f

Scheduled

Successfully assigned openshift-ingress/router-default-7685746588-wcx7f to ip-10-0-140-157.ec2.internal

openshift-ingress

e2e-noten-749a53-openshift-default-7c4cbc8bb6-h2hgq

Scheduled

Successfully assigned openshift-ingress/e2e-noten-749a53-openshift-default-7c4cbc8bb6-h2hgq to ip-10-0-140-157.ec2.internal

openshift-ingress

e2e-inf-a-2aaab1-openshift-default-59c66c6874-ztrkq

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-2aaab1-openshift-default-59c66c6874-ztrkq to ip-10-0-140-157.ec2.internal

openshift-ingress

payload-processing-e2e-derive-ef9b2234-6d4b9747c7-q6hq8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-ef9b2234-6d4b9747c7-q6hq8 to ip-10-0-128-94.ec2.internal

openshift-ingress

e2e-shared-a-w2-d99c83-openshift-default-77cb785cc4-8pzjg

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-d99c83-openshift-default-77cb785cc4-8pzjg to ip-10-0-140-157.ec2.internal

openshift-ingress

payload-processing-e2e-autores-66cedd-7676d8b945-jrxxs

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-66cedd-7676d8b945-jrxxs to ip-10-0-128-94.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-9dedad-7d6b486d87-n4sk8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-9dedad-7d6b486d87-n4sk8 to ip-10-0-133-204.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-5d8401-76887ccf55-vslsg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-5d8401-76887ccf55-vslsg to ip-10-0-128-94.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-68cf4d799cxv4ls

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cxv4ls to ip-10-0-140-157.ec2.internal

openshift-ingress

e2e-autores-66cedd-openshift-default-66bbb95fb6-rv5zk

Scheduled

Successfully assigned openshift-ingress/e2e-autores-66cedd-openshift-default-66bbb95fb6-rv5zk to ip-10-0-140-157.ec2.internal

openshift-ingress

e2e-migrate-98c7fb47-gw-openshift-default-7d98597448-q876t

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-98c7fb47-gw-openshift-default-7d98597448-q876t to ip-10-0-140-157.ec2.internal

openshift-ingress

kube-auth-proxy-5769888876-m84dl

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-5769888876-m84dl to ip-10-0-128-94.ec2.internal

openshift-ingress

e2e-shared-a-w3-2d3bc8-openshift-default-7744dd8884-zlh6r

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-2d3bc8-openshift-default-7744dd8884-zlh6r to ip-10-0-140-157.ec2.internal

openshift-ingress

e2e-ipp-a-100032-openshift-default-5b4c44ffd-tp4d8

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-100032-openshift-default-5b4c44ffd-tp4d8 to ip-10-0-140-157.ec2.internal

openshift-ingress

e2e-shared-b-w2-9e275c-openshift-default-56594987bb-vfrx4

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-9e275c-openshift-default-56594987bb-vfrx4 to ip-10-0-140-157.ec2.internal

openshift-ingress

payload-processing-e2e-ait-04d63732-5d467bccd9-pxkkm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-04d63732-5d467bccd9-pxkkm to ip-10-0-133-204.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-lswx7

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-lswx7 to ip-10-0-133-204.ec2.internal

openshift-ingress

kube-auth-proxy-5769888876-6z8xd

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-5769888876-6z8xd to ip-10-0-133-204.ec2.internal

openshift-ingress

e2e-shared-b-w3-64fec6-openshift-default-798455f9fd-fl9b2

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-64fec6-openshift-default-798455f9fd-fl9b2 to ip-10-0-140-157.ec2.internal

openshift-ingress

e2e-derive-ef9b2234-openshift-default-78cff6548d-gdb5d

Scheduled

Successfully assigned openshift-ingress/e2e-derive-ef9b2234-openshift-default-78cff6548d-gdb5d to ip-10-0-140-157.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-3fa986-5869fb8cd-tzl7c

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-3fa986-5869fb8cd-tzl7c to ip-10-0-128-94.ec2.internal

openshift-ingress

e2e-explicit-331c9d-openshift-default-85f6c79d6d-hjzb9

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-331c9d-openshift-default-85f6c79d6d-hjzb9 to ip-10-0-140-157.ec2.internal

openshift-ingress

e2e-worker-w0-390abc-openshift-default-8647c4bc56-tjhbb

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-390abc-openshift-default-8647c4bc56-tjhbb to ip-10-0-140-157.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-xzdss

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-xzdss to ip-10-0-128-94.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-xm4k6

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xm4k6 to ip-10-0-128-94.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-7685746588 from 0 to 1

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x14)

openshift-ingress

replicaset-controller

router-default-7685746588

FailedCreate

Error creating: pods "router-default-7685746588-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x16)

openshift-ingress

replicaset-controller

router-default-7685746588

FailedCreate

Error creating: pods "router-default-7685746588-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-7685746588

SuccessfulCreate

Created pod: router-default-7685746588-wcx7f
(x5)

openshift-ingress

kubelet

router-default-7685746588-wcx7f

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x5)

openshift-ingress

kubelet

router-default-7685746588-wcx7f

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found

openshift-ingress

multus

router-default-7685746588-wcx7f

AddedInterface

Add eth0 [10.132.0.13/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-7685746588-wcx7f

Started

Started container router

openshift-ingress

kubelet

router-default-7685746588-wcx7f

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:da130d90f0bffd5c5876c94544c91b2a1be0d23ce2747ddfeafe88e03ee7d8d1" already present on machine

openshift-ingress

kubelet

router-default-7685746588-wcx7f

Created

Created container: router

openshift-ingress

replicaset-controller

kube-auth-proxy-5769888876

SuccessfulCreate

Created pod: kube-auth-proxy-5769888876-6z8xd

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-5769888876 from 0 to 2

openshift-ingress

kubelet

kube-auth-proxy-5769888876-6z8xd

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

replicaset-controller

kube-auth-proxy-5769888876

SuccessfulCreate

Created pod: kube-auth-proxy-5769888876-m84dl

openshift-ingress

multus

kube-auth-proxy-5769888876-m84dl

AddedInterface

Add eth0 [10.134.0.17/23] from ovn-kubernetes

openshift-ingress

multus

kube-auth-proxy-5769888876-6z8xd

AddedInterface

Add eth0 [10.133.0.28/23] from ovn-kubernetes
(x3)

openshift-ingress

replicaset-controller

kube-auth-proxy-5769888876

FailedCreate

Error creating: pods "kube-auth-proxy-5769888876-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

kubelet

kube-auth-proxy-5769888876-m84dl

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-xm4k6

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-xm4k6

AddedInterface

Add eth0 [10.134.0.18/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-xm4k6

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

kube-auth-proxy-5769888876-6z8xd

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 3.417s (3.417s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-5769888876-6z8xd

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-5769888876-m84dl

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-5769888876-m84dl

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-5769888876-m84dl

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 3.46s (3.46s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-5769888876-6z8xd

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-xm4k6

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-xm4k6

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-xm4k6

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.967s (3.967s including waiting). Image size: 181126104 bytes.

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-68cf4d799c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-68cf4d799cxv4ls

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-68cf4d799c from 0 to 1

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cxv4ls

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-68cf4d799cxv4ls

AddedInterface

Add eth0 [10.132.0.30/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cxv4ls

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cxv4ls

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cxv4ls

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 3.686s (3.686s including waiting). Image size: 181318953 bytes.

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-xzdss

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-xzdss

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-xzdss

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" already present on machine

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-xzdss

AddedInterface

Add eth0 [10.134.0.19/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-xzdss

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-xm4k6

Killing

Stopping container discovery

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-xm4k6

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

multus

maas-default-gateway-openshift-default-5ccb968c66-vxvgt

AddedInterface

Add eth0 [10.132.0.41/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-5ccb968c66 from 0 to 1

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5ccb968c66

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5ccb968c66-vxvgt

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-6wpd7

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-6wpd7

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

multus

payload-processing-5b54b7fbb7-lswx7

AddedInterface

Add eth0 [10.133.0.37/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-lswx7

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-6wpd7

AddedInterface

Add eth0 [10.134.0.29/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-lswx7
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-lswx7

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.762s (1.762s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-lswx7

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-lswx7

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-6wpd7

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.614s (2.615s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-6wpd7

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-6wpd7

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-vxvgt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-vxvgt

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-vxvgt

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-vxvgt

Unhealthy

Startup probe failed: Get "http://10.132.0.41:15021/healthz/ready": dial tcp 10.132.0.41:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-vxvgt

ProbeError

Startup probe error: Get "http://10.132.0.41:15021/healthz/ready": dial tcp 10.132.0.41:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-worker-w0-390abc-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-390abc-openshift-default-8647c4bc56 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-390abc

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-390abc

openshift-ingress

replicaset-controller

e2e-worker-w4-3fa986-openshift-default-d7f4fdfd6

SuccessfulCreate

Created pod: e2e-worker-w4-3fa986-openshift-default-d7f4fdfd6-n8f7m

openshift-ingress

deployment-controller

e2e-worker-w4-3fa986-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-3fa986-openshift-default-d7f4fdfd6 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w0-390abc-openshift-default-8647c4bc56

SuccessfulCreate

Created pod: e2e-worker-w0-390abc-openshift-default-8647c4bc56-tjhbb

openshift-ingress

gateway_labeler_controller

e2e-inf-a-2aaab1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-2aaab1

openshift-ingress

deployment-controller

e2e-inf-a-2aaab1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-2aaab1-openshift-default-59c66c6874 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-2aaab1-openshift-default-59c66c6874

SuccessfulCreate

Created pod: e2e-inf-a-2aaab1-openshift-default-59c66c6874-ztrkq

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-3fa986

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-3fa986

openshift-ingress

multus

e2e-worker-w0-390abc-openshift-default-8647c4bc56-tjhbb

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w4-3fa986-openshift-default-d7f4fdfd6-n8f7m

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

openshift-ingress

multus

e2e-inf-a-2aaab1-openshift-default-59c66c6874-ztrkq

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-3fa986-7767558c7c

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-3fa986-7767558c7c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-3fa986: serviceaccount "payload-processing-e2e-worker-w4-3fa986" not found

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-3fa986

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-3fa986-7767558c7c from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-3fa986-5869fb8cd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-3fa986-5869fb8cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-3fa986: serviceaccount "payload-processing-e2e-worker-w4-3fa986" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-3fa986

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-3fa986-5869fb8cd from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-3fa986-7767558c7c

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-3fa986-7767558c7c-vstt2

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-3fa986-5869fb8cd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-3fa986-5869fb8cd-tzl7c

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-390abc

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-390abc-59b465557f from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-3fa986-7767558c7c-vstt2

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-worker-w4-3fa986-7767558c7c-vstt2

AddedInterface

Add eth0 [10.134.0.34/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-390abc-57cfb4f7f8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-390abc-57cfb4f7f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-390abc: serviceaccount "payload-processing-e2e-worker-w0-390abc" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-390abc-57cfb4f7f8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-390abc-57cfb4f7f8-2hdvj

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-3fa986-5869fb8cd-tzl7c

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-3fa986-7767558c7c-vstt2

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-3fa986-5869fb8cd-tzl7c

AddedInterface

Add eth0 [10.134.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-3fa986-7767558c7c-vstt2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-3fa986-5869fb8cd-tzl7c

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-3fa986-5869fb8cd-tzl7c

Created

Created container: payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-390abc

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-390abc-57cfb4f7f8 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-390abc-59b465557f

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-390abc-59b465557f-nvtg4
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-390abc-59b465557f

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-390abc-59b465557f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-390abc: serviceaccount "payload-processing-e2e-worker-w0-390abc" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-390abc-57cfb4f7f8-2hdvj

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-390abc-57cfb4f7f8-2hdvj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-390abc-59b465557f-nvtg4

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

e2e-autores-66cedd-openshift-default-66bbb95fb6

SuccessfulCreate

Created pod: e2e-autores-66cedd-openshift-default-66bbb95fb6-rv5zk

openshift-ingress

gateway_labeler_controller

e2e-autores-66cedd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-66cedd

openshift-ingress

multus

e2e-autores-66cedd-openshift-default-66bbb95fb6-rv5zk

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-390abc-59b465557f-nvtg4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-worker-w0-390abc-59b465557f-nvtg4

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-390abc-57cfb4f7f8-2hdvj

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-390abc-59b465557f-nvtg4

Started

Started container payload-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-2aaab1-c64d77d5d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-2aaab1-c64d77d5d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-2aaab1: serviceaccount "payload-processing-e2e-inf-a-2aaab1" not found

openshift-ingress

deployment-controller

e2e-autores-66cedd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-66cedd-openshift-default-66bbb95fb6 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-2aaab1-68b5dd8b7c

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-2aaab1-68b5dd8b7c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-2aaab1: serviceaccount "payload-processing-e2e-inf-a-2aaab1" not found

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-390abc-57cfb4f7f8-2hdvj

AddedInterface

Add eth0 [10.134.0.36/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-2aaab1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-2aaab1-68b5dd8b7c from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-2aaab1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-2aaab1-c64d77d5d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-2aaab1-c64d77d5d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-2aaab1-c64d77d5d-9vv8g

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-2aaab1-68b5dd8b7c

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-2aaab1-68b5dd8b7c-xqvkg

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-2aaab1-c64d77d5d-9vv8g

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-2aaab1-c64d77d5d-9vv8g

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-2aaab1-68b5dd8b7c-xqvkg

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-2aaab1-68b5dd8b7c-xqvkg

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-inf-a-2aaab1-68b5dd8b7c-xqvkg

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-2aaab1-68b5dd8b7c-xqvkg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-2aaab1-c64d77d5d-9vv8g

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-2aaab1-c64d77d5d-9vv8g

AddedInterface

Add eth0 [10.133.0.44/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ait-04d63732

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-04d63732

openshift-ingress

deployment-controller

e2e-ait-04d63732-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-04d63732-openshift-default-5455bb5f4b from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-04d63732-openshift-default-5455bb5f4b

SuccessfulCreate

Created pod: e2e-ait-04d63732-openshift-default-5455bb5f4b-gkmgg

openshift-ingress

multus

e2e-ait-04d63732-openshift-default-5455bb5f4b-gkmgg

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-66cedd-7676d8b945

SuccessfulCreate

Created pod: payload-processing-e2e-autores-66cedd-7676d8b945-jrxxs
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-66cedd-74bccd9db

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-66cedd-74bccd9db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-66cedd: serviceaccount "payload-processing-e2e-autores-66cedd" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-66cedd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-66cedd-74bccd9db from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-66cedd-7676d8b945

FailedCreate

Error creating: pods "payload-processing-e2e-autores-66cedd-7676d8b945-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-66cedd: serviceaccount "payload-processing-e2e-autores-66cedd" not found

openshift-ingress

deployment-controller

payload-processing-e2e-autores-66cedd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-66cedd-7676d8b945 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-66cedd-74bccd9db

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-66cedd-74bccd9db-bhprn

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-66cedd-74bccd9db-bhprn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-autores-66cedd-7676d8b945-jrxxs

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-66cedd-7676d8b945-jrxxs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-autores-66cedd-7676d8b945-jrxxs

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-66cedd-7676d8b945-jrxxs

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-66cedd-74bccd9db-bhprn

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-66cedd-74bccd9db-bhprn

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-autores-66cedd-74bccd9db-bhprn

AddedInterface

Add eth0 [10.134.0.38/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-04d63732-5d467bccd9

FailedCreate

Error creating: pods "payload-processing-e2e-ait-04d63732-5d467bccd9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-04d63732: serviceaccount "payload-processing-e2e-ait-04d63732" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-04d63732

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-04d63732-8865dc7c8 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ait-04d63732-8865dc7c8-c6kvq

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-04d63732-8865dc7c8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-04d63732-8865dc7c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-04d63732: serviceaccount "payload-processing-e2e-ait-04d63732" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-04d63732-8865dc7c8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-04d63732-8865dc7c8-c6kvq

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-04d63732-5d467bccd9

SuccessfulCreate

Created pod: payload-processing-e2e-ait-04d63732-5d467bccd9-pxkkm

openshift-ingress

deployment-controller

payload-processing-e2e-ait-04d63732

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-04d63732-5d467bccd9 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-04d63732-5d467bccd9-pxkkm

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-ait-04d63732-5d467bccd9-pxkkm

AddedInterface

Add eth0 [10.133.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-04d63732-5d467bccd9-pxkkm

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-04d63732-8865dc7c8-c6kvq

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-04d63732-8865dc7c8-c6kvq

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-04d63732-8865dc7c8-c6kvq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-04d63732-5d467bccd9-pxkkm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w4-3fa986-openshift-default-d7f4fdfd6-n8f7m

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-390abc-openshift-default-8647c4bc56-tjhbb

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-3fa986-openshift-default-d7f4fdfd6-n8f7m

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w0-390abc-openshift-default-8647c4bc56-tjhbb

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-2aaab1-openshift-default-59c66c6874-ztrkq

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-3fa986-openshift-default-d7f4fdfd6-n8f7m

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-2aaab1-openshift-default-59c66c6874-ztrkq

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-2aaab1-openshift-default-59c66c6874-ztrkq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w0-390abc-openshift-default-8647c4bc56-tjhbb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x7)

openshift-ingress

kubelet

e2e-inf-a-2aaab1-openshift-default-59c66c6874-ztrkq

ProbeError

Startup probe error: Get "http://10.132.0.47:15021/healthz/ready": dial tcp 10.132.0.47:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w4-3fa986-openshift-default-d7f4fdfd6-n8f7m

ProbeError

Startup probe error: Get "http://10.132.0.45:15021/healthz/ready": dial tcp 10.132.0.45:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w4-3fa986-openshift-default-d7f4fdfd6-n8f7m

Unhealthy

Startup probe failed: Get "http://10.132.0.45:15021/healthz/ready": dial tcp 10.132.0.45:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-inf-a-2aaab1-openshift-default-59c66c6874-ztrkq

Unhealthy

Startup probe failed: Get "http://10.132.0.47:15021/healthz/ready": dial tcp 10.132.0.47:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w0-390abc-openshift-default-8647c4bc56-tjhbb

ProbeError

Startup probe error: Get "http://10.132.0.46:15021/healthz/ready": dial tcp 10.132.0.46:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w0-390abc-openshift-default-8647c4bc56-tjhbb

Unhealthy

Startup probe failed: Get "http://10.132.0.46:15021/healthz/ready": dial tcp 10.132.0.46:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-autores-66cedd-openshift-default-66bbb95fb6-rv5zk

Started

Started container istio-proxy

openshift-ingress

deployment-controller

e2e-inf-b-da0a18-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-da0a18-openshift-default-75799b96b from 0 to 1

openshift-ingress

multus

e2e-inf-b-da0a18-openshift-default-75799b96b-bjpl5

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-inf-b-da0a18-openshift-default-75799b96b

SuccessfulCreate

Created pod: e2e-inf-b-da0a18-openshift-default-75799b96b-bjpl5
(x2)

openshift-ingress

kubelet

e2e-autores-66cedd-openshift-default-66bbb95fb6-rv5zk

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-66cedd-openshift-default-66bbb95fb6-rv5zk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

gateway_labeler_controller

e2e-inf-b-da0a18

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-da0a18
(x2)

openshift-ingress

kubelet

e2e-ait-04d63732-openshift-default-5455bb5f4b-gkmgg

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-04d63732-openshift-default-5455bb5f4b-gkmgg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-04d63732-openshift-default-5455bb5f4b-gkmgg

Created

Created container: istio-proxy

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-da0a18-6fc78c9597

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-da0a18-6fc78c9597-27mdl
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-da0a18-6fc78c9597

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-da0a18-6fc78c9597-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-da0a18: serviceaccount "payload-processing-e2e-inf-b-da0a18" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-da0a18-5bf6777478

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-da0a18-5bf6777478-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-da0a18: serviceaccount "payload-processing-e2e-inf-b-da0a18" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-da0a18-5bf6777478

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-da0a18-5bf6777478-g5mqw

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-da0a18

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-da0a18-5bf6777478 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-da0a18

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-da0a18-6fc78c9597 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-da0a18-5bf6777478-g5mqw

AddedInterface

Add eth0 [10.133.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-da0a18-5bf6777478-g5mqw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-da0a18-5bf6777478-g5mqw

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-da0a18-5bf6777478-g5mqw

Started

Started container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-autores-66cedd-openshift-default-66bbb95fb6-rv5zk

Unhealthy

Startup probe failed: Get "http://10.132.0.51:15021/healthz/ready": dial tcp 10.132.0.51:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-inf-b-da0a18-6fc78c9597-27mdl

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-inf-b-da0a18-6fc78c9597-27mdl

AddedInterface

Add eth0 [10.133.0.50/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-autores-66cedd-openshift-default-66bbb95fb6-rv5zk

ProbeError

Startup probe error: Get "http://10.132.0.51:15021/healthz/ready": dial tcp 10.132.0.51:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-inf-b-da0a18-6fc78c9597-27mdl

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-da0a18-6fc78c9597-27mdl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ait-04d63732-openshift-default-5455bb5f4b-gkmgg

Unhealthy

Startup probe failed: Get "http://10.132.0.52:15021/healthz/ready": dial tcp 10.132.0.52:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-04d63732-openshift-default-5455bb5f4b-gkmgg

ProbeError

Startup probe error: Get "http://10.132.0.52:15021/healthz/ready": dial tcp 10.132.0.52:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ait-04d63732-openshift-default-5455bb5f4b-gkmgg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-04d63732-8865dc7c8-c6kvq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-04d63732-5d467bccd9-pxkkm

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-migrate-98c7fb47-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-98c7fb47-gw

openshift-ingress

kubelet

e2e-ait-04d63732-openshift-default-5455bb5f4b-gkmgg

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

e2e-migrate-98c7fb47-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-98c7fb47-gw-openshift-default-7d98597448 from 0 to 1

openshift-ingress

kubelet

e2e-ait-04d63732-openshift-default-5455bb5f4b-gkmgg

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

e2e-migrate-98c7fb47-gw-openshift-default-7d98597448

SuccessfulCreate

Created pod: e2e-migrate-98c7fb47-gw-openshift-default-7d98597448-q876t
(x2)

openshift-ingress

kubelet

e2e-inf-b-da0a18-openshift-default-75799b96b-bjpl5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-da0a18-openshift-default-75799b96b-bjpl5

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-da0a18-openshift-default-75799b96b-bjpl5

Started

Started container istio-proxy

openshift-ingress

multus

e2e-migrate-98c7fb47-gw-openshift-default-7d98597448-q876t

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-98c7fb47-549cbfd9d6

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-98c7fb47-549cbfd9d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-98c7fb47: serviceaccount "payload-processing-e2e-migrate-98c7fb47" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-98c7fb47

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-98c7fb47-d7cccc7db from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-98c7fb47

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-98c7fb47-549cbfd9d6 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-98c7fb47-d7cccc7db-mp8xv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-migrate-98c7fb47-549cbfd9d6-rlwr9

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-98c7fb47-549cbfd9d6-rlwr9

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-98c7fb47-549cbfd9d6-rlwr9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-migrate-98c7fb47-549cbfd9d6-rlwr9

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-98c7fb47-d7cccc7db-mp8xv

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-98c7fb47-d7cccc7db-mp8xv

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-migrate-98c7fb47-d7cccc7db-mp8xv

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-98c7fb47-d7cccc7db

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-98c7fb47-d7cccc7db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-98c7fb47: serviceaccount "payload-processing-e2e-migrate-98c7fb47" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-98c7fb47-d7cccc7db

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-98c7fb47-d7cccc7db-mp8xv

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-98c7fb47-549cbfd9d6

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-98c7fb47-549cbfd9d6-rlwr9
(x6)

openshift-ingress

kubelet

e2e-inf-b-da0a18-openshift-default-75799b96b-bjpl5

ProbeError

Startup probe error: Get "http://10.132.0.53:15021/healthz/ready": dial tcp 10.132.0.53:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-b-da0a18-openshift-default-75799b96b-bjpl5

Unhealthy

Startup probe failed: Get "http://10.132.0.53:15021/healthz/ready": dial tcp 10.132.0.53:15021: connect: connection refused

openshift-ingress

kubelet

e2e-migrate-98c7fb47-gw-openshift-default-7d98597448-q876t

ProbeError

Readiness probe error: Get "http://10.132.0.54:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-migrate-98c7fb47-gw-openshift-default-7d98597448-q876t

Unhealthy

Readiness probe failed: Get "http://10.132.0.54:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-migrate-98c7fb47-gw-openshift-default-7d98597448-q876t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-98c7fb47-gw-openshift-default-7d98597448-q876t

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-98c7fb47-gw-openshift-default-7d98597448-q876t

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-migrate-98c7fb47-gw-openshift-default-7d98597448-q876t

ProbeError

Startup probe error: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-migrate-98c7fb47-gw-openshift-default-7d98597448-q876t

Unhealthy

Startup probe failed: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused

openshift-ingress

kubelet

e2e-migrate-98c7fb47-gw-openshift-default-7d98597448-q876t

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-98c7fb47-d7cccc7db-mp8xv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-98c7fb47-549cbfd9d6-rlwr9

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

e2e-ait-b27eb4af-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-b27eb4af-openshift-default-978c8d498 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-b27eb4af

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-b27eb4af

openshift-ingress

replicaset-controller

e2e-ait-b27eb4af-openshift-default-978c8d498

SuccessfulCreate

Created pod: e2e-ait-b27eb4af-openshift-default-978c8d498-sh9vj

openshift-ingress

multus

e2e-ait-b27eb4af-openshift-default-978c8d498-sh9vj

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-b27eb4af-676599659d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-b27eb4af-676599659d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-b27eb4af: serviceaccount "payload-processing-e2e-ait-b27eb4af" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-b27eb4af

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-b27eb4af-7676cd8bdf from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-b27eb4af

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-b27eb4af-676599659d from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-b27eb4af-7676cd8bdf

FailedCreate

Error creating: pods "payload-processing-e2e-ait-b27eb4af-7676cd8bdf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-b27eb4af: serviceaccount "payload-processing-e2e-ait-b27eb4af" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-b27eb4af-676599659d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-b27eb4af-676599659d-zwx95

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-b27eb4af-676599659d-zwx95

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-b27eb4af-7676cd8bdf-jkphd

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-b27eb4af-676599659d-zwx95

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-b27eb4af-7676cd8bdf-jkphd

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-b27eb4af-7676cd8bdf-jkphd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-b27eb4af-7676cd8bdf-jkphd

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-b27eb4af-7676cd8bdf

SuccessfulCreate

Created pod: payload-processing-e2e-ait-b27eb4af-7676cd8bdf-jkphd

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-b27eb4af-676599659d-zwx95

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-b27eb4af-676599659d-zwx95

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ait-b27eb4af-openshift-default-978c8d498-sh9vj

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-b27eb4af-openshift-default-978c8d498-sh9vj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-b27eb4af-openshift-default-978c8d498-sh9vj

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-ait-b27eb4af-openshift-default-978c8d498-sh9vj

Unhealthy

Startup probe failed: Get "http://10.132.0.55:15021/healthz/ready": dial tcp 10.132.0.55:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ait-b27eb4af-openshift-default-978c8d498-sh9vj

ProbeError

Startup probe error: Get "http://10.132.0.55:15021/healthz/ready": dial tcp 10.132.0.55:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-b27eb4af-676599659d-zwx95

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-b27eb4af-7676cd8bdf-jkphd

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-derive-ef9b2234

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-ef9b2234

openshift-ingress

kubelet

e2e-ait-b27eb4af-openshift-default-978c8d498-sh9vj

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-derive-ef9b2234-openshift-default-78cff6548d-gdb5d

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-derive-ef9b2234-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-ef9b2234-openshift-default-78cff6548d from 0 to 1

openshift-ingress

replicaset-controller

e2e-derive-ef9b2234-openshift-default-78cff6548d

SuccessfulCreate

Created pod: e2e-derive-ef9b2234-openshift-default-78cff6548d-gdb5d

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-ef9b2234

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-ef9b2234-85f8b7bf86 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-ef9b2234-85f8b7bf86

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-ef9b2234-85f8b7bf86-nh2cp

openshift-ingress

deployment-controller

payload-processing-e2e-derive-ef9b2234

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-ef9b2234-6d4b9747c7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-ef9b2234-6d4b9747c7

SuccessfulCreate

Created pod: payload-processing-e2e-derive-ef9b2234-6d4b9747c7-q6hq8
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-ef9b2234-6d4b9747c7

FailedCreate

Error creating: pods "payload-processing-e2e-derive-ef9b2234-6d4b9747c7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-ef9b2234: serviceaccount "payload-processing-e2e-derive-ef9b2234" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-ef9b2234-85f8b7bf86

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-ef9b2234-85f8b7bf86-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-ef9b2234: serviceaccount "payload-processing-e2e-derive-ef9b2234" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-ef9b2234-85f8b7bf86-nh2cp

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-ef9b2234-85f8b7bf86-nh2cp

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-ef9b2234-6d4b9747c7-q6hq8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-derive-ef9b2234-6d4b9747c7-q6hq8

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-ef9b2234-85f8b7bf86-nh2cp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-derive-ef9b2234-85f8b7bf86-nh2cp

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-ef9b2234-6d4b9747c7-q6hq8

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-derive-ef9b2234-6d4b9747c7-q6hq8

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-derive-ef9b2234-openshift-default-78cff6548d-gdb5d

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-ef9b2234-openshift-default-78cff6548d-gdb5d

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-ef9b2234-openshift-default-78cff6548d-gdb5d

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-derive-ef9b2234-openshift-default-78cff6548d-gdb5d

Unhealthy

Startup probe failed: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-derive-ef9b2234-openshift-default-78cff6548d-gdb5d

ProbeError

Startup probe error: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-derive-ef9b2234-6d4b9747c7-q6hq8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-ef9b2234-85f8b7bf86-nh2cp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-ef9b2234-openshift-default-78cff6548d-gdb5d

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-66cedd-74bccd9db-bhprn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-66cedd-7676d8b945-jrxxs

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-autores-66cedd-openshift-default-66bbb95fb6-rv5zk

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-explicit-331c9d-openshift-default-85f6c79d6d

SuccessfulCreate

Created pod: e2e-explicit-331c9d-openshift-default-85f6c79d6d-hjzb9

openshift-ingress

deployment-controller

e2e-explicit-331c9d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-331c9d-openshift-default-85f6c79d6d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-explicit-331c9d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-331c9d

openshift-ingress

multus

e2e-explicit-331c9d-openshift-default-85f6c79d6d-hjzb9

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-331c9d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-331c9d-64f4495494 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-331c9d-64f4495494

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-331c9d-64f4495494-qxll2

openshift-ingress

multus

payload-processing-e2e-explicit-331c9d-b5d7767c-mmtf5

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-331c9d-b5d7767c-mmtf5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-331c9d-64f4495494

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-331c9d-64f4495494-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-331c9d: serviceaccount "payload-processing-e2e-explicit-331c9d" not found

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-331c9d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-331c9d-b5d7767c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-331c9d-b5d7767c

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-331c9d-b5d7767c-mmtf5
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-331c9d-b5d7767c

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-331c9d-b5d7767c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-331c9d: serviceaccount "payload-processing-e2e-explicit-331c9d" not found

openshift-ingress

multus

payload-pre-processing-e2e-explicit-331c9d-64f4495494-qxll2

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-331c9d-64f4495494-qxll2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-explicit-331c9d-b5d7767c-mmtf5

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-331c9d-b5d7767c-mmtf5

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-331c9d-64f4495494-qxll2

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-331c9d-64f4495494-qxll2

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-explicit-331c9d-openshift-default-85f6c79d6d-hjzb9

Unhealthy

Readiness probe failed: Get "http://10.132.0.58:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-explicit-331c9d-openshift-default-85f6c79d6d-hjzb9

ProbeError

Readiness probe error: Get "http://10.132.0.58:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-explicit-331c9d-openshift-default-85f6c79d6d-hjzb9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-331c9d-openshift-default-85f6c79d6d-hjzb9

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-331c9d-openshift-default-85f6c79d6d-hjzb9

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-explicit-331c9d-openshift-default-85f6c79d6d-hjzb9

ProbeError

Startup probe error: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-explicit-331c9d-openshift-default-85f6c79d6d-hjzb9

Unhealthy

Startup probe failed: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-mt-65d42a05

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-65d42a05

openshift-ingress

deployment-controller

e2e-mt-65d42a05-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-65d42a05-openshift-default-657799b5b4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-65d42a05-openshift-default-657799b5b4

SuccessfulCreate

Created pod: e2e-mt-65d42a05-openshift-default-657799b5b4-7rmn5

openshift-ingress

multus

e2e-mt-65d42a05-openshift-default-657799b5b4-7rmn5

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-mt-65d42a05

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-65d42a05-5b84498bf7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-65d42a05-5b84498bf7

SuccessfulCreate

Created pod: payload-processing-e2e-mt-65d42a05-5b84498bf7-9n2bh
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-65d42a05-5b84498bf7

FailedCreate

Error creating: pods "payload-processing-e2e-mt-65d42a05-5b84498bf7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-65d42a05: serviceaccount "payload-processing-e2e-mt-65d42a05" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-65d42a05-966449566

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-65d42a05-966449566-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-65d42a05: serviceaccount "payload-processing-e2e-mt-65d42a05" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-65d42a05-966449566

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-65d42a05-966449566-9mfd5

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-65d42a05

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-65d42a05-966449566 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-mt-65d42a05-5b84498bf7-9n2bh

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-65d42a05-5b84498bf7-9n2bh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-65d42a05-5b84498bf7-9n2bh

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-65d42a05-966449566-9mfd5

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-65d42a05-966449566-9mfd5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-65d42a05-5b84498bf7-9n2bh

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-65d42a05-966449566-9mfd5

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-65d42a05-966449566-9mfd5

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-mt-65d42a05-openshift-default-657799b5b4-7rmn5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-65d42a05-openshift-default-657799b5b4-7rmn5

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-65d42a05-openshift-default-657799b5b4-7rmn5

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-mt-65d42a05-openshift-default-657799b5b4-7rmn5

ProbeError

Startup probe error: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-65d42a05-openshift-default-657799b5b4-7rmn5

Unhealthy

Startup probe failed: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-65d42a05-966449566-9mfd5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-65d42a05-5b84498bf7-9n2bh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-65d42a05-openshift-default-657799b5b4-7rmn5

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-shared-a-w2-d99c83-openshift-default-77cb785cc4-8pzjg

AddedInterface

Add eth0 [10.132.0.62/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-d99c83

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-d99c83

openshift-ingress

replicaset-controller

e2e-shared-a-w2-d99c83-openshift-default-77cb785cc4

SuccessfulCreate

Created pod: e2e-shared-a-w2-d99c83-openshift-default-77cb785cc4-8pzjg

openshift-ingress

deployment-controller

e2e-shared-a-w2-d99c83-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-d99c83-openshift-default-77cb785cc4 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-d99c83

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-d99c83-86bf9975d9 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-d99c83-86bf9975d9

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-d99c83-86bf9975d9-8cnl2
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-d99c83-86bf9975d9

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-d99c83-86bf9975d9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-d99c83: serviceaccount "payload-processing-e2e-shared-a-w2-d99c83" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-d99c83-6988bf498

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-d99c83-6988bf498-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-d99c83: serviceaccount "payload-processing-e2e-shared-a-w2-d99c83" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-d99c83-6988bf498

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-d99c83-6988bf498-v2dqf

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-d99c83

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-d99c83-6988bf498 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-d99c83-86bf9975d9-8cnl2

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-d99c83-86bf9975d9-8cnl2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-d99c83-86bf9975d9-8cnl2

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-d99c83-86bf9975d9-8cnl2

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-d99c83-6988bf498-v2dqf

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-d99c83-6988bf498-v2dqf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-d99c83-6988bf498-v2dqf

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-d99c83-6988bf498-v2dqf

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-d99c83-openshift-default-77cb785cc4-8pzjg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-d99c83-openshift-default-77cb785cc4-8pzjg

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-d99c83-openshift-default-77cb785cc4-8pzjg

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-d99c83-openshift-default-77cb785cc4-8pzjg

Unhealthy

Startup probe failed: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-d99c83-openshift-default-77cb785cc4-8pzjg

ProbeError

Startup probe error: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-shared-b-w2-9e275c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-9e275c-openshift-default-56594987bb from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-9e275c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-9e275c

openshift-ingress

replicaset-controller

e2e-shared-b-w2-9e275c-openshift-default-56594987bb

SuccessfulCreate

Created pod: e2e-shared-b-w2-9e275c-openshift-default-56594987bb-vfrx4

openshift-ingress

multus

e2e-shared-b-w2-9e275c-openshift-default-56594987bb-vfrx4

AddedInterface

Add eth0 [10.132.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-331c9d-b5d7767c-mmtf5

Unhealthy

Readiness probe failed: dial tcp 10.134.0.48:9004: connect: connection refused

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-explicit-331c9d

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-explicit-331c9d: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-explicit-331c9d": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-explicit-331c9d, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 6d632680-b9ae-4d55-8c6f-4995dbbdfd5f, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-331c9d-64f4495494-qxll2

Unhealthy

Readiness probe failed: dial tcp 10.134.0.49:9004: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-explicit-331c9d-b5d7767c-mmtf5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-331c9d-64f4495494-qxll2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-9e275c-7994c94758-9ksr2

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-9e275c-64575c7d97-ttmb9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-9e275c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-9e275c-64575c7d97 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-9e275c-64575c7d97

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-9e275c-64575c7d97-ttmb9
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-9e275c-64575c7d97

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-9e275c-64575c7d97-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-9e275c: serviceaccount "payload-processing-e2e-shared-b-w2-9e275c" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-9e275c-7994c94758-9ksr2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-9e275c-64575c7d97-ttmb9

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-9e275c-7994c94758-9ksr2

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-9e275c-64575c7d97-ttmb9

Created

Created container: payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-9e275c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-9e275c-7994c94758 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-9e275c-64575c7d97-ttmb9

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-9e275c-7994c94758

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-9e275c-7994c94758-9ksr2
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-9e275c-7994c94758

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-9e275c-7994c94758-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-9e275c: serviceaccount "payload-processing-e2e-shared-b-w2-9e275c" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-9e275c-7994c94758-9ksr2

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-9e275c-openshift-default-56594987bb-vfrx4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-9e275c-openshift-default-56594987bb-vfrx4

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-9e275c-openshift-default-56594987bb-vfrx4

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-9e275c-openshift-default-56594987bb-vfrx4

Unhealthy

Startup probe failed: Get "http://10.132.0.64:15021/healthz/ready": dial tcp 10.132.0.64:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-9e275c-openshift-default-56594987bb-vfrx4

ProbeError

Startup probe error: Get "http://10.132.0.64:15021/healthz/ready": dial tcp 10.132.0.64:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-mt-4883373b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-4883373b-openshift-default-56585b57fb from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-4883373b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-4883373b

openshift-ingress

multus

e2e-mt-4883373b-openshift-default-56585b57fb-k2q5r

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-mt-4883373b-openshift-default-56585b57fb

SuccessfulCreate

Created pod: e2e-mt-4883373b-openshift-default-56585b57fb-k2q5r

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-4883373b-7cfd55c54f

SuccessfulCreate

Created pod: payload-processing-e2e-mt-4883373b-7cfd55c54f-rqfkp

openshift-ingress

deployment-controller

payload-processing-e2e-mt-4883373b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-4883373b-7cfd55c54f from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-4883373b-77b9d687bb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-4883373b-77b9d687bb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-4883373b: serviceaccount "payload-processing-e2e-mt-4883373b" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-4883373b-77b9d687bb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-4883373b-77b9d687bb-lwlzx

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-4883373b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-4883373b-77b9d687bb from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-4883373b-77b9d687bb-lwlzx

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-4883373b-77b9d687bb-lwlzx

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-4883373b-77b9d687bb-lwlzx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-mt-4883373b-77b9d687bb-lwlzx

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-4883373b-7cfd55c54f

FailedCreate

Error creating: pods "payload-processing-e2e-mt-4883373b-7cfd55c54f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-4883373b: serviceaccount "payload-processing-e2e-mt-4883373b" not found

openshift-ingress

multus

payload-processing-e2e-mt-4883373b-7cfd55c54f-rqfkp

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-4883373b-7cfd55c54f-rqfkp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-4883373b-7cfd55c54f-rqfkp

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-4883373b-7cfd55c54f-rqfkp

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-explicit-331c9d-openshift-default-85f6c79d6d-hjzb9

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-noten-749a53

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-749a53

openshift-ingress

deployment-controller

e2e-noten-749a53-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-749a53-openshift-default-7c4cbc8bb6 from 0 to 1

openshift-ingress

replicaset-controller

e2e-noten-749a53-openshift-default-7c4cbc8bb6

SuccessfulCreate

Created pod: e2e-noten-749a53-openshift-default-7c4cbc8bb6-h2hgq

openshift-ingress

kubelet

e2e-noten-749a53-openshift-default-7c4cbc8bb6-h2hgq

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-noten-749a53-openshift-default-7c4cbc8bb6-h2hgq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

multus

e2e-noten-749a53-openshift-default-7c4cbc8bb6-h2hgq

AddedInterface

Add eth0 [10.132.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-749a53-openshift-default-7c4cbc8bb6-h2hgq

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-noten-749a53-openshift-default-7c4cbc8bb6-h2hgq

Unhealthy

Startup probe failed: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused

openshift-ingress

kubelet

e2e-noten-749a53-openshift-default-7c4cbc8bb6-h2hgq

ProbeError

Startup probe error: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-mt-4883373b-openshift-default-56585b57fb-k2q5r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-4883373b-openshift-default-56585b57fb-k2q5r

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-4883373b-openshift-default-56585b57fb-k2q5r

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-4883373b-openshift-default-56585b57fb-k2q5r

Unhealthy

Startup probe failed: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-4883373b-openshift-default-56585b57fb-k2q5r

ProbeError

Startup probe error: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-2aaab1-c64d77d5d-9vv8g

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-2aaab1-68b5dd8b7c-xqvkg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-a-2aaab1-openshift-default-59c66c6874-ztrkq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-2aaab1-openshift-default-59c66c6874-ztrkq

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-a-2aaab1-openshift-default-59c66c6874-ztrkq

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-da0a18-5bf6777478-g5mqw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-da0a18-6fc78c9597-27mdl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-noten-749a53-openshift-default-7c4cbc8bb6-h2hgq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-da0a18-openshift-default-75799b96b-bjpl5

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-w3-2d3bc8-openshift-default-7744dd8884

SuccessfulCreate

Created pod: e2e-shared-a-w3-2d3bc8-openshift-default-7744dd8884-zlh6r

openshift-ingress

deployment-controller

e2e-shared-a-w3-2d3bc8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-2d3bc8-openshift-default-7744dd8884 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-2d3bc8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-2d3bc8

openshift-ingress

multus

e2e-shared-a-w3-2d3bc8-openshift-default-7744dd8884-zlh6r

AddedInterface

Add eth0 [10.132.0.73/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-2d3bc8-54b8c58546

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-2d3bc8-54b8c58546-l2vl6
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-2d3bc8-c768b769f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-2d3bc8-c768b769f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-2d3bc8: serviceaccount "payload-processing-e2e-shared-a-w3-2d3bc8" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-2d3bc8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-2d3bc8-54b8c58546 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-2d3bc8-c768b769f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-2d3bc8-c768b769f-8t5xb

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-2d3bc8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-2d3bc8-c768b769f from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-2d3bc8-54b8c58546

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-2d3bc8-54b8c58546-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-2d3bc8: serviceaccount "payload-processing-e2e-shared-a-w3-2d3bc8" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-2d3bc8-54b8c58546-l2vl6

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-2d3bc8-54b8c58546-l2vl6

AddedInterface

Add eth0 [10.133.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-2d3bc8-c768b769f-8t5xb

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-2d3bc8-54b8c58546-l2vl6

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-2d3bc8-c768b769f-8t5xb

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-2d3bc8-54b8c58546-l2vl6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-2d3bc8-c768b769f-8t5xb

AddedInterface

Add eth0 [10.133.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-2d3bc8-c768b769f-8t5xb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-2d3bc8-openshift-default-7744dd8884-zlh6r

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-2d3bc8-openshift-default-7744dd8884-zlh6r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-2d3bc8-openshift-default-7744dd8884-zlh6r

Started

Started container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-b-w3-64fec6-openshift-default-798455f9fd

SuccessfulCreate

Created pod: e2e-shared-b-w3-64fec6-openshift-default-798455f9fd-fl9b2

openshift-ingress

deployment-controller

e2e-shared-b-w3-64fec6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-64fec6-openshift-default-798455f9fd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-64fec6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-64fec6

openshift-ingress

multus

e2e-shared-b-w3-64fec6-openshift-default-798455f9fd-fl9b2

AddedInterface

Add eth0 [10.132.0.75/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-2d3bc8-openshift-default-7744dd8884-zlh6r

ProbeError

Startup probe error: Get "http://10.132.0.73:15021/healthz/ready": dial tcp 10.132.0.73:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-2d3bc8-openshift-default-7744dd8884-zlh6r

Unhealthy

Startup probe failed: Get "http://10.132.0.73:15021/healthz/ready": dial tcp 10.132.0.73:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-64fec6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-64fec6-84dff8b554 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-64fec6-866767cccc

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-64fec6-866767cccc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-64fec6: serviceaccount "payload-processing-e2e-shared-b-w3-64fec6" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-64fec6-84dff8b554

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-64fec6-84dff8b554-kpb64

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-64fec6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-64fec6-866767cccc from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-64fec6-84dff8b554

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-64fec6-84dff8b554-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-64fec6: serviceaccount "payload-processing-e2e-shared-b-w3-64fec6" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-64fec6-84dff8b554-kpb64

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-64fec6-866767cccc

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-64fec6-866767cccc-szm94

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-64fec6-866767cccc-szm94

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-64fec6-866767cccc-szm94

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-64fec6-866767cccc-szm94

AddedInterface

Add eth0 [10.133.0.78/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-64fec6-84dff8b554-kpb64

AddedInterface

Add eth0 [10.133.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-64fec6-84dff8b554-kpb64

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-64fec6-84dff8b554-kpb64

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-64fec6-866767cccc-szm94

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-4883373b-77b9d687bb-lwlzx

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-mt-4883373b

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-mt-4883373b: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-mt-4883373b": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-mt-4883373b, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 995d0b5e-e065-4b54-b43e-fb4a0ba04819, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-mt-4883373b-7cfd55c54f-rqfkp

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-64fec6-openshift-default-798455f9fd-fl9b2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-64fec6-openshift-default-798455f9fd-fl9b2

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-64fec6-openshift-default-798455f9fd-fl9b2

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-64fec6-openshift-default-798455f9fd-fl9b2

ProbeError

Startup probe error: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-64fec6-openshift-default-798455f9fd-fl9b2

Unhealthy

Startup probe failed: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused

openshift-ingress

kubelet

e2e-mt-4883373b-openshift-default-56585b57fb-k2q5r

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-4883373b-openshift-default-56585b57fb-k2q5r

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-4883373b-openshift-default-56585b57fb-k2q5r

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

gateway_labeler_controller

e2e-api-a-5d8401

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-5d8401

openshift-ingress

deployment-controller

e2e-api-a-5d8401-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-5d8401-openshift-default-6b7665bfd8 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-5d8401-openshift-default-6b7665bfd8

SuccessfulCreate

Created pod: e2e-api-a-5d8401-openshift-default-6b7665bfd8-wbbs4

openshift-ingress

multus

e2e-api-a-5d8401-openshift-default-6b7665bfd8-wbbs4

AddedInterface

Add eth0 [10.132.0.78/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-5d8401

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-5d8401-559dd65bf8 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-5d8401

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-5d8401-76887ccf55 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-5d8401-76887ccf55

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-5d8401-76887ccf55-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-5d8401: serviceaccount "payload-processing-e2e-api-a-5d8401" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-5d8401-559dd65bf8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-5d8401-559dd65bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-5d8401: serviceaccount "payload-processing-e2e-api-a-5d8401" not found

openshift-ingress

multus

payload-pre-processing-e2e-api-a-5d8401-559dd65bf8-524vr

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-5d8401-559dd65bf8-524vr

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-5d8401-559dd65bf8-524vr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-a-5d8401-76887ccf55-vslsg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-5d8401-559dd65bf8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-5d8401-559dd65bf8-524vr

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-5d8401-559dd65bf8-524vr

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-5d8401-76887ccf55-vslsg

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-api-a-5d8401-76887ccf55-vslsg

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-5d8401-76887ccf55-vslsg

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-5d8401-76887ccf55

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-5d8401-76887ccf55-vslsg

openshift-ingress

deployment-controller

e2e-api-b-9dedad-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-9dedad-openshift-default-ccb56564 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-9dedad

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-9dedad

openshift-ingress

replicaset-controller

e2e-api-b-9dedad-openshift-default-ccb56564

SuccessfulCreate

Created pod: e2e-api-b-9dedad-openshift-default-ccb56564-mppvx

openshift-ingress

multus

e2e-api-b-9dedad-openshift-default-ccb56564-mppvx

AddedInterface

Add eth0 [10.132.0.80/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-9dedad

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-9dedad-7d6b486d87 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-9dedad-d569b978-vnq65

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-9dedad-d569b978-vnq65

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-9dedad-7d6b486d87-n4sk8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-b-9dedad-7d6b486d87-n4sk8

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-9dedad-7d6b486d87-n4sk8

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-9dedad-d569b978

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-9dedad-d569b978-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-9dedad: serviceaccount "payload-processing-e2e-api-b-9dedad" not found

openshift-ingress

multus

payload-pre-processing-e2e-api-b-9dedad-d569b978-vnq65

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-9dedad

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-9dedad-d569b978 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-9dedad-d569b978

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-9dedad-d569b978-vnq65

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-9dedad-7d6b486d87

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-9dedad-7d6b486d87-n4sk8
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-9dedad-7d6b486d87

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-9dedad-7d6b486d87-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-9dedad: serviceaccount "payload-processing-e2e-api-b-9dedad" not found

openshift-ingress

multus

payload-processing-e2e-api-b-9dedad-7d6b486d87-n4sk8

AddedInterface

Add eth0 [10.133.0.81/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-9dedad-d569b978-vnq65

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-api-b-9dedad-openshift-default-ccb56564-mppvx

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-5d8401-openshift-default-6b7665bfd8-wbbs4

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-5d8401-openshift-default-6b7665bfd8-wbbs4

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-5d8401-openshift-default-6b7665bfd8-wbbs4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-9dedad-openshift-default-ccb56564-mppvx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-9dedad-openshift-default-ccb56564-mppvx

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-b-9dedad-openshift-default-ccb56564-mppvx

Unhealthy

Startup probe failed: Get "http://10.132.0.80:15021/healthz/ready": dial tcp 10.132.0.80:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-b-9dedad-openshift-default-ccb56564-mppvx

ProbeError

Startup probe error: Get "http://10.132.0.80:15021/healthz/ready": dial tcp 10.132.0.80:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-a-5d8401-openshift-default-6b7665bfd8-wbbs4

ProbeError

Startup probe error: Get "http://10.132.0.78:15021/healthz/ready": dial tcp 10.132.0.78:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-a-5d8401-openshift-default-6b7665bfd8-wbbs4

Unhealthy

Startup probe failed: Get "http://10.132.0.78:15021/healthz/ready": dial tcp 10.132.0.78:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-390abc-57cfb4f7f8-2hdvj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-390abc-59b465557f-nvtg4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-5d8401-76887ccf55-vslsg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-5d8401-559dd65bf8-524vr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w0-390abc-openshift-default-8647c4bc56-tjhbb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-5d8401-openshift-default-6b7665bfd8-wbbs4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-api-b-9dedad-7d6b486d87-n4sk8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-9dedad-d569b978-vnq65

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-api-b-9dedad

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-api-b-9dedad: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-api-b-9dedad": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-api-b-9dedad, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: f66f4ffb-2c4f-4d0b-aa77-cdf9eabd46af, UID in object meta:

openshift-ingress

kubelet

e2e-api-b-9dedad-openshift-default-ccb56564-mppvx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-9dedad-openshift-default-ccb56564-mppvx

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-b-9dedad-openshift-default-ccb56564-mppvx

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-d99c83-6988bf498-v2dqf

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-a-w2-d99c83

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-a-w2-d99c83: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-a-w2-d99c83": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-a-w2-d99c83, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 9cbc865e-a5bb-4d54-a419-dfc122847b1b, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-d99c83-86bf9975d9-8cnl2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w2-d99c83-openshift-default-77cb785cc4-8pzjg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-9e275c-7994c94758-9ksr2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-9e275c-64575c7d97-ttmb9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w2-9e275c-openshift-default-56594987bb-vfrx4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-9e275c-openshift-default-56594987bb-vfrx4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w2-9e275c-openshift-default-56594987bb-vfrx4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-3fa986-5869fb8cd-tzl7c

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-3fa986-7767558c7c-vstt2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w4-3fa986-openshift-default-d7f4fdfd6-n8f7m

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-3fa986-openshift-default-d7f4fdfd6-n8f7m

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w4-3fa986-openshift-default-d7f4fdfd6-n8f7m

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

GatewayAuthBootstrap

e2e-ipp-a-100032

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-ipp-a-100032-authn-ssl: envoyfilters.networking.istio.io "e2e-ipp-a-100032-authn-ssl" already exists

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-100032

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-100032

openshift-ingress

deployment-controller

e2e-ipp-a-100032-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-100032-openshift-default-5b4c44ffd from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-100032-openshift-default-5b4c44ffd

SuccessfulCreate

Created pod: e2e-ipp-a-100032-openshift-default-5b4c44ffd-tp4d8

openshift-ingress

multus

e2e-ipp-a-100032-openshift-default-5b4c44ffd-tp4d8

AddedInterface

Add eth0 [10.132.0.87/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-100032

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-100032-6d8467f586 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-100032-847c459c7c

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-100032-847c459c7c-v2t42

openshift-ingress

multus

payload-processing-e2e-ipp-a-100032-847c459c7c-v2t42

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-100032-847c459c7c-v2t42

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-100032-6d8467f586

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-100032-6d8467f586-g45qb
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-100032-6d8467f586

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-100032-6d8467f586-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-100032: serviceaccount "payload-processing-e2e-ipp-a-100032" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-100032-847c459c7c-v2t42

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-100032-6d8467f586-g45qb

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-100032-6d8467f586-g45qb

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-100032-847c459c7c-v2t42

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-100032-6d8467f586-g45qb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-100032-847c459c7c

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-100032-847c459c7c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-100032: serviceaccount "payload-processing-e2e-ipp-a-100032" not found

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-100032-6d8467f586-g45qb

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-100032

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-100032-847c459c7c from 0 to 1

openshift-ingress

kubelet

e2e-ipp-a-100032-openshift-default-5b4c44ffd-tp4d8

Unhealthy

Readiness probe failed: Get "http://10.132.0.87:15021/healthz/ready": dial tcp 10.132.0.87:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-ipp-a-100032-openshift-default-5b4c44ffd-tp4d8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-100032-openshift-default-5b4c44ffd-tp4d8

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-100032-openshift-default-5b4c44ffd-tp4d8

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-100032-openshift-default-5b4c44ffd-tp4d8

ProbeError

Readiness probe error: Get "http://10.132.0.87:15021/healthz/ready": dial tcp 10.132.0.87:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-100032-openshift-default-5b4c44ffd-tp4d8

Unhealthy

Startup probe failed: Get "http://10.132.0.87:15021/healthz/ready": dial tcp 10.132.0.87:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-100032-openshift-default-5b4c44ffd-tp4d8

ProbeError

Startup probe error: Get "http://10.132.0.87:15021/healthz/ready": dial tcp 10.132.0.87:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-855e86

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-855e86

openshift-ingress

multus

e2e-ipp-b-855e86-openshift-default-787f847fc8-vggg5

AddedInterface

Add eth0 [10.132.0.88/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ipp-b-855e86-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-855e86-openshift-default-787f847fc8 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-855e86-openshift-default-787f847fc8

SuccessfulCreate

Created pod: e2e-ipp-b-855e86-openshift-default-787f847fc8-vggg5
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-855e86-5879d78cd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-855e86-5879d78cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-855e86: serviceaccount "payload-processing-e2e-ipp-b-855e86" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-855e86-546d9bc677

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-855e86-546d9bc677-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-855e86: serviceaccount "payload-processing-e2e-ipp-b-855e86" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-855e86-5879d78cd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-855e86-5879d78cd-hcqzh

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-855e86

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-855e86-546d9bc677 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-855e86

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-855e86-5879d78cd from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-855e86-546d9bc677

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-855e86-546d9bc677-s6lxc

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-855e86-546d9bc677-s6lxc

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-855e86-5879d78cd-hcqzh

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-855e86-5879d78cd-hcqzh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-855e86-5879d78cd-hcqzh

AddedInterface

Add eth0 [10.134.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-855e86-5879d78cd-hcqzh

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-855e86-546d9bc677-s6lxc

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-855e86-546d9bc677-s6lxc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-b-855e86-546d9bc677-s6lxc

AddedInterface

Add eth0 [10.134.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-b-855e86-openshift-default-787f847fc8-vggg5

ProbeError

Readiness probe error: Get "http://10.132.0.88:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-b-855e86-openshift-default-787f847fc8-vggg5

Unhealthy

Readiness probe failed: Get "http://10.132.0.88:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ipp-b-855e86-openshift-default-787f847fc8-vggg5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-855e86-openshift-default-787f847fc8-vggg5

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-855e86-openshift-default-787f847fc8-vggg5

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-b-855e86-openshift-default-787f847fc8-vggg5

ProbeError

Startup probe error: Get "http://10.132.0.88:15021/healthz/ready": dial tcp 10.132.0.88:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-b-855e86-openshift-default-787f847fc8-vggg5

Unhealthy

Startup probe failed: Get "http://10.132.0.88:15021/healthz/ready": dial tcp 10.132.0.88:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-bcb351

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-bcb351

openshift-ingress

deployment-controller

e2e-ipp-cleanup-bcb351-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-bcb351-openshift-default-6586f4bc6d from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-bcb351-openshift-default-6586f4bc6d

SuccessfulCreate

Created pod: e2e-ipp-cleanup-bcb351-openshift-default-6586f4bc6d-lpncr

openshift-ingress

multus

e2e-ipp-cleanup-bcb351-openshift-default-6586f4bc6d-lpncr

AddedInterface

Add eth0 [10.132.0.89/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-bcb351

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-bcb351-6b677f6658 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-bcb351

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-bcb351-7fccbcb875 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-bcb351-7fccbcb875

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-bcb351-7fccbcb875-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-bcb351: serviceaccount "payload-processing-e2e-ipp-cleanup-bcb351" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-bcb351-6b677f6658-79b9g

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-bcb351-6b677f6658-79b9g

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-bcb351-7fccbcb875-dsj5h

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-bcb351-7fccbcb875-dsj5h

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-bcb351-6b677f6658

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-bcb351-6b677f6658-79b9g

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-bcb351-7fccbcb875-dsj5h

AddedInterface

Add eth0 [10.133.0.97/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-bcb351-7fccbcb875-dsj5h

Started

Started container payload-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-bcb351-6b677f6658

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-bcb351-6b677f6658-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-bcb351: serviceaccount "payload-processing-e2e-ipp-cleanup-bcb351" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-bcb351-7fccbcb875

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-bcb351-7fccbcb875-dsj5h

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-bcb351-6b677f6658-79b9g

AddedInterface

Add eth0 [10.133.0.96/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-bcb351-6b677f6658-79b9g

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-bcb351-openshift-default-6586f4bc6d-lpncr

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-bcb351-openshift-default-6586f4bc6d-lpncr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-bcb351-openshift-default-6586f4bc6d-lpncr

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-bcb351-openshift-default-6586f4bc6d-lpncr

Unhealthy

Startup probe failed: Get "http://10.132.0.89:15021/healthz/ready": dial tcp 10.132.0.89:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-bcb351-openshift-default-6586f4bc6d-lpncr

ProbeError

Startup probe error: Get "http://10.132.0.89:15021/healthz/ready": dial tcp 10.132.0.89:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-bcb351-6b677f6658-79b9g

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-bcb351-7fccbcb875-dsj5h

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-bcb351-openshift-default-6586f4bc6d-lpncr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-cleanup-bcb351-openshift-default-6586f4bc6d-lpncr

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-cleanup-bcb351-openshift-default-6586f4bc6d-lpncr

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-100032-6d8467f586-g45qb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-100032-847c459c7c-v2t42

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-a-100032

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-a-100032: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-a-100032": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-a-100032, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: dc514b2d-4465-40ab-b92d-07e7b82e0d31, UID in object meta:

openshift-ingress

kubelet

e2e-ipp-a-100032-openshift-default-5b4c44ffd-tp4d8

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-a-100032-openshift-default-5b4c44ffd-tp4d8

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-a-100032-openshift-default-5b4c44ffd-tp4d8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-855e86-5879d78cd-hcqzh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-855e86-546d9bc677-s6lxc

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-b-855e86

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-b-855e86: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-b-855e86": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-b-855e86, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: f1130136-bf9d-4c86-82eb-a19391164b1c, UID in object meta:

openshift-ingress

kubelet

e2e-ipp-b-855e86-openshift-default-787f847fc8-vggg5

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-b-855e86-openshift-default-787f847fc8-vggg5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-855e86-openshift-default-787f847fc8-vggg5

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-a-w3-2d3bc8

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-a-w3-2d3bc8: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-a-w3-2d3bc8": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-a-w3-2d3bc8, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 6c328a68-ceea-48ee-881b-6cb0fa782d97, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-2d3bc8-c768b769f-8t5xb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-2d3bc8-54b8c58546-l2vl6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w3-2d3bc8-openshift-default-7744dd8884-zlh6r

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-64fec6-866767cccc-szm94

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-64fec6-84dff8b554-kpb64

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w3-64fec6-openshift-default-798455f9fd-fl9b2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w3-64fec6-openshift-default-798455f9fd-fl9b2

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w3-64fec6-openshift-default-798455f9fd-fl9b2

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: