Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-processing-e2e-explicit-c3f8d8-7894ccff57-slm67

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-c3f8d8-7894ccff57-slm67 to ip-10-0-130-132.ec2.internal

openshift-ingress

payload-processing-e2e-autores-4b6ed7-6dc894869-wh5ds

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-4b6ed7-6dc894869-wh5ds to ip-10-0-130-132.ec2.internal

openshift-ingress

e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x to ip-10-0-131-144.ec2.internal

openshift-ingress

e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj

Scheduled

Successfully assigned openshift-ingress/e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj to ip-10-0-131-144.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-81df64-78f4df6995-8hl6p

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-81df64-78f4df6995-8hl6p to ip-10-0-131-144.ec2.internal

openshift-ingress

e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t

Scheduled

Successfully assigned openshift-ingress/e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t to ip-10-0-131-144.ec2.internal

openshift-ingress

e2e-noten-904cd0-openshift-default-76bccb7f4d-6cwm4

Scheduled

Successfully assigned openshift-ingress/e2e-noten-904cd0-openshift-default-76bccb7f4d-6cwm4 to ip-10-0-131-144.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-5b711c-6f6c894c89-88fpr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-5b711c-6f6c894c89-88fpr to ip-10-0-142-85.ec2.internal

openshift-ingress

e2e-ait-220bac51-openshift-default-5b57cb59c6-7sj72

Scheduled

Successfully assigned openshift-ingress/e2e-ait-220bac51-openshift-default-5b57cb59c6-7sj72 to ip-10-0-130-132.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-5b711c-85865587bb-5f94g

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-5b711c-85865587bb-5f94g to ip-10-0-130-132.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-723148b6-9d745c6bb-pkf2x

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-723148b6-9d745c6bb-pkf2x to ip-10-0-142-85.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-9a2657-7d9c5fb7db-mklz4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-9a2657-7d9c5fb7db-mklz4 to ip-10-0-130-132.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-bb6e74-6dfbdcd5d-bmst9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-bb6e74-6dfbdcd5d-bmst9 to ip-10-0-142-85.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-5306e6ca-7986884b4b-f9k62

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-5306e6ca-7986884b4b-f9k62 to ip-10-0-142-85.ec2.internal

openshift-ingress

kube-auth-proxy-797549bd89-twhcg

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-797549bd89-twhcg to ip-10-0-131-144.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-ee23f934-5569bfc5f8-p54kk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-ee23f934-5569bfc5f8-p54kk to ip-10-0-130-132.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-c3f8d8-7659c6cc8b-4l2jf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-c3f8d8-7659c6cc8b-4l2jf to ip-10-0-130-132.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-f2beda59-f4849979d-qh4cw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-f2beda59-f4849979d-qh4cw to ip-10-0-130-132.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-4b6ed7-66df57b866-xsq2w

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-4b6ed7-66df57b866-xsq2w to ip-10-0-131-144.ec2.internal

openshift-ingress

e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg

Scheduled

Successfully assigned openshift-ingress/e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg to ip-10-0-131-144.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-088c83-68bc58bff8-8j22l

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-088c83-68bc58bff8-8j22l to ip-10-0-130-132.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-c14a20-6d949db59d-qjqd6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-c14a20-6d949db59d-qjqd6 to ip-10-0-130-132.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-9511bd-8d458d974-85lsm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-9511bd-8d458d974-85lsm to ip-10-0-142-85.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-c3ca75-5446f78574-8twql

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-c3ca75-5446f78574-8twql to ip-10-0-130-132.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-dd25dd-85477c9b8b-92knm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-dd25dd-85477c9b8b-92knm to ip-10-0-142-85.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-4d485e-7c8bb46bcd-s9g6d

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-4d485e-7c8bb46bcd-s9g6d to ip-10-0-142-85.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-04f8e8-77b7bbcbd6-94svw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-04f8e8-77b7bbcbd6-94svw to ip-10-0-130-132.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-51ad044d-84d6d7b6b-rz57w

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-51ad044d-84d6d7b6b-rz57w to ip-10-0-130-132.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-220bac51-7878986646-zjp7r

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-220bac51-7878986646-zjp7r to ip-10-0-142-85.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-783804-5556ddd99f-q6p76

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-783804-5556ddd99f-q6p76 to ip-10-0-142-85.ec2.internal

openshift-ingress

e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b to ip-10-0-131-144.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-723148b6-7d96755558-tbp24

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-723148b6-7d96755558-tbp24 to ip-10-0-142-85.ec2.internal

openshift-ingress

kube-auth-proxy-797549bd89-h8pbs

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-797549bd89-h8pbs to ip-10-0-142-85.ec2.internal

openshift-ingress

e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt to ip-10-0-131-144.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-4v29t

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4v29t to ip-10-0-131-144.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-783804-746986ddc8-krjgc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-783804-746986ddc8-krjgc to ip-10-0-130-132.ec2.internal

openshift-ingress

e2e-ipp-cleanup-783804-openshift-default-579dbbbcb-x97pw

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-783804-openshift-default-579dbbbcb-x97pw to ip-10-0-130-132.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-bb6e74-59d9668859-c96ng

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-bb6e74-59d9668859-c96ng to ip-10-0-142-85.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-81df64-5c8776d946-srz6k

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-81df64-5c8776d946-srz6k to ip-10-0-142-85.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-68cf4d799c5b6cw

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c5b6cw to ip-10-0-130-132.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-9a2657-88bfd9b9c-j657t

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-9a2657-88bfd9b9c-j657t to ip-10-0-142-85.ec2.internal

openshift-ingress

payload-processing-e2e-derive-f2beda59-68ff76d5b9-77jlc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-f2beda59-68ff76d5b9-77jlc to ip-10-0-130-132.ec2.internal

openshift-ingress

e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5 to ip-10-0-131-144.ec2.internal

openshift-ingress

e2e-api-b-c14a20-openshift-default-b87544596-cchfr

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-c14a20-openshift-default-b87544596-cchfr to ip-10-0-131-144.ec2.internal

openshift-ingress

e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n to ip-10-0-131-144.ec2.internal

openshift-ingress

e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc to ip-10-0-131-144.ec2.internal

openshift-ingress

router-default-d6d5fbc68-m67sb

Scheduled

Successfully assigned openshift-ingress/router-default-d6d5fbc68-m67sb to ip-10-0-142-85.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-c14a20-689f56858c-qgfrf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-c14a20-689f56858c-qgfrf to ip-10-0-130-132.ec2.internal

openshift-ingress

payload-processing-e2e-mt-5306e6ca-7595f6f657-w5glr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-5306e6ca-7595f6f657-w5glr to ip-10-0-130-132.ec2.internal

openshift-ingress

payload-processing-e2e-mt-ee23f934-5b9cf5577c-s484q

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-ee23f934-5b9cf5577c-s484q to ip-10-0-130-132.ec2.internal

openshift-ingress

e2e-ipp-b-5b711c-openshift-default-76b46dfb86-qq7g4

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-5b711c-openshift-default-76b46dfb86-qq7g4 to ip-10-0-130-132.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-04f8e8-6fc7764877-9b8c6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-04f8e8-6fc7764877-9b8c6 to ip-10-0-142-85.ec2.internal

openshift-ingress

payload-processing-e2e-ait-51ad044d-6d7dbdd8f7-wvjh8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-51ad044d-6d7dbdd8f7-wvjh8 to ip-10-0-130-132.ec2.internal

openshift-ingress

e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd to ip-10-0-131-144.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-lxcxb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-lxcxb to ip-10-0-142-85.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w4-876808-6494cfc7b9-xwsw7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-876808-6494cfc7b9-xwsw7 to ip-10-0-142-85.ec2.internal

openshift-ingress

e2e-autores-4b6ed7-openshift-default-77659899c8-jqn8w

Scheduled

Successfully assigned openshift-ingress/e2e-autores-4b6ed7-openshift-default-77659899c8-jqn8w to ip-10-0-130-132.ec2.internal

openshift-ingress

payload-processing-e2e-ait-220bac51-d9bccdcb7-ln7qk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-220bac51-d9bccdcb7-ln7qk to ip-10-0-142-85.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-088c83-9d4dbc6f7-rb8n6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-088c83-9d4dbc6f7-rb8n6 to ip-10-0-130-132.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-9511bd-69d77c4d7f-6qgz6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-9511bd-69d77c4d7f-6qgz6 to ip-10-0-142-85.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-c3ca75-797c7b55d7-nfhkb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-c3ca75-797c7b55d7-nfhkb to ip-10-0-130-132.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-dd25dd-57b899966c-t8hq4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-dd25dd-57b899966c-t8hq4 to ip-10-0-130-132.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-4d485e-65b7fbc5c9-llkv7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-4d485e-65b7fbc5c9-llkv7 to ip-10-0-142-85.ec2.internal

openshift-ingress

e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b to ip-10-0-131-144.ec2.internal

openshift-ingress

e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf to ip-10-0-131-144.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-p4mlv

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-p4mlv to ip-10-0-131-144.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-5ccb968c66-cvpvm

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-cvpvm to ip-10-0-130-132.ec2.internal

openshift-ingress

e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv to ip-10-0-131-144.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-876808-7c65579d9d-sqzzc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-876808-7c65579d9d-sqzzc to ip-10-0-142-85.ec2.internal

openshift-ingress

e2e-derive-f2beda59-openshift-default-7d8669f696-8cf6q

Scheduled

Successfully assigned openshift-ingress/e2e-derive-f2beda59-openshift-default-7d8669f696-8cf6q to ip-10-0-131-144.ec2.internal

openshift-ingress

e2e-worker-w4-876808-openshift-default-b6fbd76c4-f22b7

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-876808-openshift-default-b6fbd76c4-f22b7 to ip-10-0-130-132.ec2.internal

openshift-ingress

e2e-inf-b-bb6e74-openshift-default-68cb6df57b-nh7br

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-bb6e74-openshift-default-68cb6df57b-nh7br to ip-10-0-130-132.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-c7zdh

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-c7zdh to ip-10-0-131-144.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-d6d5fbc68 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

router-default-d6d5fbc68

FailedCreate

Error creating: pods "router-default-d6d5fbc68-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x17)

openshift-ingress

replicaset-controller

router-default-d6d5fbc68

FailedCreate

Error creating: pods "router-default-d6d5fbc68-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-d6d5fbc68

SuccessfulCreate

Created pod: router-default-d6d5fbc68-m67sb
(x5)

openshift-ingress

kubelet

router-default-d6d5fbc68-m67sb

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x5)

openshift-ingress

kubelet

router-default-d6d5fbc68-m67sb

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found

openshift-ingress

kubelet

router-default-d6d5fbc68-m67sb

Created

Created container: router

openshift-ingress

multus

router-default-d6d5fbc68-m67sb

AddedInterface

Add eth0 [10.133.0.10/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-d6d5fbc68-m67sb

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:48526e08a2a06d05806dbcf3ddb069e5182371667d9e9f7d2cf09f60cd247d20" already present on machine

openshift-ingress

kubelet

router-default-d6d5fbc68-m67sb

Started

Started container router

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-797549bd89 from 0 to 2

openshift-ingress

multus

kube-auth-proxy-797549bd89-h8pbs

AddedInterface

Add eth0 [10.133.0.25/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-797549bd89-twhcg

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-797549bd89-twhcg

AddedInterface

Add eth0 [10.132.0.36/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

kube-auth-proxy-797549bd89

SuccessfulCreate

Created pod: kube-auth-proxy-797549bd89-h8pbs

openshift-ingress

replicaset-controller

kube-auth-proxy-797549bd89

SuccessfulCreate

Created pod: kube-auth-proxy-797549bd89-twhcg

openshift-ingress

kubelet

kube-auth-proxy-797549bd89-h8pbs

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-4v29t

openshift-ingress

kubelet

kube-auth-proxy-797549bd89-twhcg

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.765s (2.765s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-4v29t

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-4v29t

AddedInterface

Add eth0 [10.132.0.37/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-797549bd89-twhcg

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-797549bd89-twhcg

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-797549bd89-h8pbs

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 3.024s (3.024s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-797549bd89-h8pbs

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-797549bd89-h8pbs

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-4v29t

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.447s (2.447s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-4v29t

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-4v29t

Started

Started container discovery

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-68cf4d799c from 0 to 1

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-68cf4d799c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-68cf4d799c5b6cw

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799c5b6cw

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-68cf4d799c5b6cw

AddedInterface

Add eth0 [10.134.0.15/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799c5b6cw

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 3.301s (3.301s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799c5b6cw

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799c5b6cw

Created

Created container: istio-proxy

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-c7zdh

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-c7zdh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" already present on machine

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-c7zdh

Created

Created container: discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-c7zdh

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-c7zdh

AddedInterface

Add eth0 [10.132.0.39/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-4v29t

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-4v29t

Killing

Stopping container discovery

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-5ccb968c66 from 0 to 1

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5ccb968c66

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5ccb968c66-cvpvm

openshift-ingress

multus

maas-default-gateway-openshift-default-5ccb968c66-cvpvm

AddedInterface

Add eth0 [10.134.0.22/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-lxcxb
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-p4mlv
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

multus

payload-processing-5b54b7fbb7-p4mlv

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-p4mlv

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-lxcxb

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-lxcxb

AddedInterface

Add eth0 [10.133.0.31/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-p4mlv

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-p4mlv

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-p4mlv

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.22s (1.22s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-lxcxb

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-lxcxb

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.372s (2.372s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-lxcxb

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-cvpvm

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-cvpvm

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-cvpvm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-cvpvm

Unhealthy

Startup probe failed: Get "http://10.134.0.22:15021/healthz/ready": dial tcp 10.134.0.22:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-cvpvm

ProbeError

Startup probe error: Get "http://10.134.0.22:15021/healthz/ready": dial tcp 10.134.0.22:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-inf-a-81df64-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-81df64-openshift-default-5fdd9fbd8d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-876808

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-876808

openshift-ingress

deployment-controller

e2e-worker-w0-4d485e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-4d485e-openshift-default-69788755f6 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w0-4d485e-openshift-default-69788755f6

SuccessfulCreate

Created pod: e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv

openshift-ingress

replicaset-controller

e2e-worker-w4-876808-openshift-default-b6fbd76c4

SuccessfulCreate

Created pod: e2e-worker-w4-876808-openshift-default-b6fbd76c4-f22b7

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-4d485e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-4d485e

openshift-ingress

deployment-controller

e2e-worker-w4-876808-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-876808-openshift-default-b6fbd76c4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-81df64-openshift-default-5fdd9fbd8d

SuccessfulCreate

Created pod: e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt

openshift-ingress

gateway_labeler_controller

e2e-inf-a-81df64

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-81df64

openshift-ingress

multus

e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

e2e-worker-w4-876808-openshift-default-b6fbd76c4-f22b7

AddedInterface

Add eth0 [10.134.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.776s (2.776s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.841s (2.841s including waiting). Image size: 181318953 bytes.

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-876808

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-876808-6494cfc7b9 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-876808-6494cfc7b9

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-876808-6494cfc7b9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-876808: serviceaccount "payload-processing-e2e-worker-w4-876808" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-876808-7c65579d9d-sqzzc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-worker-w4-876808-6494cfc7b9-xwsw7

AddedInterface

Add eth0 [10.133.0.38/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-876808-6494cfc7b9-xwsw7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-876808-6494cfc7b9-xwsw7

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-876808-6494cfc7b9-xwsw7

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-876808-6494cfc7b9

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-876808-6494cfc7b9-xwsw7

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-876808-7c65579d9d-sqzzc

AddedInterface

Add eth0 [10.133.0.37/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-876808

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-876808-7c65579d9d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-876808-7c65579d9d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-876808-7c65579d9d-sqzzc

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-876808-7c65579d9d-sqzzc

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-876808-7c65579d9d-sqzzc

Started

Started container payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-876808-7c65579d9d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-876808-7c65579d9d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-876808: serviceaccount "payload-processing-e2e-worker-w4-876808" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-4d485e-7c8bb46bcd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-4d485e-7c8bb46bcd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-4d485e: serviceaccount "payload-processing-e2e-worker-w0-4d485e" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-4d485e-65b7fbc5c9

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-4d485e-65b7fbc5c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-4d485e: serviceaccount "payload-processing-e2e-worker-w0-4d485e" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-4d485e-65b7fbc5c9

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-4d485e-65b7fbc5c9-llkv7

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-4d485e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-4d485e-65b7fbc5c9 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-4d485e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-4d485e-7c8bb46bcd from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-4d485e-7c8bb46bcd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-4d485e-7c8bb46bcd-s9g6d
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-81df64-5c8776d946

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-81df64-5c8776d946-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-81df64: serviceaccount "payload-processing-e2e-inf-a-81df64" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-81df64-5c8776d946

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-81df64-5c8776d946-srz6k

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-4d485e-65b7fbc5c9-llkv7

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-4d485e-65b7fbc5c9-llkv7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-4d485e-7c8bb46bcd-s9g6d

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-81df64-78f4df6995

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-81df64-78f4df6995-8hl6p

openshift-ingress

multus

payload-processing-e2e-worker-w0-4d485e-65b7fbc5c9-llkv7

AddedInterface

Add eth0 [10.133.0.40/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-81df64

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-81df64-78f4df6995 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-81df64-78f4df6995

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-81df64-78f4df6995-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-81df64: serviceaccount "payload-processing-e2e-inf-a-81df64" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-4d485e-65b7fbc5c9-llkv7

Started

Started container payload-processing

openshift-ingress

replicaset-controller

e2e-autores-4b6ed7-openshift-default-77659899c8

SuccessfulCreate

Created pod: e2e-autores-4b6ed7-openshift-default-77659899c8-jqn8w

openshift-ingress

deployment-controller

e2e-autores-4b6ed7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-4b6ed7-openshift-default-77659899c8 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-autores-4b6ed7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-4b6ed7

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-4d485e-7c8bb46bcd-s9g6d

AddedInterface

Add eth0 [10.133.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-4d485e-7c8bb46bcd-s9g6d

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-4d485e-7c8bb46bcd-s9g6d

Created

Created container: payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-81df64

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-81df64-5c8776d946 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-220bac51

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-220bac51

openshift-ingress

multus

e2e-autores-4b6ed7-openshift-default-77659899c8-jqn8w

AddedInterface

Add eth0 [10.134.0.35/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-inf-a-81df64-78f4df6995-8hl6p

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-81df64-5c8776d946-srz6k

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-81df64-5c8776d946-srz6k

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-81df64-5c8776d946-srz6k

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-81df64-5c8776d946-srz6k

AddedInterface

Add eth0 [10.133.0.41/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ait-220bac51-openshift-default-5b57cb59c6

SuccessfulCreate

Created pod: e2e-ait-220bac51-openshift-default-5b57cb59c6-7sj72

openshift-ingress

deployment-controller

e2e-ait-220bac51-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-220bac51-openshift-default-5b57cb59c6 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-a-81df64-78f4df6995-8hl6p

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-a-81df64-78f4df6995-8hl6p

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-81df64-78f4df6995-8hl6p

Created

Created container: payload-processing

openshift-ingress

multus

e2e-ait-220bac51-openshift-default-5b57cb59c6-7sj72

AddedInterface

Add eth0 [10.134.0.36/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ait-220bac51

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-220bac51-d9bccdcb7 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-220bac51-d9bccdcb7

FailedCreate

Error creating: pods "payload-processing-e2e-ait-220bac51-d9bccdcb7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-220bac51: serviceaccount "payload-processing-e2e-ait-220bac51" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-220bac51-d9bccdcb7

SuccessfulCreate

Created pod: payload-processing-e2e-ait-220bac51-d9bccdcb7-ln7qk
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-220bac51-7878986646

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-220bac51-7878986646-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-220bac51: serviceaccount "payload-processing-e2e-ait-220bac51" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-220bac51-7878986646

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-220bac51-7878986646-zjp7r

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-220bac51

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-220bac51-7878986646 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-220bac51-7878986646-zjp7r

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-220bac51-d9bccdcb7-ln7qk

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-ait-220bac51-d9bccdcb7-ln7qk

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-220bac51-7878986646-zjp7r

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-220bac51-7878986646-zjp7r

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-220bac51-d9bccdcb7-ln7qk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-220bac51-7878986646-zjp7r

AddedInterface

Add eth0 [10.133.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-220bac51-d9bccdcb7-ln7qk

Started

Started container payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-4b6ed7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-4b6ed7-66df57b866 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-4b6ed7-66df57b866

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-4b6ed7-66df57b866-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-4b6ed7: serviceaccount "payload-processing-e2e-autores-4b6ed7" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-4b6ed7-6dc894869

SuccessfulCreate

Created pod: payload-processing-e2e-autores-4b6ed7-6dc894869-wh5ds
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-4b6ed7-6dc894869

FailedCreate

Error creating: pods "payload-processing-e2e-autores-4b6ed7-6dc894869-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-4b6ed7: serviceaccount "payload-processing-e2e-autores-4b6ed7" not found

openshift-ingress

deployment-controller

payload-processing-e2e-autores-4b6ed7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-4b6ed7-6dc894869 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-4b6ed7-66df57b866

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-4b6ed7-66df57b866-xsq2w

openshift-ingress

multus

payload-processing-e2e-autores-4b6ed7-6dc894869-wh5ds

AddedInterface

Add eth0 [10.134.0.37/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-876808-openshift-default-b6fbd76c4-f22b7

Unhealthy

Readiness probe failed: Get "http://10.134.0.33:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

multus

payload-pre-processing-e2e-autores-4b6ed7-66df57b866-xsq2w

AddedInterface

Add eth0 [10.132.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-4b6ed7-6dc894869-wh5ds

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-4b6ed7-66df57b866-xsq2w

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-4b6ed7-66df57b866-xsq2w

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w4-876808-openshift-default-b6fbd76c4-f22b7

ProbeError

Readiness probe error: Get "http://10.134.0.33:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-4b6ed7-66df57b866-xsq2w

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w4-876808-openshift-default-b6fbd76c4-f22b7

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-876808-openshift-default-b6fbd76c4-f22b7

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-876808-openshift-default-b6fbd76c4-f22b7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-autores-4b6ed7-6dc894869-wh5ds

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.458s (2.458s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-processing-e2e-autores-4b6ed7-6dc894869-wh5ds

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-4b6ed7-6dc894869-wh5ds

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt

ProbeError

Readiness probe error: Get "http://10.132.0.56:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt

Unhealthy

Readiness probe failed: Get "http://10.132.0.56:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-worker-w4-876808-openshift-default-b6fbd76c4-f22b7

Unhealthy

Startup probe failed: Get "http://10.134.0.33:15021/healthz/ready": dial tcp 10.134.0.33:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w4-876808-openshift-default-b6fbd76c4-f22b7

ProbeError

Startup probe error: Get "http://10.134.0.33:15021/healthz/ready": dial tcp 10.134.0.33:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-inf-b-bb6e74-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-bb6e74-openshift-default-68cb6df57b from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-bb6e74-openshift-default-68cb6df57b

SuccessfulCreate

Created pod: e2e-inf-b-bb6e74-openshift-default-68cb6df57b-nh7br

openshift-ingress

gateway_labeler_controller

e2e-inf-b-bb6e74

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-bb6e74

openshift-ingress

multus

e2e-inf-b-bb6e74-openshift-default-68cb6df57b-nh7br

AddedInterface

Add eth0 [10.134.0.38/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt

ProbeError

Startup probe error: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt

Unhealthy

Startup probe failed: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv

Unhealthy

Startup probe failed: Get "http://10.132.0.55:15021/healthz/ready": dial tcp 10.132.0.55:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv

ProbeError

Startup probe error: Get "http://10.132.0.55:15021/healthz/ready": dial tcp 10.132.0.55:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-bb6e74

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-bb6e74-59d9668859 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-inf-b-bb6e74-59d9668859-c96ng

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-bb6e74-59d9668859-c96ng

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-bb6e74-59d9668859-c96ng

Created

Created container: payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-bb6e74

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-bb6e74-6dfbdcd5d from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-b-bb6e74-59d9668859-c96ng

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-bb6e74-59d9668859

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-bb6e74-59d9668859-c96ng

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-bb6e74-6dfbdcd5d-bmst9

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-bb6e74-6dfbdcd5d-bmst9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-bb6e74-6dfbdcd5d-bmst9

Started

Started container payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-bb6e74-6dfbdcd5d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-bb6e74-6dfbdcd5d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-bb6e74: serviceaccount "payload-processing-e2e-inf-b-bb6e74" not found

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-bb6e74-6dfbdcd5d-bmst9

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-bb6e74-6dfbdcd5d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-bb6e74-6dfbdcd5d-bmst9
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-bb6e74-59d9668859

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-bb6e74-59d9668859-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-bb6e74: serviceaccount "payload-processing-e2e-inf-b-bb6e74" not found
(x2)

openshift-ingress

kubelet

e2e-ait-220bac51-openshift-default-5b57cb59c6-7sj72

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-4b6ed7-openshift-default-77659899c8-jqn8w

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-4b6ed7-openshift-default-77659899c8-jqn8w

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-4b6ed7-openshift-default-77659899c8-jqn8w

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-220bac51-openshift-default-5b57cb59c6-7sj72

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-220bac51-openshift-default-5b57cb59c6-7sj72

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-ait-220bac51-openshift-default-5b57cb59c6-7sj72

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-220bac51-7878986646-zjp7r

Killing

Stopping container payload-pre-processing
(x3)

openshift-ingress

kubelet

e2e-ait-220bac51-openshift-default-5b57cb59c6-7sj72

Unhealthy

Startup probe failed: Get "http://10.134.0.36:15021/healthz/ready": dial tcp 10.134.0.36:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ait-220bac51-d9bccdcb7-ln7qk

Killing

Stopping container payload-processing
(x3)

openshift-ingress

kubelet

e2e-ait-220bac51-openshift-default-5b57cb59c6-7sj72

ProbeError

Startup probe error: Get "http://10.134.0.36:15021/healthz/ready": dial tcp 10.134.0.36:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-migrate-723148b6-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-723148b6-gw
(x5)

openshift-ingress

kubelet

e2e-autores-4b6ed7-openshift-default-77659899c8-jqn8w

Unhealthy

Startup probe failed: Get "http://10.134.0.35:15021/healthz/ready": dial tcp 10.134.0.35:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-autores-4b6ed7-openshift-default-77659899c8-jqn8w

ProbeError

Startup probe error: Get "http://10.134.0.35:15021/healthz/ready": dial tcp 10.134.0.35:15021: connect: connection refused body:

openshift-ingress

GatewayAuthBootstrap

e2e-migrate-723148b6-gw

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-migrate-723148b6-gw-authn-ssl: envoyfilters.networking.istio.io "e2e-migrate-723148b6-gw-authn-ssl" already exists

openshift-ingress

deployment-controller

e2e-migrate-723148b6-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-723148b6-gw-openshift-default-7cd4557568 from 0 to 1

openshift-ingress

replicaset-controller

e2e-migrate-723148b6-gw-openshift-default-7cd4557568

SuccessfulCreate

Created pod: e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x

openshift-ingress

multus

e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x

AddedInterface

Add eth0 [10.132.0.63/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-723148b6-9d745c6bb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-723148b6-9d745c6bb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-723148b6: serviceaccount "payload-processing-e2e-migrate-723148b6" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-723148b6-7d96755558

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-723148b6-7d96755558-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-723148b6: serviceaccount "payload-processing-e2e-migrate-723148b6" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-723148b6-9d745c6bb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-723148b6-9d745c6bb-pkf2x

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-723148b6-7d96755558

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-723148b6-7d96755558-tbp24

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-723148b6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-723148b6-7d96755558 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-723148b6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-723148b6-9d745c6bb from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-723148b6-9d745c6bb-pkf2x

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-723148b6-7d96755558-tbp24

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-723148b6-7d96755558-tbp24

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-migrate-723148b6-9d745c6bb-pkf2x

AddedInterface

Add eth0 [10.133.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-723148b6-9d745c6bb-pkf2x

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-migrate-723148b6-7d96755558-tbp24

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-723148b6-9d745c6bb-pkf2x

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-migrate-723148b6-7d96755558-tbp24

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-inf-b-bb6e74-openshift-default-68cb6df57b-nh7br

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-bb6e74-openshift-default-68cb6df57b-nh7br

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-bb6e74-openshift-default-68cb6df57b-nh7br

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-inf-b-bb6e74-openshift-default-68cb6df57b-nh7br

ProbeError

Startup probe error: Get "http://10.134.0.38:15021/healthz/ready": dial tcp 10.134.0.38:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-b-bb6e74-openshift-default-68cb6df57b-nh7br

Unhealthy

Startup probe failed: Get "http://10.134.0.38:15021/healthz/ready": dial tcp 10.134.0.38:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x

ProbeError

Startup probe error: Get "http://10.132.0.63:15021/healthz/ready": dial tcp 10.132.0.63:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x

Unhealthy

Startup probe failed: Get "http://10.132.0.63:15021/healthz/ready": dial tcp 10.132.0.63:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-723148b6-9d745c6bb-pkf2x

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-723148b6-7d96755558-tbp24

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

e2e-ait-51ad044d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-51ad044d-openshift-default-5cb46bd4d6 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-51ad044d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-51ad044d

openshift-ingress

replicaset-controller

e2e-ait-51ad044d-openshift-default-5cb46bd4d6

SuccessfulCreate

Created pod: e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg

openshift-ingress

kubelet

e2e-migrate-723148b6-gw-openshift-default-7cd4557568-gwp8x

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg

AddedInterface

Add eth0 [10.132.0.65/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-51ad044d-6d7dbdd8f7

FailedCreate

Error creating: pods "payload-processing-e2e-ait-51ad044d-6d7dbdd8f7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-51ad044d: serviceaccount "payload-processing-e2e-ait-51ad044d" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-51ad044d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-51ad044d-84d6d7b6b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-51ad044d-84d6d7b6b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-51ad044d-84d6d7b6b-rz57w
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-51ad044d-84d6d7b6b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-51ad044d-84d6d7b6b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-51ad044d: serviceaccount "payload-processing-e2e-ait-51ad044d" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-51ad044d-6d7dbdd8f7

SuccessfulCreate

Created pod: payload-processing-e2e-ait-51ad044d-6d7dbdd8f7-wvjh8

openshift-ingress

deployment-controller

payload-processing-e2e-ait-51ad044d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-51ad044d-6d7dbdd8f7 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-51ad044d-84d6d7b6b-rz57w

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-51ad044d-84d6d7b6b-rz57w

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ait-51ad044d-6d7dbdd8f7-wvjh8

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-51ad044d-6d7dbdd8f7-wvjh8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-51ad044d-6d7dbdd8f7-wvjh8

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-51ad044d-6d7dbdd8f7-wvjh8

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-51ad044d-84d6d7b6b-rz57w

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-51ad044d-84d6d7b6b-rz57w

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg

Unhealthy

Startup probe failed: Get "http://10.132.0.65:15021/healthz/ready": dial tcp 10.132.0.65:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg

ProbeError

Startup probe error: Get "http://10.132.0.65:15021/healthz/ready": dial tcp 10.132.0.65:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ait-51ad044d-6d7dbdd8f7-wvjh8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-51ad044d-84d6d7b6b-rz57w

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-51ad044d-openshift-default-5cb46bd4d6-d8mxg

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-derive-f2beda59-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-f2beda59-openshift-default-7d8669f696 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-derive-f2beda59

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-f2beda59

openshift-ingress

replicaset-controller

e2e-derive-f2beda59-openshift-default-7d8669f696

SuccessfulCreate

Created pod: e2e-derive-f2beda59-openshift-default-7d8669f696-8cf6q

openshift-ingress

multus

e2e-derive-f2beda59-openshift-default-7d8669f696-8cf6q

AddedInterface

Add eth0 [10.132.0.67/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-f2beda59-f4849979d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-f2beda59-f4849979d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-f2beda59: serviceaccount "payload-processing-e2e-derive-f2beda59" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-f2beda59-68ff76d5b9

SuccessfulCreate

Created pod: payload-processing-e2e-derive-f2beda59-68ff76d5b9-77jlc
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-f2beda59-68ff76d5b9

FailedCreate

Error creating: pods "payload-processing-e2e-derive-f2beda59-68ff76d5b9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-f2beda59: serviceaccount "payload-processing-e2e-derive-f2beda59" not found

openshift-ingress

deployment-controller

payload-processing-e2e-derive-f2beda59

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-f2beda59-68ff76d5b9 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-f2beda59-f4849979d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-f2beda59-f4849979d-qh4cw

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-f2beda59

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-f2beda59-f4849979d from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-derive-f2beda59-68ff76d5b9-77jlc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-f2beda59-f4849979d-qh4cw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-derive-f2beda59-f4849979d-qh4cw

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-f2beda59-f4849979d-qh4cw

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-f2beda59-68ff76d5b9-77jlc

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-f2beda59-68ff76d5b9-77jlc

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-derive-f2beda59-68ff76d5b9-77jlc

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-f2beda59-f4849979d-qh4cw

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-derive-f2beda59-openshift-default-7d8669f696-8cf6q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-f2beda59-openshift-default-7d8669f696-8cf6q

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-f2beda59-openshift-default-7d8669f696-8cf6q

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-derive-f2beda59-openshift-default-7d8669f696-8cf6q

Unhealthy

Startup probe failed: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-autores-4b6ed7-6dc894869-wh5ds

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-4b6ed7-66df57b866-xsq2w

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-f2beda59-68ff76d5b9-77jlc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-f2beda59-f4849979d-qh4cw

Killing

Stopping container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-derive-f2beda59-openshift-default-7d8669f696-8cf6q

ProbeError

Startup probe error: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-derive-f2beda59-openshift-default-7d8669f696-8cf6q

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-autores-4b6ed7-openshift-default-77659899c8-jqn8w

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-autores-4b6ed7-openshift-default-77659899c8-jqn8w

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-autores-4b6ed7-openshift-default-77659899c8-jqn8w

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

e2e-explicit-c3f8d8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-c3f8d8-openshift-default-64f7555764 from 0 to 1

openshift-ingress

replicaset-controller

e2e-explicit-c3f8d8-openshift-default-64f7555764

SuccessfulCreate

Created pod: e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n

openshift-ingress

gateway_labeler_controller

e2e-explicit-c3f8d8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-c3f8d8

openshift-ingress

multus

e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-c3f8d8-7659c6cc8b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-c3f8d8-7659c6cc8b-4l2jf
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-c3f8d8-7659c6cc8b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-c3f8d8-7659c6cc8b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-c3f8d8: serviceaccount "payload-processing-e2e-explicit-c3f8d8" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-c3f8d8-7894ccff57

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-c3f8d8-7894ccff57-slm67
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-c3f8d8-7894ccff57

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-c3f8d8-7894ccff57-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-c3f8d8: serviceaccount "payload-processing-e2e-explicit-c3f8d8" not found

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-c3f8d8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-c3f8d8-7894ccff57 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-c3f8d8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-c3f8d8-7659c6cc8b from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-c3f8d8-7659c6cc8b-4l2jf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-explicit-c3f8d8-7894ccff57-slm67

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-c3f8d8-7659c6cc8b-4l2jf

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-c3f8d8-7894ccff57-slm67

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-c3f8d8-7659c6cc8b-4l2jf

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-c3f8d8-7894ccff57-slm67

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-explicit-c3f8d8-7894ccff57-slm67

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-explicit-c3f8d8-7659c6cc8b-4l2jf

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n

Unhealthy

Startup probe failed: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n

ProbeError

Startup probe error: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused body:

openshift-ingress

multus

e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t

AddedInterface

Add eth0 [10.132.0.71/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-mt-ee23f934-openshift-default-77d4b559b4

SuccessfulCreate

Created pod: e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t

openshift-ingress

deployment-controller

e2e-mt-ee23f934-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-ee23f934-openshift-default-77d4b559b4 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-ee23f934

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-ee23f934

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-ee23f934

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-ee23f934-5569bfc5f8 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-mt-ee23f934

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-ee23f934-5b9cf5577c from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-ee23f934-5b9cf5577c

FailedCreate

Error creating: pods "payload-processing-e2e-mt-ee23f934-5b9cf5577c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-ee23f934: serviceaccount "payload-processing-e2e-mt-ee23f934" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-ee23f934-5569bfc5f8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-ee23f934-5569bfc5f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-ee23f934: serviceaccount "payload-processing-e2e-mt-ee23f934" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-ee23f934-5569bfc5f8-p54kk

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-ee23f934-5569bfc5f8-p54kk

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-ee23f934-5569bfc5f8-p54kk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-mt-ee23f934-5569bfc5f8-p54kk

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-mt-ee23f934-5b9cf5577c-s484q

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-ee23f934-5b9cf5577c-s484q

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-ee23f934-5b9cf5577c-s484q

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-ee23f934-5b9cf5577c-s484q

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-ee23f934-5b9cf5577c

SuccessfulCreate

Created pod: payload-processing-e2e-mt-ee23f934-5b9cf5577c-s484q

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-ee23f934-5569bfc5f8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-ee23f934-5569bfc5f8-p54kk

openshift-ingress

kubelet

e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t

Unhealthy

Readiness probe failed: Get "http://10.132.0.71:15021/healthz/ready": read tcp 10.132.0.2:55812->10.132.0.71:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t

ProbeError

Readiness probe error: Get "http://10.132.0.71:15021/healthz/ready": read tcp 10.132.0.2:55812->10.132.0.71:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t

ProbeError

Startup probe error: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t

Unhealthy

Startup probe failed: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-mt-ee23f934-5b9cf5577c-s484q

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-ee23f934-5569bfc5f8-p54kk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-ee23f934-openshift-default-77d4b559b4-qct6t

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b

SuccessfulCreate

Created pod: e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-c3f8d8-7659c6cc8b-4l2jf

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

e2e-shared-a-w2-088c83-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-088c83

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-088c83

openshift-ingress

kubelet

payload-processing-e2e-explicit-c3f8d8-7894ccff57-slm67

Killing

Stopping container payload-processing

openshift-ingress

multus

e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5

AddedInterface

Add eth0 [10.132.0.72/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-088c83-68bc58bff8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-088c83-68bc58bff8-8j22l

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-088c83-9d4dbc6f7

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-088c83-9d4dbc6f7-rb8n6
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-088c83-68bc58bff8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-088c83-68bc58bff8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-088c83: serviceaccount "payload-processing-e2e-shared-a-w2-088c83" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-088c83-9d4dbc6f7-rb8n6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-088c83-9d4dbc6f7-rb8n6

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-088c83-9d4dbc6f7

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-088c83-9d4dbc6f7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-088c83: serviceaccount "payload-processing-e2e-shared-a-w2-088c83" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-088c83

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-088c83-9d4dbc6f7 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-088c83

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-088c83-68bc58bff8 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-088c83-68bc58bff8-8j22l

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-088c83-68bc58bff8-8j22l

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-088c83-68bc58bff8-8j22l

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-088c83-68bc58bff8-8j22l

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-088c83-9d4dbc6f7-rb8n6

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-088c83-9d4dbc6f7-rb8n6

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-noten-904cd0-openshift-default-76bccb7f4d

SuccessfulCreate

Created pod: e2e-noten-904cd0-openshift-default-76bccb7f4d-6cwm4

openshift-ingress

deployment-controller

e2e-noten-904cd0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-904cd0-openshift-default-76bccb7f4d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-noten-904cd0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-904cd0

openshift-ingress

multus

e2e-noten-904cd0-openshift-default-76bccb7f4d-6cwm4

AddedInterface

Add eth0 [10.132.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-904cd0-openshift-default-76bccb7f4d-6cwm4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-noten-904cd0-openshift-default-76bccb7f4d-6cwm4

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-noten-904cd0-openshift-default-76bccb7f4d-6cwm4

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-explicit-c3f8d8-openshift-default-64f7555764-9f94n

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5

Created

Created container: istio-proxy

openshift-ingress

multus

e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd

AddedInterface

Add eth0 [10.132.0.75/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-b-w2-c3ca75-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-c3ca75-openshift-default-684696668 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w2-c3ca75-openshift-default-684696668

SuccessfulCreate

Created pod: e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-c3ca75

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-c3ca75
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5

Unhealthy

Startup probe failed: Get "http://10.132.0.72:15021/healthz/ready": dial tcp 10.132.0.72:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5

ProbeError

Startup probe error: Get "http://10.132.0.72:15021/healthz/ready": dial tcp 10.132.0.72:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-c3ca75

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-c3ca75-5446f78574 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-c3ca75-797c7b55d7

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-c3ca75-797c7b55d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-c3ca75: serviceaccount "payload-processing-e2e-shared-b-w2-c3ca75" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-c3ca75

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-c3ca75-797c7b55d7 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-c3ca75-797c7b55d7-nfhkb

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-c3ca75-5446f78574-8twql

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-c3ca75-797c7b55d7-nfhkb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-c3ca75-797c7b55d7

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-c3ca75-797c7b55d7-nfhkb

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-c3ca75-5446f78574

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-c3ca75-5446f78574-8twql
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-c3ca75-5446f78574

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-c3ca75-5446f78574-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-c3ca75: serviceaccount "payload-processing-e2e-shared-b-w2-c3ca75" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-c3ca75-797c7b55d7-nfhkb

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-c3ca75-5446f78574-8twql

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-c3ca75-797c7b55d7-nfhkb

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-c3ca75-5446f78574-8twql

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-c3ca75-5446f78574-8twql

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd

ProbeError

Startup probe error: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd

Unhealthy

Startup probe failed: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-mt-5306e6ca-openshift-default-b8f9746c6

SuccessfulCreate

Created pod: e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj

openshift-ingress

deployment-controller

e2e-mt-5306e6ca-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-5306e6ca-openshift-default-b8f9746c6 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-5306e6ca

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-5306e6ca

openshift-ingress

multus

e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj

AddedInterface

Add eth0 [10.132.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-81df64-5c8776d946-srz6k

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-81df64-78f4df6995-8hl6p

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-5306e6ca-7595f6f657

SuccessfulCreate

Created pod: payload-processing-e2e-mt-5306e6ca-7595f6f657-w5glr

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-5306e6ca-7986884b4b-f9k62

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-5306e6ca

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-5306e6ca-7986884b4b from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-mt-5306e6ca-7986884b4b-f9k62

AddedInterface

Add eth0 [10.133.0.61/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-mt-5306e6ca

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-5306e6ca-7595f6f657 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-mt-5306e6ca-7595f6f657-w5glr

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-5306e6ca-7595f6f657-w5glr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-5306e6ca-7986884b4b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-5306e6ca-7986884b4b-f9k62
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-5306e6ca-7986884b4b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-5306e6ca-7986884b4b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-5306e6ca: serviceaccount "payload-processing-e2e-mt-5306e6ca" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-5306e6ca-7595f6f657

FailedCreate

Error creating: pods "payload-processing-e2e-mt-5306e6ca-7595f6f657-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-5306e6ca: serviceaccount "payload-processing-e2e-mt-5306e6ca" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-5306e6ca-7986884b4b-f9k62

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-5306e6ca-7986884b4b-f9k62

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-5306e6ca-7595f6f657-w5glr

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-5306e6ca-7595f6f657-w5glr

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-a-81df64-openshift-default-5fdd9fbd8d-vwmvt

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-noten-904cd0-openshift-default-76bccb7f4d-6cwm4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-inf-b-bb6e74-59d9668859-c96ng

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-bb6e74-6dfbdcd5d-bmst9

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj

Unhealthy

Startup probe failed: Get "http://10.132.0.77:15021/healthz/ready": dial tcp 10.132.0.77:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj

ProbeError

Startup probe error: Get "http://10.132.0.77:15021/healthz/ready": dial tcp 10.132.0.77:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-inf-b-bb6e74-openshift-default-68cb6df57b-nh7br

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6

SuccessfulCreate

Created pod: e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc

openshift-ingress

deployment-controller

e2e-shared-a-w3-9511bd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-9511bd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-9511bd

openshift-ingress

multus

e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc

AddedInterface

Add eth0 [10.132.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-9511bd-8d458d974-85lsm

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-9511bd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-9511bd-8d458d974 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-9511bd-69d77c4d7f-6qgz6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-9511bd-8d458d974-85lsm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-9511bd-69d77c4d7f-6qgz6

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-9511bd-69d77c4d7f-6qgz6

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-9511bd-69d77c4d7f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-9511bd-69d77c4d7f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-9511bd: serviceaccount "payload-processing-e2e-shared-a-w3-9511bd" not found

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-9511bd-69d77c4d7f-6qgz6

AddedInterface

Add eth0 [10.133.0.64/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-9511bd-8d458d974

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-9511bd-8d458d974-85lsm
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-9511bd-8d458d974

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-9511bd-8d458d974-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-9511bd: serviceaccount "payload-processing-e2e-shared-a-w3-9511bd" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-9511bd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-9511bd-69d77c4d7f from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-9511bd-8d458d974-85lsm

AddedInterface

Add eth0 [10.133.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-9511bd-8d458d974-85lsm

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-9511bd-69d77c4d7f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-9511bd-69d77c4d7f-6qgz6

openshift-ingress

kubelet

e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc

ProbeError

Readiness probe error: Get "http://10.132.0.78:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc

Unhealthy

Readiness probe failed: Get "http://10.132.0.78:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-dd25dd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-dd25dd

openshift-ingress

replicaset-controller

e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676

SuccessfulCreate

Created pod: e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf

openshift-ingress

multus

e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf

AddedInterface

Add eth0 [10.132.0.80/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-b-w3-dd25dd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-dd25dd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-dd25dd-85477c9b8b from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-dd25dd-85477c9b8b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-dd25dd-85477c9b8b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-dd25dd: serviceaccount "payload-processing-e2e-shared-b-w3-dd25dd" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-dd25dd-85477c9b8b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-dd25dd-85477c9b8b-92knm

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-dd25dd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-dd25dd-57b899966c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-dd25dd-57b899966c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-dd25dd-57b899966c-t8hq4
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-dd25dd-57b899966c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-dd25dd-57b899966c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-dd25dd: serviceaccount "payload-processing-e2e-shared-b-w3-dd25dd" not found
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc

ProbeError

Startup probe error: Get "http://10.132.0.78:15021/healthz/ready": dial tcp 10.132.0.78:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc

Unhealthy

Startup probe failed: Get "http://10.132.0.78:15021/healthz/ready": dial tcp 10.132.0.78:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-dd25dd-85477c9b8b-92knm

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-dd25dd-85477c9b8b-92knm

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-dd25dd-85477c9b8b-92knm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-dd25dd-57b899966c-t8hq4

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-dd25dd-57b899966c-t8hq4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-dd25dd-57b899966c-t8hq4

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-dd25dd-57b899966c-t8hq4

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-dd25dd-85477c9b8b-92knm

AddedInterface

Add eth0 [10.133.0.66/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf

ProbeError

Startup probe error: Get "http://10.132.0.80:15021/healthz/ready": dial tcp 10.132.0.80:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf

Unhealthy

Startup probe failed: Get "http://10.132.0.80:15021/healthz/ready": dial tcp 10.132.0.80:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-5306e6ca-7986884b4b-f9k62

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-5306e6ca-7595f6f657-w5glr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-5306e6ca-7595f6f657-w5glr

Unhealthy

Readiness probe failed: dial tcp 10.134.0.64:9004: i/o timeout

openshift-ingress

kubelet

e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-5306e6ca-openshift-default-b8f9746c6-s2ggj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

gateway_labeler_controller

e2e-api-a-04f8e8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-04f8e8

openshift-ingress

deployment-controller

e2e-api-a-04f8e8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-04f8e8-openshift-default-9469d6ff8 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-04f8e8-openshift-default-9469d6ff8

SuccessfulCreate

Created pod: e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b

openshift-ingress

multus

e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b

AddedInterface

Add eth0 [10.132.0.82/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-04f8e8-6fc7764877-9b8c6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-api-a-04f8e8-6fc7764877-9b8c6

AddedInterface

Add eth0 [10.133.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-04f8e8-77b7bbcbd6-94svw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-a-04f8e8-77b7bbcbd6-94svw

AddedInterface

Add eth0 [10.134.0.70/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-04f8e8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-04f8e8-77b7bbcbd6 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-04f8e8-77b7bbcbd6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-04f8e8-77b7bbcbd6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-04f8e8: serviceaccount "payload-processing-e2e-api-a-04f8e8" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-04f8e8-77b7bbcbd6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-04f8e8-77b7bbcbd6-94svw

openshift-ingress

kubelet

payload-processing-e2e-api-a-04f8e8-6fc7764877-9b8c6

Created

Created container: payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-04f8e8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-04f8e8-6fc7764877 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-04f8e8-6fc7764877

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-04f8e8-6fc7764877-9b8c6
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-04f8e8-6fc7764877

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-04f8e8-6fc7764877-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-04f8e8: serviceaccount "payload-processing-e2e-api-a-04f8e8" not found

openshift-ingress

kubelet

payload-processing-e2e-api-a-04f8e8-6fc7764877-9b8c6

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-04f8e8-77b7bbcbd6-94svw

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-04f8e8-77b7bbcbd6-94svw

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b

Unhealthy

Readiness probe failed: Get "http://10.132.0.82:15021/healthz/ready": dial tcp 10.132.0.82:15021: connect: connection refused

openshift-ingress

kubelet

e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b

ProbeError

Readiness probe error: Get "http://10.132.0.82:15021/healthz/ready": dial tcp 10.132.0.82:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b

Started

Started container istio-proxy

openshift-ingress

replicaset-controller

e2e-api-b-c14a20-openshift-default-b87544596

SuccessfulCreate

Created pod: e2e-api-b-c14a20-openshift-default-b87544596-cchfr

openshift-ingress

deployment-controller

e2e-api-b-c14a20-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-c14a20-openshift-default-b87544596 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-c14a20

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-c14a20

openshift-ingress

multus

e2e-api-b-c14a20-openshift-default-b87544596-cchfr

AddedInterface

Add eth0 [10.132.0.84/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b

ProbeError

Startup probe error: Get "http://10.132.0.82:15021/healthz/ready": dial tcp 10.132.0.82:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b

Unhealthy

Startup probe failed: Get "http://10.132.0.82:15021/healthz/ready": dial tcp 10.132.0.82:15021: connect: connection refused

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-c14a20-689f56858c

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-c14a20-689f56858c-qgfrf

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-c14a20-6d949db59d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-c14a20-6d949db59d-qjqd6
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-c14a20-6d949db59d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-c14a20-6d949db59d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-c14a20: serviceaccount "payload-processing-e2e-api-b-c14a20" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-c14a20

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-c14a20-689f56858c from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-c14a20

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-c14a20-6d949db59d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-c14a20-689f56858c

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-c14a20-689f56858c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-c14a20: serviceaccount "payload-processing-e2e-api-b-c14a20" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-c14a20-6d949db59d-qjqd6

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-c14a20-689f56858c-qgfrf

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-api-b-c14a20-689f56858c-qgfrf

AddedInterface

Add eth0 [10.134.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-c14a20-689f56858c-qgfrf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-b-c14a20-689f56858c-qgfrf

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-b-c14a20-6d949db59d-qjqd6

AddedInterface

Add eth0 [10.134.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-c14a20-6d949db59d-qjqd6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-c14a20-6d949db59d-qjqd6

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-04f8e8-77b7bbcbd6-94svw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-04f8e8-6fc7764877-9b8c6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-a-04f8e8-openshift-default-9469d6ff8-kpb9b

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-c14a20-openshift-default-b87544596-cchfr

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-c14a20-openshift-default-b87544596-cchfr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-c14a20-openshift-default-b87544596-cchfr

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-b-c14a20-openshift-default-b87544596-cchfr

Unhealthy

Startup probe failed: Get "http://10.132.0.84:15021/healthz/ready": dial tcp 10.132.0.84:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-b-c14a20-openshift-default-b87544596-cchfr

ProbeError

Startup probe error: Get "http://10.132.0.84:15021/healthz/ready": dial tcp 10.132.0.84:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-c14a20-6d949db59d-qjqd6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-c14a20-689f56858c-qgfrf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-b-c14a20-openshift-default-b87544596-cchfr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-c14a20-openshift-default-b87544596-cchfr

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-b-c14a20-openshift-default-b87544596-cchfr

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-088c83-68bc58bff8-8j22l

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-088c83-9d4dbc6f7-rb8n6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-4d485e-7c8bb46bcd-s9g6d

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-4d485e-65b7fbc5c9-llkv7

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-worker-w0-4d485e

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-worker-w0-4d485e: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-worker-w0-4d485e": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-worker-w0-4d485e, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 85173251-13bb-4264-81ac-3ba2e742aa10, UID in object meta:

openshift-ingress

kubelet

e2e-shared-a-w2-088c83-openshift-default-7dd4cd778b-n56w5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-4d485e-openshift-default-69788755f6-qf7tv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-c3ca75-797c7b55d7-nfhkb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-c3ca75-5446f78574-8twql

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w2-c3ca75-openshift-default-684696668-pv8zd

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-876808-6494cfc7b9-xwsw7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-876808-7c65579d9d-sqzzc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w4-876808-openshift-default-b6fbd76c4-f22b7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-876808-openshift-default-b6fbd76c4-f22b7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w4-876808-openshift-default-b6fbd76c4-f22b7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

e2e-ipp-a-9a2657-openshift-default-5bb9c475c4

SuccessfulCreate

Created pod: e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b

openshift-ingress

deployment-controller

e2e-ipp-a-9a2657-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-9a2657-openshift-default-5bb9c475c4 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-9a2657

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-9a2657

openshift-ingress

multus

e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b

AddedInterface

Add eth0 [10.132.0.86/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-9a2657-7d9c5fb7db

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-9a2657-7d9c5fb7db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-9a2657: serviceaccount "payload-processing-e2e-ipp-a-9a2657" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-9a2657

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-9a2657-88bfd9b9c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-9a2657-7d9c5fb7db

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-9a2657-7d9c5fb7db-mklz4

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-9a2657

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-9a2657-7d9c5fb7db from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-9a2657-88bfd9b9c

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-9a2657-88bfd9b9c-j657t
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-9a2657-88bfd9b9c

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-9a2657-88bfd9b9c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-9a2657: serviceaccount "payload-processing-e2e-ipp-a-9a2657" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-9a2657-88bfd9b9c-j657t

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-9a2657-88bfd9b9c-j657t

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-9a2657-7d9c5fb7db-mklz4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-9a2657-7d9c5fb7db-mklz4

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-9a2657-7d9c5fb7db-mklz4

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-a-9a2657-88bfd9b9c-j657t

AddedInterface

Add eth0 [10.133.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-9a2657-88bfd9b9c-j657t

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-9a2657-7d9c5fb7db-mklz4

AddedInterface

Add eth0 [10.134.0.86/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b

ProbeError

Readiness probe error: Get "http://10.132.0.86:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b

Unhealthy

Readiness probe failed: Get "http://10.132.0.86:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b

ProbeError

Startup probe error: Get "http://10.132.0.86:15021/healthz/ready": dial tcp 10.132.0.86:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b

Unhealthy

Startup probe failed: Get "http://10.132.0.86:15021/healthz/ready": dial tcp 10.132.0.86:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-5b711c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-5b711c

openshift-ingress

replicaset-controller

e2e-ipp-b-5b711c-openshift-default-76b46dfb86

SuccessfulCreate

Created pod: e2e-ipp-b-5b711c-openshift-default-76b46dfb86-qq7g4

openshift-ingress

multus

e2e-ipp-b-5b711c-openshift-default-76b46dfb86-qq7g4

AddedInterface

Add eth0 [10.134.0.87/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ipp-b-5b711c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-5b711c-openshift-default-76b46dfb86 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-5b711c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-5b711c-6f6c894c89 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-5b711c-85865587bb-5f94g

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-5b711c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-5b711c-85865587bb from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-5b711c-6f6c894c89

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-5b711c-6f6c894c89-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-5b711c: serviceaccount "payload-processing-e2e-ipp-b-5b711c" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-5b711c-6f6c894c89-88fpr

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-5b711c-6f6c894c89

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-5b711c-6f6c894c89-88fpr

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-5b711c-6f6c894c89-88fpr

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-5b711c-6f6c894c89-88fpr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-b-5b711c-6f6c894c89-88fpr

AddedInterface

Add eth0 [10.133.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-5b711c-85865587bb-5f94g

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-5b711c-85865587bb-5f94g

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-5b711c-85865587bb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-5b711c-85865587bb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-5b711c: serviceaccount "payload-processing-e2e-ipp-b-5b711c" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-5b711c-85865587bb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-5b711c-85865587bb-5f94g

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-5b711c-85865587bb-5f94g

AddedInterface

Add eth0 [10.134.0.88/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-b-5b711c-openshift-default-76b46dfb86-qq7g4

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-5b711c-openshift-default-76b46dfb86-qq7g4

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-5b711c-openshift-default-76b46dfb86-qq7g4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-b-5b711c-openshift-default-76b46dfb86-qq7g4

Unhealthy

Startup probe failed: Get "http://10.134.0.87:15021/healthz/ready": dial tcp 10.134.0.87:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-5b711c-openshift-default-76b46dfb86-qq7g4

ProbeError

Startup probe error: Get "http://10.134.0.87:15021/healthz/ready": dial tcp 10.134.0.87:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-ipp-cleanup-783804-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-783804-openshift-default-579dbbbcb from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-783804-openshift-default-579dbbbcb

SuccessfulCreate

Created pod: e2e-ipp-cleanup-783804-openshift-default-579dbbbcb-x97pw

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-783804

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-783804

openshift-ingress

multus

e2e-ipp-cleanup-783804-openshift-default-579dbbbcb-x97pw

AddedInterface

Add eth0 [10.134.0.90/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-783804-746986ddc8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-783804-746986ddc8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-783804: serviceaccount "payload-processing-e2e-ipp-cleanup-783804" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-783804

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-783804-5556ddd99f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-783804-5556ddd99f

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-783804-5556ddd99f-q6p76

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-783804-746986ddc8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-783804-746986ddc8-krjgc

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-783804

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-783804-746986ddc8 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-783804-5556ddd99f

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-783804-5556ddd99f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-783804: serviceaccount "payload-processing-e2e-ipp-cleanup-783804" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-783804-5556ddd99f-q6p76

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-783804-746986ddc8-krjgc

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-783804-746986ddc8-krjgc

AddedInterface

Add eth0 [10.134.0.91/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-783804-746986ddc8-krjgc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-783804-5556ddd99f-q6p76

AddedInterface

Add eth0 [10.133.0.80/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-783804-746986ddc8-krjgc

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-783804-5556ddd99f-q6p76

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-783804-5556ddd99f-q6p76

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-783804-openshift-default-579dbbbcb-x97pw

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-783804-openshift-default-579dbbbcb-x97pw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-783804-openshift-default-579dbbbcb-x97pw

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-783804-openshift-default-579dbbbcb-x97pw

ProbeError

Startup probe error: Get "http://10.134.0.90:15021/healthz/ready": dial tcp 10.134.0.90:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-783804-openshift-default-579dbbbcb-x97pw

Unhealthy

Startup probe failed: Get "http://10.134.0.90:15021/healthz/ready": dial tcp 10.134.0.90:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-783804-5556ddd99f-q6p76

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-783804-746986ddc8-krjgc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-783804-openshift-default-579dbbbcb-x97pw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-cleanup-783804-openshift-default-579dbbbcb-x97pw

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-cleanup-783804-openshift-default-579dbbbcb-x97pw

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-9a2657-88bfd9b9c-j657t

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-9a2657-7d9c5fb7db-mklz4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-9a2657-openshift-default-5bb9c475c4-x857b

Killing

Stopping container istio-proxy

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-b-5b711c

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-b-5b711c: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-b-5b711c": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-b-5b711c, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: d4500b43-cc0b-44ab-8bae-02957ac88745, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-5b711c-6f6c894c89-88fpr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-5b711c-85865587bb-5f94g

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-5b711c-openshift-default-76b46dfb86-qq7g4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-9511bd-69d77c4d7f-6qgz6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-9511bd-8d458d974-85lsm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w3-9511bd-openshift-default-8648dbcdc6-bdnhc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-dd25dd-57b899966c-t8hq4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-dd25dd-85477c9b8b-92knm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w3-dd25dd-openshift-default-7cd75b8676-q28qf

Killing

Stopping container istio-proxy