Time Namespace Component RelatedObject Reason Message

openshift-ingress

e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj to ip-10-0-128-41.ec2.internal

openshift-ingress

payload-processing-e2e-mt-5842bc8c-56d56f769-sj65g

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-5842bc8c-56d56f769-sj65g to ip-10-0-128-41.ec2.internal

openshift-ingress

payload-processing-e2e-ait-707dcc5c-85989d4dd7-ws5qn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-707dcc5c-85989d4dd7-ws5qn to ip-10-0-128-41.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-4bb7b3-56459fd4fd-5t59j

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-4bb7b3-56459fd4fd-5t59j to ip-10-0-134-169.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-746f54-78b844b659-gfl6b

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-746f54-78b844b659-gfl6b to ip-10-0-128-41.ec2.internal

openshift-ingress

e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj

Scheduled

Successfully assigned openshift-ingress/e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj to ip-10-0-128-41.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-e50cdb-799789b575-2xm25

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-e50cdb-799789b575-2xm25 to ip-10-0-138-252.ec2.internal

openshift-ingress

payload-processing-e2e-autores-80a7cc-6488b976fc-t8xgz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-80a7cc-6488b976fc-t8xgz to ip-10-0-134-169.ec2.internal

openshift-ingress

e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8

Scheduled

Successfully assigned openshift-ingress/e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8 to ip-10-0-128-41.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-8e248304-7d85cc786b-v7k4c

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-8e248304-7d85cc786b-v7k4c to ip-10-0-134-169.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-4441a1-6ff7fbf9cf-bdq5t

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-4441a1-6ff7fbf9cf-bdq5t to ip-10-0-138-252.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-e50cdb-6b58cb9994-25n6j

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-e50cdb-6b58cb9994-25n6j to ip-10-0-128-41.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-f9e4ef-8586584477-5ljzm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-f9e4ef-8586584477-5ljzm to ip-10-0-128-41.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-80a7cc-75fd9ff4-k4qs5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-80a7cc-75fd9ff4-k4qs5 to ip-10-0-138-252.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-707dcc5c-5564447578-72xsl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-707dcc5c-5564447578-72xsl to ip-10-0-128-41.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-nc9q7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-nc9q7 to ip-10-0-134-169.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-4d224

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-4d224 to ip-10-0-134-169.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-5ccb968c66-n4f4m

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-n4f4m to ip-10-0-138-252.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-a090a0-6b96b64966-t9wg8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-a090a0-6b96b64966-t9wg8 to ip-10-0-134-169.ec2.internal

openshift-ingress

e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x

Scheduled

Successfully assigned openshift-ingress/e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x to ip-10-0-128-41.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-583e9a-798555686-8vmrc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-583e9a-798555686-8vmrc to ip-10-0-128-41.ec2.internal

openshift-ingress

payload-processing-e2e-mt-14c2563f-57cf8b4cdf-tgrkz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-14c2563f-57cf8b4cdf-tgrkz to ip-10-0-128-41.ec2.internal

openshift-ingress

payload-processing-e2e-derive-974680ec-c86c579bf-mq5j9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-974680ec-c86c579bf-mq5j9 to ip-10-0-128-41.ec2.internal

openshift-ingress

e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9 to ip-10-0-128-41.ec2.internal

openshift-ingress

e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb to ip-10-0-128-41.ec2.internal

openshift-ingress

e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x

Scheduled

Successfully assigned openshift-ingress/e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x to ip-10-0-128-41.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-1293e7-8cdf44469-xljkk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-1293e7-8cdf44469-xljkk to ip-10-0-134-169.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-d418fd-5b7847d9f-vdqwp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-d418fd-5b7847d9f-vdqwp to ip-10-0-128-41.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-4bb7b3-7554f66d7f-gj7tl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-4bb7b3-7554f66d7f-gj7tl to ip-10-0-134-169.ec2.internal

openshift-ingress

e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp to ip-10-0-128-41.ec2.internal

openshift-ingress

e2e-api-a-746f54-openshift-default-8466df476d-s9rqw

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-746f54-openshift-default-8466df476d-s9rqw to ip-10-0-128-41.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-974680ec-7dc964686b-zrxms

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-974680ec-7dc964686b-zrxms to ip-10-0-128-41.ec2.internal

openshift-ingress

e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6 to ip-10-0-128-41.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-a5a300cf-57cb548b8b-86qjc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-a5a300cf-57cb548b8b-86qjc to ip-10-0-128-41.ec2.internal

openshift-ingress

e2e-shared-b-w3-d418fd-openshift-default-848d7cf44-tpt4g

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-d418fd-openshift-default-848d7cf44-tpt4g to ip-10-0-138-252.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-2aa332-8d4b44d4c-qj9q8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-2aa332-8d4b44d4c-qj9q8 to ip-10-0-134-169.ec2.internal

openshift-ingress

e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn to ip-10-0-128-41.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-66261e-69bf97f4f8-wl964

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-66261e-69bf97f4f8-wl964 to ip-10-0-134-169.ec2.internal

openshift-ingress

e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph to ip-10-0-128-41.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-fkt6n

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-fkt6n to ip-10-0-134-169.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-68cf4d799cn944f

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cn944f to ip-10-0-128-41.ec2.internal

openshift-ingress

e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d to ip-10-0-128-41.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-a5a300cf-77d5c8f794-28lv7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-a5a300cf-77d5c8f794-28lv7 to ip-10-0-128-41.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-d418fd-6774d98678-87fgz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-d418fd-6774d98678-87fgz to ip-10-0-128-41.ec2.internal

openshift-ingress

router-default-55fc4dcbd8-x64q6

Scheduled

Successfully assigned openshift-ingress/router-default-55fc4dcbd8-x64q6 to ip-10-0-128-41.ec2.internal

openshift-ingress

kube-auth-proxy-698b9db946-nq62k

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-698b9db946-nq62k to ip-10-0-128-41.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w4-66261e-64cb66b9ff-cn9b7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-66261e-64cb66b9ff-cn9b7 to ip-10-0-134-169.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-a090a0-6b87cd4745-ckgzh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-a090a0-6b87cd4745-ckgzh to ip-10-0-128-41.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-5842bc8c-678b48df9d-z7bk6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-5842bc8c-678b48df9d-z7bk6 to ip-10-0-138-252.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-14c2563f-7b979dc546-4gjtz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-14c2563f-7b979dc546-4gjtz to ip-10-0-128-41.ec2.internal

openshift-ingress

e2e-noten-fa9465-openshift-default-7cb57d49d-lv2zt

Scheduled

Successfully assigned openshift-ingress/e2e-noten-fa9465-openshift-default-7cb57d49d-lv2zt to ip-10-0-128-41.ec2.internal

openshift-ingress

kube-auth-proxy-698b9db946-8qhfv

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-698b9db946-8qhfv to ip-10-0-138-252.ec2.internal

openshift-ingress

e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x

Scheduled

Successfully assigned openshift-ingress/e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x to ip-10-0-128-41.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-746f54-f9b7c67f4-dx28h

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-746f54-f9b7c67f4-dx28h to ip-10-0-128-41.ec2.internal

openshift-ingress

e2e-inf-a-4441a1-openshift-default-7b8dcdd768-j644s

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-4441a1-openshift-default-7b8dcdd768-j644s to ip-10-0-138-252.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-583e9a-7854fbc79-vx72w

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-583e9a-7854fbc79-vx72w to ip-10-0-128-41.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-2aa332-59b4cfbf86-4lt9q

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-2aa332-59b4cfbf86-4lt9q to ip-10-0-128-41.ec2.internal

openshift-ingress

e2e-shared-a-w3-a090a0-openshift-default-6676bb465d-r2fjc

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-a090a0-openshift-default-6676bb465d-r2fjc to ip-10-0-138-252.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-1293e7-84c5dbbd5d-crvnq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-1293e7-84c5dbbd5d-crvnq to ip-10-0-134-169.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-4441a1-6d7b988694-g6jdb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-4441a1-6d7b988694-g6jdb to ip-10-0-134-169.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-f9e4ef-544469d9db-s4rrh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-f9e4ef-544469d9db-s4rrh to ip-10-0-128-41.ec2.internal

openshift-ingress

payload-processing-e2e-ait-8e248304-565bbc66bc-sgmfn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-8e248304-565bbc66bc-sgmfn to ip-10-0-128-41.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-48zf2

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-48zf2 to ip-10-0-138-252.ec2.internal

openshift-ingress

e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8

Scheduled

Successfully assigned openshift-ingress/e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8 to ip-10-0-128-41.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-55fc4dcbd8 from 0 to 1
(x11)

openshift-ingress

replicaset-controller

router-default-55fc4dcbd8

FailedCreate

Error creating: pods "router-default-55fc4dcbd8-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x17)

openshift-ingress

replicaset-controller

router-default-55fc4dcbd8

FailedCreate

Error creating: pods "router-default-55fc4dcbd8-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-55fc4dcbd8

SuccessfulCreate

Created pod: router-default-55fc4dcbd8-x64q6

openshift-ingress

multus

router-default-55fc4dcbd8-x64q6

AddedInterface

Add eth0 [10.133.0.11/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-55fc4dcbd8-x64q6

Started

Started container router

openshift-ingress

kubelet

router-default-55fc4dcbd8-x64q6

Created

Created container: router

openshift-ingress

kubelet

router-default-55fc4dcbd8-x64q6

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:48526e08a2a06d05806dbcf3ddb069e5182371667d9e9f7d2cf09f60cd247d20" already present on machine
(x3)

openshift-ingress

replicaset-controller

kube-auth-proxy-698b9db946

FailedCreate

Error creating: pods "kube-auth-proxy-698b9db946-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-698b9db946 from 0 to 2

openshift-ingress

multus

kube-auth-proxy-698b9db946-nq62k

AddedInterface

Add eth0 [10.133.0.30/23] from ovn-kubernetes

openshift-ingress

multus

kube-auth-proxy-698b9db946-8qhfv

AddedInterface

Add eth0 [10.132.0.19/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

kube-auth-proxy-698b9db946

SuccessfulCreate

Created pod: kube-auth-proxy-698b9db946-8qhfv

openshift-ingress

replicaset-controller

kube-auth-proxy-698b9db946

SuccessfulCreate

Created pod: kube-auth-proxy-698b9db946-nq62k

openshift-ingress

kubelet

kube-auth-proxy-698b9db946-nq62k

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

kubelet

kube-auth-proxy-698b9db946-8qhfv

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-48zf2

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-48zf2

AddedInterface

Add eth0 [10.132.0.20/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-698b9db946-8qhfv

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-48zf2

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

kube-auth-proxy-698b9db946-nq62k

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-698b9db946-nq62k

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-698b9db946-nq62k

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.74s (2.74s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-698b9db946-8qhfv

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-698b9db946-8qhfv

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.712s (2.712s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-48zf2

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-48zf2

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-48zf2

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.59s (2.59s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-48zf2

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-48zf2

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-68cf4d799c from 0 to 1

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-68cf4d799c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-68cf4d799cn944f

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cn944f

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-68cf4d799cn944f

AddedInterface

Add eth0 [10.133.0.32/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cn944f

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cn944f

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cn944f

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 3.89s (3.89s including waiting). Image size: 181318953 bytes.

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-fkt6n

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-fkt6n

AddedInterface

Add eth0 [10.134.0.25/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-fkt6n

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-fkt6n

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-fkt6n

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.508s (2.508s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-fkt6n

Created

Created container: discovery
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-fkt6n

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-fkt6n

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-48zf2

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-48zf2

Killing

Stopping container discovery

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5ccb968c66

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5ccb968c66-n4f4m

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-5ccb968c66 from 0 to 1

openshift-ingress

multus

maas-default-gateway-openshift-default-5ccb968c66-n4f4m

AddedInterface

Add eth0 [10.132.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-n4f4m

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-n4f4m

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 5.302s (5.302s including waiting). Image size: 181318953 bytes.

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-4d224

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-nc9q7
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-nc9q7

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-nc9q7

AddedInterface

Add eth0 [10.134.0.32/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-5b54b7fbb7-4d224

AddedInterface

Add eth0 [10.134.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-4d224

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-nc9q7

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.631s (1.631s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-nc9q7

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-nc9q7

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-4d224

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.528s (1.528s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-4d224

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-4d224

Started

Started container payload-processing

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-n4f4m

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-n4f4m

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-n4f4m

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-n4f4m

ProbeError

Startup probe error: Get "http://10.132.0.33:15021/healthz/ready": dial tcp 10.132.0.33:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-n4f4m

Unhealthy

Startup probe failed: Get "http://10.132.0.33:15021/healthz/ready": dial tcp 10.132.0.33:15021: connect: connection refused

openshift-ingress

multus

e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph

AddedInterface

Add eth0 [10.133.0.49/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-1293e7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-1293e7

openshift-ingress

multus

e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w0-1293e7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-1293e7-openshift-default-567dbc6586 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-4441a1-openshift-default-7b8dcdd768

SuccessfulCreate

Created pod: e2e-inf-a-4441a1-openshift-default-7b8dcdd768-j644s

openshift-ingress

deployment-controller

e2e-inf-a-4441a1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-4441a1-openshift-default-7b8dcdd768 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-66261e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-66261e

openshift-ingress

deployment-controller

e2e-worker-w4-66261e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-66261e-openshift-default-86bd889684 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w0-1293e7-openshift-default-567dbc6586

SuccessfulCreate

Created pod: e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn

openshift-ingress

replicaset-controller

e2e-worker-w4-66261e-openshift-default-86bd889684

SuccessfulCreate

Created pod: e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph

openshift-ingress

gateway_labeler_controller

e2e-inf-a-4441a1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-4441a1

openshift-ingress

multus

e2e-inf-a-4441a1-openshift-default-7b8dcdd768-j644s

AddedInterface

Add eth0 [10.132.0.39/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-1293e7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-1293e7-84c5dbbd5d from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-1293e7-8cdf44469

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-1293e7-8cdf44469-xljkk
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-1293e7-8cdf44469

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-1293e7-8cdf44469-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-1293e7: serviceaccount "payload-processing-e2e-worker-w0-1293e7" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-1293e7-84c5dbbd5d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-1293e7-84c5dbbd5d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-1293e7: serviceaccount "payload-processing-e2e-worker-w0-1293e7" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-1293e7-84c5dbbd5d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-1293e7-84c5dbbd5d-crvnq

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-1293e7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-1293e7-8cdf44469 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-worker-w0-1293e7-8cdf44469-xljkk

AddedInterface

Add eth0 [10.134.0.37/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-autores-80a7cc

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-80a7cc

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-66261e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-66261e-69bf97f4f8 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-1293e7-84c5dbbd5d-crvnq

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-66261e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-66261e-64cb66b9ff from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-1293e7-8cdf44469-xljkk

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-1293e7-8cdf44469-xljkk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-1293e7-84c5dbbd5d-crvnq

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-1293e7-84c5dbbd5d-crvnq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-1293e7-84c5dbbd5d-crvnq

AddedInterface

Add eth0 [10.134.0.36/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-1293e7-8cdf44469-xljkk

Started

Started container payload-processing

openshift-ingress

replicaset-controller

e2e-autores-80a7cc-openshift-default-5f789585f4

SuccessfulCreate

Created pod: e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-66261e-69bf97f4f8-wl964

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-66261e-69bf97f4f8-wl964

Created

Created container: payload-pre-processing

openshift-ingress

multus

e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-66261e-64cb66b9ff-cn9b7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-66261e-69bf97f4f8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-66261e-69bf97f4f8-wl964

openshift-ingress

multus

payload-processing-e2e-worker-w4-66261e-64cb66b9ff-cn9b7

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-66261e-69bf97f4f8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-66261e-69bf97f4f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-66261e: serviceaccount "payload-processing-e2e-worker-w4-66261e" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-66261e-64cb66b9ff-cn9b7

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-66261e-64cb66b9ff-cn9b7

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-66261e-64cb66b9ff

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-66261e-64cb66b9ff-cn9b7

openshift-ingress

deployment-controller

e2e-autores-80a7cc-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-80a7cc-openshift-default-5f789585f4 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-66261e-69bf97f4f8-wl964

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-66261e-64cb66b9ff

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-66261e-64cb66b9ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-66261e: serviceaccount "payload-processing-e2e-worker-w4-66261e" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-66261e-69bf97f4f8-wl964

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-4441a1-6ff7fbf9cf-bdq5t

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-e2e-inf-a-4441a1-6ff7fbf9cf-bdq5t

AddedInterface

Add eth0 [10.132.0.40/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-4441a1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-4441a1-6d7b988694 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-4441a1-6d7b988694

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-4441a1-6d7b988694-g6jdb
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-4441a1-6d7b988694

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-4441a1-6d7b988694-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-4441a1: serviceaccount "payload-processing-e2e-inf-a-4441a1" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-4441a1-6d7b988694-g6jdb

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-4441a1-6d7b988694-g6jdb

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-4441a1-6d7b988694-g6jdb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-4441a1-6d7b988694-g6jdb

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-4441a1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-4441a1-6ff7fbf9cf from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-4441a1-6ff7fbf9cf

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-4441a1-6ff7fbf9cf-bdq5t
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-4441a1-6ff7fbf9cf

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-4441a1-6ff7fbf9cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-4441a1: serviceaccount "payload-processing-e2e-inf-a-4441a1" not found

openshift-ingress

replicaset-controller

e2e-ait-8e248304-openshift-default-84c6c598b4

SuccessfulCreate

Created pod: e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x

openshift-ingress

deployment-controller

e2e-ait-8e248304-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-8e248304-openshift-default-84c6c598b4 from 0 to 1

openshift-ingress

multus

e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ait-8e248304

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-8e248304

openshift-ingress

kubelet

payload-processing-e2e-inf-a-4441a1-6ff7fbf9cf-bdq5t

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.321s (1.321s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-processing-e2e-inf-a-4441a1-6ff7fbf9cf-bdq5t

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-4441a1-6ff7fbf9cf-bdq5t

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-8e248304-565bbc66bc

SuccessfulCreate

Created pod: payload-processing-e2e-ait-8e248304-565bbc66bc-sgmfn
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-8e248304-7d85cc786b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-8e248304-7d85cc786b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-8e248304: serviceaccount "payload-processing-e2e-ait-8e248304" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-8e248304-7d85cc786b-v7k4c

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-8e248304-565bbc66bc

FailedCreate

Error creating: pods "payload-processing-e2e-ait-8e248304-565bbc66bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-8e248304: serviceaccount "payload-processing-e2e-ait-8e248304" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-8e248304-7d85cc786b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-8e248304-7d85cc786b-v7k4c

openshift-ingress

deployment-controller

payload-processing-e2e-ait-8e248304

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-8e248304-565bbc66bc from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-8e248304-565bbc66bc-sgmfn

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-e2e-ait-8e248304-565bbc66bc-sgmfn

AddedInterface

Add eth0 [10.133.0.54/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-8e248304

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-8e248304-7d85cc786b from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ait-8e248304-7d85cc786b-v7k4c

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-8e248304-7d85cc786b-v7k4c

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-8e248304-7d85cc786b-v7k4c

Created

Created container: payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-80a7cc

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-80a7cc-75fd9ff4 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-8e248304-565bbc66bc-sgmfn

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-80a7cc-6488b976fc

FailedCreate

Error creating: pods "payload-processing-e2e-autores-80a7cc-6488b976fc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-80a7cc: serviceaccount "payload-processing-e2e-autores-80a7cc" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-80a7cc-6488b976fc

SuccessfulCreate

Created pod: payload-processing-e2e-autores-80a7cc-6488b976fc-t8xgz

openshift-ingress

kubelet

payload-processing-e2e-ait-8e248304-565bbc66bc-sgmfn

Created

Created container: payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-80a7cc-75fd9ff4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-80a7cc-75fd9ff4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-80a7cc: serviceaccount "payload-processing-e2e-autores-80a7cc" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-80a7cc-75fd9ff4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-80a7cc-75fd9ff4-k4qs5

openshift-ingress

kubelet

payload-processing-e2e-ait-8e248304-565bbc66bc-sgmfn

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.838s (1.838s including waiting). Image size: 166449312 bytes.

openshift-ingress

deployment-controller

payload-processing-e2e-autores-80a7cc

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-80a7cc-6488b976fc from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-80a7cc-75fd9ff4-k4qs5

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-80a7cc-6488b976fc-t8xgz

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-80a7cc-6488b976fc-t8xgz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-80a7cc-75fd9ff4-k4qs5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-autores-80a7cc-6488b976fc-t8xgz

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-80a7cc-75fd9ff4-k4qs5

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-80a7cc-6488b976fc-t8xgz

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-autores-80a7cc-75fd9ff4-k4qs5

AddedInterface

Add eth0 [10.132.0.42/23] from ovn-kubernetes

openshift-ingress

multus

e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph

Unhealthy

Readiness probe failed: Get "http://10.133.0.49:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph

ProbeError

Readiness probe error: Get "http://10.133.0.49:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

deployment-controller

e2e-inf-b-2aa332-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-2aa332-openshift-default-b94f494dd from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-2aa332-openshift-default-b94f494dd

SuccessfulCreate

Created pod: e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9

openshift-ingress

gateway_labeler_controller

e2e-inf-b-2aa332

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-2aa332
(x2)

openshift-ingress

kubelet

e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-4441a1-openshift-default-7b8dcdd768-j644s

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-4441a1-openshift-default-7b8dcdd768-j644s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-4441a1-openshift-default-7b8dcdd768-j644s

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-inf-a-4441a1-openshift-default-7b8dcdd768-j644s

ProbeError

Startup probe error: Get "http://10.132.0.39:15021/healthz/ready": dial tcp 10.132.0.39:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-a-4441a1-openshift-default-7b8dcdd768-j644s

Unhealthy

Startup probe failed: Get "http://10.132.0.39:15021/healthz/ready": dial tcp 10.132.0.39:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-2aa332

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-2aa332-8d4b44d4c from 0 to 1
(x6)

openshift-ingress

kubelet

e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph

Unhealthy

Startup probe failed: Get "http://10.133.0.49:15021/healthz/ready": dial tcp 10.133.0.49:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph

ProbeError

Startup probe error: Get "http://10.133.0.49:15021/healthz/ready": dial tcp 10.133.0.49:15021: connect: connection refused body:

openshift-ingress

multus

payload-processing-e2e-inf-b-2aa332-8d4b44d4c-qj9q8

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-2aa332-59b4cfbf86-4lt9q

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x7)

openshift-ingress

kubelet

e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn

Unhealthy

Startup probe failed: Get "http://10.133.0.48:15021/healthz/ready": dial tcp 10.133.0.48:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-inf-b-2aa332-8d4b44d4c-qj9q8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-b-2aa332-8d4b44d4c-qj9q8

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-2aa332-59b4cfbf86-4lt9q

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-2aa332-59b4cfbf86-4lt9q

Created

Created container: payload-pre-processing
(x7)

openshift-ingress

kubelet

e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn

ProbeError

Startup probe error: Get "http://10.133.0.48:15021/healthz/ready": dial tcp 10.133.0.48:15021: connect: connection refused body:

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-2aa332-59b4cfbf86-4lt9q

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-2aa332-59b4cfbf86

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-2aa332-59b4cfbf86-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-2aa332: serviceaccount "payload-processing-e2e-inf-b-2aa332" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-2aa332-59b4cfbf86

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-2aa332-59b4cfbf86-4lt9q

openshift-ingress

kubelet

payload-processing-e2e-inf-b-2aa332-8d4b44d4c-qj9q8

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-2aa332-8d4b44d4c

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-2aa332-8d4b44d4c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-2aa332: serviceaccount "payload-processing-e2e-inf-b-2aa332" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-2aa332-8d4b44d4c

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-2aa332-8d4b44d4c-qj9q8

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-2aa332

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-2aa332-59b4cfbf86 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x

ProbeError

Startup probe error: Get "http://10.133.0.53:15021/healthz/ready": dial tcp 10.133.0.53:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x

Unhealthy

Startup probe failed: Get "http://10.133.0.53:15021/healthz/ready": dial tcp 10.133.0.53:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x

Unhealthy

Startup probe failed: Get "http://10.133.0.52:15021/healthz/ready": dial tcp 10.133.0.52:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x

ProbeError

Startup probe error: Get "http://10.133.0.52:15021/healthz/ready": dial tcp 10.133.0.52:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ait-8e248304-565bbc66bc-sgmfn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-8e248304-openshift-default-84c6c598b4-gd56x

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-8e248304-7d85cc786b-v7k4c

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b

SuccessfulCreate

Created pod: e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp

openshift-ingress

deployment-controller

e2e-migrate-a5a300cf-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-migrate-a5a300cf-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-a5a300cf-gw

openshift-ingress

multus

e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-a5a300cf-57cb548b8b

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-a5a300cf-57cb548b8b-86qjc
(x2)

openshift-ingress

kubelet

e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-a5a300cf-77d5c8f794-28lv7

Started

Started container payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-a5a300cf-77d5c8f794

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-a5a300cf-77d5c8f794-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-a5a300cf: serviceaccount "payload-processing-e2e-migrate-a5a300cf" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-a5a300cf-77d5c8f794

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-a5a300cf-77d5c8f794-28lv7

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-a5a300cf-77d5c8f794-28lv7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-a5a300cf

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-a5a300cf-77d5c8f794 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-a5a300cf

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-a5a300cf-57cb548b8b from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-a5a300cf-57cb548b8b

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-a5a300cf-57cb548b8b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-a5a300cf: serviceaccount "payload-processing-e2e-migrate-a5a300cf" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-a5a300cf-77d5c8f794-28lv7

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9

Started

Started container istio-proxy

openshift-ingress

multus

payload-pre-processing-e2e-migrate-a5a300cf-77d5c8f794-28lv7

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-migrate-a5a300cf-57cb548b8b-86qjc

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-a5a300cf-57cb548b8b-86qjc

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-a5a300cf-57cb548b8b-86qjc

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-a5a300cf-57cb548b8b-86qjc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

kubelet

e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9

Unhealthy

Startup probe failed: Get "http://10.133.0.55:15021/healthz/ready": dial tcp 10.133.0.55:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9

ProbeError

Startup probe error: Get "http://10.133.0.55:15021/healthz/ready": dial tcp 10.133.0.55:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp

Unhealthy

Startup probe failed: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp

ProbeError

Startup probe error: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused body:

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-migrate-a5a300cf

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-migrate-a5a300cf: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-migrate-a5a300cf": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-migrate-a5a300cf, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: b9c83e0c-6150-402c-9091-59cd8e0b1c94, UID in object meta:

openshift-ingress

kubelet

e2e-migrate-a5a300cf-gw-openshift-default-d9695ff5b-cl4wp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-a5a300cf-77d5c8f794-28lv7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-a5a300cf-57cb548b8b-86qjc

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-ait-707dcc5c-openshift-default-77c978f868

SuccessfulCreate

Created pod: e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8

openshift-ingress

multus

e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8

AddedInterface

Add eth0 [10.133.0.62/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ait-707dcc5c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-707dcc5c-openshift-default-77c978f868 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-707dcc5c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-707dcc5c

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-707dcc5c-85989d4dd7

SuccessfulCreate

Created pod: payload-processing-e2e-ait-707dcc5c-85989d4dd7-ws5qn
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-707dcc5c-85989d4dd7

FailedCreate

Error creating: pods "payload-processing-e2e-ait-707dcc5c-85989d4dd7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-707dcc5c: serviceaccount "payload-processing-e2e-ait-707dcc5c" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-707dcc5c-5564447578

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-707dcc5c-5564447578-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-707dcc5c: serviceaccount "payload-processing-e2e-ait-707dcc5c" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-707dcc5c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-707dcc5c-85989d4dd7 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-707dcc5c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-707dcc5c-5564447578 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-707dcc5c-5564447578

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-707dcc5c-5564447578-72xsl

openshift-ingress

kubelet

payload-processing-e2e-ait-707dcc5c-85989d4dd7-ws5qn

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-707dcc5c-5564447578-72xsl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-707dcc5c-5564447578-72xsl

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-707dcc5c-5564447578-72xsl

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-707dcc5c-5564447578-72xsl

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ait-707dcc5c-85989d4dd7-ws5qn

AddedInterface

Add eth0 [10.133.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-707dcc5c-85989d4dd7-ws5qn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-707dcc5c-85989d4dd7-ws5qn

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8

ProbeError

Startup probe error: Get "http://10.133.0.62:15021/healthz/ready": dial tcp 10.133.0.62:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8

Unhealthy

Startup probe failed: Get "http://10.133.0.62:15021/healthz/ready": dial tcp 10.133.0.62:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ait-707dcc5c-85989d4dd7-ws5qn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-707dcc5c-5564447578-72xsl

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-derive-974680ec-openshift-default-5477f5c74d

SuccessfulCreate

Created pod: e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8

openshift-ingress

deployment-controller

e2e-derive-974680ec-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-974680ec-openshift-default-5477f5c74d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-derive-974680ec

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-974680ec

openshift-ingress

multus

e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8

AddedInterface

Add eth0 [10.133.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-707dcc5c-openshift-default-77c978f868-64lt8

Killing

Stopping container istio-proxy
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-974680ec-7dc964686b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-974680ec-7dc964686b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-974680ec: serviceaccount "payload-processing-e2e-derive-974680ec" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-974680ec

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-974680ec-7dc964686b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-974680ec-7dc964686b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-974680ec-7dc964686b-zrxms
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-974680ec-c86c579bf

FailedCreate

Error creating: pods "payload-processing-e2e-derive-974680ec-c86c579bf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-974680ec: serviceaccount "payload-processing-e2e-derive-974680ec" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-974680ec-c86c579bf

SuccessfulCreate

Created pod: payload-processing-e2e-derive-974680ec-c86c579bf-mq5j9

openshift-ingress

deployment-controller

payload-processing-e2e-derive-974680ec

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-974680ec-c86c579bf from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-derive-974680ec-7dc964686b-zrxms

AddedInterface

Add eth0 [10.133.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-974680ec-c86c579bf-mq5j9

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-974680ec-7dc964686b-zrxms

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-974680ec-7dc964686b-zrxms

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-974680ec-c86c579bf-mq5j9

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-974680ec-7dc964686b-zrxms

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-derive-974680ec-c86c579bf-mq5j9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-derive-974680ec-c86c579bf-mq5j9

AddedInterface

Add eth0 [10.133.0.68/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x7)

openshift-ingress

kubelet

e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8

ProbeError

Startup probe error: Get "http://10.133.0.66:15021/healthz/ready": dial tcp 10.133.0.66:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8

Unhealthy

Startup probe failed: Get "http://10.133.0.66:15021/healthz/ready": dial tcp 10.133.0.66:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-974680ec-7dc964686b-zrxms

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-974680ec-c86c579bf-mq5j9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-derive-974680ec-openshift-default-5477f5c74d-xf4w8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-80a7cc-75fd9ff4-k4qs5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-80a7cc-6488b976fc-t8xgz

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-explicit-f9e4ef

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-f9e4ef

openshift-ingress

kubelet

e2e-autores-80a7cc-openshift-default-5f789585f4-bpw9x

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-explicit-f9e4ef-openshift-default-7884cdcffb

SuccessfulCreate

Created pod: e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6

openshift-ingress

deployment-controller

e2e-explicit-f9e4ef-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-f9e4ef-openshift-default-7884cdcffb from 0 to 1

openshift-ingress

multus

e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6

AddedInterface

Add eth0 [10.133.0.72/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-f9e4ef

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-f9e4ef-8586584477 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-f9e4ef

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-f9e4ef-544469d9db from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-f9e4ef-544469d9db

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-f9e4ef-544469d9db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-f9e4ef: serviceaccount "payload-processing-e2e-explicit-f9e4ef" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-f9e4ef-544469d9db-s4rrh

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-explicit-f9e4ef-8586584477-5ljzm

AddedInterface

Add eth0 [10.133.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-f9e4ef-8586584477-5ljzm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-explicit-f9e4ef-8586584477-5ljzm

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-explicit-f9e4ef-544469d9db-s4rrh

AddedInterface

Add eth0 [10.133.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-f9e4ef-544469d9db-s4rrh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-f9e4ef-8586584477

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-f9e4ef-8586584477-5ljzm

openshift-ingress

kubelet

payload-processing-e2e-explicit-f9e4ef-8586584477-5ljzm

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-f9e4ef-8586584477

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-f9e4ef-8586584477-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-f9e4ef: serviceaccount "payload-processing-e2e-explicit-f9e4ef" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-f9e4ef-544469d9db-s4rrh

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-f9e4ef-544469d9db

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-f9e4ef-544469d9db-s4rrh
(x2)

openshift-ingress

kubelet

e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6

Unhealthy

Startup probe failed: Get "http://10.133.0.72:15021/healthz/ready": dial tcp 10.133.0.72:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6

ProbeError

Startup probe error: Get "http://10.133.0.72:15021/healthz/ready": dial tcp 10.133.0.72:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-f9e4ef-544469d9db-s4rrh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-f9e4ef-8586584477-5ljzm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

e2e-noten-fa9465-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-fa9465-openshift-default-7cb57d49d from 0 to 1

openshift-ingress

kubelet

e2e-explicit-f9e4ef-openshift-default-7884cdcffb-7vhp6

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

e2e-noten-fa9465-openshift-default-7cb57d49d

SuccessfulCreate

Created pod: e2e-noten-fa9465-openshift-default-7cb57d49d-lv2zt

openshift-ingress

gateway_labeler_controller

e2e-noten-fa9465

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-fa9465

openshift-ingress

kubelet

e2e-noten-fa9465-openshift-default-7cb57d49d-lv2zt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-noten-fa9465-openshift-default-7cb57d49d-lv2zt

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-noten-fa9465-openshift-default-7cb57d49d-lv2zt

Started

Started container istio-proxy

openshift-ingress

multus

e2e-noten-fa9465-openshift-default-7cb57d49d-lv2zt

AddedInterface

Add eth0 [10.133.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-fa9465-openshift-default-7cb57d49d-lv2zt

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-mt-14c2563f-openshift-default-579cff8cb8

SuccessfulCreate

Created pod: e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj

openshift-ingress

gateway_labeler_controller

e2e-mt-14c2563f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-14c2563f

openshift-ingress

deployment-controller

e2e-mt-14c2563f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-14c2563f-openshift-default-579cff8cb8 from 0 to 1

openshift-ingress

multus

e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj

AddedInterface

Add eth0 [10.133.0.82/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-14c2563f-7b979dc546

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-14c2563f-7b979dc546-4gjtz

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-14c2563f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-14c2563f-7b979dc546 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-14c2563f-57cf8b4cdf

SuccessfulCreate

Created pod: payload-processing-e2e-mt-14c2563f-57cf8b4cdf-tgrkz
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-14c2563f-57cf8b4cdf

FailedCreate

Error creating: pods "payload-processing-e2e-mt-14c2563f-57cf8b4cdf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-14c2563f: serviceaccount "payload-processing-e2e-mt-14c2563f" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-14c2563f-7b979dc546

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-14c2563f-7b979dc546-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-14c2563f: serviceaccount "payload-processing-e2e-mt-14c2563f" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-14c2563f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-14c2563f-57cf8b4cdf from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-14c2563f-7b979dc546-4gjtz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-14c2563f-57cf8b4cdf-tgrkz

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-mt-14c2563f-57cf8b4cdf-tgrkz

AddedInterface

Add eth0 [10.133.0.84/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-14c2563f-57cf8b4cdf-tgrkz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-14c2563f-57cf8b4cdf-tgrkz

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-14c2563f-7b979dc546-4gjtz

AddedInterface

Add eth0 [10.133.0.83/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-14c2563f-7b979dc546-4gjtz

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-14c2563f-7b979dc546-4gjtz

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj

ProbeError

Readiness probe error: Get "http://10.133.0.82:15021/healthz/ready": dial tcp 10.133.0.82:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj

Unhealthy

Readiness probe failed: Get "http://10.133.0.82:15021/healthz/ready": dial tcp 10.133.0.82:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj

Unhealthy

Startup probe failed: Get "http://10.133.0.82:15021/healthz/ready": dial tcp 10.133.0.82:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj

ProbeError

Startup probe error: Get "http://10.133.0.82:15021/healthz/ready": dial tcp 10.133.0.82:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-14c2563f-7b979dc546-4gjtz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-14c2563f-57cf8b4cdf-tgrkz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-14c2563f-openshift-default-579cff8cb8-2hkzj

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-583e9a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-583e9a

openshift-ingress

replicaset-controller

e2e-shared-a-w2-583e9a-openshift-default-5556fff988

SuccessfulCreate

Created pod: e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj

openshift-ingress

multus

e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj

AddedInterface

Add eth0 [10.133.0.90/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-a-w2-583e9a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-583e9a-openshift-default-5556fff988 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-583e9a-798555686

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-583e9a-798555686-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-583e9a: serviceaccount "payload-processing-e2e-shared-a-w2-583e9a" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-583e9a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-583e9a-798555686 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-583e9a-7854fbc79

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-583e9a-7854fbc79-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-583e9a: serviceaccount "payload-processing-e2e-shared-a-w2-583e9a" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-583e9a-798555686

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-583e9a-798555686-8vmrc

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-583e9a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-583e9a-7854fbc79 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-583e9a-7854fbc79

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-583e9a-7854fbc79-vx72w

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-583e9a-7854fbc79-vx72w

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-583e9a-798555686-8vmrc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-583e9a-798555686-8vmrc

AddedInterface

Add eth0 [10.133.0.92/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-583e9a-7854fbc79-vx72w

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-583e9a-7854fbc79-vx72w

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-583e9a-7854fbc79-vx72w

AddedInterface

Add eth0 [10.133.0.91/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-583e9a-798555686-8vmrc

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-583e9a-798555686-8vmrc

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd

SuccessfulCreate

Created pod: e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb

openshift-ingress

deployment-controller

e2e-shared-b-w2-4bb7b3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-4bb7b3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-4bb7b3

openshift-ingress

multus

e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb

AddedInterface

Add eth0 [10.133.0.93/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj

Started

Started container istio-proxy

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-4bb7b3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-4bb7b3-56459fd4fd from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-4bb7b3-56459fd4fd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-4bb7b3-56459fd4fd-5t59j

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-4bb7b3-7554f66d7f-gj7tl

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-4bb7b3-7554f66d7f-gj7tl

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-4bb7b3-7554f66d7f-gj7tl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-4bb7b3-7554f66d7f-gj7tl

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-4bb7b3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-4bb7b3-7554f66d7f from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-4bb7b3-7554f66d7f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-4bb7b3-7554f66d7f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-4bb7b3: serviceaccount "payload-processing-e2e-shared-b-w2-4bb7b3" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-4bb7b3-56459fd4fd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-4bb7b3-56459fd4fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-4bb7b3: serviceaccount "payload-processing-e2e-shared-b-w2-4bb7b3" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-4bb7b3-7554f66d7f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-4bb7b3-7554f66d7f-gj7tl

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-4bb7b3-56459fd4fd-5t59j

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-4bb7b3-56459fd4fd-5t59j

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-4bb7b3-56459fd4fd-5t59j

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-4bb7b3-56459fd4fd-5t59j

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj

Unhealthy

Startup probe failed: Get "http://10.133.0.90:15021/healthz/ready": dial tcp 10.133.0.90:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj

ProbeError

Startup probe error: Get "http://10.133.0.90:15021/healthz/ready": dial tcp 10.133.0.90:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb

ProbeError

Startup probe error: Get "http://10.133.0.93:15021/healthz/ready": dial tcp 10.133.0.93:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb

Unhealthy

Startup probe failed: Get "http://10.133.0.93:15021/healthz/ready": dial tcp 10.133.0.93:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-mt-5842bc8c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-5842bc8c

openshift-ingress

deployment-controller

e2e-mt-5842bc8c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-5842bc8c-openshift-default-5f95546cbd from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-5842bc8c-openshift-default-5f95546cbd

SuccessfulCreate

Created pod: e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x

openshift-ingress

multus

e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x

AddedInterface

Add eth0 [10.133.0.98/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-5842bc8c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-5842bc8c-678b48df9d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-5842bc8c-56d56f769

FailedCreate

Error creating: pods "payload-processing-e2e-mt-5842bc8c-56d56f769-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-5842bc8c: serviceaccount "payload-processing-e2e-mt-5842bc8c" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-5842bc8c-678b48df9d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-5842bc8c-678b48df9d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-5842bc8c: serviceaccount "payload-processing-e2e-mt-5842bc8c" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-5842bc8c-678b48df9d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-5842bc8c-678b48df9d-z7bk6

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-5842bc8c-56d56f769

SuccessfulCreate

Created pod: payload-processing-e2e-mt-5842bc8c-56d56f769-sj65g

openshift-ingress

deployment-controller

payload-processing-e2e-mt-5842bc8c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-5842bc8c-56d56f769 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-mt-5842bc8c-678b48df9d-z7bk6

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-5842bc8c-56d56f769-sj65g

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-5842bc8c-56d56f769-sj65g

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-mt-5842bc8c-56d56f769-sj65g

AddedInterface

Add eth0 [10.133.0.99/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-5842bc8c-678b48df9d-z7bk6

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-5842bc8c-56d56f769-sj65g

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-5842bc8c-678b48df9d-z7bk6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-5842bc8c-678b48df9d-z7bk6

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x

Unhealthy

Startup probe failed: Get "http://10.133.0.98:15021/healthz/ready": dial tcp 10.133.0.98:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x

ProbeError

Startup probe error: Get "http://10.133.0.98:15021/healthz/ready": dial tcp 10.133.0.98:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-inf-a-4441a1-openshift-default-7b8dcdd768-j644s

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-4441a1-openshift-default-7b8dcdd768-j644s

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-a-4441a1-openshift-default-7b8dcdd768-j644s

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-mt-5842bc8c-56d56f769-sj65g

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-5842bc8c-678b48df9d-z7bk6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-5842bc8c-openshift-default-5f95546cbd-jv67x

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-a090a0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-a090a0

openshift-ingress

kubelet

e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-a-w3-a090a0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-a090a0-openshift-default-6676bb465d from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w3-a090a0-openshift-default-6676bb465d

SuccessfulCreate

Created pod: e2e-shared-a-w3-a090a0-openshift-default-6676bb465d-r2fjc

openshift-ingress

multus

e2e-shared-a-w3-a090a0-openshift-default-6676bb465d-r2fjc

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-b-2aa332-openshift-default-b94f494dd-x48k9

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-a090a0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-a090a0-6b87cd4745 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-a090a0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-a090a0-6b96b64966 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-a090a0-6b96b64966

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-a090a0-6b96b64966-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-a090a0: serviceaccount "payload-processing-e2e-shared-a-w3-a090a0" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-a090a0-6b87cd4745

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-a090a0-6b87cd4745-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-a090a0: serviceaccount "payload-processing-e2e-shared-a-w3-a090a0" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-a090a0-6b96b64966

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-a090a0-6b96b64966-t9wg8

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-a090a0-6b87cd4745

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-a090a0-6b87cd4745-ckgzh

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-a090a0-6b87cd4745-ckgzh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-a090a0-6b87cd4745-ckgzh

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-a090a0-6b96b64966-t9wg8

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-a090a0-6b96b64966-t9wg8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-a090a0-6b96b64966-t9wg8

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-a090a0-6b96b64966-t9wg8

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-a090a0-6b87cd4745-ckgzh

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-a090a0-6b87cd4745-ckgzh

AddedInterface

Add eth0 [10.133.0.104/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-a090a0-openshift-default-6676bb465d-r2fjc

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-a090a0-openshift-default-6676bb465d-r2fjc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-a090a0-openshift-default-6676bb465d-r2fjc

Started

Started container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-b-w3-d418fd-openshift-default-848d7cf44

SuccessfulCreate

Created pod: e2e-shared-b-w3-d418fd-openshift-default-848d7cf44-tpt4g

openshift-ingress

deployment-controller

e2e-shared-b-w3-d418fd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-d418fd-openshift-default-848d7cf44 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-d418fd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-d418fd
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-a090a0-openshift-default-6676bb465d-r2fjc

ProbeError

Startup probe error: Get "http://10.132.0.60:15021/healthz/ready": dial tcp 10.132.0.60:15021: connect: connection refused body:

openshift-ingress

multus

e2e-shared-b-w3-d418fd-openshift-default-848d7cf44-tpt4g

AddedInterface

Add eth0 [10.132.0.62/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-a090a0-openshift-default-6676bb465d-r2fjc

Unhealthy

Startup probe failed: Get "http://10.132.0.60:15021/healthz/ready": dial tcp 10.132.0.60:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-d418fd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-d418fd-6774d98678 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-d418fd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-d418fd-5b7847d9f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-d418fd-6774d98678

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-d418fd-6774d98678-87fgz

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-d418fd-5b7847d9f-vdqwp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-d418fd-6774d98678-87fgz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-d418fd-6774d98678-87fgz

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-d418fd-6774d98678-87fgz

Started

Started container payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-d418fd-6774d98678

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-d418fd-6774d98678-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-d418fd: serviceaccount "payload-processing-e2e-shared-b-w3-d418fd" not found

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-d418fd-5b7847d9f-vdqwp

AddedInterface

Add eth0 [10.133.0.105/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-d418fd-6774d98678-87fgz

AddedInterface

Add eth0 [10.133.0.106/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-d418fd-5b7847d9f-vdqwp

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-d418fd-5b7847d9f-vdqwp

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-d418fd-5b7847d9f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-d418fd-5b7847d9f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-d418fd: serviceaccount "payload-processing-e2e-shared-b-w3-d418fd" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-d418fd-5b7847d9f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-d418fd-5b7847d9f-vdqwp
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-d418fd-openshift-default-848d7cf44-tpt4g

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-d418fd-openshift-default-848d7cf44-tpt4g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-d418fd-openshift-default-848d7cf44-tpt4g

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-d418fd-openshift-default-848d7cf44-tpt4g

Unhealthy

Startup probe failed: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-d418fd-openshift-default-848d7cf44-tpt4g

ProbeError

Startup probe error: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w0-1293e7-openshift-default-567dbc6586-qk4jn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-66261e-openshift-default-86bd889684-6v7ph

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-api-a-746f54

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-746f54

openshift-ingress

deployment-controller

e2e-api-a-746f54-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-746f54-openshift-default-8466df476d from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-746f54-openshift-default-8466df476d

SuccessfulCreate

Created pod: e2e-api-a-746f54-openshift-default-8466df476d-s9rqw

openshift-ingress

multus

e2e-api-a-746f54-openshift-default-8466df476d-s9rqw

AddedInterface

Add eth0 [10.133.0.107/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-746f54-78b844b659

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-746f54-78b844b659-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-746f54: serviceaccount "payload-processing-e2e-api-a-746f54" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-746f54

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-746f54-78b844b659 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-746f54

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-746f54-f9b7c67f4 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-746f54-f9b7c67f4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-746f54-f9b7c67f4-dx28h

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-746f54-f9b7c67f4-dx28h

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-a-746f54-78b844b659-gfl6b

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-746f54-78b844b659-gfl6b

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-746f54-78b844b659-gfl6b

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-746f54-78b844b659

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-746f54-78b844b659-gfl6b

openshift-ingress

multus

payload-pre-processing-e2e-api-a-746f54-f9b7c67f4-dx28h

AddedInterface

Add eth0 [10.133.0.109/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-746f54-f9b7c67f4-dx28h

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-746f54-f9b7c67f4-dx28h

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-api-a-746f54-78b844b659-gfl6b

AddedInterface

Add eth0 [10.133.0.108/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-746f54-f9b7c67f4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-746f54-f9b7c67f4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-746f54: serviceaccount "payload-processing-e2e-api-a-746f54" not found

openshift-ingress

replicaset-controller

e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6

SuccessfulCreate

Created pod: e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d

openshift-ingress

deployment-controller

e2e-api-b-e50cdb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-e50cdb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-e50cdb

openshift-ingress

multus

e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d

AddedInterface

Add eth0 [10.133.0.110/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-api-a-746f54-openshift-default-8466df476d-s9rqw

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-746f54-openshift-default-8466df476d-s9rqw

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-746f54-openshift-default-8466df476d-s9rqw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-api-a-746f54-openshift-default-8466df476d-s9rqw

Unhealthy

Startup probe failed: Get "http://10.133.0.107:15021/healthz/ready": dial tcp 10.133.0.107:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-a-746f54-openshift-default-8466df476d-s9rqw

ProbeError

Startup probe error: Get "http://10.133.0.107:15021/healthz/ready": dial tcp 10.133.0.107:15021: connect: connection refused body:
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-e50cdb-6b58cb9994

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-e50cdb-6b58cb9994-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-e50cdb: serviceaccount "payload-processing-e2e-api-b-e50cdb" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-e50cdb-799789b575

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-e50cdb-799789b575-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-e50cdb: serviceaccount "payload-processing-e2e-api-b-e50cdb" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-e50cdb-799789b575

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-e50cdb-799789b575-2xm25

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-e50cdb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-e50cdb-799789b575 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-e50cdb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-e50cdb-6b58cb9994 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-e50cdb-6b58cb9994

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-e50cdb-6b58cb9994-25n6j

openshift-ingress

multus

payload-pre-processing-e2e-api-b-e50cdb-6b58cb9994-25n6j

AddedInterface

Add eth0 [10.133.0.111/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-e50cdb-6b58cb9994-25n6j

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-e50cdb-6b58cb9994-25n6j

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-e50cdb-6b58cb9994-25n6j

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-e50cdb-799789b575-2xm25

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-e50cdb-799789b575-2xm25

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-api-b-e50cdb-799789b575-2xm25

AddedInterface

Add eth0 [10.132.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-e50cdb-799789b575-2xm25

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d

Unhealthy

Startup probe failed: Get "http://10.133.0.110:15021/healthz/ready": dial tcp 10.133.0.110:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d

ProbeError

Startup probe error: Get "http://10.133.0.110:15021/healthz/ready": dial tcp 10.133.0.110:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-api-a-746f54-78b844b659-gfl6b

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-746f54-f9b7c67f4-dx28h

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-a-746f54-openshift-default-8466df476d-s9rqw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-e50cdb-6b58cb9994-25n6j

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-e50cdb-799789b575-2xm25

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-b-e50cdb-openshift-default-6c4c7d6cf6-fpf2d

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-583e9a-7854fbc79-vx72w

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-583e9a-798555686-8vmrc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w2-583e9a-openshift-default-5556fff988-9rrgj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-4bb7b3-7554f66d7f-gj7tl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-4bb7b3-56459fd4fd-5t59j

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w2-4bb7b3-openshift-default-7cdf9997dd-9cwtb

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-a090a0-6b87cd4745-ckgzh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-a090a0-6b96b64966-t9wg8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-a090a0-6b87cd4745-ckgzh

Unhealthy

Readiness probe failed: dial tcp 10.133.0.104:9004: connect: connection refused

openshift-ingress

kubelet

e2e-shared-a-w3-a090a0-openshift-default-6676bb465d-r2fjc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-a090a0-openshift-default-6676bb465d-r2fjc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w3-a090a0-openshift-default-6676bb465d-r2fjc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-d418fd-5b7847d9f-vdqwp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-d418fd-6774d98678-87fgz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w3-d418fd-openshift-default-848d7cf44-tpt4g

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w3-d418fd-openshift-default-848d7cf44-tpt4g

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w3-d418fd-openshift-default-848d7cf44-tpt4g

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503