Time Namespace Component RelatedObject Reason Message

openshift-ingress

kube-auth-proxy-79674675df-hkgzr

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-79674675df-hkgzr to ip-10-0-138-153.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-68cf4d799c5zz6c

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c5zz6c to ip-10-0-132-240.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-a73e48-7d98954d54-rsmwq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-a73e48-7d98954d54-rsmwq to ip-10-0-138-153.ec2.internal

openshift-ingress

e2e-migrate-07a6c076-gw-openshift-default-5596775f6-zjs9x

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-07a6c076-gw-openshift-default-5596775f6-zjs9x to ip-10-0-138-153.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-6f21996a-555d757574-hn6j4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-6f21996a-555d757574-hn6j4 to ip-10-0-135-143.ec2.internal

openshift-ingress

e2e-mt-5f7ca109-openshift-default-557bb948fb-657tb

Scheduled

Successfully assigned openshift-ingress/e2e-mt-5f7ca109-openshift-default-557bb948fb-657tb to ip-10-0-138-153.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-4d6dbb-648b4c496b-vdh4d

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-4d6dbb-648b4c496b-vdh4d to ip-10-0-138-153.ec2.internal

openshift-ingress

payload-processing-e2e-mt-baee2b93-54575b6977-rqn9r

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-baee2b93-54575b6977-rqn9r to ip-10-0-138-153.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-2f0e97-686dcbdfc4-mjfbm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-2f0e97-686dcbdfc4-mjfbm to ip-10-0-135-143.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-78522e-666646fc98-n54hf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-78522e-666646fc98-n54hf to ip-10-0-138-153.ec2.internal

openshift-ingress

e2e-ait-9b1cbda7-openshift-default-5d96788786-d9j8g

Scheduled

Successfully assigned openshift-ingress/e2e-ait-9b1cbda7-openshift-default-5d96788786-d9j8g to ip-10-0-138-153.ec2.internal

openshift-ingress

payload-processing-e2e-derive-6f21996a-7f7f87fc77-stlrx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-6f21996a-7f7f87fc77-stlrx to ip-10-0-135-143.ec2.internal

openshift-ingress

e2e-worker-w4-b8fbdd-openshift-default-575d4f777b-g7hx4

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-b8fbdd-openshift-default-575d4f777b-g7hx4 to ip-10-0-138-153.ec2.internal

openshift-ingress

e2e-worker-w0-6e996c-openshift-default-575d5b56b8-k88zz

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-6e996c-openshift-default-575d5b56b8-k88zz to ip-10-0-138-153.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-pjn7w

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-pjn7w to ip-10-0-138-153.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-d63075-768974c9d5-xzk4j

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-d63075-768974c9d5-xzk4j to ip-10-0-135-143.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-173324-7bd485c4c4-zxdz2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-173324-7bd485c4c4-zxdz2 to ip-10-0-135-143.ec2.internal

openshift-ingress

payload-processing-e2e-mt-5f7ca109-f8b9454c7-l6ddp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-5f7ca109-f8b9454c7-l6ddp to ip-10-0-135-143.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-d40293-665f49f49d-xj6pv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-d40293-665f49f49d-xj6pv to ip-10-0-135-143.ec2.internal

openshift-ingress

payload-processing-e2e-autores-4d6dbb-77fc667d85-ppldl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-4d6dbb-77fc667d85-ppldl to ip-10-0-135-143.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-a73e48-694cd5bbd9-wbw54

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-a73e48-694cd5bbd9-wbw54 to ip-10-0-135-143.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-2f0e97-888ddd8b7-4c78q

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-2f0e97-888ddd8b7-4c78q to ip-10-0-135-143.ec2.internal

openshift-ingress

e2e-ipp-cleanup-1e87f5-openshift-default-59fbc687bd-72b5j

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-1e87f5-openshift-default-59fbc687bd-72b5j to ip-10-0-138-153.ec2.internal

openshift-ingress

e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq

Scheduled

Successfully assigned openshift-ingress/e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq to ip-10-0-132-240.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-07a6c076-7cc4676d74-vcmtk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-07a6c076-7cc4676d74-vcmtk to ip-10-0-138-153.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-9fc4b9-57fd8f4b99-mgpnb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-9fc4b9-57fd8f4b99-mgpnb to ip-10-0-138-153.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-rjh54

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rjh54 to ip-10-0-138-153.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-bcb732-778b8b4b5c-zdmzd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-bcb732-778b8b4b5c-zdmzd to ip-10-0-138-153.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-1e87f5-7c565789b7-xtp2j

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-1e87f5-7c565789b7-xtp2j to ip-10-0-135-143.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-d40293-7fdbcfc787-59hv5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-d40293-7fdbcfc787-59hv5 to ip-10-0-138-153.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-173324-7bb57d89bf-gcrbq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-173324-7bb57d89bf-gcrbq to ip-10-0-135-143.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-2cc790-597c44d749-gqvdp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-2cc790-597c44d749-gqvdp to ip-10-0-135-143.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-1e87f5-d76885474-2g8qk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-1e87f5-d76885474-2g8qk to ip-10-0-135-143.ec2.internal

openshift-ingress

e2e-shared-b-w3-2cc790-openshift-default-6746f98cd6-4xqjj

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-2cc790-openshift-default-6746f98cd6-4xqjj to ip-10-0-138-153.ec2.internal

openshift-ingress

e2e-api-a-bcb732-openshift-default-c4f7cc554-ljkb8

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-bcb732-openshift-default-c4f7cc554-ljkb8 to ip-10-0-138-153.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-78522e-f4b89754f-f8kx5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-78522e-f4b89754f-f8kx5 to ip-10-0-135-143.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-bcb732-56896f7658-zvfgh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-bcb732-56896f7658-zvfgh to ip-10-0-138-153.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-07a6c076-5f9fcb459d-ksczs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-07a6c076-5f9fcb459d-ksczs to ip-10-0-135-143.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-9fc4b9-5b67fd497d-gzkt6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-9fc4b9-5b67fd497d-gzkt6 to ip-10-0-138-153.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-5f7ca109-6dbfcdcdd6-6tzvs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-5f7ca109-6dbfcdcdd6-6tzvs to ip-10-0-135-143.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-baee2b93-7bd7db4886-rth74

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-baee2b93-7bd7db4886-rth74 to ip-10-0-135-143.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-5a8d6f-68955556b6-8n98l

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-5a8d6f-68955556b6-8n98l to ip-10-0-135-143.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-6e996c-579b598687-nwdqb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-6e996c-579b598687-nwdqb to ip-10-0-135-143.ec2.internal

openshift-ingress

e2e-mt-baee2b93-openshift-default-7f96dd88b8-fkpgl

Scheduled

Successfully assigned openshift-ingress/e2e-mt-baee2b93-openshift-default-7f96dd88b8-fkpgl to ip-10-0-138-153.ec2.internal

openshift-ingress

e2e-ipp-b-d40293-openshift-default-54c84b46b8-wl224

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-d40293-openshift-default-54c84b46b8-wl224 to ip-10-0-138-153.ec2.internal

openshift-ingress

e2e-api-b-2f0e97-openshift-default-9d8c58fd4-6tjzw

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-2f0e97-openshift-default-9d8c58fd4-6tjzw to ip-10-0-138-153.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-f193f9fb-786c8bb478-vjmw2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-f193f9fb-786c8bb478-vjmw2 to ip-10-0-138-153.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-9b1cbda7-6f9dd44778-6rhnf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-9b1cbda7-6f9dd44778-6rhnf to ip-10-0-135-143.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w4-b8fbdd-69dc8955f-zbjbw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-b8fbdd-69dc8955f-zbjbw to ip-10-0-138-153.ec2.internal

openshift-ingress

e2e-noten-ed9962-openshift-default-87699cbf4-km6hv

Scheduled

Successfully assigned openshift-ingress/e2e-noten-ed9962-openshift-default-87699cbf4-km6hv to ip-10-0-138-153.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-f9vl9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-f9vl9 to ip-10-0-138-153.ec2.internal

openshift-ingress

e2e-ipp-a-173324-openshift-default-7cf5df54fd-46p9j

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-173324-openshift-default-7cf5df54fd-46p9j to ip-10-0-138-153.ec2.internal

openshift-ingress

router-default-568d798994-hm7cl

Scheduled

Successfully assigned openshift-ingress/router-default-568d798994-hm7cl to ip-10-0-138-153.ec2.internal

openshift-ingress

router-default-568d798994-hm7cl

FailedScheduling

0/2 nodes are available: 2 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/2 nodes are available: 2 Preemption is not helpful for scheduling.

openshift-ingress

payload-processing-e2e-shared-a-w2-5a8d6f-9dcf78f65-8k6qm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-5a8d6f-9dcf78f65-8k6qm to ip-10-0-135-143.ec2.internal

openshift-ingress

e2e-shared-a-w2-5a8d6f-openshift-default-57c8dcc7c8-9mzqw

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-5a8d6f-openshift-default-57c8dcc7c8-9mzqw to ip-10-0-138-153.ec2.internal

openshift-ingress

e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96

Scheduled

Successfully assigned openshift-ingress/e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96 to ip-10-0-132-240.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-7efa8b-545cff7746-twdn5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-7efa8b-545cff7746-twdn5 to ip-10-0-135-143.ec2.internal

openshift-ingress

payload-processing-e2e-ait-f193f9fb-746ddf768c-knvkr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-f193f9fb-746ddf768c-knvkr to ip-10-0-138-153.ec2.internal

openshift-ingress

payload-processing-e2e-ait-9b1cbda7-74779bbb77-vpb52

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-9b1cbda7-74779bbb77-vpb52 to ip-10-0-138-153.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-d63075-59df885f58-8pbzr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-d63075-59df885f58-8pbzr to ip-10-0-138-153.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-2cc790-65464dff98-nw9r6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-2cc790-65464dff98-nw9r6 to ip-10-0-135-143.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-5ccb968c66-pgr4n

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pgr4n to ip-10-0-138-153.ec2.internal

openshift-ingress

e2e-inf-b-78522e-openshift-default-6789554c58-h2795

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-78522e-openshift-default-6789554c58-h2795 to ip-10-0-132-240.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-6e996c-95fc4785d-5dt6z

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-6e996c-95fc4785d-5dt6z to ip-10-0-132-240.ec2.internal

openshift-ingress

e2e-shared-a-w3-7efa8b-openshift-default-59b66b7c4-jq8kz

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-7efa8b-openshift-default-59b66b7c4-jq8kz to ip-10-0-138-153.ec2.internal

openshift-ingress

e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8 to ip-10-0-132-240.ec2.internal

openshift-ingress

e2e-derive-6f21996a-openshift-default-5d6f9b5ff6-trf6n

Scheduled

Successfully assigned openshift-ingress/e2e-derive-6f21996a-openshift-default-5d6f9b5ff6-trf6n to ip-10-0-138-153.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-7efa8b-5bd6d54d9c-rfrf4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-7efa8b-5bd6d54d9c-rfrf4 to ip-10-0-138-153.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-b8fbdd-57dd7dfb7d-fd7v6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-b8fbdd-57dd7dfb7d-fd7v6 to ip-10-0-135-143.ec2.internal

openshift-ingress

kube-auth-proxy-79674675df-ptdl6

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-79674675df-ptdl6 to ip-10-0-132-240.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-bp6jm

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-bp6jm to ip-10-0-132-240.ec2.internal

openshift-ingress

e2e-shared-b-w2-d63075-openshift-default-696965bc98-s8gjh

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-d63075-openshift-default-696965bc98-s8gjh to ip-10-0-138-153.ec2.internal

openshift-ingress

e2e-explicit-a73e48-openshift-default-7b6556cdd-gw9vs

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-a73e48-openshift-default-7b6556cdd-gw9vs to ip-10-0-138-153.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-568d798994 from 0 to 1
(x9)

openshift-ingress

replicaset-controller

router-default-568d798994

FailedCreate

Error creating: pods "router-default-568d798994-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x16)

openshift-ingress

replicaset-controller

router-default-568d798994

FailedCreate

Error creating: pods "router-default-568d798994-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

replicaset-controller

router-default-568d798994

SuccessfulCreate

Created pod: router-default-568d798994-hm7cl
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts
(x6)

openshift-ingress

kubelet

router-default-568d798994-hm7cl

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x6)

openshift-ingress

kubelet

router-default-568d798994-hm7cl

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found

openshift-ingress

multus

router-default-568d798994-hm7cl

AddedInterface

Add eth0 [10.132.0.10/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-568d798994-hm7cl

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:48526e08a2a06d05806dbcf3ddb069e5182371667d9e9f7d2cf09f60cd247d20" already present on machine

openshift-ingress

kubelet

router-default-568d798994-hm7cl

Created

Created container: router

openshift-ingress

kubelet

router-default-568d798994-hm7cl

Started

Started container router

openshift-ingress

multus

kube-auth-proxy-79674675df-hkgzr

AddedInterface

Add eth0 [10.132.0.22/23] from ovn-kubernetes

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-79674675df from 0 to 2

openshift-ingress

kubelet

kube-auth-proxy-79674675df-hkgzr

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-79674675df-ptdl6

AddedInterface

Add eth0 [10.134.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-79674675df-ptdl6

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

replicaset-controller

kube-auth-proxy-79674675df

FailedCreate

Error creating: pods "kube-auth-proxy-79674675df-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-79674675df

SuccessfulCreate

Created pod: kube-auth-proxy-79674675df-hkgzr

openshift-ingress

replicaset-controller

kube-auth-proxy-79674675df

SuccessfulCreate

Created pod: kube-auth-proxy-79674675df-ptdl6

openshift-ingress

kubelet

kube-auth-proxy-79674675df-ptdl6

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-79674675df-ptdl6

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.733s (2.733s including waiting). Image size: 265120132 bytes.

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-rjh54

openshift-ingress

kubelet

kube-auth-proxy-79674675df-hkgzr

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-79674675df-hkgzr

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-79674675df-hkgzr

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.864s (2.865s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-79674675df-ptdl6

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-rjh54

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-rjh54

AddedInterface

Add eth0 [10.132.0.23/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-rjh54

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-rjh54

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-rjh54

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.814s (3.814s including waiting). Image size: 181126104 bytes.

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-68cf4d799c from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-rjh54

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-rjh54

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-68cf4d799c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-68cf4d799c5zz6c

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-68cf4d799c5zz6c

AddedInterface

Add eth0 [10.134.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799c5zz6c

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799c5zz6c

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 4.076s (4.076s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799c5zz6c

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799c5zz6c

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799c5zz6c

Unhealthy

Startup probe failed: Get "http://10.134.0.35:15021/healthz/ready": dial tcp 10.134.0.35:15021: connect: connection refused

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799c5zz6c

ProbeError

Startup probe error: Get "http://10.134.0.35:15021/healthz/ready": dial tcp 10.134.0.35:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-pjn7w

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-pjn7w

AddedInterface

Add eth0 [10.132.0.24/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-pjn7w

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" already present on machine

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-pjn7w

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-pjn7w

Started

Started container discovery

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-rjh54

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-rjh54

Killing

Stopping container discovery

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5ccb968c66

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5ccb968c66-pgr4n

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-5ccb968c66 from 0 to 1

openshift-ingress

multus

maas-default-gateway-openshift-default-5ccb968c66-pgr4n

AddedInterface

Add eth0 [10.132.0.31/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-pgr4n

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-pgr4n

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.662s (2.662s including waiting). Image size: 181318953 bytes.
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-bp6jm

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-f9vl9

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-f9vl9

AddedInterface

Add eth0 [10.132.0.37/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-bp6jm

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-f9vl9

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-5b54b7fbb7-bp6jm

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-bp6jm

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.355s (1.355s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-bp6jm

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-bp6jm

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-f9vl9

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 3.078s (3.078s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-f9vl9

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-f9vl9

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-pgr4n

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-pgr4n

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-pgr4n

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-pgr4n

Unhealthy

Startup probe failed: Get "http://10.132.0.31:15021/healthz/ready": dial tcp 10.132.0.31:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-pgr4n

ProbeError

Startup probe error: Get "http://10.132.0.31:15021/healthz/ready": dial tcp 10.132.0.31:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-6e996c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-6e996c

openshift-ingress

deployment-controller

e2e-worker-w0-6e996c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-6e996c-openshift-default-575d5b56b8 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w0-6e996c-openshift-default-575d5b56b8

SuccessfulCreate

Created pod: e2e-worker-w0-6e996c-openshift-default-575d5b56b8-k88zz

openshift-ingress

replicaset-controller

e2e-worker-w4-b8fbdd-openshift-default-575d4f777b

SuccessfulCreate

Created pod: e2e-worker-w4-b8fbdd-openshift-default-575d4f777b-g7hx4

openshift-ingress

deployment-controller

e2e-inf-a-9fc4b9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-9fc4b9-openshift-default-86d476c484 from 0 to 1

openshift-ingress

deployment-controller

e2e-worker-w4-b8fbdd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-b8fbdd-openshift-default-575d4f777b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-b8fbdd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-b8fbdd

openshift-ingress

gateway_labeler_controller

e2e-inf-a-9fc4b9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-9fc4b9

openshift-ingress

multus

e2e-worker-w4-b8fbdd-openshift-default-575d4f777b-g7hx4

AddedInterface

Add eth0 [10.132.0.40/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-inf-a-9fc4b9-openshift-default-86d476c484

SuccessfulCreate

Created pod: e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8

openshift-ingress

multus

e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w0-6e996c-openshift-default-575d5b56b8-k88zz

AddedInterface

Add eth0 [10.132.0.41/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-9fc4b9-57fd8f4b99

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-9fc4b9-57fd8f4b99-mgpnb

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-9fc4b9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-9fc4b9-57fd8f4b99 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-9fc4b9-5b67fd497d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-9fc4b9-5b67fd497d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-9fc4b9: serviceaccount "payload-processing-e2e-inf-a-9fc4b9" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-9fc4b9-57fd8f4b99

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-9fc4b9-57fd8f4b99-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-9fc4b9: serviceaccount "payload-processing-e2e-inf-a-9fc4b9" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-9fc4b9-5b67fd497d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-9fc4b9-5b67fd497d-gzkt6

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-9fc4b9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-9fc4b9-5b67fd497d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-6e996c-579b598687

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-6e996c-579b598687-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-6e996c: serviceaccount "payload-processing-e2e-worker-w0-6e996c" not found

openshift-ingress

multus

payload-processing-e2e-inf-a-9fc4b9-57fd8f4b99-mgpnb

AddedInterface

Add eth0 [10.132.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-9fc4b9-5b67fd497d-gzkt6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-6e996c-95fc4785d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-6e996c-95fc4785d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-6e996c: serviceaccount "payload-processing-e2e-worker-w0-6e996c" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-6e996c-95fc4785d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-6e996c-95fc4785d-5dt6z

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-9fc4b9-5b67fd497d-gzkt6

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-6e996c-579b598687

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-6e996c-579b598687-nwdqb

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-6e996c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-6e996c-579b598687 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-6e996c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-6e996c-95fc4785d from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-9fc4b9-5b67fd497d-gzkt6

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-9fc4b9-5b67fd497d-gzkt6

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-9fc4b9-57fd8f4b99-mgpnb

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-9fc4b9-57fd8f4b99-mgpnb

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-9fc4b9-57fd8f4b99-mgpnb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-b8fbdd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-b8fbdd-69dc8955f from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-6e996c-579b598687-nwdqb

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

deployment-controller

e2e-autores-4d6dbb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-4d6dbb-openshift-default-64496db7f8 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-b8fbdd-69dc8955f

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-b8fbdd-69dc8955f-zbjbw

openshift-ingress

multus

payload-processing-e2e-worker-w0-6e996c-579b598687-nwdqb

AddedInterface

Add eth0 [10.133.0.32/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-6e996c-95fc4785d-5dt6z

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-autores-4d6dbb-openshift-default-64496db7f8

SuccessfulCreate

Created pod: e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-b8fbdd-69dc8955f

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-b8fbdd-69dc8955f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-b8fbdd: serviceaccount "payload-processing-e2e-worker-w4-b8fbdd" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-6e996c-95fc4785d-5dt6z

Created

Created container: payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-autores-4d6dbb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-4d6dbb

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-b8fbdd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-b8fbdd-57dd7dfb7d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-b8fbdd-57dd7dfb7d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-b8fbdd-57dd7dfb7d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-b8fbdd: serviceaccount "payload-processing-e2e-worker-w4-b8fbdd" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-b8fbdd-57dd7dfb7d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-b8fbdd-57dd7dfb7d-fd7v6

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-6e996c-95fc4785d-5dt6z

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-6e996c-95fc4785d-5dt6z

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-b8fbdd-69dc8955f-zbjbw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-worker-w4-b8fbdd-69dc8955f-zbjbw

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-b8fbdd-69dc8955f-zbjbw

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-b8fbdd-57dd7dfb7d-fd7v6

AddedInterface

Add eth0 [10.133.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-b8fbdd-69dc8955f-zbjbw

Started

Started container payload-processing

openshift-ingress

multus

e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-b8fbdd-57dd7dfb7d-fd7v6

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

deployment-controller

e2e-ait-f193f9fb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-f193f9fb-openshift-default-54d9656cd8 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-f193f9fb-openshift-default-54d9656cd8

SuccessfulCreate

Created pod: e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq

openshift-ingress

gateway_labeler_controller

e2e-ait-f193f9fb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-f193f9fb

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-b8fbdd-57dd7dfb7d-fd7v6

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.399s (2.399s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-6e996c-579b598687-nwdqb

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 3.693s (3.693s including waiting). Image size: 166449312 bytes.

openshift-ingress

multus

e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-b8fbdd-57dd7dfb7d-fd7v6

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-6e996c-579b598687-nwdqb

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-b8fbdd-57dd7dfb7d-fd7v6

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-6e996c-579b598687-nwdqb

Created

Created container: payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-autores-4d6dbb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-4d6dbb-77fc667d85 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-4d6dbb-648b4c496b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-4d6dbb-648b4c496b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-4d6dbb: serviceaccount "payload-processing-e2e-autores-4d6dbb" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-4d6dbb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-4d6dbb-648b4c496b from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-4d6dbb-77fc667d85

FailedCreate

Error creating: pods "payload-processing-e2e-autores-4d6dbb-77fc667d85-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-4d6dbb: serviceaccount "payload-processing-e2e-autores-4d6dbb" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-4d6dbb-648b4c496b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-4d6dbb-648b4c496b-vdh4d

openshift-ingress

multus

payload-pre-processing-e2e-autores-4d6dbb-648b4c496b-vdh4d

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-4d6dbb-648b4c496b-vdh4d

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-4d6dbb-648b4c496b-vdh4d

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-4d6dbb-648b4c496b-vdh4d

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-4d6dbb-77fc667d85

SuccessfulCreate

Created pod: payload-processing-e2e-autores-4d6dbb-77fc667d85-ppldl

openshift-ingress

kubelet

payload-processing-e2e-autores-4d6dbb-77fc667d85-ppldl

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-4d6dbb-77fc667d85-ppldl

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-4d6dbb-77fc667d85-ppldl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-autores-4d6dbb-77fc667d85-ppldl

AddedInterface

Add eth0 [10.133.0.35/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-inf-b-78522e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-78522e

openshift-ingress

replicaset-controller

e2e-inf-b-78522e-openshift-default-6789554c58

SuccessfulCreate

Created pod: e2e-inf-b-78522e-openshift-default-6789554c58-h2795

openshift-ingress

deployment-controller

e2e-inf-b-78522e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-78522e-openshift-default-6789554c58 from 0 to 1

openshift-ingress

multus

e2e-inf-b-78522e-openshift-default-6789554c58-h2795

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-f193f9fb-746ddf768c

FailedCreate

Error creating: pods "payload-processing-e2e-ait-f193f9fb-746ddf768c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-f193f9fb: serviceaccount "payload-processing-e2e-ait-f193f9fb" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-f193f9fb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-f193f9fb-786c8bb478 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ait-f193f9fb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-f193f9fb-746ddf768c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-f193f9fb-746ddf768c

SuccessfulCreate

Created pod: payload-processing-e2e-ait-f193f9fb-746ddf768c-knvkr

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-f193f9fb-786c8bb478

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-f193f9fb-786c8bb478-vjmw2
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-f193f9fb-786c8bb478

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-f193f9fb-786c8bb478-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-f193f9fb: serviceaccount "payload-processing-e2e-ait-f193f9fb" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f193f9fb-786c8bb478-vjmw2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f193f9fb-786c8bb478-vjmw2

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-f193f9fb-746ddf768c-knvkr

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-f193f9fb-786c8bb478-vjmw2

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f193f9fb-786c8bb478-vjmw2

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-f193f9fb-746ddf768c-knvkr

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-f193f9fb-746ddf768c-knvkr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-f193f9fb-746ddf768c-knvkr

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-worker-w0-6e996c-openshift-default-575d5b56b8-k88zz

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-6e996c-openshift-default-575d5b56b8-k88zz

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w0-6e996c-openshift-default-575d5b56b8-k88zz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-b8fbdd-openshift-default-575d4f777b-g7hx4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w4-b8fbdd-openshift-default-575d4f777b-g7hx4

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-b8fbdd-openshift-default-575d4f777b-g7hx4

Started

Started container istio-proxy
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-78522e-f4b89754f

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-78522e-f4b89754f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-78522e: serviceaccount "payload-processing-e2e-inf-b-78522e" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-78522e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-78522e-666646fc98 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-78522e-666646fc98

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-78522e-666646fc98-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-78522e: serviceaccount "payload-processing-e2e-inf-b-78522e" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-78522e-f4b89754f

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-78522e-f4b89754f-f8kx5

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-78522e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-78522e-f4b89754f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-78522e-666646fc98

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-78522e-666646fc98-n54hf
(x5)

openshift-ingress

kubelet

e2e-worker-w4-b8fbdd-openshift-default-575d4f777b-g7hx4

Unhealthy

Startup probe failed: Get "http://10.132.0.40:15021/healthz/ready": dial tcp 10.132.0.40:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-inf-b-78522e-f4b89754f-f8kx5

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-78522e-666646fc98-n54hf

Started

Started container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-worker-w0-6e996c-openshift-default-575d5b56b8-k88zz

Unhealthy

Startup probe failed: Get "http://10.132.0.41:15021/healthz/ready": dial tcp 10.132.0.41:15021: connect: connection refused

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-78522e-666646fc98-n54hf

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-78522e-666646fc98-n54hf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-b-78522e-f4b89754f-f8kx5

Started

Started container payload-processing
(x5)

openshift-ingress

kubelet

e2e-worker-w4-b8fbdd-openshift-default-575d4f777b-g7hx4

ProbeError

Startup probe error: Get "http://10.132.0.40:15021/healthz/ready": dial tcp 10.132.0.40:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-inf-b-78522e-f4b89754f-f8kx5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-inf-b-78522e-f4b89754f-f8kx5

AddedInterface

Add eth0 [10.133.0.37/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-worker-w0-6e996c-openshift-default-575d5b56b8-k88zz

ProbeError

Startup probe error: Get "http://10.132.0.41:15021/healthz/ready": dial tcp 10.132.0.41:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-78522e-666646fc98-n54hf

Created

Created container: payload-pre-processing
(x7)

openshift-ingress

kubelet

e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8

Unhealthy

Startup probe failed: Get "http://10.134.0.51:15021/healthz/ready": dial tcp 10.134.0.51:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8

ProbeError

Startup probe error: Get "http://10.134.0.51:15021/healthz/ready": dial tcp 10.134.0.51:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq

Unhealthy

Startup probe failed: Get "http://10.134.0.55:15021/healthz/ready": dial tcp 10.134.0.55:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96

Unhealthy

Startup probe failed: Get "http://10.134.0.54:15021/healthz/ready": dial tcp 10.134.0.54:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq

ProbeError

Startup probe error: Get "http://10.134.0.55:15021/healthz/ready": dial tcp 10.134.0.55:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96

ProbeError

Startup probe error: Get "http://10.134.0.54:15021/healthz/ready": dial tcp 10.134.0.54:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-inf-b-78522e-openshift-default-6789554c58-h2795

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-78522e-openshift-default-6789554c58-h2795

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-78522e-openshift-default-6789554c58-h2795

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-ait-f193f9fb-openshift-default-54d9656cd8-75hcq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ait-f193f9fb-746ddf768c-knvkr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f193f9fb-786c8bb478-vjmw2

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-migrate-07a6c076-gw-openshift-default-5596775f6

SuccessfulCreate

Created pod: e2e-migrate-07a6c076-gw-openshift-default-5596775f6-zjs9x

openshift-ingress

gateway_labeler_controller

e2e-migrate-07a6c076-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-07a6c076-gw

openshift-ingress

deployment-controller

e2e-migrate-07a6c076-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-07a6c076-gw-openshift-default-5596775f6 from 0 to 1

openshift-ingress

multus

e2e-migrate-07a6c076-gw-openshift-default-5596775f6-zjs9x

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-inf-b-78522e-openshift-default-6789554c58-h2795

Unhealthy

Startup probe failed: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-b-78522e-openshift-default-6789554c58-h2795

ProbeError

Startup probe error: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused body:
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-07a6c076-5f9fcb459d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-07a6c076-5f9fcb459d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-07a6c076: serviceaccount "payload-processing-e2e-migrate-07a6c076" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-07a6c076-5f9fcb459d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-07a6c076-5f9fcb459d-ksczs

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-07a6c076

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-07a6c076-5f9fcb459d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-07a6c076-7cc4676d74

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-07a6c076-7cc4676d74-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-07a6c076: serviceaccount "payload-processing-e2e-migrate-07a6c076" not found

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-07a6c076

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-07a6c076-7cc4676d74 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-07a6c076-7cc4676d74

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-07a6c076-7cc4676d74-vcmtk

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-07a6c076-5f9fcb459d-ksczs

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-migrate-07a6c076-5f9fcb459d-ksczs

AddedInterface

Add eth0 [10.133.0.38/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-07a6c076-7cc4676d74-vcmtk

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-07a6c076-7cc4676d74-vcmtk

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-07a6c076-7cc4676d74-vcmtk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-migrate-07a6c076-7cc4676d74-vcmtk

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-07a6c076-5f9fcb459d-ksczs

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-07a6c076-5f9fcb459d-ksczs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-07a6c076-gw-openshift-default-5596775f6-zjs9x

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-07a6c076-gw-openshift-default-5596775f6-zjs9x

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-07a6c076-gw-openshift-default-5596775f6-zjs9x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-migrate-07a6c076-gw-openshift-default-5596775f6-zjs9x

Unhealthy

Startup probe failed: Get "http://10.132.0.51:15021/healthz/ready": dial tcp 10.132.0.51:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-migrate-07a6c076-gw-openshift-default-5596775f6-zjs9x

ProbeError

Startup probe error: Get "http://10.132.0.51:15021/healthz/ready": dial tcp 10.132.0.51:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-07a6c076-5f9fcb459d-ksczs

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-07a6c076-7cc4676d74-vcmtk

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-ait-9b1cbda7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-9b1cbda7

openshift-ingress

replicaset-controller

e2e-ait-9b1cbda7-openshift-default-5d96788786

SuccessfulCreate

Created pod: e2e-ait-9b1cbda7-openshift-default-5d96788786-d9j8g

openshift-ingress

deployment-controller

e2e-ait-9b1cbda7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-9b1cbda7-openshift-default-5d96788786 from 0 to 1

openshift-ingress

kubelet

e2e-migrate-07a6c076-gw-openshift-default-5596775f6-zjs9x

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-ait-9b1cbda7-openshift-default-5d96788786-d9j8g

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ait-9b1cbda7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-9b1cbda7-74779bbb77 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-9b1cbda7-74779bbb77

FailedCreate

Error creating: pods "payload-processing-e2e-ait-9b1cbda7-74779bbb77-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-9b1cbda7: serviceaccount "payload-processing-e2e-ait-9b1cbda7" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-9b1cbda7-74779bbb77

SuccessfulCreate

Created pod: payload-processing-e2e-ait-9b1cbda7-74779bbb77-vpb52

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-9b1cbda7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-9b1cbda7-6f9dd44778 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-9b1cbda7-6f9dd44778

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-9b1cbda7-6f9dd44778-6rhnf
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-9b1cbda7-6f9dd44778

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-9b1cbda7-6f9dd44778-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-9b1cbda7: serviceaccount "payload-processing-e2e-ait-9b1cbda7" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-9b1cbda7-6f9dd44778-6rhnf

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-9b1cbda7-74779bbb77-vpb52

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-9b1cbda7-6f9dd44778-6rhnf

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-9b1cbda7-6f9dd44778-6rhnf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-9b1cbda7-6f9dd44778-6rhnf

AddedInterface

Add eth0 [10.133.0.40/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ait-9b1cbda7-74779bbb77-vpb52

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-9b1cbda7-74779bbb77-vpb52

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-9b1cbda7-74779bbb77-vpb52

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-ait-9b1cbda7-openshift-default-5d96788786-d9j8g

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-9b1cbda7-openshift-default-5d96788786-d9j8g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-9b1cbda7-openshift-default-5d96788786-d9j8g

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ait-9b1cbda7-openshift-default-5d96788786-d9j8g

Unhealthy

Startup probe failed: Get "http://10.132.0.53:15021/healthz/ready": dial tcp 10.132.0.53:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-9b1cbda7-openshift-default-5d96788786-d9j8g

ProbeError

Startup probe error: Get "http://10.132.0.53:15021/healthz/ready": dial tcp 10.132.0.53:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ait-9b1cbda7-74779bbb77-vpb52

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-4d6dbb-648b4c496b-vdh4d

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-4d6dbb-77fc667d85-ppldl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-9b1cbda7-6f9dd44778-6rhnf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-9b1cbda7-openshift-default-5d96788786-d9j8g

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-derive-6f21996a-openshift-default-5d6f9b5ff6

SuccessfulCreate

Created pod: e2e-derive-6f21996a-openshift-default-5d6f9b5ff6-trf6n

openshift-ingress

multus

e2e-derive-6f21996a-openshift-default-5d6f9b5ff6-trf6n

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-derive-6f21996a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-6f21996a-openshift-default-5d6f9b5ff6 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-derive-6f21996a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-6f21996a

openshift-ingress

kubelet

e2e-ait-9b1cbda7-openshift-default-5d96788786-d9j8g

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ait-9b1cbda7-openshift-default-5d96788786-d9j8g

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-6f21996a-555d757574

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-6f21996a-555d757574-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-6f21996a: serviceaccount "payload-processing-e2e-derive-6f21996a" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-6f21996a-555d757574

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-6f21996a-555d757574-hn6j4

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-6f21996a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-6f21996a-555d757574 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-6f21996a-7f7f87fc77

FailedCreate

Error creating: pods "payload-processing-e2e-derive-6f21996a-7f7f87fc77-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-6f21996a: serviceaccount "payload-processing-e2e-derive-6f21996a" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-6f21996a-7f7f87fc77

SuccessfulCreate

Created pod: payload-processing-e2e-derive-6f21996a-7f7f87fc77-stlrx

openshift-ingress

deployment-controller

payload-processing-e2e-derive-6f21996a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-6f21996a-7f7f87fc77 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-6f21996a-555d757574-hn6j4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-derive-6f21996a-7f7f87fc77-stlrx

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-6f21996a-7f7f87fc77-stlrx

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-6f21996a-7f7f87fc77-stlrx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-derive-6f21996a-7f7f87fc77-stlrx

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-6f21996a-555d757574-hn6j4

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-6f21996a-555d757574-hn6j4

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-derive-6f21996a-555d757574-hn6j4

AddedInterface

Add eth0 [10.133.0.42/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-derive-6f21996a-openshift-default-5d6f9b5ff6-trf6n

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-6f21996a-openshift-default-5d6f9b5ff6-trf6n

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-6f21996a-openshift-default-5d6f9b5ff6-trf6n

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-derive-6f21996a-openshift-default-5d6f9b5ff6-trf6n

Unhealthy

Startup probe failed: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-derive-6f21996a-openshift-default-5d6f9b5ff6-trf6n

ProbeError

Startup probe error: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-6f21996a-555d757574-hn6j4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-6f21996a-openshift-default-5d6f9b5ff6-trf6n

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-derive-6f21996a-7f7f87fc77-stlrx

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-explicit-a73e48

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-a73e48

openshift-ingress

GatewayAuthBootstrap

e2e-explicit-a73e48

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-explicit-a73e48-authn-ssl: envoyfilters.networking.istio.io "e2e-explicit-a73e48-authn-ssl" already exists

openshift-ingress

kubelet

e2e-autores-4d6dbb-openshift-default-64496db7f8-zkk96

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-explicit-a73e48-openshift-default-7b6556cdd-gw9vs

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-explicit-a73e48-openshift-default-7b6556cdd

SuccessfulCreate

Created pod: e2e-explicit-a73e48-openshift-default-7b6556cdd-gw9vs

openshift-ingress

deployment-controller

e2e-explicit-a73e48-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-a73e48-openshift-default-7b6556cdd from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-explicit-a73e48-694cd5bbd9-wbw54

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-a73e48-694cd5bbd9

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-a73e48-694cd5bbd9-wbw54

openshift-ingress

multus

payload-pre-processing-e2e-explicit-a73e48-7d98954d54-rsmwq

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-a73e48-694cd5bbd9-wbw54

Created

Created container: payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-a73e48-7d98954d54

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-a73e48-7d98954d54-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-a73e48: serviceaccount "payload-processing-e2e-explicit-a73e48" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-a73e48-7d98954d54

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-a73e48-7d98954d54-rsmwq

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-a73e48

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-a73e48-7d98954d54 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-explicit-a73e48-694cd5bbd9-wbw54

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-a73e48-694cd5bbd9-wbw54

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-a73e48-694cd5bbd9

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-a73e48-694cd5bbd9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-a73e48: serviceaccount "payload-processing-e2e-explicit-a73e48" not found

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-a73e48

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-a73e48-694cd5bbd9 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-a73e48-7d98954d54-rsmwq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-a73e48-7d98954d54-rsmwq

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-a73e48-7d98954d54-rsmwq

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-explicit-a73e48-openshift-default-7b6556cdd-gw9vs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-a73e48-openshift-default-7b6556cdd-gw9vs

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-a73e48-openshift-default-7b6556cdd-gw9vs

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-explicit-a73e48-openshift-default-7b6556cdd-gw9vs

ProbeError

Startup probe error: Get "http://10.132.0.57:15021/healthz/ready": dial tcp 10.132.0.57:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-explicit-a73e48-openshift-default-7b6556cdd-gw9vs

Unhealthy

Startup probe failed: Get "http://10.132.0.57:15021/healthz/ready": dial tcp 10.132.0.57:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-mt-5f7ca109

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-5f7ca109

openshift-ingress

deployment-controller

e2e-mt-5f7ca109-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-5f7ca109-openshift-default-557bb948fb from 0 to 1

openshift-ingress

multus

e2e-mt-5f7ca109-openshift-default-557bb948fb-657tb

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-mt-5f7ca109-openshift-default-557bb948fb

SuccessfulCreate

Created pod: e2e-mt-5f7ca109-openshift-default-557bb948fb-657tb
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-5f7ca109-6dbfcdcdd6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-5f7ca109-6dbfcdcdd6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-5f7ca109: serviceaccount "payload-processing-e2e-mt-5f7ca109" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-5f7ca109-f8b9454c7

SuccessfulCreate

Created pod: payload-processing-e2e-mt-5f7ca109-f8b9454c7-l6ddp

openshift-ingress

deployment-controller

payload-processing-e2e-mt-5f7ca109

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-5f7ca109-f8b9454c7 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-5f7ca109-6dbfcdcdd6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-5f7ca109-6dbfcdcdd6-6tzvs

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-5f7ca109

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-5f7ca109-6dbfcdcdd6 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-5f7ca109-f8b9454c7

FailedCreate

Error creating: pods "payload-processing-e2e-mt-5f7ca109-f8b9454c7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-5f7ca109: serviceaccount "payload-processing-e2e-mt-5f7ca109" not found

openshift-ingress

kubelet

payload-processing-e2e-mt-5f7ca109-f8b9454c7-l6ddp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-5f7ca109-f8b9454c7-l6ddp

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-mt-5f7ca109-f8b9454c7-l6ddp

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-5f7ca109-6dbfcdcdd6-6tzvs

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-5f7ca109-6dbfcdcdd6-6tzvs

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-5f7ca109-6dbfcdcdd6-6tzvs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-5f7ca109-f8b9454c7-l6ddp

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-5f7ca109-6dbfcdcdd6-6tzvs

AddedInterface

Add eth0 [10.133.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-a73e48-694cd5bbd9-wbw54

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-a73e48-7d98954d54-rsmwq

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-mt-5f7ca109-openshift-default-557bb948fb-657tb

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-mt-5f7ca109-openshift-default-557bb948fb-657tb

ProbeError

Readiness probe error: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-mt-5f7ca109-openshift-default-557bb948fb-657tb

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-mt-5f7ca109-openshift-default-557bb948fb-657tb

Unhealthy

Readiness probe failed: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-mt-5f7ca109-openshift-default-557bb948fb-657tb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-mt-5f7ca109-openshift-default-557bb948fb-657tb

ProbeError

Startup probe error: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-5f7ca109-openshift-default-557bb948fb-657tb

Unhealthy

Startup probe failed: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused

openshift-ingress

kubelet

e2e-explicit-a73e48-openshift-default-7b6556cdd-gw9vs

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-noten-ed9962-openshift-default-87699cbf4-km6hv

AddedInterface

Add eth0 [10.132.0.62/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-noten-ed9962

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-ed9962

openshift-ingress

deployment-controller

e2e-noten-ed9962-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-ed9962-openshift-default-87699cbf4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-noten-ed9962-openshift-default-87699cbf4

SuccessfulCreate

Created pod: e2e-noten-ed9962-openshift-default-87699cbf4-km6hv

openshift-ingress

kubelet

e2e-noten-ed9962-openshift-default-87699cbf4-km6hv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-noten-ed9962-openshift-default-87699cbf4-km6hv

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-noten-ed9962-openshift-default-87699cbf4-km6hv

Created

Created container: istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-5f7ca109-6dbfcdcdd6-6tzvs

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-5f7ca109-f8b9454c7-l6ddp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-5f7ca109-openshift-default-557bb948fb-657tb

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-w2-5a8d6f-openshift-default-57c8dcc7c8

SuccessfulCreate

Created pod: e2e-shared-a-w2-5a8d6f-openshift-default-57c8dcc7c8-9mzqw

openshift-ingress

deployment-controller

e2e-shared-a-w2-5a8d6f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-5a8d6f-openshift-default-57c8dcc7c8 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-5a8d6f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-5a8d6f

openshift-ingress

multus

e2e-shared-a-w2-5a8d6f-openshift-default-57c8dcc7c8-9mzqw

AddedInterface

Add eth0 [10.132.0.63/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-5a8d6f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-5a8d6f-9dcf78f65 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-5a8d6f-9dcf78f65

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-5a8d6f-9dcf78f65-8k6qm
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-5a8d6f-9dcf78f65

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-5a8d6f-9dcf78f65-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-5a8d6f: serviceaccount "payload-processing-e2e-shared-a-w2-5a8d6f" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-5a8d6f-68955556b6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-5a8d6f-68955556b6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-5a8d6f: serviceaccount "payload-processing-e2e-shared-a-w2-5a8d6f" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-5a8d6f-68955556b6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-5a8d6f-68955556b6-8n98l

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-5a8d6f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-5a8d6f-68955556b6 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-5a8d6f-9dcf78f65-8k6qm

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-5a8d6f-9dcf78f65-8k6qm

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-5a8d6f-68955556b6-8n98l

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-5a8d6f-68955556b6-8n98l

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-5a8d6f-68955556b6-8n98l

AddedInterface

Add eth0 [10.133.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-5a8d6f-9dcf78f65-8k6qm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-5a8d6f-9dcf78f65-8k6qm

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-5a8d6f-68955556b6-8n98l

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-5a8d6f-openshift-default-57c8dcc7c8-9mzqw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-5a8d6f-openshift-default-57c8dcc7c8-9mzqw

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-5a8d6f-openshift-default-57c8dcc7c8-9mzqw

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-5a8d6f-openshift-default-57c8dcc7c8-9mzqw

Unhealthy

Startup probe failed: Get "http://10.132.0.63:15021/healthz/ready": dial tcp 10.132.0.63:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-5a8d6f-openshift-default-57c8dcc7c8-9mzqw

ProbeError

Startup probe error: Get "http://10.132.0.63:15021/healthz/ready": dial tcp 10.132.0.63:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-d63075

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-d63075

openshift-ingress

deployment-controller

e2e-shared-b-w2-d63075-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-d63075-openshift-default-696965bc98 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w2-d63075-openshift-default-696965bc98

SuccessfulCreate

Created pod: e2e-shared-b-w2-d63075-openshift-default-696965bc98-s8gjh

openshift-ingress

multus

e2e-shared-b-w2-d63075-openshift-default-696965bc98-s8gjh

AddedInterface

Add eth0 [10.132.0.64/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-d63075

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-d63075-768974c9d5 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-d63075-59df885f58

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-d63075-59df885f58-8pbzr
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-d63075-59df885f58

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-d63075-59df885f58-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-d63075: serviceaccount "payload-processing-e2e-shared-b-w2-d63075" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-d63075-768974c9d5

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-d63075-768974c9d5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-d63075: serviceaccount "payload-processing-e2e-shared-b-w2-d63075" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-d63075-768974c9d5

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-d63075-768974c9d5-xzk4j

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-d63075

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-d63075-59df885f58 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-d63075-768974c9d5-xzk4j

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-d63075-59df885f58-8pbzr

AddedInterface

Add eth0 [10.132.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-d63075-768974c9d5-xzk4j

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-d63075-768974c9d5-xzk4j

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-d63075-768974c9d5-xzk4j

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-d63075-59df885f58-8pbzr

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-d63075-59df885f58-8pbzr

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-d63075-59df885f58-8pbzr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-d63075-openshift-default-696965bc98-s8gjh

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-d63075-openshift-default-696965bc98-s8gjh

Unhealthy

Readiness probe failed: Get "http://10.132.0.64:15021/healthz/ready": dial tcp 10.132.0.64:15021: connect: connection refused

openshift-ingress

kubelet

e2e-shared-b-w2-d63075-openshift-default-696965bc98-s8gjh

ProbeError

Readiness probe error: Get "http://10.132.0.64:15021/healthz/ready": dial tcp 10.132.0.64:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-d63075-openshift-default-696965bc98-s8gjh

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-d63075-openshift-default-696965bc98-s8gjh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-d63075-openshift-default-696965bc98-s8gjh

Unhealthy

Startup probe failed: Get "http://10.132.0.64:15021/healthz/ready": dial tcp 10.132.0.64:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-d63075-openshift-default-696965bc98-s8gjh

ProbeError

Startup probe error: Get "http://10.132.0.64:15021/healthz/ready": dial tcp 10.132.0.64:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-mt-baee2b93

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-baee2b93

openshift-ingress

deployment-controller

e2e-mt-baee2b93-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-baee2b93-openshift-default-7f96dd88b8 from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-baee2b93-openshift-default-7f96dd88b8

SuccessfulCreate

Created pod: e2e-mt-baee2b93-openshift-default-7f96dd88b8-fkpgl

openshift-ingress

multus

e2e-mt-baee2b93-openshift-default-7f96dd88b8-fkpgl

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-ed9962-openshift-default-87699cbf4-km6hv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-mt-baee2b93-54575b6977-rqn9r

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-baee2b93-54575b6977

FailedCreate

Error creating: pods "payload-processing-e2e-mt-baee2b93-54575b6977-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-baee2b93: serviceaccount "payload-processing-e2e-mt-baee2b93" not found

openshift-ingress

multus

payload-processing-e2e-mt-baee2b93-54575b6977-rqn9r

AddedInterface

Add eth0 [10.132.0.70/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-baee2b93-7bd7db4886

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-baee2b93-7bd7db4886-rth74

openshift-ingress

kubelet

payload-processing-e2e-mt-baee2b93-54575b6977-rqn9r

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-baee2b93-7bd7db4886-rth74

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-baee2b93-7bd7db4886-rth74

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-baee2b93-7bd7db4886

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-baee2b93-7bd7db4886-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-baee2b93: serviceaccount "payload-processing-e2e-mt-baee2b93" not found

openshift-ingress

kubelet

payload-processing-e2e-mt-baee2b93-54575b6977-rqn9r

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-baee2b93-54575b6977

SuccessfulCreate

Created pod: payload-processing-e2e-mt-baee2b93-54575b6977-rqn9r

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-baee2b93

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-baee2b93-7bd7db4886 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-mt-baee2b93

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-baee2b93-54575b6977 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-baee2b93-7bd7db4886-rth74

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-baee2b93-7bd7db4886-rth74

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-mt-baee2b93-openshift-default-7f96dd88b8-fkpgl

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-baee2b93-openshift-default-7f96dd88b8-fkpgl

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-baee2b93-openshift-default-7f96dd88b8-fkpgl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-mt-baee2b93-openshift-default-7f96dd88b8-fkpgl

Unhealthy

Startup probe failed: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-baee2b93-openshift-default-7f96dd88b8-fkpgl

ProbeError

Startup probe error: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused body:

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-inf-a-9fc4b9

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-inf-a-9fc4b9: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-inf-a-9fc4b9": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-inf-a-9fc4b9, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: ba5283cd-27d6-46e4-8bd9-a3d1ef9ea322, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-9fc4b9-5b67fd497d-gzkt6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-9fc4b9-57fd8f4b99-mgpnb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-a-9fc4b9-openshift-default-86d476c484-cckt8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-inf-b-78522e-f4b89754f-f8kx5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-78522e-666646fc98-n54hf

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-shared-a-w3-7efa8b-openshift-default-59b66b7c4

SuccessfulCreate

Created pod: e2e-shared-a-w3-7efa8b-openshift-default-59b66b7c4-jq8kz

openshift-ingress

deployment-controller

e2e-shared-a-w3-7efa8b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-7efa8b-openshift-default-59b66b7c4 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-7efa8b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-7efa8b

openshift-ingress

kubelet

e2e-inf-b-78522e-openshift-default-6789554c58-h2795

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-shared-a-w3-7efa8b-openshift-default-59b66b7c4-jq8kz

AddedInterface

Add eth0 [10.132.0.74/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-7efa8b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-7efa8b-545cff7746 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-7efa8b-5bd6d54d9c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-7efa8b-5bd6d54d9c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-7efa8b: serviceaccount "payload-processing-e2e-shared-a-w3-7efa8b" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-7efa8b-545cff7746

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-7efa8b-545cff7746-twdn5
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-7efa8b-545cff7746

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-7efa8b-545cff7746-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-7efa8b: serviceaccount "payload-processing-e2e-shared-a-w3-7efa8b" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-7efa8b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-7efa8b-5bd6d54d9c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-7efa8b-5bd6d54d9c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-7efa8b-5bd6d54d9c-rfrf4

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-7efa8b-5bd6d54d9c-rfrf4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-7efa8b-545cff7746-twdn5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-7efa8b-5bd6d54d9c-rfrf4

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-7efa8b-545cff7746-twdn5

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-7efa8b-545cff7746-twdn5

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-7efa8b-545cff7746-twdn5

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-7efa8b-5bd6d54d9c-rfrf4

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-7efa8b-5bd6d54d9c-rfrf4

AddedInterface

Add eth0 [10.132.0.75/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-7efa8b-openshift-default-59b66b7c4-jq8kz

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-7efa8b-openshift-default-59b66b7c4-jq8kz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-shared-a-w3-7efa8b-openshift-default-59b66b7c4-jq8kz

Unhealthy

Readiness probe failed: Get "http://10.132.0.74:15021/healthz/ready": dial tcp 10.132.0.74:15021: connect: connection refused

openshift-ingress

kubelet

e2e-shared-a-w3-7efa8b-openshift-default-59b66b7c4-jq8kz

ProbeError

Readiness probe error: Get "http://10.132.0.74:15021/healthz/ready": dial tcp 10.132.0.74:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-7efa8b-openshift-default-59b66b7c4-jq8kz

Started

Started container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-b-w3-2cc790-openshift-default-6746f98cd6

SuccessfulCreate

Created pod: e2e-shared-b-w3-2cc790-openshift-default-6746f98cd6-4xqjj

openshift-ingress

deployment-controller

e2e-shared-b-w3-2cc790-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-2cc790-openshift-default-6746f98cd6 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-2cc790

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-2cc790

openshift-ingress

multus

e2e-shared-b-w3-2cc790-openshift-default-6746f98cd6-4xqjj

AddedInterface

Add eth0 [10.132.0.76/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-shared-a-w3-7efa8b-openshift-default-59b66b7c4-jq8kz

ProbeError

Startup probe error: Get "http://10.132.0.74:15021/healthz/ready": dial tcp 10.132.0.74:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-shared-a-w3-7efa8b-openshift-default-59b66b7c4-jq8kz

Unhealthy

Startup probe failed: Get "http://10.132.0.74:15021/healthz/ready": dial tcp 10.132.0.74:15021: connect: connection refused

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-2cc790-65464dff98

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-2cc790-65464dff98-nw9r6

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-2cc790

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-2cc790-65464dff98 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-2cc790-65464dff98

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-2cc790-65464dff98-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-2cc790: serviceaccount "payload-processing-e2e-shared-b-w3-2cc790" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-2cc790

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-2cc790-597c44d749 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-2cc790-597c44d749

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-2cc790-597c44d749-gqvdp
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-2cc790-597c44d749

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-2cc790-597c44d749-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-2cc790: serviceaccount "payload-processing-e2e-shared-b-w3-2cc790" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-2cc790-597c44d749-gqvdp

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-2cc790-65464dff98-nw9r6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-2cc790-597c44d749-gqvdp

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-2cc790-65464dff98-nw9r6

AddedInterface

Add eth0 [10.133.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-2cc790-597c44d749-gqvdp

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-2cc790-65464dff98-nw9r6

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-2cc790-597c44d749-gqvdp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-2cc790-65464dff98-nw9r6

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-2cc790-openshift-default-6746f98cd6-4xqjj

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-2cc790-openshift-default-6746f98cd6-4xqjj

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-2cc790-openshift-default-6746f98cd6-4xqjj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-2cc790-openshift-default-6746f98cd6-4xqjj

ProbeError

Startup probe error: Get "http://10.132.0.76:15021/healthz/ready": dial tcp 10.132.0.76:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-2cc790-openshift-default-6746f98cd6-4xqjj

Unhealthy

Startup probe failed: Get "http://10.132.0.76:15021/healthz/ready": dial tcp 10.132.0.76:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-mt-baee2b93-54575b6977-rqn9r

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-baee2b93-7bd7db4886-rth74

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-baee2b93-openshift-default-7f96dd88b8-fkpgl

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-api-a-bcb732

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-bcb732

openshift-ingress

deployment-controller

e2e-api-a-bcb732-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-bcb732-openshift-default-c4f7cc554 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-bcb732-openshift-default-c4f7cc554

SuccessfulCreate

Created pod: e2e-api-a-bcb732-openshift-default-c4f7cc554-ljkb8

openshift-ingress

multus

e2e-api-a-bcb732-openshift-default-c4f7cc554-ljkb8

AddedInterface

Add eth0 [10.132.0.79/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-bcb732-56896f7658

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-bcb732-56896f7658-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-bcb732: serviceaccount "payload-processing-e2e-api-a-bcb732" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-bcb732

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-bcb732-56896f7658 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-bcb732

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-bcb732-778b8b4b5c from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-a-bcb732-778b8b4b5c-zdmzd

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-bcb732-56896f7658-zvfgh

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-api-a-bcb732-778b8b4b5c-zdmzd

AddedInterface

Add eth0 [10.132.0.81/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-bcb732-778b8b4b5c-zdmzd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-a-bcb732-56896f7658-zvfgh

AddedInterface

Add eth0 [10.132.0.80/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-bcb732-56896f7658-zvfgh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-bcb732-56896f7658-zvfgh

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-bcb732-778b8b4b5c-zdmzd

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-bcb732-56896f7658

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-bcb732-56896f7658-zvfgh

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-bcb732-778b8b4b5c

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-bcb732-778b8b4b5c-zdmzd
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-bcb732-778b8b4b5c

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-bcb732-778b8b4b5c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-bcb732: serviceaccount "payload-processing-e2e-api-a-bcb732" not found

openshift-ingress

multus

e2e-api-b-2f0e97-openshift-default-9d8c58fd4-6tjzw

AddedInterface

Add eth0 [10.132.0.82/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-api-b-2f0e97

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-2f0e97

openshift-ingress

deployment-controller

e2e-api-b-2f0e97-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-2f0e97-openshift-default-9d8c58fd4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-2f0e97-openshift-default-9d8c58fd4

SuccessfulCreate

Created pod: e2e-api-b-2f0e97-openshift-default-9d8c58fd4-6tjzw
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-2f0e97-686dcbdfc4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-2f0e97-686dcbdfc4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-2f0e97: serviceaccount "payload-processing-e2e-api-b-2f0e97" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-2f0e97

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-2f0e97-686dcbdfc4 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-2f0e97-686dcbdfc4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-2f0e97-686dcbdfc4-mjfbm
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-2f0e97-888ddd8b7

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-2f0e97-888ddd8b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-2f0e97: serviceaccount "payload-processing-e2e-api-b-2f0e97" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-2f0e97-888ddd8b7

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-2f0e97-888ddd8b7-4c78q

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-2f0e97

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-2f0e97-888ddd8b7 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-2f0e97-686dcbdfc4-mjfbm

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-api-b-2f0e97-888ddd8b7-4c78q

AddedInterface

Add eth0 [10.133.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-2f0e97-686dcbdfc4-mjfbm

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-2f0e97-686dcbdfc4-mjfbm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-b-2f0e97-888ddd8b7-4c78q

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-2f0e97-888ddd8b7-4c78q

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-b-2f0e97-686dcbdfc4-mjfbm

AddedInterface

Add eth0 [10.133.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-2f0e97-888ddd8b7-4c78q

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-bcb732-openshift-default-c4f7cc554-ljkb8

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-bcb732-openshift-default-c4f7cc554-ljkb8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-bcb732-openshift-default-c4f7cc554-ljkb8

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-a-bcb732-openshift-default-c4f7cc554-ljkb8

Unhealthy

Startup probe failed: Get "http://10.132.0.79:15021/healthz/ready": dial tcp 10.132.0.79:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-a-bcb732-openshift-default-c4f7cc554-ljkb8

ProbeError

Startup probe error: Get "http://10.132.0.79:15021/healthz/ready": dial tcp 10.132.0.79:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-6e996c-95fc4785d-5dt6z

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-6e996c-579b598687-nwdqb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w0-6e996c-openshift-default-575d5b56b8-k88zz

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-2f0e97-openshift-default-9d8c58fd4-6tjzw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-2f0e97-openshift-default-9d8c58fd4-6tjzw

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-2f0e97-openshift-default-9d8c58fd4-6tjzw

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-b-2f0e97-openshift-default-9d8c58fd4-6tjzw

ProbeError

Startup probe error: Get "http://10.132.0.82:15021/healthz/ready": dial tcp 10.132.0.82:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-2f0e97-openshift-default-9d8c58fd4-6tjzw

Unhealthy

Startup probe failed: Get "http://10.132.0.82:15021/healthz/ready": dial tcp 10.132.0.82:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-bcb732-56896f7658-zvfgh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-bcb732-778b8b4b5c-zdmzd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-a-bcb732-openshift-default-c4f7cc554-ljkb8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-bcb732-openshift-default-c4f7cc554-ljkb8

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-a-bcb732-openshift-default-c4f7cc554-ljkb8

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-api-b-2f0e97-888ddd8b7-4c78q

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-2f0e97-686dcbdfc4-mjfbm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-2f0e97-openshift-default-9d8c58fd4-6tjzw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-b8fbdd-57dd7dfb7d-fd7v6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-b8fbdd-69dc8955f-zbjbw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w4-b8fbdd-openshift-default-575d4f777b-g7hx4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-5a8d6f-68955556b6-8n98l

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-5a8d6f-9dcf78f65-8k6qm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w4-b8fbdd-openshift-default-575d4f777b-g7hx4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w4-b8fbdd-openshift-default-575d4f777b-g7hx4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w2-5a8d6f-openshift-default-57c8dcc7c8-9mzqw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-d63075-59df885f58-8pbzr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-d63075-768974c9d5-xzk4j

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w2-d63075-openshift-default-696965bc98-s8gjh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-d63075-openshift-default-696965bc98-s8gjh

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w2-d63075-openshift-default-696965bc98-s8gjh

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

multus

e2e-ipp-a-173324-openshift-default-7cf5df54fd-46p9j

AddedInterface

Add eth0 [10.132.0.86/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-173324

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-173324

openshift-ingress

deployment-controller

e2e-ipp-a-173324-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-173324-openshift-default-7cf5df54fd from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-173324-openshift-default-7cf5df54fd

SuccessfulCreate

Created pod: e2e-ipp-a-173324-openshift-default-7cf5df54fd-46p9j

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-173324-7bd485c4c4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-173324-7bd485c4c4-zxdz2
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-173324-7bb57d89bf

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-173324-7bb57d89bf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-173324: serviceaccount "payload-processing-e2e-ipp-a-173324" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-173324-7bd485c4c4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-173324-7bd485c4c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-173324: serviceaccount "payload-processing-e2e-ipp-a-173324" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-173324

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-173324-7bd485c4c4 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-173324-7bb57d89bf

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-173324-7bb57d89bf-gcrbq

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-173324

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-173324-7bb57d89bf from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-173324-7bd485c4c4-zxdz2

AddedInterface

Add eth0 [10.133.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-173324-7bd485c4c4-zxdz2

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-a-173324-7bb57d89bf-gcrbq

AddedInterface

Add eth0 [10.133.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-173324-7bb57d89bf-gcrbq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-173324-7bb57d89bf-gcrbq

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-173324-7bb57d89bf-gcrbq

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-173324-7bd485c4c4-zxdz2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-173324-7bd485c4c4-zxdz2

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-173324-openshift-default-7cf5df54fd-46p9j

ProbeError

Readiness probe error: Get "http://10.132.0.86:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-a-173324-openshift-default-7cf5df54fd-46p9j

Unhealthy

Readiness probe failed: Get "http://10.132.0.86:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ipp-a-173324-openshift-default-7cf5df54fd-46p9j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-173324-openshift-default-7cf5df54fd-46p9j

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-173324-openshift-default-7cf5df54fd-46p9j

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-a-173324-openshift-default-7cf5df54fd-46p9j

Unhealthy

Startup probe failed: Get "http://10.132.0.86:15021/healthz/ready": dial tcp 10.132.0.86:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-173324-openshift-default-7cf5df54fd-46p9j

ProbeError

Startup probe error: Get "http://10.132.0.86:15021/healthz/ready": dial tcp 10.132.0.86:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-d40293

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-d40293

openshift-ingress

deployment-controller

e2e-ipp-b-d40293-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-d40293-openshift-default-54c84b46b8 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-d40293-openshift-default-54c84b46b8

SuccessfulCreate

Created pod: e2e-ipp-b-d40293-openshift-default-54c84b46b8-wl224

openshift-ingress

multus

e2e-ipp-b-d40293-openshift-default-54c84b46b8-wl224

AddedInterface

Add eth0 [10.132.0.87/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-d40293-665f49f49d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-d40293-665f49f49d-xj6pv

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-d40293

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-d40293-7fdbcfc787 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-d40293-665f49f49d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-d40293-665f49f49d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-d40293: serviceaccount "payload-processing-e2e-ipp-b-d40293" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-d40293-7fdbcfc787

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-d40293-7fdbcfc787-59hv5

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-d40293

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-d40293-665f49f49d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-d40293-7fdbcfc787

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-d40293-7fdbcfc787-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-d40293: serviceaccount "payload-processing-e2e-ipp-b-d40293" not found

openshift-ingress

multus

payload-processing-e2e-ipp-b-d40293-7fdbcfc787-59hv5

AddedInterface

Add eth0 [10.132.0.88/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-d40293-665f49f49d-xj6pv

AddedInterface

Add eth0 [10.133.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-d40293-7fdbcfc787-59hv5

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-d40293-665f49f49d-xj6pv

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-d40293-665f49f49d-xj6pv

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-d40293-665f49f49d-xj6pv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-d40293-7fdbcfc787-59hv5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-d40293-7fdbcfc787-59hv5

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-d40293-openshift-default-54c84b46b8-wl224

ProbeError

Readiness probe error: Get "http://10.132.0.87:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-b-d40293-openshift-default-54c84b46b8-wl224

Unhealthy

Readiness probe failed: Get "http://10.132.0.87:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ipp-b-d40293-openshift-default-54c84b46b8-wl224

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-d40293-openshift-default-54c84b46b8-wl224

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-d40293-openshift-default-54c84b46b8-wl224

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-b-d40293-openshift-default-54c84b46b8-wl224

Unhealthy

Startup probe failed: Get "http://10.132.0.87:15021/healthz/ready": dial tcp 10.132.0.87:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-d40293-openshift-default-54c84b46b8-wl224

ProbeError

Startup probe error: Get "http://10.132.0.87:15021/healthz/ready": dial tcp 10.132.0.87:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-1e87f5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-1e87f5

openshift-ingress

deployment-controller

e2e-ipp-cleanup-1e87f5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-1e87f5-openshift-default-59fbc687bd from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-1e87f5-openshift-default-59fbc687bd

SuccessfulCreate

Created pod: e2e-ipp-cleanup-1e87f5-openshift-default-59fbc687bd-72b5j

openshift-ingress

multus

e2e-ipp-cleanup-1e87f5-openshift-default-59fbc687bd-72b5j

AddedInterface

Add eth0 [10.132.0.89/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-1e87f5-7c565789b7

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-1e87f5-7c565789b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-1e87f5: serviceaccount "payload-processing-e2e-ipp-cleanup-1e87f5" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-1e87f5-d76885474

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-1e87f5-d76885474-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-1e87f5: serviceaccount "payload-processing-e2e-ipp-cleanup-1e87f5" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-1e87f5-d76885474

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-1e87f5-d76885474-2g8qk

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-1e87f5-7c565789b7

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-1e87f5-7c565789b7-xtp2j

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-1e87f5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-1e87f5-d76885474 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-1e87f5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-1e87f5-7c565789b7 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-1e87f5-d76885474-2g8qk

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-1e87f5-d76885474-2g8qk

AddedInterface

Add eth0 [10.133.0.77/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-1e87f5-7c565789b7-xtp2j

AddedInterface

Add eth0 [10.133.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-1e87f5-7c565789b7-xtp2j

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-1e87f5-7c565789b7-xtp2j

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-1e87f5-7c565789b7-xtp2j

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-1e87f5-d76885474-2g8qk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-1e87f5-d76885474-2g8qk

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-1e87f5-openshift-default-59fbc687bd-72b5j

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-1e87f5-openshift-default-59fbc687bd-72b5j

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-1e87f5-openshift-default-59fbc687bd-72b5j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-ipp-cleanup-1e87f5-openshift-default-59fbc687bd-72b5j

ProbeError

Startup probe error: Get "http://10.132.0.89:15021/healthz/ready": dial tcp 10.132.0.89:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-cleanup-1e87f5-openshift-default-59fbc687bd-72b5j

Unhealthy

Startup probe failed: Get "http://10.132.0.89:15021/healthz/ready": dial tcp 10.132.0.89:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-1e87f5-7c565789b7-xtp2j

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-1e87f5-d76885474-2g8qk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-1e87f5-openshift-default-59fbc687bd-72b5j

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-173324-7bb57d89bf-gcrbq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-173324-7bd485c4c4-zxdz2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-173324-openshift-default-7cf5df54fd-46p9j

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-173324-openshift-default-7cf5df54fd-46p9j

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-a-173324-openshift-default-7cf5df54fd-46p9j

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-d40293-665f49f49d-xj6pv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-d40293-7fdbcfc787-59hv5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-d40293-openshift-default-54c84b46b8-wl224

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-d40293-openshift-default-54c84b46b8-wl224

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-b-d40293-openshift-default-54c84b46b8-wl224

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-7efa8b-5bd6d54d9c-rfrf4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-7efa8b-545cff7746-twdn5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w3-7efa8b-openshift-default-59b66b7c4-jq8kz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-2cc790-597c44d749-gqvdp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-2cc790-65464dff98-nw9r6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w3-2cc790-openshift-default-6746f98cd6-4xqjj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w3-2cc790-openshift-default-6746f98cd6-4xqjj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w3-2cc790-openshift-default-6746f98cd6-4xqjj

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503