Time Namespace Component RelatedObject Reason Message

openshift-ingress

e2e-migrate-7bed33dc-gw-openshift-default-d5c7b4cd4-hxs6h

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-7bed33dc-gw-openshift-default-d5c7b4cd4-hxs6h to ip-10-0-140-178.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-c34fad-7c9ff8f98f-2b29s

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-c34fad-7c9ff8f98f-2b29s to ip-10-0-130-248.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-vp9n5

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vp9n5 to ip-10-0-132-172.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-j8kd5

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-j8kd5 to ip-10-0-132-172.ec2.internal

openshift-ingress

kube-auth-proxy-6dc98cf6f8-p6m5k

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-6dc98cf6f8-p6m5k to ip-10-0-132-172.ec2.internal

openshift-ingress

e2e-worker-w3-4b633d-openshift-default-fcd56d6f4-fxn48

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-4b633d-openshift-default-fcd56d6f4-fxn48 to ip-10-0-140-178.ec2.internal

openshift-ingress

e2e-worker-w0-5284dc-openshift-default-6797c7d96-ljkmr

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-5284dc-openshift-default-6797c7d96-ljkmr to ip-10-0-140-178.ec2.internal

openshift-ingress

kube-auth-proxy-6dc98cf6f8-zx5xc

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-6dc98cf6f8-zx5xc to ip-10-0-130-248.ec2.internal

openshift-ingress

e2e-ait-0a7e3fae-openshift-default-656fdc8c44-vp26n

Scheduled

Successfully assigned openshift-ingress/e2e-ait-0a7e3fae-openshift-default-656fdc8c44-vp26n to ip-10-0-140-178.ec2.internal

openshift-ingress

e2e-shared-b-w4-81f19d-openshift-default-5557d4f646-hqkcq

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w4-81f19d-openshift-default-5557d4f646-hqkcq to ip-10-0-140-178.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-thwfx

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-thwfx to ip-10-0-140-178.ec2.internal

openshift-ingress

e2e-shared-b-w2-c5206e-openshift-default-7864cb5c8b-xkx5g

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-c5206e-openshift-default-7864cb5c8b-xkx5g to ip-10-0-140-178.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-ktlxz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-ktlxz to ip-10-0-130-248.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-0a7e3fae-7cdb84fc7d-7qqgs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-0a7e3fae-7cdb84fc7d-7qqgs to ip-10-0-130-248.ec2.internal

openshift-ingress

e2e-shared-a-w4-40a1a5-openshift-default-64769dfc98-h89b9

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w4-40a1a5-openshift-default-64769dfc98-h89b9 to ip-10-0-140-178.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-5284dc-5858845794-wblgm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-5284dc-5858845794-wblgm to ip-10-0-130-248.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-c5206e-7c9b5b484f-f2xn4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-c5206e-7c9b5b484f-f2xn4 to ip-10-0-130-248.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-f524d4ec-7d9cbb5cb6-tp292

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-f524d4ec-7d9cbb5cb6-tp292 to ip-10-0-130-248.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-69f1ba-59b5d6fbb6-xbdpd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-69f1ba-59b5d6fbb6-xbdpd to ip-10-0-132-172.ec2.internal

openshift-ingress

e2e-ait-f524d4ec-openshift-default-7cf9f69b46-jpkf2

Scheduled

Successfully assigned openshift-ingress/e2e-ait-f524d4ec-openshift-default-7cf9f69b46-jpkf2 to ip-10-0-140-178.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-3a8052-5cc57f4755-vdxww

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-3a8052-5cc57f4755-vdxww to ip-10-0-132-172.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-46f024-55998f9b57-shlcb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-46f024-55998f9b57-shlcb to ip-10-0-130-248.ec2.internal

openshift-ingress

payload-processing-e2e-derive-fa77d0d6-566cd99897-j79fw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-fa77d0d6-566cd99897-j79fw to ip-10-0-132-172.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w4-40a1a5-5675bc9fbf-7jjsc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w4-40a1a5-5675bc9fbf-7jjsc to ip-10-0-132-172.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-4cd712-74cbd79c74-k6ggt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-4cd712-74cbd79c74-k6ggt to ip-10-0-132-172.ec2.internal

openshift-ingress

e2e-shared-a-w2-5319c6-openshift-default-59bffb687b-8m84x

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-5319c6-openshift-default-59bffb687b-8m84x to ip-10-0-140-178.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-5319c6-6c4b795659-2bl2d

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-5319c6-6c4b795659-2bl2d to ip-10-0-130-248.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-d0d77c-68db6956bb-nxnvn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-d0d77c-68db6956bb-nxnvn to ip-10-0-132-172.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-46f024-c7c9dbc54-kwk2v

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-46f024-c7c9dbc54-kwk2v to ip-10-0-132-172.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-3a8052-6f755cc7c8-ll6nd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-3a8052-6f755cc7c8-ll6nd to ip-10-0-130-248.ec2.internal

openshift-ingress

e2e-api-a-69f1ba-openshift-default-569c8d9dd6-wn99g

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-69f1ba-openshift-default-569c8d9dd6-wn99g to ip-10-0-140-178.ec2.internal

openshift-ingress

payload-processing-e2e-autores-d0d77c-649b889959-bkvfh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-d0d77c-649b889959-bkvfh to ip-10-0-132-172.ec2.internal

openshift-ingress

e2e-noten-a733e2-openshift-default-66b6684854-xdvs6

Scheduled

Successfully assigned openshift-ingress/e2e-noten-a733e2-openshift-default-66b6684854-xdvs6 to ip-10-0-140-178.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-c34fad-b4565dc4b-qzggp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-c34fad-b4565dc4b-qzggp to ip-10-0-132-172.ec2.internal

openshift-ingress

e2e-mt-aba3750c-openshift-default-7ffb5f9756-2w5df

Scheduled

Successfully assigned openshift-ingress/e2e-mt-aba3750c-openshift-default-7ffb5f9756-2w5df to ip-10-0-140-178.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-de7ea3-7b9c9945bb-8v2jb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-de7ea3-7b9c9945bb-8v2jb to ip-10-0-130-248.ec2.internal

openshift-ingress

payload-processing-e2e-mt-aba3750c-7cb845fbb5-dbjgd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-aba3750c-7cb845fbb5-dbjgd to ip-10-0-132-172.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-a1a0a2-6d8cdc97fd-jbb8m

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-a1a0a2-6d8cdc97fd-jbb8m to ip-10-0-132-172.ec2.internal

openshift-ingress

payload-processing-e2e-mt-7d49a30d-db75dd9fc-6z26j

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-7d49a30d-db75dd9fc-6z26j to ip-10-0-132-172.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-876382-7d8fc7cc66-6cnj9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-876382-7d8fc7cc66-6cnj9 to ip-10-0-130-248.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-7bed33dc-7574cd898-8mvph

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-7bed33dc-7574cd898-8mvph to ip-10-0-132-172.ec2.internal

openshift-ingress

e2e-api-b-4cd712-openshift-default-85df66dcb4-p8526

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-4cd712-openshift-default-85df66dcb4-p8526 to ip-10-0-140-178.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-876382-7797846bd7-h7hgx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-876382-7797846bd7-h7hgx to ip-10-0-132-172.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-7bed33dc-76c564f54-4vlgj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-7bed33dc-76c564f54-4vlgj to ip-10-0-130-248.ec2.internal

openshift-ingress

e2e-mt-7d49a30d-openshift-default-644f67b664-7f6c4

Scheduled

Successfully assigned openshift-ingress/e2e-mt-7d49a30d-openshift-default-644f67b664-7f6c4 to ip-10-0-140-178.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-7d49a30d-666789878-rfx57

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-7d49a30d-666789878-rfx57 to ip-10-0-130-248.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-aba3750c-55f999b9fd-l47xt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-aba3750c-55f999b9fd-l47xt to ip-10-0-130-248.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-5319c6-7d59bcf4fd-j2cnm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-5319c6-7d59bcf4fd-j2cnm to ip-10-0-132-172.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-a1a0a2-797c5469b7-j94zc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-a1a0a2-797c5469b7-j94zc to ip-10-0-130-248.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-de7ea3-fcbdf454c-lncdr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-de7ea3-fcbdf454c-lncdr to ip-10-0-132-172.ec2.internal

openshift-ingress

router-default-7ff8bb4888-5sfkj

Scheduled

Successfully assigned openshift-ingress/router-default-7ff8bb4888-5sfkj to ip-10-0-140-178.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w4-40a1a5-7dd4f759c8-7c7tn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w4-40a1a5-7dd4f759c8-7c7tn to ip-10-0-132-172.ec2.internal

openshift-ingress

e2e-autores-d0d77c-openshift-default-5b67d98676-5p2nr

Scheduled

Successfully assigned openshift-ingress/e2e-autores-d0d77c-openshift-default-5b67d98676-5p2nr to ip-10-0-140-178.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-c5206e-5bc4ddbd58-6f82t

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-c5206e-5bc4ddbd58-6f82t to ip-10-0-132-172.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w4-81f19d-654546cbd6-lh8sz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w4-81f19d-654546cbd6-lh8sz to ip-10-0-130-248.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-fa77d0d6-549d6cd49d-xrc9h

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-fa77d0d6-549d6cd49d-xrc9h to ip-10-0-132-172.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w4-81f19d-669f594fb5-djwkg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w4-81f19d-669f594fb5-djwkg to ip-10-0-132-172.ec2.internal

openshift-ingress

e2e-ipp-cleanup-876382-openshift-default-854df5b556-x2phg

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-876382-openshift-default-854df5b556-x2phg to ip-10-0-140-178.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w3-4b633d-86ddb8f76b-bvk84

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w3-4b633d-86ddb8f76b-bvk84 to ip-10-0-132-172.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-5284dc-97575bc5-jl756

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-5284dc-97575bc5-jl756 to ip-10-0-132-172.ec2.internal

openshift-ingress

e2e-ipp-b-a1a0a2-openshift-default-5746f6c86d-n7dzt

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-a1a0a2-openshift-default-5746f6c86d-n7dzt to ip-10-0-140-178.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w3-4b633d-5b696bd5f7-nvjnq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w3-4b633d-5b696bd5f7-nvjnq to ip-10-0-130-248.ec2.internal

openshift-ingress

e2e-ipp-a-de7ea3-openshift-default-6c5cf9d56-vbwbd

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-de7ea3-openshift-default-6c5cf9d56-vbwbd to ip-10-0-140-178.ec2.internal

openshift-ingress

e2e-derive-fa77d0d6-openshift-default-749c9d66cb-bdr8g

Scheduled

Successfully assigned openshift-ingress/e2e-derive-fa77d0d6-openshift-default-749c9d66cb-bdr8g to ip-10-0-140-178.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-xr9rk

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-xr9rk to ip-10-0-130-248.ec2.internal

openshift-ingress

e2e-inf-b-c34fad-openshift-default-6b5889c74b-vpxnm

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-c34fad-openshift-default-6b5889c74b-vpxnm to ip-10-0-140-178.ec2.internal

openshift-ingress

e2e-inf-a-3a8052-openshift-default-744fc9b4f6-kgknk

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-3a8052-openshift-default-744fc9b4f6-kgknk to ip-10-0-140-178.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-4cd712-6bf66cbb55-jv6s9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-4cd712-6bf66cbb55-jv6s9 to ip-10-0-130-248.ec2.internal

openshift-ingress

payload-processing-e2e-ait-0a7e3fae-776d9784f5-zhk64

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-0a7e3fae-776d9784f5-zhk64 to ip-10-0-132-172.ec2.internal

openshift-ingress

e2e-explicit-46f024-openshift-default-b6bd79d7b-h82dm

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-46f024-openshift-default-b6bd79d7b-h82dm to ip-10-0-140-178.ec2.internal

openshift-ingress

payload-processing-e2e-ait-f524d4ec-9d7c9c89c-pb75r

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-f524d4ec-9d7c9c89c-pb75r to ip-10-0-132-172.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-69f1ba-7b76fd84d5-n6mjz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-69f1ba-7b76fd84d5-n6mjz to ip-10-0-132-172.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-5zktm

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5zktm to ip-10-0-140-178.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-7ff8bb4888 from 0 to 1
(x12)

openshift-ingress

replicaset-controller

router-default-7ff8bb4888

FailedCreate

Error creating: pods "router-default-7ff8bb4888-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x16)

openshift-ingress

replicaset-controller

router-default-7ff8bb4888

FailedCreate

Error creating: pods "router-default-7ff8bb4888-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-7ff8bb4888

SuccessfulCreate

Created pod: router-default-7ff8bb4888-5sfkj
(x5)

openshift-ingress

kubelet

router-default-7ff8bb4888-5sfkj

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x5)

openshift-ingress

kubelet

router-default-7ff8bb4888-5sfkj

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

multus

router-default-7ff8bb4888-5sfkj

AddedInterface

Add eth0 [10.133.0.11/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-7ff8bb4888-5sfkj

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eaa467bc105be2f7695ecfea0f0c53f4c5cd52f1f705da378c7a33d13f1d102f" already present on machine

openshift-ingress

kubelet

router-default-7ff8bb4888-5sfkj

Started

Started container router

openshift-ingress

kubelet

router-default-7ff8bb4888-5sfkj

Created

Created container: router
(x4)

openshift-ingress

replicaset-controller

kube-auth-proxy-6dc98cf6f8

FailedCreate

Error creating: pods "kube-auth-proxy-6dc98cf6f8-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-6dc98cf6f8

SuccessfulCreate

Created pod: kube-auth-proxy-6dc98cf6f8-p6m5k

openshift-ingress

replicaset-controller

kube-auth-proxy-6dc98cf6f8

SuccessfulCreate

Created pod: kube-auth-proxy-6dc98cf6f8-zx5xc

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-6dc98cf6f8 from 0 to 2

openshift-ingress

kubelet

kube-auth-proxy-6dc98cf6f8-zx5xc

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-6dc98cf6f8-p6m5k

AddedInterface

Add eth0 [10.132.0.17/23] from ovn-kubernetes

openshift-ingress

multus

kube-auth-proxy-6dc98cf6f8-zx5xc

AddedInterface

Add eth0 [10.134.0.29/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-6dc98cf6f8-p6m5k

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-vp9n5

openshift-ingress

kubelet

kube-auth-proxy-6dc98cf6f8-p6m5k

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.777s (2.777s including waiting). Image size: 265120132 bytes.

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

kubelet

kube-auth-proxy-6dc98cf6f8-p6m5k

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-6dc98cf6f8-p6m5k

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-6dc98cf6f8-zx5xc

Started

Started container kube-auth-proxy

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-vp9n5

AddedInterface

Add eth0 [10.132.0.18/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-vp9n5

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

kube-auth-proxy-6dc98cf6f8-zx5xc

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.702s (2.702s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-6dc98cf6f8-zx5xc

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-vp9n5

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.358s (2.358s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-vp9n5

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-vp9n5

Started

Started container discovery

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-vp9n5

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-5zktm

AddedInterface

Add eth0 [10.133.0.32/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-vp9n5

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-5zktm

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-5zktm

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-5zktm

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.914s (2.914s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-5zktm

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-5zktm

Started

Started container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-j8kd5

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-j8kd5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" already present on machine

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-j8kd5

Started

Started container discovery

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-j8kd5

AddedInterface

Add eth0 [10.132.0.19/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-j8kd5

Created

Created container: discovery

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-vp9n5

Killing

Stopping container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-vp9n5

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-thwfx

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-thwfx

AddedInterface

Add eth0 [10.133.0.42/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-ktlxz

AddedInterface

Add eth0 [10.134.0.35/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-ktlxz

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-xr9rk

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-ktlxz
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

multus

payload-processing-5b54b7fbb7-xr9rk

AddedInterface

Add eth0 [10.134.0.36/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-xr9rk

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-ktlxz

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.712s (2.712s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-xr9rk

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.663s (2.663s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-ktlxz

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-xr9rk

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-xr9rk

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-ktlxz

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-thwfx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-thwfx

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-thwfx

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-thwfx

Unhealthy

Startup probe failed: Get "http://10.133.0.42:15021/healthz/ready": dial tcp 10.133.0.42:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-thwfx

ProbeError

Startup probe error: Get "http://10.133.0.42:15021/healthz/ready": dial tcp 10.133.0.42:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-worker-w3-4b633d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-4b633d-openshift-default-fcd56d6f4 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-5284dc

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-5284dc

openshift-ingress

gateway_labeler_controller

e2e-worker-w3-4b633d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w3-4b633d

openshift-ingress

gateway_labeler_controller

e2e-inf-a-3a8052

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-3a8052

openshift-ingress

deployment-controller

e2e-inf-a-3a8052-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-3a8052-openshift-default-744fc9b4f6 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-3a8052-openshift-default-744fc9b4f6

SuccessfulCreate

Created pod: e2e-inf-a-3a8052-openshift-default-744fc9b4f6-kgknk

openshift-ingress

replicaset-controller

e2e-worker-w3-4b633d-openshift-default-fcd56d6f4

SuccessfulCreate

Created pod: e2e-worker-w3-4b633d-openshift-default-fcd56d6f4-fxn48

openshift-ingress

deployment-controller

e2e-worker-w0-5284dc-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-5284dc-openshift-default-6797c7d96 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w0-5284dc-openshift-default-6797c7d96

SuccessfulCreate

Created pod: e2e-worker-w0-5284dc-openshift-default-6797c7d96-ljkmr

openshift-ingress

multus

e2e-worker-w0-5284dc-openshift-default-6797c7d96-ljkmr

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes

openshift-ingress

multus

e2e-inf-a-3a8052-openshift-default-744fc9b4f6-kgknk

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w3-4b633d-openshift-default-fcd56d6f4-fxn48

AddedInterface

Add eth0 [10.133.0.44/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-5284dc-5858845794

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-5284dc-5858845794-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-5284dc: serviceaccount "payload-processing-e2e-worker-w0-5284dc" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-5284dc-97575bc5

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-5284dc-97575bc5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-5284dc: serviceaccount "payload-processing-e2e-worker-w0-5284dc" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-5284dc-97575bc5

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-5284dc-97575bc5-jl756

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-5284dc

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-5284dc-5858845794 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-5284dc

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-5284dc-97575bc5 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-5284dc-5858845794

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-5284dc-5858845794-wblgm

openshift-ingress

deployment-controller

e2e-autores-d0d77c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-d0d77c-openshift-default-5b67d98676 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-autores-d0d77c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-d0d77c

openshift-ingress

replicaset-controller

e2e-autores-d0d77c-openshift-default-5b67d98676

SuccessfulCreate

Created pod: e2e-autores-d0d77c-openshift-default-5b67d98676-5p2nr

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-5284dc-5858845794-wblgm

FailedMount

MountVolume.SetUp failed for volume "plugins-config-volume" : failed to sync configmap cache: timed out waiting for the condition

openshift-ingress

multus

payload-processing-e2e-worker-w0-5284dc-97575bc5-jl756

AddedInterface

Add eth0 [10.132.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-5284dc-5858845794-wblgm

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-5284dc-97575bc5-jl756

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-4b633d-5b696bd5f7

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w3-4b633d-5b696bd5f7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-4b633d: serviceaccount "payload-processing-e2e-worker-w3-4b633d" not found

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w3-4b633d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w3-4b633d-5b696bd5f7 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w3-4b633d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w3-4b633d-86ddb8f76b from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-5284dc-5858845794-wblgm

Started

Started container payload-pre-processing

openshift-ingress

multus

e2e-autores-d0d77c-openshift-default-5b67d98676-5p2nr

AddedInterface

Add eth0 [10.133.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-5284dc-5858845794-wblgm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-5284dc-5858845794-wblgm

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-5284dc-97575bc5-jl756

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-worker-w3-4b633d-86ddb8f76b-bvk84

AddedInterface

Add eth0 [10.132.0.36/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-worker-w3-4b633d-5b696bd5f7-nvjnq

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-4b633d-5b696bd5f7-nvjnq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-5284dc-97575bc5-jl756

Started

Started container payload-processing
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-4b633d-86ddb8f76b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w3-4b633d-86ddb8f76b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-4b633d: serviceaccount "payload-processing-e2e-worker-w3-4b633d" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-4b633d-5b696bd5f7-nvjnq

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-5284dc-97575bc5-jl756

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.236s (1.236s including waiting). Image size: 166449312 bytes.

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-4b633d-5b696bd5f7

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w3-4b633d-5b696bd5f7-nvjnq

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-4b633d-86ddb8f76b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w3-4b633d-86ddb8f76b-bvk84

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-4b633d-5b696bd5f7-nvjnq

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-4b633d-86ddb8f76b-bvk84

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-4b633d-86ddb8f76b-bvk84

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-4b633d-86ddb8f76b-bvk84

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-3a8052-5cc57f4755

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-3a8052-5cc57f4755-vdxww
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-3a8052-5cc57f4755

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-3a8052-5cc57f4755-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-3a8052: serviceaccount "payload-processing-e2e-inf-a-3a8052" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-3a8052

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-3a8052-5cc57f4755 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-3a8052-6f755cc7c8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-3a8052-6f755cc7c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-3a8052: serviceaccount "payload-processing-e2e-inf-a-3a8052" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-3a8052-6f755cc7c8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-3a8052-6f755cc7c8-ll6nd

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-3a8052

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-3a8052-6f755cc7c8 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-3a8052-6f755cc7c8-ll6nd

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-inf-a-3a8052-5cc57f4755-vdxww

AddedInterface

Add eth0 [10.132.0.38/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-3a8052-5cc57f4755-vdxww

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-3a8052-5cc57f4755-vdxww

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-3a8052-6f755cc7c8-ll6nd

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-3a8052-6f755cc7c8-ll6nd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-3a8052-6f755cc7c8-ll6nd

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-3a8052-5cc57f4755-vdxww

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

gateway_labeler_controller

e2e-ait-0a7e3fae

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-0a7e3fae

openshift-ingress

replicaset-controller

e2e-ait-0a7e3fae-openshift-default-656fdc8c44

SuccessfulCreate

Created pod: e2e-ait-0a7e3fae-openshift-default-656fdc8c44-vp26n

openshift-ingress

multus

e2e-ait-0a7e3fae-openshift-default-656fdc8c44-vp26n

AddedInterface

Add eth0 [10.133.0.50/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ait-0a7e3fae-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-0a7e3fae-openshift-default-656fdc8c44 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-autores-d0d77c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-d0d77c-649b889959 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-d0d77c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-d0d77c-68db6956bb from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-d0d77c-649b889959

FailedCreate

Error creating: pods "payload-processing-e2e-autores-d0d77c-649b889959-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-d0d77c: serviceaccount "payload-processing-e2e-autores-d0d77c" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-d0d77c-649b889959

SuccessfulCreate

Created pod: payload-processing-e2e-autores-d0d77c-649b889959-bkvfh
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-d0d77c-68db6956bb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-d0d77c-68db6956bb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-d0d77c: serviceaccount "payload-processing-e2e-autores-d0d77c" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-d0d77c-68db6956bb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-d0d77c-68db6956bb-nxnvn

openshift-ingress

multus

payload-processing-e2e-autores-d0d77c-649b889959-bkvfh

AddedInterface

Add eth0 [10.132.0.40/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-autores-d0d77c-68db6956bb-nxnvn

AddedInterface

Add eth0 [10.132.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-d0d77c-68db6956bb-nxnvn

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-d0d77c-649b889959-bkvfh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-autores-d0d77c-649b889959-bkvfh

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-d0d77c-68db6956bb-nxnvn

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-d0d77c-68db6956bb-nxnvn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-autores-d0d77c-649b889959-bkvfh

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-worker-w3-4b633d-openshift-default-fcd56d6f4-fxn48

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w0-5284dc-openshift-default-6797c7d96-ljkmr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-3a8052-openshift-default-744fc9b4f6-kgknk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-3a8052-openshift-default-744fc9b4f6-kgknk

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w3-4b633d-openshift-default-fcd56d6f4-fxn48

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w3-4b633d-openshift-default-fcd56d6f4-fxn48

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-3a8052-openshift-default-744fc9b4f6-kgknk

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-5284dc-openshift-default-6797c7d96-ljkmr

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-5284dc-openshift-default-6797c7d96-ljkmr

Created

Created container: istio-proxy

openshift-ingress

replicaset-controller

e2e-inf-b-c34fad-openshift-default-6b5889c74b

SuccessfulCreate

Created pod: e2e-inf-b-c34fad-openshift-default-6b5889c74b-vpxnm

openshift-ingress

deployment-controller

e2e-inf-b-c34fad-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-c34fad-openshift-default-6b5889c74b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-b-c34fad

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-c34fad

openshift-ingress

multus

e2e-inf-b-c34fad-openshift-default-6b5889c74b-vpxnm

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-0a7e3fae-7cdb84fc7d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-0a7e3fae-7cdb84fc7d-7qqgs
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-0a7e3fae-7cdb84fc7d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-0a7e3fae-7cdb84fc7d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-0a7e3fae: serviceaccount "payload-processing-e2e-ait-0a7e3fae" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-0a7e3fae

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-0a7e3fae-7cdb84fc7d from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ait-0a7e3fae

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-0a7e3fae-776d9784f5 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-0a7e3fae-776d9784f5

SuccessfulCreate

Created pod: payload-processing-e2e-ait-0a7e3fae-776d9784f5-zhk64
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-0a7e3fae-776d9784f5

FailedCreate

Error creating: pods "payload-processing-e2e-ait-0a7e3fae-776d9784f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-0a7e3fae: serviceaccount "payload-processing-e2e-ait-0a7e3fae" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-0a7e3fae-7cdb84fc7d-7qqgs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-0a7e3fae-7cdb84fc7d-7qqgs

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-0a7e3fae-776d9784f5-zhk64

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-0a7e3fae-776d9784f5-zhk64

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-0a7e3fae-7cdb84fc7d-7qqgs

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ait-0a7e3fae-776d9784f5-zhk64

AddedInterface

Add eth0 [10.132.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-0a7e3fae-776d9784f5-zhk64

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-0a7e3fae-7cdb84fc7d-7qqgs

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-inf-a-3a8052-openshift-default-744fc9b4f6-kgknk

Unhealthy

Startup probe failed: Get "http://10.133.0.45:15021/healthz/ready": dial tcp 10.133.0.45:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-inf-a-3a8052-openshift-default-744fc9b4f6-kgknk

ProbeError

Startup probe error: Get "http://10.133.0.45:15021/healthz/ready": dial tcp 10.133.0.45:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w3-4b633d-openshift-default-fcd56d6f4-fxn48

Unhealthy

Startup probe failed: Get "http://10.133.0.44:15021/healthz/ready": dial tcp 10.133.0.44:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w3-4b633d-openshift-default-fcd56d6f4-fxn48

ProbeError

Startup probe error: Get "http://10.133.0.44:15021/healthz/ready": dial tcp 10.133.0.44:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w0-5284dc-openshift-default-6797c7d96-ljkmr

ProbeError

Startup probe error: Get "http://10.133.0.46:15021/healthz/ready": dial tcp 10.133.0.46:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w0-5284dc-openshift-default-6797c7d96-ljkmr

Unhealthy

Startup probe failed: Get "http://10.133.0.46:15021/healthz/ready": dial tcp 10.133.0.46:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-c34fad

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-c34fad-b4565dc4b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-c34fad-b4565dc4b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-c34fad-b4565dc4b-qzggp
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-c34fad-b4565dc4b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-c34fad-b4565dc4b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-c34fad: serviceaccount "payload-processing-e2e-inf-b-c34fad" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-c34fad-7c9ff8f98f

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-c34fad-7c9ff8f98f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-c34fad: serviceaccount "payload-processing-e2e-inf-b-c34fad" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-c34fad

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-c34fad-7c9ff8f98f from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-c34fad-b4565dc4b-qzggp

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-autores-d0d77c-openshift-default-5b67d98676-5p2nr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-b-c34fad-7c9ff8f98f-2b29s

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-c34fad-7c9ff8f98f-2b29s

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-c34fad-b4565dc4b-qzggp

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-autores-d0d77c-openshift-default-5b67d98676-5p2nr

Created

Created container: istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-c34fad-b4565dc4b-qzggp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-autores-d0d77c-openshift-default-5b67d98676-5p2nr

Started

Started container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-c34fad-b4565dc4b-qzggp

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-c34fad-7c9ff8f98f

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-c34fad-7c9ff8f98f-2b29s

openshift-ingress

multus

payload-processing-e2e-inf-b-c34fad-7c9ff8f98f-2b29s

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-c34fad-7c9ff8f98f-2b29s

Started

Started container payload-processing
(x7)

openshift-ingress

kubelet

e2e-autores-d0d77c-openshift-default-5b67d98676-5p2nr

ProbeError

Startup probe error: Get "http://10.133.0.49:15021/healthz/ready": dial tcp 10.133.0.49:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-autores-d0d77c-openshift-default-5b67d98676-5p2nr

Unhealthy

Startup probe failed: Get "http://10.133.0.49:15021/healthz/ready": dial tcp 10.133.0.49:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-ait-0a7e3fae-openshift-default-656fdc8c44-vp26n

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-0a7e3fae-openshift-default-656fdc8c44-vp26n

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-0a7e3fae-openshift-default-656fdc8c44-vp26n

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ait-0a7e3fae-openshift-default-656fdc8c44-vp26n

ProbeError

Startup probe error: Get "http://10.133.0.50:15021/healthz/ready": dial tcp 10.133.0.50:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-0a7e3fae-openshift-default-656fdc8c44-vp26n

Unhealthy

Startup probe failed: Get "http://10.133.0.50:15021/healthz/ready": dial tcp 10.133.0.50:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-inf-b-c34fad-openshift-default-6b5889c74b-vpxnm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-c34fad-openshift-default-6b5889c74b-vpxnm

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-c34fad-openshift-default-6b5889c74b-vpxnm

Started

Started container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-0a7e3fae-7cdb84fc7d-7qqgs

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-0a7e3fae-776d9784f5-zhk64

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-0a7e3fae-openshift-default-656fdc8c44-vp26n

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-migrate-7bed33dc-gw-openshift-default-d5c7b4cd4-hxs6h

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-inf-b-c34fad-openshift-default-6b5889c74b-vpxnm

ProbeError

Startup probe error: Get "http://10.133.0.51:15021/healthz/ready": dial tcp 10.133.0.51:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-migrate-7bed33dc-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-7bed33dc-gw

openshift-ingress

deployment-controller

e2e-migrate-7bed33dc-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-7bed33dc-gw-openshift-default-d5c7b4cd4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-migrate-7bed33dc-gw-openshift-default-d5c7b4cd4

SuccessfulCreate

Created pod: e2e-migrate-7bed33dc-gw-openshift-default-d5c7b4cd4-hxs6h
(x6)

openshift-ingress

kubelet

e2e-inf-b-c34fad-openshift-default-6b5889c74b-vpxnm

Unhealthy

Startup probe failed: Get "http://10.133.0.51:15021/healthz/ready": dial tcp 10.133.0.51:15021: connect: connection refused

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-7bed33dc-76c564f54

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-7bed33dc-76c564f54-4vlgj
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-7bed33dc-76c564f54

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-7bed33dc-76c564f54-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-7bed33dc: serviceaccount "payload-processing-e2e-migrate-7bed33dc" not found

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-7bed33dc

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-7bed33dc-7574cd898 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-7bed33dc-7574cd898

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-7bed33dc-7574cd898-8mvph
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-7bed33dc-7574cd898

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-7bed33dc-7574cd898-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-7bed33dc: serviceaccount "payload-processing-e2e-migrate-7bed33dc" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-7bed33dc

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-7bed33dc-76c564f54 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-migrate-7bed33dc-7574cd898-8mvph

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-7bed33dc-7574cd898-8mvph

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-migrate-7bed33dc-7574cd898-8mvph

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-migrate-7bed33dc-76c564f54-4vlgj

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-7bed33dc-76c564f54-4vlgj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-7bed33dc-76c564f54-4vlgj

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-7bed33dc-76c564f54-4vlgj

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-7bed33dc-7574cd898-8mvph

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-migrate-7bed33dc-gw-openshift-default-d5c7b4cd4-hxs6h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-7bed33dc-gw-openshift-default-d5c7b4cd4-hxs6h

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-7bed33dc-gw-openshift-default-d5c7b4cd4-hxs6h

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-migrate-7bed33dc-gw-openshift-default-d5c7b4cd4-hxs6h

ProbeError

Startup probe error: Get "http://10.133.0.53:15021/healthz/ready": dial tcp 10.133.0.53:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-migrate-7bed33dc-gw-openshift-default-d5c7b4cd4-hxs6h

Unhealthy

Startup probe failed: Get "http://10.133.0.53:15021/healthz/ready": dial tcp 10.133.0.53:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-migrate-7bed33dc-7574cd898-8mvph

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-7bed33dc-76c564f54-4vlgj

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-ait-f524d4ec-openshift-default-7cf9f69b46

SuccessfulCreate

Created pod: e2e-ait-f524d4ec-openshift-default-7cf9f69b46-jpkf2

openshift-ingress

deployment-controller

e2e-ait-f524d4ec-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-f524d4ec-openshift-default-7cf9f69b46 from 0 to 1

openshift-ingress

kubelet

e2e-migrate-7bed33dc-gw-openshift-default-d5c7b4cd4-hxs6h

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-migrate-7bed33dc-gw-openshift-default-d5c7b4cd4-hxs6h

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-migrate-7bed33dc-gw-openshift-default-d5c7b4cd4-hxs6h

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ait-f524d4ec

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-f524d4ec

openshift-ingress

multus

e2e-ait-f524d4ec-openshift-default-7cf9f69b46-jpkf2

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-f524d4ec-7d9cbb5cb6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-f524d4ec-7d9cbb5cb6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-f524d4ec: serviceaccount "payload-processing-e2e-ait-f524d4ec" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f524d4ec-7d9cbb5cb6-tp292

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-f524d4ec-9d7c9c89c-pb75r

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-f524d4ec-9d7c9c89c-pb75r

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-f524d4ec-9d7c9c89c-pb75r

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-f524d4ec-9d7c9c89c-pb75r

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-f524d4ec

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-f524d4ec-7d9cbb5cb6 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-f524d4ec-7d9cbb5cb6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-f524d4ec-7d9cbb5cb6-tp292

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f524d4ec-7d9cbb5cb6-tp292

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f524d4ec-7d9cbb5cb6-tp292

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-f524d4ec-7d9cbb5cb6-tp292

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ait-f524d4ec

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-f524d4ec-9d7c9c89c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-f524d4ec-9d7c9c89c

SuccessfulCreate

Created pod: payload-processing-e2e-ait-f524d4ec-9d7c9c89c-pb75r
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-f524d4ec-9d7c9c89c

FailedCreate

Error creating: pods "payload-processing-e2e-ait-f524d4ec-9d7c9c89c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-f524d4ec: serviceaccount "payload-processing-e2e-ait-f524d4ec" not found
(x2)

openshift-ingress

kubelet

e2e-ait-f524d4ec-openshift-default-7cf9f69b46-jpkf2

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-f524d4ec-openshift-default-7cf9f69b46-jpkf2

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-f524d4ec-openshift-default-7cf9f69b46-jpkf2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ait-f524d4ec-openshift-default-7cf9f69b46-jpkf2

ProbeError

Startup probe error: Get "http://10.133.0.56:15021/healthz/ready": dial tcp 10.133.0.56:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-f524d4ec-openshift-default-7cf9f69b46-jpkf2

Unhealthy

Startup probe failed: Get "http://10.133.0.56:15021/healthz/ready": dial tcp 10.133.0.56:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ait-f524d4ec-9d7c9c89c-pb75r

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f524d4ec-7d9cbb5cb6-tp292

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-f524d4ec-openshift-default-7cf9f69b46-jpkf2

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-derive-fa77d0d6-openshift-default-749c9d66cb-bdr8g

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-derive-fa77d0d6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-fa77d0d6

openshift-ingress

deployment-controller

e2e-derive-fa77d0d6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-fa77d0d6-openshift-default-749c9d66cb from 0 to 1

openshift-ingress

replicaset-controller

e2e-derive-fa77d0d6-openshift-default-749c9d66cb

SuccessfulCreate

Created pod: e2e-derive-fa77d0d6-openshift-default-749c9d66cb-bdr8g

openshift-ingress

kubelet

payload-processing-e2e-derive-fa77d0d6-566cd99897-j79fw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-fa77d0d6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-fa77d0d6-549d6cd49d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-fa77d0d6-549d6cd49d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-fa77d0d6-549d6cd49d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-fa77d0d6: serviceaccount "payload-processing-e2e-derive-fa77d0d6" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-fa77d0d6-549d6cd49d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-fa77d0d6-549d6cd49d-xrc9h

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-fa77d0d6-566cd99897

SuccessfulCreate

Created pod: payload-processing-e2e-derive-fa77d0d6-566cd99897-j79fw

openshift-ingress

multus

payload-processing-e2e-derive-fa77d0d6-566cd99897-j79fw

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-derive-fa77d0d6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-fa77d0d6-566cd99897 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-fa77d0d6-566cd99897

FailedCreate

Error creating: pods "payload-processing-e2e-derive-fa77d0d6-566cd99897-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-fa77d0d6: serviceaccount "payload-processing-e2e-derive-fa77d0d6" not found

openshift-ingress

kubelet

payload-processing-e2e-derive-fa77d0d6-566cd99897-j79fw

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-derive-fa77d0d6-549d6cd49d-xrc9h

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-fa77d0d6-549d6cd49d-xrc9h

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-fa77d0d6-549d6cd49d-xrc9h

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-fa77d0d6-549d6cd49d-xrc9h

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-derive-fa77d0d6-566cd99897-j79fw

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-derive-fa77d0d6-openshift-default-749c9d66cb-bdr8g

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-fa77d0d6-openshift-default-749c9d66cb-bdr8g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-fa77d0d6-openshift-default-749c9d66cb-bdr8g

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-derive-fa77d0d6-openshift-default-749c9d66cb-bdr8g

ProbeError

Startup probe error: Get "http://10.133.0.59:15021/healthz/ready": dial tcp 10.133.0.59:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-derive-fa77d0d6-openshift-default-749c9d66cb-bdr8g

Unhealthy

Startup probe failed: Get "http://10.133.0.59:15021/healthz/ready": dial tcp 10.133.0.59:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-d0d77c-68db6956bb-nxnvn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-d0d77c-649b889959-bkvfh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-fa77d0d6-566cd99897-j79fw

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-processing-e2e-derive-fa77d0d6

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-processing-e2e-derive-fa77d0d6: Operation cannot be fulfilled on endpoints "payload-processing-e2e-derive-fa77d0d6": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-processing-e2e-derive-fa77d0d6, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 4f9e9452-6abd-4465-847c-7c5bb7b19f80, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-fa77d0d6-549d6cd49d-xrc9h

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-fa77d0d6-openshift-default-749c9d66cb-bdr8g

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-derive-fa77d0d6-openshift-default-749c9d66cb-bdr8g

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-derive-fa77d0d6-openshift-default-749c9d66cb-bdr8g

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-4b633d-5b696bd5f7-nvjnq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-4b633d-86ddb8f76b-bvk84

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w3-4b633d-openshift-default-fcd56d6f4-fxn48

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-4b633d-openshift-default-fcd56d6f4-fxn48

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w3-4b633d-openshift-default-fcd56d6f4-fxn48

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-autores-d0d77c-openshift-default-5b67d98676-5p2nr

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-explicit-46f024-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-46f024-openshift-default-b6bd79d7b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-explicit-46f024

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-46f024

openshift-ingress

replicaset-controller

e2e-explicit-46f024-openshift-default-b6bd79d7b

SuccessfulCreate

Created pod: e2e-explicit-46f024-openshift-default-b6bd79d7b-h82dm

openshift-ingress

multus

e2e-explicit-46f024-openshift-default-b6bd79d7b-h82dm

AddedInterface

Add eth0 [10.133.0.65/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-46f024

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-46f024-c7c9dbc54 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-46f024-55998f9b57

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-46f024-55998f9b57-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-46f024: serviceaccount "payload-processing-e2e-explicit-46f024" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-46f024-55998f9b57

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-46f024-55998f9b57-shlcb

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-46f024

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-46f024-55998f9b57 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-46f024-c7c9dbc54

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-46f024-c7c9dbc54-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-46f024: serviceaccount "payload-processing-e2e-explicit-46f024" not found

openshift-ingress

kubelet

payload-processing-e2e-explicit-46f024-55998f9b57-shlcb

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-46f024-c7c9dbc54

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-46f024-c7c9dbc54-kwk2v

openshift-ingress

multus

payload-pre-processing-e2e-explicit-46f024-c7c9dbc54-kwk2v

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-explicit-46f024-55998f9b57-shlcb

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-46f024-55998f9b57-shlcb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-explicit-46f024-55998f9b57-shlcb

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-46f024-c7c9dbc54-kwk2v

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-46f024-c7c9dbc54-kwk2v

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-46f024-c7c9dbc54-kwk2v

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-explicit-46f024-openshift-default-b6bd79d7b-h82dm

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-46f024-openshift-default-b6bd79d7b-h82dm

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-46f024-openshift-default-b6bd79d7b-h82dm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-explicit-46f024-openshift-default-b6bd79d7b-h82dm

ProbeError

Startup probe error: Get "http://10.133.0.65:15021/healthz/ready": dial tcp 10.133.0.65:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-explicit-46f024-openshift-default-b6bd79d7b-h82dm

Unhealthy

Startup probe failed: Get "http://10.133.0.65:15021/healthz/ready": dial tcp 10.133.0.65:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-explicit-46f024-55998f9b57-shlcb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-46f024-c7c9dbc54-kwk2v

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-mt-aba3750c-openshift-default-7ffb5f9756

SuccessfulCreate

Created pod: e2e-mt-aba3750c-openshift-default-7ffb5f9756-2w5df

openshift-ingress

gateway_labeler_controller

e2e-mt-aba3750c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-aba3750c

openshift-ingress

deployment-controller

e2e-mt-aba3750c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-aba3750c-openshift-default-7ffb5f9756 from 0 to 1

openshift-ingress

multus

e2e-mt-aba3750c-openshift-default-7ffb5f9756-2w5df

AddedInterface

Add eth0 [10.133.0.68/23] from ovn-kubernetes

openshift-ingress

GatewayAuthBootstrap

e2e-noten-a733e2

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-noten-a733e2-authn-ssl: envoyfilters.networking.istio.io "e2e-noten-a733e2-authn-ssl" already exists

openshift-ingress

gateway_labeler_controller

e2e-noten-a733e2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-a733e2

openshift-ingress

kubelet

e2e-explicit-46f024-openshift-default-b6bd79d7b-h82dm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-noten-a733e2-openshift-default-66b6684854-xdvs6

Started

Started container istio-proxy

openshift-ingress

deployment-controller

e2e-noten-a733e2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-a733e2-openshift-default-66b6684854 from 0 to 1

openshift-ingress

kubelet

e2e-noten-a733e2-openshift-default-66b6684854-xdvs6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

replicaset-controller

e2e-noten-a733e2-openshift-default-66b6684854

SuccessfulCreate

Created pod: e2e-noten-a733e2-openshift-default-66b6684854-xdvs6

openshift-ingress

kubelet

e2e-noten-a733e2-openshift-default-66b6684854-xdvs6

Created

Created container: istio-proxy

openshift-ingress

multus

e2e-noten-a733e2-openshift-default-66b6684854-xdvs6

AddedInterface

Add eth0 [10.133.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-a733e2-openshift-default-66b6684854-xdvs6

ProbeError

Startup probe error: Get "http://10.133.0.69:15021/healthz/ready": dial tcp 10.133.0.69:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-noten-a733e2-openshift-default-66b6684854-xdvs6

Unhealthy

Startup probe failed: Get "http://10.133.0.69:15021/healthz/ready": dial tcp 10.133.0.69:15021: connect: connection refused

openshift-ingress

kubelet

e2e-explicit-46f024-openshift-default-b6bd79d7b-h82dm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-explicit-46f024-openshift-default-b6bd79d7b-h82dm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-mt-aba3750c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-aba3750c-7cb845fbb5 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-aba3750c-7cb845fbb5

FailedCreate

Error creating: pods "payload-processing-e2e-mt-aba3750c-7cb845fbb5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-aba3750c: serviceaccount "payload-processing-e2e-mt-aba3750c" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-aba3750c-55f999b9fd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-aba3750c-55f999b9fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-aba3750c: serviceaccount "payload-processing-e2e-mt-aba3750c" not found

openshift-ingress

kubelet

payload-processing-e2e-mt-aba3750c-7cb845fbb5-dbjgd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-aba3750c-55f999b9fd-l47xt

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-mt-aba3750c-7cb845fbb5-dbjgd

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-aba3750c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-aba3750c-55f999b9fd from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-mt-aba3750c-55f999b9fd-l47xt

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-aba3750c-7cb845fbb5

SuccessfulCreate

Created pod: payload-processing-e2e-mt-aba3750c-7cb845fbb5-dbjgd

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-aba3750c-55f999b9fd-l47xt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-aba3750c-55f999b9fd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-aba3750c-55f999b9fd-l47xt

openshift-ingress

kubelet

payload-processing-e2e-mt-aba3750c-7cb845fbb5-dbjgd

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-aba3750c-7cb845fbb5-dbjgd

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-aba3750c-55f999b9fd-l47xt

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-aba3750c-openshift-default-7ffb5f9756-2w5df

ProbeError

Readiness probe error: Get "http://10.133.0.68:15021/healthz/ready": read tcp 10.133.0.2:55138->10.133.0.68:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-mt-aba3750c-openshift-default-7ffb5f9756-2w5df

Unhealthy

Readiness probe failed: Get "http://10.133.0.68:15021/healthz/ready": read tcp 10.133.0.2:55138->10.133.0.68:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-mt-aba3750c-openshift-default-7ffb5f9756-2w5df

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-aba3750c-openshift-default-7ffb5f9756-2w5df

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-aba3750c-openshift-default-7ffb5f9756-2w5df

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-aba3750c-openshift-default-7ffb5f9756-2w5df

Unhealthy

Startup probe failed: Get "http://10.133.0.68:15021/healthz/ready": dial tcp 10.133.0.68:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-aba3750c-openshift-default-7ffb5f9756-2w5df

ProbeError

Startup probe error: Get "http://10.133.0.68:15021/healthz/ready": dial tcp 10.133.0.68:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-noten-a733e2-openshift-default-66b6684854-xdvs6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-noten-a733e2-openshift-default-66b6684854-xdvs6

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-noten-a733e2-openshift-default-66b6684854-xdvs6

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-mt-aba3750c-7cb845fbb5-dbjgd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-aba3750c-55f999b9fd-l47xt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-aba3750c-openshift-default-7ffb5f9756-2w5df

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-3a8052-6f755cc7c8-ll6nd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-3a8052-5cc57f4755-vdxww

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-a-3a8052-openshift-default-744fc9b4f6-kgknk

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-5319c6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-5319c6

openshift-ingress

replicaset-controller

e2e-shared-a-w2-5319c6-openshift-default-59bffb687b

SuccessfulCreate

Created pod: e2e-shared-a-w2-5319c6-openshift-default-59bffb687b-8m84x

openshift-ingress

deployment-controller

e2e-shared-a-w2-5319c6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-5319c6-openshift-default-59bffb687b from 0 to 1

openshift-ingress

multus

e2e-shared-a-w2-5319c6-openshift-default-59bffb687b-8m84x

AddedInterface

Add eth0 [10.133.0.73/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-5319c6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-5319c6-6c4b795659 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-5319c6-7d59bcf4fd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-5319c6-7d59bcf4fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-5319c6: serviceaccount "payload-processing-e2e-shared-a-w2-5319c6" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-5319c6-6c4b795659

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-5319c6-6c4b795659-2bl2d
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-5319c6-6c4b795659

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-5319c6-6c4b795659-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-5319c6: serviceaccount "payload-processing-e2e-shared-a-w2-5319c6" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-5319c6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-5319c6-7d59bcf4fd from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-5319c6-7d59bcf4fd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-5319c6-7d59bcf4fd-j2cnm

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-5319c6-6c4b795659-2bl2d

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-b-c34fad-7c9ff8f98f-2b29s

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-5319c6-7d59bcf4fd-j2cnm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-5319c6-7d59bcf4fd-j2cnm

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-5319c6-7d59bcf4fd-j2cnm

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-c34fad-b4565dc4b-qzggp

Killing

Stopping container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-5319c6-7d59bcf4fd-j2cnm

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-5319c6-6c4b795659-2bl2d

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-5319c6-6c4b795659-2bl2d

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-5319c6-6c4b795659-2bl2d

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-inf-b-c34fad-openshift-default-6b5889c74b-vpxnm

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w4-40a1a5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w4-40a1a5

openshift-ingress

replicaset-controller

e2e-shared-a-w4-40a1a5-openshift-default-64769dfc98

SuccessfulCreate

Created pod: e2e-shared-a-w4-40a1a5-openshift-default-64769dfc98-h89b9

openshift-ingress

kubelet

e2e-inf-b-c34fad-openshift-default-6b5889c74b-vpxnm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

e2e-shared-a-w4-40a1a5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w4-40a1a5-openshift-default-64769dfc98 from 0 to 1

openshift-ingress

kubelet

e2e-inf-b-c34fad-openshift-default-6b5889c74b-vpxnm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

multus

e2e-shared-a-w4-40a1a5-openshift-default-64769dfc98-h89b9

AddedInterface

Add eth0 [10.133.0.74/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-c5206e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-c5206e

openshift-ingress

GatewayAuthBootstrap

e2e-shared-b-w2-c5206e

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-shared-b-w2-c5206e-authn-ssl: envoyfilters.networking.istio.io "e2e-shared-b-w2-c5206e-authn-ssl" already exists

openshift-ingress

replicaset-controller

e2e-shared-b-w2-c5206e-openshift-default-7864cb5c8b

SuccessfulCreate

Created pod: e2e-shared-b-w2-c5206e-openshift-default-7864cb5c8b-xkx5g

openshift-ingress

deployment-controller

e2e-shared-b-w2-c5206e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-c5206e-openshift-default-7864cb5c8b from 0 to 1

openshift-ingress

multus

e2e-shared-b-w2-c5206e-openshift-default-7864cb5c8b-xkx5g

AddedInterface

Add eth0 [10.133.0.75/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-5319c6-openshift-default-59bffb687b-8m84x

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-5319c6-openshift-default-59bffb687b-8m84x

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-5319c6-openshift-default-59bffb687b-8m84x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-c5206e-5bc4ddbd58

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-c5206e-5bc4ddbd58-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-c5206e: serviceaccount "payload-processing-e2e-shared-b-w2-c5206e" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-c5206e-5bc4ddbd58

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-c5206e-5bc4ddbd58-6f82t

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-c5206e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-c5206e-5bc4ddbd58 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-c5206e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-c5206e-7c9b5b484f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-c5206e-7c9b5b484f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-c5206e-7c9b5b484f-f2xn4
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-c5206e-7c9b5b484f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-c5206e-7c9b5b484f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-c5206e: serviceaccount "payload-processing-e2e-shared-b-w2-c5206e" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-c5206e-5bc4ddbd58-6f82t

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w4-40a1a5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w4-40a1a5-5675bc9fbf from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w4-40a1a5-5675bc9fbf

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w4-40a1a5-5675bc9fbf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w4-40a1a5: serviceaccount "payload-processing-e2e-shared-a-w4-40a1a5" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w4-40a1a5-7dd4f759c8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w4-40a1a5-7dd4f759c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w4-40a1a5: serviceaccount "payload-processing-e2e-shared-a-w4-40a1a5" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w4-40a1a5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w4-40a1a5-7dd4f759c8 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-c5206e-5bc4ddbd58-6f82t

AddedInterface

Add eth0 [10.132.0.61/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-c5206e-7c9b5b484f-f2xn4

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-c5206e-7c9b5b484f-f2xn4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-c5206e-7c9b5b484f-f2xn4

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-c5206e-7c9b5b484f-f2xn4

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-c5206e-5bc4ddbd58-6f82t

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-c5206e-5bc4ddbd58-6f82t

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-40a1a5-5675bc9fbf-7jjsc

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-w4-40a1a5-5675bc9fbf-7jjsc

AddedInterface

Add eth0 [10.132.0.64/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w4-40a1a5-7dd4f759c8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w4-40a1a5-7dd4f759c8-7c7tn

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w4-40a1a5-5675bc9fbf

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w4-40a1a5-5675bc9fbf-7jjsc

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-40a1a5-5675bc9fbf-7jjsc

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-40a1a5-7dd4f759c8-7c7tn

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-40a1a5-5675bc9fbf-7jjsc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-40a1a5-7dd4f759c8-7c7tn

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w4-40a1a5-7dd4f759c8-7c7tn

AddedInterface

Add eth0 [10.132.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-40a1a5-7dd4f759c8-7c7tn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-5319c6-openshift-default-59bffb687b-8m84x

Unhealthy

Startup probe failed: Get "http://10.133.0.73:15021/healthz/ready": dial tcp 10.133.0.73:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-5319c6-openshift-default-59bffb687b-8m84x

ProbeError

Startup probe error: Get "http://10.133.0.73:15021/healthz/ready": dial tcp 10.133.0.73:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w4-40a1a5-openshift-default-64769dfc98-h89b9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-c5206e-openshift-default-7864cb5c8b-xkx5g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w4-40a1a5-openshift-default-64769dfc98-h89b9

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-c5206e-openshift-default-7864cb5c8b-xkx5g

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-c5206e-openshift-default-7864cb5c8b-xkx5g

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w4-40a1a5-openshift-default-64769dfc98-h89b9

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-shared-a-w4-40a1a5-openshift-default-64769dfc98-h89b9

Unhealthy

Startup probe failed: Get "http://10.133.0.74:15021/healthz/ready": dial tcp 10.133.0.74:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w4-40a1a5-openshift-default-64769dfc98-h89b9

ProbeError

Startup probe error: Get "http://10.133.0.74:15021/healthz/ready": dial tcp 10.133.0.74:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-shared-b-w2-c5206e-openshift-default-7864cb5c8b-xkx5g

ProbeError

Startup probe error: Get "http://10.133.0.75:15021/healthz/ready": dial tcp 10.133.0.75:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-shared-b-w2-c5206e-openshift-default-7864cb5c8b-xkx5g

Unhealthy

Startup probe failed: Get "http://10.133.0.75:15021/healthz/ready": dial tcp 10.133.0.75:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w4-81f19d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w4-81f19d

openshift-ingress

replicaset-controller

e2e-shared-b-w4-81f19d-openshift-default-5557d4f646

SuccessfulCreate

Created pod: e2e-shared-b-w4-81f19d-openshift-default-5557d4f646-hqkcq

openshift-ingress

deployment-controller

e2e-shared-b-w4-81f19d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w4-81f19d-openshift-default-5557d4f646 from 0 to 1

openshift-ingress

multus

e2e-shared-b-w4-81f19d-openshift-default-5557d4f646-hqkcq

AddedInterface

Add eth0 [10.133.0.78/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-mt-7d49a30d-openshift-default-644f67b664

SuccessfulCreate

Created pod: e2e-mt-7d49a30d-openshift-default-644f67b664-7f6c4

openshift-ingress

multus

e2e-mt-7d49a30d-openshift-default-644f67b664-7f6c4

AddedInterface

Add eth0 [10.133.0.81/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-mt-7d49a30d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-7d49a30d

openshift-ingress

deployment-controller

e2e-mt-7d49a30d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-7d49a30d-openshift-default-644f67b664 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w4-81f19d-654546cbd6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w4-81f19d-654546cbd6-lh8sz
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w4-81f19d-669f594fb5

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w4-81f19d-669f594fb5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w4-81f19d: serviceaccount "payload-processing-e2e-shared-b-w4-81f19d" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w4-81f19d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w4-81f19d-654546cbd6 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w4-81f19d-654546cbd6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w4-81f19d-654546cbd6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w4-81f19d: serviceaccount "payload-processing-e2e-shared-b-w4-81f19d" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w4-81f19d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w4-81f19d-669f594fb5 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w4-81f19d-654546cbd6-lh8sz

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-81f19d-654546cbd6-lh8sz

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-81f19d-654546cbd6-lh8sz

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-81f19d-669f594fb5-djwkg

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-81f19d-669f594fb5-djwkg

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-81f19d-654546cbd6-lh8sz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-81f19d-669f594fb5-djwkg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w4-81f19d-669f594fb5

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w4-81f19d-669f594fb5-djwkg

openshift-ingress

multus

payload-processing-e2e-shared-b-w4-81f19d-669f594fb5-djwkg

AddedInterface

Add eth0 [10.132.0.65/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-mt-7d49a30d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-7d49a30d-db75dd9fc from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-7d49a30d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-7d49a30d-666789878 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-mt-7d49a30d-db75dd9fc-6z26j

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-7d49a30d-db75dd9fc

FailedCreate

Error creating: pods "payload-processing-e2e-mt-7d49a30d-db75dd9fc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-7d49a30d: serviceaccount "payload-processing-e2e-mt-7d49a30d" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-7d49a30d-666789878

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-7d49a30d-666789878-rfx57
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-7d49a30d-666789878

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-7d49a30d-666789878-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-7d49a30d: serviceaccount "payload-processing-e2e-mt-7d49a30d" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-7d49a30d-666789878-rfx57

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-7d49a30d-666789878-rfx57

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-7d49a30d-666789878-rfx57

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-7d49a30d-db75dd9fc-6z26j

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-7d49a30d-db75dd9fc-6z26j

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-7d49a30d-666789878-rfx57

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-7d49a30d-db75dd9fc-6z26j

AddedInterface

Add eth0 [10.132.0.66/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-7d49a30d-db75dd9fc

SuccessfulCreate

Created pod: payload-processing-e2e-mt-7d49a30d-db75dd9fc-6z26j
(x2)

openshift-ingress

kubelet

e2e-mt-7d49a30d-openshift-default-644f67b664-7f6c4

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-81f19d-openshift-default-5557d4f646-hqkcq

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w4-81f19d-openshift-default-5557d4f646-hqkcq

Unhealthy

Readiness probe failed: Get "http://10.133.0.78:15021/healthz/ready": read tcp 10.133.0.2:54726->10.133.0.78:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-shared-b-w4-81f19d-openshift-default-5557d4f646-hqkcq

ProbeError

Readiness probe error: Get "http://10.133.0.78:15021/healthz/ready": read tcp 10.133.0.2:54726->10.133.0.78:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-mt-7d49a30d-openshift-default-644f67b664-7f6c4

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-7d49a30d-openshift-default-644f67b664-7f6c4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-81f19d-openshift-default-5557d4f646-hqkcq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-81f19d-openshift-default-5557d4f646-hqkcq

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-mt-7d49a30d-openshift-default-644f67b664-7f6c4

ProbeError

Startup probe error: Get "http://10.133.0.81:15021/healthz/ready": dial tcp 10.133.0.81:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w4-81f19d-openshift-default-5557d4f646-hqkcq

ProbeError

Startup probe error: Get "http://10.133.0.78:15021/healthz/ready": dial tcp 10.133.0.78:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w4-81f19d-openshift-default-5557d4f646-hqkcq

Unhealthy

Startup probe failed: Get "http://10.133.0.78:15021/healthz/ready": dial tcp 10.133.0.78:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-mt-7d49a30d-openshift-default-644f67b664-7f6c4

Unhealthy

Startup probe failed: Get "http://10.133.0.81:15021/healthz/ready": dial tcp 10.133.0.81:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-7d49a30d-666789878-rfx57

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-7d49a30d-db75dd9fc-6z26j

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-5284dc-97575bc5-jl756

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-worker-w0-5284dc

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-worker-w0-5284dc: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-worker-w0-5284dc": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-worker-w0-5284dc, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 48cd3c7e-6ae3-4ffb-8b24-f9fe87b493cc, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-5284dc-5858845794-wblgm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w0-5284dc-openshift-default-6797c7d96-ljkmr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-7d49a30d-openshift-default-644f67b664-7f6c4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-5284dc-openshift-default-6797c7d96-ljkmr

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w0-5284dc-openshift-default-6797c7d96-ljkmr

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

e2e-api-a-69f1ba-openshift-default-569c8d9dd6

SuccessfulCreate

Created pod: e2e-api-a-69f1ba-openshift-default-569c8d9dd6-wn99g

openshift-ingress

deployment-controller

e2e-api-a-69f1ba-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-69f1ba-openshift-default-569c8d9dd6 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-69f1ba

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-69f1ba

openshift-ingress

multus

e2e-api-a-69f1ba-openshift-default-569c8d9dd6-wn99g

AddedInterface

Add eth0 [10.133.0.86/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-69f1ba-7b76fd84d5

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-69f1ba-7b76fd84d5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-69f1ba: serviceaccount "payload-processing-e2e-api-a-69f1ba" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-69f1ba

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-69f1ba-59b5d6fbb6 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-69f1ba-59b5d6fbb6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-69f1ba-59b5d6fbb6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-69f1ba: serviceaccount "payload-processing-e2e-api-a-69f1ba" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-69f1ba-59b5d6fbb6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-69f1ba-59b5d6fbb6-xbdpd

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-69f1ba

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-69f1ba-7b76fd84d5 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-a-69f1ba-7b76fd84d5-n6mjz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-a-69f1ba-7b76fd84d5-n6mjz

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-69f1ba-59b5d6fbb6-xbdpd

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-api-a-69f1ba-7b76fd84d5-n6mjz

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-69f1ba-7b76fd84d5-n6mjz

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-69f1ba-7b76fd84d5

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-69f1ba-7b76fd84d5-n6mjz

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-69f1ba-59b5d6fbb6-xbdpd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-a-69f1ba-59b5d6fbb6-xbdpd

AddedInterface

Add eth0 [10.132.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-69f1ba-59b5d6fbb6-xbdpd

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-api-a-69f1ba-openshift-default-569c8d9dd6-wn99g

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-69f1ba-openshift-default-569c8d9dd6-wn99g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-69f1ba-openshift-default-569c8d9dd6-wn99g

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-a-69f1ba-openshift-default-569c8d9dd6-wn99g

ProbeError

Startup probe error: Get "http://10.133.0.86:15021/healthz/ready": dial tcp 10.133.0.86:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-a-69f1ba-openshift-default-569c8d9dd6-wn99g

Unhealthy

Startup probe failed: Get "http://10.133.0.86:15021/healthz/ready": dial tcp 10.133.0.86:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-api-b-4cd712-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-4cd712-openshift-default-85df66dcb4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-4cd712-openshift-default-85df66dcb4

SuccessfulCreate

Created pod: e2e-api-b-4cd712-openshift-default-85df66dcb4-p8526

openshift-ingress

gateway_labeler_controller

e2e-api-b-4cd712

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-4cd712

openshift-ingress

multus

e2e-api-b-4cd712-openshift-default-85df66dcb4-p8526

AddedInterface

Add eth0 [10.133.0.87/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-4cd712-6bf66cbb55

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-4cd712-6bf66cbb55-jv6s9

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-4cd712

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-4cd712-6bf66cbb55 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-4cd712

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-4cd712-74cbd79c74 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-4cd712-6bf66cbb55

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-4cd712-6bf66cbb55-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-4cd712: serviceaccount "payload-processing-e2e-api-b-4cd712" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-4cd712-74cbd79c74

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-4cd712-74cbd79c74-k6ggt
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-4cd712-74cbd79c74

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-4cd712-74cbd79c74-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-4cd712: serviceaccount "payload-processing-e2e-api-b-4cd712" not found

openshift-ingress

multus

payload-processing-e2e-api-b-4cd712-6bf66cbb55-jv6s9

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-api-b-4cd712-74cbd79c74-k6ggt

AddedInterface

Add eth0 [10.132.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-4cd712-74cbd79c74-k6ggt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-4cd712-74cbd79c74-k6ggt

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-4cd712-74cbd79c74-k6ggt

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-4cd712-6bf66cbb55-jv6s9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-b-4cd712-6bf66cbb55-jv6s9

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-4cd712-6bf66cbb55-jv6s9

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-api-b-4cd712-openshift-default-85df66dcb4-p8526

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-4cd712-openshift-default-85df66dcb4-p8526

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-4cd712-openshift-default-85df66dcb4-p8526

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-api-b-4cd712-openshift-default-85df66dcb4-p8526

Unhealthy

Startup probe failed: Get "http://10.133.0.87:15021/healthz/ready": dial tcp 10.133.0.87:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-b-4cd712-openshift-default-85df66dcb4-p8526

ProbeError

Startup probe error: Get "http://10.133.0.87:15021/healthz/ready": dial tcp 10.133.0.87:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-69f1ba-59b5d6fbb6-xbdpd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-69f1ba-7b76fd84d5-n6mjz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-a-69f1ba-openshift-default-569c8d9dd6-wn99g

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-api-b-4cd712-6bf66cbb55-jv6s9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-4cd712-74cbd79c74-k6ggt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-4cd712-openshift-default-85df66dcb4-p8526

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-5319c6-6c4b795659-2bl2d

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-a-w2-5319c6

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-a-w2-5319c6: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-a-w2-5319c6": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-a-w2-5319c6, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 655a53d0-699c-463e-8c13-3c8dec88d9b6, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-5319c6-7d59bcf4fd-j2cnm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w2-5319c6-openshift-default-59bffb687b-8m84x

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-5319c6-openshift-default-59bffb687b-8m84x

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w2-5319c6-openshift-default-59bffb687b-8m84x

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-c5206e-7c9b5b484f-f2xn4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-c5206e-5bc4ddbd58-6f82t

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w2-c5206e-openshift-default-7864cb5c8b-xkx5g

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-de7ea3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-de7ea3

openshift-ingress

replicaset-controller

e2e-ipp-a-de7ea3-openshift-default-6c5cf9d56

SuccessfulCreate

Created pod: e2e-ipp-a-de7ea3-openshift-default-6c5cf9d56-vbwbd

openshift-ingress

deployment-controller

e2e-ipp-a-de7ea3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-de7ea3-openshift-default-6c5cf9d56 from 0 to 1

openshift-ingress

multus

e2e-ipp-a-de7ea3-openshift-default-6c5cf9d56-vbwbd

AddedInterface

Add eth0 [10.133.0.97/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-de7ea3-fcbdf454c

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-de7ea3-fcbdf454c-lncdr

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-de7ea3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-de7ea3-fcbdf454c from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-de7ea3-fcbdf454c

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-de7ea3-fcbdf454c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-de7ea3: serviceaccount "payload-processing-e2e-ipp-a-de7ea3" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-de7ea3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-de7ea3-7b9c9945bb from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-de7ea3-7b9c9945bb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-de7ea3-7b9c9945bb-8v2jb
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-de7ea3-7b9c9945bb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-de7ea3-7b9c9945bb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-de7ea3: serviceaccount "payload-processing-e2e-ipp-a-de7ea3" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-de7ea3-fcbdf454c-lncdr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-de7ea3-7b9c9945bb-8v2jb

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-de7ea3-7b9c9945bb-8v2jb

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-de7ea3-7b9c9945bb-8v2jb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-de7ea3-7b9c9945bb-8v2jb

AddedInterface

Add eth0 [10.134.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-de7ea3-fcbdf454c-lncdr

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-ipp-a-de7ea3-fcbdf454c-lncdr

AddedInterface

Add eth0 [10.132.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-de7ea3-fcbdf454c-lncdr

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-ipp-a-de7ea3-openshift-default-6c5cf9d56-vbwbd

ProbeError

Readiness probe error: Get "http://10.133.0.97:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-a-de7ea3-openshift-default-6c5cf9d56-vbwbd

Unhealthy

Readiness probe failed: Get "http://10.133.0.97:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ipp-a-de7ea3-openshift-default-6c5cf9d56-vbwbd

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-de7ea3-openshift-default-6c5cf9d56-vbwbd

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-de7ea3-openshift-default-6c5cf9d56-vbwbd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-a-de7ea3-openshift-default-6c5cf9d56-vbwbd

ProbeError

Startup probe error: Get "http://10.133.0.97:15021/healthz/ready": dial tcp 10.133.0.97:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-de7ea3-openshift-default-6c5cf9d56-vbwbd

Unhealthy

Startup probe failed: Get "http://10.133.0.97:15021/healthz/ready": dial tcp 10.133.0.97:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-ipp-b-a1a0a2-openshift-default-5746f6c86d

SuccessfulCreate

Created pod: e2e-ipp-b-a1a0a2-openshift-default-5746f6c86d-n7dzt

openshift-ingress

deployment-controller

e2e-ipp-b-a1a0a2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-a1a0a2-openshift-default-5746f6c86d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-a1a0a2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-a1a0a2

openshift-ingress

multus

e2e-ipp-b-a1a0a2-openshift-default-5746f6c86d-n7dzt

AddedInterface

Add eth0 [10.133.0.98/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-a1a0a2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-a1a0a2-6d8cdc97fd from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-a1a0a2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-a1a0a2-797c5469b7 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-a1a0a2-797c5469b7

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-a1a0a2-797c5469b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-a1a0a2: serviceaccount "payload-processing-e2e-ipp-b-a1a0a2" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-a1a0a2-6d8cdc97fd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-a1a0a2-6d8cdc97fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-a1a0a2: serviceaccount "payload-processing-e2e-ipp-b-a1a0a2" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a1a0a2-6d8cdc97fd-jbb8m

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-b-a1a0a2-797c5469b7-j94zc

AddedInterface

Add eth0 [10.134.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a1a0a2-797c5469b7-j94zc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a1a0a2-797c5469b7-j94zc

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a1a0a2-797c5469b7-j94zc

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-a1a0a2-797c5469b7

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-a1a0a2-797c5469b7-j94zc

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-a1a0a2-6d8cdc97fd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-a1a0a2-6d8cdc97fd-jbb8m

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a1a0a2-6d8cdc97fd-jbb8m

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a1a0a2-6d8cdc97fd-jbb8m

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-a1a0a2-6d8cdc97fd-jbb8m

AddedInterface

Add eth0 [10.132.0.74/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-b-a1a0a2-openshift-default-5746f6c86d-n7dzt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-a1a0a2-openshift-default-5746f6c86d-n7dzt

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-a1a0a2-openshift-default-5746f6c86d-n7dzt

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-ipp-b-a1a0a2-openshift-default-5746f6c86d-n7dzt

ProbeError

Startup probe error: Get "http://10.133.0.98:15021/healthz/ready": dial tcp 10.133.0.98:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-b-a1a0a2-openshift-default-5746f6c86d-n7dzt

Unhealthy

Startup probe failed: Get "http://10.133.0.98:15021/healthz/ready": dial tcp 10.133.0.98:15021: connect: connection refused

openshift-ingress

multus

e2e-ipp-cleanup-876382-openshift-default-854df5b556-x2phg

AddedInterface

Add eth0 [10.133.0.100/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-876382

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-876382

openshift-ingress

deployment-controller

e2e-ipp-cleanup-876382-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-876382-openshift-default-854df5b556 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-876382-openshift-default-854df5b556

SuccessfulCreate

Created pod: e2e-ipp-cleanup-876382-openshift-default-854df5b556-x2phg

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-876382

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-876382-7797846bd7 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-876382-7797846bd7

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-876382-7797846bd7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-876382: serviceaccount "payload-processing-e2e-ipp-cleanup-876382" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-876382-7d8fc7cc66

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-876382-7d8fc7cc66-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-876382: serviceaccount "payload-processing-e2e-ipp-cleanup-876382" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-876382-7d8fc7cc66

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-876382-7d8fc7cc66-6cnj9

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-876382

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-876382-7d8fc7cc66 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-876382-7797846bd7

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-876382-7797846bd7-h7hgx

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-876382-7797846bd7-h7hgx

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-876382-7797846bd7-h7hgx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-876382-7d8fc7cc66-6cnj9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-876382-7797846bd7-h7hgx

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-876382-7797846bd7-h7hgx

AddedInterface

Add eth0 [10.132.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-876382-7d8fc7cc66-6cnj9

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-876382-7d8fc7cc66-6cnj9

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-876382-7d8fc7cc66-6cnj9

AddedInterface

Add eth0 [10.134.0.74/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-876382-openshift-default-854df5b556-x2phg

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-876382-openshift-default-854df5b556-x2phg

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-876382-openshift-default-854df5b556-x2phg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-ipp-cleanup-876382-openshift-default-854df5b556-x2phg

Unhealthy

Startup probe failed: Get "http://10.133.0.100:15021/healthz/ready": dial tcp 10.133.0.100:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-cleanup-876382-openshift-default-854df5b556-x2phg

ProbeError

Startup probe error: Get "http://10.133.0.100:15021/healthz/ready": dial tcp 10.133.0.100:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-876382-7797846bd7-h7hgx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-876382-7d8fc7cc66-6cnj9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-876382-openshift-default-854df5b556-x2phg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-de7ea3-7b9c9945bb-8v2jb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-de7ea3-fcbdf454c-lncdr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-de7ea3-openshift-default-6c5cf9d56-vbwbd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-de7ea3-openshift-default-6c5cf9d56-vbwbd

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-a-de7ea3-openshift-default-6c5cf9d56-vbwbd

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a1a0a2-6d8cdc97fd-jbb8m

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a1a0a2-797c5469b7-j94zc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-a1a0a2-openshift-default-5746f6c86d-n7dzt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-40a1a5-7dd4f759c8-7c7tn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-40a1a5-5675bc9fbf-7jjsc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w4-40a1a5-openshift-default-64769dfc98-h89b9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w4-40a1a5-openshift-default-64769dfc98-h89b9

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w4-40a1a5-openshift-default-64769dfc98-h89b9

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-81f19d-669f594fb5-djwkg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-81f19d-654546cbd6-lh8sz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w4-81f19d-openshift-default-5557d4f646-hqkcq

Killing

Stopping container istio-proxy