Time Namespace Component RelatedObject Reason Message

openshift-ingress

e2e-autores-b275d0-openshift-default-f5cf4fffd-86gzv

Scheduled

Successfully assigned openshift-ingress/e2e-autores-b275d0-openshift-default-f5cf4fffd-86gzv to ip-10-0-136-89.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-d5e418-58c6d6bcdf-w84gj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-d5e418-58c6d6bcdf-w84gj to ip-10-0-142-201.ec2.internal

openshift-ingress

e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2

Scheduled

Successfully assigned openshift-ingress/e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2 to ip-10-0-142-201.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-cc14fe-5957f6f569-vtdsl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-cc14fe-5957f6f569-vtdsl to ip-10-0-142-201.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-p7qjr

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-p7qjr to ip-10-0-136-89.ec2.internal

openshift-ingress

e2e-noten-d6e5fb-openshift-default-9d978b84d-5kk9t

Scheduled

Successfully assigned openshift-ingress/e2e-noten-d6e5fb-openshift-default-9d978b84d-5kk9t to ip-10-0-136-89.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-a521b5-9dcdbb9d7-x2f6n

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-a521b5-9dcdbb9d7-x2f6n to ip-10-0-137-53.ec2.internal

openshift-ingress

e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh to ip-10-0-142-201.ec2.internal

openshift-ingress

e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4

Scheduled

Successfully assigned openshift-ingress/e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4 to ip-10-0-142-201.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-0777c1-75869b6f54-t2s9l

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-0777c1-75869b6f54-t2s9l to ip-10-0-137-53.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-04195c-5d85fcdd86-dlzdz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-04195c-5d85fcdd86-dlzdz to ip-10-0-137-53.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-cc14fe-569449c9c8-czgth

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-cc14fe-569449c9c8-czgth to ip-10-0-142-201.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-bcc15f82-6cc5796574-rwvpr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-bcc15f82-6cc5796574-rwvpr to ip-10-0-142-201.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-b275d0-8dd84d5db-6tsg4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-b275d0-8dd84d5db-6tsg4 to ip-10-0-137-53.ec2.internal

openshift-ingress

kube-auth-proxy-848c99f856-pl4cb

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-848c99f856-pl4cb to ip-10-0-142-201.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-a521b5-66c8dcf694-bmwjc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-a521b5-66c8dcf694-bmwjc to ip-10-0-142-201.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-d5e418-85cfbd5f8-48mvs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d5e418-85cfbd5f8-48mvs to ip-10-0-137-53.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-73290f4b-784cbdc4c4-x8dzc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-73290f4b-784cbdc4c4-x8dzc to ip-10-0-142-201.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-f8e582-5978df4bb6-458l9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-f8e582-5978df4bb6-458l9 to ip-10-0-142-201.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-e6e0b4a3-6669d65c98-l8xz9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-e6e0b4a3-6669d65c98-l8xz9 to ip-10-0-137-53.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-29e74e-85664db6-xhbmm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-29e74e-85664db6-xhbmm to ip-10-0-137-53.ec2.internal

openshift-ingress

e2e-ait-6706857a-openshift-default-7b98fbbdf6-fxm98

Scheduled

Successfully assigned openshift-ingress/e2e-ait-6706857a-openshift-default-7b98fbbdf6-fxm98 to ip-10-0-136-89.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-6706857a-6cd6dbdc54-rn5g5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-6706857a-6cd6dbdc54-rn5g5 to ip-10-0-137-53.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-1d16dc05-566f77cf98-x8hpc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-1d16dc05-566f77cf98-x8hpc to ip-10-0-137-53.ec2.internal

openshift-ingress

payload-processing-e2e-autores-b275d0-dcbf759d5-t6zjc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-b275d0-dcbf759d5-t6zjc to ip-10-0-142-201.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-f8e582-58b77c449c-thb87

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-f8e582-58b77c449c-thb87 to ip-10-0-137-53.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-29e74e-6fb8fc5c5-bk6nv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-29e74e-6fb8fc5c5-bk6nv to ip-10-0-137-53.ec2.internal

openshift-ingress

e2e-shared-a-w3-fdbc00-openshift-default-86965b886b-s92bk

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-fdbc00-openshift-default-86965b886b-s92bk to ip-10-0-136-89.ec2.internal

openshift-ingress

e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b to ip-10-0-142-201.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-0777c1-6c5445689c-wqd5f

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-0777c1-6c5445689c-wqd5f to ip-10-0-137-53.ec2.internal

openshift-ingress

payload-processing-e2e-ait-6706857a-798454d459-tm86r

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-6706857a-798454d459-tm86r to ip-10-0-137-53.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-xkx49

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-xkx49 to ip-10-0-137-53.ec2.internal

openshift-ingress

payload-processing-e2e-ait-1d16dc05-74c7bffb8c-nj85f

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-1d16dc05-74c7bffb8c-nj85f to ip-10-0-142-201.ec2.internal

openshift-ingress

e2e-shared-b-w2-22b014-openshift-default-6cbf9d5c54-7h2lv

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-22b014-openshift-default-6cbf9d5c54-7h2lv to ip-10-0-136-89.ec2.internal

openshift-ingress

e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb to ip-10-0-142-201.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-bf45e0-749866b585-t6jzl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-bf45e0-749866b585-t6jzl to ip-10-0-142-201.ec2.internal

openshift-ingress

kube-auth-proxy-848c99f856-g64c6

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-848c99f856-g64c6 to ip-10-0-137-53.ec2.internal

openshift-ingress

e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9 to ip-10-0-142-201.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-bf45e0-8f49c4bbb-jk5nj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-bf45e0-8f49c4bbb-jk5nj to ip-10-0-137-53.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-04195c-559d584fc-6gqvc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-04195c-559d584fc-6gqvc to ip-10-0-137-53.ec2.internal

openshift-ingress

payload-processing-e2e-derive-bcc15f82-696f6675bf-sp726

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-bcc15f82-696f6675bf-sp726 to ip-10-0-142-201.ec2.internal

openshift-ingress

e2e-mt-e6e0b4a3-openshift-default-8cc4d8bd8-ns5x8

Scheduled

Successfully assigned openshift-ingress/e2e-mt-e6e0b4a3-openshift-default-8cc4d8bd8-ns5x8 to ip-10-0-136-89.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w4-4ebf73-9687f9869-zpnm6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-4ebf73-9687f9869-zpnm6 to ip-10-0-137-53.ec2.internal

openshift-ingress

e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc to ip-10-0-142-201.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-n8rc5

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-n8rc5 to ip-10-0-142-201.ec2.internal

openshift-ingress

e2e-api-b-f8e582-openshift-default-57b8c8cc8-rfrnt

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-f8e582-openshift-default-57b8c8cc8-rfrnt to ip-10-0-136-89.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-73290f4b-59d955fd4b-fnrpb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-73290f4b-59d955fd4b-fnrpb to ip-10-0-137-53.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-sqxlk

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-sqxlk to ip-10-0-142-201.ec2.internal

openshift-ingress

e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9 to ip-10-0-142-201.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-4ebf73-5567b59786-mzx5m

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-4ebf73-5567b59786-mzx5m to ip-10-0-137-53.ec2.internal

openshift-ingress

router-default-5c77589b76-877mb

Scheduled

Successfully assigned openshift-ingress/router-default-5c77589b76-877mb to ip-10-0-142-201.ec2.internal

openshift-ingress

e2e-worker-w0-7984b1-openshift-default-74dd5fd5d6-26dnc

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-7984b1-openshift-default-74dd5fd5d6-26dnc to ip-10-0-136-89.ec2.internal

openshift-ingress

e2e-ipp-b-a521b5-openshift-default-8486f85b48-sdb5j

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-a521b5-openshift-default-8486f85b48-sdb5j to ip-10-0-136-89.ec2.internal

openshift-ingress

payload-processing-e2e-mt-e6e0b4a3-79c9b5bc6f-p5829

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-e6e0b4a3-79c9b5bc6f-p5829 to ip-10-0-142-201.ec2.internal

openshift-ingress

payload-processing-e2e-mt-e977dc37-577ff7b9d5-h52md

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-e977dc37-577ff7b9d5-h52md to ip-10-0-142-201.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-ae9d47-584d59c9f7-zpbtw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-ae9d47-584d59c9f7-zpbtw to ip-10-0-142-201.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-fdbc00-64d8fb85bf-5zgk5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-fdbc00-64d8fb85bf-5zgk5 to ip-10-0-137-53.ec2.internal

openshift-ingress

e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf to ip-10-0-142-201.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-22b014-856b6b656f-jst2t

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-22b014-856b6b656f-jst2t to ip-10-0-142-201.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-0fb86d-6658f598c7-xtzs5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-0fb86d-6658f598c7-xtzs5 to ip-10-0-137-53.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-7984b1-56cdcd4d45-bfgfv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-7984b1-56cdcd4d45-bfgfv to ip-10-0-137-53.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-7984b1-6999cf6c6b-8vbcv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-7984b1-6999cf6c6b-8vbcv to ip-10-0-137-53.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-82wsv

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-82wsv to ip-10-0-142-201.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-0fb86d-7c8c54f78-s9p7j

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-0fb86d-7c8c54f78-s9p7j to ip-10-0-137-53.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-22b014-55ddd8cc54-m4lfm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-22b014-55ddd8cc54-m4lfm to ip-10-0-137-53.ec2.internal

openshift-ingress

e2e-worker-w4-4ebf73-openshift-default-ff4c898c4-dvlvw

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-4ebf73-openshift-default-ff4c898c4-dvlvw to ip-10-0-136-89.ec2.internal

openshift-ingress

e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz to ip-10-0-142-201.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-fdbc00-67944d958-zfr26

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-fdbc00-67944d958-zfr26 to ip-10-0-137-53.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-ae9d47-69f8f699fd-jpqr9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-ae9d47-69f8f699fd-jpqr9 to ip-10-0-142-201.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-e977dc37-54b796654-g79ph

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-e977dc37-54b796654-g79ph to ip-10-0-142-201.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-cr4vl

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-cr4vl to ip-10-0-142-201.ec2.internal

openshift-ingress

e2e-derive-bcc15f82-openshift-default-69dccbb8fb-bppg2

Scheduled

Successfully assigned openshift-ingress/e2e-derive-bcc15f82-openshift-default-69dccbb8fb-bppg2 to ip-10-0-142-201.ec2.internal

openshift-ingress

e2e-inf-b-0777c1-openshift-default-8d776c9d-5pc5p

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-0777c1-openshift-default-8d776c9d-5pc5p to ip-10-0-136-89.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-5c77589b76 from 0 to 1
(x11)

openshift-ingress

replicaset-controller

router-default-5c77589b76

FailedCreate

Error creating: pods "router-default-5c77589b76-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x16)

openshift-ingress

replicaset-controller

router-default-5c77589b76

FailedCreate

Error creating: pods "router-default-5c77589b76-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-5c77589b76

SuccessfulCreate

Created pod: router-default-5c77589b76-877mb
(x6)

openshift-ingress

kubelet

router-default-5c77589b76-877mb

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x6)

openshift-ingress

kubelet

router-default-5c77589b76-877mb

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found

openshift-ingress

multus

router-default-5c77589b76-877mb

AddedInterface

Add eth0 [10.134.0.9/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-5c77589b76-877mb

Started

Started container router

openshift-ingress

kubelet

router-default-5c77589b76-877mb

Created

Created container: router

openshift-ingress

kubelet

router-default-5c77589b76-877mb

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:48526e08a2a06d05806dbcf3ddb069e5182371667d9e9f7d2cf09f60cd247d20" already present on machine

openshift-ingress

replicaset-controller

kube-auth-proxy-848c99f856

SuccessfulCreate

Created pod: kube-auth-proxy-848c99f856-pl4cb
(x4)

openshift-ingress

replicaset-controller

kube-auth-proxy-848c99f856

FailedCreate

Error creating: pods "kube-auth-proxy-848c99f856-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-848c99f856

SuccessfulCreate

Created pod: kube-auth-proxy-848c99f856-g64c6

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-848c99f856 from 0 to 2

openshift-ingress

multus

kube-auth-proxy-848c99f856-g64c6

AddedInterface

Add eth0 [10.133.0.26/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-848c99f856-pl4cb

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-848c99f856-pl4cb

AddedInterface

Add eth0 [10.134.0.17/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-848c99f856-g64c6

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-n8rc5

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-n8rc5

AddedInterface

Add eth0 [10.134.0.18/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-848c99f856-pl4cb

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-n8rc5

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

kube-auth-proxy-848c99f856-g64c6

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-848c99f856-pl4cb

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.782s (2.782s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-848c99f856-pl4cb

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-848c99f856-g64c6

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-848c99f856-g64c6

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.596s (2.596s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-n8rc5

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.307s (2.307s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-n8rc5

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-n8rc5

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-n8rc5

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-n8rc5

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-p7qjr

AddedInterface

Add eth0 [10.132.0.35/23] from ovn-kubernetes

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-p7qjr

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-p7qjr

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-p7qjr

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.561s (2.561s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-p7qjr

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-p7qjr

Created

Created container: istio-proxy

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-cr4vl

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-cr4vl

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-cr4vl

Started

Started container discovery

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-cr4vl

AddedInterface

Add eth0 [10.134.0.19/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-cr4vl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" already present on machine

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-cr4vl

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-cr4vl

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-n8rc5

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-n8rc5

Killing

Stopping container discovery

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-82wsv

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-82wsv

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-82wsv

AddedInterface

Add eth0 [10.134.0.25/23] from ovn-kubernetes

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-82wsv

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.724s (2.724s including waiting). Image size: 181318953 bytes.

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-xkx49

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-xkx49

openshift-ingress

multus

payload-processing-5b54b7fbb7-sqxlk

AddedInterface

Add eth0 [10.134.0.30/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-sqxlk

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-sqxlk

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-xkx49

AddedInterface

Add eth0 [10.133.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-xkx49

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.249s (2.249s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-sqxlk

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.353s (2.353s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-xkx49

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-xkx49

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-sqxlk

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-sqxlk

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-82wsv

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-82wsv

Created

Created container: istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-82wsv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-82wsv

Unhealthy

Startup probe failed: Get "http://10.134.0.25:15021/healthz/ready": dial tcp 10.134.0.25:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-82wsv

ProbeError

Startup probe error: Get "http://10.134.0.25:15021/healthz/ready": dial tcp 10.134.0.25:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-7984b1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-7984b1

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-4ebf73

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-4ebf73

openshift-ingress

gateway_labeler_controller

e2e-inf-a-04195c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-04195c

openshift-ingress

deployment-controller

e2e-inf-a-04195c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-04195c-openshift-default-7c4d789666 from 0 to 1

openshift-ingress

deployment-controller

e2e-worker-w0-7984b1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-7984b1-openshift-default-74dd5fd5d6 from 0 to 1

openshift-ingress

multus

e2e-worker-w0-7984b1-openshift-default-74dd5fd5d6-26dnc

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w4-4ebf73-openshift-default-ff4c898c4

SuccessfulCreate

Created pod: e2e-worker-w4-4ebf73-openshift-default-ff4c898c4-dvlvw

openshift-ingress

multus

e2e-worker-w4-4ebf73-openshift-default-ff4c898c4-dvlvw

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-inf-a-04195c-openshift-default-7c4d789666

SuccessfulCreate

Created pod: e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9

openshift-ingress

deployment-controller

e2e-worker-w4-4ebf73-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-4ebf73-openshift-default-ff4c898c4 from 0 to 1

openshift-ingress

multus

e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9

AddedInterface

Add eth0 [10.134.0.35/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w0-7984b1-openshift-default-74dd5fd5d6

SuccessfulCreate

Created pod: e2e-worker-w0-7984b1-openshift-default-74dd5fd5d6-26dnc

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-4ebf73-9687f9869

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-4ebf73-9687f9869-zpnm6

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-4ebf73

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-4ebf73-5567b59786 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-4ebf73-5567b59786

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-4ebf73-5567b59786-mzx5m

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-4ebf73

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-4ebf73-9687f9869 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-4ebf73-9687f9869

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-4ebf73-9687f9869-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-4ebf73: serviceaccount "payload-processing-e2e-worker-w4-4ebf73" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-4ebf73-5567b59786

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-4ebf73-5567b59786-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-4ebf73: serviceaccount "payload-processing-e2e-worker-w4-4ebf73" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-4ebf73-9687f9869-zpnm6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-7984b1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-7984b1-6999cf6c6b from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-4ebf73-5567b59786-mzx5m

Started

Started container payload-pre-processing
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-7984b1-56cdcd4d45

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-7984b1-56cdcd4d45-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-7984b1: serviceaccount "payload-processing-e2e-worker-w0-7984b1" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-4ebf73-5567b59786-mzx5m

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-4ebf73-9687f9869-zpnm6

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-worker-w4-4ebf73-9687f9869-zpnm6

AddedInterface

Add eth0 [10.133.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-4ebf73-9687f9869-zpnm6

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-4ebf73-5567b59786-mzx5m

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-7984b1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-7984b1-56cdcd4d45 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-7984b1-6999cf6c6b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-7984b1-6999cf6c6b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-7984b1: serviceaccount "payload-processing-e2e-worker-w0-7984b1" not found

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-4ebf73-5567b59786-mzx5m

AddedInterface

Add eth0 [10.133.0.39/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-7984b1-6999cf6c6b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-7984b1-6999cf6c6b-8vbcv

openshift-ingress

multus

payload-processing-e2e-worker-w0-7984b1-56cdcd4d45-bfgfv

AddedInterface

Add eth0 [10.133.0.42/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-autores-b275d0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-b275d0

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-7984b1-6999cf6c6b-8vbcv

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-7984b1-6999cf6c6b-8vbcv

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-7984b1-6999cf6c6b-8vbcv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-7984b1-6999cf6c6b-8vbcv

AddedInterface

Add eth0 [10.133.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-7984b1-56cdcd4d45-bfgfv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-7984b1-56cdcd4d45

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-7984b1-56cdcd4d45-bfgfv

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-7984b1-56cdcd4d45-bfgfv

Created

Created container: payload-processing

openshift-ingress

deployment-controller

e2e-autores-b275d0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-b275d0-openshift-default-f5cf4fffd from 0 to 1

openshift-ingress

replicaset-controller

e2e-autores-b275d0-openshift-default-f5cf4fffd

SuccessfulCreate

Created pod: e2e-autores-b275d0-openshift-default-f5cf4fffd-86gzv

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-04195c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-04195c-559d584fc from 0 to 1

openshift-ingress

GatewayAuthBootstrap

e2e-autores-b275d0

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-autores-b275d0-authn-ssl: envoyfilters.networking.istio.io "e2e-autores-b275d0-authn-ssl" already exists

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-7984b1-56cdcd4d45-bfgfv

Started

Started container payload-processing
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-04195c-5d85fcdd86

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-04195c-5d85fcdd86-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-04195c: serviceaccount "payload-processing-e2e-inf-a-04195c" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-04195c-5d85fcdd86

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-04195c-5d85fcdd86-dlzdz

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-04195c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-04195c-5d85fcdd86 from 0 to 1

openshift-ingress

multus

e2e-autores-b275d0-openshift-default-f5cf4fffd-86gzv

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-04195c-559d584fc

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-04195c-559d584fc-6gqvc
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-04195c-559d584fc

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-04195c-559d584fc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-04195c: serviceaccount "payload-processing-e2e-inf-a-04195c" not found

openshift-ingress

kubelet

payload-processing-e2e-inf-a-04195c-559d584fc-6gqvc

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-04195c-559d584fc-6gqvc

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-04195c-5d85fcdd86-dlzdz

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-04195c-559d584fc-6gqvc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-04195c-5d85fcdd86-dlzdz

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-inf-a-04195c-559d584fc-6gqvc

AddedInterface

Add eth0 [10.133.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-04195c-5d85fcdd86-dlzdz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-04195c-5d85fcdd86-dlzdz

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes

openshift-ingress

multus

e2e-ait-6706857a-openshift-default-7b98fbbdf6-fxm98

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ait-6706857a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-6706857a

openshift-ingress

deployment-controller

e2e-ait-6706857a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-6706857a-openshift-default-7b98fbbdf6 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-6706857a-openshift-default-7b98fbbdf6

SuccessfulCreate

Created pod: e2e-ait-6706857a-openshift-default-7b98fbbdf6-fxm98
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-b275d0-dcbf759d5

FailedCreate

Error creating: pods "payload-processing-e2e-autores-b275d0-dcbf759d5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-b275d0: serviceaccount "payload-processing-e2e-autores-b275d0" not found

openshift-ingress

deployment-controller

payload-processing-e2e-autores-b275d0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-b275d0-dcbf759d5 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-b275d0-8dd84d5db

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-b275d0-8dd84d5db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-b275d0: serviceaccount "payload-processing-e2e-autores-b275d0" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-b275d0-8dd84d5db

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-b275d0-8dd84d5db-6tsg4

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-b275d0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-b275d0-8dd84d5db from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-autores-b275d0-8dd84d5db-6tsg4

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-b275d0-8dd84d5db-6tsg4

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-b275d0-8dd84d5db-6tsg4

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-b275d0-8dd84d5db-6tsg4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-b275d0-dcbf759d5

SuccessfulCreate

Created pod: payload-processing-e2e-autores-b275d0-dcbf759d5-t6zjc

openshift-ingress

multus

payload-processing-e2e-autores-b275d0-dcbf759d5-t6zjc

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-b275d0-dcbf759d5-t6zjc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-autores-b275d0-dcbf759d5-t6zjc

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-b275d0-dcbf759d5-t6zjc

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-6706857a-798454d459

SuccessfulCreate

Created pod: payload-processing-e2e-ait-6706857a-798454d459-tm86r
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-6706857a-6cd6dbdc54

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-6706857a-6cd6dbdc54-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-6706857a: serviceaccount "payload-processing-e2e-ait-6706857a" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-6706857a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-6706857a-6cd6dbdc54 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-6706857a-798454d459

FailedCreate

Error creating: pods "payload-processing-e2e-ait-6706857a-798454d459-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-6706857a: serviceaccount "payload-processing-e2e-ait-6706857a" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-6706857a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-6706857a-798454d459 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-6706857a-6cd6dbdc54

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-6706857a-6cd6dbdc54-rn5g5

openshift-ingress

multus

payload-pre-processing-e2e-ait-6706857a-6cd6dbdc54-rn5g5

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-6706857a-6cd6dbdc54-rn5g5

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-6706857a-6cd6dbdc54-rn5g5

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-6706857a-6cd6dbdc54-rn5g5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-6706857a-798454d459-tm86r

AddedInterface

Add eth0 [10.133.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-6706857a-798454d459-tm86r

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-6706857a-798454d459-tm86r

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-6706857a-798454d459-tm86r

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-7984b1-openshift-default-74dd5fd5d6-26dnc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w0-7984b1-openshift-default-74dd5fd5d6-26dnc

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-7984b1-openshift-default-74dd5fd5d6-26dnc

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w4-4ebf73-openshift-default-ff4c898c4-dvlvw

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-4ebf73-openshift-default-ff4c898c4-dvlvw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w4-4ebf73-openshift-default-ff4c898c4-dvlvw

Created

Created container: istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-inf-b-0777c1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-0777c1

openshift-ingress

deployment-controller

e2e-inf-b-0777c1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-0777c1-openshift-default-8d776c9d from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-0777c1-openshift-default-8d776c9d

SuccessfulCreate

Created pod: e2e-inf-b-0777c1-openshift-default-8d776c9d-5pc5p

openshift-ingress

multus

e2e-inf-b-0777c1-openshift-default-8d776c9d-5pc5p

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9

ProbeError

Startup probe error: Get "http://10.134.0.35:15021/healthz/ready": dial tcp 10.134.0.35:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9

Unhealthy

Startup probe failed: Get "http://10.134.0.35:15021/healthz/ready": dial tcp 10.134.0.35:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w0-7984b1-openshift-default-74dd5fd5d6-26dnc

ProbeError

Startup probe error: Get "http://10.132.0.49:15021/healthz/ready": dial tcp 10.132.0.49:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w0-7984b1-openshift-default-74dd5fd5d6-26dnc

Unhealthy

Startup probe failed: Get "http://10.132.0.49:15021/healthz/ready": dial tcp 10.132.0.49:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-4ebf73-openshift-default-ff4c898c4-dvlvw

ProbeError

Startup probe error: Get "http://10.132.0.50:15021/healthz/ready": dial tcp 10.132.0.50:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-4ebf73-openshift-default-ff4c898c4-dvlvw

Unhealthy

Startup probe failed: Get "http://10.132.0.50:15021/healthz/ready": dial tcp 10.132.0.50:15021: connect: connection refused
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-0777c1-6c5445689c

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-0777c1-6c5445689c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-0777c1: serviceaccount "payload-processing-e2e-inf-b-0777c1" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-0777c1-75869b6f54

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-0777c1-75869b6f54-t2s9l

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-0777c1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-0777c1-75869b6f54 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-0777c1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-0777c1-6c5445689c from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-0777c1-75869b6f54

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-0777c1-75869b6f54-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-0777c1: serviceaccount "payload-processing-e2e-inf-b-0777c1" not found

openshift-ingress

kubelet

payload-processing-e2e-inf-b-0777c1-6c5445689c-wqd5f

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-b-0777c1-6c5445689c-wqd5f

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-0777c1-75869b6f54-t2s9l

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-0777c1-75869b6f54-t2s9l

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-inf-b-0777c1-6c5445689c-wqd5f

AddedInterface

Add eth0 [10.133.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-0777c1-75869b6f54-t2s9l

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-0777c1-6c5445689c

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-0777c1-6c5445689c-wqd5f

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-0777c1-75869b6f54-t2s9l

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-0777c1-6c5445689c-wqd5f

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-autores-b275d0-openshift-default-f5cf4fffd-86gzv

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-b275d0-openshift-default-f5cf4fffd-86gzv

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-b275d0-openshift-default-f5cf4fffd-86gzv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-6706857a-openshift-default-7b98fbbdf6-fxm98

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-6706857a-openshift-default-7b98fbbdf6-fxm98

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-6706857a-openshift-default-7b98fbbdf6-fxm98

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-autores-b275d0-openshift-default-f5cf4fffd-86gzv

Unhealthy

Startup probe failed: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ait-6706857a-openshift-default-7b98fbbdf6-fxm98

Unhealthy

Startup probe failed: Get "http://10.132.0.55:15021/healthz/ready": dial tcp 10.132.0.55:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ait-6706857a-openshift-default-7b98fbbdf6-fxm98

ProbeError

Startup probe error: Get "http://10.132.0.55:15021/healthz/ready": dial tcp 10.132.0.55:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-autores-b275d0-openshift-default-f5cf4fffd-86gzv

ProbeError

Startup probe error: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-inf-b-0777c1-openshift-default-8d776c9d-5pc5p

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-0777c1-openshift-default-8d776c9d-5pc5p

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-0777c1-openshift-default-8d776c9d-5pc5p

Started

Started container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ait-6706857a-798454d459-tm86r

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-6706857a-6cd6dbdc54-rn5g5

Killing

Stopping container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-inf-b-0777c1-openshift-default-8d776c9d-5pc5p

ProbeError

Startup probe error: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-b-0777c1-openshift-default-8d776c9d-5pc5p

Unhealthy

Startup probe failed: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ait-6706857a-openshift-default-7b98fbbdf6-fxm98

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-migrate-73290f4b-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-73290f4b-gw

openshift-ingress

replicaset-controller

e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8

SuccessfulCreate

Created pod: e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b

openshift-ingress

deployment-controller

e2e-migrate-73290f4b-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8 from 0 to 1

openshift-ingress

kubelet

e2e-ait-6706857a-openshift-default-7b98fbbdf6-fxm98

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ait-6706857a-openshift-default-7b98fbbdf6-fxm98

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-73290f4b-784cbdc4c4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-73290f4b-784cbdc4c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-73290f4b: serviceaccount "payload-processing-e2e-migrate-73290f4b" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-73290f4b-59d955fd4b

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-73290f4b-59d955fd4b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-73290f4b: serviceaccount "payload-processing-e2e-migrate-73290f4b" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-73290f4b-59d955fd4b

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-73290f4b-59d955fd4b-fnrpb

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-73290f4b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-73290f4b-59d955fd4b from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-73290f4b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-73290f4b-784cbdc4c4 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-migrate-73290f4b-59d955fd4b-fnrpb

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-73290f4b-59d955fd4b-fnrpb

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-73290f4b-784cbdc4c4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-73290f4b-784cbdc4c4-x8dzc

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-73290f4b-784cbdc4c4-x8dzc

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-73290f4b-784cbdc4c4-x8dzc

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-73290f4b-784cbdc4c4-x8dzc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-migrate-73290f4b-59d955fd4b-fnrpb

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-73290f4b-59d955fd4b-fnrpb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-migrate-73290f4b-784cbdc4c4-x8dzc

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b

ProbeError

Startup probe error: Get "http://10.134.0.41:15021/healthz/ready": dial tcp 10.134.0.41:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b

Unhealthy

Startup probe failed: Get "http://10.134.0.41:15021/healthz/ready": dial tcp 10.134.0.41:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-migrate-73290f4b-59d955fd4b-fnrpb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-73290f4b-784cbdc4c4-x8dzc

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-ait-1d16dc05

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-1d16dc05

openshift-ingress

replicaset-controller

e2e-ait-1d16dc05-openshift-default-564f485788

SuccessfulCreate

Created pod: e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4

openshift-ingress

deployment-controller

e2e-ait-1d16dc05-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-1d16dc05-openshift-default-564f485788 from 0 to 1

openshift-ingress

multus

e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-migrate-73290f4b-gw-openshift-default-b5685ccb8-gcl6b

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-1d16dc05-74c7bffb8c

FailedCreate

Error creating: pods "payload-processing-e2e-ait-1d16dc05-74c7bffb8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-1d16dc05: serviceaccount "payload-processing-e2e-ait-1d16dc05" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-1d16dc05

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-1d16dc05-566f77cf98 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-1d16dc05-74c7bffb8c

SuccessfulCreate

Created pod: payload-processing-e2e-ait-1d16dc05-74c7bffb8c-nj85f

openshift-ingress

deployment-controller

payload-processing-e2e-ait-1d16dc05

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-1d16dc05-74c7bffb8c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-1d16dc05-566f77cf98

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-1d16dc05-566f77cf98-x8hpc
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-1d16dc05-566f77cf98

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-1d16dc05-566f77cf98-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-1d16dc05: serviceaccount "payload-processing-e2e-ait-1d16dc05" not found

openshift-ingress

kubelet

payload-processing-e2e-ait-1d16dc05-74c7bffb8c-nj85f

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-1d16dc05-566f77cf98-x8hpc

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-1d16dc05-566f77cf98-x8hpc

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-1d16dc05-566f77cf98-x8hpc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-1d16dc05-566f77cf98-x8hpc

AddedInterface

Add eth0 [10.133.0.54/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ait-1d16dc05-74c7bffb8c-nj85f

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-1d16dc05-74c7bffb8c-nj85f

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-1d16dc05-74c7bffb8c-nj85f

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4

Unhealthy

Startup probe failed: Get "http://10.134.0.43:15021/healthz/ready": dial tcp 10.134.0.43:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4

ProbeError

Startup probe error: Get "http://10.134.0.43:15021/healthz/ready": dial tcp 10.134.0.43:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-1d16dc05-566f77cf98-x8hpc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-1d16dc05-74c7bffb8c-nj85f

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-derive-bcc15f82-openshift-default-69dccbb8fb

SuccessfulCreate

Created pod: e2e-derive-bcc15f82-openshift-default-69dccbb8fb-bppg2

openshift-ingress

gateway_labeler_controller

e2e-derive-bcc15f82

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-bcc15f82

openshift-ingress

deployment-controller

e2e-derive-bcc15f82-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-bcc15f82-openshift-default-69dccbb8fb from 0 to 1

openshift-ingress

multus

e2e-derive-bcc15f82-openshift-default-69dccbb8fb-bppg2

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ait-1d16dc05-openshift-default-564f485788-q5fp4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-bcc15f82

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-bcc15f82-6cc5796574 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-derive-bcc15f82

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-bcc15f82-696f6675bf from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-bcc15f82-696f6675bf

FailedCreate

Error creating: pods "payload-processing-e2e-derive-bcc15f82-696f6675bf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-bcc15f82: serviceaccount "payload-processing-e2e-derive-bcc15f82" not found

openshift-ingress

kubelet

payload-processing-e2e-derive-bcc15f82-696f6675bf-sp726

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-derive-bcc15f82-6cc5796574-rwvpr

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-bcc15f82-6cc5796574

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-bcc15f82-6cc5796574-rwvpr

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-bcc15f82-696f6675bf

SuccessfulCreate

Created pod: payload-processing-e2e-derive-bcc15f82-696f6675bf-sp726

openshift-ingress

kubelet

payload-processing-e2e-derive-bcc15f82-696f6675bf-sp726

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-bcc15f82-6cc5796574-rwvpr

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-bcc15f82-6cc5796574-rwvpr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-bcc15f82-6cc5796574

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-bcc15f82-6cc5796574-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-bcc15f82: serviceaccount "payload-processing-e2e-derive-bcc15f82" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-bcc15f82-6cc5796574-rwvpr

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-derive-bcc15f82-696f6675bf-sp726

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-bcc15f82-696f6675bf-sp726

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-autores-b275d0-dcbf759d5-t6zjc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-b275d0-8dd84d5db-6tsg4

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-derive-bcc15f82-openshift-default-69dccbb8fb-bppg2

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-bcc15f82-openshift-default-69dccbb8fb-bppg2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-bcc15f82-openshift-default-69dccbb8fb-bppg2

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-derive-bcc15f82-openshift-default-69dccbb8fb-bppg2

ProbeError

Startup probe error: Get "http://10.134.0.45:15021/healthz/ready": dial tcp 10.134.0.45:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-derive-bcc15f82-openshift-default-69dccbb8fb-bppg2

Unhealthy

Startup probe failed: Get "http://10.134.0.45:15021/healthz/ready": dial tcp 10.134.0.45:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-derive-bcc15f82-696f6675bf-sp726

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-bcc15f82-6cc5796574-rwvpr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-bcc15f82-openshift-default-69dccbb8fb-bppg2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-autores-b275d0-openshift-default-f5cf4fffd-86gzv

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-explicit-cc14fe

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-cc14fe

openshift-ingress

deployment-controller

e2e-explicit-cc14fe-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-cc14fe-openshift-default-8544975848 from 0 to 1

openshift-ingress

replicaset-controller

e2e-explicit-cc14fe-openshift-default-8544975848

SuccessfulCreate

Created pod: e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf

openshift-ingress

multus

e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-autores-b275d0-openshift-default-f5cf4fffd-86gzv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-autores-b275d0-openshift-default-f5cf4fffd-86gzv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

multus

payload-processing-e2e-explicit-cc14fe-5957f6f569-vtdsl

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-cc14fe-5957f6f569-vtdsl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-cc14fe-569449c9c8-czgth

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-cc14fe-569449c9c8-czgth

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-cc14fe-569449c9c8-czgth

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-cc14fe

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-cc14fe-5957f6f569 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-cc14fe-569449c9c8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-cc14fe-569449c9c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-cc14fe: serviceaccount "payload-processing-e2e-explicit-cc14fe" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-cc14fe-569449c9c8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-cc14fe-569449c9c8-czgth

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-cc14fe

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-cc14fe-569449c9c8 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-explicit-cc14fe-569449c9c8-czgth

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-cc14fe-5957f6f569-vtdsl

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-cc14fe-5957f6f569-vtdsl

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-cc14fe-5957f6f569

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-cc14fe-5957f6f569-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-cc14fe: serviceaccount "payload-processing-e2e-explicit-cc14fe" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-cc14fe-5957f6f569

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-cc14fe-5957f6f569-vtdsl
(x2)

openshift-ingress

kubelet

e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf

ProbeError

Startup probe error: Get "http://10.134.0.50:15021/healthz/ready": dial tcp 10.134.0.50:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf

Unhealthy

Startup probe failed: Get "http://10.134.0.50:15021/healthz/ready": dial tcp 10.134.0.50:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-mt-e977dc37-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-e977dc37-openshift-default-67cd775956 from 0 to 1

openshift-ingress

GatewayAuthBootstrap

e2e-mt-e977dc37

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-mt-e977dc37-authn-ssl: envoyfilters.networking.istio.io "e2e-mt-e977dc37-authn-ssl" already exists

openshift-ingress

gateway_labeler_controller

e2e-mt-e977dc37

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-e977dc37

openshift-ingress

replicaset-controller

e2e-mt-e977dc37-openshift-default-67cd775956

SuccessfulCreate

Created pod: e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2

openshift-ingress

multus

e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-cc14fe-569449c9c8-czgth

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-cc14fe-5957f6f569-vtdsl

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-mt-e977dc37

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-e977dc37-577ff7b9d5 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-e977dc37

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-e977dc37-54b796654 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-e977dc37-54b796654

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-e977dc37-54b796654-g79ph
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-e977dc37-54b796654

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-e977dc37-54b796654-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-e977dc37: serviceaccount "payload-processing-e2e-mt-e977dc37" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-e977dc37-577ff7b9d5

FailedCreate

Error creating: pods "payload-processing-e2e-mt-e977dc37-577ff7b9d5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-e977dc37: serviceaccount "payload-processing-e2e-mt-e977dc37" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-e977dc37-577ff7b9d5

SuccessfulCreate

Created pod: payload-processing-e2e-mt-e977dc37-577ff7b9d5-h52md

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-e977dc37-54b796654-g79ph

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-e977dc37-577ff7b9d5-h52md

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-e977dc37-577ff7b9d5-h52md

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-e977dc37-54b796654-g79ph

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-e977dc37-54b796654-g79ph

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-mt-e977dc37-54b796654-g79ph

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-e977dc37-577ff7b9d5-h52md

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-e977dc37-577ff7b9d5-h52md

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-explicit-cc14fe-openshift-default-8544975848-9r6lf

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-noten-d6e5fb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-d6e5fb-openshift-default-9d978b84d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-noten-d6e5fb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-d6e5fb

openshift-ingress

replicaset-controller

e2e-noten-d6e5fb-openshift-default-9d978b84d

SuccessfulCreate

Created pod: e2e-noten-d6e5fb-openshift-default-9d978b84d-5kk9t

openshift-ingress

multus

e2e-noten-d6e5fb-openshift-default-9d978b84d-5kk9t

AddedInterface

Add eth0 [10.132.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-d6e5fb-openshift-default-9d978b84d-5kk9t

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-noten-d6e5fb-openshift-default-9d978b84d-5kk9t

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-noten-d6e5fb-openshift-default-9d978b84d-5kk9t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2

ProbeError

Startup probe error: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2

Unhealthy

Startup probe failed: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-mt-e977dc37

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-mt-e977dc37: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-mt-e977dc37": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-mt-e977dc37, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 1dd479c6-4ea4-4161-a0df-61a9963d61f7, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-mt-e977dc37-577ff7b9d5-h52md

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-e977dc37-54b796654-g79ph

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-e977dc37-openshift-default-67cd775956-hhzg2

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

e2e-shared-a-w2-ae9d47-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-ae9d47

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-ae9d47

openshift-ingress

replicaset-controller

e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794

SuccessfulCreate

Created pod: e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh

openshift-ingress

kubelet

e2e-noten-d6e5fb-openshift-default-9d978b84d-5kk9t

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-d6e5fb-openshift-default-9d978b84d-5kk9t

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-noten-d6e5fb-openshift-default-9d978b84d-5kk9t

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-ae9d47-584d59c9f7

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-ae9d47-584d59c9f7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-ae9d47: serviceaccount "payload-processing-e2e-shared-a-w2-ae9d47" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-ae9d47-69f8f699fd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-ae9d47-69f8f699fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-ae9d47: serviceaccount "payload-processing-e2e-shared-a-w2-ae9d47" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-ae9d47

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-ae9d47-69f8f699fd from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-ae9d47-69f8f699fd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-ae9d47-69f8f699fd-jpqr9

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-ae9d47-584d59c9f7

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-ae9d47-584d59c9f7-zpbtw

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-ae9d47-69f8f699fd-jpqr9

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-ae9d47

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-ae9d47-584d59c9f7 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-ae9d47-584d59c9f7-zpbtw

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-ae9d47-584d59c9f7-zpbtw

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-ae9d47-584d59c9f7-zpbtw

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-ae9d47-69f8f699fd-jpqr9

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-ae9d47-69f8f699fd-jpqr9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-ae9d47-69f8f699fd-jpqr9

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-ae9d47-584d59c9f7-zpbtw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-a-04195c-559d584fc-6gqvc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-04195c-5d85fcdd86-dlzdz

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-22b014

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-22b014

openshift-ingress

deployment-controller

e2e-shared-b-w2-22b014-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-22b014-openshift-default-6cbf9d5c54 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w2-22b014-openshift-default-6cbf9d5c54

SuccessfulCreate

Created pod: e2e-shared-b-w2-22b014-openshift-default-6cbf9d5c54-7h2lv

openshift-ingress

kubelet

e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-shared-b-w2-22b014-openshift-default-6cbf9d5c54-7h2lv

AddedInterface

Add eth0 [10.132.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-a-04195c-openshift-default-7c4d789666-kz4j9

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-22b014-856b6b656f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-22b014-856b6b656f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-22b014: serviceaccount "payload-processing-e2e-shared-b-w2-22b014" not found
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh

Created

Created container: istio-proxy

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-22b014-856b6b656f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-22b014-856b6b656f-jst2t
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh

Started

Started container istio-proxy

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-22b014

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-22b014-856b6b656f from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-22b014

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-22b014-55ddd8cc54 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-22b014-55ddd8cc54

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-22b014-55ddd8cc54-m4lfm
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-22b014-55ddd8cc54

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-22b014-55ddd8cc54-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-22b014: serviceaccount "payload-processing-e2e-shared-b-w2-22b014" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-22b014-55ddd8cc54-m4lfm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-22b014-55ddd8cc54-m4lfm

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-22b014-856b6b656f-jst2t

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-22b014-856b6b656f-jst2t

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-22b014-55ddd8cc54-m4lfm

AddedInterface

Add eth0 [10.133.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-22b014-856b6b656f-jst2t

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-22b014-55ddd8cc54-m4lfm

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-22b014-856b6b656f-jst2t

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-0777c1-6c5445689c-wqd5f

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-0777c1-75869b6f54-t2s9l

Killing

Stopping container payload-pre-processing
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh

Unhealthy

Startup probe failed: Get "http://10.134.0.57:15021/healthz/ready": dial tcp 10.134.0.57:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh

ProbeError

Startup probe error: Get "http://10.134.0.57:15021/healthz/ready": dial tcp 10.134.0.57:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-inf-b-0777c1-openshift-default-8d776c9d-5pc5p

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-a-w3-fdbc00-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-fdbc00-openshift-default-86965b886b from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w3-fdbc00-openshift-default-86965b886b

SuccessfulCreate

Created pod: e2e-shared-a-w3-fdbc00-openshift-default-86965b886b-s92bk

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-fdbc00

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-fdbc00

openshift-ingress

multus

e2e-shared-a-w3-fdbc00-openshift-default-86965b886b-s92bk

AddedInterface

Add eth0 [10.132.0.72/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-fdbc00

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-fdbc00-64d8fb85bf from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-fdbc00-64d8fb85bf

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-fdbc00-64d8fb85bf-5zgk5
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-fdbc00-64d8fb85bf

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-fdbc00-64d8fb85bf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-fdbc00: serviceaccount "payload-processing-e2e-shared-a-w3-fdbc00" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-fdbc00-67944d958

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-fdbc00-67944d958-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-fdbc00: serviceaccount "payload-processing-e2e-shared-a-w3-fdbc00" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-fdbc00-67944d958

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-fdbc00-67944d958-zfr26

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-fdbc00

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-fdbc00-67944d958 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-fdbc00-67944d958-zfr26

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-fdbc00-64d8fb85bf-5zgk5

AddedInterface

Add eth0 [10.133.0.67/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-fdbc00-67944d958-zfr26

AddedInterface

Add eth0 [10.133.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-fdbc00-67944d958-zfr26

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-fdbc00-67944d958-zfr26

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-fdbc00-64d8fb85bf-5zgk5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-fdbc00-64d8fb85bf-5zgk5

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-fdbc00-64d8fb85bf-5zgk5

Started

Started container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-mt-e6e0b4a3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-e6e0b4a3

openshift-ingress

deployment-controller

e2e-mt-e6e0b4a3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-e6e0b4a3-openshift-default-8cc4d8bd8 from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-e6e0b4a3-openshift-default-8cc4d8bd8

SuccessfulCreate

Created pod: e2e-mt-e6e0b4a3-openshift-default-8cc4d8bd8-ns5x8

openshift-ingress

multus

e2e-mt-e6e0b4a3-openshift-default-8cc4d8bd8-ns5x8

AddedInterface

Add eth0 [10.132.0.78/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-22b014-openshift-default-6cbf9d5c54-7h2lv

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-22b014-openshift-default-6cbf9d5c54-7h2lv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-22b014-openshift-default-6cbf9d5c54-7h2lv

Created

Created container: istio-proxy

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-e6e0b4a3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-e6e0b4a3-6669d65c98 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-e6e0b4a3-6669d65c98

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-e6e0b4a3-6669d65c98-l8xz9
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-e6e0b4a3-6669d65c98

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-e6e0b4a3-6669d65c98-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-e6e0b4a3: serviceaccount "payload-processing-e2e-mt-e6e0b4a3" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-e6e0b4a3-79c9b5bc6f

FailedCreate

Error creating: pods "payload-processing-e2e-mt-e6e0b4a3-79c9b5bc6f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-e6e0b4a3: serviceaccount "payload-processing-e2e-mt-e6e0b4a3" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-e6e0b4a3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-e6e0b4a3-79c9b5bc6f from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-e6e0b4a3-6669d65c98-l8xz9

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-e6e0b4a3-6669d65c98-l8xz9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-e6e0b4a3-6669d65c98-l8xz9

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-e6e0b4a3-79c9b5bc6f

SuccessfulCreate

Created pod: payload-processing-e2e-mt-e6e0b4a3-79c9b5bc6f-p5829

openshift-ingress

kubelet

payload-processing-e2e-mt-e6e0b4a3-79c9b5bc6f-p5829

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-e6e0b4a3-79c9b5bc6f-p5829

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-e6e0b4a3-79c9b5bc6f-p5829

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-mt-e6e0b4a3-6669d65c98-l8xz9

AddedInterface

Add eth0 [10.133.0.69/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-mt-e6e0b4a3-79c9b5bc6f-p5829

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-22b014-openshift-default-6cbf9d5c54-7h2lv

Unhealthy

Startup probe failed: Get "http://10.132.0.70:15021/healthz/ready": dial tcp 10.132.0.70:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-22b014-openshift-default-6cbf9d5c54-7h2lv

ProbeError

Startup probe error: Get "http://10.132.0.70:15021/healthz/ready": dial tcp 10.132.0.70:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d

SuccessfulCreate

Created pod: e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9

openshift-ingress

deployment-controller

e2e-shared-b-w3-0fb86d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-0fb86d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-0fb86d

openshift-ingress

multus

e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-0fb86d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-0fb86d-7c8c54f78 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-0fb86d-6658f598c7

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-0fb86d-6658f598c7-xtzs5

openshift-ingress

kubelet

e2e-shared-a-w3-fdbc00-openshift-default-86965b886b-s92bk

Unhealthy

Readiness probe failed: Get "http://10.132.0.72:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-0fb86d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-0fb86d-6658f598c7 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-0fb86d-6658f598c7

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-0fb86d-6658f598c7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-0fb86d: serviceaccount "payload-processing-e2e-shared-b-w3-0fb86d" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-0fb86d-6658f598c7-xtzs5

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-0fb86d-7c8c54f78-s9p7j

AddedInterface

Add eth0 [10.133.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-0fb86d-6658f598c7-xtzs5

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-shared-a-w3-fdbc00-openshift-default-86965b886b-s92bk

ProbeError

Readiness probe error: Get "http://10.132.0.72:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-0fb86d-6658f598c7-xtzs5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-0fb86d-6658f598c7-xtzs5

AddedInterface

Add eth0 [10.133.0.71/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-0fb86d-7c8c54f78

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-0fb86d-7c8c54f78-s9p7j
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-0fb86d-7c8c54f78

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-0fb86d-7c8c54f78-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-0fb86d: serviceaccount "payload-processing-e2e-shared-b-w3-0fb86d" not found
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-fdbc00-openshift-default-86965b886b-s92bk

Started

Started container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-0fb86d-7c8c54f78-s9p7j

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-fdbc00-openshift-default-86965b886b-s92bk

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-fdbc00-openshift-default-86965b886b-s92bk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-0fb86d-7c8c54f78-s9p7j

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-0fb86d-7c8c54f78-s9p7j

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-fdbc00-openshift-default-86965b886b-s92bk

Unhealthy

Startup probe failed: Get "http://10.132.0.72:15021/healthz/ready": dial tcp 10.132.0.72:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-fdbc00-openshift-default-86965b886b-s92bk

ProbeError

Startup probe error: Get "http://10.132.0.72:15021/healthz/ready": dial tcp 10.132.0.72:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-mt-e6e0b4a3-openshift-default-8cc4d8bd8-ns5x8

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-e6e0b4a3-openshift-default-8cc4d8bd8-ns5x8

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-e6e0b4a3-openshift-default-8cc4d8bd8-ns5x8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-mt-e6e0b4a3-openshift-default-8cc4d8bd8-ns5x8

Unhealthy

Startup probe failed: Get "http://10.132.0.78:15021/healthz/ready": dial tcp 10.132.0.78:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-e6e0b4a3-openshift-default-8cc4d8bd8-ns5x8

ProbeError

Startup probe error: Get "http://10.132.0.78:15021/healthz/ready": dial tcp 10.132.0.78:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9

ProbeError

Startup probe error: Get "http://10.134.0.62:15021/healthz/ready": dial tcp 10.134.0.62:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9

Unhealthy

Startup probe failed: Get "http://10.134.0.62:15021/healthz/ready": dial tcp 10.134.0.62:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-e6e0b4a3-6669d65c98-l8xz9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-e6e0b4a3-79c9b5bc6f-p5829

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-e6e0b4a3-openshift-default-8cc4d8bd8-ns5x8

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-api-a-29e74e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-29e74e

openshift-ingress

deployment-controller

e2e-api-a-29e74e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-29e74e-openshift-default-6cdbf99896 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-29e74e-openshift-default-6cdbf99896

SuccessfulCreate

Created pod: e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb

openshift-ingress

multus

e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-7984b1-56cdcd4d45-bfgfv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-7984b1-6999cf6c6b-8vbcv

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-29e74e-6fb8fc5c5

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-29e74e-6fb8fc5c5-bk6nv
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-29e74e-85664db6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-29e74e-85664db6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-29e74e: serviceaccount "payload-processing-e2e-api-a-29e74e" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-29e74e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-29e74e-85664db6 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-api-a-29e74e-85664db6-xhbmm

AddedInterface

Add eth0 [10.133.0.82/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-29e74e-85664db6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-29e74e-85664db6-xhbmm

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-29e74e-85664db6-xhbmm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-29e74e-6fb8fc5c5

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-29e74e-6fb8fc5c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-29e74e: serviceaccount "payload-processing-e2e-api-a-29e74e" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-29e74e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-29e74e-6fb8fc5c5 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-29e74e-85664db6-xhbmm

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-api-a-29e74e-6fb8fc5c5-bk6nv

AddedInterface

Add eth0 [10.133.0.83/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-29e74e-6fb8fc5c5-bk6nv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-a-29e74e-6fb8fc5c5-bk6nv

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-29e74e-6fb8fc5c5-bk6nv

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-29e74e-85664db6-xhbmm

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w0-7984b1-openshift-default-74dd5fd5d6-26dnc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-7984b1-openshift-default-74dd5fd5d6-26dnc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w0-7984b1-openshift-default-74dd5fd5d6-26dnc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

gateway_labeler_controller

e2e-api-b-f8e582

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-f8e582

openshift-ingress

deployment-controller

e2e-api-b-f8e582-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-f8e582-openshift-default-57b8c8cc8 from 0 to 1

openshift-ingress

GatewayAuthBootstrap

e2e-api-b-f8e582

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-api-b-f8e582-authn-ssl: envoyfilters.networking.istio.io "e2e-api-b-f8e582-authn-ssl" already exists

openshift-ingress

multus

e2e-api-b-f8e582-openshift-default-57b8c8cc8-rfrnt

AddedInterface

Add eth0 [10.132.0.85/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-api-b-f8e582-openshift-default-57b8c8cc8

SuccessfulCreate

Created pod: e2e-api-b-f8e582-openshift-default-57b8c8cc8-rfrnt

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-4ebf73-9687f9869-zpnm6

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-worker-w4-4ebf73

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-worker-w4-4ebf73: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-worker-w4-4ebf73": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-worker-w4-4ebf73, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 5ce569a1-f552-4663-92a8-b9ad71fed7f8, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-4ebf73-5567b59786-mzx5m

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-f8e582

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-f8e582-58b77c449c from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-f8e582-58b77c449c

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-f8e582-58b77c449c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-f8e582: serviceaccount "payload-processing-e2e-api-b-f8e582" not found

openshift-ingress

kubelet

e2e-worker-w4-4ebf73-openshift-default-ff4c898c4-dvlvw

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-f8e582

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-f8e582-5978df4bb6 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-f8e582-5978df4bb6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-f8e582-5978df4bb6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-f8e582: serviceaccount "payload-processing-e2e-api-b-f8e582" not found

openshift-ingress

kubelet

payload-processing-e2e-api-b-f8e582-58b77c449c-thb87

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-api-b-f8e582-58b77c449c-thb87

AddedInterface

Add eth0 [10.133.0.84/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-f8e582-58b77c449c

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-f8e582-58b77c449c-thb87

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-f8e582-5978df4bb6-458l9

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-f8e582-5978df4bb6-458l9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-f8e582-5978df4bb6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-f8e582-5978df4bb6-458l9

openshift-ingress

kubelet

payload-processing-e2e-api-b-f8e582-58b77c449c-thb87

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-f8e582-5978df4bb6-458l9

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-f8e582-58b77c449c-thb87

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-b-f8e582-5978df4bb6-458l9

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-4ebf73-openshift-default-ff4c898c4-dvlvw

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w4-4ebf73-openshift-default-ff4c898c4-dvlvw

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb

ProbeError

Startup probe error: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb

Unhealthy

Startup probe failed: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-api-b-f8e582-openshift-default-57b8c8cc8-rfrnt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-f8e582-openshift-default-57b8c8cc8-rfrnt

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-f8e582-openshift-default-57b8c8cc8-rfrnt

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-b-f8e582-openshift-default-57b8c8cc8-rfrnt

ProbeError

Startup probe error: Get "http://10.132.0.85:15021/healthz/ready": dial tcp 10.132.0.85:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-f8e582-openshift-default-57b8c8cc8-rfrnt

Unhealthy

Startup probe failed: Get "http://10.132.0.85:15021/healthz/ready": dial tcp 10.132.0.85:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-api-a-29e74e-6fb8fc5c5-bk6nv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-29e74e-85664db6-xhbmm

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-api-a-29e74e

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-api-a-29e74e: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-api-a-29e74e": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-api-a-29e74e, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 6f148635-8161-4d9f-af23-f7de24eab0b1, UID in object meta:

openshift-ingress

kubelet

e2e-api-a-29e74e-openshift-default-6cdbf99896-9zflb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-f8e582-5978df4bb6-458l9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-f8e582-58b77c449c-thb87

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-b-f8e582-openshift-default-57b8c8cc8-rfrnt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-ae9d47-69f8f699fd-jpqr9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-ae9d47-584d59c9f7-zpbtw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w2-ae9d47-openshift-default-7dbfbbf794-4t4sh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-22b014-856b6b656f-jst2t

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-22b014-55ddd8cc54-m4lfm

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-b-w2-22b014

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-b-w2-22b014: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-b-w2-22b014": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-b-w2-22b014, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 612449da-aaf5-45f5-b981-341ddc85e259, UID in object meta:

openshift-ingress

kubelet

e2e-shared-b-w2-22b014-openshift-default-6cbf9d5c54-7h2lv

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-ipp-a-bf45e0-openshift-default-8458bd7b46

SuccessfulCreate

Created pod: e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz

openshift-ingress

multus

e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz

AddedInterface

Add eth0 [10.134.0.70/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ipp-a-bf45e0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-bf45e0-openshift-default-8458bd7b46 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-bf45e0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-bf45e0
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-bf45e0-8f49c4bbb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-bf45e0-8f49c4bbb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-bf45e0: serviceaccount "payload-processing-e2e-ipp-a-bf45e0" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-bf45e0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-bf45e0-749866b585 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-bf45e0-749866b585

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-bf45e0-749866b585-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-bf45e0: serviceaccount "payload-processing-e2e-ipp-a-bf45e0" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-bf45e0-8f49c4bbb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-bf45e0-8f49c4bbb-jk5nj

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-bf45e0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-bf45e0-8f49c4bbb from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-bf45e0-8f49c4bbb-jk5nj

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-bf45e0-749866b585

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-bf45e0-749866b585-t6jzl

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-bf45e0-8f49c4bbb-jk5nj

AddedInterface

Add eth0 [10.133.0.90/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-bf45e0-749866b585-t6jzl

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-bf45e0-749866b585-t6jzl

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-bf45e0-8f49c4bbb-jk5nj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-bf45e0-8f49c4bbb-jk5nj

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-bf45e0-749866b585-t6jzl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-a-bf45e0-749866b585-t6jzl

AddedInterface

Add eth0 [10.134.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz

Unhealthy

Readiness probe failed: Get "http://10.134.0.70:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz

ProbeError

Readiness probe error: Get "http://10.134.0.70:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz

Unhealthy

Startup probe failed: Get "http://10.134.0.70:15021/healthz/ready": dial tcp 10.134.0.70:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz

ProbeError

Startup probe error: Get "http://10.134.0.70:15021/healthz/ready": dial tcp 10.134.0.70:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-ipp-b-a521b5-openshift-default-8486f85b48

SuccessfulCreate

Created pod: e2e-ipp-b-a521b5-openshift-default-8486f85b48-sdb5j

openshift-ingress

deployment-controller

e2e-ipp-b-a521b5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-a521b5-openshift-default-8486f85b48 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-a521b5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-a521b5

openshift-ingress

multus

e2e-ipp-b-a521b5-openshift-default-8486f85b48-sdb5j

AddedInterface

Add eth0 [10.132.0.92/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-a521b5-9dcdbb9d7

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-a521b5-9dcdbb9d7-x2f6n

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-a521b5-66c8dcf694

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-a521b5-66c8dcf694-bmwjc
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-a521b5-9dcdbb9d7

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-a521b5-9dcdbb9d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-a521b5: serviceaccount "payload-processing-e2e-ipp-b-a521b5" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-a521b5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-a521b5-9dcdbb9d7 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-a521b5-66c8dcf694

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-a521b5-66c8dcf694-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-a521b5: serviceaccount "payload-processing-e2e-ipp-b-a521b5" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-a521b5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-a521b5-66c8dcf694 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ipp-b-a521b5-9dcdbb9d7-x2f6n

AddedInterface

Add eth0 [10.133.0.91/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-a521b5-66c8dcf694-bmwjc

AddedInterface

Add eth0 [10.134.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a521b5-66c8dcf694-bmwjc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a521b5-66c8dcf694-bmwjc

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a521b5-66c8dcf694-bmwjc

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a521b5-9dcdbb9d7-x2f6n

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a521b5-9dcdbb9d7-x2f6n

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a521b5-9dcdbb9d7-x2f6n

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-b-a521b5-openshift-default-8486f85b48-sdb5j

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-a521b5-openshift-default-8486f85b48-sdb5j

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-a521b5-openshift-default-8486f85b48-sdb5j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-ipp-b-a521b5-openshift-default-8486f85b48-sdb5j

ProbeError

Startup probe error: Get "http://10.132.0.92:15021/healthz/ready": dial tcp 10.132.0.92:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-b-a521b5-openshift-default-8486f85b48-sdb5j

Unhealthy

Startup probe failed: Get "http://10.132.0.92:15021/healthz/ready": dial tcp 10.132.0.92:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-ipp-cleanup-d5e418-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b

SuccessfulCreate

Created pod: e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-d5e418

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-d5e418

openshift-ingress

multus

e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc

AddedInterface

Add eth0 [10.134.0.73/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-d5e418-85cfbd5f8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-d5e418-85cfbd5f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-d5e418: serviceaccount "payload-processing-e2e-ipp-cleanup-d5e418" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-d5e418-85cfbd5f8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-d5e418-85cfbd5f8-48mvs

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-d5e418

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-d5e418-85cfbd5f8 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-d5e418

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-d5e418-58c6d6bcdf from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-d5e418-58c6d6bcdf

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-d5e418-58c6d6bcdf-w84gj
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-d5e418-58c6d6bcdf

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-d5e418-58c6d6bcdf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-d5e418: serviceaccount "payload-processing-e2e-ipp-cleanup-d5e418" not found

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-d5e418-58c6d6bcdf-w84gj

AddedInterface

Add eth0 [10.134.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-d5e418-58c6d6bcdf-w84gj

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-d5e418-58c6d6bcdf-w84gj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-d5e418-85cfbd5f8-48mvs

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-d5e418-58c6d6bcdf-w84gj

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-d5e418-85cfbd5f8-48mvs

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-d5e418-85cfbd5f8-48mvs

AddedInterface

Add eth0 [10.133.0.93/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-d5e418-85cfbd5f8-48mvs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc

Unhealthy

Startup probe failed: Get "http://10.134.0.73:15021/healthz/ready": dial tcp 10.134.0.73:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc

ProbeError

Startup probe error: Get "http://10.134.0.73:15021/healthz/ready": dial tcp 10.134.0.73:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-d5e418-85cfbd5f8-48mvs

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-d5e418-58c6d6bcdf-w84gj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-d5e418-openshift-default-6ffb87588b-n79gc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-bf45e0-749866b585-t6jzl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-bf45e0-8f49c4bbb-jk5nj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-bf45e0-openshift-default-8458bd7b46-rqxwz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a521b5-9dcdbb9d7-x2f6n

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a521b5-66c8dcf694-bmwjc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-a521b5-openshift-default-8486f85b48-sdb5j

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-fdbc00-67944d958-zfr26

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-fdbc00-64d8fb85bf-5zgk5

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-a-w3-fdbc00

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-a-w3-fdbc00: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-a-w3-fdbc00": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-a-w3-fdbc00, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: b7fadc81-204e-496d-bac8-4100aa9bb00b, UID in object meta:

openshift-ingress

kubelet

e2e-shared-a-w3-fdbc00-openshift-default-86965b886b-s92bk

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w3-fdbc00-openshift-default-86965b886b-s92bk

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w3-fdbc00-openshift-default-86965b886b-s92bk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-0fb86d-6658f598c7-xtzs5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-0fb86d-7c8c54f78-s9p7j

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w3-0fb86d-openshift-default-7dc5d975d-hclm9

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503