Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-processing-5b54b7fbb7-pnm4r

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-pnm4r to ip-10-0-128-234.ec2.internal

openshift-ingress

e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr to ip-10-0-128-234.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-6745bb66bcflwcm

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcflwcm to ip-10-0-128-234.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-fc06d4-5c7c7b997d-6mxxs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-fc06d4-5c7c7b997d-6mxxs to ip-10-0-135-236.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-7bf16f-7bd5896978-hngjp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-7bf16f-7bd5896978-hngjp to ip-10-0-128-234.ec2.internal

openshift-ingress

e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc to ip-10-0-128-234.ec2.internal

openshift-ingress

e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6 to ip-10-0-128-234.ec2.internal

openshift-ingress

payload-processing-e2e-ait-49ac64b7-669c84c4f9-pt5kp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-49ac64b7-669c84c4f9-pt5kp to ip-10-0-128-234.ec2.internal

openshift-ingress

payload-processing-e2e-ait-ad4f3b47-9cdfc69df-q56rn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-ad4f3b47-9cdfc69df-q56rn to ip-10-0-128-234.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-8ecc1f-5bf6bb8498-mrslb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-8ecc1f-5bf6bb8498-mrslb to ip-10-0-128-234.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-e25a5e89-698f5d6b54-kn2tp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-e25a5e89-698f5d6b54-kn2tp to ip-10-0-138-102.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-92vmv

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-92vmv to ip-10-0-135-236.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-25792506-b84c5b58-g674h

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-25792506-b84c5b58-g674h to ip-10-0-128-234.ec2.internal

openshift-ingress

e2e-shared-b-w2-fc06d4-openshift-default-6bd66998d6-fmxvc

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-fc06d4-openshift-default-6bd66998d6-fmxvc to ip-10-0-135-236.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-45qrv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-45qrv to ip-10-0-128-234.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-1d2af2-577cd885b7-8tl5x

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-1d2af2-577cd885b7-8tl5x to ip-10-0-135-236.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-4ba551-bc6c77477-b7g7b

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-4ba551-bc6c77477-b7g7b to ip-10-0-128-234.ec2.internal

openshift-ingress

payload-processing-e2e-autores-d24d4c-65b655c8c-cllhw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-d24d4c-65b655c8c-cllhw to ip-10-0-128-234.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-d24d4c-7f984fcdd6-64qbq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-d24d4c-7f984fcdd6-64qbq to ip-10-0-138-102.ec2.internal

openshift-ingress

e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4 to ip-10-0-128-234.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-b42t5

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b42t5 to ip-10-0-128-234.ec2.internal

openshift-ingress

e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg to ip-10-0-128-234.ec2.internal

openshift-ingress

e2e-inf-b-8ee208-openshift-default-76f8b95d56-n5g5w

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-8ee208-openshift-default-76f8b95d56-n5g5w to ip-10-0-135-236.ec2.internal

openshift-ingress

e2e-ait-49ac64b7-openshift-default-7976bbd5fb-bh77l

Scheduled

Successfully assigned openshift-ingress/e2e-ait-49ac64b7-openshift-default-7976bbd5fb-bh77l to ip-10-0-135-236.ec2.internal

openshift-ingress

e2e-mt-25792506-openshift-default-564b5b8588-65lvx

Scheduled

Successfully assigned openshift-ingress/e2e-mt-25792506-openshift-default-564b5b8588-65lvx to ip-10-0-128-234.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-42514d-74ddb96797-bh6dm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-42514d-74ddb96797-bh6dm to ip-10-0-135-236.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-4ba551-848fb5d858-b7km7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-4ba551-848fb5d858-b7km7 to ip-10-0-135-236.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-w8nmv

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w8nmv to ip-10-0-135-236.ec2.internal

openshift-ingress

e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5

Scheduled

Successfully assigned openshift-ingress/e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5 to ip-10-0-128-234.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-8ee208-575799d9c9-mbtcs

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-8ee208-575799d9c9-mbtcs to ip-10-0-128-234.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-1d2af2-6f59cfd574-csshm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-1d2af2-6f59cfd574-csshm to ip-10-0-128-234.ec2.internal

openshift-ingress

e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw to ip-10-0-128-234.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-42514d-56dc6c9bf8-q9bqw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-42514d-56dc6c9bf8-q9bqw to ip-10-0-135-236.ec2.internal

openshift-ingress

e2e-noten-651c34-openshift-default-7777797c4d-j98l5

Scheduled

Successfully assigned openshift-ingress/e2e-noten-651c34-openshift-default-7777797c4d-j98l5 to ip-10-0-135-236.ec2.internal

openshift-ingress

e2e-ait-ad4f3b47-openshift-default-59b786598b-4l9fr

Scheduled

Successfully assigned openshift-ingress/e2e-ait-ad4f3b47-openshift-default-59b786598b-4l9fr to ip-10-0-135-236.ec2.internal

openshift-ingress

e2e-mt-e25a5e89-openshift-default-678b5bf964-j2n2k

Scheduled

Successfully assigned openshift-ingress/e2e-mt-e25a5e89-openshift-default-678b5bf964-j2n2k to ip-10-0-135-236.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-d320da1d-bc558d6-xmhxd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-d320da1d-bc558d6-xmhxd to ip-10-0-128-234.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-268239-79c5568b4b-qkwdh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-268239-79c5568b4b-qkwdh to ip-10-0-128-234.ec2.internal

openshift-ingress

kube-auth-proxy-79c7cbc6bf-2ctcp

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-79c7cbc6bf-2ctcp to ip-10-0-135-236.ec2.internal

openshift-ingress

e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh to ip-10-0-128-234.ec2.internal

openshift-ingress

e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk to ip-10-0-128-234.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-59dc59-dccf565d6-tcqjx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-59dc59-dccf565d6-tcqjx to ip-10-0-128-234.ec2.internal

openshift-ingress

e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7 to ip-10-0-128-234.ec2.internal

openshift-ingress

kube-auth-proxy-79c7cbc6bf-jxtdf

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-79c7cbc6bf-jxtdf to ip-10-0-138-102.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-8ee208-556c8c4c9d-h6dhn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-8ee208-556c8c4c9d-h6dhn to ip-10-0-128-234.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-600197-84567bdfb6-v7wqd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-600197-84567bdfb6-v7wqd to ip-10-0-128-234.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-345a2c-7cfd79d666-bndv6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-345a2c-7cfd79d666-bndv6 to ip-10-0-138-102.ec2.internal

openshift-ingress

e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v to ip-10-0-128-234.ec2.internal

openshift-ingress

e2e-autores-d24d4c-openshift-default-7986f99c8d-t2tlq

Scheduled

Successfully assigned openshift-ingress/e2e-autores-d24d4c-openshift-default-7986f99c8d-t2tlq to ip-10-0-135-236.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-5c43af-9994f6647-5l9ds

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-5c43af-9994f6647-5l9ds to ip-10-0-135-236.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-268239-65fd74c747-7r9k9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-268239-65fd74c747-7r9k9 to ip-10-0-135-236.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-d320da1d-54c956c678-h7997

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-d320da1d-54c956c678-h7997 to ip-10-0-128-234.ec2.internal

openshift-ingress

router-default-56968c8f6-wb7q7

Scheduled

Successfully assigned openshift-ingress/router-default-56968c8f6-wb7q7 to ip-10-0-128-234.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-0245a1e4-d777f6486-822l7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-0245a1e4-d777f6486-822l7 to ip-10-0-128-234.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-59dc59-dc7f8ff87-x7w5c

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-59dc59-dc7f8ff87-x7w5c to ip-10-0-135-236.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-fc06d4-749c468585-hf8jn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-fc06d4-749c468585-hf8jn to ip-10-0-135-236.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-7bf16f-5c665dfdc-npdbf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-7bf16f-5c665dfdc-npdbf to ip-10-0-135-236.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-8ecc1f-856d9cc485-tsbxf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-8ecc1f-856d9cc485-tsbxf to ip-10-0-128-234.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-49ac64b7-7f946fdb8b-dnzmj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-49ac64b7-7f946fdb8b-dnzmj to ip-10-0-128-234.ec2.internal

openshift-ingress

payload-processing-e2e-mt-e25a5e89-8957d4cd9-plzll

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-e25a5e89-8957d4cd9-plzll to ip-10-0-128-234.ec2.internal

openshift-ingress

payload-processing-e2e-mt-25792506-7594f8f6bf-8djsd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-25792506-7594f8f6bf-8djsd to ip-10-0-135-236.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-jz98w

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-jz98w to ip-10-0-128-234.ec2.internal

openshift-ingress

payload-processing-e2e-derive-0245a1e4-77fd4944f-vgz8z

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-0245a1e4-77fd4944f-vgz8z to ip-10-0-128-234.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-345a2c-7868b8974f-gvqgb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-345a2c-7868b8974f-gvqgb to ip-10-0-128-234.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-600197-6f99b5676c-bfjf9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-600197-6f99b5676c-bfjf9 to ip-10-0-128-234.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-ad4f3b47-6cbd778fcd-gktnt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-ad4f3b47-6cbd778fcd-gktnt to ip-10-0-128-234.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-5c43af-779c6457cd-hmdjn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-5c43af-779c6457cd-hmdjn to ip-10-0-128-234.ec2.internal

openshift-ingress

e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m to ip-10-0-128-234.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-56968c8f6 from 0 to 1

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x14)

openshift-ingress

replicaset-controller

router-default-56968c8f6

FailedCreate

Error creating: pods "router-default-56968c8f6-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x16)

openshift-ingress

replicaset-controller

router-default-56968c8f6

FailedCreate

Error creating: pods "router-default-56968c8f6-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-56968c8f6

SuccessfulCreate

Created pod: router-default-56968c8f6-wb7q7
(x6)

openshift-ingress

kubelet

router-default-56968c8f6-wb7q7

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x6)

openshift-ingress

kubelet

router-default-56968c8f6-wb7q7

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

kubelet

router-default-56968c8f6-wb7q7

Created

Created container: router

openshift-ingress

kubelet

router-default-56968c8f6-wb7q7

Started

Started container router

openshift-ingress

kubelet

router-default-56968c8f6-wb7q7

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:da130d90f0bffd5c5876c94544c91b2a1be0d23ce2747ddfeafe88e03ee7d8d1" already present on machine

openshift-ingress

multus

router-default-56968c8f6-wb7q7

AddedInterface

Add eth0 [10.132.0.18/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-79c7cbc6bf-jxtdf

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-79c7cbc6bf from 0 to 2

openshift-ingress

replicaset-controller

kube-auth-proxy-79c7cbc6bf

SuccessfulCreate

Created pod: kube-auth-proxy-79c7cbc6bf-jxtdf

openshift-ingress

replicaset-controller

kube-auth-proxy-79c7cbc6bf

SuccessfulCreate

Created pod: kube-auth-proxy-79c7cbc6bf-2ctcp

openshift-ingress

kubelet

kube-auth-proxy-79c7cbc6bf-2ctcp

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-79c7cbc6bf-2ctcp

AddedInterface

Add eth0 [10.134.0.17/23] from ovn-kubernetes
(x3)

openshift-ingress

replicaset-controller

kube-auth-proxy-79c7cbc6bf

FailedCreate

Error creating: pods "kube-auth-proxy-79c7cbc6bf-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

multus

kube-auth-proxy-79c7cbc6bf-jxtdf

AddedInterface

Add eth0 [10.133.0.29/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-w8nmv

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-w8nmv

AddedInterface

Add eth0 [10.134.0.18/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-w8nmv

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

kube-auth-proxy-79c7cbc6bf-jxtdf

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.992s (2.992s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-79c7cbc6bf-2ctcp

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 3.05s (3.05s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-79c7cbc6bf-jxtdf

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-79c7cbc6bf-2ctcp

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-79c7cbc6bf-jxtdf

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-79c7cbc6bf-2ctcp

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-w8nmv

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-w8nmv

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-w8nmv

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.549s (3.549s including waiting). Image size: 181126104 bytes.

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-6745bb66bc

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-6745bb66bcflwcm

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-92vmv

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-6745bb66bc from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-w8nmv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-w8nmv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-92vmv

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcflwcm

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-6745bb66bcflwcm

AddedInterface

Add eth0 [10.132.0.29/23] from ovn-kubernetes

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-92vmv

AddedInterface

Add eth0 [10.134.0.19/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-92vmv

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-92vmv

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-92vmv

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.432s (2.432s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-92vmv

Unhealthy

Startup probe failed: Get "http://10.134.0.19:15021/healthz/ready": dial tcp 10.134.0.19:15021: connect: connection refused

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-92vmv

ProbeError

Startup probe error: Get "http://10.134.0.19:15021/healthz/ready": dial tcp 10.134.0.19:15021: connect: connection refused body:

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcflwcm

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.852s (2.852s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcflwcm

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcflwcm

Created

Created container: istio-proxy

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled down replica set data-science-gateway-data-science-gateway-class-6745bb66bc from 1 to 0

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-6745bb66bc

SuccessfulDelete

Deleted pod: data-science-gateway-data-science-gateway-class-6745bb66bcflwcm

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcflwcm

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcflwcm

Unhealthy

Startup probe failed: Get "http://10.132.0.29:15021/healthz/ready": dial tcp 10.132.0.29:15021: connect: connection refused
(x3)

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcflwcm

ProbeError

Startup probe error: Get "http://10.132.0.29:15021/healthz/ready": dial tcp 10.132.0.29:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-jz98w

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-jz98w

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-jz98w

AddedInterface

Add eth0 [10.132.0.31/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-jz98w

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-jz98w

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-jz98w

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.36s (2.36s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-jz98w

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-jz98w

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-w8nmv

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-w8nmv

Killing

Stopping container discovery

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-b42t5

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-b42t5

AddedInterface

Add eth0 [10.132.0.33/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-45qrv

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-pnm4r

openshift-ingress

multus

payload-processing-5b54b7fbb7-pnm4r

AddedInterface

Add eth0 [10.132.0.36/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-pnm4r

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-45qrv

AddedInterface

Add eth0 [10.132.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-45qrv

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-pnm4r

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-45qrv

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-pnm4r

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-pnm4r

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 3.121s (3.121s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-45qrv

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-45qrv

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 3.16s (3.16s including waiting). Image size: 166449337 bytes.
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-b42t5

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-b42t5

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-b42t5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-b42t5

ProbeError

Startup probe error: Get "http://10.132.0.33:15021/healthz/ready": dial tcp 10.132.0.33:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-b42t5

Unhealthy

Startup probe failed: Get "http://10.132.0.33:15021/healthz/ready": dial tcp 10.132.0.33:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-inf-a-600197

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-600197

openshift-ingress

deployment-controller

e2e-inf-a-600197-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-600197-openshift-default-7574dcc9b4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-600197-openshift-default-7574dcc9b4

SuccessfulCreate

Created pod: e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr

openshift-ingress

multus

e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr

AddedInterface

Add eth0 [10.132.0.39/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-600197

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-600197-6f99b5676c from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-a-600197-6f99b5676c-bfjf9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-a-600197-6f99b5676c-bfjf9

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-600197-6f99b5676c-bfjf9

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-600197-6f99b5676c

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-600197-6f99b5676c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-600197: serviceaccount "payload-processing-e2e-inf-a-600197" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-600197-6f99b5676c

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-600197-6f99b5676c-bfjf9

openshift-ingress

multus

payload-processing-e2e-inf-a-600197-6f99b5676c-bfjf9

AddedInterface

Add eth0 [10.132.0.40/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-600197-84567bdfb6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-600197-84567bdfb6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-600197: serviceaccount "payload-processing-e2e-inf-a-600197" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-600197-84567bdfb6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-600197-84567bdfb6-v7wqd

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-600197

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-600197-84567bdfb6 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-600197-84567bdfb6-v7wqd

AddedInterface

Add eth0 [10.132.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-600197-84567bdfb6-v7wqd

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-600197-84567bdfb6-v7wqd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-600197-84567bdfb6-v7wqd

Started

Started container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-ait-ad4f3b47

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-ad4f3b47

openshift-ingress

deployment-controller

e2e-ait-ad4f3b47-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-ad4f3b47-openshift-default-59b786598b from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-ad4f3b47-openshift-default-59b786598b

SuccessfulCreate

Created pod: e2e-ait-ad4f3b47-openshift-default-59b786598b-4l9fr

openshift-ingress

multus

e2e-ait-ad4f3b47-openshift-default-59b786598b-4l9fr

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes

openshift-ingress

multus

e2e-autores-d24d4c-openshift-default-7986f99c8d-t2tlq

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-autores-d24d4c-openshift-default-7986f99c8d

SuccessfulCreate

Created pod: e2e-autores-d24d4c-openshift-default-7986f99c8d-t2tlq

openshift-ingress

deployment-controller

e2e-autores-d24d4c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-d24d4c-openshift-default-7986f99c8d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-autores-d24d4c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-d24d4c
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-ad4f3b47-6cbd778fcd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-ad4f3b47-6cbd778fcd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-ad4f3b47: serviceaccount "payload-processing-e2e-ait-ad4f3b47" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-ad4f3b47-9cdfc69df

SuccessfulCreate

Created pod: payload-processing-e2e-ait-ad4f3b47-9cdfc69df-q56rn

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-ad4f3b47-6cbd778fcd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-ad4f3b47-6cbd778fcd-gktnt

openshift-ingress

deployment-controller

payload-processing-e2e-ait-ad4f3b47

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-ad4f3b47-9cdfc69df from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-ad4f3b47

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-ad4f3b47-6cbd778fcd from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-ad4f3b47-9cdfc69df

FailedCreate

Error creating: pods "payload-processing-e2e-ait-ad4f3b47-9cdfc69df-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-ad4f3b47: serviceaccount "payload-processing-e2e-ait-ad4f3b47" not found

openshift-ingress

kubelet

payload-processing-e2e-ait-ad4f3b47-9cdfc69df-q56rn

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-ad4f3b47-9cdfc69df-q56rn

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-ait-ad4f3b47-9cdfc69df-q56rn

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ait-ad4f3b47-6cbd778fcd-gktnt

AddedInterface

Add eth0 [10.132.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-ad4f3b47-6cbd778fcd-gktnt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-ad4f3b47-6cbd778fcd-gktnt

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-ad4f3b47-6cbd778fcd-gktnt

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-ad4f3b47-9cdfc69df-q56rn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-autores-d24d4c-65b655c8c-cllhw

Created

Created container: payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-autores-d24d4c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-d24d4c-65b655c8c from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-autores-d24d4c-65b655c8c-cllhw

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-d24d4c-65b655c8c

FailedCreate

Error creating: pods "payload-processing-e2e-autores-d24d4c-65b655c8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-d24d4c: serviceaccount "payload-processing-e2e-autores-d24d4c" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-d24d4c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-d24d4c-7f984fcdd6 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-autores-d24d4c-65b655c8c-cllhw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-d24d4c-65b655c8c

SuccessfulCreate

Created pod: payload-processing-e2e-autores-d24d4c-65b655c8c-cllhw

openshift-ingress

multus

payload-pre-processing-e2e-autores-d24d4c-7f984fcdd6-64qbq

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-d24d4c-7f984fcdd6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-d24d4c-7f984fcdd6-64qbq
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-d24d4c-7f984fcdd6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-d24d4c-7f984fcdd6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-d24d4c: serviceaccount "payload-processing-e2e-autores-d24d4c" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-d24d4c-7f984fcdd6-64qbq

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-e2e-autores-d24d4c-65b655c8c-cllhw

AddedInterface

Add eth0 [10.132.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-d24d4c-7f984fcdd6-64qbq

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-d24d4c-7f984fcdd6-64qbq

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.22s (2.22s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-d24d4c-7f984fcdd6-64qbq

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-ait-ad4f3b47-openshift-default-59b786598b-4l9fr

Unhealthy

Readiness probe failed: Get "http://10.134.0.39:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ait-ad4f3b47-openshift-default-59b786598b-4l9fr

ProbeError

Readiness probe error: Get "http://10.134.0.39:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-autores-d24d4c-openshift-default-7986f99c8d-t2tlq

ProbeError

Readiness probe error: Get "http://10.134.0.40:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-autores-d24d4c-openshift-default-7986f99c8d-t2tlq

Unhealthy

Readiness probe failed: Get "http://10.134.0.40:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x5)

openshift-ingress

kubelet

e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr

Unhealthy

Startup probe failed: Get "http://10.132.0.39:15021/healthz/ready": dial tcp 10.132.0.39:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr

ProbeError

Startup probe error: Get "http://10.132.0.39:15021/healthz/ready": dial tcp 10.132.0.39:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-inf-b-8ee208

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-8ee208

openshift-ingress

deployment-controller

e2e-inf-b-8ee208-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-8ee208-openshift-default-76f8b95d56 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-8ee208-openshift-default-76f8b95d56

SuccessfulCreate

Created pod: e2e-inf-b-8ee208-openshift-default-76f8b95d56-n5g5w
(x2)

openshift-ingress

kubelet

e2e-ait-ad4f3b47-openshift-default-59b786598b-4l9fr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-ad4f3b47-openshift-default-59b786598b-4l9fr

Created

Created container: istio-proxy

openshift-ingress

multus

e2e-inf-b-8ee208-openshift-default-76f8b95d56-n5g5w

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ait-ad4f3b47-openshift-default-59b786598b-4l9fr

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-d24d4c-openshift-default-7986f99c8d-t2tlq

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-d24d4c-openshift-default-7986f99c8d-t2tlq

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-d24d4c-openshift-default-7986f99c8d-t2tlq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-8ee208-575799d9c9

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-8ee208-575799d9c9-mbtcs

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-8ee208

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-8ee208-575799d9c9 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-b-8ee208-575799d9c9-mbtcs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-inf-b-8ee208-575799d9c9-mbtcs

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-8ee208-556c8c4c9d-h6dhn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-8ee208-556c8c4c9d-h6dhn

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-8ee208-556c8c4c9d-h6dhn

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-8ee208-556c8c4c9d-h6dhn

Started

Started container payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-8ee208-556c8c4c9d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-8ee208-556c8c4c9d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-8ee208: serviceaccount "payload-processing-e2e-inf-b-8ee208" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-8ee208-556c8c4c9d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-8ee208-556c8c4c9d-h6dhn

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-8ee208

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-8ee208-556c8c4c9d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-8ee208-575799d9c9

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-8ee208-575799d9c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-8ee208: serviceaccount "payload-processing-e2e-inf-b-8ee208" not found

openshift-ingress

kubelet

payload-processing-e2e-inf-b-8ee208-575799d9c9-mbtcs

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-8ee208-575799d9c9-mbtcs

Created

Created container: payload-processing
(x5)

openshift-ingress

kubelet

e2e-autores-d24d4c-openshift-default-7986f99c8d-t2tlq

Unhealthy

Startup probe failed: Get "http://10.134.0.40:15021/healthz/ready": dial tcp 10.134.0.40:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-autores-d24d4c-openshift-default-7986f99c8d-t2tlq

ProbeError

Startup probe error: Get "http://10.134.0.40:15021/healthz/ready": dial tcp 10.134.0.40:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ait-ad4f3b47-openshift-default-59b786598b-4l9fr

ProbeError

Startup probe error: Get "http://10.134.0.39:15021/healthz/ready": dial tcp 10.134.0.39:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ait-ad4f3b47-openshift-default-59b786598b-4l9fr

Unhealthy

Startup probe failed: Get "http://10.134.0.39:15021/healthz/ready": dial tcp 10.134.0.39:15021: connect: connection refused

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ait-ad4f3b47

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ait-ad4f3b47: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ait-ad4f3b47": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ait-ad4f3b47, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 39f1502d-8e11-4e6e-ad51-0b6a4f2e63b1, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-ad4f3b47-6cbd778fcd-gktnt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-ad4f3b47-openshift-default-59b786598b-4l9fr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ait-ad4f3b47-9cdfc69df-q56rn

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-inf-b-8ee208-openshift-default-76f8b95d56-n5g5w

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-8ee208-openshift-default-76f8b95d56-n5g5w

Started

Started container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-migrate-d320da1d-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-d320da1d-gw

openshift-ingress

deployment-controller

e2e-migrate-d320da1d-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b from 0 to 1

openshift-ingress

replicaset-controller

e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b

SuccessfulCreate

Created pod: e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh
(x2)

openshift-ingress

kubelet

e2e-inf-b-8ee208-openshift-default-76f8b95d56-n5g5w

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

GatewayAuthBootstrap

e2e-migrate-d320da1d-gw

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-migrate-d320da1d-gw-authn-ssl: envoyfilters.networking.istio.io "e2e-migrate-d320da1d-gw-authn-ssl" already exists

openshift-ingress

multus

e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-d320da1d-54c956c678-h7997

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-d320da1d-54c956c678

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-d320da1d-54c956c678-h7997

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-d320da1d-bc558d6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-d320da1d-bc558d6-xmhxd
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-d320da1d-bc558d6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-d320da1d-bc558d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-d320da1d: serviceaccount "payload-processing-e2e-migrate-d320da1d" not found

openshift-ingress

multus

payload-processing-e2e-migrate-d320da1d-54c956c678-h7997

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-d320da1d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-d320da1d-bc558d6 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-migrate-d320da1d-54c956c678-h7997

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-d320da1d-54c956c678-h7997

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-d320da1d-54c956c678

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-d320da1d-54c956c678-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-d320da1d: serviceaccount "payload-processing-e2e-migrate-d320da1d" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-d320da1d-bc558d6-xmhxd

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-d320da1d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-d320da1d-54c956c678 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-d320da1d-bc558d6-xmhxd

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-d320da1d-bc558d6-xmhxd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-migrate-d320da1d-bc558d6-xmhxd

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-inf-b-8ee208-openshift-default-76f8b95d56-n5g5w

ProbeError

Startup probe error: Get "http://10.134.0.42:15021/healthz/ready": dial tcp 10.134.0.42:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-b-8ee208-openshift-default-76f8b95d56-n5g5w

Unhealthy

Startup probe failed: Get "http://10.134.0.42:15021/healthz/ready": dial tcp 10.134.0.42:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh

ProbeError

Startup probe error: Get "http://10.132.0.47:15021/healthz/ready": dial tcp 10.132.0.47:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh

Unhealthy

Startup probe failed: Get "http://10.132.0.47:15021/healthz/ready": dial tcp 10.132.0.47:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-d320da1d-bc558d6-xmhxd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-d320da1d-54c956c678-h7997

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ait-49ac64b7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-49ac64b7

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-migrate-d320da1d

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-migrate-d320da1d: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-migrate-d320da1d": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-migrate-d320da1d, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 9b7d1880-6b08-419f-8c77-65d1ecfe86c6, UID in object meta:

openshift-ingress

multus

e2e-ait-49ac64b7-openshift-default-7976bbd5fb-bh77l

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ait-49ac64b7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-49ac64b7-openshift-default-7976bbd5fb from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-49ac64b7-openshift-default-7976bbd5fb

SuccessfulCreate

Created pod: e2e-ait-49ac64b7-openshift-default-7976bbd5fb-bh77l

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-49ac64b7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-49ac64b7-7f946fdb8b from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ait-49ac64b7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-49ac64b7-669c84c4f9 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-49ac64b7-669c84c4f9

SuccessfulCreate

Created pod: payload-processing-e2e-ait-49ac64b7-669c84c4f9-pt5kp

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-49ac64b7-7f946fdb8b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-49ac64b7-7f946fdb8b-dnzmj
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-49ac64b7-669c84c4f9

FailedCreate

Error creating: pods "payload-processing-e2e-ait-49ac64b7-669c84c4f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-49ac64b7: serviceaccount "payload-processing-e2e-ait-49ac64b7" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-49ac64b7-7f946fdb8b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-49ac64b7-7f946fdb8b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-49ac64b7: serviceaccount "payload-processing-e2e-ait-49ac64b7" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-49ac64b7-7f946fdb8b-dnzmj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-49ac64b7-669c84c4f9-pt5kp

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-49ac64b7-669c84c4f9-pt5kp

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-49ac64b7-7f946fdb8b-dnzmj

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-49ac64b7-7f946fdb8b-dnzmj

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-49ac64b7-7f946fdb8b-dnzmj

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-49ac64b7-669c84c4f9-pt5kp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-49ac64b7-669c84c4f9-pt5kp

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ait-49ac64b7-openshift-default-7976bbd5fb-bh77l

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-49ac64b7-openshift-default-7976bbd5fb-bh77l

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-49ac64b7-openshift-default-7976bbd5fb-bh77l

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ait-49ac64b7-openshift-default-7976bbd5fb-bh77l

Unhealthy

Startup probe failed: Get "http://10.134.0.45:15021/healthz/ready": dial tcp 10.134.0.45:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-49ac64b7-openshift-default-7976bbd5fb-bh77l

ProbeError

Startup probe error: Get "http://10.134.0.45:15021/healthz/ready": dial tcp 10.134.0.45:15021: connect: connection refused body:

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ait-49ac64b7

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ait-49ac64b7: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ait-49ac64b7": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ait-49ac64b7, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 79d301bc-b012-43ac-b83a-b53707446979, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-ait-49ac64b7-669c84c4f9-pt5kp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-49ac64b7-7f946fdb8b-dnzmj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-49ac64b7-openshift-default-7976bbd5fb-bh77l

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-derive-0245a1e4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-0245a1e4-openshift-default-f8f5c8844 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-derive-0245a1e4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-0245a1e4

openshift-ingress

replicaset-controller

e2e-derive-0245a1e4-openshift-default-f8f5c8844

SuccessfulCreate

Created pod: e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5

openshift-ingress

multus

e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-0245a1e4-d777f6486

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-0245a1e4-d777f6486-822l7

openshift-ingress

deployment-controller

payload-processing-e2e-derive-0245a1e4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-0245a1e4-77fd4944f from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-0245a1e4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-0245a1e4-d777f6486 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-0245a1e4-77fd4944f

SuccessfulCreate

Created pod: payload-processing-e2e-derive-0245a1e4-77fd4944f-vgz8z
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-0245a1e4-d777f6486

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-0245a1e4-d777f6486-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-0245a1e4: serviceaccount "payload-processing-e2e-derive-0245a1e4" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-0245a1e4-77fd4944f

FailedCreate

Error creating: pods "payload-processing-e2e-derive-0245a1e4-77fd4944f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-0245a1e4: serviceaccount "payload-processing-e2e-derive-0245a1e4" not found

openshift-ingress

kubelet

payload-processing-e2e-derive-0245a1e4-77fd4944f-vgz8z

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-0245a1e4-77fd4944f-vgz8z

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-0245a1e4-d777f6486-822l7

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-0245a1e4-d777f6486-822l7

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-0245a1e4-d777f6486-822l7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-derive-0245a1e4-d777f6486-822l7

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-derive-0245a1e4-77fd4944f-vgz8z

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-0245a1e4-77fd4944f-vgz8z

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5

ProbeError

Startup probe error: Get "http://10.132.0.52:15021/healthz/ready": dial tcp 10.132.0.52:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5

Unhealthy

Startup probe failed: Get "http://10.132.0.52:15021/healthz/ready": dial tcp 10.132.0.52:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-derive-0245a1e4-77fd4944f-vgz8z

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-0245a1e4-d777f6486-822l7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5

Killing

Stopping container istio-proxy

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-autores-d24d4c

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-autores-d24d4c: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-autores-d24d4c": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-autores-d24d4c, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 6be5e399-ffa8-45d5-9c87-50567649d9b5, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-autores-d24d4c-65b655c8c-cllhw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-d24d4c-7f984fcdd6-64qbq

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-explicit-345a2c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-345a2c

openshift-ingress

kubelet

e2e-autores-d24d4c-openshift-default-7986f99c8d-t2tlq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-autores-d24d4c-openshift-default-7986f99c8d-t2tlq

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

e2e-explicit-345a2c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-345a2c-openshift-default-5b9cf7878d from 0 to 1

openshift-ingress

replicaset-controller

e2e-explicit-345a2c-openshift-default-5b9cf7878d

SuccessfulCreate

Created pod: e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m

openshift-ingress

multus

e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-autores-d24d4c-openshift-default-7986f99c8d-t2tlq

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-345a2c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-345a2c-7cfd79d666 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-345a2c-7cfd79d666

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-345a2c-7cfd79d666-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-345a2c: serviceaccount "payload-processing-e2e-explicit-345a2c" not found

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-345a2c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-345a2c-7868b8974f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-345a2c-7868b8974f

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-345a2c-7868b8974f-gvqgb
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-345a2c-7868b8974f

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-345a2c-7868b8974f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-345a2c: serviceaccount "payload-processing-e2e-explicit-345a2c" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-345a2c-7cfd79d666

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-345a2c-7cfd79d666-bndv6

openshift-ingress

kubelet

payload-processing-e2e-explicit-345a2c-7868b8974f-gvqgb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-explicit-345a2c-7868b8974f-gvqgb

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-345a2c-7cfd79d666-bndv6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-explicit-345a2c-7cfd79d666-bndv6

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-345a2c-7cfd79d666-bndv6

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-explicit-345a2c-7868b8974f-gvqgb

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-345a2c-7868b8974f-gvqgb

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-345a2c-7cfd79d666-bndv6

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m

ProbeError

Startup probe error: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m

Unhealthy

Startup probe failed: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-345a2c-7cfd79d666-bndv6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-345a2c-7868b8974f-gvqgb

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-mt-e25a5e89

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-e25a5e89

openshift-ingress

replicaset-controller

e2e-mt-e25a5e89-openshift-default-678b5bf964

SuccessfulCreate

Created pod: e2e-mt-e25a5e89-openshift-default-678b5bf964-j2n2k

openshift-ingress

deployment-controller

e2e-mt-e25a5e89-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-e25a5e89-openshift-default-678b5bf964 from 0 to 1

openshift-ingress

multus

e2e-mt-e25a5e89-openshift-default-678b5bf964-j2n2k

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-e25a5e89

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-e25a5e89-698f5d6b54 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-mt-e25a5e89

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-e25a5e89-8957d4cd9 from 0 to 1

openshift-ingress

deployment-controller

e2e-noten-651c34-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-651c34-openshift-default-7777797c4d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-e25a5e89-8957d4cd9

FailedCreate

Error creating: pods "payload-processing-e2e-mt-e25a5e89-8957d4cd9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-e25a5e89: serviceaccount "payload-processing-e2e-mt-e25a5e89" not found

openshift-ingress

multus

payload-processing-e2e-mt-e25a5e89-8957d4cd9-plzll

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-mt-e25a5e89-8957d4cd9-plzll

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-e25a5e89-8957d4cd9-plzll

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-e25a5e89-8957d4cd9-plzll

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-e25a5e89-698f5d6b54

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-e25a5e89-698f5d6b54-kn2tp
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-e25a5e89-698f5d6b54

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-e25a5e89-698f5d6b54-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-e25a5e89: serviceaccount "payload-processing-e2e-mt-e25a5e89" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-e25a5e89-8957d4cd9

SuccessfulCreate

Created pod: payload-processing-e2e-mt-e25a5e89-8957d4cd9-plzll

openshift-ingress

multus

payload-pre-processing-e2e-mt-e25a5e89-698f5d6b54-kn2tp

AddedInterface

Add eth0 [10.133.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-e25a5e89-698f5d6b54-kn2tp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

e2e-noten-651c34-openshift-default-7777797c4d

SuccessfulCreate

Created pod: e2e-noten-651c34-openshift-default-7777797c4d-j98l5

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-e25a5e89-698f5d6b54-kn2tp

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-e25a5e89-698f5d6b54-kn2tp

Started

Started container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-noten-651c34

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-651c34

openshift-ingress

kubelet

e2e-noten-651c34-openshift-default-7777797c4d-j98l5

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-noten-651c34-openshift-default-7777797c4d-j98l5

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-noten-651c34-openshift-default-7777797c4d-j98l5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

multus

e2e-noten-651c34-openshift-default-7777797c4d-j98l5

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-mt-e25a5e89-openshift-default-678b5bf964-j2n2k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-e25a5e89-openshift-default-678b5bf964-j2n2k

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-e25a5e89-openshift-default-678b5bf964-j2n2k

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-e25a5e89-openshift-default-678b5bf964-j2n2k

ProbeError

Startup probe error: Get "http://10.134.0.51:15021/healthz/ready": dial tcp 10.134.0.51:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-e25a5e89-openshift-default-678b5bf964-j2n2k

Unhealthy

Startup probe failed: Get "http://10.134.0.51:15021/healthz/ready": dial tcp 10.134.0.51:15021: connect: connection refused

openshift-ingress

kubelet

e2e-noten-651c34-openshift-default-7777797c4d-j98l5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-e25a5e89-698f5d6b54-kn2tp

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-mt-e25a5e89

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-mt-e25a5e89: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-mt-e25a5e89": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-mt-e25a5e89, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 13b27ff4-2dab-491c-b0fa-a4ef0897eb76, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-mt-e25a5e89-8957d4cd9-plzll

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-inf-a-600197

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-inf-a-600197: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-inf-a-600197": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-inf-a-600197, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 816a516a-43ef-4df2-8993-ca9a1eae486b, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-inf-a-600197-6f99b5676c-bfjf9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-600197-84567bdfb6-v7wqd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-e25a5e89-openshift-default-678b5bf964-j2n2k

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-8ecc1f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-8ecc1f

openshift-ingress

deployment-controller

e2e-shared-a-w2-8ecc1f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd

SuccessfulCreate

Created pod: e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw

openshift-ingress

kubelet

payload-processing-e2e-inf-b-8ee208-575799d9c9-mbtcs

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-8ee208-556c8c4c9d-h6dhn

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-inf-b-8ee208

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-inf-b-8ee208: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-inf-b-8ee208": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-inf-b-8ee208, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 0d0f5e18-39c7-48f2-b618-d150b543fad1, UID in object meta:

openshift-ingress

multus

e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw

AddedInterface

Add eth0 [10.132.0.62/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-8ecc1f-5bf6bb8498

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-8ecc1f-5bf6bb8498-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-8ecc1f: serviceaccount "payload-processing-e2e-shared-a-w2-8ecc1f" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-8ecc1f-5bf6bb8498

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-8ecc1f-5bf6bb8498-mrslb

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-8ecc1f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-8ecc1f-5bf6bb8498 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-8ecc1f-856d9cc485

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-8ecc1f-856d9cc485-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-8ecc1f: serviceaccount "payload-processing-e2e-shared-a-w2-8ecc1f" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-8ecc1f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-8ecc1f-856d9cc485 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-8ecc1f-856d9cc485

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-8ecc1f-856d9cc485-tsbxf

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-8ecc1f-5bf6bb8498-mrslb

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-8ecc1f-856d9cc485-tsbxf

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-8ecc1f-856d9cc485-tsbxf

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-8ecc1f-856d9cc485-tsbxf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-8ecc1f-856d9cc485-tsbxf

AddedInterface

Add eth0 [10.132.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-8ecc1f-5bf6bb8498-mrslb

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-8ecc1f-5bf6bb8498-mrslb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-8ecc1f-5bf6bb8498-mrslb

AddedInterface

Add eth0 [10.132.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-8ee208-openshift-default-76f8b95d56-n5g5w

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk

AddedInterface

Add eth0 [10.132.0.65/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-7bf16f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-7bf16f

openshift-ingress

deployment-controller

e2e-shared-a-w3-7bf16f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6

SuccessfulCreate

Created pod: e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-7bf16f-7bd5896978

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-7bf16f-7bd5896978-hngjp
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-7bf16f-5c665dfdc

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-7bf16f-5c665dfdc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-7bf16f: serviceaccount "payload-processing-e2e-shared-a-w3-7bf16f" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-7bf16f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-7bf16f-7bd5896978 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-7bf16f-7bd5896978

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-7bf16f-7bd5896978-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-7bf16f: serviceaccount "payload-processing-e2e-shared-a-w3-7bf16f" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-7bf16f-7bd5896978-hngjp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-7bf16f-7bd5896978-hngjp

AddedInterface

Add eth0 [10.132.0.66/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-7bf16f-5c665dfdc

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-7bf16f-5c665dfdc-npdbf

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-7bf16f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-7bf16f-5c665dfdc from 0 to 1

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-7bf16f-5c665dfdc-npdbf

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-7bf16f-5c665dfdc-npdbf

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-7bf16f-7bd5896978-hngjp

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-7bf16f-7bd5896978-hngjp

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-7bf16f-5c665dfdc-npdbf

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-7bf16f-5c665dfdc-npdbf

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.562s (1.562s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-7bf16f-5c665dfdc-npdbf

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw

Unhealthy

Readiness probe failed: Get "http://10.132.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw

ProbeError

Readiness probe error: Get "http://10.132.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw

Unhealthy

Startup probe failed: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw

ProbeError

Startup probe error: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk

Unhealthy

Readiness probe failed: Get "http://10.132.0.65:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk

ProbeError

Readiness probe error: Get "http://10.132.0.65:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk

Started

Started container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-b-w2-fc06d4-openshift-default-6bd66998d6

SuccessfulCreate

Created pod: e2e-shared-b-w2-fc06d4-openshift-default-6bd66998d6-fmxvc

openshift-ingress

multus

e2e-shared-b-w2-fc06d4-openshift-default-6bd66998d6-fmxvc

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-b-w2-fc06d4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-fc06d4-openshift-default-6bd66998d6 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-fc06d4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-fc06d4
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk

Unhealthy

Startup probe failed: Get "http://10.132.0.65:15021/healthz/ready": dial tcp 10.132.0.65:15021: connect: connection refused
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-fc06d4-749c468585

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-fc06d4-749c468585-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-fc06d4: serviceaccount "payload-processing-e2e-shared-b-w2-fc06d4" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-fc06d4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-fc06d4-5c7c7b997d from 0 to 1
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk

ProbeError

Startup probe error: Get "http://10.132.0.65:15021/healthz/ready": dial tcp 10.132.0.65:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-fc06d4-5c7c7b997d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-fc06d4-5c7c7b997d-6mxxs
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-fc06d4-5c7c7b997d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-fc06d4-5c7c7b997d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-fc06d4: serviceaccount "payload-processing-e2e-shared-b-w2-fc06d4" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-fc06d4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-fc06d4-749c468585 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-fc06d4-749c468585

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-fc06d4-749c468585-hf8jn

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-fc06d4-749c468585-hf8jn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-fc06d4-749c468585-hf8jn

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-fc06d4-749c468585-hf8jn

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-fc06d4-749c468585-hf8jn

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-fc06d4-5c7c7b997d-6mxxs

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-fc06d4-5c7c7b997d-6mxxs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-fc06d4-5c7c7b997d-6mxxs

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-fc06d4-5c7c7b997d-6mxxs

Started

Started container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-59dc59

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-59dc59

openshift-ingress

replicaset-controller

e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4

SuccessfulCreate

Created pod: e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg

openshift-ingress

deployment-controller

e2e-shared-b-w3-59dc59-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4 from 0 to 1

openshift-ingress

multus

e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg

AddedInterface

Add eth0 [10.132.0.67/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-59dc59-dc7f8ff87

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-59dc59-dc7f8ff87-x7w5c
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-59dc59-dc7f8ff87

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-59dc59-dc7f8ff87-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-59dc59: serviceaccount "payload-processing-e2e-shared-b-w3-59dc59" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-59dc59

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-59dc59-dc7f8ff87 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-59dc59-dccf565d6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-59dc59-dccf565d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-59dc59: serviceaccount "payload-processing-e2e-shared-b-w3-59dc59" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-59dc59

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-59dc59-dccf565d6 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-59dc59-dccf565d6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-59dc59-dccf565d6-tcqjx

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-59dc59-dccf565d6-tcqjx

AddedInterface

Add eth0 [10.132.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-59dc59-dccf565d6-tcqjx

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-59dc59-dccf565d6-tcqjx

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-59dc59-dc7f8ff87-x7w5c

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-59dc59-dc7f8ff87-x7w5c

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-59dc59-dc7f8ff87-x7w5c

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-59dc59-dc7f8ff87-x7w5c

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-59dc59-dccf565d6-tcqjx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-fc06d4-openshift-default-6bd66998d6-fmxvc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-fc06d4-openshift-default-6bd66998d6-fmxvc

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-fc06d4-openshift-default-6bd66998d6-fmxvc

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-fc06d4-openshift-default-6bd66998d6-fmxvc

Unhealthy

Startup probe failed: Get "http://10.134.0.54:15021/healthz/ready": dial tcp 10.134.0.54:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-fc06d4-openshift-default-6bd66998d6-fmxvc

ProbeError

Startup probe error: Get "http://10.134.0.54:15021/healthz/ready": dial tcp 10.134.0.54:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg

Unhealthy

Startup probe failed: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg

ProbeError

Startup probe error: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-mt-25792506-openshift-default-564b5b8588

SuccessfulCreate

Created pod: e2e-mt-25792506-openshift-default-564b5b8588-65lvx

openshift-ingress

deployment-controller

e2e-mt-25792506-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-25792506-openshift-default-564b5b8588 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-25792506

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-25792506

openshift-ingress

multus

e2e-mt-25792506-openshift-default-564b5b8588-65lvx

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-25792506-b84c5b58

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-25792506-b84c5b58-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-25792506: serviceaccount "payload-processing-e2e-mt-25792506" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-25792506-7594f8f6bf

FailedCreate

Error creating: pods "payload-processing-e2e-mt-25792506-7594f8f6bf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-25792506: serviceaccount "payload-processing-e2e-mt-25792506" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-25792506

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-25792506-b84c5b58 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-25792506-b84c5b58

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-25792506-b84c5b58-g674h

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-25792506-7594f8f6bf

SuccessfulCreate

Created pod: payload-processing-e2e-mt-25792506-7594f8f6bf-8djsd

openshift-ingress

deployment-controller

payload-processing-e2e-mt-25792506

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-25792506-7594f8f6bf from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-25792506-b84c5b58-g674h

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-mt-25792506-7594f8f6bf-8djsd

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-25792506-b84c5b58-g674h

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-25792506-b84c5b58-g674h

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-25792506-b84c5b58-g674h

AddedInterface

Add eth0 [10.132.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-25792506-7594f8f6bf-8djsd

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-25792506-7594f8f6bf-8djsd

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-25792506-7594f8f6bf-8djsd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-25792506-openshift-default-564b5b8588-65lvx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-25792506-openshift-default-564b5b8588-65lvx

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-25792506-openshift-default-564b5b8588-65lvx

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-25792506-openshift-default-564b5b8588-65lvx

Unhealthy

Startup probe failed: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-25792506-openshift-default-564b5b8588-65lvx

ProbeError

Startup probe error: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-mt-25792506-7594f8f6bf-8djsd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-25792506-b84c5b58-g674h

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-25792506-openshift-default-564b5b8588-65lvx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-25792506-openshift-default-564b5b8588-65lvx

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-25792506-openshift-default-564b5b8588-65lvx

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

multus

e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v

AddedInterface

Add eth0 [10.132.0.71/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-api-a-1d2af2-openshift-default-6897d8b696

SuccessfulCreate

Created pod: e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v

openshift-ingress

deployment-controller

e2e-api-a-1d2af2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-1d2af2-openshift-default-6897d8b696 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-1d2af2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-1d2af2

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-1d2af2-6f59cfd574

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-1d2af2-6f59cfd574-csshm

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-1d2af2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-1d2af2-6f59cfd574 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-1d2af2-6f59cfd574

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-1d2af2-6f59cfd574-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-1d2af2: serviceaccount "payload-processing-e2e-api-a-1d2af2" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-1d2af2-577cd885b7

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-1d2af2-577cd885b7-8tl5x
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-1d2af2-577cd885b7

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-1d2af2-577cd885b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-1d2af2: serviceaccount "payload-processing-e2e-api-a-1d2af2" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-1d2af2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-1d2af2-577cd885b7 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-1d2af2-6f59cfd574-csshm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-a-1d2af2-577cd885b7-8tl5x

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-a-1d2af2-6f59cfd574-csshm

AddedInterface

Add eth0 [10.132.0.72/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-api-a-1d2af2-577cd885b7-8tl5x

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-1d2af2-577cd885b7-8tl5x

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-1d2af2-6f59cfd574-csshm

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-1d2af2-6f59cfd574-csshm

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-1d2af2-577cd885b7-8tl5x

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v

Started

Started container istio-proxy

openshift-ingress

replicaset-controller

e2e-api-b-4ba551-openshift-default-66fc7d6c58

SuccessfulCreate

Created pod: e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7

openshift-ingress

deployment-controller

e2e-api-b-4ba551-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-4ba551-openshift-default-66fc7d6c58 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-4ba551

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-4ba551

openshift-ingress

multus

e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7

AddedInterface

Add eth0 [10.132.0.73/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v

ProbeError

Startup probe error: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v

Unhealthy

Startup probe failed: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-4ba551-848fb5d858-b7km7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-4ba551

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-4ba551-bc6c77477 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-4ba551-848fb5d858

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-4ba551-848fb5d858-b7km7

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-4ba551

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-4ba551-848fb5d858 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-4ba551-848fb5d858

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-4ba551-848fb5d858-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-4ba551: serviceaccount "payload-processing-e2e-api-b-4ba551" not found

openshift-ingress

multus

payload-processing-e2e-api-b-4ba551-bc6c77477-b7g7b

AddedInterface

Add eth0 [10.132.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-4ba551-848fb5d858-b7km7

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-4ba551-848fb5d858-b7km7

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-b-4ba551-848fb5d858-b7km7

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-4ba551-bc6c77477-b7g7b

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-b-4ba551-bc6c77477-b7g7b

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-4ba551-bc6c77477-b7g7b

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-4ba551-bc6c77477

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-4ba551-bc6c77477-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-4ba551: serviceaccount "payload-processing-e2e-api-b-4ba551" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-4ba551-bc6c77477

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-4ba551-bc6c77477-b7g7b
(x2)

openshift-ingress

kubelet

e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7

Unhealthy

Startup probe failed: Get "http://10.132.0.73:15021/healthz/ready": dial tcp 10.132.0.73:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7

ProbeError

Startup probe error: Get "http://10.132.0.73:15021/healthz/ready": dial tcp 10.132.0.73:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-1d2af2-6f59cfd574-csshm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-1d2af2-577cd885b7-8tl5x

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-api-b-4ba551-bc6c77477-b7g7b

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-4ba551-848fb5d858-b7km7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-8ecc1f-5bf6bb8498-mrslb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-8ecc1f-856d9cc485-tsbxf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-fc06d4-749c468585-hf8jn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-fc06d4-5c7c7b997d-6mxxs

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w2-fc06d4-openshift-default-6bd66998d6-fmxvc

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-ipp-a-42514d-openshift-default-54ccc688db

SuccessfulCreate

Created pod: e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4

openshift-ingress

deployment-controller

e2e-ipp-a-42514d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-42514d-openshift-default-54ccc688db from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-42514d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-42514d

openshift-ingress

multus

e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4

AddedInterface

Add eth0 [10.132.0.76/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-42514d-74ddb96797

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-42514d-74ddb96797-bh6dm
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-42514d-74ddb96797

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-42514d-74ddb96797-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-42514d: serviceaccount "payload-processing-e2e-ipp-a-42514d" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-42514d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-42514d-56dc6c9bf8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-42514d-56dc6c9bf8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-42514d-56dc6c9bf8-q9bqw
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-42514d-56dc6c9bf8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-42514d-56dc6c9bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-42514d: serviceaccount "payload-processing-e2e-ipp-a-42514d" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-42514d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-42514d-74ddb96797 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-42514d-56dc6c9bf8-q9bqw

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-42514d-56dc6c9bf8-q9bqw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-a-42514d-74ddb96797-bh6dm

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-42514d-74ddb96797-bh6dm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-42514d-74ddb96797-bh6dm

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-42514d-74ddb96797-bh6dm

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-42514d-56dc6c9bf8-q9bqw

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-42514d-56dc6c9bf8-q9bqw

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4

Unhealthy

Readiness probe failed: Get "http://10.132.0.76:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4

ProbeError

Readiness probe error: Get "http://10.132.0.76:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4

ProbeError

Startup probe error: Get "http://10.132.0.76:15021/healthz/ready": dial tcp 10.132.0.76:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4

Unhealthy

Startup probe failed: Get "http://10.132.0.76:15021/healthz/ready": dial tcp 10.132.0.76:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-5c43af

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-5c43af

openshift-ingress

deployment-controller

e2e-ipp-b-5c43af-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-5c43af-openshift-default-7b76f6b85b from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-5c43af-openshift-default-7b76f6b85b

SuccessfulCreate

Created pod: e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6

openshift-ingress

multus

e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6

AddedInterface

Add eth0 [10.132.0.77/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-5c43af

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-5c43af-9994f6647 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-5c43af-9994f6647

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-5c43af-9994f6647-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-5c43af: serviceaccount "payload-processing-e2e-ipp-b-5c43af" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-5c43af-779c6457cd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-5c43af-779c6457cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-5c43af: serviceaccount "payload-processing-e2e-ipp-b-5c43af" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-5c43af-9994f6647-5l9ds

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-5c43af-9994f6647

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-5c43af-9994f6647-5l9ds

openshift-ingress

multus

payload-processing-e2e-ipp-b-5c43af-9994f6647-5l9ds

AddedInterface

Add eth0 [10.134.0.70/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-5c43af

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-5c43af-779c6457cd from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-5c43af-9994f6647-5l9ds

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-5c43af-779c6457cd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-5c43af-779c6457cd-hmdjn

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-5c43af-779c6457cd-hmdjn

AddedInterface

Add eth0 [10.132.0.80/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-5c43af-779c6457cd-hmdjn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-5c43af-779c6457cd-hmdjn

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-5c43af-779c6457cd-hmdjn

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-5c43af-9994f6647-5l9ds

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6

Unhealthy

Startup probe failed: Get "http://10.132.0.77:15021/healthz/ready": dial tcp 10.132.0.77:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6

ProbeError

Startup probe error: Get "http://10.132.0.77:15021/healthz/ready": dial tcp 10.132.0.77:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-268239

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-268239

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd

SuccessfulCreate

Created pod: e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc

openshift-ingress

deployment-controller

e2e-ipp-cleanup-268239-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd from 0 to 1

openshift-ingress

multus

e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc

AddedInterface

Add eth0 [10.132.0.81/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-268239-65fd74c747

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-268239-65fd74c747-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-268239: serviceaccount "payload-processing-e2e-ipp-cleanup-268239" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-268239-65fd74c747

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-268239-65fd74c747-7r9k9
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-268239-79c5568b4b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-268239-79c5568b4b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-268239: serviceaccount "payload-processing-e2e-ipp-cleanup-268239" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-268239-79c5568b4b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-268239-79c5568b4b-qkwdh

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-268239

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-268239-79c5568b4b from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-268239

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-268239-65fd74c747 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-268239-65fd74c747-7r9k9

AddedInterface

Add eth0 [10.134.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-268239-79c5568b4b-qkwdh

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-268239-65fd74c747-7r9k9

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-268239-65fd74c747-7r9k9

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-268239-65fd74c747-7r9k9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-268239-79c5568b4b-qkwdh

AddedInterface

Add eth0 [10.132.0.82/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-268239-79c5568b4b-qkwdh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-268239-79c5568b4b-qkwdh

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc

Unhealthy

Startup probe failed: Get "http://10.132.0.81:15021/healthz/ready": dial tcp 10.132.0.81:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc

ProbeError

Startup probe error: Get "http://10.132.0.81:15021/healthz/ready": dial tcp 10.132.0.81:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-268239-79c5568b4b-qkwdh

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-cleanup-268239

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-268239: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-cleanup-268239": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-268239, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: ed476900-1259-44f7-9550-f4159ebcf48a, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-268239-65fd74c747-7r9k9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-42514d-74ddb96797-bh6dm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-42514d-56dc6c9bf8-q9bqw

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-a-42514d

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-a-42514d: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-a-42514d": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-a-42514d, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 32940492-32db-40c1-b0e6-f947eaee0d97, UID in object meta:

openshift-ingress

kubelet

e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-5c43af-9994f6647-5l9ds

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-5c43af-779c6457cd-hmdjn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-7bf16f-5c665dfdc-npdbf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-7bf16f-7bd5896978-hngjp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-59dc59-dccf565d6-tcqjx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-59dc59-dc7f8ff87-x7w5c

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg

Killing

Stopping container istio-proxy