Time Namespace Component RelatedObject Reason Message

openshift-ingress

e2e-ipp-cleanup-f46871-openshift-default-6d978f6dc6-km5hn

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-f46871-openshift-default-6d978f6dc6-km5hn to ip-10-0-130-4.ec2.internal

openshift-ingress

e2e-ait-30fb702c-openshift-default-c4f568d6b-24wst

Scheduled

Successfully assigned openshift-ingress/e2e-ait-30fb702c-openshift-default-c4f568d6b-24wst to ip-10-0-130-4.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w3-2534e3-5bcb57cff4-tz8rf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w3-2534e3-5bcb57cff4-tz8rf to ip-10-0-130-207.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-195f51-5cc698659d-x8lzl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-195f51-5cc698659d-x8lzl to ip-10-0-130-207.ec2.internal

openshift-ingress

e2e-shared-b-w1-45446b-openshift-default-64c94999cb-fpwlp

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w1-45446b-openshift-default-64c94999cb-fpwlp to ip-10-0-130-4.ec2.internal

openshift-ingress

e2e-shared-b-w2-0ee1bf-openshift-default-9d6c8d686-5g8kw

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-0ee1bf-openshift-default-9d6c8d686-5g8kw to ip-10-0-131-89.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-96c840-56b9dd4654-5rp7j

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-96c840-56b9dd4654-5rp7j to ip-10-0-130-207.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-8j925

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-8j925 to ip-10-0-130-207.ec2.internal

openshift-ingress

kube-auth-proxy-5bfdbc6f8d-xj5xh

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-5bfdbc6f8d-xj5xh to ip-10-0-130-4.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-f46871-5fb4b547f8-2mc6p

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-f46871-5fb4b547f8-2mc6p to ip-10-0-130-207.ec2.internal

openshift-ingress

payload-processing-e2e-mt-f29ccae3-c47b8bc49-b4w4r

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-f29ccae3-c47b8bc49-b4w4r to ip-10-0-131-89.ec2.internal

openshift-ingress

payload-processing-e2e-mt-e7d6db19-5cd4d57545-9t7zp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-e7d6db19-5cd4d57545-9t7zp to ip-10-0-130-207.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-0ee1bf-9d8459445-ddpbs

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-0ee1bf-9d8459445-ddpbs to ip-10-0-130-207.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-a58c3d9e-6f8bfd97c4-ltdgg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-a58c3d9e-6f8bfd97c4-ltdgg to ip-10-0-131-89.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-089563-756db6b94-2ngrq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-089563-756db6b94-2ngrq to ip-10-0-131-89.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-6d0d72-5875fff75d-htxqr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-6d0d72-5875fff75d-htxqr to ip-10-0-130-207.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-d58169-f98bd68d6-bzh2g

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-d58169-f98bd68d6-bzh2g to ip-10-0-131-89.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-6f50fc84-6789f9678-h67n8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-6f50fc84-6789f9678-h67n8 to ip-10-0-130-207.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-e7d6db19-77b958bf6b-cbwhw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-e7d6db19-77b958bf6b-cbwhw to ip-10-0-131-89.ec2.internal

openshift-ingress

e2e-ait-f097ba39-openshift-default-7dbd7dc76b-lnv5p

Scheduled

Successfully assigned openshift-ingress/e2e-ait-f097ba39-openshift-default-7dbd7dc76b-lnv5p to ip-10-0-130-4.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-f29ccae3-6fdb5f549d-2jshw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-f29ccae3-6fdb5f549d-2jshw to ip-10-0-130-207.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w1-f39e09-f5677f8cd-dj7jx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w1-f39e09-f5677f8cd-dj7jx to ip-10-0-130-207.ec2.internal

openshift-ingress

e2e-worker-w0-96c840-openshift-default-6c66cf578d-f8sbv

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-96c840-openshift-default-6c66cf578d-f8sbv to ip-10-0-131-89.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-96c840-76f5c8849f-ks9pz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-96c840-76f5c8849f-ks9pz to ip-10-0-130-207.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-00f5c9-7f5cddb44b-rqx4c

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-00f5c9-7f5cddb44b-rqx4c to ip-10-0-131-89.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-f831c5-7fcf9bb6f8-86vjn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f831c5-7fcf9bb6f8-86vjn to ip-10-0-130-207.ec2.internal

openshift-ingress

e2e-shared-a-w2-f831c5-openshift-default-648cfddf5d-8j74r

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-f831c5-openshift-default-648cfddf5d-8j74r to ip-10-0-131-89.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w1-45446b-5f77bf4fbc-92529

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w1-45446b-5f77bf4fbc-92529 to ip-10-0-130-207.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-ad13e5-64d48d9c7d-dvgxg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-ad13e5-64d48d9c7d-dvgxg to ip-10-0-131-89.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-f097ba39-fdc9664fd-hjcxz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-f097ba39-fdc9664fd-hjcxz to ip-10-0-131-89.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-30fb702c-849ff5678b-bj9fz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-30fb702c-849ff5678b-bj9fz to ip-10-0-130-207.ec2.internal

openshift-ingress

payload-processing-5d7dbbd56b-87r96

Scheduled

Successfully assigned openshift-ingress/payload-processing-5d7dbbd56b-87r96 to ip-10-0-131-89.ec2.internal

openshift-ingress

e2e-ipp-a-089563-openshift-default-dd65bb8b4-gmmnj

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-089563-openshift-default-dd65bb8b4-gmmnj to ip-10-0-131-89.ec2.internal

openshift-ingress

e2e-shared-a-w1-f39e09-openshift-default-85cf756ddd-9ldvm

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w1-f39e09-openshift-default-85cf756ddd-9ldvm to ip-10-0-131-89.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-d58169-cb6c754ff-r9hv6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-d58169-cb6c754ff-r9hv6 to ip-10-0-131-89.ec2.internal

openshift-ingress

payload-processing-e2e-derive-6f50fc84-7bdc466c5c-n27qv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-6f50fc84-7bdc466c5c-n27qv to ip-10-0-130-207.ec2.internal

openshift-ingress

payload-processing-e2e-ait-30fb702c-68f994b98f-wq2lg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-30fb702c-68f994b98f-wq2lg to ip-10-0-130-207.ec2.internal

openshift-ingress

e2e-ipp-b-195f51-openshift-default-6cc5dfc99d-hfd9t

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-195f51-openshift-default-6cc5dfc99d-hfd9t to ip-10-0-131-89.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-f831c5-bd474457c-p7hh4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-f831c5-bd474457c-p7hh4 to ip-10-0-131-89.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-5ccb968c66-kdnf6

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-kdnf6 to ip-10-0-131-89.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-a58c3d9e-dd4f9d4b-mfjzp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-a58c3d9e-dd4f9d4b-mfjzp to ip-10-0-130-207.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w1-f39e09-5d74949579-6jqsj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w1-f39e09-5d74949579-6jqsj to ip-10-0-130-207.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-f46871-788665f459-4p8zg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-f46871-788665f459-4p8zg to ip-10-0-130-207.ec2.internal

openshift-ingress

e2e-api-b-00f5c9-openshift-default-5f4f8877d8-2j6wz

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-00f5c9-openshift-default-5f4f8877d8-2j6wz to ip-10-0-131-89.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-195f51-6c8f7975cc-gzrj6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-195f51-6c8f7975cc-gzrj6 to ip-10-0-130-207.ec2.internal

openshift-ingress

router-default-74867654d6-ccpxx

Scheduled

Successfully assigned openshift-ingress/router-default-74867654d6-ccpxx to ip-10-0-131-89.ec2.internal

openshift-ingress

e2e-api-a-ad13e5-openshift-default-5466b9c866-8klnl

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-ad13e5-openshift-default-5466b9c866-8klnl to ip-10-0-130-4.ec2.internal

openshift-ingress

e2e-inf-b-6d0d72-openshift-default-65f77f5774-2rm5z

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-6d0d72-openshift-default-65f77f5774-2rm5z to ip-10-0-130-4.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-68cf4d799c92k86

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c92k86 to ip-10-0-131-89.ec2.internal

openshift-ingress

kube-auth-proxy-5bfdbc6f8d-j5r2k

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-5bfdbc6f8d-j5r2k to ip-10-0-130-207.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-00f5c9-5b985bd6d7-bnkdx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-00f5c9-5b985bd6d7-bnkdx to ip-10-0-130-207.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-089563-6b887d48f5-2c4x2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-089563-6b887d48f5-2c4x2 to ip-10-0-131-89.ec2.internal

openshift-ingress

e2e-worker-w3-2534e3-openshift-default-79f6c745d6-6pnpj

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-2534e3-openshift-default-79f6c745d6-6pnpj to ip-10-0-131-89.ec2.internal

openshift-ingress

payload-pre-processing-6cd864bc95-gr57w

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-6cd864bc95-gr57w to ip-10-0-131-89.ec2.internal

openshift-ingress

e2e-derive-6f50fc84-openshift-default-b796d5576-9z8j5

Scheduled

Successfully assigned openshift-ingress/e2e-derive-6f50fc84-openshift-default-b796d5576-9z8j5 to ip-10-0-130-4.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-0ee1bf-589b478bf4-tmjrm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-0ee1bf-589b478bf4-tmjrm to ip-10-0-130-207.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w1-45446b-789f6d5898-z449s

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w1-45446b-789f6d5898-z449s to ip-10-0-131-89.ec2.internal

openshift-ingress

payload-processing-e2e-ait-f097ba39-847548d9c7-fw67p

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-f097ba39-847548d9c7-fw67p to ip-10-0-130-207.ec2.internal

openshift-ingress

e2e-mt-f29ccae3-openshift-default-5bb66cfc6-prw6t

Scheduled

Successfully assigned openshift-ingress/e2e-mt-f29ccae3-openshift-default-5bb66cfc6-prw6t to ip-10-0-130-4.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-7v9tv

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-7v9tv to ip-10-0-130-207.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-ad13e5-59468867bf-xjs9r

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-ad13e5-59468867bf-xjs9r to ip-10-0-130-207.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-6d0d72-66b74965bf-x4dl6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-6d0d72-66b74965bf-x4dl6 to ip-10-0-130-207.ec2.internal

openshift-ingress

e2e-mt-e7d6db19-openshift-default-6476c67568-mrn26

Scheduled

Successfully assigned openshift-ingress/e2e-mt-e7d6db19-openshift-default-6476c67568-mrn26 to ip-10-0-131-89.ec2.internal

openshift-ingress

e2e-inf-a-d58169-openshift-default-74df6c49bd-5rqrx

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-d58169-openshift-default-74df6c49bd-5rqrx to ip-10-0-131-89.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-sng4t

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-sng4t to ip-10-0-130-207.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w3-2534e3-55c6dd8485-4lb47

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w3-2534e3-55c6dd8485-4lb47 to ip-10-0-131-89.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-k58gh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-k58gh to ip-10-0-131-89.ec2.internal

openshift-ingress

e2e-migrate-a58c3d9e-gw-openshift-default-7995cf64-c4km2

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-a58c3d9e-gw-openshift-default-7995cf64-c4km2 to ip-10-0-130-4.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-74867654d6 from 0 to 1
(x10)

openshift-ingress

replicaset-controller

router-default-74867654d6

FailedCreate

Error creating: pods "router-default-74867654d6-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x17)

openshift-ingress

replicaset-controller

router-default-74867654d6

FailedCreate

Error creating: pods "router-default-74867654d6-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-74867654d6

SuccessfulCreate

Created pod: router-default-74867654d6-ccpxx
(x5)

openshift-ingress

kubelet

router-default-74867654d6-ccpxx

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x5)

openshift-ingress

kubelet

router-default-74867654d6-ccpxx

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

multus

router-default-74867654d6-ccpxx

AddedInterface

Add eth0 [10.134.0.11/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-74867654d6-ccpxx

Created

Created container: router

openshift-ingress

kubelet

router-default-74867654d6-ccpxx

Started

Started container router

openshift-ingress

kubelet

router-default-74867654d6-ccpxx

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:48526e08a2a06d05806dbcf3ddb069e5182371667d9e9f7d2cf09f60cd247d20" already present on machine

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-5bfdbc6f8d from 0 to 2
(x4)

openshift-ingress

replicaset-controller

kube-auth-proxy-5bfdbc6f8d

FailedCreate

Error creating: pods "kube-auth-proxy-5bfdbc6f8d-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-5bfdbc6f8d

SuccessfulCreate

Created pod: kube-auth-proxy-5bfdbc6f8d-xj5xh

openshift-ingress

replicaset-controller

kube-auth-proxy-5bfdbc6f8d

SuccessfulCreate

Created pod: kube-auth-proxy-5bfdbc6f8d-j5r2k

openshift-ingress

kubelet

kube-auth-proxy-5bfdbc6f8d-j5r2k

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

kubelet

kube-auth-proxy-5bfdbc6f8d-xj5xh

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-sng4t

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

kubelet

kube-auth-proxy-5bfdbc6f8d-j5r2k

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

kubelet

kube-auth-proxy-5bfdbc6f8d-xj5xh

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-5bfdbc6f8d-xj5xh

AddedInterface

Add eth0 [10.132.0.35/23] from ovn-kubernetes

openshift-ingress

multus

kube-auth-proxy-5bfdbc6f8d-j5r2k

AddedInterface

Add eth0 [10.133.0.17/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-sng4t

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-sng4t

AddedInterface

Add eth0 [10.133.0.18/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-5bfdbc6f8d-j5r2k

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.673s (2.673s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-5bfdbc6f8d-j5r2k

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-5bfdbc6f8d-j5r2k

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-5bfdbc6f8d-xj5xh

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.772s (2.772s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-5bfdbc6f8d-xj5xh

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-5bfdbc6f8d-xj5xh

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-sng4t

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-sng4t

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-sng4t

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.713s (3.713s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-sng4t

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-sng4t

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-68cf4d799c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-68cf4d799c92k86

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-68cf4d799c from 0 to 1

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799c92k86

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-68cf4d799c92k86

AddedInterface

Add eth0 [10.134.0.24/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799c92k86

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799c92k86

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799c92k86

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 3.366s (3.366s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-7v9tv

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-7v9tv

Created

Created container: discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-7v9tv

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-7v9tv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" already present on machine

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-7v9tv

AddedInterface

Add eth0 [10.133.0.19/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-7v9tv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-7v9tv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-sng4t

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-sng4t

Killing

Stopping container discovery
(x3)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5ccb968c66

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5ccb968c66-kdnf6

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-5ccb968c66 from 0 to 1

openshift-ingress

multus

maas-default-gateway-openshift-default-5ccb968c66-kdnf6

AddedInterface

Add eth0 [10.134.0.33/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-k58gh

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-8j925
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-k58gh

AddedInterface

Add eth0 [10.134.0.38/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-k58gh

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-5b54b7fbb7-8j925

AddedInterface

Add eth0 [10.133.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-8j925

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-k58gh

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.863s (2.863s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-8j925

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-k58gh

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-8j925

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-8j925

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.612s (2.612s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-k58gh

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-kdnf6

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-kdnf6

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-kdnf6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-kdnf6

ProbeError

Startup probe error: Get "http://10.134.0.33:15021/healthz/ready": dial tcp 10.134.0.33:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-kdnf6

Unhealthy

Startup probe failed: Get "http://10.134.0.33:15021/healthz/ready": dial tcp 10.134.0.33:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-k58gh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-8j925

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-6cd864bc95

SuccessfulCreate

Created pod: payload-pre-processing-6cd864bc95-gr57w

openshift-ingress

kubelet

payload-processing-5d7dbbd56b-87r96

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

replicaset-controller

payload-processing-5d7dbbd56b

SuccessfulCreate

Created pod: payload-processing-5d7dbbd56b-87r96

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-6cd864bc95 from 0 to 1

openshift-ingress

multus

payload-pre-processing-6cd864bc95-gr57w

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-6cd864bc95-gr57w

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5d7dbbd56b from 0 to 1

openshift-ingress

multus

payload-processing-5d7dbbd56b-87r96

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5d7dbbd56b-87r96

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-6cd864bc95-gr57w

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-5d7dbbd56b-87r96

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 1.273s (1.273s including waiting). Image size: 141123057 bytes.

openshift-ingress

kubelet

payload-pre-processing-6cd864bc95-gr57w

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 1.239s (1.239s including waiting). Image size: 141123057 bytes.

openshift-ingress

kubelet

payload-processing-5d7dbbd56b-87r96

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-6cd864bc95-gr57w

Created

Created container: payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-inf-a-d58169

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-d58169

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-96c840

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-96c840

openshift-ingress

deployment-controller

e2e-worker-w0-96c840-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-96c840-openshift-default-6c66cf578d from 0 to 1

openshift-ingress

multus

e2e-inf-a-d58169-openshift-default-74df6c49bd-5rqrx

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-worker-w3-2534e3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w3-2534e3

openshift-ingress

multus

e2e-worker-w3-2534e3-openshift-default-79f6c745d6-6pnpj

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-inf-a-d58169-openshift-default-74df6c49bd

SuccessfulCreate

Created pod: e2e-inf-a-d58169-openshift-default-74df6c49bd-5rqrx

openshift-ingress

deployment-controller

e2e-inf-a-d58169-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-d58169-openshift-default-74df6c49bd from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w3-2534e3-openshift-default-79f6c745d6

SuccessfulCreate

Created pod: e2e-worker-w3-2534e3-openshift-default-79f6c745d6-6pnpj

openshift-ingress

deployment-controller

e2e-worker-w3-2534e3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-2534e3-openshift-default-79f6c745d6 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w0-96c840-openshift-default-6c66cf578d

SuccessfulCreate

Created pod: e2e-worker-w0-96c840-openshift-default-6c66cf578d-f8sbv

openshift-ingress

multus

e2e-worker-w0-96c840-openshift-default-6c66cf578d-f8sbv

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-96c840

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-96c840-76f5c8849f from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-96c840-76f5c8849f-ks9pz

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-worker-w0-96c840-76f5c8849f-ks9pz

AddedInterface

Add eth0 [10.133.0.42/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-96c840-56b9dd4654-5rp7j

AddedInterface

Add eth0 [10.133.0.41/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-96c840-76f5c8849f

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-96c840-76f5c8849f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-96c840: serviceaccount "payload-processing-e2e-worker-w0-96c840" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-96c840-56b9dd4654-5rp7j

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-96c840-56b9dd4654-5rp7j

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-96c840-76f5c8849f

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-96c840-76f5c8849f-ks9pz

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-96c840-76f5c8849f-ks9pz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-96c840-56b9dd4654-5rp7j

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-96c840-76f5c8849f-ks9pz

Started

Started container payload-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-96c840-56b9dd4654

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-96c840-56b9dd4654-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-96c840: serviceaccount "payload-processing-e2e-worker-w0-96c840" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-96c840-56b9dd4654

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-96c840-56b9dd4654-5rp7j

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-96c840

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-96c840-56b9dd4654 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-2534e3-5bcb57cff4-tz8rf

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w3-2534e3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w3-2534e3-55c6dd8485 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-2534e3-5bcb57cff4-tz8rf

Created

Created container: payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-2534e3-5bcb57cff4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w3-2534e3-5bcb57cff4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-2534e3: serviceaccount "payload-processing-e2e-worker-w3-2534e3" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-2534e3-5bcb57cff4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w3-2534e3-5bcb57cff4-tz8rf

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w3-2534e3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w3-2534e3-5bcb57cff4 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-worker-w3-2534e3-5bcb57cff4-tz8rf

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-d58169

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-d58169-cb6c754ff from 0 to 1

openshift-ingress

multus

payload-processing-e2e-worker-w3-2534e3-55c6dd8485-4lb47

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-2534e3-5bcb57cff4-tz8rf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-2534e3-55c6dd8485-4lb47

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-2534e3-55c6dd8485-4lb47

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-2534e3-55c6dd8485-4lb47

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-2534e3-55c6dd8485

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w3-2534e3-55c6dd8485-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-2534e3: serviceaccount "payload-processing-e2e-worker-w3-2534e3" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-2534e3-55c6dd8485

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w3-2534e3-55c6dd8485-4lb47

openshift-ingress

multus

payload-processing-e2e-inf-a-d58169-cb6c754ff-r9hv6

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-d58169-cb6c754ff

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-d58169-cb6c754ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-d58169: serviceaccount "payload-processing-e2e-inf-a-d58169" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-d58169

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-d58169-f98bd68d6 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-d58169-cb6c754ff

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-d58169-cb6c754ff-r9hv6

openshift-ingress

kubelet

payload-processing-e2e-inf-a-d58169-cb6c754ff-r9hv6

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-d58169-cb6c754ff-r9hv6

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-d58169-cb6c754ff-r9hv6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-d58169-f98bd68d6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-d58169-f98bd68d6-bzh2g

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-d58169-f98bd68d6-bzh2g

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-d58169-f98bd68d6-bzh2g

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-d58169-f98bd68d6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-d58169-f98bd68d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-d58169: serviceaccount "payload-processing-e2e-inf-a-d58169" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-d58169-f98bd68d6-bzh2g

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-d58169-f98bd68d6-bzh2g

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w3-2534e3-openshift-default-79f6c745d6-6pnpj

ProbeError

Readiness probe error: Get "http://10.134.0.49:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-inf-a-d58169-openshift-default-74df6c49bd-5rqrx

ProbeError

Readiness probe error: Get "http://10.134.0.47:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-inf-a-d58169-openshift-default-74df6c49bd-5rqrx

Unhealthy

Readiness probe failed: Get "http://10.134.0.47:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-96c840-openshift-default-6c66cf578d-f8sbv

Unhealthy

Readiness probe failed: Get "http://10.134.0.48:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-96c840-openshift-default-6c66cf578d-f8sbv

ProbeError

Readiness probe error: Get "http://10.134.0.48:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w3-2534e3-openshift-default-79f6c745d6-6pnpj

Unhealthy

Readiness probe failed: Get "http://10.134.0.49:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w3-2534e3-openshift-default-79f6c745d6-6pnpj

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-d58169-openshift-default-74df6c49bd-5rqrx

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-d58169-openshift-default-74df6c49bd-5rqrx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w0-96c840-openshift-default-6c66cf578d-f8sbv

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-96c840-openshift-default-6c66cf578d-f8sbv

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w3-2534e3-openshift-default-79f6c745d6-6pnpj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w0-96c840-openshift-default-6c66cf578d-f8sbv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w3-2534e3-openshift-default-79f6c745d6-6pnpj

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-d58169-openshift-default-74df6c49bd-5rqrx

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-inf-a-d58169-openshift-default-74df6c49bd-5rqrx

Unhealthy

Startup probe failed: Get "http://10.134.0.47:15021/healthz/ready": dial tcp 10.134.0.47:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w0-96c840-openshift-default-6c66cf578d-f8sbv

Unhealthy

Startup probe failed: Get "http://10.134.0.48:15021/healthz/ready": dial tcp 10.134.0.48:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w0-96c840-openshift-default-6c66cf578d-f8sbv

ProbeError

Startup probe error: Get "http://10.134.0.48:15021/healthz/ready": dial tcp 10.134.0.48:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-a-d58169-openshift-default-74df6c49bd-5rqrx

ProbeError

Startup probe error: Get "http://10.134.0.47:15021/healthz/ready": dial tcp 10.134.0.47:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-2534e3-openshift-default-79f6c745d6-6pnpj

Unhealthy

Startup probe failed: Get "http://10.134.0.49:15021/healthz/ready": dial tcp 10.134.0.49:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-2534e3-openshift-default-79f6c745d6-6pnpj

ProbeError

Startup probe error: Get "http://10.134.0.49:15021/healthz/ready": dial tcp 10.134.0.49:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-inf-b-6d0d72

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-6d0d72

openshift-ingress

replicaset-controller

e2e-inf-b-6d0d72-openshift-default-65f77f5774

SuccessfulCreate

Created pod: e2e-inf-b-6d0d72-openshift-default-65f77f5774-2rm5z

openshift-ingress

deployment-controller

e2e-inf-b-6d0d72-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-6d0d72-openshift-default-65f77f5774 from 0 to 1

openshift-ingress

multus

e2e-inf-b-6d0d72-openshift-default-65f77f5774-2rm5z

AddedInterface

Add eth0 [10.132.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-6d0d72-openshift-default-65f77f5774-2rm5z

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

e2e-inf-b-6d0d72-openshift-default-65f77f5774-2rm5z

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 3.899s (3.899s including waiting). Image size: 181318953 bytes.

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-6d0d72

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-6d0d72-66b74965bf from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-6d0d72

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-6d0d72-5875fff75d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-6d0d72-66b74965bf

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-6d0d72-66b74965bf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-6d0d72: serviceaccount "payload-processing-e2e-inf-b-6d0d72" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-6d0d72-66b74965bf

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-6d0d72-66b74965bf-x4dl6

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-6d0d72-5875fff75d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-6d0d72-5875fff75d-htxqr
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-6d0d72-5875fff75d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-6d0d72-5875fff75d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-6d0d72: serviceaccount "payload-processing-e2e-inf-b-6d0d72" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-6d0d72-5875fff75d-htxqr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-inf-b-6d0d72-66b74965bf-x4dl6

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-6d0d72-66b74965bf-x4dl6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-b-6d0d72-66b74965bf-x4dl6

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-6d0d72-66b74965bf-x4dl6

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-6d0d72-5875fff75d-htxqr

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-6d0d72-5875fff75d-htxqr

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-6d0d72-5875fff75d-htxqr

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-inf-b-6d0d72-openshift-default-65f77f5774-2rm5z

ProbeError

Readiness probe error: Get "http://10.132.0.42:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-inf-b-6d0d72-openshift-default-65f77f5774-2rm5z

Unhealthy

Readiness probe failed: Get "http://10.132.0.42:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-inf-b-6d0d72-openshift-default-65f77f5774-2rm5z

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-6d0d72-openshift-default-65f77f5774-2rm5z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-6d0d72-openshift-default-65f77f5774-2rm5z

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-inf-b-6d0d72-openshift-default-65f77f5774-2rm5z

Unhealthy

Startup probe failed: Get "http://10.132.0.42:15021/healthz/ready": dial tcp 10.132.0.42:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-b-6d0d72-openshift-default-65f77f5774-2rm5z

ProbeError

Startup probe error: Get "http://10.132.0.42:15021/healthz/ready": dial tcp 10.132.0.42:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ait-f097ba39

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-f097ba39

openshift-ingress

multus

e2e-ait-f097ba39-openshift-default-7dbd7dc76b-lnv5p

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ait-f097ba39-openshift-default-7dbd7dc76b

SuccessfulCreate

Created pod: e2e-ait-f097ba39-openshift-default-7dbd7dc76b-lnv5p

openshift-ingress

deployment-controller

e2e-ait-f097ba39-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-f097ba39-openshift-default-7dbd7dc76b from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-f097ba39-847548d9c7

SuccessfulCreate

Created pod: payload-processing-e2e-ait-f097ba39-847548d9c7-fw67p

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-f097ba39

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-f097ba39-fdc9664fd from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-f097ba39-847548d9c7

FailedCreate

Error creating: pods "payload-processing-e2e-ait-f097ba39-847548d9c7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-f097ba39: serviceaccount "payload-processing-e2e-ait-f097ba39" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-f097ba39-fdc9664fd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-f097ba39-fdc9664fd-hjcxz
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-f097ba39-fdc9664fd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-f097ba39-fdc9664fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-f097ba39: serviceaccount "payload-processing-e2e-ait-f097ba39" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-f097ba39

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-f097ba39-847548d9c7 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f097ba39-fdc9664fd-hjcxz

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ait-f097ba39-847548d9c7-fw67p

AddedInterface

Add eth0 [10.133.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-f097ba39-847548d9c7-fw67p

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-f097ba39-fdc9664fd-hjcxz

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f097ba39-fdc9664fd-hjcxz

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-f097ba39-847548d9c7-fw67p

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-f097ba39-847548d9c7-fw67p

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f097ba39-fdc9664fd-hjcxz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-f097ba39-openshift-default-7dbd7dc76b-lnv5p

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-f097ba39-openshift-default-7dbd7dc76b-lnv5p

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-f097ba39-openshift-default-7dbd7dc76b-lnv5p

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ait-f097ba39-openshift-default-7dbd7dc76b-lnv5p

ProbeError

Startup probe error: Get "http://10.132.0.49:15021/healthz/ready": dial tcp 10.132.0.49:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-f097ba39-openshift-default-7dbd7dc76b-lnv5p

Unhealthy

Startup probe failed: Get "http://10.132.0.49:15021/healthz/ready": dial tcp 10.132.0.49:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ait-f097ba39-847548d9c7-fw67p

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ait-f097ba39

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ait-f097ba39: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ait-f097ba39": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ait-f097ba39, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 23908062-7f70-4b24-83e9-44842baaa9e6, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f097ba39-fdc9664fd-hjcxz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-f097ba39-openshift-default-7dbd7dc76b-lnv5p

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-migrate-a58c3d9e-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-a58c3d9e-gw

openshift-ingress

deployment-controller

e2e-migrate-a58c3d9e-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-a58c3d9e-gw-openshift-default-7995cf64 from 0 to 1

openshift-ingress

replicaset-controller

e2e-migrate-a58c3d9e-gw-openshift-default-7995cf64

SuccessfulCreate

Created pod: e2e-migrate-a58c3d9e-gw-openshift-default-7995cf64-c4km2

openshift-ingress

multus

e2e-migrate-a58c3d9e-gw-openshift-default-7995cf64-c4km2

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-d58169-f98bd68d6-bzh2g

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-d58169-cb6c754ff-r9hv6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-f097ba39-openshift-default-7dbd7dc76b-lnv5p

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ait-f097ba39-openshift-default-7dbd7dc76b-lnv5p

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-a58c3d9e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-a58c3d9e-6f8bfd97c4 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-a58c3d9e-6f8bfd97c4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-a58c3d9e-6f8bfd97c4-ltdgg
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-a58c3d9e-6f8bfd97c4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-a58c3d9e-6f8bfd97c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-a58c3d9e: serviceaccount "payload-processing-e2e-migrate-a58c3d9e" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-a58c3d9e-dd4f9d4b

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-a58c3d9e-dd4f9d4b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-a58c3d9e: serviceaccount "payload-processing-e2e-migrate-a58c3d9e" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-a58c3d9e-dd4f9d4b

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-a58c3d9e-dd4f9d4b-mfjzp

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-a58c3d9e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-a58c3d9e-dd4f9d4b from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-a58c3d9e-6f8bfd97c4-ltdgg

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-a58c3d9e-dd4f9d4b-mfjzp

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-migrate-a58c3d9e-dd4f9d4b-mfjzp

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-a58c3d9e-dd4f9d4b-mfjzp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-migrate-a58c3d9e-dd4f9d4b-mfjzp

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-a58c3d9e-6f8bfd97c4-ltdgg

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-a58c3d9e-6f8bfd97c4-ltdgg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-migrate-a58c3d9e-6f8bfd97c4-ltdgg

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-d58169-openshift-default-74df6c49bd-5rqrx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-6d0d72-5875fff75d-htxqr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-6d0d72-66b74965bf-x4dl6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-b-6d0d72-openshift-default-65f77f5774-2rm5z

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-w2-f831c5-openshift-default-648cfddf5d

SuccessfulCreate

Created pod: e2e-shared-a-w2-f831c5-openshift-default-648cfddf5d-8j74r

openshift-ingress

kubelet

e2e-inf-b-6d0d72-openshift-default-65f77f5774-2rm5z

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

e2e-shared-a-w2-f831c5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-f831c5-openshift-default-648cfddf5d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-f831c5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-f831c5

openshift-ingress

kubelet

e2e-inf-b-6d0d72-openshift-default-65f77f5774-2rm5z

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

multus

e2e-shared-a-w2-f831c5-openshift-default-648cfddf5d-8j74r

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-f831c5-bd474457c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-f831c5-bd474457c-p7hh4

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-f831c5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-f831c5-7fcf9bb6f8 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-f831c5-7fcf9bb6f8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-f831c5-7fcf9bb6f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-f831c5: serviceaccount "payload-processing-e2e-shared-a-w2-f831c5" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-f831c5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-f831c5-bd474457c from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-f831c5-7fcf9bb6f8-86vjn

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-f831c5-7fcf9bb6f8-86vjn

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-f831c5-bd474457c-p7hh4

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-f831c5-7fcf9bb6f8-86vjn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-f831c5-7fcf9bb6f8-86vjn

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-f831c5-bd474457c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-f831c5-bd474457c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-f831c5: serviceaccount "payload-processing-e2e-shared-a-w2-f831c5" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-f831c5-bd474457c-p7hh4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-f831c5-bd474457c-p7hh4

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-f831c5-7fcf9bb6f8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-f831c5-7fcf9bb6f8-86vjn

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-f831c5-bd474457c-p7hh4

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-migrate-a58c3d9e-gw-openshift-default-7995cf64-c4km2

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-a58c3d9e-gw-openshift-default-7995cf64-c4km2

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-a58c3d9e-gw-openshift-default-7995cf64-c4km2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-migrate-a58c3d9e-gw-openshift-default-7995cf64-c4km2

ProbeError

Readiness probe error: Get "http://10.132.0.51:15021/healthz/ready": read tcp 10.132.0.2:35904->10.132.0.51:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-migrate-a58c3d9e-gw-openshift-default-7995cf64-c4km2

Unhealthy

Readiness probe failed: Get "http://10.132.0.51:15021/healthz/ready": read tcp 10.132.0.2:35904->10.132.0.51:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-migrate-a58c3d9e-gw-openshift-default-7995cf64-c4km2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-a58c3d9e-6f8bfd97c4-ltdgg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-a58c3d9e-dd4f9d4b-mfjzp

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-ait-30fb702c-openshift-default-c4f568d6b

SuccessfulCreate

Created pod: e2e-ait-30fb702c-openshift-default-c4f568d6b-24wst

openshift-ingress

multus

e2e-ait-30fb702c-openshift-default-c4f568d6b-24wst

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ait-30fb702c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-30fb702c

openshift-ingress

deployment-controller

e2e-ait-30fb702c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-30fb702c-openshift-default-c4f568d6b from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-30fb702c-68f994b98f

SuccessfulCreate

Created pod: payload-processing-e2e-ait-30fb702c-68f994b98f-wq2lg

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-30fb702c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-30fb702c-849ff5678b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-30fb702c-849ff5678b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-30fb702c-849ff5678b-bj9fz

openshift-ingress

deployment-controller

payload-processing-e2e-ait-30fb702c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-30fb702c-68f994b98f from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-30fb702c-68f994b98f

FailedCreate

Error creating: pods "payload-processing-e2e-ait-30fb702c-68f994b98f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-30fb702c: serviceaccount "payload-processing-e2e-ait-30fb702c" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-30fb702c-849ff5678b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-30fb702c-849ff5678b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-30fb702c: serviceaccount "payload-processing-e2e-ait-30fb702c" not found

openshift-ingress

kubelet

payload-processing-e2e-ait-30fb702c-68f994b98f-wq2lg

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-30fb702c-849ff5678b-bj9fz

AddedInterface

Add eth0 [10.133.0.54/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ait-30fb702c-68f994b98f-wq2lg

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-30fb702c-849ff5678b-bj9fz

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-30fb702c-849ff5678b-bj9fz

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-30fb702c-68f994b98f-wq2lg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-30fb702c-849ff5678b-bj9fz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-30fb702c-68f994b98f-wq2lg

Created

Created container: payload-processing

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-0ee1bf

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-0ee1bf

openshift-ingress

deployment-controller

e2e-shared-b-w2-0ee1bf-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-0ee1bf-openshift-default-9d6c8d686 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w2-0ee1bf-openshift-default-9d6c8d686

SuccessfulCreate

Created pod: e2e-shared-b-w2-0ee1bf-openshift-default-9d6c8d686-5g8kw

openshift-ingress

multus

e2e-shared-b-w2-0ee1bf-openshift-default-9d6c8d686-5g8kw

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-0ee1bf

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-0ee1bf-589b478bf4 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-0ee1bf-9d8459445

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-0ee1bf-9d8459445-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-0ee1bf: serviceaccount "payload-processing-e2e-shared-b-w2-0ee1bf" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-0ee1bf-9d8459445

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-0ee1bf-9d8459445-ddpbs

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-0ee1bf-589b478bf4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-0ee1bf-589b478bf4-tmjrm
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-0ee1bf-589b478bf4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-0ee1bf-589b478bf4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-0ee1bf: serviceaccount "payload-processing-e2e-shared-b-w2-0ee1bf" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-0ee1bf

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-0ee1bf-9d8459445 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-0ee1bf-589b478bf4-tmjrm

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-0ee1bf-9d8459445-ddpbs

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-0ee1bf-9d8459445-ddpbs

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-0ee1bf-9d8459445-ddpbs

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-0ee1bf-589b478bf4-tmjrm

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-0ee1bf-9d8459445-ddpbs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-0ee1bf-589b478bf4-tmjrm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-0ee1bf-589b478bf4-tmjrm

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-f831c5-openshift-default-648cfddf5d-8j74r

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-30fb702c-openshift-default-c4f568d6b-24wst

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-30fb702c-openshift-default-c4f568d6b-24wst

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-f831c5-openshift-default-648cfddf5d-8j74r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-f831c5-openshift-default-648cfddf5d-8j74r

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-30fb702c-openshift-default-c4f568d6b-24wst

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-f831c5-openshift-default-648cfddf5d-8j74r

ProbeError

Startup probe error: Get "http://10.134.0.63:15021/healthz/ready": dial tcp 10.134.0.63:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-f831c5-openshift-default-648cfddf5d-8j74r

Unhealthy

Startup probe failed: Get "http://10.134.0.63:15021/healthz/ready": dial tcp 10.134.0.63:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-30fb702c-openshift-default-c4f568d6b-24wst

Unhealthy

Startup probe failed: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-30fb702c-openshift-default-c4f568d6b-24wst

ProbeError

Startup probe error: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-30fb702c-849ff5678b-bj9fz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-30fb702c-68f994b98f-wq2lg

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ait-30fb702c

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ait-30fb702c: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ait-30fb702c": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ait-30fb702c, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 20c8ed36-ba86-4243-be17-1513691ce776, UID in object meta:

openshift-ingress

kubelet

e2e-ait-30fb702c-openshift-default-c4f568d6b-24wst

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-derive-6f50fc84

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-6f50fc84

openshift-ingress

replicaset-controller

e2e-derive-6f50fc84-openshift-default-b796d5576

SuccessfulCreate

Created pod: e2e-derive-6f50fc84-openshift-default-b796d5576-9z8j5

openshift-ingress

deployment-controller

e2e-derive-6f50fc84-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-6f50fc84-openshift-default-b796d5576 from 0 to 1

openshift-ingress

multus

e2e-derive-6f50fc84-openshift-default-b796d5576-9z8j5

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-derive-6f50fc84-openshift-default-b796d5576-9z8j5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-derive-6f50fc84-openshift-default-b796d5576-9z8j5

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-derive-6f50fc84-openshift-default-b796d5576-9z8j5

Created

Created container: istio-proxy
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-6f50fc84-7bdc466c5c

FailedCreate

Error creating: pods "payload-processing-e2e-derive-6f50fc84-7bdc466c5c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-6f50fc84: serviceaccount "payload-processing-e2e-derive-6f50fc84" not found

openshift-ingress

multus

payload-processing-e2e-derive-6f50fc84-7bdc466c5c-n27qv

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-derive-6f50fc84-6789f9678-h67n8

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-6f50fc84-6789f9678

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-6f50fc84-6789f9678-h67n8

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-6f50fc84

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-6f50fc84-6789f9678 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-6f50fc84-7bdc466c5c

SuccessfulCreate

Created pod: payload-processing-e2e-derive-6f50fc84-7bdc466c5c-n27qv

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-6f50fc84-6789f9678-h67n8

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-6f50fc84-7bdc466c5c-n27qv

Created

Created container: payload-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-6f50fc84-6789f9678

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-6f50fc84-6789f9678-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-6f50fc84: serviceaccount "payload-processing-e2e-derive-6f50fc84" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-6f50fc84-6789f9678-h67n8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-6f50fc84-6789f9678-h67n8

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-derive-6f50fc84

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-6f50fc84-7bdc466c5c from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-derive-6f50fc84-7bdc466c5c-n27qv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-derive-6f50fc84-7bdc466c5c-n27qv

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-0ee1bf-openshift-default-9d6c8d686-5g8kw

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-0ee1bf-openshift-default-9d6c8d686-5g8kw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-0ee1bf-openshift-default-9d6c8d686-5g8kw

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-0ee1bf-openshift-default-9d6c8d686-5g8kw

ProbeError

Startup probe error: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-0ee1bf-openshift-default-9d6c8d686-5g8kw

Unhealthy

Startup probe failed: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-derive-6f50fc84-7bdc466c5c-n27qv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-6f50fc84-6789f9678-h67n8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-6f50fc84-openshift-default-b796d5576-9z8j5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-2534e3-5bcb57cff4-tz8rf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-2534e3-55c6dd8485-4lb47

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w3-2534e3-openshift-default-79f6c745d6-6pnpj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-2534e3-openshift-default-79f6c745d6-6pnpj

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w3-2534e3-openshift-default-79f6c745d6-6pnpj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

e2e-mt-f29ccae3-openshift-default-5bb66cfc6

SuccessfulCreate

Created pod: e2e-mt-f29ccae3-openshift-default-5bb66cfc6-prw6t

openshift-ingress

deployment-controller

e2e-mt-f29ccae3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-f29ccae3-openshift-default-5bb66cfc6 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-f29ccae3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-f29ccae3

openshift-ingress

multus

e2e-mt-f29ccae3-openshift-default-5bb66cfc6-prw6t

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-f29ccae3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-f29ccae3-6fdb5f549d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-f29ccae3-c47b8bc49

FailedCreate

Error creating: pods "payload-processing-e2e-mt-f29ccae3-c47b8bc49-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-f29ccae3: serviceaccount "payload-processing-e2e-mt-f29ccae3" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-f29ccae3-c47b8bc49

SuccessfulCreate

Created pod: payload-processing-e2e-mt-f29ccae3-c47b8bc49-b4w4r

openshift-ingress

deployment-controller

payload-processing-e2e-mt-f29ccae3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-f29ccae3-c47b8bc49 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-f29ccae3-6fdb5f549d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-f29ccae3-6fdb5f549d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-f29ccae3: serviceaccount "payload-processing-e2e-mt-f29ccae3" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-f29ccae3-6fdb5f549d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-f29ccae3-6fdb5f549d-2jshw

openshift-ingress

multus

payload-pre-processing-e2e-mt-f29ccae3-6fdb5f549d-2jshw

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-f29ccae3-6fdb5f549d-2jshw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-f29ccae3-c47b8bc49-b4w4r

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-f29ccae3-c47b8bc49-b4w4r

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-f29ccae3-c47b8bc49-b4w4r

AddedInterface

Add eth0 [10.134.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-f29ccae3-6fdb5f549d-2jshw

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-f29ccae3-6fdb5f549d-2jshw

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-f29ccae3-c47b8bc49-b4w4r

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-mt-f29ccae3-openshift-default-5bb66cfc6-prw6t

Unhealthy

Readiness probe failed: Get "http://10.132.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-mt-f29ccae3-openshift-default-5bb66cfc6-prw6t

ProbeError

Readiness probe error: Get "http://10.132.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-mt-f29ccae3-openshift-default-5bb66cfc6-prw6t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-f29ccae3-openshift-default-5bb66cfc6-prw6t

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-f29ccae3-openshift-default-5bb66cfc6-prw6t

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-mt-f29ccae3-openshift-default-5bb66cfc6-prw6t

Unhealthy

Startup probe failed: Get "http://10.132.0.60:15021/healthz/ready": dial tcp 10.132.0.60:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-mt-f29ccae3-openshift-default-5bb66cfc6-prw6t

ProbeError

Startup probe error: Get "http://10.132.0.60:15021/healthz/ready": dial tcp 10.132.0.60:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-f29ccae3-6fdb5f549d-2jshw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-96c840-56b9dd4654-5rp7j

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-96c840-76f5c8849f-ks9pz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-f29ccae3-c47b8bc49-b4w4r

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-f29ccae3-openshift-default-5bb66cfc6-prw6t

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-96c840-openshift-default-6c66cf578d-f8sbv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-f29ccae3-openshift-default-5bb66cfc6-prw6t

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-f29ccae3-openshift-default-5bb66cfc6-prw6t

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-shared-a-w1-f39e09-openshift-default-85cf756ddd

SuccessfulCreate

Created pod: e2e-shared-a-w1-f39e09-openshift-default-85cf756ddd-9ldvm

openshift-ingress

deployment-controller

e2e-shared-a-w1-f39e09-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w1-f39e09-openshift-default-85cf756ddd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w1-f39e09

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w1-f39e09

openshift-ingress

multus

e2e-shared-a-w1-f39e09-openshift-default-85cf756ddd-9ldvm

AddedInterface

Add eth0 [10.134.0.74/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w1-f39e09-f5677f8cd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w1-f39e09-f5677f8cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w1-f39e09: serviceaccount "payload-processing-e2e-shared-a-w1-f39e09" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w1-f39e09-5d74949579

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w1-f39e09-5d74949579-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w1-f39e09: serviceaccount "payload-processing-e2e-shared-a-w1-f39e09" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w1-f39e09

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w1-f39e09-f5677f8cd from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w1-f39e09-5d74949579

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w1-f39e09-5d74949579-6jqsj

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w1-f39e09-f5677f8cd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w1-f39e09-f5677f8cd-dj7jx

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w1-f39e09

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w1-f39e09-5d74949579 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w1-f39e09-f5677f8cd-dj7jx

AddedInterface

Add eth0 [10.133.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-f39e09-f5677f8cd-dj7jx

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-f39e09-5d74949579-6jqsj

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-f39e09-5d74949579-6jqsj

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-w1-f39e09-5d74949579-6jqsj

AddedInterface

Add eth0 [10.133.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-f39e09-5d74949579-6jqsj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-f39e09-f5677f8cd-dj7jx

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-f39e09-f5677f8cd-dj7jx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-shared-a-w1-f39e09-openshift-default-85cf756ddd-9ldvm

ProbeError

Readiness probe error: Get "http://10.134.0.74:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-a-w1-f39e09-openshift-default-85cf756ddd-9ldvm

Unhealthy

Readiness probe failed: Get "http://10.134.0.74:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-f39e09-openshift-default-85cf756ddd-9ldvm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-f39e09-openshift-default-85cf756ddd-9ldvm

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-f39e09-openshift-default-85cf756ddd-9ldvm

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-a-w1-f39e09-openshift-default-85cf756ddd-9ldvm

Unhealthy

Startup probe failed: Get "http://10.134.0.74:15021/healthz/ready": dial tcp 10.134.0.74:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w1-f39e09-openshift-default-85cf756ddd-9ldvm

ProbeError

Startup probe error: Get "http://10.134.0.74:15021/healthz/ready": dial tcp 10.134.0.74:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-shared-b-w1-45446b-openshift-default-64c94999cb

SuccessfulCreate

Created pod: e2e-shared-b-w1-45446b-openshift-default-64c94999cb-fpwlp

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w1-45446b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w1-45446b

openshift-ingress

deployment-controller

e2e-shared-b-w1-45446b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w1-45446b-openshift-default-64c94999cb from 0 to 1

openshift-ingress

multus

e2e-shared-b-w1-45446b-openshift-default-64c94999cb-fpwlp

AddedInterface

Add eth0 [10.132.0.62/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w1-45446b-5f77bf4fbc

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w1-45446b-5f77bf4fbc-92529

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w1-45446b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w1-45446b-789f6d5898 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w1-45446b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w1-45446b-5f77bf4fbc from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w1-45446b-789f6d5898

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w1-45446b-789f6d5898-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w1-45446b: serviceaccount "payload-processing-e2e-shared-b-w1-45446b" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w1-45446b-5f77bf4fbc

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w1-45446b-5f77bf4fbc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w1-45446b: serviceaccount "payload-processing-e2e-shared-b-w1-45446b" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w1-45446b-789f6d5898

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w1-45446b-789f6d5898-z449s

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-45446b-5f77bf4fbc-92529

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-w1-45446b-5f77bf4fbc-92529

AddedInterface

Add eth0 [10.133.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-45446b-5f77bf4fbc-92529

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-45446b-5f77bf4fbc-92529

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-45446b-789f6d5898-z449s

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-45446b-789f6d5898-z449s

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-45446b-789f6d5898-z449s

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w1-45446b-789f6d5898-z449s

AddedInterface

Add eth0 [10.134.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w1-45446b-openshift-default-64c94999cb-fpwlp

Unhealthy

Readiness probe failed: Get "http://10.132.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-b-w1-45446b-openshift-default-64c94999cb-fpwlp

ProbeError

Readiness probe error: Get "http://10.132.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-45446b-openshift-default-64c94999cb-fpwlp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-45446b-openshift-default-64c94999cb-fpwlp

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-45446b-openshift-default-64c94999cb-fpwlp

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w1-45446b-openshift-default-64c94999cb-fpwlp

Unhealthy

Startup probe failed: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w1-45446b-openshift-default-64c94999cb-fpwlp

ProbeError

Startup probe error: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-mt-e7d6db19-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-e7d6db19-openshift-default-6476c67568 from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-e7d6db19-openshift-default-6476c67568

SuccessfulCreate

Created pod: e2e-mt-e7d6db19-openshift-default-6476c67568-mrn26

openshift-ingress

gateway_labeler_controller

e2e-mt-e7d6db19

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-e7d6db19

openshift-ingress

multus

e2e-mt-e7d6db19-openshift-default-6476c67568-mrn26

AddedInterface

Add eth0 [10.134.0.76/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-e7d6db19-77b958bf6b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-e7d6db19-77b958bf6b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-e7d6db19: serviceaccount "payload-processing-e2e-mt-e7d6db19" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-e7d6db19-5cd4d57545

FailedCreate

Error creating: pods "payload-processing-e2e-mt-e7d6db19-5cd4d57545-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-e7d6db19: serviceaccount "payload-processing-e2e-mt-e7d6db19" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-e7d6db19-77b958bf6b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-e7d6db19-77b958bf6b-cbwhw

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-e7d6db19

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-e7d6db19-77b958bf6b from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-mt-e7d6db19

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-e7d6db19-5cd4d57545 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-e7d6db19-5cd4d57545

SuccessfulCreate

Created pod: payload-processing-e2e-mt-e7d6db19-5cd4d57545-9t7zp

openshift-ingress

kubelet

payload-processing-e2e-mt-e7d6db19-5cd4d57545-9t7zp

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-e7d6db19-5cd4d57545-9t7zp

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-e7d6db19-77b958bf6b-cbwhw

AddedInterface

Add eth0 [10.134.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-e7d6db19-77b958bf6b-cbwhw

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-mt-e7d6db19-5cd4d57545-9t7zp

AddedInterface

Add eth0 [10.133.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-e7d6db19-5cd4d57545-9t7zp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-e7d6db19-77b958bf6b-cbwhw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-e7d6db19-77b958bf6b-cbwhw

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-mt-e7d6db19-openshift-default-6476c67568-mrn26

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-e7d6db19-openshift-default-6476c67568-mrn26

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-e7d6db19-openshift-default-6476c67568-mrn26

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-mt-e7d6db19-openshift-default-6476c67568-mrn26

ProbeError

Startup probe error: Get "http://10.134.0.76:15021/healthz/ready": dial tcp 10.134.0.76:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-e7d6db19-openshift-default-6476c67568-mrn26

Unhealthy

Startup probe failed: Get "http://10.134.0.76:15021/healthz/ready": dial tcp 10.134.0.76:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-mt-e7d6db19-5cd4d57545-9t7zp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-e7d6db19-77b958bf6b-cbwhw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-e7d6db19-openshift-default-6476c67568-mrn26

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-ipp-a-089563-openshift-default-dd65bb8b4

SuccessfulCreate

Created pod: e2e-ipp-a-089563-openshift-default-dd65bb8b4-gmmnj

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-089563

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-089563

openshift-ingress

deployment-controller

e2e-ipp-a-089563-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-089563-openshift-default-dd65bb8b4 from 0 to 1

openshift-ingress

multus

e2e-ipp-a-089563-openshift-default-dd65bb8b4-gmmnj

AddedInterface

Add eth0 [10.134.0.81/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-089563

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-089563-6b887d48f5 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-089563

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-089563-756db6b94 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-089563-6b887d48f5

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-089563-6b887d48f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-089563: serviceaccount "payload-processing-e2e-ipp-a-089563" not found

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-089563-756db6b94-2ngrq

AddedInterface

Add eth0 [10.134.0.82/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-089563-6b887d48f5-2c4x2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-089563-756db6b94-2ngrq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-089563-756db6b94

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-089563-756db6b94-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-089563: serviceaccount "payload-processing-e2e-ipp-a-089563" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-089563-756db6b94-2ngrq

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-089563-756db6b94

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-089563-756db6b94-2ngrq

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-089563-6b887d48f5

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-089563-6b887d48f5-2c4x2

openshift-ingress

multus

payload-processing-e2e-ipp-a-089563-6b887d48f5-2c4x2

AddedInterface

Add eth0 [10.134.0.83/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-089563-6b887d48f5-2c4x2

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-089563-6b887d48f5-2c4x2

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-089563-756db6b94-2ngrq

Started

Started container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-api-a-ad13e5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-ad13e5

openshift-ingress

replicaset-controller

e2e-api-a-ad13e5-openshift-default-5466b9c866

SuccessfulCreate

Created pod: e2e-api-a-ad13e5-openshift-default-5466b9c866-8klnl

openshift-ingress

deployment-controller

e2e-api-a-ad13e5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-ad13e5-openshift-default-5466b9c866 from 0 to 1

openshift-ingress

multus

e2e-api-a-ad13e5-openshift-default-5466b9c866-8klnl

AddedInterface

Add eth0 [10.132.0.74/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-ad13e5-64d48d9c7d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-ad13e5-64d48d9c7d-dvgxg
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-ad13e5-59468867bf

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-ad13e5-59468867bf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-ad13e5: serviceaccount "payload-processing-e2e-api-a-ad13e5" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-ad13e5-59468867bf

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-ad13e5-59468867bf-xjs9r

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-ad13e5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-ad13e5-59468867bf from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-ad13e5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-ad13e5-64d48d9c7d from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-ad13e5-64d48d9c7d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-ad13e5-64d48d9c7d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-ad13e5: serviceaccount "payload-processing-e2e-api-a-ad13e5" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-ad13e5-64d48d9c7d-dvgxg

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-ad13e5-64d48d9c7d-dvgxg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-a-ad13e5-64d48d9c7d-dvgxg

AddedInterface

Add eth0 [10.134.0.84/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-api-a-ad13e5-59468867bf-xjs9r

AddedInterface

Add eth0 [10.133.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-ad13e5-59468867bf-xjs9r

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-ad13e5-59468867bf-xjs9r

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-ad13e5-64d48d9c7d-dvgxg

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-ad13e5-59468867bf-xjs9r

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-195f51

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-195f51
(x2)

openshift-ingress

kubelet

e2e-ipp-a-089563-openshift-default-dd65bb8b4-gmmnj

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-089563-openshift-default-dd65bb8b4-gmmnj

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-089563-openshift-default-dd65bb8b4-gmmnj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

multus

e2e-ipp-b-195f51-openshift-default-6cc5dfc99d-hfd9t

AddedInterface

Add eth0 [10.134.0.85/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-b-195f51-openshift-default-6cc5dfc99d

SuccessfulCreate

Created pod: e2e-ipp-b-195f51-openshift-default-6cc5dfc99d-hfd9t

openshift-ingress

deployment-controller

e2e-ipp-b-195f51-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-195f51-openshift-default-6cc5dfc99d from 0 to 1
(x5)

openshift-ingress

kubelet

e2e-ipp-a-089563-openshift-default-dd65bb8b4-gmmnj

ProbeError

Startup probe error: Get "http://10.134.0.81:15021/healthz/ready": dial tcp 10.134.0.81:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-089563-openshift-default-dd65bb8b4-gmmnj

Unhealthy

Startup probe failed: Get "http://10.134.0.81:15021/healthz/ready": dial tcp 10.134.0.81:15021: connect: connection refused
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-195f51-6c8f7975cc

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-195f51-6c8f7975cc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-195f51: serviceaccount "payload-processing-e2e-ipp-b-195f51" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-195f51

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-195f51-5cc698659d from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-195f51-6c8f7975cc

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-195f51-6c8f7975cc-gzrj6

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-195f51

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-195f51-6c8f7975cc from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-195f51-5cc698659d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-195f51-5cc698659d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-195f51: serviceaccount "payload-processing-e2e-ipp-b-195f51" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-195f51-5cc698659d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-195f51-5cc698659d-x8lzl

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-195f51-5cc698659d-x8lzl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-195f51-5cc698659d-x8lzl

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-195f51-6c8f7975cc-gzrj6

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-195f51-6c8f7975cc-gzrj6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-b-195f51-6c8f7975cc-gzrj6

AddedInterface

Add eth0 [10.133.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-195f51-6c8f7975cc-gzrj6

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-195f51-5cc698659d-x8lzl

AddedInterface

Add eth0 [10.133.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-195f51-5cc698659d-x8lzl

Started

Started container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-api-b-00f5c9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-00f5c9

openshift-ingress

deployment-controller

e2e-api-b-00f5c9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-00f5c9-openshift-default-5f4f8877d8 from 0 to 1

openshift-ingress

multus

e2e-api-b-00f5c9-openshift-default-5f4f8877d8-2j6wz

AddedInterface

Add eth0 [10.134.0.90/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-api-b-00f5c9-openshift-default-5f4f8877d8

SuccessfulCreate

Created pod: e2e-api-b-00f5c9-openshift-default-5f4f8877d8-2j6wz
(x2)

openshift-ingress

kubelet

e2e-api-a-ad13e5-openshift-default-5466b9c866-8klnl

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-ad13e5-openshift-default-5466b9c866-8klnl

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-ad13e5-openshift-default-5466b9c866-8klnl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-00f5c9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-00f5c9-5b985bd6d7 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-00f5c9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-00f5c9-7f5cddb44b from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-00f5c9-7f5cddb44b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-00f5c9-7f5cddb44b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-00f5c9: serviceaccount "payload-processing-e2e-api-b-00f5c9" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-00f5c9-5b985bd6d7

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-00f5c9-5b985bd6d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-00f5c9: serviceaccount "payload-processing-e2e-api-b-00f5c9" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-00f5c9-7f5cddb44b-rqx4c

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-00f5c9-5b985bd6d7

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-00f5c9-5b985bd6d7-bnkdx

openshift-ingress

kubelet

payload-processing-e2e-api-b-00f5c9-5b985bd6d7-bnkdx

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-b-00f5c9-7f5cddb44b-rqx4c

AddedInterface

Add eth0 [10.134.0.91/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-api-a-ad13e5-openshift-default-5466b9c866-8klnl

ProbeError

Startup probe error: Get "http://10.132.0.74:15021/healthz/ready": dial tcp 10.132.0.74:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-00f5c9-7f5cddb44b-rqx4c

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-00f5c9-7f5cddb44b-rqx4c

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-00f5c9-5b985bd6d7-bnkdx

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-00f5c9-7f5cddb44b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-00f5c9-7f5cddb44b-rqx4c
(x6)

openshift-ingress

kubelet

e2e-api-a-ad13e5-openshift-default-5466b9c866-8klnl

Unhealthy

Startup probe failed: Get "http://10.132.0.74:15021/healthz/ready": dial tcp 10.132.0.74:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-api-b-00f5c9-5b985bd6d7-bnkdx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-api-b-00f5c9-5b985bd6d7-bnkdx

AddedInterface

Add eth0 [10.133.0.72/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-b-195f51-openshift-default-6cc5dfc99d-hfd9t

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-195f51-openshift-default-6cc5dfc99d-hfd9t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-195f51-openshift-default-6cc5dfc99d-hfd9t

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-b-195f51-openshift-default-6cc5dfc99d-hfd9t

ProbeError

Startup probe error: Get "http://10.134.0.85:15021/healthz/ready": dial tcp 10.134.0.85:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-b-195f51-openshift-default-6cc5dfc99d-hfd9t

Unhealthy

Startup probe failed: Get "http://10.134.0.85:15021/healthz/ready": dial tcp 10.134.0.85:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-api-b-00f5c9-openshift-default-5f4f8877d8-2j6wz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-00f5c9-openshift-default-5f4f8877d8-2j6wz

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-00f5c9-openshift-default-5f4f8877d8-2j6wz

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-b-00f5c9-openshift-default-5f4f8877d8-2j6wz

Unhealthy

Startup probe failed: Get "http://10.134.0.90:15021/healthz/ready": dial tcp 10.134.0.90:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-b-00f5c9-openshift-default-5f4f8877d8-2j6wz

ProbeError

Startup probe error: Get "http://10.134.0.90:15021/healthz/ready": dial tcp 10.134.0.90:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-api-a-ad13e5-59468867bf-xjs9r

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-ad13e5-64d48d9c7d-dvgxg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-a-ad13e5-openshift-default-5466b9c866-8klnl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-api-b-00f5c9-5b985bd6d7-bnkdx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-00f5c9-7f5cddb44b-rqx4c

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-00f5c9-openshift-default-5f4f8877d8-2j6wz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-f39e09-f5677f8cd-dj7jx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-f39e09-5d74949579-6jqsj

Killing

Stopping container payload-processing

openshift-ingress

multus

e2e-ipp-cleanup-f46871-openshift-default-6d978f6dc6-km5hn

AddedInterface

Add eth0 [10.132.0.79/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-f46871-openshift-default-6d978f6dc6

SuccessfulCreate

Created pod: e2e-ipp-cleanup-f46871-openshift-default-6d978f6dc6-km5hn

openshift-ingress

deployment-controller

e2e-ipp-cleanup-f46871-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-f46871-openshift-default-6d978f6dc6 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-f46871

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-f46871

openshift-ingress

kubelet

e2e-shared-a-w1-f39e09-openshift-default-85cf756ddd-9ldvm

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-f46871

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-f46871-5fb4b547f8 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-f46871

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-f46871-788665f459 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-f46871-5fb4b547f8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-f46871-5fb4b547f8-2mc6p

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-f46871-5fb4b547f8-2mc6p

AddedInterface

Add eth0 [10.133.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-f46871-788665f459-4p8zg

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-f46871-788665f459-4p8zg

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-f46871-788665f459

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-f46871-788665f459-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-f46871: serviceaccount "payload-processing-e2e-ipp-cleanup-f46871" not found

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-f46871-788665f459-4p8zg

AddedInterface

Add eth0 [10.133.0.76/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-f46871-788665f459

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-f46871-788665f459-4p8zg
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-f46871-5fb4b547f8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-f46871-5fb4b547f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-f46871: serviceaccount "payload-processing-e2e-ipp-cleanup-f46871" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-f46871-5fb4b547f8-2mc6p

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-f46871-788665f459-4p8zg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-shared-a-w1-f39e09-openshift-default-85cf756ddd-9ldvm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w1-f39e09-openshift-default-85cf756ddd-9ldvm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-f46871-5fb4b547f8-2mc6p

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-f46871-5fb4b547f8-2mc6p

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-45446b-5f77bf4fbc-92529

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-45446b-789f6d5898-z449s

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w1-45446b-openshift-default-64c94999cb-fpwlp

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-f46871-openshift-default-6d978f6dc6-km5hn

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-f46871-openshift-default-6d978f6dc6-km5hn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-f46871-openshift-default-6d978f6dc6-km5hn

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-ipp-cleanup-f46871-openshift-default-6d978f6dc6-km5hn

Unhealthy

Startup probe failed: Get "http://10.132.0.79:15021/healthz/ready": dial tcp 10.132.0.79:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-cleanup-f46871-openshift-default-6d978f6dc6-km5hn

ProbeError

Startup probe error: Get "http://10.132.0.79:15021/healthz/ready": dial tcp 10.132.0.79:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-f46871-5fb4b547f8-2mc6p

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-f46871-788665f459-4p8zg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-f46871-openshift-default-6d978f6dc6-km5hn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-089563-756db6b94-2ngrq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-089563-6b887d48f5-2c4x2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-089563-openshift-default-dd65bb8b4-gmmnj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-195f51-5cc698659d-x8lzl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-195f51-6c8f7975cc-gzrj6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-195f51-openshift-default-6cc5dfc99d-hfd9t

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-f831c5-bd474457c-p7hh4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-f831c5-7fcf9bb6f8-86vjn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w2-f831c5-openshift-default-648cfddf5d-8j74r

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-0ee1bf-589b478bf4-tmjrm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-0ee1bf-9d8459445-ddpbs

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w2-0ee1bf-openshift-default-9d6c8d686-5g8kw

Killing

Stopping container istio-proxy
(x23)

openshift-ingress

kubelet

payload-pre-processing-6cd864bc95-gr57w

FailedToRetrieveImagePullSecret

Unable to retrieve some image pull secrets (payload-processing-dockercfg-2xnr2); attempting to pull the image may not succeed.
(x24)

openshift-ingress

kubelet

payload-processing-5d7dbbd56b-87r96

FailedToRetrieveImagePullSecret

Unable to retrieve some image pull secrets (payload-processing-dockercfg-2xnr2); attempting to pull the image may not succeed.