Time Namespace Component RelatedObject Reason Message

openshift-ingress

e2e-ipp-a-92693f-openshift-default-65fc9f67b8-xg46m

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-92693f-openshift-default-65fc9f67b8-xg46m to ip-10-0-139-244.ec2.internal

openshift-ingress

payload-pre-processing-687dbb6cf6-zbfnf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-687dbb6cf6-zbfnf to ip-10-0-140-80.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-6745bb66bcjgcpn

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjgcpn to ip-10-0-139-244.ec2.internal

openshift-ingress

e2e-mt-4ba182d6-openshift-default-5bffb587f6-vv8lz

Scheduled

Successfully assigned openshift-ingress/e2e-mt-4ba182d6-openshift-default-5bffb587f6-vv8lz to ip-10-0-139-244.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-sxm2r

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-sxm2r to ip-10-0-135-233.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-xq45x

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xq45x to ip-10-0-135-233.ec2.internal

openshift-ingress

e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj to ip-10-0-139-244.ec2.internal

openshift-ingress

payload-processing-e2e-ait-f231d414-557748c7f8-zfrvw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-f231d414-557748c7f8-zfrvw to ip-10-0-140-80.ec2.internal

openshift-ingress

payload-processing-e2e-ait-74f5d728-d5565f77d-jwds5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-74f5d728-d5565f77d-jwds5 to ip-10-0-140-80.ec2.internal

openshift-ingress

payload-processing-5cc6cd444b-8n49r

Scheduled

Successfully assigned openshift-ingress/payload-processing-5cc6cd444b-8n49r to ip-10-0-140-80.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-b9a122-68965657bd-bjsqg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-b9a122-68965657bd-bjsqg to ip-10-0-140-80.ec2.internal

openshift-ingress

e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl

Scheduled

Successfully assigned openshift-ingress/e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl to ip-10-0-139-244.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-13c2c7-7fcff7948-j8zrq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-13c2c7-7fcff7948-j8zrq to ip-10-0-140-80.ec2.internal

openshift-ingress

e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g to ip-10-0-139-244.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-4ba182d6-789699b656-6qb79

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-4ba182d6-789699b656-6qb79 to ip-10-0-140-80.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-47dfc7db-7d7b97cbbd-8lwrj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-47dfc7db-7d7b97cbbd-8lwrj to ip-10-0-140-80.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-ac84f7-6f679bfb5d-fqkb6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-ac84f7-6f679bfb5d-fqkb6 to ip-10-0-140-80.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-dx52n

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-dx52n to ip-10-0-139-244.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-94ab01-79b45ccbcb-mx4cr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-94ab01-79b45ccbcb-mx4cr to ip-10-0-140-80.ec2.internal

openshift-ingress

payload-processing-e2e-derive-72534233-696b549486-gxrw5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-72534233-696b549486-gxrw5 to ip-10-0-140-80.ec2.internal

openshift-ingress

e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv

Scheduled

Successfully assigned openshift-ingress/e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv to ip-10-0-135-233.ec2.internal

openshift-ingress

e2e-ait-74f5d728-openshift-default-8f6cf59db-cljbz

Scheduled

Successfully assigned openshift-ingress/e2e-ait-74f5d728-openshift-default-8f6cf59db-cljbz to ip-10-0-139-244.ec2.internal

openshift-ingress

e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8 to ip-10-0-135-233.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-3f26bc98-6fdd9969b9-79mns

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-3f26bc98-6fdd9969b9-79mns to ip-10-0-140-80.ec2.internal

openshift-ingress

e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz to ip-10-0-139-244.ec2.internal

openshift-ingress

payload-processing-e2e-mt-47dfc7db-7c9994f4db-pp7k8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-47dfc7db-7c9994f4db-pp7k8 to ip-10-0-140-80.ec2.internal

openshift-ingress

e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5 to ip-10-0-139-244.ec2.internal

openshift-ingress

payload-processing-e2e-mt-4ba182d6-55dfccbb66-v784d

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-4ba182d6-55dfccbb66-v784d to ip-10-0-140-80.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-13c2c7-b9974c8cd-2lgkz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-13c2c7-b9974c8cd-2lgkz to ip-10-0-140-80.ec2.internal

openshift-ingress

kube-auth-proxy-8cdf7544b-fxfn4

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-8cdf7544b-fxfn4 to ip-10-0-135-233.ec2.internal

openshift-ingress

e2e-migrate-3f26bc98-gw-openshift-default-c9b78648-gg7g6

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-3f26bc98-gw-openshift-default-c9b78648-gg7g6 to ip-10-0-135-233.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-fgx2r

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fgx2r to ip-10-0-135-233.ec2.internal

openshift-ingress

e2e-ait-f231d414-openshift-default-854d489498-2bfxz

Scheduled

Successfully assigned openshift-ingress/e2e-ait-f231d414-openshift-default-854d489498-2bfxz to ip-10-0-139-244.ec2.internal

openshift-ingress

e2e-ipp-cleanup-201d60-openshift-default-884d7754-c4tft

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-201d60-openshift-default-884d7754-c4tft to ip-10-0-135-233.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-74f5d728-5d67864d96-9dzxv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-74f5d728-5d67864d96-9dzxv to ip-10-0-140-80.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-f231d414-5fdf8688cb-cmzbk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-f231d414-5fdf8688cb-cmzbk to ip-10-0-140-80.ec2.internal

openshift-ingress

e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9 to ip-10-0-135-233.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-ac84f7-545b4dd48d-48brx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-ac84f7-545b4dd48d-48brx to ip-10-0-140-80.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-94ab01-7cccc69dd4-lh22c

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-94ab01-7cccc69dd4-lh22c to ip-10-0-140-80.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-72534233-6d848c4688-d5wx7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-72534233-6d848c4688-d5wx7 to ip-10-0-140-80.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-5e8b71-5fdcc7f66d-znkqq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-5e8b71-5fdcc7f66d-znkqq to ip-10-0-140-80.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-368755-55974c9cfb-m2qsd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-368755-55974c9cfb-m2qsd to ip-10-0-140-80.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-92693f-7458cc6548-kvvrf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-92693f-7458cc6548-kvvrf to ip-10-0-140-80.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-ea8b57-6d64795844-d79bs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-ea8b57-6d64795844-d79bs to ip-10-0-140-80.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-b9a122-79b6bd7478-h9npm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-b9a122-79b6bd7478-h9npm to ip-10-0-140-80.ec2.internal

openshift-ingress

kube-auth-proxy-8cdf7544b-lwnng

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-8cdf7544b-lwnng to ip-10-0-140-80.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-5e8b71-5c9587c4d6-p5vtx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-5e8b71-5c9587c4d6-p5vtx to ip-10-0-140-80.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-3f26bc98-78f5b67484-tcmnt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-3f26bc98-78f5b67484-tcmnt to ip-10-0-140-80.ec2.internal

openshift-ingress

router-default-b8b6894cc-sf8bk

Scheduled

Successfully assigned openshift-ingress/router-default-b8b6894cc-sf8bk to ip-10-0-135-233.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-368755-7986c657d4-cst9m

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-368755-7986c657d4-cst9m to ip-10-0-140-80.ec2.internal

openshift-ingress

e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq to ip-10-0-135-233.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-92693f-5cfcdf9596-7gjlr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-92693f-5cfcdf9596-7gjlr to ip-10-0-140-80.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-ea8b57-5cfd55759b-qwfwg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-ea8b57-5cfd55759b-qwfwg to ip-10-0-140-80.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-201d60-57f647fc58-g549r

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-201d60-57f647fc58-g549r to ip-10-0-140-80.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-201d60-6454dff6d8-kbcfr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-201d60-6454dff6d8-kbcfr to ip-10-0-140-80.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-b8b6894cc from 0 to 1
(x9)

openshift-ingress

replicaset-controller

router-default-b8b6894cc

FailedCreate

Error creating: pods "router-default-b8b6894cc-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x17)

openshift-ingress

replicaset-controller

router-default-b8b6894cc

FailedCreate

Error creating: pods "router-default-b8b6894cc-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-b8b6894cc

SuccessfulCreate

Created pod: router-default-b8b6894cc-sf8bk
(x5)

openshift-ingress

kubelet

router-default-b8b6894cc-sf8bk

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x5)

openshift-ingress

kubelet

router-default-b8b6894cc-sf8bk

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found

openshift-ingress

kubelet

router-default-b8b6894cc-sf8bk

Created

Created container: router

openshift-ingress

kubelet

router-default-b8b6894cc-sf8bk

Started

Started container router

openshift-ingress

kubelet

router-default-b8b6894cc-sf8bk

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559" already present on machine

openshift-ingress

multus

router-default-b8b6894cc-sf8bk

AddedInterface

Add eth0 [10.132.0.12/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

kube-auth-proxy-8cdf7544b

FailedCreate

Error creating: pods "kube-auth-proxy-8cdf7544b-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-8cdf7544b from 0 to 2

openshift-ingress

replicaset-controller

kube-auth-proxy-8cdf7544b

SuccessfulCreate

Created pod: kube-auth-proxy-8cdf7544b-lwnng

openshift-ingress

replicaset-controller

kube-auth-proxy-8cdf7544b

SuccessfulCreate

Created pod: kube-auth-proxy-8cdf7544b-fxfn4

openshift-ingress

kubelet

kube-auth-proxy-8cdf7544b-lwnng

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-8cdf7544b-lwnng

AddedInterface

Add eth0 [10.133.0.19/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-8cdf7544b-fxfn4

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-8cdf7544b-fxfn4

AddedInterface

Add eth0 [10.132.0.30/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-fgx2r

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-fgx2r

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-fgx2r

AddedInterface

Add eth0 [10.132.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-8cdf7544b-lwnng

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-8cdf7544b-lwnng

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-8cdf7544b-lwnng

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.871s (2.871s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-8cdf7544b-fxfn4

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 4.327s (4.327s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-8cdf7544b-fxfn4

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-8cdf7544b-fxfn4

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-fgx2r

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-fgx2r

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-fgx2r

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 4.022s (4.022s including waiting). Image size: 181126104 bytes.

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-6745bb66bc

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-6745bb66bcjgcpn

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-sxm2r

AddedInterface

Add eth0 [10.132.0.34/23] from ovn-kubernetes

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-6745bb66bcjgcpn

AddedInterface

Add eth0 [10.134.0.25/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcjgcpn

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-dx52n

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-fgx2r

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-dx52n

AddedInterface

Add eth0 [10.134.0.26/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-sxm2r

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-fgx2r

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-dx52n

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-sxm2r

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-6745bb66bc from 0 to 1

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-sxm2r

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 3.128s (3.128s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcjgcpn

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-sxm2r

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-sxm2r

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcjgcpn

Created

Created container: istio-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-dx52n

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.792s (3.792s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcjgcpn

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 3.812s (3.812s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-dx52n

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-dx52n

Started

Started container discovery

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-fgx2r

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-fgx2r

Killing

Stopping container discovery

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled down replica set data-science-gateway-data-science-gateway-class-6745bb66bc from 1 to 0

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-6745bb66bc

SuccessfulDelete

Deleted pod: data-science-gateway-data-science-gateway-class-6745bb66bcjgcpn
(x3)

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcjgcpn

Unhealthy

Startup probe failed: Get "http://10.134.0.25:15021/healthz/ready": dial tcp 10.134.0.25:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcjgcpn

ProbeError

Startup probe error: Get "http://10.134.0.25:15021/healthz/ready": dial tcp 10.134.0.25:15021: connect: connection refused body:

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcjgcpn

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-xq45x

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-xq45x

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-687dbb6cf6

SuccessfulCreate

Created pod: payload-pre-processing-687dbb6cf6-zbfnf

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5cc6cd444b from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-5cc6cd444b

SuccessfulCreate

Created pod: payload-processing-5cc6cd444b-8n49r
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-687dbb6cf6

FailedCreate

Error creating: pods "payload-pre-processing-687dbb6cf6-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-687dbb6cf6 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-5cc6cd444b

FailedCreate

Error creating: pods "payload-processing-5cc6cd444b-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-zbfnf

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-5cc6cd444b-8n49r

AddedInterface

Add eth0 [10.133.0.26/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5cc6cd444b-8n49r

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-687dbb6cf6-zbfnf

AddedInterface

Add eth0 [10.133.0.25/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-zbfnf

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-zbfnf

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.42s (2.42s including waiting). Image size: 165776054 bytes.

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-zbfnf

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-5cc6cd444b-8n49r

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-5cc6cd444b-8n49r

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5cc6cd444b-8n49r

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.411s (2.411s including waiting). Image size: 165776054 bytes.
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-xq45x

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-xq45x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-xq45x

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-xq45x

ProbeError

Startup probe error: Get "http://10.132.0.50:15021/healthz/ready": dial tcp 10.132.0.50:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-xq45x

Unhealthy

Startup probe failed: Get "http://10.132.0.50:15021/healthz/ready": dial tcp 10.132.0.50:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-ait-f231d414-openshift-default-854d489498

SuccessfulCreate

Created pod: e2e-ait-f231d414-openshift-default-854d489498-2bfxz

openshift-ingress

GatewayAuthBootstrap

e2e-ait-f231d414

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-ait-f231d414-authn-ssl: envoyfilters.networking.istio.io "e2e-ait-f231d414-authn-ssl" already exists

openshift-ingress

gateway_labeler_controller

e2e-ait-f231d414

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-f231d414

openshift-ingress

deployment-controller

e2e-ait-f231d414-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-f231d414-openshift-default-854d489498 from 0 to 1

openshift-ingress

multus

e2e-ait-f231d414-openshift-default-854d489498-2bfxz

AddedInterface

Add eth0 [10.134.0.31/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ait-f231d414

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-f231d414-557748c7f8 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-f231d414-557748c7f8

FailedCreate

Error creating: pods "payload-processing-e2e-ait-f231d414-557748c7f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-f231d414: serviceaccount "payload-processing-e2e-ait-f231d414" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-f231d414

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-f231d414-5fdf8688cb from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-f231d414-5fdf8688cb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-f231d414-5fdf8688cb-cmzbk
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-f231d414-5fdf8688cb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-f231d414-5fdf8688cb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-f231d414: serviceaccount "payload-processing-e2e-ait-f231d414" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-f231d414-557748c7f8

SuccessfulCreate

Created pod: payload-processing-e2e-ait-f231d414-557748c7f8-zfrvw

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f231d414-5fdf8688cb-cmzbk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-f231d414-5fdf8688cb-cmzbk

AddedInterface

Add eth0 [10.133.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f231d414-5fdf8688cb-cmzbk

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-f231d414-557748c7f8-zfrvw

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f231d414-5fdf8688cb-cmzbk

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-f231d414-557748c7f8-zfrvw

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-f231d414-557748c7f8-zfrvw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-f231d414-557748c7f8-zfrvw

AddedInterface

Add eth0 [10.133.0.32/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ait-f231d414-openshift-default-854d489498-2bfxz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-f231d414-openshift-default-854d489498-2bfxz

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-f231d414-openshift-default-854d489498-2bfxz

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-ait-f231d414-openshift-default-854d489498-2bfxz

ProbeError

Readiness probe error: Get "http://10.134.0.31:15021/healthz/ready": dial tcp 10.134.0.31:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ait-f231d414-openshift-default-854d489498-2bfxz

Unhealthy

Readiness probe failed: Get "http://10.134.0.31:15021/healthz/ready": dial tcp 10.134.0.31:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-f231d414-openshift-default-854d489498-2bfxz

ProbeError

Startup probe error: Get "http://10.134.0.31:15021/healthz/ready": dial tcp 10.134.0.31:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-f231d414-openshift-default-854d489498-2bfxz

Unhealthy

Startup probe failed: Get "http://10.134.0.31:15021/healthz/ready": dial tcp 10.134.0.31:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ait-f231d414-557748c7f8-zfrvw

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ait-f231d414

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ait-f231d414: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ait-f231d414": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ait-f231d414, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 26fbea1e-45c7-4a28-a30b-944523f118b0, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f231d414-5fdf8688cb-cmzbk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-f231d414-openshift-default-854d489498-2bfxz

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-migrate-3f26bc98-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-3f26bc98-gw-openshift-default-c9b78648 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-migrate-3f26bc98-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-3f26bc98-gw

openshift-ingress

replicaset-controller

e2e-migrate-3f26bc98-gw-openshift-default-c9b78648

SuccessfulCreate

Created pod: e2e-migrate-3f26bc98-gw-openshift-default-c9b78648-gg7g6

openshift-ingress

multus

e2e-migrate-3f26bc98-gw-openshift-default-c9b78648-gg7g6

AddedInterface

Add eth0 [10.132.0.63/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-3f26bc98

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-3f26bc98-6fdd9969b9 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-3f26bc98-6fdd9969b9

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-3f26bc98-6fdd9969b9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-3f26bc98: serviceaccount "payload-processing-e2e-migrate-3f26bc98" not found

openshift-ingress

kubelet

payload-processing-e2e-migrate-3f26bc98-6fdd9969b9-79mns

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-3f26bc98-6fdd9969b9-79mns

Created

Created container: payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-3f26bc98

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-3f26bc98-78f5b67484 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-3f26bc98-6fdd9969b9

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-3f26bc98-6fdd9969b9-79mns

openshift-ingress

kubelet

payload-processing-e2e-migrate-3f26bc98-6fdd9969b9-79mns

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-migrate-3f26bc98-78f5b67484-tcmnt

AddedInterface

Add eth0 [10.133.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-3f26bc98-78f5b67484-tcmnt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-3f26bc98-78f5b67484-tcmnt

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-3f26bc98-78f5b67484-tcmnt

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-migrate-3f26bc98-6fdd9969b9-79mns

AddedInterface

Add eth0 [10.133.0.35/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-3f26bc98-78f5b67484

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-3f26bc98-78f5b67484-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-3f26bc98: serviceaccount "payload-processing-e2e-migrate-3f26bc98" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-3f26bc98-78f5b67484

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-3f26bc98-78f5b67484-tcmnt
(x2)

openshift-ingress

kubelet

e2e-migrate-3f26bc98-gw-openshift-default-c9b78648-gg7g6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-3f26bc98-gw-openshift-default-c9b78648-gg7g6

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-3f26bc98-gw-openshift-default-c9b78648-gg7g6

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-migrate-3f26bc98-gw-openshift-default-c9b78648-gg7g6

ProbeError

Startup probe error: Get "http://10.132.0.63:15021/healthz/ready": dial tcp 10.132.0.63:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-migrate-3f26bc98-gw-openshift-default-c9b78648-gg7g6

Unhealthy

Startup probe failed: Get "http://10.132.0.63:15021/healthz/ready": dial tcp 10.132.0.63:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-3f26bc98-78f5b67484-tcmnt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-3f26bc98-6fdd9969b9-79mns

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-migrate-3f26bc98-gw-openshift-default-c9b78648-gg7g6

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ait-74f5d728

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-74f5d728

openshift-ingress

deployment-controller

e2e-ait-74f5d728-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-74f5d728-openshift-default-8f6cf59db from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-74f5d728-openshift-default-8f6cf59db

SuccessfulCreate

Created pod: e2e-ait-74f5d728-openshift-default-8f6cf59db-cljbz

openshift-ingress

multus

e2e-ait-74f5d728-openshift-default-8f6cf59db-cljbz

AddedInterface

Add eth0 [10.134.0.34/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-74f5d728

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-74f5d728-5d67864d96 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ait-74f5d728

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-74f5d728-d5565f77d from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-74f5d728-d5565f77d-jwds5

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-ait-74f5d728-d5565f77d-jwds5

AddedInterface

Add eth0 [10.133.0.36/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-74f5d728-d5565f77d

FailedCreate

Error creating: pods "payload-processing-e2e-ait-74f5d728-d5565f77d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-74f5d728: serviceaccount "payload-processing-e2e-ait-74f5d728" not found

openshift-ingress

kubelet

payload-processing-e2e-ait-74f5d728-d5565f77d-jwds5

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-74f5d728-d5565f77d-jwds5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-74f5d728-d5565f77d

SuccessfulCreate

Created pod: payload-processing-e2e-ait-74f5d728-d5565f77d-jwds5

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-74f5d728-5d67864d96

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-74f5d728-5d67864d96-9dzxv
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-74f5d728-5d67864d96

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-74f5d728-5d67864d96-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-74f5d728: serviceaccount "payload-processing-e2e-ait-74f5d728" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-74f5d728-5d67864d96-9dzxv

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-74f5d728-5d67864d96-9dzxv

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-74f5d728-5d67864d96-9dzxv

AddedInterface

Add eth0 [10.133.0.37/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-74f5d728-5d67864d96-9dzxv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-74f5d728-openshift-default-8f6cf59db-cljbz

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-74f5d728-openshift-default-8f6cf59db-cljbz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-74f5d728-openshift-default-8f6cf59db-cljbz

Created

Created container: istio-proxy
(x4)

openshift-ingress

kubelet

e2e-ait-74f5d728-openshift-default-8f6cf59db-cljbz

Unhealthy

Startup probe failed: Get "http://10.134.0.34:15021/healthz/ready": dial tcp 10.134.0.34:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-ait-74f5d728-openshift-default-8f6cf59db-cljbz

ProbeError

Startup probe error: Get "http://10.134.0.34:15021/healthz/ready": dial tcp 10.134.0.34:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ait-74f5d728-d5565f77d-jwds5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-74f5d728-5d67864d96-9dzxv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-74f5d728-openshift-default-8f6cf59db-cljbz

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv

AddedInterface

Add eth0 [10.132.0.66/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-derive-72534233-openshift-default-f9d6b5f9b

SuccessfulCreate

Created pod: e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv

openshift-ingress

deployment-controller

e2e-derive-72534233-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-72534233-openshift-default-f9d6b5f9b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-derive-72534233

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-72534233

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-72534233-6d848c4688

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-72534233-6d848c4688-d5wx7

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-72534233-696b549486

SuccessfulCreate

Created pod: payload-processing-e2e-derive-72534233-696b549486-gxrw5
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-72534233-696b549486

FailedCreate

Error creating: pods "payload-processing-e2e-derive-72534233-696b549486-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-72534233: serviceaccount "payload-processing-e2e-derive-72534233" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-72534233

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-72534233-6d848c4688 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-derive-72534233

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-72534233-696b549486 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-72534233-6d848c4688

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-72534233-6d848c4688-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-72534233: serviceaccount "payload-processing-e2e-derive-72534233" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-72534233-6d848c4688-d5wx7

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-72534233-6d848c4688-d5wx7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-derive-72534233-696b549486-gxrw5

AddedInterface

Add eth0 [10.133.0.38/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-72534233-696b549486-gxrw5

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-72534233-696b549486-gxrw5

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-derive-72534233-6d848c4688-d5wx7

AddedInterface

Add eth0 [10.133.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-72534233-6d848c4688-d5wx7

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-72534233-696b549486-gxrw5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv

Unhealthy

Startup probe failed: Get "http://10.132.0.66:15021/healthz/ready": dial tcp 10.132.0.66:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv

ProbeError

Startup probe error: Get "http://10.132.0.66:15021/healthz/ready": dial tcp 10.132.0.66:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-72534233-6d848c4688-d5wx7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-72534233-696b549486-gxrw5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-derive-72534233-openshift-default-f9d6b5f9b-9zzfv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-mt-4ba182d6-openshift-default-5bffb587f6

SuccessfulCreate

Created pod: e2e-mt-4ba182d6-openshift-default-5bffb587f6-vv8lz

openshift-ingress

gateway_labeler_controller

e2e-mt-4ba182d6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-4ba182d6

openshift-ingress

deployment-controller

e2e-mt-4ba182d6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-4ba182d6-openshift-default-5bffb587f6 from 0 to 1

openshift-ingress

multus

e2e-mt-4ba182d6-openshift-default-5bffb587f6-vv8lz

AddedInterface

Add eth0 [10.134.0.37/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-4ba182d6-789699b656

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-4ba182d6-789699b656-6qb79
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-4ba182d6-789699b656

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-4ba182d6-789699b656-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-4ba182d6: serviceaccount "payload-processing-e2e-mt-4ba182d6" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-4ba182d6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-4ba182d6-789699b656 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-4ba182d6-55dfccbb66

FailedCreate

Error creating: pods "payload-processing-e2e-mt-4ba182d6-55dfccbb66-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-4ba182d6: serviceaccount "payload-processing-e2e-mt-4ba182d6" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-4ba182d6-55dfccbb66

SuccessfulCreate

Created pod: payload-processing-e2e-mt-4ba182d6-55dfccbb66-v784d

openshift-ingress

deployment-controller

payload-processing-e2e-mt-4ba182d6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-4ba182d6-55dfccbb66 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-4ba182d6-789699b656-6qb79

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-4ba182d6-789699b656-6qb79

AddedInterface

Add eth0 [10.133.0.40/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-mt-4ba182d6-55dfccbb66-v784d

AddedInterface

Add eth0 [10.133.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-4ba182d6-789699b656-6qb79

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-4ba182d6-55dfccbb66-v784d

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-4ba182d6-55dfccbb66-v784d

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-4ba182d6-55dfccbb66-v784d

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-4ba182d6-789699b656-6qb79

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-4ba182d6-openshift-default-5bffb587f6-vv8lz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-4ba182d6-openshift-default-5bffb587f6-vv8lz

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-4ba182d6-openshift-default-5bffb587f6-vv8lz

Created

Created container: istio-proxy
(x4)

openshift-ingress

kubelet

e2e-mt-4ba182d6-openshift-default-5bffb587f6-vv8lz

Unhealthy

Startup probe failed: Get "http://10.134.0.37:15021/healthz/ready": dial tcp 10.134.0.37:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-mt-4ba182d6-openshift-default-5bffb587f6-vv8lz

ProbeError

Startup probe error: Get "http://10.134.0.37:15021/healthz/ready": dial tcp 10.134.0.37:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-4ba182d6-789699b656-6qb79

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-mt-4ba182d6

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-mt-4ba182d6: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-mt-4ba182d6": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-mt-4ba182d6, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: db9843f1-d1e1-4bf0-8b08-a3f72d5b7e95, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-mt-4ba182d6-55dfccbb66-v784d

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-4ba182d6-openshift-default-5bffb587f6-vv8lz

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-mt-47dfc7db-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-47dfc7db-openshift-default-8b84bb6dd from 0 to 1

openshift-ingress

multus

e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-mt-47dfc7db

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-47dfc7db

openshift-ingress

replicaset-controller

e2e-mt-47dfc7db-openshift-default-8b84bb6dd

SuccessfulCreate

Created pod: e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-47dfc7db-7d7b97cbbd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-47dfc7db-7d7b97cbbd-8lwrj
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-47dfc7db-7d7b97cbbd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-47dfc7db-7d7b97cbbd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-47dfc7db: serviceaccount "payload-processing-e2e-mt-47dfc7db" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-47dfc7db

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-47dfc7db-7c9994f4db from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-47dfc7db

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-47dfc7db-7d7b97cbbd from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-47dfc7db-7c9994f4db

SuccessfulCreate

Created pod: payload-processing-e2e-mt-47dfc7db-7c9994f4db-pp7k8
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-47dfc7db-7c9994f4db

FailedCreate

Error creating: pods "payload-processing-e2e-mt-47dfc7db-7c9994f4db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-47dfc7db: serviceaccount "payload-processing-e2e-mt-47dfc7db" not found

openshift-ingress

kubelet

payload-processing-e2e-mt-47dfc7db-7c9994f4db-pp7k8

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-47dfc7db-7c9994f4db-pp7k8

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-47dfc7db-7d7b97cbbd-8lwrj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-47dfc7db-7c9994f4db-pp7k8

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-47dfc7db-7c9994f4db-pp7k8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-mt-47dfc7db-7d7b97cbbd-8lwrj

AddedInterface

Add eth0 [10.133.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-47dfc7db-7d7b97cbbd-8lwrj

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-47dfc7db-7d7b97cbbd-8lwrj

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl

Unhealthy

Readiness probe failed: Get "http://10.134.0.39:15021/healthz/ready": read tcp 10.134.0.2:46590->10.134.0.39:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl

ProbeError

Readiness probe error: Get "http://10.134.0.39:15021/healthz/ready": read tcp 10.134.0.2:46590->10.134.0.39:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl

ProbeError

Startup probe error: Get "http://10.134.0.39:15021/healthz/ready": dial tcp 10.134.0.39:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl

Unhealthy

Startup probe failed: Get "http://10.134.0.39:15021/healthz/ready": dial tcp 10.134.0.39:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-47dfc7db-7d7b97cbbd-8lwrj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-47dfc7db-7c9994f4db-pp7k8

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-mt-47dfc7db

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-mt-47dfc7db: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-mt-47dfc7db": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-mt-47dfc7db, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 7176a9c8-2422-4611-b8a4-582d18d2e15f, UID in object meta:

openshift-ingress

kubelet

e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl

ProbeError

Readiness probe error: Get "http://10.134.0.39:15021/healthz/ready": dial tcp 10.134.0.39:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl

Unhealthy

Readiness probe failed: Get "http://10.134.0.39:15021/healthz/ready": dial tcp 10.134.0.39:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-inf-a-5e8b71

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-5e8b71

openshift-ingress

deployment-controller

e2e-inf-a-5e8b71-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-5e8b71-openshift-default-579476bdb6 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-5e8b71-openshift-default-579476bdb6

SuccessfulCreate

Created pod: e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj

openshift-ingress

multus

e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-5e8b71-5c9587c4d6

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-5e8b71-5c9587c4d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-5e8b71: serviceaccount "payload-processing-e2e-inf-a-5e8b71" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-5e8b71

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-5e8b71-5c9587c4d6 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-5e8b71

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-5e8b71-5fdcc7f66d from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-5e8b71-5fdcc7f66d-znkqq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-5e8b71-5fdcc7f66d-znkqq

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-5e8b71-5fdcc7f66d-znkqq

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-5e8b71-5c9587c4d6-p5vtx

Started

Started container payload-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-5e8b71-5fdcc7f66d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-5e8b71-5fdcc7f66d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-5e8b71: serviceaccount "payload-processing-e2e-inf-a-5e8b71" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-5e8b71-5fdcc7f66d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-5e8b71-5fdcc7f66d-znkqq

openshift-ingress

kubelet

payload-processing-e2e-inf-a-5e8b71-5c9587c4d6-p5vtx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-a-5e8b71-5c9587c4d6-p5vtx

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-inf-a-5e8b71-5c9587c4d6-p5vtx

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-5e8b71-5fdcc7f66d-znkqq

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-5e8b71-5c9587c4d6

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-5e8b71-5c9587c4d6-p5vtx

openshift-ingress

deployment-controller

e2e-inf-b-368755-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-368755-openshift-default-7c5c499884 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-368755-openshift-default-7c5c499884

SuccessfulCreate

Created pod: e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g

openshift-ingress

gateway_labeler_controller

e2e-inf-b-368755

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-368755

openshift-ingress

multus

e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-368755-7986c657d4

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-368755-7986c657d4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-368755: serviceaccount "payload-processing-e2e-inf-b-368755" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-368755

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-368755-55974c9cfb from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-368755-55974c9cfb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-368755-55974c9cfb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-368755: serviceaccount "payload-processing-e2e-inf-b-368755" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-368755

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-368755-7986c657d4 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-368755-7986c657d4

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-368755-7986c657d4-cst9m

openshift-ingress

kubelet

payload-processing-e2e-inf-b-368755-7986c657d4-cst9m

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-368755-7986c657d4-cst9m

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-inf-b-368755-7986c657d4-cst9m

AddedInterface

Add eth0 [10.133.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-368755-7986c657d4-cst9m

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-368755-55974c9cfb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-368755-55974c9cfb-m2qsd

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-368755-55974c9cfb-m2qsd

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-368755-55974c9cfb-m2qsd

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-368755-55974c9cfb-m2qsd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-368755-55974c9cfb-m2qsd

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-5e8b71-5fdcc7f66d-znkqq

Unhealthy

Readiness probe failed: dial tcp 10.133.0.45:9004: connect: connection refused

openshift-ingress

kubelet

e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj

ProbeError

Readiness probe error: Get "http://10.134.0.41:15021/healthz/ready": read tcp 10.134.0.2:34728->10.134.0.41:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj

Unhealthy

Readiness probe failed: Get "http://10.134.0.41:15021/healthz/ready": read tcp 10.134.0.2:34728->10.134.0.41:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj

Unhealthy

Startup probe failed: Get "http://10.134.0.41:15021/healthz/ready": dial tcp 10.134.0.41:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj

ProbeError

Startup probe error: Get "http://10.134.0.41:15021/healthz/ready": dial tcp 10.134.0.41:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g

Unhealthy

Startup probe failed: Get "http://10.134.0.42:15021/healthz/ready": dial tcp 10.134.0.42:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g

ProbeError

Startup probe error: Get "http://10.134.0.42:15021/healthz/ready": dial tcp 10.134.0.42:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-inf-a-5e8b71-5c9587c4d6-p5vtx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-5e8b71-5fdcc7f66d-znkqq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj

ProbeError

Readiness probe error: Get "http://10.134.0.41:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj

Unhealthy

Readiness probe failed: Get "http://10.134.0.41:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-368755-55974c9cfb-m2qsd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-368755-7986c657d4-cst9m

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-api-a-ac84f7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-ac84f7

openshift-ingress

kubelet

e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-api-a-ac84f7-openshift-default-76c7cf4986

SuccessfulCreate

Created pod: e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq

openshift-ingress

multus

e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq

AddedInterface

Add eth0 [10.132.0.74/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-api-a-ac84f7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-ac84f7-openshift-default-76c7cf4986 from 0 to 1

openshift-ingress

kubelet

e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-ac84f7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-ac84f7-545b4dd48d from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-ac84f7-545b4dd48d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-ac84f7-545b4dd48d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-ac84f7: serviceaccount "payload-processing-e2e-api-a-ac84f7" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-ac84f7-6f679bfb5d

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-ac84f7-6f679bfb5d-fqkb6

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-ac84f7-545b4dd48d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-ac84f7-545b4dd48d-48brx

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-ac84f7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-ac84f7-6f679bfb5d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-ac84f7-6f679bfb5d

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-ac84f7-6f679bfb5d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-ac84f7: serviceaccount "payload-processing-e2e-api-a-ac84f7" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-ac84f7-545b4dd48d-48brx

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-a-ac84f7-545b4dd48d-48brx

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-api-a-ac84f7-6f679bfb5d-fqkb6

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-ac84f7-545b4dd48d-48brx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-ac84f7-545b4dd48d-48brx

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-ac84f7-6f679bfb5d-fqkb6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-a-ac84f7-6f679bfb5d-fqkb6

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-ac84f7-6f679bfb5d-fqkb6

Started

Started container payload-processing

openshift-ingress

replicaset-controller

e2e-api-b-94ab01-openshift-default-7d6fd48c76

SuccessfulCreate

Created pod: e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz

openshift-ingress

multus

e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-api-b-94ab01

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-94ab01

openshift-ingress

deployment-controller

e2e-api-b-94ab01-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-94ab01-openshift-default-7d6fd48c76 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-94ab01

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-94ab01-7cccc69dd4 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-94ab01-79b45ccbcb

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-94ab01-79b45ccbcb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-94ab01: serviceaccount "payload-processing-e2e-api-b-94ab01" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-94ab01-79b45ccbcb

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-94ab01-79b45ccbcb-mx4cr

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-94ab01

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-94ab01-79b45ccbcb from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-94ab01-7cccc69dd4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-94ab01-7cccc69dd4-lh22c
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-94ab01-7cccc69dd4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-94ab01-7cccc69dd4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-94ab01: serviceaccount "payload-processing-e2e-api-b-94ab01" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-94ab01-7cccc69dd4-lh22c

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-api-b-94ab01-79b45ccbcb-mx4cr

AddedInterface

Add eth0 [10.133.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-94ab01-7cccc69dd4-lh22c

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-94ab01-79b45ccbcb-mx4cr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-b-94ab01-7cccc69dd4-lh22c

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-94ab01-7cccc69dd4-lh22c

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-b-94ab01-79b45ccbcb-mx4cr

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-94ab01-79b45ccbcb-mx4cr

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq

Unhealthy

Readiness probe failed: Get "http://10.132.0.74:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq

ProbeError

Readiness probe error: Get "http://10.132.0.74:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq

Unhealthy

Startup probe failed: Get "http://10.132.0.74:15021/healthz/ready": dial tcp 10.132.0.74:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq

ProbeError

Startup probe error: Get "http://10.132.0.74:15021/healthz/ready": dial tcp 10.132.0.74:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz

ProbeError

Readiness probe error: Get "http://10.134.0.45:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz

Unhealthy

Readiness probe failed: Get "http://10.134.0.45:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz

ProbeError

Startup probe error: Get "http://10.134.0.45:15021/healthz/ready": dial tcp 10.134.0.45:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz

Unhealthy

Startup probe failed: Get "http://10.134.0.45:15021/healthz/ready": dial tcp 10.134.0.45:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-api-a-ac84f7-6f679bfb5d-fqkb6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-ac84f7-545b4dd48d-48brx

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-api-a-ac84f7

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-api-a-ac84f7: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-api-a-ac84f7": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-api-a-ac84f7, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 3365f28e-f0a0-4999-9a8a-b846643402d6, UID in object meta:

openshift-ingress

kubelet

e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-a-ac84f7-openshift-default-76c7cf4986-bt5jq

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-94ab01-7cccc69dd4-lh22c

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-94ab01-79b45ccbcb-mx4cr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

GatewayAuthBootstrap

e2e-shared-a-13c2c7

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-shared-a-13c2c7-authn-ssl: envoyfilters.networking.istio.io "e2e-shared-a-13c2c7-authn-ssl" already exists

openshift-ingress

kubelet

e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

gateway_labeler_controller

e2e-shared-a-13c2c7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-13c2c7

openshift-ingress

replicaset-controller

e2e-shared-a-13c2c7-openshift-default-7789df65fb

SuccessfulCreate

Created pod: e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8

openshift-ingress

deployment-controller

e2e-shared-a-13c2c7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-13c2c7-openshift-default-7789df65fb from 0 to 1

openshift-ingress

multus

e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8

AddedInterface

Add eth0 [10.132.0.76/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-13c2c7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-13c2c7-b9974c8cd from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-13c2c7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-13c2c7-7fcff7948 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-a-13c2c7-b9974c8cd-2lgkz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-13c2c7-7fcff7948-j8zrq

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-13c2c7-7fcff7948-j8zrq

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-13c2c7-7fcff7948-j8zrq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-13c2c7-7fcff7948-j8zrq

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-13c2c7-b9974c8cd

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-13c2c7-b9974c8cd-2lgkz

openshift-ingress

multus

payload-processing-e2e-shared-a-13c2c7-b9974c8cd-2lgkz

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-13c2c7-b9974c8cd

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-13c2c7-b9974c8cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-13c2c7: serviceaccount "payload-processing-e2e-shared-a-13c2c7" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-a-13c2c7-b9974c8cd-2lgkz

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-13c2c7-b9974c8cd-2lgkz

Created

Created container: payload-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-13c2c7-7fcff7948

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-13c2c7-7fcff7948-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-13c2c7: serviceaccount "payload-processing-e2e-shared-a-13c2c7" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-13c2c7-7fcff7948

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-13c2c7-7fcff7948-j8zrq

openshift-ingress

multus

e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-b-b9a122-openshift-default-7649d9947b

SuccessfulCreate

Created pod: e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5

openshift-ingress

deployment-controller

e2e-shared-b-b9a122-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-b9a122-openshift-default-7649d9947b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-b9a122

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-b9a122
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-b9a122-79b6bd7478

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-b9a122-79b6bd7478-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-b9a122: serviceaccount "payload-processing-e2e-shared-b-b9a122" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-b9a122

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-b9a122-68965657bd from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-b9a122

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-b9a122-79b6bd7478 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-b9a122-68965657bd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-b9a122-68965657bd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-b9a122: serviceaccount "payload-processing-e2e-shared-b-b9a122" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-b-b9a122-79b6bd7478-h9npm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-b-b9a122-79b6bd7478-h9npm

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-b9a122-68965657bd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-b9a122-68965657bd-bjsqg

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-b9a122-68965657bd-bjsqg

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-b9a122-68965657bd-bjsqg

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-b9a122-68965657bd-bjsqg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-b9a122-79b6bd7478-h9npm

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-b9a122-79b6bd7478-h9npm

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-b9a122-79b6bd7478

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-b9a122-79b6bd7478-h9npm

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-b9a122-68965657bd-bjsqg

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8

Unhealthy

Readiness probe failed: Get "http://10.132.0.76:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8

ProbeError

Readiness probe error: Get "http://10.132.0.76:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8

Unhealthy

Startup probe failed: Get "http://10.132.0.76:15021/healthz/ready": dial tcp 10.132.0.76:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8

ProbeError

Startup probe error: Get "http://10.132.0.76:15021/healthz/ready": dial tcp 10.132.0.76:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5

Unhealthy

Readiness probe failed: Get "http://10.134.0.49:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5

ProbeError

Readiness probe error: Get "http://10.134.0.49:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5

ProbeError

Startup probe error: Get "http://10.134.0.49:15021/healthz/ready": dial tcp 10.134.0.49:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5

Unhealthy

Startup probe failed: Get "http://10.134.0.49:15021/healthz/ready": dial tcp 10.134.0.49:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-ipp-a-92693f-openshift-default-65fc9f67b8

SuccessfulCreate

Created pod: e2e-ipp-a-92693f-openshift-default-65fc9f67b8-xg46m

openshift-ingress

deployment-controller

e2e-ipp-a-92693f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-92693f-openshift-default-65fc9f67b8 from 0 to 1

openshift-ingress

multus

e2e-ipp-a-92693f-openshift-default-65fc9f67b8-xg46m

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-92693f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-92693f

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-92693f-7458cc6548-kvvrf

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-92693f-7458cc6548

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-92693f-7458cc6548-kvvrf
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-92693f-7458cc6548

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-92693f-7458cc6548-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-92693f: serviceaccount "payload-processing-e2e-ipp-a-92693f" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-92693f-5cfcdf9596

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-92693f-5cfcdf9596-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-92693f: serviceaccount "payload-processing-e2e-ipp-a-92693f" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-92693f-5cfcdf9596

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-92693f-5cfcdf9596-7gjlr

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-92693f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-92693f-5cfcdf9596 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-92693f-5cfcdf9596-7gjlr

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-92693f-5cfcdf9596-7gjlr

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-92693f-7458cc6548-kvvrf

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-92693f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-92693f-7458cc6548 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-92693f-5cfcdf9596-7gjlr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-a-92693f-5cfcdf9596-7gjlr

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-92693f-7458cc6548-kvvrf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-92693f-7458cc6548-kvvrf

AddedInterface

Add eth0 [10.133.0.62/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-a-92693f-openshift-default-65fc9f67b8-xg46m

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-92693f-openshift-default-65fc9f67b8-xg46m

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-92693f-openshift-default-65fc9f67b8-xg46m

Started

Started container istio-proxy

openshift-ingress

replicaset-controller

e2e-ipp-b-ea8b57-openshift-default-74f6994d88

SuccessfulCreate

Created pod: e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9

openshift-ingress

deployment-controller

e2e-ipp-b-ea8b57-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-ea8b57-openshift-default-74f6994d88 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-ea8b57

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-ea8b57

openshift-ingress

multus

e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9

AddedInterface

Add eth0 [10.132.0.84/23] from ovn-kubernetes
(x4)

openshift-ingress

kubelet

e2e-ipp-a-92693f-openshift-default-65fc9f67b8-xg46m

Unhealthy

Startup probe failed: Get "http://10.134.0.54:15021/healthz/ready": dial tcp 10.134.0.54:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-ipp-a-92693f-openshift-default-65fc9f67b8-xg46m

ProbeError

Startup probe error: Get "http://10.134.0.54:15021/healthz/ready": dial tcp 10.134.0.54:15021: connect: connection refused body:
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-ea8b57-5cfd55759b

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-ea8b57-5cfd55759b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-ea8b57: serviceaccount "payload-processing-e2e-ipp-b-ea8b57" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-ea8b57

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-ea8b57-6d64795844 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-ea8b57-6d64795844

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-ea8b57-6d64795844-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-ea8b57: serviceaccount "payload-processing-e2e-ipp-b-ea8b57" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-ea8b57-5cfd55759b

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-ea8b57-5cfd55759b-qwfwg

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-ea8b57

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-ea8b57-5cfd55759b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-ea8b57-6d64795844

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-ea8b57-6d64795844-d79bs

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-ea8b57-6d64795844-d79bs

AddedInterface

Add eth0 [10.133.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-ea8b57-5cfd55759b-qwfwg

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-ipp-b-ea8b57-5cfd55759b-qwfwg

AddedInterface

Add eth0 [10.133.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-ea8b57-6d64795844-d79bs

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-ea8b57-5cfd55759b-qwfwg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-ea8b57-6d64795844-d79bs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-ea8b57-5cfd55759b-qwfwg

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-ea8b57-6d64795844-d79bs

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9

Unhealthy

Startup probe failed: Get "http://10.132.0.84:15021/healthz/ready": dial tcp 10.132.0.84:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9

ProbeError

Startup probe error: Get "http://10.132.0.84:15021/healthz/ready": dial tcp 10.132.0.84:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-201d60

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-201d60

openshift-ingress

multus

e2e-ipp-cleanup-201d60-openshift-default-884d7754-c4tft

AddedInterface

Add eth0 [10.132.0.85/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-201d60-openshift-default-884d7754

SuccessfulCreate

Created pod: e2e-ipp-cleanup-201d60-openshift-default-884d7754-c4tft

openshift-ingress

deployment-controller

e2e-ipp-cleanup-201d60-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-201d60-openshift-default-884d7754 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-201d60-57f647fc58

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-201d60-57f647fc58-g549r

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-201d60

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-201d60-6454dff6d8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-201d60-6454dff6d8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-201d60-6454dff6d8-kbcfr

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-201d60

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-201d60-57f647fc58 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-201d60-6454dff6d8-kbcfr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-201d60-57f647fc58-g549r

AddedInterface

Add eth0 [10.133.0.68/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-201d60-6454dff6d8-kbcfr

AddedInterface

Add eth0 [10.133.0.67/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-201d60-57f647fc58

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-201d60-57f647fc58-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-201d60: serviceaccount "payload-processing-e2e-ipp-cleanup-201d60" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-201d60-6454dff6d8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-201d60-6454dff6d8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-201d60: serviceaccount "payload-processing-e2e-ipp-cleanup-201d60" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-201d60-57f647fc58-g549r

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-201d60-57f647fc58-g549r

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-201d60-57f647fc58-g549r

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-201d60-6454dff6d8-kbcfr

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-201d60-6454dff6d8-kbcfr

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-201d60-openshift-default-884d7754-c4tft

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-201d60-openshift-default-884d7754-c4tft

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-201d60-openshift-default-884d7754-c4tft

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-ipp-cleanup-201d60-openshift-default-884d7754-c4tft

ProbeError

Startup probe error: Get "http://10.132.0.85:15021/healthz/ready": dial tcp 10.132.0.85:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-ipp-cleanup-201d60-openshift-default-884d7754-c4tft

Unhealthy

Startup probe failed: Get "http://10.132.0.85:15021/healthz/ready": dial tcp 10.132.0.85:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-201d60-57f647fc58-g549r

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-201d60-6454dff6d8-kbcfr

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-cleanup-201d60

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-201d60: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-cleanup-201d60": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-201d60, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 76b0cb9c-c8bb-4783-8131-c12f7ec12eb2, UID in object meta:

openshift-ingress

kubelet

e2e-ipp-cleanup-201d60-openshift-default-884d7754-c4tft

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-92693f-7458cc6548-kvvrf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-92693f-5cfcdf9596-7gjlr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-92693f-openshift-default-65fc9f67b8-xg46m

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-ea8b57-5cfd55759b-qwfwg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-ea8b57-6d64795844-d79bs

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-b-ea8b57-openshift-default-74f6994d88-2b6l9

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-shared-a-13c2c7-b9974c8cd-2lgkz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-13c2c7-7fcff7948-j8zrq

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-a-13c2c7

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-a-13c2c7: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-a-13c2c7": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-a-13c2c7, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: b9693c1b-59b3-4c1f-b01c-8ba215d315f8, UID in object meta:

openshift-ingress

endpoint-slice-controller

payload-pre-processing-e2e-shared-a-13c2c7

FailedToUpdateEndpointSlices

Error updating Endpoint Slices for Service openshift-ingress/payload-pre-processing-e2e-shared-a-13c2c7: failed to update payload-pre-processing-e2e-shared-a-13c2c7-l7lnk EndpointSlice for Service openshift-ingress/payload-pre-processing-e2e-shared-a-13c2c7: endpointslices.discovery.k8s.io "payload-pre-processing-e2e-shared-a-13c2c7-l7lnk" not found

openshift-ingress

kubelet

e2e-shared-a-13c2c7-openshift-default-7789df65fb-sdrh8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-b9a122-79b6bd7478-h9npm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-b9a122-68965657bd-bjsqg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5

Killing

Stopping container istio-proxy