Time Namespace Component RelatedObject Reason Message

openshift-ingress

e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk to ip-10-0-132-44.ec2.internal

openshift-ingress

payload-processing-e2e-mt-ec1b3fa4-67f58b667d-xqpzg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-ec1b3fa4-67f58b667d-xqpzg to ip-10-0-132-238.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-7d2c59-5b64ff7d94-f2ldx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-7d2c59-5b64ff7d94-f2ldx to ip-10-0-132-238.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-vkh84

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vkh84 to ip-10-0-138-250.ec2.internal

openshift-ingress

e2e-shared-a-73e2fd-openshift-default-d6f49dbb8-p2v22

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-73e2fd-openshift-default-d6f49dbb8-p2v22 to ip-10-0-132-44.ec2.internal

openshift-ingress

e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt

Scheduled

Successfully assigned openshift-ingress/e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt to ip-10-0-132-44.ec2.internal

openshift-ingress

kube-auth-proxy-fbf9bd945-lp78h

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-fbf9bd945-lp78h to ip-10-0-138-250.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-c08eabd1-677b795cc6-mgh92

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-c08eabd1-677b795cc6-mgh92 to ip-10-0-132-238.ec2.internal

openshift-ingress

e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8

Scheduled

Successfully assigned openshift-ingress/e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8 to ip-10-0-132-44.ec2.internal

openshift-ingress

kube-auth-proxy-fbf9bd945-z8bb2

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-fbf9bd945-z8bb2 to ip-10-0-132-238.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-c69ac9dc-ccfb694b8-lsphj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-c69ac9dc-ccfb694b8-lsphj to ip-10-0-132-238.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-ec1b3fa4-5d76895856-m27qb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-ec1b3fa4-5d76895856-m27qb to ip-10-0-132-238.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-73e2fd-bf98b6b4d-2gvvf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-73e2fd-bf98b6b4d-2gvvf to ip-10-0-132-238.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-7d2c59-555b74ccfb-9cj7f

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-7d2c59-555b74ccfb-9cj7f to ip-10-0-132-238.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-2cd0f2-7644b5c596-m77kc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-2cd0f2-7644b5c596-m77kc to ip-10-0-132-238.ec2.internal

openshift-ingress

payload-processing-5cc6cd444b-8gzgx

Scheduled

Successfully assigned openshift-ingress/payload-processing-5cc6cd444b-8gzgx to ip-10-0-132-44.ec2.internal

openshift-ingress

e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz

Scheduled

Successfully assigned openshift-ingress/e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz to ip-10-0-132-44.ec2.internal

openshift-ingress

e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj to ip-10-0-132-44.ec2.internal

openshift-ingress

e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb

Scheduled

Successfully assigned openshift-ingress/e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb to ip-10-0-132-44.ec2.internal

openshift-ingress

e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v

Scheduled

Successfully assigned openshift-ingress/e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v to ip-10-0-132-44.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-1a2510d6-7dc9f557b4-dwjxj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-1a2510d6-7dc9f557b4-dwjxj to ip-10-0-132-238.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-3940b7-54c4b89c8d-gw8lv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-3940b7-54c4b89c8d-gw8lv to ip-10-0-132-238.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-64a682-5fdb6db6d4-nxxnt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-64a682-5fdb6db6d4-nxxnt to ip-10-0-132-238.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-e0fd3dac-54cd9bf544-5gsh9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-e0fd3dac-54cd9bf544-5gsh9 to ip-10-0-132-238.ec2.internal

openshift-ingress

e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4 to ip-10-0-132-44.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-0dbe3ebb-857dd5c7c6-4975j

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-0dbe3ebb-857dd5c7c6-4975j to ip-10-0-132-238.ec2.internal

openshift-ingress

e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t to ip-10-0-132-44.ec2.internal

openshift-ingress

payload-processing-e2e-ait-0dbe3ebb-69f846bb86-sjsqw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-0dbe3ebb-69f846bb86-sjsqw to ip-10-0-132-238.ec2.internal

openshift-ingress

router-default-5b886669c7-2wtgq

Scheduled

Successfully assigned openshift-ingress/router-default-5b886669c7-2wtgq to ip-10-0-132-44.ec2.internal

openshift-ingress

router-default-5b886669c7-2wtgq

FailedScheduling

0/1 nodes are available: 1 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.

openshift-ingress

e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x to ip-10-0-132-44.ec2.internal

openshift-ingress

payload-pre-processing-687dbb6cf6-fss7v

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-687dbb6cf6-fss7v to ip-10-0-132-44.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-f9t7x

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-f9t7x to ip-10-0-138-250.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-68cf4d799cjd8vc

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjd8vc to ip-10-0-132-44.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-64a682-cf87788c8-flb78

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-64a682-cf87788c8-flb78 to ip-10-0-132-238.ec2.internal

openshift-ingress

payload-processing-e2e-mt-c69ac9dc-6b8f45bc7d-b8tdd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-c69ac9dc-6b8f45bc7d-b8tdd to ip-10-0-132-238.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-c08eabd1-968885bf-dslxg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-c08eabd1-968885bf-dslxg to ip-10-0-132-238.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-f67c19-cf6c5f756-x9s8x

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-f67c19-cf6c5f756-x9s8x to ip-10-0-132-238.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-2cd0f2-7bdc79f768-gx679

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-2cd0f2-7bdc79f768-gx679 to ip-10-0-132-238.ec2.internal

openshift-ingress

payload-processing-e2e-derive-1a2510d6-5998cc4fdb-whhf7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-1a2510d6-5998cc4fdb-whhf7 to ip-10-0-132-238.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-3940b7-758c87d88-bksxm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-3940b7-758c87d88-bksxm to ip-10-0-132-238.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-73e2fd-66b47b8c4b-k92h4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-73e2fd-66b47b8c4b-k92h4 to ip-10-0-132-238.ec2.internal

openshift-ingress

payload-processing-e2e-ait-e0fd3dac-77dc586d88-4w7dk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-e0fd3dac-77dc586d88-4w7dk to ip-10-0-132-238.ec2.internal

openshift-ingress

e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp to ip-10-0-132-44.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-f67c19-f9bcc4b9b-qzp7m

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-f67c19-f9bcc4b9b-qzp7m to ip-10-0-132-238.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-5ccb968c66-8fg5c

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8fg5c to ip-10-0-132-44.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-5b886669c7 from 0 to 1
(x12)

openshift-ingress

replicaset-controller

router-default-5b886669c7

FailedCreate

Error creating: pods "router-default-5b886669c7-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x16)

openshift-ingress

replicaset-controller

router-default-5b886669c7

FailedCreate

Error creating: pods "router-default-5b886669c7-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

replicaset-controller

router-default-5b886669c7

SuccessfulCreate

Created pod: router-default-5b886669c7-2wtgq
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts
(x6)

openshift-ingress

kubelet

router-default-5b886669c7-2wtgq

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x6)

openshift-ingress

kubelet

router-default-5b886669c7-2wtgq

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found

openshift-ingress

kubelet

router-default-5b886669c7-2wtgq

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559" already present on machine

openshift-ingress

kubelet

router-default-5b886669c7-2wtgq

Started

Started container router

openshift-ingress

kubelet

router-default-5b886669c7-2wtgq

Created

Created container: router

openshift-ingress

multus

router-default-5b886669c7-2wtgq

AddedInterface

Add eth0 [10.132.0.6/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-fbf9bd945-z8bb2

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-fbf9bd945

SuccessfulCreate

Created pod: kube-auth-proxy-fbf9bd945-lp78h

openshift-ingress

replicaset-controller

kube-auth-proxy-fbf9bd945

SuccessfulCreate

Created pod: kube-auth-proxy-fbf9bd945-z8bb2

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-fbf9bd945 from 0 to 2
(x5)

openshift-ingress

replicaset-controller

kube-auth-proxy-fbf9bd945

FailedCreate

Error creating: pods "kube-auth-proxy-fbf9bd945-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

kubelet

kube-auth-proxy-fbf9bd945-lp78h

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

multus

kube-auth-proxy-fbf9bd945-z8bb2

AddedInterface

Add eth0 [10.134.0.25/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-fbf9bd945-z8bb2

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-vkh84

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

multus

kube-auth-proxy-fbf9bd945-lp78h

AddedInterface

Add eth0 [10.133.0.16/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-fbf9bd945-lp78h

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-vkh84

AddedInterface

Add eth0 [10.133.0.18/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-vkh84

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

kube-auth-proxy-fbf9bd945-z8bb2

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-fbf9bd945-z8bb2

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-fbf9bd945-z8bb2

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.596s (2.596s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-vkh84

Created

Created container: discovery

openshift-ingress

kubelet

kube-auth-proxy-fbf9bd945-lp78h

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-fbf9bd945-lp78h

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-fbf9bd945-lp78h

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 5.049s (5.05s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-vkh84

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-vkh84

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 4.454s (4.454s including waiting). Image size: 181126104 bytes.

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-f9t7x

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-vkh84

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-vkh84

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-68cf4d799c from 0 to 1

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-68cf4d799c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-68cf4d799cjd8vc

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cjd8vc

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-f9t7x

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-f9t7x

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-f9t7x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" already present on machine

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-f9t7x

AddedInterface

Add eth0 [10.133.0.19/23] from ovn-kubernetes

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-68cf4d799cjd8vc

AddedInterface

Add eth0 [10.132.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-f9t7x

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-f9t7x

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-vkh84

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-vkh84

Killing

Stopping container discovery

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cjd8vc

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.986s (2.986s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cjd8vc

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cjd8vc

Started

Started container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-5ccb968c66 from 0 to 1

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5ccb968c66

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5ccb968c66-8fg5c

openshift-ingress

multus

maas-default-gateway-openshift-default-5ccb968c66-8fg5c

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-687dbb6cf6 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-687dbb6cf6

FailedCreate

Error creating: pods "payload-pre-processing-687dbb6cf6-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-pre-processing-687dbb6cf6

SuccessfulCreate

Created pod: payload-pre-processing-687dbb6cf6-fss7v
(x5)

openshift-ingress

replicaset-controller

payload-processing-5cc6cd444b

FailedCreate

Error creating: pods "payload-processing-5cc6cd444b-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-processing-5cc6cd444b

SuccessfulCreate

Created pod: payload-processing-5cc6cd444b-8gzgx

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5cc6cd444b from 0 to 1

openshift-ingress

multus

payload-pre-processing-687dbb6cf6-fss7v

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-5cc6cd444b-8gzgx

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5cc6cd444b-8gzgx

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-fss7v

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-fss7v

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-5cc6cd444b-8gzgx

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.798s (2.798s including waiting). Image size: 165907129 bytes.

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-fss7v

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.752s (2.752s including waiting). Image size: 165907129 bytes.

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-fss7v

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-5cc6cd444b-8gzgx

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-5cc6cd444b-8gzgx

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-8fg5c

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-8fg5c

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-8fg5c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-8fg5c

Unhealthy

Startup probe failed: Get "http://10.132.0.45:15021/healthz/ready": dial tcp 10.132.0.45:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-8fg5c

ProbeError

Startup probe error: Get "http://10.132.0.45:15021/healthz/ready": dial tcp 10.132.0.45:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ait-0dbe3ebb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-0dbe3ebb

openshift-ingress

multus

e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8

AddedInterface

Add eth0 [10.132.0.64/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8

SuccessfulCreate

Created pod: e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8

openshift-ingress

deployment-controller

e2e-ait-0dbe3ebb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ait-0dbe3ebb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-0dbe3ebb-69f846bb86 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-0dbe3ebb-857dd5c7c6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-0dbe3ebb-857dd5c7c6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-0dbe3ebb: serviceaccount "payload-processing-e2e-ait-0dbe3ebb" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-0dbe3ebb-69f846bb86

FailedCreate

Error creating: pods "payload-processing-e2e-ait-0dbe3ebb-69f846bb86-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-0dbe3ebb: serviceaccount "payload-processing-e2e-ait-0dbe3ebb" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-0dbe3ebb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-0dbe3ebb-857dd5c7c6 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-0dbe3ebb-69f846bb86

SuccessfulCreate

Created pod: payload-processing-e2e-ait-0dbe3ebb-69f846bb86-sjsqw

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-0dbe3ebb-857dd5c7c6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-0dbe3ebb-857dd5c7c6-4975j

openshift-ingress

multus

payload-processing-e2e-ait-0dbe3ebb-69f846bb86-sjsqw

AddedInterface

Add eth0 [10.134.0.37/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-0dbe3ebb-857dd5c7c6-4975j

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-e2e-ait-0dbe3ebb-857dd5c7c6-4975j

AddedInterface

Add eth0 [10.134.0.36/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-0dbe3ebb-69f846bb86-sjsqw

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-e2e-ait-0dbe3ebb-69f846bb86-sjsqw

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-0dbe3ebb-69f846bb86-sjsqw

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-0dbe3ebb-857dd5c7c6-4975j

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.35s (2.35s including waiting). Image size: 165907129 bytes.

openshift-ingress

kubelet

payload-processing-e2e-ait-0dbe3ebb-69f846bb86-sjsqw

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.321s (2.321s including waiting). Image size: 165907129 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-0dbe3ebb-857dd5c7c6-4975j

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-0dbe3ebb-857dd5c7c6-4975j

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8

Unhealthy

Startup probe failed: Get "http://10.132.0.64:15021/healthz/ready": dial tcp 10.132.0.64:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8

ProbeError

Startup probe error: Get "http://10.132.0.64:15021/healthz/ready": dial tcp 10.132.0.64:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-0dbe3ebb-857dd5c7c6-4975j

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-0dbe3ebb-69f846bb86-sjsqw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564

SuccessfulCreate

Created pod: e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk

openshift-ingress

gateway_labeler_controller

e2e-migrate-c08eabd1-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-c08eabd1-gw

openshift-ingress

deployment-controller

e2e-migrate-c08eabd1-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564 from 0 to 1

openshift-ingress

multus

e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk

AddedInterface

Add eth0 [10.132.0.65/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-c08eabd1-968885bf

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-c08eabd1-968885bf-dslxg

openshift-ingress

multus

payload-pre-processing-e2e-migrate-c08eabd1-677b795cc6-mgh92

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-c08eabd1-968885bf

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-c08eabd1-968885bf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-c08eabd1: serviceaccount "payload-processing-e2e-migrate-c08eabd1" not found

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-c08eabd1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-c08eabd1-968885bf from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-c08eabd1-677b795cc6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-c08eabd1-677b795cc6-mgh92
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-c08eabd1-677b795cc6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-c08eabd1-677b795cc6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-c08eabd1: serviceaccount "payload-processing-e2e-migrate-c08eabd1" not found

openshift-ingress

kubelet

payload-processing-e2e-migrate-c08eabd1-968885bf-dslxg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-migrate-c08eabd1-968885bf-dslxg

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-c08eabd1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-c08eabd1-677b795cc6 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-c08eabd1-677b795cc6-mgh92

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-c08eabd1-677b795cc6-mgh92

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-c08eabd1-677b795cc6-mgh92

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-c08eabd1-968885bf-dslxg

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-c08eabd1-968885bf-dslxg

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-c08eabd1-677b795cc6-mgh92

Unhealthy

Readiness probe failed: dial tcp 10.134.0.40:9004: connect: connection refused

openshift-ingress

kubelet

e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk

ProbeError

Readiness probe error: Get "http://10.132.0.65:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk

Unhealthy

Readiness probe failed: Get "http://10.132.0.65:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk

Unhealthy

Startup probe failed: Get "http://10.132.0.65:15021/healthz/ready": dial tcp 10.132.0.65:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk

ProbeError

Startup probe error: Get "http://10.132.0.65:15021/healthz/ready": dial tcp 10.132.0.65:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-migrate-c08eabd1-968885bf-dslxg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-c08eabd1-677b795cc6-mgh92

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v

AddedInterface

Add eth0 [10.132.0.66/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ait-e0fd3dac-openshift-default-745fbf857b

SuccessfulCreate

Created pod: e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v

openshift-ingress

deployment-controller

e2e-ait-e0fd3dac-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-e0fd3dac-openshift-default-745fbf857b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-e0fd3dac

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-e0fd3dac
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-e0fd3dac-77dc586d88

FailedCreate

Error creating: pods "payload-processing-e2e-ait-e0fd3dac-77dc586d88-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-e0fd3dac: serviceaccount "payload-processing-e2e-ait-e0fd3dac" not found

openshift-ingress

multus

payload-processing-e2e-ait-e0fd3dac-77dc586d88-4w7dk

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ait-e0fd3dac-54cd9bf544-5gsh9

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-e0fd3dac-77dc586d88

SuccessfulCreate

Created pod: payload-processing-e2e-ait-e0fd3dac-77dc586d88-4w7dk

openshift-ingress

deployment-controller

payload-processing-e2e-ait-e0fd3dac

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-e0fd3dac-77dc586d88 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-e0fd3dac-54cd9bf544-5gsh9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-e0fd3dac-54cd9bf544

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-e0fd3dac-54cd9bf544-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-e0fd3dac: serviceaccount "payload-processing-e2e-ait-e0fd3dac" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-e0fd3dac-54cd9bf544

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-e0fd3dac-54cd9bf544-5gsh9

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-e0fd3dac

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-e0fd3dac-54cd9bf544 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-e0fd3dac-77dc586d88-4w7dk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-e0fd3dac-54cd9bf544-5gsh9

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-e0fd3dac-77dc586d88-4w7dk

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-e0fd3dac-77dc586d88-4w7dk

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-e0fd3dac-54cd9bf544-5gsh9

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v

Unhealthy

Startup probe failed: Get "http://10.132.0.66:15021/healthz/ready": dial tcp 10.132.0.66:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v

ProbeError

Startup probe error: Get "http://10.132.0.66:15021/healthz/ready": dial tcp 10.132.0.66:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ait-e0fd3dac-77dc586d88-4w7dk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-e0fd3dac-54cd9bf544-5gsh9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-derive-1a2510d6-openshift-default-b88549fb8

SuccessfulCreate

Created pod: e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz

openshift-ingress

gateway_labeler_controller

e2e-derive-1a2510d6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-1a2510d6

openshift-ingress

deployment-controller

e2e-derive-1a2510d6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-1a2510d6-openshift-default-b88549fb8 from 0 to 1

openshift-ingress

multus

e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz

AddedInterface

Add eth0 [10.132.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz

FailedToRetrieveImagePullSecret

Unable to retrieve some image pull secrets (e2e-derive-1a2510d6-openshift-default-dockercfg-bmw6t); attempting to pull the image may not succeed.

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-1a2510d6-5998cc4fdb

SuccessfulCreate

Created pod: payload-processing-e2e-derive-1a2510d6-5998cc4fdb-whhf7

openshift-ingress

deployment-controller

payload-processing-e2e-derive-1a2510d6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-1a2510d6-5998cc4fdb from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-1a2510d6-7dc9f557b4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-1a2510d6-7dc9f557b4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-1a2510d6: serviceaccount "payload-processing-e2e-derive-1a2510d6" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-1a2510d6-7dc9f557b4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-1a2510d6-7dc9f557b4-dwjxj
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-1a2510d6-5998cc4fdb

FailedCreate

Error creating: pods "payload-processing-e2e-derive-1a2510d6-5998cc4fdb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-1a2510d6: serviceaccount "payload-processing-e2e-derive-1a2510d6" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-1a2510d6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-1a2510d6-7dc9f557b4 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-derive-1a2510d6-7dc9f557b4-dwjxj

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-1a2510d6-5998cc4fdb-whhf7

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-1a2510d6-7dc9f557b4-dwjxj

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-1a2510d6-5998cc4fdb-whhf7

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-1a2510d6-5998cc4fdb-whhf7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-1a2510d6-7dc9f557b4-dwjxj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-derive-1a2510d6-5998cc4fdb-whhf7

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-1a2510d6-7dc9f557b4-dwjxj

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz

Unhealthy

Readiness probe failed: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz

ProbeError

Readiness probe error: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz

ProbeError

Startup probe error: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz

Unhealthy

Startup probe failed: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-1a2510d6-7dc9f557b4-dwjxj

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-derive-1a2510d6

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-derive-1a2510d6: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-derive-1a2510d6": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-derive-1a2510d6, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: b582f67f-2478-4771-9259-5fb8ff7f08d9, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-derive-1a2510d6-5998cc4fdb-whhf7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-mt-c69ac9dc

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-c69ac9dc

openshift-ingress

deployment-controller

e2e-mt-c69ac9dc-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b from 0 to 1

openshift-ingress

multus

e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb

AddedInterface

Add eth0 [10.132.0.68/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b

SuccessfulCreate

Created pod: e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb

openshift-ingress

deployment-controller

payload-processing-e2e-mt-c69ac9dc

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-c69ac9dc-6b8f45bc7d from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-c69ac9dc-ccfb694b8-lsphj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-c69ac9dc-ccfb694b8-lsphj

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-c69ac9dc-6b8f45bc7d

SuccessfulCreate

Created pod: payload-processing-e2e-mt-c69ac9dc-6b8f45bc7d-b8tdd
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-c69ac9dc-6b8f45bc7d

FailedCreate

Error creating: pods "payload-processing-e2e-mt-c69ac9dc-6b8f45bc7d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-c69ac9dc: serviceaccount "payload-processing-e2e-mt-c69ac9dc" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-c69ac9dc-ccfb694b8-lsphj

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-c69ac9dc-6b8f45bc7d-b8tdd

Started

Started container payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-c69ac9dc

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-c69ac9dc-ccfb694b8 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-mt-c69ac9dc-ccfb694b8-lsphj

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-c69ac9dc-ccfb694b8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-c69ac9dc-ccfb694b8-lsphj

openshift-ingress

multus

payload-processing-e2e-mt-c69ac9dc-6b8f45bc7d-b8tdd

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-c69ac9dc-6b8f45bc7d-b8tdd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-c69ac9dc-6b8f45bc7d-b8tdd

Created

Created container: payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-c69ac9dc-ccfb694b8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-c69ac9dc-ccfb694b8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-c69ac9dc: serviceaccount "payload-processing-e2e-mt-c69ac9dc" not found

openshift-ingress

kubelet

e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb

Unhealthy

Readiness probe failed: Get "http://10.132.0.68:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb

ProbeError

Readiness probe error: Get "http://10.132.0.68:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb

Unhealthy

Startup probe failed: Get "http://10.132.0.68:15021/healthz/ready": dial tcp 10.132.0.68:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb

ProbeError

Startup probe error: Get "http://10.132.0.68:15021/healthz/ready": dial tcp 10.132.0.68:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-mt-c69ac9dc-6b8f45bc7d-b8tdd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-c69ac9dc-ccfb694b8-lsphj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

e2e-mt-ec1b3fa4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-ec1b3fa4-openshift-default-74d7c5d84 from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-ec1b3fa4-openshift-default-74d7c5d84

SuccessfulCreate

Created pod: e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt

openshift-ingress

multus

e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-mt-ec1b3fa4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-ec1b3fa4

openshift-ingress

deployment-controller

payload-processing-e2e-mt-ec1b3fa4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-ec1b3fa4-67f58b667d from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-ec1b3fa4-67f58b667d

SuccessfulCreate

Created pod: payload-processing-e2e-mt-ec1b3fa4-67f58b667d-xqpzg
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-ec1b3fa4-67f58b667d

FailedCreate

Error creating: pods "payload-processing-e2e-mt-ec1b3fa4-67f58b667d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-ec1b3fa4: serviceaccount "payload-processing-e2e-mt-ec1b3fa4" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-ec1b3fa4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-ec1b3fa4-5d76895856 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-ec1b3fa4-5d76895856

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-ec1b3fa4-5d76895856-m27qb
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-ec1b3fa4-5d76895856

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-ec1b3fa4-5d76895856-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-ec1b3fa4: serviceaccount "payload-processing-e2e-mt-ec1b3fa4" not found

openshift-ingress

kubelet

payload-processing-e2e-mt-ec1b3fa4-67f58b667d-xqpzg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-ec1b3fa4-5d76895856-m27qb

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-ec1b3fa4-67f58b667d-xqpzg

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-mt-ec1b3fa4-67f58b667d-xqpzg

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-mt-ec1b3fa4-5d76895856-m27qb

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-ec1b3fa4-67f58b667d-xqpzg

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-ec1b3fa4-5d76895856-m27qb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-ec1b3fa4-5d76895856-m27qb

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt

ProbeError

Readiness probe error: Get "http://10.132.0.69:15021/healthz/ready": read tcp 10.132.0.2:53266->10.132.0.69:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt

Unhealthy

Readiness probe failed: Get "http://10.132.0.69:15021/healthz/ready": read tcp 10.132.0.2:53266->10.132.0.69:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt

Unhealthy

Startup probe failed: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt

ProbeError

Startup probe error: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-ec1b3fa4-5d76895856-m27qb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-ec1b3fa4-67f58b667d-xqpzg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-inf-a-2cd0f2-openshift-default-5569c68476

SuccessfulCreate

Created pod: e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4

openshift-ingress

gateway_labeler_controller

e2e-inf-a-2cd0f2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-2cd0f2

openshift-ingress

deployment-controller

e2e-inf-a-2cd0f2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-2cd0f2-openshift-default-5569c68476 from 0 to 1

openshift-ingress

multus

e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4

AddedInterface

Add eth0 [10.132.0.70/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-2cd0f2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-2cd0f2-7bdc79f768 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-2cd0f2-7644b5c596

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-2cd0f2-7644b5c596-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-2cd0f2: serviceaccount "payload-processing-e2e-inf-a-2cd0f2" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-2cd0f2-7644b5c596

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-2cd0f2-7644b5c596-m77kc

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-2cd0f2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-2cd0f2-7644b5c596 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-2cd0f2-7bdc79f768

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-2cd0f2-7bdc79f768-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-2cd0f2: serviceaccount "payload-processing-e2e-inf-a-2cd0f2" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-2cd0f2-7bdc79f768

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-2cd0f2-7bdc79f768-gx679

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-2cd0f2-7644b5c596-m77kc

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-2cd0f2-7bdc79f768-gx679

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-inf-a-2cd0f2-7bdc79f768-gx679

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-2cd0f2-7644b5c596-m77kc

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-2cd0f2-7644b5c596-m77kc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-2cd0f2-7644b5c596-m77kc

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-2cd0f2-7bdc79f768-gx679

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-2cd0f2-7bdc79f768-gx679

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

gateway_labeler_controller

e2e-inf-b-f67c19

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-f67c19

openshift-ingress

replicaset-controller

e2e-inf-b-f67c19-openshift-default-c75bfcff6

SuccessfulCreate

Created pod: e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t

openshift-ingress

deployment-controller

e2e-inf-b-f67c19-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-f67c19-openshift-default-c75bfcff6 from 0 to 1

openshift-ingress

multus

e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t

AddedInterface

Add eth0 [10.132.0.71/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-f67c19

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-f67c19-f9bcc4b9b from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-f67c19-f9bcc4b9b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-f67c19-f9bcc4b9b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-f67c19: serviceaccount "payload-processing-e2e-inf-b-f67c19" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-f67c19

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-f67c19-cf6c5f756 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-f67c19-cf6c5f756

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-f67c19-cf6c5f756-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-f67c19: serviceaccount "payload-processing-e2e-inf-b-f67c19" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-f67c19-cf6c5f756

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-f67c19-cf6c5f756-x9s8x

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-f67c19-f9bcc4b9b-qzp7m

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-f67c19-f9bcc4b9b-qzp7m

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-f67c19-f9bcc4b9b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-f67c19-f9bcc4b9b-qzp7m

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-f67c19-f9bcc4b9b-qzp7m

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-f67c19-f9bcc4b9b-qzp7m

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-f67c19-cf6c5f756-x9s8x

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-f67c19-cf6c5f756-x9s8x

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-inf-b-f67c19-cf6c5f756-x9s8x

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-f67c19-cf6c5f756-x9s8x

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-2cd0f2-7644b5c596-m77kc

Unhealthy

Readiness probe failed: dial tcp 10.134.0.63:9004: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4

Started

Started container istio-proxy
(x3)

openshift-ingress

kubelet

e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4

ProbeError

Startup probe error: Get "http://10.132.0.70:15021/healthz/ready": dial tcp 10.132.0.70:15021: connect: connection refused body:
(x3)

openshift-ingress

kubelet

e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4

Unhealthy

Startup probe failed: Get "http://10.132.0.70:15021/healthz/ready": dial tcp 10.132.0.70:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t

Unhealthy

Startup probe failed: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t

ProbeError

Startup probe error: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-2cd0f2-7644b5c596-m77kc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-2cd0f2-7bdc79f768-gx679

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-inf-b-f67c19-cf6c5f756-x9s8x

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-f67c19-f9bcc4b9b-qzp7m

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-api-a-64a682-openshift-default-576f78c5b6

SuccessfulCreate

Created pod: e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x

openshift-ingress

gateway_labeler_controller

e2e-api-a-64a682

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-64a682

openshift-ingress

deployment-controller

e2e-api-a-64a682-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-64a682-openshift-default-576f78c5b6 from 0 to 1

openshift-ingress

multus

e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x

AddedInterface

Add eth0 [10.132.0.72/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-64a682

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-64a682-5fdb6db6d4 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-64a682-5fdb6db6d4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-64a682-5fdb6db6d4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-64a682: serviceaccount "payload-processing-e2e-api-a-64a682" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-64a682-5fdb6db6d4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-64a682-5fdb6db6d4-nxxnt
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-64a682-cf87788c8

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-64a682-cf87788c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-64a682: serviceaccount "payload-processing-e2e-api-a-64a682" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-64a682

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-64a682-cf87788c8 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-64a682-cf87788c8

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-64a682-cf87788c8-flb78

openshift-ingress

multus

payload-processing-e2e-api-a-64a682-cf87788c8-flb78

AddedInterface

Add eth0 [10.134.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-64a682-5fdb6db6d4-nxxnt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-a-64a682-cf87788c8-flb78

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-64a682-cf87788c8-flb78

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-a-64a682-cf87788c8-flb78

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-64a682-5fdb6db6d4-nxxnt

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-64a682-5fdb6db6d4-nxxnt

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-a-64a682-5fdb6db6d4-nxxnt

AddedInterface

Add eth0 [10.134.0.70/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-api-b-3940b7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-3940b7

openshift-ingress

deployment-controller

e2e-api-b-3940b7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-3940b7-openshift-default-5fdf77db64 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-3940b7-openshift-default-5fdf77db64

SuccessfulCreate

Created pod: e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp

openshift-ingress

multus

e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp

AddedInterface

Add eth0 [10.132.0.73/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-3940b7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-3940b7-54c4b89c8d from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-3940b7-758c87d88

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-3940b7-758c87d88-bksxm

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-3940b7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-3940b7-758c87d88 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-3940b7-758c87d88

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-3940b7-758c87d88-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-3940b7: serviceaccount "payload-processing-e2e-api-b-3940b7" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-3940b7-54c4b89c8d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-3940b7-54c4b89c8d-gw8lv
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-3940b7-54c4b89c8d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-3940b7-54c4b89c8d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-3940b7: serviceaccount "payload-processing-e2e-api-b-3940b7" not found

openshift-ingress

multus

payload-processing-e2e-api-b-3940b7-758c87d88-bksxm

AddedInterface

Add eth0 [10.134.0.73/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-api-b-3940b7-54c4b89c8d-gw8lv

AddedInterface

Add eth0 [10.134.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-3940b7-54c4b89c8d-gw8lv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-b-3940b7-758c87d88-bksxm

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-3940b7-54c4b89c8d-gw8lv

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-3940b7-758c87d88-bksxm

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-3940b7-54c4b89c8d-gw8lv

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-3940b7-758c87d88-bksxm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x

ProbeError

Readiness probe error: Get "http://10.132.0.72:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x

Unhealthy

Readiness probe failed: Get "http://10.132.0.72:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x

Created

Created container: istio-proxy
(x4)

openshift-ingress

kubelet

e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x

Unhealthy

Startup probe failed: Get "http://10.132.0.72:15021/healthz/ready": dial tcp 10.132.0.72:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x

ProbeError

Startup probe error: Get "http://10.132.0.72:15021/healthz/ready": dial tcp 10.132.0.72:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp

Unhealthy

Readiness probe failed: Get "http://10.132.0.73:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp

ProbeError

Readiness probe error: Get "http://10.132.0.73:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp

ProbeError

Startup probe error: Get "http://10.132.0.73:15021/healthz/ready": dial tcp 10.132.0.73:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp

Unhealthy

Startup probe failed: Get "http://10.132.0.73:15021/healthz/ready": dial tcp 10.132.0.73:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-64a682-5fdb6db6d4-nxxnt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-64a682-cf87788c8-flb78

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-api-b-3940b7-758c87d88-bksxm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-3940b7-54c4b89c8d-gw8lv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-73e2fd-openshift-default-d6f49dbb8

SuccessfulCreate

Created pod: e2e-shared-a-73e2fd-openshift-default-d6f49dbb8-p2v22

openshift-ingress

gateway_labeler_controller

e2e-shared-a-73e2fd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-73e2fd

openshift-ingress

deployment-controller

e2e-shared-a-73e2fd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-73e2fd-openshift-default-d6f49dbb8 from 0 to 1

openshift-ingress

multus

e2e-shared-a-73e2fd-openshift-default-d6f49dbb8-p2v22

AddedInterface

Add eth0 [10.132.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-73e2fd-bf98b6b4d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-73e2fd-bf98b6b4d-2gvvf

openshift-ingress

kubelet

payload-processing-e2e-shared-a-73e2fd-66b47b8c4b-k92h4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-73e2fd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-73e2fd-66b47b8c4b from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-73e2fd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-73e2fd-bf98b6b4d from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-73e2fd-bf98b6b4d-2gvvf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-73e2fd-bf98b6b4d-2gvvf

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-73e2fd-66b47b8c4b

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-73e2fd-66b47b8c4b-k92h4

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-73e2fd-bf98b6b4d-2gvvf

AddedInterface

Add eth0 [10.134.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-73e2fd-bf98b6b4d-2gvvf

Started

Started container payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-73e2fd-66b47b8c4b

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-73e2fd-66b47b8c4b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-73e2fd: serviceaccount "payload-processing-e2e-shared-a-73e2fd" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-a-73e2fd-66b47b8c4b-k92h4

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-73e2fd-66b47b8c4b-k92h4

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-73e2fd-66b47b8c4b-k92h4

AddedInterface

Add eth0 [10.134.0.78/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-73e2fd-bf98b6b4d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-73e2fd-bf98b6b4d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-73e2fd: serviceaccount "payload-processing-e2e-shared-a-73e2fd" not found

openshift-ingress

replicaset-controller

e2e-shared-b-7d2c59-openshift-default-7bddc46c7b

SuccessfulCreate

Created pod: e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj

openshift-ingress

multus

e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj

AddedInterface

Add eth0 [10.132.0.75/23] from ovn-kubernetes

openshift-ingress

GatewayAuthBootstrap

e2e-shared-b-7d2c59

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-shared-b-7d2c59-authn-ssl: envoyfilters.networking.istio.io "e2e-shared-b-7d2c59-authn-ssl" already exists

openshift-ingress

gateway_labeler_controller

e2e-shared-b-7d2c59

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-7d2c59

openshift-ingress

deployment-controller

e2e-shared-b-7d2c59-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-7d2c59-openshift-default-7bddc46c7b from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-7d2c59

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-7d2c59-5b64ff7d94 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-7d2c59-555b74ccfb-9cj7f

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-7d2c59-555b74ccfb-9cj7f

AddedInterface

Add eth0 [10.134.0.80/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-7d2c59-5b64ff7d94

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-7d2c59-5b64ff7d94-f2ldx

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-7d2c59

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-7d2c59-555b74ccfb from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-7d2c59-555b74ccfb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-7d2c59-555b74ccfb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-7d2c59: serviceaccount "payload-processing-e2e-shared-b-7d2c59" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-7d2c59-5b64ff7d94

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-7d2c59-5b64ff7d94-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-7d2c59: serviceaccount "payload-processing-e2e-shared-b-7d2c59" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-7d2c59-555b74ccfb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-7d2c59-555b74ccfb-9cj7f

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-7d2c59-555b74ccfb-9cj7f

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-7d2c59-5b64ff7d94-f2ldx

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-7d2c59-5b64ff7d94-f2ldx

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-7d2c59-5b64ff7d94-f2ldx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-b-7d2c59-5b64ff7d94-f2ldx

AddedInterface

Add eth0 [10.134.0.81/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-7d2c59-555b74ccfb-9cj7f

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-shared-a-73e2fd-openshift-default-d6f49dbb8-p2v22

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-73e2fd-openshift-default-d6f49dbb8-p2v22

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-73e2fd-openshift-default-d6f49dbb8-p2v22

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-shared-a-73e2fd-openshift-default-d6f49dbb8-p2v22

Unhealthy

Startup probe failed: Get "http://10.132.0.74:15021/healthz/ready": dial tcp 10.132.0.74:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-shared-a-73e2fd-openshift-default-d6f49dbb8-p2v22

ProbeError

Startup probe error: Get "http://10.132.0.74:15021/healthz/ready": dial tcp 10.132.0.74:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj

Unhealthy

Readiness probe failed: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused

openshift-ingress

kubelet

e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj

ProbeError

Readiness probe error: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj

Created

Created container: istio-proxy
(x4)

openshift-ingress

kubelet

e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj

ProbeError

Startup probe error: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj

Unhealthy

Startup probe failed: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-73e2fd-bf98b6b4d-2gvvf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-73e2fd-66b47b8c4b-k92h4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-73e2fd-openshift-default-d6f49dbb8-p2v22

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-7d2c59-555b74ccfb-9cj7f

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-b-7d2c59

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-b-7d2c59: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-b-7d2c59": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-b-7d2c59, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 6c0fd756-44db-49e7-b119-6f155ea31489, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-shared-b-7d2c59-5b64ff7d94-f2ldx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj

Killing

Stopping container istio-proxy