Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-processing-7bb9489676-qcnxp

Scheduled

Successfully assigned openshift-ingress/payload-processing-7bb9489676-qcnxp to ip-10-0-134-71.us-west-1.compute.internal

openshift-ingress

router-default-85d7978dc5-vflbf

Scheduled

Successfully assigned openshift-ingress/router-default-85d7978dc5-vflbf to ip-10-0-131-64.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-59f957fdd7-kndtt

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-kndtt to ip-10-0-134-71.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-59f957fdd7-n79ks

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-n79ks to ip-10-0-131-64.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-59f957fdd7-gvnng

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-gvnng to ip-10-0-131-64.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-59f957fdd7-6hkkd

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-6hkkd to ip-10-0-134-71.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-59f957fdd7-2x8vt

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-2x8vt to ip-10-0-131-101.us-west-1.compute.internal

openshift-ingress

kube-auth-proxy-655c576ffb-lvlq5

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-655c576ffb-lvlq5 to ip-10-0-131-101.us-west-1.compute.internal

openshift-ingress

istiod-openshift-gateway-7876bfcb74-gnvm4

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7876bfcb74-gnvm4 to ip-10-0-134-71.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-59f957fdd7-xtsh2

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-xtsh2 to ip-10-0-131-101.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-59f957fdd7-xj5qx

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-xj5qx to ip-10-0-131-64.us-west-1.compute.internal

openshift-ingress

e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8 to ip-10-0-131-64.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-main-e56f6e-754b95b59-df49l

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-main-e56f6e-754b95b59-df49l to ip-10-0-131-64.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-59f957fdd7-tqlvx

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-tqlvx to ip-10-0-131-101.us-west-1.compute.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-86dq7

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-86dq7 to ip-10-0-134-71.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-main-12288c-67c58f56c96ms6g

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-main-12288c-67c58f56c96ms6g to ip-10-0-131-64.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-59f957fdd7-q6cx2

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-q6cx2 to ip-10-0-131-64.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-59f957fdd7-lgvxj

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-lgvxj to ip-10-0-134-71.us-west-1.compute.internal

openshift-ingress

router-default-85d7978dc5-vflbf

FailedScheduling

no nodes available to schedule pods

openshift-ingress

router-default-85d7978dc5-vflbf

FailedScheduling

no nodes available to schedule pods

openshift-ingress

payload-processing-e2e-shared-b-main-12288c-55f4d7c574-8k45w

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-main-12288c-55f4d7c574-8k45w to ip-10-0-134-71.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-shared-a-main-e56f6e-6c854875f4-s4494

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-main-e56f6e-6c854875f4-s4494 to ip-10-0-131-64.us-west-1.compute.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-76f56c5945fk5rx

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-76f56c5945fk5rx to ip-10-0-131-64.us-west-1.compute.internal

openshift-ingress

kube-auth-proxy-655c576ffb-dbtgj

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-655c576ffb-dbtgj to ip-10-0-134-71.us-west-1.compute.internal

openshift-ingress

openshift-ai-inference-openshift-ai-inference-7cd79c685f-k9wnm

Scheduled

Successfully assigned openshift-ingress/openshift-ai-inference-openshift-ai-inference-7cd79c685f-k9wnm to ip-10-0-131-64.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-7b98bb678c-wpsp2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-7b98bb678c-wpsp2 to ip-10-0-134-71.us-west-1.compute.internal

openshift-ingress

e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r to ip-10-0-131-64.us-west-1.compute.internal

openshift-ingress

replicaset-controller

router-default-85d7978dc5

SuccessfulCreate

Created pod: router-default-85d7978dc5-vflbf

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-85d7978dc5 from 0 to 1

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts
(x5)

openshift-ingress

kubelet

router-default-85d7978dc5-vflbf

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x5)

openshift-ingress

kubelet

router-default-85d7978dc5-vflbf

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x2)

openshift-ingress

kubelet

router-default-85d7978dc5-vflbf

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x3)

openshift-ingress

kubelet

router-default-85d7978dc5-vflbf

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found

openshift-ingress

multus

router-default-85d7978dc5-vflbf

AddedInterface

Add eth0 [10.132.0.19/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-85d7978dc5-vflbf

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3a679d80eb36ca7db888d4fbd1fdf16b0997a7c7a107936396b7a57d8b199f4e" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

router-default-85d7978dc5-vflbf

Created

Container created

openshift-ingress

kubelet

router-default-85d7978dc5-vflbf

Started

Container started

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7876bfcb74 from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulCreate

Created pod: istiod-openshift-gateway-7876bfcb74-gnvm4

openshift-ingress

multus

istiod-openshift-gateway-7876bfcb74-gnvm4

AddedInterface

Add eth0 [10.133.0.16/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-gnvm4

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-gnvm4

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-gnvm4

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-gnvm4

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 5.007s (5.007s including waiting). Image size: 185476477 bytes.
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-gnvm4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-gnvm4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-59f957fdd7

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-59f957fdd7-q6cx2

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-59f957fdd7 from 0 to 1

openshift-ingress

multus

maas-default-gateway-openshift-default-59f957fdd7-q6cx2

AddedInterface

Add eth0 [10.132.0.34/23] from ovn-kubernetes

openshift-ingress

service-controller

openshift-ai-inference-openshift-ai-inference

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-7cd79c685f-k9wnm

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-q6cx2

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

multus

openshift-ai-inference-openshift-ai-inference-7cd79c685f-k9wnm

AddedInterface

Add eth0 [10.132.0.35/23] from ovn-kubernetes

openshift-ingress

deployment-controller

openshift-ai-inference-openshift-ai-inference

ScalingReplicaSet

Scaled up replica set openshift-ai-inference-openshift-ai-inference-7cd79c685f from 0 to 1

openshift-ingress

replicaset-controller

openshift-ai-inference-openshift-ai-inference-7cd79c685f

SuccessfulCreate

Created pod: openshift-ai-inference-openshift-ai-inference-7cd79c685f-k9wnm

openshift-ingress

service-controller

openshift-ai-inference-openshift-ai-inference

EnsuredLoadBalancer

Ensured load balancer

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-7cd79c685f-k9wnm

Started

Container started

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-7cd79c685f-k9wnm

Created

Container created

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-7cd79c685f-k9wnm

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 11.327s (11.327s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-q6cx2

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 11.874s (11.874s including waiting). Image size: 183555333 bytes.
(x2)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-655c576ffb from 0 to 2

openshift-ingress

replicaset-controller

kube-auth-proxy-655c576ffb

SuccessfulCreate

Created pod: kube-auth-proxy-655c576ffb-lvlq5

openshift-ingress

replicaset-controller

kube-auth-proxy-655c576ffb

SuccessfulCreate

Created pod: kube-auth-proxy-655c576ffb-dbtgj

openshift-ingress

multus

kube-auth-proxy-655c576ffb-lvlq5

AddedInterface

Add eth0 [10.134.0.30/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-76f56c5945

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-76f56c5945fk5rx

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-76f56c5945 from 0 to 1

openshift-ingress

kubelet

kube-auth-proxy-655c576ffb-lvlq5

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"

openshift-ingress

multus

kube-auth-proxy-655c576ffb-dbtgj

AddedInterface

Add eth0 [10.133.0.18/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-655c576ffb-dbtgj

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-76f56c5945fk5rx

Started

Container started

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-76f56c5945fk5rx

Created

Container created

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-76f56c5945fk5rx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-76f56c5945fk5rx

AddedInterface

Add eth0 [10.132.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-655c576ffb-lvlq5

Started

Container started

openshift-ingress

kubelet

kube-auth-proxy-655c576ffb-dbtgj

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.87s (2.87s including waiting). Image size: 188904677 bytes.

openshift-ingress

kubelet

kube-auth-proxy-655c576ffb-dbtgj

Created

Container created

openshift-ingress

kubelet

kube-auth-proxy-655c576ffb-lvlq5

Created

Container created

openshift-ingress

kubelet

kube-auth-proxy-655c576ffb-lvlq5

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.995s (2.995s including waiting). Image size: 188904677 bytes.

openshift-ingress

kubelet

kube-auth-proxy-655c576ffb-dbtgj

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-86dq7

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-86dq7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" already present on machine and can be accessed by the pod

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-86dq7

AddedInterface

Add eth0 [10.133.0.21/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-86dq7

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-86dq7

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-86dq7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-86dq7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7876bfcb74 from 1 to 0

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7876bfcb74-gnvm4

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-gnvm4

Killing

Stopping container discovery
(x5)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-q6cx2

Unhealthy

Readiness probe failed: Get "http://10.132.0.34:15021/healthz/ready": read tcp 10.132.0.2:52202->10.132.0.34:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-q6cx2

Created

Container created
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-q6cx2

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-q6cx2

ProbeError

Readiness probe error: Get "http://10.132.0.34:15021/healthz/ready": read tcp 10.132.0.2:52202->10.132.0.34:15021: read: connection reset by peer body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-q6cx2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-q6cx2

ProbeError

Startup probe error: Get "http://10.132.0.34:15021/healthz/ready": dial tcp 10.132.0.34:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-q6cx2

Unhealthy

Startup probe failed: Get "http://10.132.0.34:15021/healthz/ready": dial tcp 10.132.0.34:15021: connect: connection refused
(x5)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

FailedCreate

Error creating: pods "payload-pre-processing-7b98bb678c-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

SuccessfulCreate

Created pod: payload-pre-processing-7b98bb678c-wpsp2

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-7b98bb678c from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-7bb9489676

FailedCreate

Error creating: pods "payload-processing-7bb9489676-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-processing-7bb9489676

SuccessfulCreate

Created pod: payload-processing-7bb9489676-qcnxp

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-7bb9489676 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-wpsp2

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

kubelet

payload-processing-7bb9489676-qcnxp

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-processing-7bb9489676-qcnxp

AddedInterface

Add eth0 [10.133.0.34/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-7b98bb678c-wpsp2

AddedInterface

Add eth0 [10.133.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-wpsp2

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-wpsp2

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.735s (2.735s including waiting). Image size: 125353963 bytes.

openshift-ingress

kubelet

payload-processing-7bb9489676-qcnxp

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.597s (2.597s including waiting). Image size: 125353963 bytes.

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-wpsp2

Started

Container started

openshift-ingress

kubelet

payload-processing-7bb9489676-qcnxp

Started

Container started

openshift-ingress

kubelet

payload-processing-7bb9489676-qcnxp

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-59f957fdd7 from 1 to 2

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-59f957fdd7

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-59f957fdd7-6hkkd

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-6hkkd

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

multus

maas-default-gateway-openshift-default-59f957fdd7-6hkkd

AddedInterface

Add eth0 [10.133.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-6hkkd

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-6hkkd

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 10.685s (10.685s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-6hkkd

Created

Container created

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-59f957fdd7

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-59f957fdd7-xj5qx

openshift-ingress

multus

maas-default-gateway-openshift-default-59f957fdd7-xtsh2

AddedInterface

Add eth0 [10.134.0.38/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-59f957fdd7

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-59f957fdd7-xtsh2

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-59f957fdd7 from 2 to 4

openshift-ingress

multus

maas-default-gateway-openshift-default-59f957fdd7-xj5qx

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-xj5qx

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-xj5qx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-xj5qx

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-xtsh2

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-6hkkd

ProbeError

Startup probe error: Get "http://10.133.0.41:15021/healthz/ready": dial tcp 10.133.0.41:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-6hkkd

Unhealthy

Startup probe failed: Get "http://10.133.0.41:15021/healthz/ready": dial tcp 10.133.0.41:15021: connect: connection refused

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-xtsh2

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 3.889s (3.889s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-xtsh2

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-xtsh2

Started

Container started
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-xj5qx

Unhealthy

Startup probe failed: Get "http://10.132.0.55:15021/healthz/ready": dial tcp 10.132.0.55:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-xj5qx

ProbeError

Startup probe error: Get "http://10.132.0.55:15021/healthz/ready": dial tcp 10.132.0.55:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-xtsh2

ProbeError

Startup probe error: Get "http://10.134.0.38:15021/healthz/ready": dial tcp 10.134.0.38:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-xtsh2

Unhealthy

Startup probe failed: Get "http://10.134.0.38:15021/healthz/ready": dial tcp 10.134.0.38:15021: connect: connection refused

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-59f957fdd7 from 4 to 6

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 6; reason:

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-59f957fdd7

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-59f957fdd7-tqlvx

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-59f957fdd7

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-59f957fdd7-lgvxj

openshift-ingress

multus

maas-default-gateway-openshift-default-59f957fdd7-lgvxj

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-tqlvx

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-lgvxj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-lgvxj

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-59f957fdd7-tqlvx

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-lgvxj

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-tqlvx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-tqlvx

Started

Container started
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-tqlvx

ProbeError

Startup probe error: Get "http://10.134.0.39:15021/healthz/ready": dial tcp 10.134.0.39:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-tqlvx

Unhealthy

Startup probe failed: Get "http://10.134.0.39:15021/healthz/ready": dial tcp 10.134.0.39:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-lgvxj

ProbeError

Startup probe error: Get "http://10.133.0.43:15021/healthz/ready": dial tcp 10.133.0.43:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-lgvxj

Unhealthy

Startup probe failed: Get "http://10.133.0.43:15021/healthz/ready": dial tcp 10.133.0.43:15021: connect: connection refused

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-59f957fdd7

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-59f957fdd7-gvnng

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-59f957fdd7 from 6 to 10

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-59f957fdd7

SuccessfulCreate

(combined from similar events): Created pod: maas-default-gateway-openshift-default-59f957fdd7-n79ks

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-59f957fdd7

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-59f957fdd7-kndtt

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-59f957fdd7

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-59f957fdd7-2x8vt

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-gvnng

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-2x8vt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-kndtt

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-59f957fdd7-2x8vt

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-kndtt

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-kndtt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-n79ks

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-n79ks

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-n79ks

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-59f957fdd7-n79ks

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-59f957fdd7-kndtt

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-gvnng

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-gvnng

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-59f957fdd7-gvnng

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-2x8vt

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-2x8vt

Started

Container started
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-n79ks

Unhealthy

Startup probe failed: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-n79ks

ProbeError

Startup probe error: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-kndtt

ProbeError

Startup probe error: Get "http://10.133.0.45:15021/healthz/ready": dial tcp 10.133.0.45:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-2x8vt

Unhealthy

Startup probe failed: Get "http://10.134.0.40:15021/healthz/ready": dial tcp 10.134.0.40:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-2x8vt

ProbeError

Startup probe error: Get "http://10.134.0.40:15021/healthz/ready": dial tcp 10.134.0.40:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-kndtt

Unhealthy

Startup probe failed: Get "http://10.133.0.45:15021/healthz/ready": dial tcp 10.133.0.45:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-gvnng

ProbeError

Startup probe error: Get "http://10.132.0.57:15021/healthz/ready": dial tcp 10.132.0.57:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-gvnng

Unhealthy

Startup probe failed: Get "http://10.132.0.57:15021/healthz/ready": dial tcp 10.132.0.57:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-shared-a-main-e56f6e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-main-e56f6e

openshift-ingress

multus

e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8

AddedInterface

Add eth0 [10.132.0.67/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-a-main-e56f6e-openshift-default-656776d9d5

SuccessfulCreate

Created pod: e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8

openshift-ingress

deployment-controller

e2e-shared-a-main-e56f6e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-main-e56f6e-openshift-default-656776d9d5 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-main-e56f6e-754b95b59

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-main-e56f6e-754b95b59-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-main-e56f6e: serviceaccount "payload-processing-e2e-shared-a-main-e56f6e" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-main-e56f6e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-main-e56f6e-6c854875f4 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-main-e56f6e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-main-e56f6e-754b95b59 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-main-e56f6e-6c854875f4

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-main-e56f6e-6c854875f4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-main-e56f6e: serviceaccount "payload-processing-e2e-shared-a-main-e56f6e" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-main-e56f6e-754b95b59

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-main-e56f6e-754b95b59-df49l

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-main-e56f6e-6c854875f4

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-main-e56f6e-6c854875f4-s4494

openshift-ingress

multus

payload-processing-e2e-shared-a-main-e56f6e-6c854875f4-s4494

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-main-e56f6e-754b95b59-df49l

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

kubelet

payload-processing-e2e-shared-a-main-e56f6e-6c854875f4-s4494

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-main-e56f6e-754b95b59-df49l

AddedInterface

Add eth0 [10.132.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-main-e56f6e-754b95b59-df49l

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.768s (2.768s including waiting). Image size: 125353963 bytes.

openshift-ingress

kubelet

payload-processing-e2e-shared-a-main-e56f6e-6c854875f4-s4494

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.96s (2.96s including waiting). Image size: 125353963 bytes.

openshift-ingress

kubelet

payload-processing-e2e-shared-a-main-e56f6e-6c854875f4-s4494

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-main-e56f6e-6c854875f4-s4494

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-main-e56f6e-754b95b59-df49l

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-main-e56f6e-754b95b59-df49l

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

gateway_labeler_controller

e2e-shared-b-main-12288c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-main-12288c

openshift-ingress

deployment-controller

e2e-shared-b-main-12288c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-main-12288c-openshift-default-754fff74df from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-main-12288c-openshift-default-754fff74df

SuccessfulCreate

Created pod: e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r

openshift-ingress

multus

e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r

AddedInterface

Add eth0 [10.132.0.70/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8

ProbeError

Startup probe error: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8

Unhealthy

Startup probe failed: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-main-12288c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-main-12288c-55f4d7c574 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-main-12288c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-main-12288c-67c58f56c9 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-main-12288c-67c58f56c96ms6g

AddedInterface

Add eth0 [10.132.0.71/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-main-12288c-67c58f56c9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-main-12288c-67c58f56c96ms6g
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-main-12288c-67c58f56c9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-main-12288c-67c58f56c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-main-12288c: serviceaccount "payload-processing-e2e-shared-b-main-12288c" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-main-12288c-55f4d7c574

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-main-12288c-55f4d7c574-8k45w

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-main-12288c-67c58f56c96ms6g

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-shared-b-main-12288c-55f4d7c574-8k45w

AddedInterface

Add eth0 [10.133.0.49/23] from ovn-kubernetes
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-main-12288c-55f4d7c574

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-main-12288c-55f4d7c574-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-main-12288c: serviceaccount "payload-processing-e2e-shared-b-main-12288c" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-b-main-12288c-55f4d7c574-8k45w

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-main-12288c-55f4d7c574-8k45w

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-b-main-12288c-55f4d7c574-8k45w

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-main-12288c-67c58f56c96ms6g

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-main-12288c-67c58f56c96ms6g

Started

Container started
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-main-e56f6e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-main-e56f6e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-main-e56f6e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-main-e56f6e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r

ProbeError

Readiness probe error: Get "http://10.132.0.70:15021/healthz/ready": read tcp 10.132.0.2:51608->10.132.0.70:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r

Unhealthy

Readiness probe failed: Get "http://10.132.0.70:15021/healthz/ready": read tcp 10.132.0.2:51608->10.132.0.70:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r

Started

Container started
(x4)

openshift-ingress

kubelet

e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r

Unhealthy

Startup probe failed: Get "http://10.132.0.70:15021/healthz/ready": dial tcp 10.132.0.70:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r

ProbeError

Startup probe error: Get "http://10.132.0.70:15021/healthz/ready": dial tcp 10.132.0.70:15021: connect: connection refused body:
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-main-12288c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-main-12288c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-6hkkd

Unhealthy

Readiness probe failed: Get "http://10.133.0.41:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-6hkkd

ProbeError

Readiness probe error: Get "http://10.133.0.41:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-tqlvx

Unhealthy

Readiness probe failed: Get "http://10.134.0.39:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-tqlvx

ProbeError

Readiness probe error: Get "http://10.134.0.39:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-q6cx2

ProbeError

Readiness probe error: Get "http://10.132.0.34:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-q6cx2

Unhealthy

Readiness probe failed: Get "http://10.132.0.34:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-lgvxj

Unhealthy

Readiness probe failed: Get "http://10.133.0.43:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-lgvxj

ProbeError

Readiness probe error: Get "http://10.133.0.43:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-xj5qx

ProbeError

Readiness probe error: Get "http://10.132.0.55:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-xj5qx

Unhealthy

Readiness probe failed: Get "http://10.132.0.55:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-2x8vt

ProbeError

Readiness probe error: Get "http://10.134.0.40:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-2x8vt

Unhealthy

Readiness probe failed: Get "http://10.134.0.40:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-kndtt

ProbeError

Readiness probe error: Get "http://10.133.0.45:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-n79ks

Unhealthy

Readiness probe failed: Get "http://10.132.0.58:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-gvnng

ProbeError

Readiness probe error: Get "http://10.132.0.57:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-n79ks

ProbeError

Readiness probe error: Get "http://10.132.0.58:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-gvnng

Unhealthy

Readiness probe failed: Get "http://10.132.0.57:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-59f957fdd7-kndtt

Unhealthy

Readiness probe failed: Get "http://10.133.0.45:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-main-e56f6e-6c854875f4-s4494

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-main-e56f6e-754b95b59-df49l

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-main-12288c-67c58f56c96ms6g

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-main-12288c-55f4d7c574-8k45w

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503