Time Namespace Component RelatedObject Reason Message

openshift-ingress

router-default-7c4dcd98c-hvk8b

Scheduled

Successfully assigned openshift-ingress/router-default-7c4dcd98c-hvk8b to ip-10-0-139-174.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-6f54779779-ll65n

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6f54779779-ll65n to ip-10-0-134-241.us-west-1.compute.internal

openshift-ingress

openshift-ai-inference-openshift-ai-inference-5579cb49c9-kh64b

Scheduled

Successfully assigned openshift-ingress/openshift-ai-inference-openshift-ai-inference-5579cb49c9-kh64b to ip-10-0-139-174.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-6f54779779-zzqkr

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6f54779779-zzqkr to ip-10-0-134-241.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-6f54779779-zxcfg

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6f54779779-zxcfg to ip-10-0-136-69.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-7b98bb678c-2wf9z

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-7b98bb678c-2wf9z to ip-10-0-136-69.us-west-1.compute.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-7556cf8c579zksq

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-7556cf8c579zksq to ip-10-0-139-174.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-6f54779779-zpjq2

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6f54779779-zpjq2 to ip-10-0-139-174.us-west-1.compute.internal

openshift-ingress

payload-processing-55fbbbf9dc-5vv5s

Scheduled

Successfully assigned openshift-ingress/payload-processing-55fbbbf9dc-5vv5s to ip-10-0-136-69.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-6f54779779-th4lh

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6f54779779-th4lh to ip-10-0-136-69.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-6f54779779-swcp2

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6f54779779-swcp2 to ip-10-0-139-174.us-west-1.compute.internal

openshift-ingress

kube-auth-proxy-7d877ff967-67f7z

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-7d877ff967-67f7z to ip-10-0-134-241.us-west-1.compute.internal

openshift-ingress

router-default-7c4dcd98c-hvk8b

FailedScheduling

no nodes available to schedule pods

openshift-ingress

router-default-7c4dcd98c-hvk8b

FailedScheduling

no nodes available to schedule pods

openshift-ingress

istiod-openshift-gateway-7876bfcb74-rszk7

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7876bfcb74-rszk7 to ip-10-0-136-69.us-west-1.compute.internal

openshift-ingress

kube-auth-proxy-7d877ff967-8xtlc

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-7d877ff967-8xtlc to ip-10-0-136-69.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-6f54779779-9stkc

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6f54779779-9stkc to ip-10-0-139-174.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-6f54779779-dtq86

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6f54779779-dtq86 to ip-10-0-136-69.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-6f54779779-f76ph

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6f54779779-f76ph to ip-10-0-134-241.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-6f54779779-jmftm

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6f54779779-jmftm to ip-10-0-136-69.us-west-1.compute.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-qxlmv

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qxlmv to ip-10-0-139-174.us-west-1.compute.internal

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-7c4dcd98c from 0 to 1

openshift-ingress

replicaset-controller

router-default-7c4dcd98c

SuccessfulCreate

Created pod: router-default-7c4dcd98c-hvk8b
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts
(x5)

openshift-ingress

kubelet

router-default-7c4dcd98c-hvk8b

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x5)

openshift-ingress

kubelet

router-default-7c4dcd98c-hvk8b

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x5)

openshift-ingress

kubelet

router-default-7c4dcd98c-hvk8b

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x5)

openshift-ingress

kubelet

router-default-7c4dcd98c-hvk8b

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

kubelet

router-default-7c4dcd98c-hvk8b

Created

Container created

openshift-ingress

kubelet

router-default-7c4dcd98c-hvk8b

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3a679d80eb36ca7db888d4fbd1fdf16b0997a7c7a107936396b7a57d8b199f4e" already present on machine and can be accessed by the pod

openshift-ingress

multus

router-default-7c4dcd98c-hvk8b

AddedInterface

Add eth0 [10.132.0.21/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-7c4dcd98c-hvk8b

Started

Container started

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulCreate

Created pod: istiod-openshift-gateway-7876bfcb74-rszk7

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7876bfcb74 from 0 to 1

openshift-ingress

multus

istiod-openshift-gateway-7876bfcb74-rszk7

AddedInterface

Add eth0 [10.133.0.19/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-rszk7

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-rszk7

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 4.457s (4.457s including waiting). Image size: 185476477 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-rszk7

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-rszk7

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-rszk7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-rszk7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

openshift-ai-inference-openshift-ai-inference

ScalingReplicaSet

Scaled up replica set openshift-ai-inference-openshift-ai-inference-5579cb49c9 from 0 to 1

openshift-ingress

replicaset-controller

openshift-ai-inference-openshift-ai-inference-5579cb49c9

SuccessfulCreate

Created pod: openshift-ai-inference-openshift-ai-inference-5579cb49c9-kh64b

openshift-ingress

service-controller

openshift-ai-inference-openshift-ai-inference

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-6f54779779 from 0 to 1

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6f54779779

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6f54779779-9stkc

openshift-ingress

multus

maas-default-gateway-openshift-default-6f54779779-9stkc

AddedInterface

Add eth0 [10.132.0.28/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-9stkc

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-5579cb49c9-kh64b

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

multus

openshift-ai-inference-openshift-ai-inference-5579cb49c9-kh64b

AddedInterface

Add eth0 [10.132.0.30/23] from ovn-kubernetes

openshift-ingress

service-controller

openshift-ai-inference-openshift-ai-inference

EnsuredLoadBalancer

Ensured load balancer

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-9stkc

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 7.195s (7.195s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-5579cb49c9-kh64b

Started

Container started

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-5579cb49c9-kh64b

Created

Container created

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-5579cb49c9-kh64b

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 6.927s (6.927s including waiting). Image size: 183555333 bytes.

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x4)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-7556cf8c57 from 0 to 1

openshift-ingress

multus

kube-auth-proxy-7d877ff967-8xtlc

AddedInterface

Add eth0 [10.133.0.21/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

kube-auth-proxy-7d877ff967

SuccessfulCreate

Created pod: kube-auth-proxy-7d877ff967-8xtlc

openshift-ingress

kubelet

kube-auth-proxy-7d877ff967-67f7z

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-7d877ff967 from 0 to 2

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-7556cf8c57

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-7556cf8c579zksq

openshift-ingress

multus

kube-auth-proxy-7d877ff967-67f7z

AddedInterface

Add eth0 [10.134.0.31/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

kube-auth-proxy-7d877ff967

SuccessfulCreate

Created pod: kube-auth-proxy-7d877ff967-67f7z

openshift-ingress

kubelet

kube-auth-proxy-7d877ff967-8xtlc

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-7556cf8c579zksq

Started

Container started

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-7556cf8c579zksq

AddedInterface

Add eth0 [10.132.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-7556cf8c579zksq

Created

Container created

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-7556cf8c579zksq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

kube-auth-proxy-7d877ff967-8xtlc

Started

Container started

openshift-ingress

kubelet

kube-auth-proxy-7d877ff967-67f7z

Started

Container started

openshift-ingress

kubelet

kube-auth-proxy-7d877ff967-67f7z

Created

Container created

openshift-ingress

kubelet

kube-auth-proxy-7d877ff967-8xtlc

Created

Container created

openshift-ingress

kubelet

kube-auth-proxy-7d877ff967-67f7z

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.804s (2.804s including waiting). Image size: 188904677 bytes.

openshift-ingress

kubelet

kube-auth-proxy-7d877ff967-8xtlc

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.821s (2.821s including waiting). Image size: 188904677 bytes.

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-qxlmv

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-qxlmv

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-qxlmv

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-qxlmv

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-qxlmv

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 3.589s (3.589s including waiting). Image size: 185476477 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-qxlmv

Started

Container started

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7876bfcb74 from 1 to 0

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7876bfcb74-rszk7

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-rszk7

Killing

Stopping container discovery

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-9stkc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-9stkc

Started

Container started
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-9stkc

Created

Container created
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-9stkc

Unhealthy

Startup probe failed: Get "http://10.132.0.28:15021/healthz/ready": dial tcp 10.132.0.28:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-9stkc

ProbeError

Startup probe error: Get "http://10.132.0.28:15021/healthz/ready": dial tcp 10.132.0.28:15021: connect: connection refused body:
(x6)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-6f54779779 from 1 to 2

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-dtq86

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6f54779779

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6f54779779-dtq86

openshift-ingress

multus

maas-default-gateway-openshift-default-6f54779779-dtq86

AddedInterface

Add eth0 [10.133.0.30/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-dtq86

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-dtq86

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-dtq86

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 4.525s (4.525s including waiting). Image size: 183555333 bytes.
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-dtq86

ProbeError

Startup probe error: Get "http://10.133.0.30:15021/healthz/ready": dial tcp 10.133.0.30:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-dtq86

Unhealthy

Startup probe failed: Get "http://10.133.0.30:15021/healthz/ready": dial tcp 10.133.0.30:15021: connect: connection refused
(x7)

openshift-ingress

replicaset-controller

payload-processing-55fbbbf9dc

FailedCreate

Error creating: pods "payload-processing-55fbbbf9dc-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-55fbbbf9dc from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-7b98bb678c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-55fbbbf9dc

SuccessfulCreate

Created pod: payload-processing-55fbbbf9dc-5vv5s

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

SuccessfulCreate

Created pod: payload-pre-processing-7b98bb678c-2wf9z
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

FailedCreate

Error creating: pods "payload-pre-processing-7b98bb678c-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-5vv5s

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-processing-55fbbbf9dc-5vv5s

AddedInterface

Add eth0 [10.133.0.33/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-7b98bb678c-2wf9z

AddedInterface

Add eth0 [10.133.0.32/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-6f54779779 from 2 to 3

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6f54779779

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6f54779779-ll65n

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-2wf9z

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-ll65n

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

multus

maas-default-gateway-openshift-default-6f54779779-ll65n

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-2wf9z

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.914s (2.914s including waiting). Image size: 125353963 bytes.

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-5vv5s

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-2wf9z

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-2wf9z

Started

Container started

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-5vv5s

Created

Container created

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-5vv5s

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.72s (2.72s including waiting). Image size: 125353963 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-ll65n

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 3.666s (3.666s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-ll65n

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-ll65n

Created

Container created
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-ll65n

Unhealthy

Startup probe failed: Get "http://10.134.0.40:15021/healthz/ready": dial tcp 10.134.0.40:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-ll65n

ProbeError

Startup probe error: Get "http://10.134.0.40:15021/healthz/ready": dial tcp 10.134.0.40:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6f54779779

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6f54779779-zxcfg

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-6f54779779 from 3 to 4

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-zxcfg

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-zxcfg

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-zxcfg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-6f54779779-zxcfg

AddedInterface

Add eth0 [10.133.0.35/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-zxcfg

Unhealthy

Startup probe failed: Get "http://10.133.0.35:15021/healthz/ready": dial tcp 10.133.0.35:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-zxcfg

ProbeError

Startup probe error: Get "http://10.133.0.35:15021/healthz/ready": dial tcp 10.133.0.35:15021: connect: connection refused body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-zpjq2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-6f54779779-zzqkr

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-6f54779779-zpjq2

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-zpjq2

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-zpjq2

Started

Container started

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6f54779779

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6f54779779-zpjq2

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6f54779779

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6f54779779-zzqkr

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-zzqkr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-zzqkr

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-zzqkr

Started

Container started

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-6f54779779 from 4 to 6
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-zzqkr

Unhealthy

Startup probe failed: Get "http://10.134.0.41:15021/healthz/ready": dial tcp 10.134.0.41:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-zzqkr

ProbeError

Startup probe error: Get "http://10.134.0.41:15021/healthz/ready": dial tcp 10.134.0.41:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-zpjq2

Unhealthy

Startup probe failed: Get "http://10.132.0.47:15021/healthz/ready": dial tcp 10.132.0.47:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-zpjq2

ProbeError

Startup probe error: Get "http://10.132.0.47:15021/healthz/ready": dial tcp 10.132.0.47:15021: connect: connection refused body:

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-6f54779779 from 6 to 10

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6f54779779

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6f54779779-f76ph

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

maas-default-gateway-openshift-default-6f54779779-f76ph

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-th4lh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-6f54779779-th4lh

AddedInterface

Add eth0 [10.133.0.42/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-6f54779779-swcp2

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-6f54779779-jmftm

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-jmftm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6f54779779

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6f54779779-th4lh

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6f54779779

SuccessfulCreate

(combined from similar events): Created pod: maas-default-gateway-openshift-default-6f54779779-jmftm

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6f54779779

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6f54779779-swcp2

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-f76ph

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-jmftm

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-jmftm

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-th4lh

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-swcp2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-swcp2

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-swcp2

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-f76ph

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-f76ph

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-th4lh

Created

Container created
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-jmftm

Unhealthy

Startup probe failed: Get "http://10.133.0.43:15021/healthz/ready": dial tcp 10.133.0.43:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-f76ph

ProbeError

Startup probe error: Get "http://10.134.0.42:15021/healthz/ready": dial tcp 10.134.0.42:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-jmftm

ProbeError

Startup probe error: Get "http://10.133.0.43:15021/healthz/ready": dial tcp 10.133.0.43:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-swcp2

ProbeError

Startup probe error: Get "http://10.132.0.49:15021/healthz/ready": dial tcp 10.132.0.49:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-swcp2

Unhealthy

Startup probe failed: Get "http://10.132.0.49:15021/healthz/ready": dial tcp 10.132.0.49:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-th4lh

Unhealthy

Startup probe failed: Get "http://10.133.0.42:15021/healthz/ready": dial tcp 10.133.0.42:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-th4lh

ProbeError

Startup probe error: Get "http://10.133.0.42:15021/healthz/ready": dial tcp 10.133.0.42:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-f76ph

Unhealthy

Startup probe failed: Get "http://10.134.0.42:15021/healthz/ready": dial tcp 10.134.0.42:15021: connect: connection refused

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6f54779779

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-6f54779779-jmftm

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6f54779779

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-6f54779779-zxcfg

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-zxcfg

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-6f54779779 from 10 to 6

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-th4lh

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6f54779779

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-6f54779779-dtq86

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6f54779779

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-6f54779779-th4lh

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-dtq86

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-jmftm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-zxcfg

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-zxcfg

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-zpjq2

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6f54779779

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-6f54779779-ll65n

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-zzqkr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-9stkc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-ll65n

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-6f54779779 from 6 to 2

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6f54779779

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-6f54779779-zpjq2

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6f54779779

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-6f54779779-9stkc

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6f54779779

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-6f54779779-zzqkr

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-9stkc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-9stkc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6f54779779

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-6f54779779-swcp2

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-swcp2

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-6f54779779 from 2 to 1