Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-pre-processing-7b98bb678c-r44xg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-7b98bb678c-r44xg to ip-10-0-140-36.ec2.internal

openshift-ingress

router-default-d6f88c97f-qsxvw

FailedScheduling

no nodes available to schedule pods

openshift-ingress

maas-default-gateway-openshift-default-9f5889779-wqw48

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-9f5889779-wqw48 to ip-10-0-140-36.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-9f5889779-cc9wb

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-9f5889779-cc9wb to ip-10-0-140-36.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-7974757cbfz6tcg

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-7974757cbfz6tcg to ip-10-0-138-215.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-9f5889779-7b2vr

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-9f5889779-7b2vr to ip-10-0-140-36.ec2.internal

openshift-ingress

kube-auth-proxy-55b669d8cd-n2fht

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-55b669d8cd-n2fht to ip-10-0-139-2.ec2.internal

openshift-ingress

openshift-ai-inference-openshift-ai-inference-6dcfc679d7-976mm

Scheduled

Successfully assigned openshift-ingress/openshift-ai-inference-openshift-ai-inference-6dcfc679d7-976mm to ip-10-0-138-215.ec2.internal

openshift-ingress

router-default-d6f88c97f-qsxvw

FailedScheduling

no nodes available to schedule pods

openshift-ingress

istiod-openshift-gateway-7876bfcb74-4b8kb

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7876bfcb74-4b8kb to ip-10-0-139-2.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-9f5889779-s98m2

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-9f5889779-s98m2 to ip-10-0-138-215.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-9f5889779-2s7rm

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-9f5889779-2s7rm to ip-10-0-138-215.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-9f5889779-r7mwn

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-9f5889779-r7mwn to ip-10-0-138-215.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-9f5889779-dl6pw

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-9f5889779-dl6pw to ip-10-0-139-2.ec2.internal

openshift-ingress

payload-processing-5f78687d5b-f66cv

Scheduled

Successfully assigned openshift-ingress/payload-processing-5f78687d5b-f66cv to ip-10-0-140-36.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-9f5889779-nr6rk

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-9f5889779-nr6rk to ip-10-0-139-2.ec2.internal

openshift-ingress

router-default-d6f88c97f-qsxvw

Scheduled

Successfully assigned openshift-ingress/router-default-d6f88c97f-qsxvw to ip-10-0-138-215.ec2.internal

openshift-ingress

kube-auth-proxy-55b669d8cd-r4r4s

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-55b669d8cd-r4r4s to ip-10-0-140-36.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-9f5889779-2d4d4

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-9f5889779-2d4d4 to ip-10-0-140-36.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-9f5889779-fx5lx

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-9f5889779-fx5lx to ip-10-0-139-2.ec2.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-k8pcv

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-k8pcv to ip-10-0-139-2.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-d6f88c97f from 0 to 1

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x2)

openshift-ingress

replicaset-controller

router-default-d6f88c97f

FailedCreate

Error creating: pods "router-default-d6f88c97f-" is forbidden: error fetching namespace "openshift-ingress": unable to find annotation openshift.io/sa.scc.uid-range

openshift-ingress

replicaset-controller

router-default-d6f88c97f

SuccessfulCreate

Created pod: router-default-d6f88c97f-qsxvw
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts
(x5)

openshift-ingress

kubelet

router-default-d6f88c97f-qsxvw

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x5)

openshift-ingress

kubelet

router-default-d6f88c97f-qsxvw

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x2)

openshift-ingress

kubelet

router-default-d6f88c97f-qsxvw

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

kubelet

router-default-d6f88c97f-qsxvw

Created

Container created

openshift-ingress

kubelet

router-default-d6f88c97f-qsxvw

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3a679d80eb36ca7db888d4fbd1fdf16b0997a7c7a107936396b7a57d8b199f4e" already present on machine and can be accessed by the pod

openshift-ingress

multus

router-default-d6f88c97f-qsxvw

AddedInterface

Add eth0 [10.132.0.9/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-d6f88c97f-qsxvw

Started

Container started

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulCreate

Created pod: istiod-openshift-gateway-7876bfcb74-4b8kb

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7876bfcb74 from 0 to 1

openshift-ingress

multus

istiod-openshift-gateway-7876bfcb74-4b8kb

AddedInterface

Add eth0 [10.133.0.18/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-4b8kb

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-4b8kb

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 3.14s (3.14s including waiting). Image size: 185476477 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-4b8kb

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-4b8kb

Started

Container started

openshift-ingress

replicaset-controller

openshift-ai-inference-openshift-ai-inference-6dcfc679d7

SuccessfulCreate

Created pod: openshift-ai-inference-openshift-ai-inference-6dcfc679d7-976mm

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-9f5889779

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-9f5889779-cc9wb

openshift-ingress

kubelet

maas-default-gateway-openshift-default-9f5889779-cc9wb

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

multus

maas-default-gateway-openshift-default-9f5889779-cc9wb

AddedInterface

Add eth0 [10.134.0.22/23] from ovn-kubernetes

openshift-ingress

deployment-controller

openshift-ai-inference-openshift-ai-inference

ScalingReplicaSet

Scaled up replica set openshift-ai-inference-openshift-ai-inference-6dcfc679d7 from 0 to 1
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-4b8kb

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-9f5889779 from 0 to 1
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-4b8kb

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

service-controller

openshift-ai-inference-openshift-ai-inference

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-6dcfc679d7-976mm

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

multus

openshift-ai-inference-openshift-ai-inference-6dcfc679d7-976mm

AddedInterface

Add eth0 [10.132.0.33/23] from ovn-kubernetes

openshift-ingress

service-controller

openshift-ai-inference-openshift-ai-inference

EnsuredLoadBalancer

Ensured load balancer

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-6dcfc679d7-976mm

Started

Container started

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-6dcfc679d7-976mm

Created

Container created

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-6dcfc679d7-976mm

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 3.117s (3.117s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-9f5889779-cc9wb

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 5.346s (5.346s including waiting). Image size: 183555333 bytes.

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-55b669d8cd from 0 to 2

openshift-ingress

replicaset-controller

kube-auth-proxy-55b669d8cd

SuccessfulCreate

Created pod: kube-auth-proxy-55b669d8cd-r4r4s

openshift-ingress

replicaset-controller

kube-auth-proxy-55b669d8cd

SuccessfulCreate

Created pod: kube-auth-proxy-55b669d8cd-n2fht

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-7974757cbfz6tcg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

kube-auth-proxy-55b669d8cd-n2fht

AddedInterface

Add eth0 [10.133.0.21/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-7974757cbfz6tcg

Started

Container started

openshift-ingress

kubelet

kube-auth-proxy-55b669d8cd-n2fht

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"

openshift-ingress

kubelet

kube-auth-proxy-55b669d8cd-r4r4s

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-7974757cbfz6tcg

AddedInterface

Add eth0 [10.132.0.38/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-7974757cbf

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-7974757cbfz6tcg

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-7974757cbf from 0 to 1

openshift-ingress

multus

kube-auth-proxy-55b669d8cd-r4r4s

AddedInterface

Add eth0 [10.134.0.29/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-7974757cbfz6tcg

Created

Container created

openshift-ingress

kubelet

kube-auth-proxy-55b669d8cd-r4r4s

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.26s (2.26s including waiting). Image size: 188904677 bytes.

openshift-ingress

kubelet

kube-auth-proxy-55b669d8cd-r4r4s

Created

Container created

openshift-ingress

kubelet

kube-auth-proxy-55b669d8cd-r4r4s

Started

Container started

openshift-ingress

kubelet

kube-auth-proxy-55b669d8cd-n2fht

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.548s (2.548s including waiting). Image size: 188904677 bytes.

openshift-ingress

kubelet

kube-auth-proxy-55b669d8cd-n2fht

Created

Container created

openshift-ingress

kubelet

kube-auth-proxy-55b669d8cd-n2fht

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-k8pcv

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-k8pcv

AddedInterface

Add eth0 [10.133.0.26/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-k8pcv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-k8pcv

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-k8pcv

Started

Container started

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7876bfcb74-4b8kb

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-4b8kb

Killing

Stopping container discovery

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7876bfcb74 from 1 to 0
(x5)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-9f5889779-cc9wb

Started

Container started
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-9f5889779-cc9wb

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-9f5889779-cc9wb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-9f5889779-cc9wb

Unhealthy

Startup probe failed: Get "http://10.134.0.22:15021/healthz/ready": dial tcp 10.134.0.22:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-9f5889779-cc9wb

ProbeError

Startup probe error: Get "http://10.134.0.22:15021/healthz/ready": dial tcp 10.134.0.22:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5f78687d5b from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

FailedCreate

Error creating: pods "payload-pre-processing-7b98bb678c-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-5f78687d5b

FailedCreate

Error creating: pods "payload-processing-5f78687d5b-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-processing-5f78687d5b

SuccessfulCreate

Created pod: payload-processing-5f78687d5b-f66cv

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

SuccessfulCreate

Created pod: payload-pre-processing-7b98bb678c-r44xg

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-7b98bb678c from 0 to 1

openshift-ingress

kubelet

payload-processing-5f78687d5b-f66cv

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-processing-5f78687d5b-f66cv

AddedInterface

Add eth0 [10.134.0.38/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-r44xg

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-pre-processing-7b98bb678c-r44xg

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5f78687d5b-f66cv

Created

Container created

openshift-ingress

kubelet

payload-processing-5f78687d5b-f66cv

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.083s (2.083s including waiting). Image size: 125317101 bytes.

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-r44xg

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-r44xg

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-r44xg

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.031s (2.031s including waiting). Image size: 125317101 bytes.

openshift-ingress

kubelet

payload-processing-5f78687d5b-f66cv

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-9f5889779-nr6rk

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-9f5889779

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-9f5889779-nr6rk

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-9f5889779 from 1 to 4

openshift-ingress

multus

maas-default-gateway-openshift-default-9f5889779-nr6rk

AddedInterface

Add eth0 [10.133.0.31/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-9f5889779-2s7rm

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-9f5889779-2s7rm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-9f5889779-2s7rm

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-9f5889779-2s7rm

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-9f5889779-7b2vr

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-9f5889779-7b2vr

Created

Container created

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-9f5889779

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-9f5889779-2s7rm

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-9f5889779

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-9f5889779-7b2vr

openshift-ingress

multus

maas-default-gateway-openshift-default-9f5889779-7b2vr

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-9f5889779-7b2vr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-9f5889779-nr6rk

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-9f5889779-nr6rk

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-9f5889779-nr6rk

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 3.875s (3.875s including waiting). Image size: 183555333 bytes.
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-9f5889779-7b2vr

Unhealthy

Startup probe failed: Get "http://10.134.0.46:15021/healthz/ready": dial tcp 10.134.0.46:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-9f5889779-2s7rm

ProbeError

Startup probe error: Get "http://10.132.0.48:15021/healthz/ready": dial tcp 10.132.0.48:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-9f5889779-2s7rm

Unhealthy

Startup probe failed: Get "http://10.132.0.48:15021/healthz/ready": dial tcp 10.132.0.48:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-9f5889779-7b2vr

ProbeError

Startup probe error: Get "http://10.134.0.46:15021/healthz/ready": dial tcp 10.134.0.46:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-9f5889779-nr6rk

ProbeError

Startup probe error: Get "http://10.133.0.31:15021/healthz/ready": dial tcp 10.133.0.31:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-9f5889779-nr6rk

Unhealthy

Startup probe failed: Get "http://10.133.0.31:15021/healthz/ready": dial tcp 10.133.0.31:15021: connect: connection refused

openshift-ingress

kubelet

maas-default-gateway-openshift-default-9f5889779-2d4d4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-9f5889779

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-9f5889779-r7mwn

openshift-ingress

multus

maas-default-gateway-openshift-default-9f5889779-2d4d4

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-9f5889779-2d4d4

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-9f5889779-2d4d4

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-9f5889779-fx5lx

AddedInterface

Add eth0 [10.133.0.32/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-9f5889779-fx5lx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-9f5889779-fx5lx

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-9f5889779-fx5lx

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-9f5889779-r7mwn

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-9f5889779-r7mwn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-9f5889779-r7mwn

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 8; reason:

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-9f5889779 from 4 to 8

openshift-ingress

kubelet

maas-default-gateway-openshift-default-9f5889779-r7mwn

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-9f5889779-s98m2

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-9f5889779-s98m2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-9f5889779-s98m2

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-9f5889779-s98m2

Started

Container started

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-9f5889779

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-9f5889779-s98m2

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-9f5889779

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-9f5889779-fx5lx

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-9f5889779

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-9f5889779-2d4d4
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-9f5889779-s98m2

Unhealthy

Startup probe failed: Get "http://10.132.0.49:15021/healthz/ready": dial tcp 10.132.0.49:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-9f5889779-fx5lx

ProbeError

Startup probe error: Get "http://10.133.0.32:15021/healthz/ready": dial tcp 10.133.0.32:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-9f5889779-2d4d4

ProbeError

Startup probe error: Get "http://10.134.0.47:15021/healthz/ready": dial tcp 10.134.0.47:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-9f5889779-2d4d4

Unhealthy

Startup probe failed: Get "http://10.134.0.47:15021/healthz/ready": dial tcp 10.134.0.47:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-9f5889779-r7mwn

Unhealthy

Startup probe failed: Get "http://10.132.0.50:15021/healthz/ready": dial tcp 10.132.0.50:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-9f5889779-r7mwn

ProbeError

Startup probe error: Get "http://10.132.0.50:15021/healthz/ready": dial tcp 10.132.0.50:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-9f5889779-fx5lx

Unhealthy

Startup probe failed: Get "http://10.133.0.32:15021/healthz/ready": dial tcp 10.133.0.32:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-9f5889779-s98m2

ProbeError

Startup probe error: Get "http://10.132.0.49:15021/healthz/ready": dial tcp 10.132.0.49:15021: connect: connection refused body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-9f5889779-dl6pw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-9f5889779-wqw48

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-9f5889779-wqw48

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-9f5889779-dl6pw

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-9f5889779-wqw48

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-9f5889779-wqw48

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-9f5889779-dl6pw

Created

Container created

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-9f5889779

SuccessfulCreate

(combined from similar events): Created pod: maas-default-gateway-openshift-default-9f5889779-wqw48

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-9f5889779

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-9f5889779-dl6pw

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-9f5889779 from 8 to 10

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 10; reason:

openshift-ingress

multus

maas-default-gateway-openshift-default-9f5889779-dl6pw

AddedInterface

Add eth0 [10.133.0.33/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-9f5889779-dl6pw

Unhealthy

Startup probe failed: Get "http://10.133.0.33:15021/healthz/ready": dial tcp 10.133.0.33:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-9f5889779-dl6pw

ProbeError

Startup probe error: Get "http://10.133.0.33:15021/healthz/ready": dial tcp 10.133.0.33:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-9f5889779-wqw48

Unhealthy

Startup probe failed: Get "http://10.134.0.48:15021/healthz/ready": dial tcp 10.134.0.48:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-9f5889779-wqw48

ProbeError

Startup probe error: Get "http://10.134.0.48:15021/healthz/ready": dial tcp 10.134.0.48:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-9f5889779 from 10 to 8

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-9f5889779

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-9f5889779-2d4d4

openshift-ingress

kubelet

maas-default-gateway-openshift-default-9f5889779-2d4d4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-9f5889779-wqw48

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-9f5889779

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-9f5889779-wqw48

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-9f5889779-fx5lx

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-9f5889779

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-9f5889779-dl6pw

openshift-ingress

kubelet

maas-default-gateway-openshift-default-9f5889779-dl6pw

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-9f5889779

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-9f5889779-fx5lx

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-9f5889779

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-9f5889779-nr6rk

openshift-ingress

kubelet

maas-default-gateway-openshift-default-9f5889779-s98m2

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-9f5889779

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-9f5889779-2s7rm

openshift-ingress

kubelet

maas-default-gateway-openshift-default-9f5889779-r7mwn

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-9f5889779

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-9f5889779-r7mwn

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-9f5889779

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-9f5889779-s98m2

openshift-ingress

kubelet

maas-default-gateway-openshift-default-9f5889779-2s7rm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-9f5889779-nr6rk

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-9f5889779 from 8 to 2

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-9f5889779

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-9f5889779-7b2vr

openshift-ingress

kubelet

maas-default-gateway-openshift-default-9f5889779-7b2vr

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-9f5889779 from 2 to 1