Time Namespace Component RelatedObject Reason Message

openshift-ingress

openshift-ai-inference-openshift-default-568c495856-s86wq

Scheduled

Successfully assigned openshift-ingress/openshift-ai-inference-openshift-default-568c495856-s86wq to ip-10-0-143-57.us-west-2.compute.internal

openshift-ingress

openshift-ai-inference-openshift-default-568c495856-jtzw2

Scheduled

Successfully assigned openshift-ingress/openshift-ai-inference-openshift-default-568c495856-jtzw2 to ip-10-0-131-97.us-west-2.compute.internal

openshift-ingress

openshift-ai-inference-openshift-default-568c495856-kzxcm

Scheduled

Successfully assigned openshift-ingress/openshift-ai-inference-openshift-default-568c495856-kzxcm to ip-10-0-132-125.us-west-2.compute.internal

openshift-ingress

openshift-ai-inference-openshift-default-568c495856-kq5fz

Scheduled

Successfully assigned openshift-ingress/openshift-ai-inference-openshift-default-568c495856-kq5fz to ip-10-0-132-125.us-west-2.compute.internal

openshift-ingress

openshift-ai-inference-openshift-default-568c495856-mkpp5

Scheduled

Successfully assigned openshift-ingress/openshift-ai-inference-openshift-default-568c495856-mkpp5 to ip-10-0-132-125.us-west-2.compute.internal

openshift-ingress

openshift-ai-inference-openshift-default-568c495856-nfb67

Scheduled

Successfully assigned openshift-ingress/openshift-ai-inference-openshift-default-568c495856-nfb67 to ip-10-0-132-125.us-west-2.compute.internal

openshift-ingress

openshift-ai-inference-openshift-default-568c495856-npztz

Scheduled

Successfully assigned openshift-ingress/openshift-ai-inference-openshift-default-568c495856-npztz to ip-10-0-143-57.us-west-2.compute.internal

openshift-ingress

openshift-ai-inference-openshift-default-568c495856-p857s

Scheduled

Successfully assigned openshift-ingress/openshift-ai-inference-openshift-default-568c495856-p857s to ip-10-0-131-97.us-west-2.compute.internal

openshift-ingress

openshift-ai-inference-openshift-default-568c495856-kb28w

Scheduled

Successfully assigned openshift-ingress/openshift-ai-inference-openshift-default-568c495856-kb28w to ip-10-0-132-125.us-west-2.compute.internal

openshift-ingress

openshift-ai-inference-openshift-default-568c495856-q8ngg

Scheduled

Successfully assigned openshift-ingress/openshift-ai-inference-openshift-default-568c495856-q8ngg to ip-10-0-143-57.us-west-2.compute.internal

openshift-ingress

openshift-ai-inference-openshift-default-568c495856-k9d69

Scheduled

Successfully assigned openshift-ingress/openshift-ai-inference-openshift-default-568c495856-k9d69 to ip-10-0-143-57.us-west-2.compute.internal

openshift-ingress

openshift-ai-inference-openshift-default-568c495856-q9tdb

Scheduled

Successfully assigned openshift-ingress/openshift-ai-inference-openshift-default-568c495856-q9tdb to ip-10-0-132-125.us-west-2.compute.internal

openshift-ingress

openshift-ai-inference-openshift-default-568c495856-qrgs4

Scheduled

Successfully assigned openshift-ingress/openshift-ai-inference-openshift-default-568c495856-qrgs4 to ip-10-0-132-125.us-west-2.compute.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-47szr

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-47szr to ip-10-0-131-97.us-west-2.compute.internal

openshift-ingress

openshift-ai-inference-openshift-default-568c495856-s4q4v

Scheduled

Successfully assigned openshift-ingress/openshift-ai-inference-openshift-default-568c495856-s4q4v to ip-10-0-132-125.us-west-2.compute.internal

openshift-ingress

openshift-ai-inference-openshift-default-568c495856-m76bd

Scheduled

Successfully assigned openshift-ingress/openshift-ai-inference-openshift-default-568c495856-m76bd to ip-10-0-131-97.us-west-2.compute.internal

openshift-ingress

openshift-ai-inference-openshift-default-568c495856-t4bb8

Scheduled

Successfully assigned openshift-ingress/openshift-ai-inference-openshift-default-568c495856-t4bb8 to ip-10-0-143-57.us-west-2.compute.internal

openshift-ingress

openshift-ai-inference-openshift-default-568c495856-v6lqx

Scheduled

Successfully assigned openshift-ingress/openshift-ai-inference-openshift-default-568c495856-v6lqx to ip-10-0-132-125.us-west-2.compute.internal

openshift-ingress

openshift-ai-inference-openshift-default-568c495856-j4vnw

Scheduled

Successfully assigned openshift-ingress/openshift-ai-inference-openshift-default-568c495856-j4vnw to ip-10-0-132-125.us-west-2.compute.internal

openshift-ingress

openshift-ai-inference-openshift-default-568c495856-vdhnm

Scheduled

Successfully assigned openshift-ingress/openshift-ai-inference-openshift-default-568c495856-vdhnm to ip-10-0-132-125.us-west-2.compute.internal

openshift-ingress

openshift-ai-inference-openshift-default-568c495856-h2nt2

Scheduled

Successfully assigned openshift-ingress/openshift-ai-inference-openshift-default-568c495856-h2nt2 to ip-10-0-132-125.us-west-2.compute.internal

openshift-ingress

openshift-ai-inference-openshift-default-568c495856-vgwht

Scheduled

Successfully assigned openshift-ingress/openshift-ai-inference-openshift-default-568c495856-vgwht to ip-10-0-132-125.us-west-2.compute.internal

openshift-ingress

istiod-openshift-gateway-7876bfcb74-6mctd

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7876bfcb74-6mctd to ip-10-0-131-97.us-west-2.compute.internal

openshift-ingress

openshift-ai-inference-openshift-default-568c495856-gxtp4

Scheduled

Successfully assigned openshift-ingress/openshift-ai-inference-openshift-default-568c495856-gxtp4 to ip-10-0-131-97.us-west-2.compute.internal

openshift-ingress

openshift-ai-inference-openshift-default-568c495856-vr5gf

Scheduled

Successfully assigned openshift-ingress/openshift-ai-inference-openshift-default-568c495856-vr5gf to ip-10-0-143-57.us-west-2.compute.internal

openshift-ingress

openshift-ai-inference-openshift-default-568c495856-fvvvx

Scheduled

Successfully assigned openshift-ingress/openshift-ai-inference-openshift-default-568c495856-fvvvx to ip-10-0-143-57.us-west-2.compute.internal

openshift-ingress

openshift-ai-inference-openshift-default-568c495856-5499q

Scheduled

Successfully assigned openshift-ingress/openshift-ai-inference-openshift-default-568c495856-5499q to ip-10-0-131-97.us-west-2.compute.internal

openshift-ingress

openshift-ai-inference-openshift-default-568c495856-xc7wn

Scheduled

Successfully assigned openshift-ingress/openshift-ai-inference-openshift-default-568c495856-xc7wn to ip-10-0-131-97.us-west-2.compute.internal

openshift-ingress

openshift-ai-inference-openshift-default-568c495856-dcvp9

Scheduled

Successfully assigned openshift-ingress/openshift-ai-inference-openshift-default-568c495856-dcvp9 to ip-10-0-131-97.us-west-2.compute.internal

openshift-ingress

openshift-ai-inference-openshift-default-568c495856-xp7fd

Scheduled

Successfully assigned openshift-ingress/openshift-ai-inference-openshift-default-568c495856-xp7fd to ip-10-0-131-97.us-west-2.compute.internal

openshift-ingress

openshift-ai-inference-openshift-default-568c495856-zckrp

Scheduled

Successfully assigned openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zckrp to ip-10-0-131-97.us-west-2.compute.internal

openshift-ingress

openshift-ai-inference-openshift-default-568c495856-zlffc

Scheduled

Successfully assigned openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zlffc to ip-10-0-143-57.us-west-2.compute.internal

openshift-ingress

openshift-ai-inference-openshift-default-568c495856-c7ln8

Scheduled

Successfully assigned openshift-ingress/openshift-ai-inference-openshift-default-568c495856-c7ln8 to ip-10-0-131-97.us-west-2.compute.internal

openshift-ingress

openshift-ai-inference-openshift-default-568c495856-zmkpb

Scheduled

Successfully assigned openshift-ingress/openshift-ai-inference-openshift-default-568c495856-zmkpb to ip-10-0-143-57.us-west-2.compute.internal

openshift-ingress

openshift-ai-inference-openshift-default-568c495856-5jnbs

Scheduled

Successfully assigned openshift-ingress/openshift-ai-inference-openshift-default-568c495856-5jnbs to ip-10-0-143-57.us-west-2.compute.internal

openshift-ingress

openshift-ai-inference-openshift-default-568c495856-b9b65

Scheduled

Successfully assigned openshift-ingress/openshift-ai-inference-openshift-default-568c495856-b9b65 to ip-10-0-132-125.us-west-2.compute.internal

openshift-ingress

openshift-ai-inference-openshift-default-568c495856-77jcv

Scheduled

Successfully assigned openshift-ingress/openshift-ai-inference-openshift-default-568c495856-77jcv to ip-10-0-131-97.us-west-2.compute.internal

openshift-ingress

router-default-55c864699c-n4cfn

FailedScheduling

no nodes available to schedule pods

openshift-ingress

openshift-ai-inference-openshift-default-568c495856-6g8bg

Scheduled

Successfully assigned openshift-ingress/openshift-ai-inference-openshift-default-568c495856-6g8bg to ip-10-0-132-125.us-west-2.compute.internal

openshift-ingress

router-default-55c864699c-n4cfn

FailedScheduling

no nodes available to schedule pods

openshift-ingress

router-default-55c864699c-n4cfn

Scheduled

Successfully assigned openshift-ingress/router-default-55c864699c-n4cfn to ip-10-0-132-125.us-west-2.compute.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-55c864699c from 0 to 1

openshift-ingress

replicaset-controller

router-default-55c864699c

SuccessfulCreate

Created pod: router-default-55c864699c-n4cfn

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x5)

openshift-ingress

kubelet

router-default-55c864699c-n4cfn

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x5)

openshift-ingress

kubelet

router-default-55c864699c-n4cfn

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x3)

openshift-ingress

kubelet

router-default-55c864699c-n4cfn

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x4)

openshift-ingress

kubelet

router-default-55c864699c-n4cfn

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found

openshift-ingress

kubelet

router-default-55c864699c-n4cfn

Started

Container started

openshift-ingress

kubelet

router-default-55c864699c-n4cfn

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3a679d80eb36ca7db888d4fbd1fdf16b0997a7c7a107936396b7a57d8b199f4e" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

router-default-55c864699c-n4cfn

Created

Container created

openshift-ingress

multus

router-default-55c864699c-n4cfn

AddedInterface

Add eth0 [10.132.0.12/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-55c864699c-n4cfn

Unhealthy

Startup probe failed: HTTP probe failed with statuscode: 500

openshift-ingress

kubelet

router-default-55c864699c-n4cfn

ProbeError

Startup probe error: HTTP probe failed with statuscode: 500 body: [-]backend-proxy-http failed: reason withheld [-]has-synced failed: reason withheld [+]process-running ok healthz check failed
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7876bfcb74 from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulCreate

Created pod: istiod-openshift-gateway-7876bfcb74-6mctd

openshift-ingress

multus

istiod-openshift-gateway-7876bfcb74-6mctd

AddedInterface

Add eth0 [10.134.0.20/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-6mctd

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-6mctd

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 3.667s (3.667s including waiting). Image size: 185476477 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-6mctd

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-6mctd

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-6mctd

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-6mctd

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

openshift-ai-inference-openshift-default

ScalingReplicaSet

Scaled up replica set openshift-ai-inference-openshift-default-568c495856 from 0 to 1

openshift-ingress

gateway_labeler_controller

openshift-ai-inference

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway openshift-ai-inference

openshift-ingress

replicaset-controller

openshift-ai-inference-openshift-default-568c495856

SuccessfulCreate

Created pod: openshift-ai-inference-openshift-default-568c495856-xc7wn

openshift-ingress

service-controller

openshift-ai-inference-openshift-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-xc7wn

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

multus

openshift-ai-inference-openshift-default-568c495856-xc7wn

AddedInterface

Add eth0 [10.134.0.21/23] from ovn-kubernetes

openshift-ingress

service-controller

openshift-ai-inference-openshift-default

EnsuredLoadBalancer

Ensured load balancer

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-xc7wn

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 4.102s (4.102s including waiting). Image size: 183555333 bytes.

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-47szr

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-47szr

Started

Container started

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-47szr

AddedInterface

Add eth0 [10.134.0.30/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-47szr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-47szr

Created

Container created

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 0 to 1
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-47szr

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-47szr

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7876bfcb74 from 1 to 0

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-6mctd

Killing

Stopping container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7876bfcb74-6mctd

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-6mctd

Unhealthy

Readiness probe failed: Get "http://10.134.0.20:8080/ready": dial tcp 10.134.0.20:8080: connect: connection refused

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-6mctd

ProbeError

Readiness probe error: Get "http://10.134.0.20:8080/ready": dial tcp 10.134.0.20:8080: connect: connection refused body:

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-xc7wn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-xc7wn

Started

Container started
(x2)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-xc7wn

Created

Container created
(x5)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-xc7wn

Unhealthy

Startup probe failed: Get "http://10.134.0.21:15021/healthz/ready": dial tcp 10.134.0.21:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-xc7wn

ProbeError

Startup probe error: Get "http://10.134.0.21:15021/healthz/ready": dial tcp 10.134.0.21:15021: connect: connection refused body:

openshift-ingress

multus

openshift-ai-inference-openshift-default-568c495856-p857s

AddedInterface

Add eth0 [10.134.0.33/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

openshift-ai-inference-openshift-default-568c495856

SuccessfulCreate

Created pod: openshift-ai-inference-openshift-default-568c495856-h2nt2

openshift-ingress

multus

openshift-ai-inference-openshift-default-568c495856-h2nt2

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes

openshift-ingress

deployment-controller

openshift-ai-inference-openshift-default

ScalingReplicaSet

Scaled up replica set openshift-ai-inference-openshift-default-568c495856 from 1 to 4

openshift-ingress

replicaset-controller

openshift-ai-inference-openshift-default-568c495856

SuccessfulCreate

Created pod: openshift-ai-inference-openshift-default-568c495856-zlffc

openshift-ingress

replicaset-controller

openshift-ai-inference-openshift-default-568c495856

SuccessfulCreate

Created pod: openshift-ai-inference-openshift-default-568c495856-p857s

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-zlffc

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

multus

openshift-ai-inference-openshift-default-568c495856-zlffc

AddedInterface

Add eth0 [10.133.0.29/23] from ovn-kubernetes

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-h2nt2

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-zlffc

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 4.49s (4.49s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-h2nt2

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 4.555s (4.555s including waiting). Image size: 183555333 bytes.

openshift-ingress

multus

openshift-ai-inference-openshift-default-568c495856-kq5fz

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-default

SuccessfulRescale

New size: 8; reason:

openshift-ingress

multus

openshift-ai-inference-openshift-default-568c495856-m76bd

AddedInterface

Add eth0 [10.134.0.34/23] from ovn-kubernetes

openshift-ingress

multus

openshift-ai-inference-openshift-default-568c495856-q8ngg

AddedInterface

Add eth0 [10.133.0.30/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

openshift-ai-inference-openshift-default-568c495856

SuccessfulCreate

Created pod: openshift-ai-inference-openshift-default-568c495856-kq5fz

openshift-ingress

replicaset-controller

openshift-ai-inference-openshift-default-568c495856

SuccessfulCreate

Created pod: openshift-ai-inference-openshift-default-568c495856-q8ngg

openshift-ingress

replicaset-controller

openshift-ai-inference-openshift-default-568c495856

SuccessfulCreate

Created pod: openshift-ai-inference-openshift-default-568c495856-m76bd

openshift-ingress

replicaset-controller

openshift-ai-inference-openshift-default-568c495856

SuccessfulCreate

Created pod: openshift-ai-inference-openshift-default-568c495856-j4vnw

openshift-ingress

multus

openshift-ai-inference-openshift-default-568c495856-j4vnw

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-kq5fz

Unhealthy

Readiness probe failed: Get "http://10.132.0.48:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-m76bd

Unhealthy

Readiness probe failed: Get "http://10.134.0.34:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-q8ngg

Unhealthy

Readiness probe failed: Get "http://10.133.0.30:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-j4vnw

Unhealthy

Readiness probe failed: Get "http://10.132.0.49:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-j4vnw

ProbeError

Readiness probe error: Get "http://10.132.0.49:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-kq5fz

ProbeError

Readiness probe error: Get "http://10.132.0.48:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-m76bd

ProbeError

Readiness probe error: Get "http://10.134.0.34:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-q8ngg

ProbeError

Readiness probe error: Get "http://10.133.0.30:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-zlffc

Started

Container started
(x2)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-q8ngg

Started

Container started

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-zlffc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-zlffc

Created

Container created
(x2)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-q8ngg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-q8ngg

Created

Container created
(x2)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-p857s

Created

Container created
(x2)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-m76bd

Started

Container started
(x2)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-p857s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-m76bd

Created

Container created
(x2)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-m76bd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-p857s

Started

Container started

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-h2nt2

Unhealthy

Readiness probe failed: Get "http://10.132.0.47:15021/healthz/ready": read tcp 10.132.0.2:43700->10.132.0.47:15021: read: connection reset by peer

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-h2nt2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-kq5fz

Created

Container created
(x2)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-kq5fz

Started

Container started
(x2)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-h2nt2

Started

Container started

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-h2nt2

ProbeError

Readiness probe error: Get "http://10.132.0.47:15021/healthz/ready": read tcp 10.132.0.2:43700->10.132.0.47:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-kq5fz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-h2nt2

Created

Container created
(x2)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-j4vnw

Created

Container created
(x2)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-j4vnw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-j4vnw

Started

Container started
(x5)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-zlffc

ProbeError

Startup probe error: Get "http://10.133.0.29:15021/healthz/ready": dial tcp 10.133.0.29:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-q8ngg

ProbeError

Startup probe error: Get "http://10.133.0.30:15021/healthz/ready": dial tcp 10.133.0.30:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-q8ngg

Unhealthy

Startup probe failed: Get "http://10.133.0.30:15021/healthz/ready": dial tcp 10.133.0.30:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-zlffc

Unhealthy

Startup probe failed: Get "http://10.133.0.29:15021/healthz/ready": dial tcp 10.133.0.29:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-m76bd

ProbeError

Startup probe error: Get "http://10.134.0.34:15021/healthz/ready": dial tcp 10.134.0.34:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-m76bd

Unhealthy

Startup probe failed: Get "http://10.134.0.34:15021/healthz/ready": dial tcp 10.134.0.34:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-h2nt2

Unhealthy

Startup probe failed: Get "http://10.132.0.47:15021/healthz/ready": dial tcp 10.132.0.47:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-p857s

Unhealthy

Startup probe failed: Get "http://10.134.0.33:15021/healthz/ready": dial tcp 10.134.0.33:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-p857s

ProbeError

Startup probe error: Get "http://10.134.0.33:15021/healthz/ready": dial tcp 10.134.0.33:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-h2nt2

ProbeError

Startup probe error: Get "http://10.132.0.47:15021/healthz/ready": dial tcp 10.132.0.47:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-kq5fz

ProbeError

Startup probe error: Get "http://10.132.0.48:15021/healthz/ready": dial tcp 10.132.0.48:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-kq5fz

Unhealthy

Startup probe failed: Get "http://10.132.0.48:15021/healthz/ready": dial tcp 10.132.0.48:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-j4vnw

Unhealthy

Startup probe failed: Get "http://10.132.0.49:15021/healthz/ready": dial tcp 10.132.0.49:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-j4vnw

ProbeError

Startup probe error: Get "http://10.132.0.49:15021/healthz/ready": dial tcp 10.132.0.49:15021: connect: connection refused body:
(x7)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x7)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-vr5gf

Started

Container started

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-vr5gf

Created

Container created

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-vr5gf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

openshift-ai-inference-openshift-default-568c495856-vr5gf

AddedInterface

Add eth0 [10.133.0.35/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

openshift-ai-inference-openshift-default-568c495856

SuccessfulCreate

Created pod: openshift-ai-inference-openshift-default-568c495856-vr5gf

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-gxtp4

Created

Container created

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-gxtp4

Started

Container started

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-gxtp4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

openshift-ai-inference-openshift-default-568c495856-gxtp4

AddedInterface

Add eth0 [10.134.0.37/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-vr5gf

ProbeError

Startup probe error: Get "http://10.133.0.35:15021/healthz/ready": dial tcp 10.133.0.35:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-gxtp4

ProbeError

Startup probe error: Get "http://10.134.0.37:15021/healthz/ready": dial tcp 10.134.0.37:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-gxtp4

Unhealthy

Startup probe failed: Get "http://10.134.0.37:15021/healthz/ready": dial tcp 10.134.0.37:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-vr5gf

Unhealthy

Startup probe failed: Get "http://10.133.0.35:15021/healthz/ready": dial tcp 10.133.0.35:15021: connect: connection refused

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-m76bd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-p857s

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

openshift-ai-inference-openshift-default-568c495856

SuccessfulDelete

Deleted pod: openshift-ai-inference-openshift-default-568c495856-m76bd

openshift-ingress

replicaset-controller

openshift-ai-inference-openshift-default-568c495856

SuccessfulDelete

Deleted pod: openshift-ai-inference-openshift-default-568c495856-p857s

openshift-ingress

replicaset-controller

openshift-ai-inference-openshift-default-568c495856

SuccessfulDelete

Deleted pod: openshift-ai-inference-openshift-default-568c495856-gxtp4

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-gxtp4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-gxtp4

ProbeError

Readiness probe error: Get "http://10.134.0.37:15021/healthz/ready": dial tcp 10.134.0.37:15021: connect: connection refused body:

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-gxtp4

Unhealthy

Readiness probe failed: Get "http://10.134.0.37:15021/healthz/ready": dial tcp 10.134.0.37:15021: connect: connection refused

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-zlffc

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

openshift-ai-inference-openshift-default

ScalingReplicaSet

Scaled down replica set openshift-ai-inference-openshift-default-568c495856 from 7 to 5

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-vr5gf

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

openshift-ai-inference-openshift-default-568c495856

SuccessfulDelete

Deleted pod: openshift-ai-inference-openshift-default-568c495856-zlffc

openshift-ingress

replicaset-controller

openshift-ai-inference-openshift-default-568c495856

SuccessfulDelete

Deleted pod: openshift-ai-inference-openshift-default-568c495856-vr5gf

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-vr5gf

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-vr5gf

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

openshift-ai-inference-openshift-default

ScalingReplicaSet

Scaled down replica set openshift-ai-inference-openshift-default-568c495856 from 5 to 3

openshift-ingress

replicaset-controller

openshift-ai-inference-openshift-default-568c495856

SuccessfulDelete

Deleted pod: openshift-ai-inference-openshift-default-568c495856-h2nt2

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-kq5fz

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

openshift-ai-inference-openshift-default-568c495856

SuccessfulDelete

Deleted pod: openshift-ai-inference-openshift-default-568c495856-kq5fz

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-h2nt2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-j4vnw

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

openshift-ai-inference-openshift-default-568c495856

SuccessfulDelete

Deleted pod: openshift-ai-inference-openshift-default-568c495856-j4vnw

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

replicaset-controller

openshift-ai-inference-openshift-default-568c495856

SuccessfulCreate

Created pod: openshift-ai-inference-openshift-default-568c495856-v6lqx
(x2)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

openshift-ai-inference-openshift-default

ScalingReplicaSet

Scaled up replica set openshift-ai-inference-openshift-default-568c495856 from 2 to 4

openshift-ingress

replicaset-controller

openshift-ai-inference-openshift-default-568c495856

SuccessfulCreate

Created pod: openshift-ai-inference-openshift-default-568c495856-s4q4v

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-v6lqx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

openshift-ai-inference-openshift-default-568c495856-v6lqx

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-s4q4v

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-v6lqx

Started

Container started

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-v6lqx

Created

Container created

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-s4q4v

Created

Container created

openshift-ingress

multus

openshift-ai-inference-openshift-default-568c495856-s4q4v

AddedInterface

Add eth0 [10.132.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-s4q4v

Started

Container started
(x6)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-s4q4v

ProbeError

Startup probe error: Get "http://10.132.0.68:15021/healthz/ready": dial tcp 10.132.0.68:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-v6lqx

ProbeError

Startup probe error: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-v6lqx

Unhealthy

Startup probe failed: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-s4q4v

Unhealthy

Startup probe failed: Get "http://10.132.0.68:15021/healthz/ready": dial tcp 10.132.0.68:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

replicaset-controller

openshift-ai-inference-openshift-default-568c495856

SuccessfulCreate

Created pod: openshift-ai-inference-openshift-default-568c495856-c7ln8

openshift-ingress

replicaset-controller

openshift-ai-inference-openshift-default-568c495856

SuccessfulCreate

Created pod: openshift-ai-inference-openshift-default-568c495856-k9d69

openshift-ingress

replicaset-controller

openshift-ai-inference-openshift-default-568c495856

SuccessfulCreate

Created pod: openshift-ai-inference-openshift-default-568c495856-vdhnm
(x2)

openshift-ingress

deployment-controller

openshift-ai-inference-openshift-default

ScalingReplicaSet

Scaled up replica set openshift-ai-inference-openshift-default-568c495856 from 4 to 8

openshift-ingress

replicaset-controller

openshift-ai-inference-openshift-default-568c495856

SuccessfulCreate

Created pod: openshift-ai-inference-openshift-default-568c495856-dcvp9

openshift-ingress

multus

openshift-ai-inference-openshift-default-568c495856-vdhnm

AddedInterface

Add eth0 [10.132.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-dcvp9

Started

Container started

openshift-ingress

multus

openshift-ai-inference-openshift-default-568c495856-dcvp9

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-dcvp9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-dcvp9

Created

Container created

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-c7ln8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-c7ln8

Created

Container created

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-c7ln8

Started

Container started

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-k9d69

Started

Container started

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-k9d69

Created

Container created

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-k9d69

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

openshift-ai-inference-openshift-default-568c495856-k9d69

AddedInterface

Add eth0 [10.133.0.49/23] from ovn-kubernetes

openshift-ingress

multus

openshift-ai-inference-openshift-default-568c495856-c7ln8

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-vdhnm

Started

Container started

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-vdhnm

Created

Container created

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-vdhnm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-k9d69

ProbeError

Startup probe error: Get "http://10.133.0.49:15021/healthz/ready": dial tcp 10.133.0.49:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-k9d69

Unhealthy

Startup probe failed: Get "http://10.133.0.49:15021/healthz/ready": dial tcp 10.133.0.49:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-vdhnm

Unhealthy

Startup probe failed: Get "http://10.132.0.70:15021/healthz/ready": dial tcp 10.132.0.70:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-dcvp9

Unhealthy

Startup probe failed: Get "http://10.134.0.55:15021/healthz/ready": dial tcp 10.134.0.55:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-vdhnm

ProbeError

Startup probe error: Get "http://10.132.0.70:15021/healthz/ready": dial tcp 10.132.0.70:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-dcvp9

ProbeError

Startup probe error: Get "http://10.134.0.55:15021/healthz/ready": dial tcp 10.134.0.55:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-c7ln8

ProbeError

Startup probe error: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-c7ln8

Unhealthy

Startup probe failed: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-default

SuccessfulRescale

New size: 10; reason: All metrics below target

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-6g8bg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

openshift-ai-inference-openshift-default-568c495856-6g8bg

AddedInterface

Add eth0 [10.132.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-t4bb8

Started

Container started

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-t4bb8

Created

Container created

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-t4bb8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

openshift-ai-inference-openshift-default-568c495856-t4bb8

AddedInterface

Add eth0 [10.133.0.50/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

openshift-ai-inference-openshift-default-568c495856

SuccessfulCreate

Created pod: openshift-ai-inference-openshift-default-568c495856-6g8bg

openshift-ingress

replicaset-controller

openshift-ai-inference-openshift-default-568c495856

SuccessfulCreate

Created pod: openshift-ai-inference-openshift-default-568c495856-t4bb8
(x2)

openshift-ingress

deployment-controller

openshift-ai-inference-openshift-default

ScalingReplicaSet

Scaled up replica set openshift-ai-inference-openshift-default-568c495856 from 8 to 10

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-6g8bg

Created

Container created

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-6g8bg

Started

Container started
(x6)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-6g8bg

ProbeError

Startup probe error: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-t4bb8

ProbeError

Startup probe error: Get "http://10.133.0.50:15021/healthz/ready": dial tcp 10.133.0.50:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-6g8bg

Unhealthy

Startup probe failed: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-t4bb8

Unhealthy

Startup probe failed: Get "http://10.133.0.50:15021/healthz/ready": dial tcp 10.133.0.50:15021: connect: connection refused

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-vdhnm

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-s4q4v

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

openshift-ai-inference-openshift-default-568c495856

SuccessfulDelete

Deleted pod: openshift-ai-inference-openshift-default-568c495856-6g8bg

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-6g8bg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-6g8bg

ProbeError

Readiness probe error: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused body:

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-6g8bg

Unhealthy

Readiness probe failed: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-s4q4v

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-s4q4v

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-k9d69

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-k9d69

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-k9d69

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

openshift-ai-inference-openshift-default-568c495856

SuccessfulCreate

Created pod: openshift-ai-inference-openshift-default-568c495856-nfb67

openshift-ingress

multus

openshift-ai-inference-openshift-default-568c495856-nfb67

AddedInterface

Add eth0 [10.132.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-zmkpb

Created

Container created

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-nfb67

Started

Container started

openshift-ingress

multus

openshift-ai-inference-openshift-default-568c495856-b9b65

AddedInterface

Add eth0 [10.132.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-nfb67

Created

Container created

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-nfb67

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-zmkpb

Started

Container started

openshift-ingress

multus

openshift-ai-inference-openshift-default-568c495856-kzxcm

AddedInterface

Add eth0 [10.132.0.75/23] from ovn-kubernetes

openshift-ingress

multus

openshift-ai-inference-openshift-default-568c495856-zmkpb

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-zmkpb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-b9b65

Created

Container created

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-kzxcm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-kzxcm

Created

Container created

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-b9b65

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-kzxcm

Started

Container started

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-b9b65

Started

Container started
(x5)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-nfb67

Unhealthy

Startup probe failed: Get "http://10.132.0.74:15021/healthz/ready": dial tcp 10.132.0.74:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-zmkpb

Unhealthy

Startup probe failed: Get "http://10.133.0.53:15021/healthz/ready": dial tcp 10.133.0.53:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-kzxcm

Unhealthy

Startup probe failed: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-kzxcm

ProbeError

Startup probe error: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-zmkpb

ProbeError

Startup probe error: Get "http://10.133.0.53:15021/healthz/ready": dial tcp 10.133.0.53:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-nfb67

ProbeError

Startup probe error: Get "http://10.132.0.74:15021/healthz/ready": dial tcp 10.132.0.74:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-b9b65

Unhealthy

Startup probe failed: Get "http://10.132.0.76:15021/healthz/ready": dial tcp 10.132.0.76:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-b9b65

ProbeError

Startup probe error: Get "http://10.132.0.76:15021/healthz/ready": dial tcp 10.132.0.76:15021: connect: connection refused body:

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-nfb67

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-v6lqx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-b9b65

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-kzxcm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-v6lqx

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-v6lqx

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-nfb67

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-kzxcm

ProbeError

Readiness probe error: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused body:

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-kzxcm

Unhealthy

Readiness probe failed: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-nfb67

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-b9b65

Unhealthy

Readiness probe failed: Get "http://10.132.0.76:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-b9b65

ProbeError

Readiness probe error: Get "http://10.132.0.76:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-t4bb8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-zmkpb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-t4bb8

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-t4bb8

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-zmkpb

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-zmkpb

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-dcvp9

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-dcvp9

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-dcvp9

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

deployment-controller

openshift-ai-inference-openshift-default

ScalingReplicaSet

Scaled down replica set openshift-ai-inference-openshift-default-568c495856 from 3 to 2

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-c7ln8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-c7ln8

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-c7ln8

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-q8ngg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-77jcv

Created

Container created

openshift-ingress

multus

openshift-ai-inference-openshift-default-568c495856-77jcv

AddedInterface

Add eth0 [10.134.0.70/23] from ovn-kubernetes

openshift-ingress

multus

openshift-ai-inference-openshift-default-568c495856-5jnbs

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-5jnbs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-5jnbs

Created

Container created

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-5jnbs

Started

Container started

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-77jcv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

openshift-ai-inference-openshift-default-568c495856-qrgs4

AddedInterface

Add eth0 [10.132.0.87/23] from ovn-kubernetes

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-qrgs4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-77jcv

Started

Container started

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-qrgs4

Created

Container created

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-qrgs4

Started

Container started
(x5)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-qrgs4

Unhealthy

Startup probe failed: Get "http://10.132.0.87:15021/healthz/ready": dial tcp 10.132.0.87:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-qrgs4

ProbeError

Startup probe error: Get "http://10.132.0.87:15021/healthz/ready": dial tcp 10.132.0.87:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-77jcv

Unhealthy

Startup probe failed: Get "http://10.134.0.70:15021/healthz/ready": dial tcp 10.134.0.70:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-77jcv

ProbeError

Startup probe error: Get "http://10.134.0.70:15021/healthz/ready": dial tcp 10.134.0.70:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-5jnbs

Unhealthy

Startup probe failed: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-5jnbs

ProbeError

Startup probe error: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused body:

openshift-ingress

multus

openshift-ai-inference-openshift-default-568c495856-npztz

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-fvvvx

Created

Container created

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-fvvvx

Started

Container started

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-fvvvx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-jtzw2

Created

Container created

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-jtzw2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-npztz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-vgwht

Started

Container started

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-vgwht

Created

Container created

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-vgwht

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

openshift-ai-inference-openshift-default-568c495856-vgwht

AddedInterface

Add eth0 [10.132.0.88/23] from ovn-kubernetes

openshift-ingress

multus

openshift-ai-inference-openshift-default-568c495856-jtzw2

AddedInterface

Add eth0 [10.134.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-jtzw2

Started

Container started

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-npztz

Created

Container created

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-npztz

Started

Container started

openshift-ingress

multus

openshift-ai-inference-openshift-default-568c495856-fvvvx

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-npztz

ProbeError

Startup probe error: Get "http://10.133.0.60:15021/healthz/ready": dial tcp 10.133.0.60:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-vgwht

ProbeError

Startup probe error: Get "http://10.132.0.88:15021/healthz/ready": dial tcp 10.132.0.88:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-vgwht

Unhealthy

Startup probe failed: Get "http://10.132.0.88:15021/healthz/ready": dial tcp 10.132.0.88:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-fvvvx

Unhealthy

Startup probe failed: Get "http://10.133.0.59:15021/healthz/ready": dial tcp 10.133.0.59:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-fvvvx

ProbeError

Startup probe error: Get "http://10.133.0.59:15021/healthz/ready": dial tcp 10.133.0.59:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-jtzw2

ProbeError

Startup probe error: Get "http://10.134.0.71:15021/healthz/ready": dial tcp 10.134.0.71:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-jtzw2

Unhealthy

Startup probe failed: Get "http://10.134.0.71:15021/healthz/ready": dial tcp 10.134.0.71:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-npztz

Unhealthy

Startup probe failed: Get "http://10.133.0.60:15021/healthz/ready": dial tcp 10.133.0.60:15021: connect: connection refused

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-mkpp5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-mkpp5

Started

Container started

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-zckrp

Started

Container started

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-zckrp

Created

Container created

openshift-ingress

multus

openshift-ai-inference-openshift-default-568c495856-zckrp

AddedInterface

Add eth0 [10.134.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-zckrp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

openshift-ai-inference-openshift-default-568c495856-mkpp5

AddedInterface

Add eth0 [10.132.0.89/23] from ovn-kubernetes

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-mkpp5

Created

Container created
(x5)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-mkpp5

ProbeError

Startup probe error: Get "http://10.132.0.89:15021/healthz/ready": dial tcp 10.132.0.89:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-mkpp5

Unhealthy

Startup probe failed: Get "http://10.132.0.89:15021/healthz/ready": dial tcp 10.132.0.89:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-zckrp

ProbeError

Startup probe error: Get "http://10.134.0.72:15021/healthz/ready": dial tcp 10.134.0.72:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-zckrp

Unhealthy

Startup probe failed: Get "http://10.134.0.72:15021/healthz/ready": dial tcp 10.134.0.72:15021: connect: connection refused

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-77jcv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-zckrp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-77jcv

Unhealthy

Readiness probe failed: Get "http://10.134.0.70:15021/healthz/ready": read tcp 10.134.0.2:35302->10.134.0.70:15021: read: connection reset by peer

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-77jcv

ProbeError

Readiness probe error: Get "http://10.134.0.70:15021/healthz/ready": read tcp 10.134.0.2:35302->10.134.0.70:15021: read: connection reset by peer body:

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-zckrp

ProbeError

Readiness probe error: Get "http://10.134.0.72:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-zckrp

Unhealthy

Readiness probe failed: Get "http://10.134.0.72:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-5jnbs

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-5jnbs

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-5jnbs

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-mkpp5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-qrgs4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-mkpp5

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-qrgs4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-qrgs4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-mkpp5

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target
(x13)

openshift-ingress

deployment-controller

openshift-ai-inference-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled up replica set openshift-ai-inference-openshift-default-568c495856 from 5 to 10
(x5)

openshift-ingress

replicaset-controller

openshift-ai-inference-openshift-default-568c495856

SuccessfulCreate

(combined from similar events): Created pod: openshift-ai-inference-openshift-default-568c495856-kb28w

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-xp7fd

Started

Container started

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-xp7fd

Created

Container created

openshift-ingress

multus

openshift-ai-inference-openshift-default-568c495856-q9tdb

AddedInterface

Add eth0 [10.132.0.97/23] from ovn-kubernetes

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-q9tdb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-q9tdb

Created

Container created

openshift-ingress

multus

openshift-ai-inference-openshift-default-568c495856-5499q

AddedInterface

Add eth0 [10.134.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-q9tdb

Started

Container started

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-5499q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-5499q

Created

Container created

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-5499q

Started

Container started

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-xp7fd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

openshift-ai-inference-openshift-default-568c495856-xp7fd

AddedInterface

Add eth0 [10.134.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-kb28w

Started

Container started

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-s86wq

Started

Container started

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-kb28w

Created

Container created

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-kb28w

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

openshift-ai-inference-openshift-default-568c495856-kb28w

AddedInterface

Add eth0 [10.132.0.96/23] from ovn-kubernetes

openshift-ingress

multus

openshift-ai-inference-openshift-default-568c495856-s86wq

AddedInterface

Add eth0 [10.133.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-s86wq

Created

Container created

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-s86wq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-5499q

ProbeError

Startup probe error: Get "http://10.134.0.76:15021/healthz/ready": dial tcp 10.134.0.76:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-q9tdb

ProbeError

Startup probe error: Get "http://10.132.0.97:15021/healthz/ready": dial tcp 10.132.0.97:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-kb28w

ProbeError

Startup probe error: Get "http://10.132.0.96:15021/healthz/ready": dial tcp 10.132.0.96:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-5499q

Unhealthy

Startup probe failed: Get "http://10.134.0.76:15021/healthz/ready": dial tcp 10.134.0.76:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-q9tdb

Unhealthy

Startup probe failed: Get "http://10.132.0.97:15021/healthz/ready": dial tcp 10.132.0.97:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-s86wq

ProbeError

Startup probe error: Get "http://10.133.0.65:15021/healthz/ready": dial tcp 10.133.0.65:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-s86wq

Unhealthy

Startup probe failed: Get "http://10.133.0.65:15021/healthz/ready": dial tcp 10.133.0.65:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-xp7fd

ProbeError

Startup probe error: Get "http://10.134.0.77:15021/healthz/ready": dial tcp 10.134.0.77:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-xp7fd

Unhealthy

Startup probe failed: Get "http://10.134.0.77:15021/healthz/ready": dial tcp 10.134.0.77:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-kb28w

Unhealthy

Startup probe failed: Get "http://10.132.0.96:15021/healthz/ready": dial tcp 10.132.0.96:15021: connect: connection refused
(x7)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x7)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-jtzw2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-xp7fd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-5499q

Killing

Stopping container istio-proxy
(x18)

openshift-ingress

replicaset-controller

openshift-ai-inference-openshift-default-568c495856

SuccessfulDelete

(combined from similar events): Deleted pod: openshift-ai-inference-openshift-default-568c495856-xp7fd
(x3)

openshift-ingress

deployment-controller

openshift-ai-inference-openshift-default

ScalingReplicaSet

Scaled down replica set openshift-ai-inference-openshift-default-568c495856 from 10 to 7

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-jtzw2

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-jtzw2

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

openshift-ai-inference-openshift-default

ScalingReplicaSet

Scaled down replica set openshift-ai-inference-openshift-default-568c495856 from 7 to 6

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-568c495856-kb28w

Killing

Stopping container istio-proxy
(x11)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-default

SuccessfulRescale

(combined from similar events): New size: 6; reason: All metrics below target