Time Namespace Component RelatedObject Reason Message

openshift-ingress

maas-default-gateway-openshift-default-596dc9545f-dztcv

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-596dc9545f-dztcv to ip-10-0-134-97.ec2.internal

openshift-ingress

kube-auth-proxy-5f7b849775-5gcnq

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-5f7b849775-5gcnq to ip-10-0-134-97.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-596dc9545f-ktwxr

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-596dc9545f-ktwxr to ip-10-0-134-97.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-596dc9545f-tvnpg

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-596dc9545f-tvnpg to ip-10-0-133-6.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-596dc9545f-hfcrg

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-596dc9545f-hfcrg to ip-10-0-133-6.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-596dc9545f-vg7xv

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-596dc9545f-vg7xv to ip-10-0-134-97.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-596dc9545f-wxs2l

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-596dc9545f-wxs2l to ip-10-0-130-237.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-596dc9545f-gpwmx

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-596dc9545f-gpwmx to ip-10-0-133-6.ec2.internal

openshift-ingress

kube-auth-proxy-5f7b849775-kvct7

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-5f7b849775-kvct7 to ip-10-0-130-237.ec2.internal

openshift-ingress

e2e-shared-a-main-d5cb1c-openshift-default-77db498d8c-rd47n

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-main-d5cb1c-openshift-default-77db498d8c-rd47n to ip-10-0-130-237.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-596dc9545f-dsvvx

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-596dc9545f-dsvvx to ip-10-0-133-6.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-main-d5cb1c-dd495866d-xjzj7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-main-d5cb1c-dd495866d-xjzj7 to ip-10-0-134-97.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-main-ca863e-6bb4985b66-gsmq2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-main-ca863e-6bb4985b66-gsmq2 to ip-10-0-134-97.ec2.internal

openshift-ingress

router-default-575669d575-qgfnp

FailedScheduling

no nodes available to schedule pods

openshift-ingress

data-science-gateway-data-science-gateway-class-6644c85865kxz26

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-6644c85865kxz26 to ip-10-0-133-6.ec2.internal

openshift-ingress

router-default-575669d575-qgfnp

FailedScheduling

no nodes available to schedule pods

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-c46hh

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-c46hh to ip-10-0-134-97.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-596dc9545f-dx86v

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-596dc9545f-dx86v to ip-10-0-130-237.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-596dc9545f-hqwv6

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-596dc9545f-hqwv6 to ip-10-0-130-237.ec2.internal

openshift-ingress

istiod-openshift-gateway-7876bfcb74-thkxp

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7876bfcb74-thkxp to ip-10-0-134-97.ec2.internal

openshift-ingress

openshift-ai-inference-openshift-ai-inference-5cb6869599-pn2md

Scheduled

Successfully assigned openshift-ingress/openshift-ai-inference-openshift-ai-inference-5cb6869599-pn2md to ip-10-0-133-6.ec2.internal

openshift-ingress

payload-processing-5f78687d5b-g9mbb

Scheduled

Successfully assigned openshift-ingress/payload-processing-5f78687d5b-g9mbb to ip-10-0-130-237.ec2.internal

openshift-ingress

payload-pre-processing-7b98bb678c-8b96t

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-7b98bb678c-8b96t to ip-10-0-130-237.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-main-d5cb1c-5bf88b86ffrqlqm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-main-d5cb1c-5bf88b86ffrqlqm to ip-10-0-134-97.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-main-ca863e-5585dd6595hlnb4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-main-ca863e-5585dd6595hlnb4 to ip-10-0-134-97.ec2.internal

openshift-ingress

router-default-575669d575-qgfnp

Scheduled

Successfully assigned openshift-ingress/router-default-575669d575-qgfnp to ip-10-0-133-6.ec2.internal

openshift-ingress

e2e-shared-b-main-ca863e-openshift-default-6f44d77dfc-s7vdt

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-main-ca863e-openshift-default-6f44d77dfc-s7vdt to ip-10-0-130-237.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-575669d575 from 0 to 1

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer

openshift-ingress

replicaset-controller

router-default-575669d575

FailedCreate

Error creating: pods "router-default-575669d575-" is forbidden: error fetching namespace "openshift-ingress": unable to find annotation openshift.io/sa.scc.uid-range

openshift-ingress

replicaset-controller

router-default-575669d575

SuccessfulCreate

Created pod: router-default-575669d575-qgfnp
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts
(x5)

openshift-ingress

kubelet

router-default-575669d575-qgfnp

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x5)

openshift-ingress

kubelet

router-default-575669d575-qgfnp

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x4)

openshift-ingress

kubelet

router-default-575669d575-qgfnp

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x4)

openshift-ingress

kubelet

router-default-575669d575-qgfnp

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

kubelet

router-default-575669d575-qgfnp

Created

Container created

openshift-ingress

multus

router-default-575669d575-qgfnp

AddedInterface

Add eth0 [10.132.0.13/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-575669d575-qgfnp

Started

Container started

openshift-ingress

kubelet

router-default-575669d575-qgfnp

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3a679d80eb36ca7db888d4fbd1fdf16b0997a7c7a107936396b7a57d8b199f4e" already present on machine and can be accessed by the pod

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7876bfcb74 from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulCreate

Created pod: istiod-openshift-gateway-7876bfcb74-thkxp

openshift-ingress

multus

istiod-openshift-gateway-7876bfcb74-thkxp

AddedInterface

Add eth0 [10.133.0.17/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-thkxp

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-thkxp

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 3.08s (3.08s including waiting). Image size: 185476477 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-thkxp

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-thkxp

Started

Container started
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-thkxp

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-thkxp

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

multus

maas-default-gateway-openshift-default-596dc9545f-dsvvx

AddedInterface

Add eth0 [10.132.0.29/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

openshift-ai-inference-openshift-ai-inference-5cb6869599

SuccessfulCreate

Created pod: openshift-ai-inference-openshift-ai-inference-5cb6869599-pn2md

openshift-ingress

deployment-controller

openshift-ai-inference-openshift-ai-inference

ScalingReplicaSet

Scaled up replica set openshift-ai-inference-openshift-ai-inference-5cb6869599 from 0 to 1

openshift-ingress

service-controller

openshift-ai-inference-openshift-ai-inference

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-596dc9545f

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-596dc9545f-dsvvx

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-596dc9545f from 0 to 1

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-5cb6869599-pn2md

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-dsvvx

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

multus

openshift-ai-inference-openshift-ai-inference-5cb6869599-pn2md

AddedInterface

Add eth0 [10.132.0.31/23] from ovn-kubernetes

openshift-ingress

service-controller

openshift-ai-inference-openshift-ai-inference

EnsuredLoadBalancer

Ensured load balancer

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-dsvvx

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 7.866s (7.866s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-5cb6869599-pn2md

Started

Container started

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-5cb6869599-pn2md

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 8.306s (8.306s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-5cb6869599-pn2md

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

kube-auth-proxy-5f7b849775

SuccessfulCreate

Created pod: kube-auth-proxy-5f7b849775-kvct7

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-5f7b849775 from 0 to 2

openshift-ingress

replicaset-controller

kube-auth-proxy-5f7b849775

SuccessfulCreate

Created pod: kube-auth-proxy-5f7b849775-5gcnq

openshift-ingress

kubelet

kube-auth-proxy-5f7b849775-5gcnq

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6644c85865kxz26

Started

Container started

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-6644c85865 from 0 to 1

openshift-ingress

kubelet

kube-auth-proxy-5f7b849775-kvct7

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"

openshift-ingress

multus

kube-auth-proxy-5f7b849775-kvct7

AddedInterface

Add eth0 [10.134.0.29/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6644c85865kxz26

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

kube-auth-proxy-5f7b849775-5gcnq

AddedInterface

Add eth0 [10.133.0.19/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-6644c85865

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-6644c85865kxz26

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-6644c85865kxz26

AddedInterface

Add eth0 [10.132.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6644c85865kxz26

Created

Container created

openshift-ingress

kubelet

kube-auth-proxy-5f7b849775-5gcnq

Created

Container created

openshift-ingress

kubelet

kube-auth-proxy-5f7b849775-kvct7

Started

Container started

openshift-ingress

kubelet

kube-auth-proxy-5f7b849775-kvct7

Created

Container created

openshift-ingress

kubelet

kube-auth-proxy-5f7b849775-kvct7

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.255s (2.255s including waiting). Image size: 188904677 bytes.

openshift-ingress

kubelet

kube-auth-proxy-5f7b849775-5gcnq

Started

Container started

openshift-ingress

kubelet

kube-auth-proxy-5f7b849775-5gcnq

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.397s (2.397s including waiting). Image size: 188904677 bytes.

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-c46hh

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-c46hh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-c46hh

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-c46hh

Started

Container started

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-c46hh

AddedInterface

Add eth0 [10.133.0.21/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-thkxp

Killing

Stopping container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7876bfcb74-thkxp

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7876bfcb74 from 1 to 0
(x5)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-dsvvx

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-dsvvx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-dsvvx

Started

Container started
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-dsvvx

ProbeError

Startup probe error: Get "http://10.132.0.29:15021/healthz/ready": dial tcp 10.132.0.29:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-dsvvx

Unhealthy

Startup probe failed: Get "http://10.132.0.29:15021/healthz/ready": dial tcp 10.132.0.29:15021: connect: connection refused

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-596dc9545f

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-596dc9545f-ktwxr

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-596dc9545f

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-596dc9545f-gpwmx

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-596dc9545f

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-596dc9545f-wxs2l

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-596dc9545f from 1 to 4

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-gpwmx

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-gpwmx

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-wxs2l

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

multus

maas-default-gateway-openshift-default-596dc9545f-wxs2l

AddedInterface

Add eth0 [10.134.0.36/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-596dc9545f-gpwmx

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-gpwmx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-ktwxr

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

multus

maas-default-gateway-openshift-default-596dc9545f-ktwxr

AddedInterface

Add eth0 [10.133.0.29/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-ktwxr

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-ktwxr

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-ktwxr

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 2.868s (2.868s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-wxs2l

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-wxs2l

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-wxs2l

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 2.616s (2.616s including waiting). Image size: 183555333 bytes.
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-gpwmx

Unhealthy

Startup probe failed: Get "http://10.132.0.48:15021/healthz/ready": dial tcp 10.132.0.48:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-gpwmx

ProbeError

Startup probe error: Get "http://10.132.0.48:15021/healthz/ready": dial tcp 10.132.0.48:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-wxs2l

Unhealthy

Startup probe failed: Get "http://10.134.0.36:15021/healthz/ready": dial tcp 10.134.0.36:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-wxs2l

ProbeError

Startup probe error: Get "http://10.134.0.36:15021/healthz/ready": dial tcp 10.134.0.36:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-ktwxr

Unhealthy

Startup probe failed: Get "http://10.133.0.29:15021/healthz/ready": dial tcp 10.133.0.29:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-ktwxr

ProbeError

Startup probe error: Get "http://10.133.0.29:15021/healthz/ready": dial tcp 10.133.0.29:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-596dc9545f

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-596dc9545f-hqwv6

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 8; reason:

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-596dc9545f from 4 to 8

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-596dc9545f

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-596dc9545f-vg7xv

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-596dc9545f

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-596dc9545f-hfcrg

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-596dc9545f

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-596dc9545f-dx86v

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-hfcrg

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-vg7xv

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-dx86v

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-596dc9545f-dx86v

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-596dc9545f-hfcrg

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-596dc9545f-hqwv6

AddedInterface

Add eth0 [10.134.0.38/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-hqwv6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-hqwv6

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-hqwv6

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-dx86v

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-dx86v

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-hfcrg

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-hfcrg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-vg7xv

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-596dc9545f-vg7xv

AddedInterface

Add eth0 [10.133.0.30/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-vg7xv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-vg7xv

Unhealthy

Startup probe failed: Get "http://10.133.0.30:15021/healthz/ready": dial tcp 10.133.0.30:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-vg7xv

ProbeError

Startup probe error: Get "http://10.133.0.30:15021/healthz/ready": dial tcp 10.133.0.30:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-dx86v

Unhealthy

Startup probe failed: Get "http://10.134.0.39:15021/healthz/ready": dial tcp 10.134.0.39:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-hfcrg

ProbeError

Startup probe error: Get "http://10.132.0.49:15021/healthz/ready": dial tcp 10.132.0.49:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-dx86v

ProbeError

Startup probe error: Get "http://10.134.0.39:15021/healthz/ready": dial tcp 10.134.0.39:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-hfcrg

Unhealthy

Startup probe failed: Get "http://10.132.0.49:15021/healthz/ready": dial tcp 10.132.0.49:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-hqwv6

Unhealthy

Startup probe failed: Get "http://10.134.0.38:15021/healthz/ready": dial tcp 10.134.0.38:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-hqwv6

ProbeError

Startup probe error: Get "http://10.134.0.38:15021/healthz/ready": dial tcp 10.134.0.38:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-596dc9545f

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-596dc9545f-tvnpg

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 10; reason:

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-596dc9545f from 8 to 10

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-596dc9545f

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-596dc9545f-dztcv

openshift-ingress

multus

maas-default-gateway-openshift-default-596dc9545f-dztcv

AddedInterface

Add eth0 [10.133.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-tvnpg

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-dztcv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-dztcv

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-dztcv

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-tvnpg

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-tvnpg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-596dc9545f-tvnpg

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-dztcv

Unhealthy

Startup probe failed: Get "http://10.133.0.34:15021/healthz/ready": dial tcp 10.133.0.34:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-dztcv

ProbeError

Startup probe error: Get "http://10.133.0.34:15021/healthz/ready": dial tcp 10.133.0.34:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-tvnpg

ProbeError

Startup probe error: Get "http://10.132.0.51:15021/healthz/ready": dial tcp 10.132.0.51:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-tvnpg

Unhealthy

Startup probe failed: Get "http://10.132.0.51:15021/healthz/ready": dial tcp 10.132.0.51:15021: connect: connection refused

openshift-ingress

replicaset-controller

payload-processing-5f78687d5b

SuccessfulCreate

Created pod: payload-processing-5f78687d5b-g9mbb

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

SuccessfulCreate

Created pod: payload-pre-processing-7b98bb678c-8b96t
(x6)

openshift-ingress

replicaset-controller

payload-processing-5f78687d5b

FailedCreate

Error creating: pods "payload-processing-5f78687d5b-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

FailedCreate

Error creating: pods "payload-pre-processing-7b98bb678c-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-7b98bb678c from 0 to 1

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5f78687d5b from 0 to 1

openshift-ingress

multus

payload-processing-5f78687d5b-g9mbb

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-7b98bb678c-8b96t

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-8b96t

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

kubelet

payload-processing-5f78687d5b-g9mbb

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-8b96t

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.316s (2.316s including waiting). Image size: 125317101 bytes.

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-8b96t

Created

Container created

openshift-ingress

kubelet

payload-processing-5f78687d5b-g9mbb

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.28s (2.28s including waiting). Image size: 125317101 bytes.

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-8b96t

Started

Container started

openshift-ingress

kubelet

payload-processing-5f78687d5b-g9mbb

Started

Container started

openshift-ingress

kubelet

payload-processing-5f78687d5b-g9mbb

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-hfcrg

Unhealthy

Readiness probe failed: Get "http://10.132.0.49:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-dztcv

ProbeError

Readiness probe error: Get "http://10.133.0.34:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-hqwv6

Unhealthy

Readiness probe failed: Get "http://10.134.0.38:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-tvnpg

ProbeError

Readiness probe error: Get "http://10.132.0.51:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-tvnpg

Unhealthy

Readiness probe failed: Get "http://10.132.0.51:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-gpwmx

Unhealthy

Readiness probe failed: Get "http://10.132.0.48:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-vg7xv

ProbeError

Readiness probe error: Get "http://10.133.0.30:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-dztcv

Unhealthy

Readiness probe failed: Get "http://10.133.0.34:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-hfcrg

ProbeError

Readiness probe error: Get "http://10.132.0.49:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-hqwv6

ProbeError

Readiness probe error: Get "http://10.134.0.38:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-vg7xv

Unhealthy

Readiness probe failed: Get "http://10.133.0.30:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-gpwmx

ProbeError

Readiness probe error: Get "http://10.132.0.48:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-dx86v

ProbeError

Readiness probe error: Get "http://10.134.0.39:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-dx86v

Unhealthy

Readiness probe failed: Get "http://10.134.0.39:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

gateway_labeler_controller

e2e-shared-a-main-d5cb1c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-main-d5cb1c

openshift-ingress

deployment-controller

e2e-shared-a-main-d5cb1c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-main-d5cb1c-openshift-default-77db498d8c from 0 to 1

openshift-ingress

multus

e2e-shared-a-main-d5cb1c-openshift-default-77db498d8c-rd47n

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-a-main-d5cb1c-openshift-default-77db498d8c

SuccessfulCreate

Created pod: e2e-shared-a-main-d5cb1c-openshift-default-77db498d8c-rd47n

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-main-d5cb1c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-main-d5cb1c-dd495866d from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-main-d5cb1c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-main-d5cb1c-5bf88b86ff from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-a-main-d5cb1c-dd495866d-xjzj7

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-main-d5cb1c-5bf88b86ff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-main-d5cb1c-5bf88b86ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-main-d5cb1c: serviceaccount "payload-processing-e2e-shared-a-main-d5cb1c" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-main-d5cb1c-5bf88b86ff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-main-d5cb1c-5bf88b86ffrqlqm

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-main-d5cb1c-dd495866d

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-main-d5cb1c-dd495866d-xjzj7

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-main-d5cb1c-5bf88b86ffrqlqm

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-main-d5cb1c-5bf88b86ffrqlqm

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-main-d5cb1c-dd495866d

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-main-d5cb1c-dd495866d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-main-d5cb1c: serviceaccount "payload-processing-e2e-shared-a-main-d5cb1c" not found

openshift-ingress

multus

payload-processing-e2e-shared-a-main-d5cb1c-dd495866d-xjzj7

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-main-d5cb1c-5bf88b86ffrqlqm

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-main-d5cb1c-dd495866d-xjzj7

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-main-d5cb1c-5bf88b86ffrqlqm

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-main-d5cb1c-dd495866d-xjzj7

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-main-d5cb1c-5bf88b86ffrqlqm

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.27s (2.27s including waiting). Image size: 125317101 bytes.

openshift-ingress

kubelet

payload-processing-e2e-shared-a-main-d5cb1c-dd495866d-xjzj7

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.289s (2.289s including waiting). Image size: 125317101 bytes.

openshift-ingress

kubelet

e2e-shared-a-main-d5cb1c-openshift-default-77db498d8c-rd47n

ProbeError

Readiness probe error: Get "http://10.134.0.50:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-a-main-d5cb1c-openshift-default-77db498d8c-rd47n

Unhealthy

Readiness probe failed: Get "http://10.134.0.50:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

deployment-controller

e2e-shared-b-main-ca863e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-main-ca863e-openshift-default-6f44d77dfc from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-main-ca863e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-main-ca863e

openshift-ingress

multus

e2e-shared-b-main-ca863e-openshift-default-6f44d77dfc-s7vdt

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-b-main-ca863e-openshift-default-6f44d77dfc

SuccessfulCreate

Created pod: e2e-shared-b-main-ca863e-openshift-default-6f44d77dfc-s7vdt
(x2)

openshift-ingress

kubelet

e2e-shared-a-main-d5cb1c-openshift-default-77db498d8c-rd47n

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-main-d5cb1c-openshift-default-77db498d8c-rd47n

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-main-d5cb1c-openshift-default-77db498d8c-rd47n

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-main-ca863e-6bb4985b66

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-main-ca863e-6bb4985b66-gsmq2

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-main-ca863e-5585dd6595hlnb4

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-main-ca863e-6bb4985b66

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-main-ca863e-6bb4985b66-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-main-ca863e: serviceaccount "payload-processing-e2e-shared-b-main-ca863e" not found
(x5)

openshift-ingress

kubelet

e2e-shared-a-main-d5cb1c-openshift-default-77db498d8c-rd47n

ProbeError

Startup probe error: Get "http://10.134.0.50:15021/healthz/ready": dial tcp 10.134.0.50:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-main-ca863e-5585dd6595hlnb4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-shared-a-main-d5cb1c-openshift-default-77db498d8c-rd47n

Unhealthy

Startup probe failed: Get "http://10.134.0.50:15021/healthz/ready": dial tcp 10.134.0.50:15021: connect: connection refused

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-main-ca863e-5585dd6595

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-main-ca863e-5585dd6595hlnb4
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-main-ca863e-5585dd6595

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-main-ca863e-5585dd6595-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-main-ca863e: serviceaccount "payload-processing-e2e-shared-b-main-ca863e" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-main-ca863e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-main-ca863e-6bb4985b66 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-main-ca863e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-main-ca863e-5585dd6595 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-main-ca863e-5585dd6595hlnb4

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-main-ca863e-6bb4985b66-gsmq2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-main-ca863e-5585dd6595hlnb4

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-main-ca863e-6bb4985b66-gsmq2

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-main-ca863e-6bb4985b66-gsmq2

Created

Container created

openshift-ingress

multus

payload-processing-e2e-shared-b-main-ca863e-6bb4985b66-gsmq2

AddedInterface

Add eth0 [10.133.0.54/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-main-d5cb1c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-main-d5cb1c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-main-ca863e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-main-ca863e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-shared-b-main-ca863e-openshift-default-6f44d77dfc-s7vdt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-main-ca863e-openshift-default-6f44d77dfc-s7vdt

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-main-ca863e-openshift-default-6f44d77dfc-s7vdt

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-main-d5cb1c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-main-d5cb1c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-shared-b-main-ca863e-openshift-default-6f44d77dfc-s7vdt

ProbeError

Startup probe error: Get "http://10.134.0.52:15021/healthz/ready": dial tcp 10.134.0.52:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-main-ca863e-openshift-default-6f44d77dfc-s7vdt

Unhealthy

Startup probe failed: Get "http://10.134.0.52:15021/healthz/ready": dial tcp 10.134.0.52:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-main-ca863e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-main-ca863e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-dsvvx

Unhealthy

Readiness probe failed: Get "http://10.132.0.29:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-dsvvx

ProbeError

Readiness probe error: Get "http://10.132.0.29:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-ktwxr

Unhealthy

Readiness probe failed: Get "http://10.133.0.29:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-ktwxr

ProbeError

Readiness probe error: Get "http://10.133.0.29:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-wxs2l

Unhealthy

Readiness probe failed: Get "http://10.134.0.36:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-wxs2l

ProbeError

Readiness probe error: Get "http://10.134.0.36:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-main-d5cb1c-5bf88b86ffrqlqm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-main-d5cb1c-dd495866d-xjzj7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-main-d5cb1c-openshift-default-77db498d8c-rd47n

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-main-ca863e-5585dd6595hlnb4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-main-ca863e-6bb4985b66-gsmq2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-main-ca863e-openshift-default-6f44d77dfc-s7vdt

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-main-ca863e-openshift-default-6f44d77dfc-s7vdt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-main-ca863e-openshift-default-6f44d77dfc-s7vdt

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-main-ca863e-6bb4985b66-gsmq2

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-main-ca863e-5585dd6595hlnb4

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")