| Time | Namespace | Component | RelatedObject | Reason | Message |
|---|---|---|---|---|---|
openshift-ingress |
maas-default-gateway-openshift-default-596dc9545f-dztcv |
Scheduled |
Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-596dc9545f-dztcv to ip-10-0-134-97.ec2.internal | ||
openshift-ingress |
kube-auth-proxy-5f7b849775-5gcnq |
Scheduled |
Successfully assigned openshift-ingress/kube-auth-proxy-5f7b849775-5gcnq to ip-10-0-134-97.ec2.internal | ||
openshift-ingress |
maas-default-gateway-openshift-default-596dc9545f-ktwxr |
Scheduled |
Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-596dc9545f-ktwxr to ip-10-0-134-97.ec2.internal | ||
openshift-ingress |
maas-default-gateway-openshift-default-596dc9545f-tvnpg |
Scheduled |
Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-596dc9545f-tvnpg to ip-10-0-133-6.ec2.internal | ||
openshift-ingress |
maas-default-gateway-openshift-default-596dc9545f-hfcrg |
Scheduled |
Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-596dc9545f-hfcrg to ip-10-0-133-6.ec2.internal | ||
openshift-ingress |
maas-default-gateway-openshift-default-596dc9545f-vg7xv |
Scheduled |
Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-596dc9545f-vg7xv to ip-10-0-134-97.ec2.internal | ||
openshift-ingress |
maas-default-gateway-openshift-default-596dc9545f-wxs2l |
Scheduled |
Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-596dc9545f-wxs2l to ip-10-0-130-237.ec2.internal | ||
openshift-ingress |
maas-default-gateway-openshift-default-596dc9545f-gpwmx |
Scheduled |
Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-596dc9545f-gpwmx to ip-10-0-133-6.ec2.internal | ||
openshift-ingress |
kube-auth-proxy-5f7b849775-kvct7 |
Scheduled |
Successfully assigned openshift-ingress/kube-auth-proxy-5f7b849775-kvct7 to ip-10-0-130-237.ec2.internal | ||
openshift-ingress |
e2e-shared-a-main-d5cb1c-openshift-default-77db498d8c-rd47n |
Scheduled |
Successfully assigned openshift-ingress/e2e-shared-a-main-d5cb1c-openshift-default-77db498d8c-rd47n to ip-10-0-130-237.ec2.internal | ||
openshift-ingress |
maas-default-gateway-openshift-default-596dc9545f-dsvvx |
Scheduled |
Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-596dc9545f-dsvvx to ip-10-0-133-6.ec2.internal | ||
openshift-ingress |
payload-processing-e2e-shared-a-main-d5cb1c-dd495866d-xjzj7 |
Scheduled |
Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-main-d5cb1c-dd495866d-xjzj7 to ip-10-0-134-97.ec2.internal | ||
openshift-ingress |
payload-processing-e2e-shared-b-main-ca863e-6bb4985b66-gsmq2 |
Scheduled |
Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-main-ca863e-6bb4985b66-gsmq2 to ip-10-0-134-97.ec2.internal | ||
openshift-ingress |
router-default-575669d575-qgfnp |
FailedScheduling |
no nodes available to schedule pods | ||
openshift-ingress |
data-science-gateway-data-science-gateway-class-6644c85865kxz26 |
Scheduled |
Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-6644c85865kxz26 to ip-10-0-133-6.ec2.internal | ||
openshift-ingress |
router-default-575669d575-qgfnp |
FailedScheduling |
no nodes available to schedule pods | ||
openshift-ingress |
istiod-openshift-gateway-7ddd9cfdc8-c46hh |
Scheduled |
Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-c46hh to ip-10-0-134-97.ec2.internal | ||
openshift-ingress |
maas-default-gateway-openshift-default-596dc9545f-dx86v |
Scheduled |
Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-596dc9545f-dx86v to ip-10-0-130-237.ec2.internal | ||
openshift-ingress |
maas-default-gateway-openshift-default-596dc9545f-hqwv6 |
Scheduled |
Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-596dc9545f-hqwv6 to ip-10-0-130-237.ec2.internal | ||
openshift-ingress |
istiod-openshift-gateway-7876bfcb74-thkxp |
Scheduled |
Successfully assigned openshift-ingress/istiod-openshift-gateway-7876bfcb74-thkxp to ip-10-0-134-97.ec2.internal | ||
openshift-ingress |
openshift-ai-inference-openshift-ai-inference-5cb6869599-pn2md |
Scheduled |
Successfully assigned openshift-ingress/openshift-ai-inference-openshift-ai-inference-5cb6869599-pn2md to ip-10-0-133-6.ec2.internal | ||
openshift-ingress |
payload-processing-5f78687d5b-g9mbb |
Scheduled |
Successfully assigned openshift-ingress/payload-processing-5f78687d5b-g9mbb to ip-10-0-130-237.ec2.internal | ||
openshift-ingress |
payload-pre-processing-7b98bb678c-8b96t |
Scheduled |
Successfully assigned openshift-ingress/payload-pre-processing-7b98bb678c-8b96t to ip-10-0-130-237.ec2.internal | ||
openshift-ingress |
payload-pre-processing-e2e-shared-a-main-d5cb1c-5bf88b86ffrqlqm |
Scheduled |
Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-main-d5cb1c-5bf88b86ffrqlqm to ip-10-0-134-97.ec2.internal | ||
openshift-ingress |
payload-pre-processing-e2e-shared-b-main-ca863e-5585dd6595hlnb4 |
Scheduled |
Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-main-ca863e-5585dd6595hlnb4 to ip-10-0-134-97.ec2.internal | ||
openshift-ingress |
router-default-575669d575-qgfnp |
Scheduled |
Successfully assigned openshift-ingress/router-default-575669d575-qgfnp to ip-10-0-133-6.ec2.internal | ||
openshift-ingress |
e2e-shared-b-main-ca863e-openshift-default-6f44d77dfc-s7vdt |
Scheduled |
Successfully assigned openshift-ingress/e2e-shared-b-main-ca863e-openshift-default-6f44d77dfc-s7vdt to ip-10-0-130-237.ec2.internal | ||
openshift-ingress |
deployment-controller |
router-default |
ScalingReplicaSet |
Scaled up replica set router-default-575669d575 from 0 to 1 | |
openshift-ingress |
service-controller |
router-default |
EnsuringLoadBalancer |
Ensuring load balancer | |
openshift-ingress |
service-controller |
router-default |
UnAvailableLoadBalancer |
There are no available nodes for LoadBalancer | |
openshift-ingress |
service-controller |
router-default |
EnsuredLoadBalancer |
Ensured load balancer | |
openshift-ingress |
replicaset-controller |
router-default-575669d575 |
FailedCreate |
Error creating: pods "router-default-575669d575-" is forbidden: error fetching namespace "openshift-ingress": unable to find annotation openshift.io/sa.scc.uid-range | |
openshift-ingress |
replicaset-controller |
router-default-575669d575 |
SuccessfulCreate |
Created pod: router-default-575669d575-qgfnp | |
| (x3) | openshift-ingress |
service-controller |
router-default |
UpdatedLoadBalancer |
Updated load balancer with new hosts |
| (x5) | openshift-ingress |
kubelet |
router-default-575669d575-qgfnp |
FailedMount |
MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt |
| (x5) | openshift-ingress |
kubelet |
router-default-575669d575-qgfnp |
FailedMount |
MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found |
| (x4) | openshift-ingress |
kubelet |
router-default-575669d575-qgfnp |
FailedMount |
MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found |
| (x4) | openshift-ingress |
kubelet |
router-default-575669d575-qgfnp |
FailedMount |
MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt |
openshift-ingress |
kubelet |
router-default-575669d575-qgfnp |
Created |
Container created | |
openshift-ingress |
multus |
router-default-575669d575-qgfnp |
AddedInterface |
Add eth0 [10.132.0.13/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
router-default-575669d575-qgfnp |
Started |
Container started | |
openshift-ingress |
kubelet |
router-default-575669d575-qgfnp |
Pulled |
Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3a679d80eb36ca7db888d4fbd1fdf16b0997a7c7a107936396b7a57d8b199f4e" already present on machine and can be accessed by the pod | |
openshift-ingress |
gateway_labeler_controller |
maas-default-gateway |
AddedLabel |
Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway | |
openshift-ingress |
deployment-controller |
istiod-openshift-gateway |
ScalingReplicaSet |
Scaled up replica set istiod-openshift-gateway-7876bfcb74 from 0 to 1 | |
openshift-ingress |
replicaset-controller |
istiod-openshift-gateway-7876bfcb74 |
SuccessfulCreate |
Created pod: istiod-openshift-gateway-7876bfcb74-thkxp | |
openshift-ingress |
multus |
istiod-openshift-gateway-7876bfcb74-thkxp |
AddedInterface |
Add eth0 [10.133.0.17/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-7876bfcb74-thkxp |
Pulling |
Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-7876bfcb74-thkxp |
Pulled |
Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 3.08s (3.08s including waiting). Image size: 185476477 bytes. | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-7876bfcb74-thkxp |
Created |
Container created | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-7876bfcb74-thkxp |
Started |
Container started | |
| (x2) | openshift-ingress |
kubelet |
istiod-openshift-gateway-7876bfcb74-thkxp |
ProbeError |
Readiness probe error: HTTP probe failed with statuscode: 503 body: |
| (x2) | openshift-ingress |
kubelet |
istiod-openshift-gateway-7876bfcb74-thkxp |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
openshift-ingress |
multus |
maas-default-gateway-openshift-default-596dc9545f-dsvvx |
AddedInterface |
Add eth0 [10.132.0.29/23] from ovn-kubernetes | |
openshift-ingress |
replicaset-controller |
openshift-ai-inference-openshift-ai-inference-5cb6869599 |
SuccessfulCreate |
Created pod: openshift-ai-inference-openshift-ai-inference-5cb6869599-pn2md | |
openshift-ingress |
deployment-controller |
openshift-ai-inference-openshift-ai-inference |
ScalingReplicaSet |
Scaled up replica set openshift-ai-inference-openshift-ai-inference-5cb6869599 from 0 to 1 | |
openshift-ingress |
service-controller |
openshift-ai-inference-openshift-ai-inference |
EnsuringLoadBalancer |
Ensuring load balancer | |
openshift-ingress |
replicaset-controller |
maas-default-gateway-openshift-default-596dc9545f |
SuccessfulCreate |
Created pod: maas-default-gateway-openshift-default-596dc9545f-dsvvx | |
openshift-ingress |
deployment-controller |
maas-default-gateway-openshift-default |
ScalingReplicaSet |
Scaled up replica set maas-default-gateway-openshift-default-596dc9545f from 0 to 1 | |
openshift-ingress |
kubelet |
openshift-ai-inference-openshift-ai-inference-5cb6869599-pn2md |
Pulling |
Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-596dc9545f-dsvvx |
Pulling |
Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" | |
openshift-ingress |
multus |
openshift-ai-inference-openshift-ai-inference-5cb6869599-pn2md |
AddedInterface |
Add eth0 [10.132.0.31/23] from ovn-kubernetes | |
openshift-ingress |
service-controller |
openshift-ai-inference-openshift-ai-inference |
EnsuredLoadBalancer |
Ensured load balancer | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-596dc9545f-dsvvx |
Pulled |
Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 7.866s (7.866s including waiting). Image size: 183555333 bytes. | |
openshift-ingress |
kubelet |
openshift-ai-inference-openshift-ai-inference-5cb6869599-pn2md |
Started |
Container started | |
openshift-ingress |
kubelet |
openshift-ai-inference-openshift-ai-inference-5cb6869599-pn2md |
Pulled |
Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 8.306s (8.306s including waiting). Image size: 183555333 bytes. | |
openshift-ingress |
kubelet |
openshift-ai-inference-openshift-ai-inference-5cb6869599-pn2md |
Created |
Container created | |
openshift-ingress |
horizontal-pod-autoscaler |
openshift-ai-inference-openshift-ai-inference |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
openshift-ingress |
horizontal-pod-autoscaler |
openshift-ai-inference-openshift-ai-inference |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
openshift-ingress |
horizontal-pod-autoscaler |
maas-default-gateway-openshift-default |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
openshift-ingress |
horizontal-pod-autoscaler |
maas-default-gateway-openshift-default |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
openshift-ingress |
horizontal-pod-autoscaler |
maas-default-gateway-openshift-default |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
openshift-ingress |
horizontal-pod-autoscaler |
openshift-ai-inference-openshift-ai-inference |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
openshift-ingress |
horizontal-pod-autoscaler |
openshift-ai-inference-openshift-ai-inference |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
openshift-ingress |
horizontal-pod-autoscaler |
maas-default-gateway-openshift-default |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
openshift-ingress |
replicaset-controller |
kube-auth-proxy-5f7b849775 |
SuccessfulCreate |
Created pod: kube-auth-proxy-5f7b849775-kvct7 | |
openshift-ingress |
deployment-controller |
kube-auth-proxy |
ScalingReplicaSet |
Scaled up replica set kube-auth-proxy-5f7b849775 from 0 to 2 | |
openshift-ingress |
replicaset-controller |
kube-auth-proxy-5f7b849775 |
SuccessfulCreate |
Created pod: kube-auth-proxy-5f7b849775-5gcnq | |
openshift-ingress |
kubelet |
kube-auth-proxy-5f7b849775-5gcnq |
Pulling |
Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" | |
openshift-ingress |
kubelet |
data-science-gateway-data-science-gateway-class-6644c85865kxz26 |
Started |
Container started | |
openshift-ingress |
deployment-controller |
data-science-gateway-data-science-gateway-class |
ScalingReplicaSet |
Scaled up replica set data-science-gateway-data-science-gateway-class-6644c85865 from 0 to 1 | |
openshift-ingress |
kubelet |
kube-auth-proxy-5f7b849775-kvct7 |
Pulling |
Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" | |
openshift-ingress |
multus |
kube-auth-proxy-5f7b849775-kvct7 |
AddedInterface |
Add eth0 [10.134.0.29/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
data-science-gateway-data-science-gateway-class-6644c85865kxz26 |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
openshift-ingress |
multus |
kube-auth-proxy-5f7b849775-5gcnq |
AddedInterface |
Add eth0 [10.133.0.19/23] from ovn-kubernetes | |
openshift-ingress |
replicaset-controller |
data-science-gateway-data-science-gateway-class-6644c85865 |
SuccessfulCreate |
Created pod: data-science-gateway-data-science-gateway-class-6644c85865kxz26 | |
openshift-ingress |
multus |
data-science-gateway-data-science-gateway-class-6644c85865kxz26 |
AddedInterface |
Add eth0 [10.132.0.41/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
data-science-gateway-data-science-gateway-class-6644c85865kxz26 |
Created |
Container created | |
openshift-ingress |
kubelet |
kube-auth-proxy-5f7b849775-5gcnq |
Created |
Container created | |
openshift-ingress |
kubelet |
kube-auth-proxy-5f7b849775-kvct7 |
Started |
Container started | |
openshift-ingress |
kubelet |
kube-auth-proxy-5f7b849775-kvct7 |
Created |
Container created | |
openshift-ingress |
kubelet |
kube-auth-proxy-5f7b849775-kvct7 |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.255s (2.255s including waiting). Image size: 188904677 bytes. | |
openshift-ingress |
kubelet |
kube-auth-proxy-5f7b849775-5gcnq |
Started |
Container started | |
openshift-ingress |
kubelet |
kube-auth-proxy-5f7b849775-5gcnq |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.397s (2.397s including waiting). Image size: 188904677 bytes. | |
openshift-ingress |
horizontal-pod-autoscaler |
kube-auth-proxy |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
openshift-ingress |
horizontal-pod-autoscaler |
kube-auth-proxy |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
openshift-ingress |
horizontal-pod-autoscaler |
kube-auth-proxy |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
openshift-ingress |
horizontal-pod-autoscaler |
kube-auth-proxy |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
| (x2) | openshift-ingress |
horizontal-pod-autoscaler |
data-science-gateway-data-science-gateway-class |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | openshift-ingress |
horizontal-pod-autoscaler |
data-science-gateway-data-science-gateway-class |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
openshift-ingress |
replicaset-controller |
istiod-openshift-gateway-7ddd9cfdc8 |
SuccessfulCreate |
Created pod: istiod-openshift-gateway-7ddd9cfdc8-c46hh | |
openshift-ingress |
deployment-controller |
istiod-openshift-gateway |
ScalingReplicaSet |
Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 0 to 1 | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-7ddd9cfdc8-c46hh |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-7ddd9cfdc8-c46hh |
Created |
Container created | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-7ddd9cfdc8-c46hh |
Started |
Container started | |
openshift-ingress |
multus |
istiod-openshift-gateway-7ddd9cfdc8-c46hh |
AddedInterface |
Add eth0 [10.133.0.21/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-7876bfcb74-thkxp |
Killing |
Stopping container discovery | |
openshift-ingress |
replicaset-controller |
istiod-openshift-gateway-7876bfcb74 |
SuccessfulDelete |
Deleted pod: istiod-openshift-gateway-7876bfcb74-thkxp | |
openshift-ingress |
deployment-controller |
istiod-openshift-gateway |
ScalingReplicaSet |
Scaled down replica set istiod-openshift-gateway-7876bfcb74 from 1 to 0 | |
| (x5) | openshift-ingress |
horizontal-pod-autoscaler |
istiod-openshift-gateway |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x5) | openshift-ingress |
horizontal-pod-autoscaler |
istiod-openshift-gateway |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
openshift-ingress |
horizontal-pod-autoscaler |
istiod-openshift-gateway |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
openshift-ingress |
horizontal-pod-autoscaler |
istiod-openshift-gateway |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
| (x2) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-596dc9545f-dsvvx |
Created |
Container created |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-596dc9545f-dsvvx |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
| (x2) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-596dc9545f-dsvvx |
Started |
Container started |
| (x5) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-596dc9545f-dsvvx |
ProbeError |
Startup probe error: Get "http://10.132.0.29:15021/healthz/ready": dial tcp 10.132.0.29:15021: connect: connection refused body: |
| (x5) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-596dc9545f-dsvvx |
Unhealthy |
Startup probe failed: Get "http://10.132.0.29:15021/healthz/ready": dial tcp 10.132.0.29:15021: connect: connection refused |
openshift-ingress |
replicaset-controller |
maas-default-gateway-openshift-default-596dc9545f |
SuccessfulCreate |
Created pod: maas-default-gateway-openshift-default-596dc9545f-ktwxr | |
openshift-ingress |
replicaset-controller |
maas-default-gateway-openshift-default-596dc9545f |
SuccessfulCreate |
Created pod: maas-default-gateway-openshift-default-596dc9545f-gpwmx | |
openshift-ingress |
replicaset-controller |
maas-default-gateway-openshift-default-596dc9545f |
SuccessfulCreate |
Created pod: maas-default-gateway-openshift-default-596dc9545f-wxs2l | |
openshift-ingress |
horizontal-pod-autoscaler |
maas-default-gateway-openshift-default |
SuccessfulRescale |
New size: 4; reason: cpu resource utilization (percentage of request) above target | |
openshift-ingress |
deployment-controller |
maas-default-gateway-openshift-default |
ScalingReplicaSet |
Scaled up replica set maas-default-gateway-openshift-default-596dc9545f from 1 to 4 | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-596dc9545f-gpwmx |
Created |
Container created | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-596dc9545f-gpwmx |
Started |
Container started | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-596dc9545f-wxs2l |
Pulling |
Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" | |
openshift-ingress |
multus |
maas-default-gateway-openshift-default-596dc9545f-wxs2l |
AddedInterface |
Add eth0 [10.134.0.36/23] from ovn-kubernetes | |
openshift-ingress |
multus |
maas-default-gateway-openshift-default-596dc9545f-gpwmx |
AddedInterface |
Add eth0 [10.132.0.48/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-596dc9545f-gpwmx |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-596dc9545f-ktwxr |
Pulling |
Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" | |
openshift-ingress |
multus |
maas-default-gateway-openshift-default-596dc9545f-ktwxr |
AddedInterface |
Add eth0 [10.133.0.29/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-596dc9545f-ktwxr |
Created |
Container created | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-596dc9545f-ktwxr |
Started |
Container started | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-596dc9545f-ktwxr |
Pulled |
Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 2.868s (2.868s including waiting). Image size: 183555333 bytes. | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-596dc9545f-wxs2l |
Started |
Container started | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-596dc9545f-wxs2l |
Created |
Container created | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-596dc9545f-wxs2l |
Pulled |
Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 2.616s (2.616s including waiting). Image size: 183555333 bytes. | |
| (x6) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-596dc9545f-gpwmx |
Unhealthy |
Startup probe failed: Get "http://10.132.0.48:15021/healthz/ready": dial tcp 10.132.0.48:15021: connect: connection refused |
| (x6) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-596dc9545f-gpwmx |
ProbeError |
Startup probe error: Get "http://10.132.0.48:15021/healthz/ready": dial tcp 10.132.0.48:15021: connect: connection refused body: |
| (x5) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-596dc9545f-wxs2l |
Unhealthy |
Startup probe failed: Get "http://10.134.0.36:15021/healthz/ready": dial tcp 10.134.0.36:15021: connect: connection refused |
| (x5) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-596dc9545f-wxs2l |
ProbeError |
Startup probe error: Get "http://10.134.0.36:15021/healthz/ready": dial tcp 10.134.0.36:15021: connect: connection refused body: |
| (x6) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-596dc9545f-ktwxr |
Unhealthy |
Startup probe failed: Get "http://10.133.0.29:15021/healthz/ready": dial tcp 10.133.0.29:15021: connect: connection refused |
| (x6) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-596dc9545f-ktwxr |
ProbeError |
Startup probe error: Get "http://10.133.0.29:15021/healthz/ready": dial tcp 10.133.0.29:15021: connect: connection refused body: |
openshift-ingress |
replicaset-controller |
maas-default-gateway-openshift-default-596dc9545f |
SuccessfulCreate |
Created pod: maas-default-gateway-openshift-default-596dc9545f-hqwv6 | |
openshift-ingress |
horizontal-pod-autoscaler |
maas-default-gateway-openshift-default |
SuccessfulRescale |
New size: 8; reason: | |
openshift-ingress |
deployment-controller |
maas-default-gateway-openshift-default |
ScalingReplicaSet |
Scaled up replica set maas-default-gateway-openshift-default-596dc9545f from 4 to 8 | |
openshift-ingress |
replicaset-controller |
maas-default-gateway-openshift-default-596dc9545f |
SuccessfulCreate |
Created pod: maas-default-gateway-openshift-default-596dc9545f-vg7xv | |
openshift-ingress |
replicaset-controller |
maas-default-gateway-openshift-default-596dc9545f |
SuccessfulCreate |
Created pod: maas-default-gateway-openshift-default-596dc9545f-hfcrg | |
openshift-ingress |
replicaset-controller |
maas-default-gateway-openshift-default-596dc9545f |
SuccessfulCreate |
Created pod: maas-default-gateway-openshift-default-596dc9545f-dx86v | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-596dc9545f-hfcrg |
Created |
Container created | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-596dc9545f-vg7xv |
Created |
Container created | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-596dc9545f-dx86v |
Started |
Container started | |
openshift-ingress |
multus |
maas-default-gateway-openshift-default-596dc9545f-dx86v |
AddedInterface |
Add eth0 [10.134.0.39/23] from ovn-kubernetes | |
openshift-ingress |
multus |
maas-default-gateway-openshift-default-596dc9545f-hfcrg |
AddedInterface |
Add eth0 [10.132.0.49/23] from ovn-kubernetes | |
openshift-ingress |
multus |
maas-default-gateway-openshift-default-596dc9545f-hqwv6 |
AddedInterface |
Add eth0 [10.134.0.38/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-596dc9545f-hqwv6 |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-596dc9545f-hqwv6 |
Created |
Container created | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-596dc9545f-hqwv6 |
Started |
Container started | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-596dc9545f-dx86v |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-596dc9545f-dx86v |
Created |
Container created | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-596dc9545f-hfcrg |
Started |
Container started | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-596dc9545f-hfcrg |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-596dc9545f-vg7xv |
Started |
Container started | |
openshift-ingress |
multus |
maas-default-gateway-openshift-default-596dc9545f-vg7xv |
AddedInterface |
Add eth0 [10.133.0.30/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-596dc9545f-vg7xv |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
| (x5) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-596dc9545f-vg7xv |
Unhealthy |
Startup probe failed: Get "http://10.133.0.30:15021/healthz/ready": dial tcp 10.133.0.30:15021: connect: connection refused |
| (x5) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-596dc9545f-vg7xv |
ProbeError |
Startup probe error: Get "http://10.133.0.30:15021/healthz/ready": dial tcp 10.133.0.30:15021: connect: connection refused body: |
| (x6) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-596dc9545f-dx86v |
Unhealthy |
Startup probe failed: Get "http://10.134.0.39:15021/healthz/ready": dial tcp 10.134.0.39:15021: connect: connection refused |
| (x5) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-596dc9545f-hfcrg |
ProbeError |
Startup probe error: Get "http://10.132.0.49:15021/healthz/ready": dial tcp 10.132.0.49:15021: connect: connection refused body: |
| (x6) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-596dc9545f-dx86v |
ProbeError |
Startup probe error: Get "http://10.134.0.39:15021/healthz/ready": dial tcp 10.134.0.39:15021: connect: connection refused body: |
| (x5) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-596dc9545f-hfcrg |
Unhealthy |
Startup probe failed: Get "http://10.132.0.49:15021/healthz/ready": dial tcp 10.132.0.49:15021: connect: connection refused |
| (x6) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-596dc9545f-hqwv6 |
Unhealthy |
Startup probe failed: Get "http://10.134.0.38:15021/healthz/ready": dial tcp 10.134.0.38:15021: connect: connection refused |
| (x6) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-596dc9545f-hqwv6 |
ProbeError |
Startup probe error: Get "http://10.134.0.38:15021/healthz/ready": dial tcp 10.134.0.38:15021: connect: connection refused body: |
openshift-ingress |
replicaset-controller |
maas-default-gateway-openshift-default-596dc9545f |
SuccessfulCreate |
Created pod: maas-default-gateway-openshift-default-596dc9545f-tvnpg | |
openshift-ingress |
horizontal-pod-autoscaler |
maas-default-gateway-openshift-default |
SuccessfulRescale |
New size: 10; reason: | |
openshift-ingress |
deployment-controller |
maas-default-gateway-openshift-default |
ScalingReplicaSet |
Scaled up replica set maas-default-gateway-openshift-default-596dc9545f from 8 to 10 | |
openshift-ingress |
replicaset-controller |
maas-default-gateway-openshift-default-596dc9545f |
SuccessfulCreate |
Created pod: maas-default-gateway-openshift-default-596dc9545f-dztcv | |
openshift-ingress |
multus |
maas-default-gateway-openshift-default-596dc9545f-dztcv |
AddedInterface |
Add eth0 [10.133.0.34/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-596dc9545f-tvnpg |
Created |
Container created | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-596dc9545f-dztcv |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-596dc9545f-dztcv |
Created |
Container created | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-596dc9545f-dztcv |
Started |
Container started | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-596dc9545f-tvnpg |
Started |
Container started | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-596dc9545f-tvnpg |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
openshift-ingress |
multus |
maas-default-gateway-openshift-default-596dc9545f-tvnpg |
AddedInterface |
Add eth0 [10.132.0.51/23] from ovn-kubernetes | |
| (x6) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-596dc9545f-dztcv |
Unhealthy |
Startup probe failed: Get "http://10.133.0.34:15021/healthz/ready": dial tcp 10.133.0.34:15021: connect: connection refused |
| (x6) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-596dc9545f-dztcv |
ProbeError |
Startup probe error: Get "http://10.133.0.34:15021/healthz/ready": dial tcp 10.133.0.34:15021: connect: connection refused body: |
| (x5) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-596dc9545f-tvnpg |
ProbeError |
Startup probe error: Get "http://10.132.0.51:15021/healthz/ready": dial tcp 10.132.0.51:15021: connect: connection refused body: |
| (x5) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-596dc9545f-tvnpg |
Unhealthy |
Startup probe failed: Get "http://10.132.0.51:15021/healthz/ready": dial tcp 10.132.0.51:15021: connect: connection refused |
openshift-ingress |
replicaset-controller |
payload-processing-5f78687d5b |
SuccessfulCreate |
Created pod: payload-processing-5f78687d5b-g9mbb | |
openshift-ingress |
replicaset-controller |
payload-pre-processing-7b98bb678c |
SuccessfulCreate |
Created pod: payload-pre-processing-7b98bb678c-8b96t | |
| (x6) | openshift-ingress |
replicaset-controller |
payload-processing-5f78687d5b |
FailedCreate |
Error creating: pods "payload-processing-5f78687d5b-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found |
| (x5) | openshift-ingress |
replicaset-controller |
payload-pre-processing-7b98bb678c |
FailedCreate |
Error creating: pods "payload-pre-processing-7b98bb678c-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found |
openshift-ingress |
deployment-controller |
payload-pre-processing |
ScalingReplicaSet |
Scaled up replica set payload-pre-processing-7b98bb678c from 0 to 1 | |
openshift-ingress |
deployment-controller |
payload-processing |
ScalingReplicaSet |
Scaled up replica set payload-processing-5f78687d5b from 0 to 1 | |
openshift-ingress |
multus |
payload-processing-5f78687d5b-g9mbb |
AddedInterface |
Add eth0 [10.134.0.44/23] from ovn-kubernetes | |
openshift-ingress |
multus |
payload-pre-processing-7b98bb678c-8b96t |
AddedInterface |
Add eth0 [10.134.0.43/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
payload-pre-processing-7b98bb678c-8b96t |
Pulling |
Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" | |
openshift-ingress |
kubelet |
payload-processing-5f78687d5b-g9mbb |
Pulling |
Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" | |
openshift-ingress |
kubelet |
payload-pre-processing-7b98bb678c-8b96t |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.316s (2.316s including waiting). Image size: 125317101 bytes. | |
openshift-ingress |
kubelet |
payload-pre-processing-7b98bb678c-8b96t |
Created |
Container created | |
openshift-ingress |
kubelet |
payload-processing-5f78687d5b-g9mbb |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.28s (2.28s including waiting). Image size: 125317101 bytes. | |
openshift-ingress |
kubelet |
payload-pre-processing-7b98bb678c-8b96t |
Started |
Container started | |
openshift-ingress |
kubelet |
payload-processing-5f78687d5b-g9mbb |
Started |
Container started | |
openshift-ingress |
kubelet |
payload-processing-5f78687d5b-g9mbb |
Created |
Container created | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-596dc9545f-hfcrg |
Unhealthy |
Readiness probe failed: Get "http://10.132.0.49:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-596dc9545f-dztcv |
ProbeError |
Readiness probe error: Get "http://10.133.0.34:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body: | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-596dc9545f-hqwv6 |
Unhealthy |
Readiness probe failed: Get "http://10.134.0.38:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-596dc9545f-tvnpg |
ProbeError |
Readiness probe error: Get "http://10.132.0.51:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body: | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-596dc9545f-tvnpg |
Unhealthy |
Readiness probe failed: Get "http://10.132.0.51:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-596dc9545f-gpwmx |
Unhealthy |
Readiness probe failed: Get "http://10.132.0.48:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-596dc9545f-vg7xv |
ProbeError |
Readiness probe error: Get "http://10.133.0.30:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body: | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-596dc9545f-dztcv |
Unhealthy |
Readiness probe failed: Get "http://10.133.0.34:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-596dc9545f-hfcrg |
ProbeError |
Readiness probe error: Get "http://10.132.0.49:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body: | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-596dc9545f-hqwv6 |
ProbeError |
Readiness probe error: Get "http://10.134.0.38:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body: | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-596dc9545f-vg7xv |
Unhealthy |
Readiness probe failed: Get "http://10.133.0.30:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-596dc9545f-gpwmx |
ProbeError |
Readiness probe error: Get "http://10.132.0.48:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body: | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-596dc9545f-dx86v |
ProbeError |
Readiness probe error: Get "http://10.134.0.39:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body: | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-596dc9545f-dx86v |
Unhealthy |
Readiness probe failed: Get "http://10.134.0.39:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) | |
openshift-ingress |
gateway_labeler_controller |
e2e-shared-a-main-d5cb1c |
AddedLabel |
Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-main-d5cb1c | |
openshift-ingress |
deployment-controller |
e2e-shared-a-main-d5cb1c-openshift-default |
ScalingReplicaSet |
Scaled up replica set e2e-shared-a-main-d5cb1c-openshift-default-77db498d8c from 0 to 1 | |
openshift-ingress |
multus |
e2e-shared-a-main-d5cb1c-openshift-default-77db498d8c-rd47n |
AddedInterface |
Add eth0 [10.134.0.50/23] from ovn-kubernetes | |
openshift-ingress |
replicaset-controller |
e2e-shared-a-main-d5cb1c-openshift-default-77db498d8c |
SuccessfulCreate |
Created pod: e2e-shared-a-main-d5cb1c-openshift-default-77db498d8c-rd47n | |
openshift-ingress |
deployment-controller |
payload-processing-e2e-shared-a-main-d5cb1c |
ScalingReplicaSet |
Scaled up replica set payload-processing-e2e-shared-a-main-d5cb1c-dd495866d from 0 to 1 | |
openshift-ingress |
deployment-controller |
payload-pre-processing-e2e-shared-a-main-d5cb1c |
ScalingReplicaSet |
Scaled up replica set payload-pre-processing-e2e-shared-a-main-d5cb1c-5bf88b86ff from 0 to 1 | |
openshift-ingress |
kubelet |
payload-processing-e2e-shared-a-main-d5cb1c-dd495866d-xjzj7 |
Pulling |
Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" | |
| (x5) | openshift-ingress |
replicaset-controller |
payload-pre-processing-e2e-shared-a-main-d5cb1c-5bf88b86ff |
FailedCreate |
Error creating: pods "payload-pre-processing-e2e-shared-a-main-d5cb1c-5bf88b86ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-main-d5cb1c: serviceaccount "payload-processing-e2e-shared-a-main-d5cb1c" not found |
openshift-ingress |
replicaset-controller |
payload-pre-processing-e2e-shared-a-main-d5cb1c-5bf88b86ff |
SuccessfulCreate |
Created pod: payload-pre-processing-e2e-shared-a-main-d5cb1c-5bf88b86ffrqlqm | |
openshift-ingress |
replicaset-controller |
payload-processing-e2e-shared-a-main-d5cb1c-dd495866d |
SuccessfulCreate |
Created pod: payload-processing-e2e-shared-a-main-d5cb1c-dd495866d-xjzj7 | |
openshift-ingress |
multus |
payload-pre-processing-e2e-shared-a-main-d5cb1c-5bf88b86ffrqlqm |
AddedInterface |
Add eth0 [10.133.0.51/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-shared-a-main-d5cb1c-5bf88b86ffrqlqm |
Pulling |
Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" | |
| (x6) | openshift-ingress |
replicaset-controller |
payload-processing-e2e-shared-a-main-d5cb1c-dd495866d |
FailedCreate |
Error creating: pods "payload-processing-e2e-shared-a-main-d5cb1c-dd495866d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-main-d5cb1c: serviceaccount "payload-processing-e2e-shared-a-main-d5cb1c" not found |
openshift-ingress |
multus |
payload-processing-e2e-shared-a-main-d5cb1c-dd495866d-xjzj7 |
AddedInterface |
Add eth0 [10.133.0.52/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-shared-a-main-d5cb1c-5bf88b86ffrqlqm |
Started |
Container started | |
openshift-ingress |
kubelet |
payload-processing-e2e-shared-a-main-d5cb1c-dd495866d-xjzj7 |
Created |
Container created | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-shared-a-main-d5cb1c-5bf88b86ffrqlqm |
Created |
Container created | |
openshift-ingress |
kubelet |
payload-processing-e2e-shared-a-main-d5cb1c-dd495866d-xjzj7 |
Started |
Container started | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-shared-a-main-d5cb1c-5bf88b86ffrqlqm |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.27s (2.27s including waiting). Image size: 125317101 bytes. | |
openshift-ingress |
kubelet |
payload-processing-e2e-shared-a-main-d5cb1c-dd495866d-xjzj7 |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.289s (2.289s including waiting). Image size: 125317101 bytes. | |
openshift-ingress |
kubelet |
e2e-shared-a-main-d5cb1c-openshift-default-77db498d8c-rd47n |
ProbeError |
Readiness probe error: Get "http://10.134.0.50:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body: | |
openshift-ingress |
kubelet |
e2e-shared-a-main-d5cb1c-openshift-default-77db498d8c-rd47n |
Unhealthy |
Readiness probe failed: Get "http://10.134.0.50:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) | |
openshift-ingress |
deployment-controller |
e2e-shared-b-main-ca863e-openshift-default |
ScalingReplicaSet |
Scaled up replica set e2e-shared-b-main-ca863e-openshift-default-6f44d77dfc from 0 to 1 | |
openshift-ingress |
gateway_labeler_controller |
e2e-shared-b-main-ca863e |
AddedLabel |
Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-main-ca863e | |
openshift-ingress |
multus |
e2e-shared-b-main-ca863e-openshift-default-6f44d77dfc-s7vdt |
AddedInterface |
Add eth0 [10.134.0.52/23] from ovn-kubernetes | |
openshift-ingress |
replicaset-controller |
e2e-shared-b-main-ca863e-openshift-default-6f44d77dfc |
SuccessfulCreate |
Created pod: e2e-shared-b-main-ca863e-openshift-default-6f44d77dfc-s7vdt | |
| (x2) | openshift-ingress |
kubelet |
e2e-shared-a-main-d5cb1c-openshift-default-77db498d8c-rd47n |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod |
| (x2) | openshift-ingress |
kubelet |
e2e-shared-a-main-d5cb1c-openshift-default-77db498d8c-rd47n |
Created |
Container created |
| (x2) | openshift-ingress |
kubelet |
e2e-shared-a-main-d5cb1c-openshift-default-77db498d8c-rd47n |
Started |
Container started |
openshift-ingress |
replicaset-controller |
payload-processing-e2e-shared-b-main-ca863e-6bb4985b66 |
SuccessfulCreate |
Created pod: payload-processing-e2e-shared-b-main-ca863e-6bb4985b66-gsmq2 | |
openshift-ingress |
multus |
payload-pre-processing-e2e-shared-b-main-ca863e-5585dd6595hlnb4 |
AddedInterface |
Add eth0 [10.133.0.53/23] from ovn-kubernetes | |
| (x6) | openshift-ingress |
replicaset-controller |
payload-processing-e2e-shared-b-main-ca863e-6bb4985b66 |
FailedCreate |
Error creating: pods "payload-processing-e2e-shared-b-main-ca863e-6bb4985b66-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-main-ca863e: serviceaccount "payload-processing-e2e-shared-b-main-ca863e" not found |
| (x5) | openshift-ingress |
kubelet |
e2e-shared-a-main-d5cb1c-openshift-default-77db498d8c-rd47n |
ProbeError |
Startup probe error: Get "http://10.134.0.50:15021/healthz/ready": dial tcp 10.134.0.50:15021: connect: connection refused body: |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-shared-b-main-ca863e-5585dd6595hlnb4 |
Pulled |
Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod | |
| (x5) | openshift-ingress |
kubelet |
e2e-shared-a-main-d5cb1c-openshift-default-77db498d8c-rd47n |
Unhealthy |
Startup probe failed: Get "http://10.134.0.50:15021/healthz/ready": dial tcp 10.134.0.50:15021: connect: connection refused |
openshift-ingress |
replicaset-controller |
payload-pre-processing-e2e-shared-b-main-ca863e-5585dd6595 |
SuccessfulCreate |
Created pod: payload-pre-processing-e2e-shared-b-main-ca863e-5585dd6595hlnb4 | |
| (x5) | openshift-ingress |
replicaset-controller |
payload-pre-processing-e2e-shared-b-main-ca863e-5585dd6595 |
FailedCreate |
Error creating: pods "payload-pre-processing-e2e-shared-b-main-ca863e-5585dd6595-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-main-ca863e: serviceaccount "payload-processing-e2e-shared-b-main-ca863e" not found |
openshift-ingress |
deployment-controller |
payload-processing-e2e-shared-b-main-ca863e |
ScalingReplicaSet |
Scaled up replica set payload-processing-e2e-shared-b-main-ca863e-6bb4985b66 from 0 to 1 | |
openshift-ingress |
deployment-controller |
payload-pre-processing-e2e-shared-b-main-ca863e |
ScalingReplicaSet |
Scaled up replica set payload-pre-processing-e2e-shared-b-main-ca863e-5585dd6595 from 0 to 1 | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-shared-b-main-ca863e-5585dd6595hlnb4 |
Created |
Container created | |
openshift-ingress |
kubelet |
payload-processing-e2e-shared-b-main-ca863e-6bb4985b66-gsmq2 |
Pulled |
Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-shared-b-main-ca863e-5585dd6595hlnb4 |
Started |
Container started | |
openshift-ingress |
kubelet |
payload-processing-e2e-shared-b-main-ca863e-6bb4985b66-gsmq2 |
Started |
Container started | |
openshift-ingress |
kubelet |
payload-processing-e2e-shared-b-main-ca863e-6bb4985b66-gsmq2 |
Created |
Container created | |
openshift-ingress |
multus |
payload-processing-e2e-shared-b-main-ca863e-6bb4985b66-gsmq2 |
AddedInterface |
Add eth0 [10.133.0.54/23] from ovn-kubernetes | |
| (x2) | openshift-ingress |
horizontal-pod-autoscaler |
e2e-shared-a-main-d5cb1c-openshift-default |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | openshift-ingress |
horizontal-pod-autoscaler |
e2e-shared-a-main-d5cb1c-openshift-default |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
openshift-ingress |
horizontal-pod-autoscaler |
e2e-shared-b-main-ca863e-openshift-default |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
openshift-ingress |
horizontal-pod-autoscaler |
e2e-shared-b-main-ca863e-openshift-default |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x2) | openshift-ingress |
kubelet |
e2e-shared-b-main-ca863e-openshift-default-6f44d77dfc-s7vdt |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod |
| (x2) | openshift-ingress |
kubelet |
e2e-shared-b-main-ca863e-openshift-default-6f44d77dfc-s7vdt |
Created |
Container created |
| (x2) | openshift-ingress |
kubelet |
e2e-shared-b-main-ca863e-openshift-default-6f44d77dfc-s7vdt |
Started |
Container started |
openshift-ingress |
horizontal-pod-autoscaler |
e2e-shared-a-main-d5cb1c-openshift-default |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
openshift-ingress |
horizontal-pod-autoscaler |
e2e-shared-a-main-d5cb1c-openshift-default |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
| (x5) | openshift-ingress |
kubelet |
e2e-shared-b-main-ca863e-openshift-default-6f44d77dfc-s7vdt |
ProbeError |
Startup probe error: Get "http://10.134.0.52:15021/healthz/ready": dial tcp 10.134.0.52:15021: connect: connection refused body: |
| (x5) | openshift-ingress |
kubelet |
e2e-shared-b-main-ca863e-openshift-default-6f44d77dfc-s7vdt |
Unhealthy |
Startup probe failed: Get "http://10.134.0.52:15021/healthz/ready": dial tcp 10.134.0.52:15021: connect: connection refused |
| (x3) | openshift-ingress |
horizontal-pod-autoscaler |
e2e-shared-b-main-ca863e-openshift-default |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | openshift-ingress |
horizontal-pod-autoscaler |
e2e-shared-b-main-ca863e-openshift-default |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-596dc9545f-dsvvx |
Unhealthy |
Readiness probe failed: Get "http://10.132.0.29:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) |
| (x4) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-596dc9545f-dsvvx |
ProbeError |
Readiness probe error: Get "http://10.132.0.29:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body: |
| (x2) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-596dc9545f-ktwxr |
Unhealthy |
Readiness probe failed: Get "http://10.133.0.29:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) |
| (x2) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-596dc9545f-ktwxr |
ProbeError |
Readiness probe error: Get "http://10.133.0.29:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body: |
| (x3) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-596dc9545f-wxs2l |
Unhealthy |
Readiness probe failed: Get "http://10.134.0.36:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) |
| (x3) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-596dc9545f-wxs2l |
ProbeError |
Readiness probe error: Get "http://10.134.0.36:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body: |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-shared-a-main-d5cb1c-5bf88b86ffrqlqm |
Killing |
Stopping container payload-pre-processing | |
openshift-ingress |
kubelet |
payload-processing-e2e-shared-a-main-d5cb1c-dd495866d-xjzj7 |
Killing |
Stopping container payload-processing | |
openshift-ingress |
kubelet |
e2e-shared-a-main-d5cb1c-openshift-default-77db498d8c-rd47n |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-shared-b-main-ca863e-5585dd6595hlnb4 |
Killing |
Stopping container payload-pre-processing | |
openshift-ingress |
kubelet |
payload-processing-e2e-shared-b-main-ca863e-6bb4985b66-gsmq2 |
Killing |
Stopping container payload-processing | |
openshift-ingress |
kubelet |
e2e-shared-b-main-ca863e-openshift-default-6f44d77dfc-s7vdt |
ProbeError |
Readiness probe error: HTTP probe failed with statuscode: 503 body: | |
openshift-ingress |
kubelet |
e2e-shared-b-main-ca863e-openshift-default-6f44d77dfc-s7vdt |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
kubelet |
e2e-shared-b-main-ca863e-openshift-default-6f44d77dfc-s7vdt |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 | |
| (x2) | openshift-ingress |
kubelet |
payload-processing-e2e-shared-b-main-ca863e-6bb4985b66-gsmq2 |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") |
| (x2) | openshift-ingress |
kubelet |
payload-pre-processing-e2e-shared-b-main-ca863e-5585dd6595hlnb4 |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") |