| Time | Namespace | Component | RelatedObject | Reason | Message |
|---|---|---|---|---|---|
kserve-ci-e2e-test |
isvc-sklearn-graph-1-predictor-74d68d6bdc-vzbzj |
Scheduled |
Successfully assigned kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-74d68d6bdc-vzbzj to ip-10-0-128-201.ec2.internal | ||
kserve-ci-e2e-test |
ensemble-graph-de58a-7d7f775b78-25zfk |
Scheduled |
Successfully assigned kserve-ci-e2e-test/ensemble-graph-de58a-7d7f775b78-25zfk to ip-10-0-140-191.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-3d0d2-predictor-7967c5b545-lq669 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-3d0d2-predictor-7967c5b545-lq669 to ip-10-0-128-201.ec2.internal | ||
kserve-ci-e2e-test |
sequence-graph-99283-794d7b9b66-gv4p9 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/sequence-graph-99283-794d7b9b66-gv4p9 to ip-10-0-140-191.ec2.internal | ||
kserve-ci-e2e-test |
sequence-graph-6b9e1-58b69f49c8-6r5th |
Scheduled |
Successfully assigned kserve-ci-e2e-test/sequence-graph-6b9e1-58b69f49c8-6r5th to ip-10-0-140-191.ec2.internal | ||
kserve-ci-e2e-test |
switch-graph-3d0d2-5f445cd894-whsfp |
Scheduled |
Successfully assigned kserve-ci-e2e-test/switch-graph-3d0d2-5f445cd894-whsfp to ip-10-0-140-191.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-1f9ad-predictor-84d585c7c-4pvwn |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-1f9ad-predictor-84d585c7c-4pvwn to ip-10-0-128-201.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-6b9e1-predictor-d9f68c7f6-rhbb2 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-6b9e1-predictor-d9f68c7f6-rhbb2 to ip-10-0-128-201.ec2.internal | ||
kserve-ci-e2e-test |
isvc-sklearn-graph-2-predictor-d76b874f9-v922p |
Scheduled |
Successfully assigned kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-d76b874f9-v922p to ip-10-0-140-191.ec2.internal | ||
kserve-ci-e2e-test |
ensemble-graph-12b34-9c57c45ff-5kq92 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/ensemble-graph-12b34-9c57c45ff-5kq92 to ip-10-0-140-191.ec2.internal | ||
kserve-ci-e2e-test |
sequence-graph-1f9ad-5789fb8557-kcq6v |
Scheduled |
Successfully assigned kserve-ci-e2e-test/sequence-graph-1f9ad-5789fb8557-kcq6v to ip-10-0-140-191.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-3d0d2-predictor-78c799bd44-wt5c2 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-3d0d2-predictor-78c799bd44-wt5c2 to ip-10-0-128-201.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-99283-predictor-75c5d8c576-2d7bl |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-99283-predictor-75c5d8c576-2d7bl to ip-10-0-128-201.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-9a649-predictor-779bcbc86d-k8kff |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-9a649-predictor-779bcbc86d-k8kff to ip-10-0-128-201.ec2.internal | ||
kserve-ci-e2e-test |
switch-graph-1bf21-b5cd598bc-pm5nx |
Scheduled |
Successfully assigned kserve-ci-e2e-test/switch-graph-1bf21-b5cd598bc-pm5nx to ip-10-0-140-191.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-e8b6e-predictor-66bb45779f-wmmzb |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-e8b6e-predictor-66bb45779f-wmmzb to ip-10-0-128-201.ec2.internal | ||
kserve-ci-e2e-test |
model-chainer-77968cf4b8-6522x |
Scheduled |
Successfully assigned kserve-ci-e2e-test/model-chainer-77968cf4b8-6522x to ip-10-0-140-191.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-de58a-predictor-56d6b9bf76-pws6k |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-de58a-predictor-56d6b9bf76-pws6k to ip-10-0-128-201.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-12b34-predictor-558d6f8bf8-mzwqn |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-12b34-predictor-558d6f8bf8-mzwqn to ip-10-0-128-201.ec2.internal | ||
kserve-ci-e2e-test |
splitter-graph-9a649-6c6f5d7c86-mqbhj |
Scheduled |
Successfully assigned kserve-ci-e2e-test/splitter-graph-9a649-6c6f5d7c86-mqbhj to ip-10-0-140-191.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-99283-predictor-5b9fd86cdf-j7k6b |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-99283-predictor-5b9fd86cdf-j7k6b to ip-10-0-128-201.ec2.internal | ||
kserve-ci-e2e-test |
splitter-graph-e8b6e-5f9c98cc85-w42z2 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/splitter-graph-e8b6e-5f9c98cc85-w42z2 to ip-10-0-140-191.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-6b9e1-predictor-77fcc484d9-s29lr |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-6b9e1-predictor-77fcc484d9-s29lr to ip-10-0-128-201.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-653df-predictor-7db8685f5-75qnk |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-653df-predictor-7db8685f5-75qnk to ip-10-0-128-201.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-1f9ad-predictor-6f68d9c676-2l6lt |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-1f9ad-predictor-6f68d9c676-2l6lt to ip-10-0-128-201.ec2.internal | ||
kserve-ci-e2e-test |
isvc-xgboost-graph-predictor-784cb989b8-x9n2v |
Scheduled |
Successfully assigned kserve-ci-e2e-test/isvc-xgboost-graph-predictor-784cb989b8-x9n2v to ip-10-0-140-191.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-e8b6e-predictor-64c44c8fcd-kllhr |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-e8b6e-predictor-64c44c8fcd-kllhr to ip-10-0-128-201.ec2.internal | ||
kserve-ci-e2e-test |
switch-graph-653df-fd48d9cd8-p5dbm |
Scheduled |
Successfully assigned kserve-ci-e2e-test/switch-graph-653df-fd48d9cd8-p5dbm to ip-10-0-140-191.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-de58a-predictor-5959f57c5c-pfhmx |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-de58a-predictor-5959f57c5c-pfhmx to ip-10-0-128-201.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-9a649-predictor-b857f97b5-fnrvk |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-9a649-predictor-b857f97b5-fnrvk to ip-10-0-128-201.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-1bf21-predictor-6544f99f87-pskk2 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-1bf21-predictor-6544f99f87-pskk2 to ip-10-0-128-201.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-653df-predictor-fd849f8f8-w5j6t |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-653df-predictor-fd849f8f8-w5j6t to ip-10-0-128-201.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-12b34-predictor-954f5b995-lqhrg |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-12b34-predictor-954f5b995-lqhrg to ip-10-0-128-201.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-1bf21-predictor-6b9945bd54-cggbr |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-1bf21-predictor-6b9945bd54-cggbr to ip-10-0-128-201.ec2.internal | ||
kserve-ci-e2e-test |
multus |
error-404-isvc-1bf21-predictor-6b9945bd54-cggbr |
AddedInterface |
Add eth0 [10.132.0.31/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
replicaset-controller |
isvc-xgboost-graph-predictor-784cb989b8 |
SuccessfulCreate |
Created pod: isvc-xgboost-graph-predictor-784cb989b8-x9n2v | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-1bf21-predictor-6544f99f87-pskk2 |
Pulling |
Pulling image "quay.io/opendatahub/success-200-isvc:odh-pr-1412" | |
kserve-ci-e2e-test |
deployment-controller |
isvc-sklearn-graph-2-predictor |
ScalingReplicaSet |
Scaled up replica set isvc-sklearn-graph-2-predictor-d76b874f9 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
isvc-sklearn-graph-2-predictor-d76b874f9 |
SuccessfulCreate |
Created pod: isvc-sklearn-graph-2-predictor-d76b874f9-v922p | |
kserve-ci-e2e-test |
deployment-controller |
isvc-sklearn-graph-1-predictor |
ScalingReplicaSet |
Scaled up replica set isvc-sklearn-graph-1-predictor-74d68d6bdc from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
isvc-sklearn-graph-1-predictor-74d68d6bdc |
SuccessfulCreate |
Created pod: isvc-sklearn-graph-1-predictor-74d68d6bdc-vzbzj | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-1bf21-predictor-6b9945bd54-cggbr |
Pulling |
Pulling image "quay.io/opendatahub/error-404-isvc:odh-pr-1412" | |
kserve-ci-e2e-test |
deployment-controller |
isvc-xgboost-graph-predictor |
ScalingReplicaSet |
Scaled up replica set isvc-xgboost-graph-predictor-784cb989b8 from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-1bf21-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-1bf21-predictor-6b9945bd54 from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-1bf21-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-1bf21-predictor-6544f99f87 from 0 to 1 | |
kserve-ci-e2e-test |
multus |
success-200-isvc-1bf21-predictor-6544f99f87-pskk2 |
AddedInterface |
Add eth0 [10.132.0.29/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-1bf21-predictor-6544f99f87 |
SuccessfulCreate |
Created pod: success-200-isvc-1bf21-predictor-6544f99f87-pskk2 | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-1bf21-predictor-6b9945bd54 |
SuccessfulCreate |
Created pod: error-404-isvc-1bf21-predictor-6b9945bd54-cggbr | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-784cb989b8-x9n2v |
Pulling |
Pulling image "quay.io/opendatahub/kserve-storage-initializer@sha256:b1408675ea4fdca559a0643f83f1f99c90fa28691ae069983f57f521927df688" | |
kserve-ci-e2e-test |
multus |
isvc-sklearn-graph-2-predictor-d76b874f9-v922p |
AddedInterface |
Add eth0 [10.134.0.30/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
multus |
isvc-sklearn-graph-1-predictor-74d68d6bdc-vzbzj |
AddedInterface |
Add eth0 [10.132.0.30/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-74d68d6bdc-vzbzj |
Pulling |
Pulling image "quay.io/opendatahub/kserve-storage-initializer@sha256:b1408675ea4fdca559a0643f83f1f99c90fa28691ae069983f57f521927df688" | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-d76b874f9-v922p |
Pulling |
Pulling image "quay.io/opendatahub/kserve-storage-initializer@sha256:b1408675ea4fdca559a0643f83f1f99c90fa28691ae069983f57f521927df688" | |
kserve-ci-e2e-test |
multus |
isvc-xgboost-graph-predictor-784cb989b8-x9n2v |
AddedInterface |
Add eth0 [10.134.0.29/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-784cb989b8-x9n2v |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-d76b874f9-v922p |
Pulled |
Successfully pulled image "quay.io/opendatahub/kserve-storage-initializer@sha256:b1408675ea4fdca559a0643f83f1f99c90fa28691ae069983f57f521927df688" in 3.787s (3.787s including waiting). Image size: 299671472 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-d76b874f9-v922p |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-784cb989b8-x9n2v |
Pulled |
Successfully pulled image "quay.io/opendatahub/kserve-storage-initializer@sha256:b1408675ea4fdca559a0643f83f1f99c90fa28691ae069983f57f521927df688" in 3.892s (3.892s including waiting). Image size: 299671472 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-784cb989b8-x9n2v |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-d76b874f9-v922p |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-74d68d6bdc-vzbzj |
Pulled |
Successfully pulled image "quay.io/opendatahub/kserve-storage-initializer@sha256:b1408675ea4fdca559a0643f83f1f99c90fa28691ae069983f57f521927df688" in 5.887s (5.887s including waiting). Image size: 299671472 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-74d68d6bdc-vzbzj |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-74d68d6bdc-vzbzj |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-d76b874f9-v922p |
Pulling |
Pulling image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1412" | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-784cb989b8-x9n2v |
Pulling |
Pulling image "kserve/xgbserver:latest" | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-74d68d6bdc-vzbzj |
Pulling |
Pulling image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1412" | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-1bf21-predictor-6b9945bd54-cggbr |
Pulled |
Successfully pulled image "quay.io/opendatahub/error-404-isvc:odh-pr-1412" in 14.312s (14.312s including waiting). Image size: 1332292201 bytes. | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-1bf21-predictor-6544f99f87-pskk2 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-1bf21-predictor-6b9945bd54-cggbr |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-1bf21-predictor-6b9945bd54-cggbr |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-1bf21-predictor-6544f99f87-pskk2 |
Pulled |
Successfully pulled image "quay.io/opendatahub/success-200-isvc:odh-pr-1412" in 14.636s (14.636s including waiting). Image size: 1332300400 bytes. | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-1bf21-predictor-6544f99f87-pskk2 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-74d68d6bdc-vzbzj |
Pulled |
Successfully pulled image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1412" in 8.264s (8.264s including waiting). Image size: 1560613811 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-74d68d6bdc-vzbzj |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-74d68d6bdc-vzbzj |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-d76b874f9-v922p |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-d76b874f9-v922p |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-d76b874f9-v922p |
Pulled |
Successfully pulled image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1412" in 14.793s (14.793s including waiting). Image size: 1560613811 bytes. | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-784cb989b8-x9n2v |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-784cb989b8-x9n2v |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-784cb989b8-x9n2v |
Pulled |
Successfully pulled image "kserve/xgbserver:latest" in 33.798s (33.798s including waiting). Image size: 1306229499 bytes. | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-1bf21-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-1bf21-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-1bf21-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-1bf21-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-1bf21 |
InferenceServiceReady |
InferenceService [error-404-isvc-1bf21] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-1bf21 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-1bf21 |
InferenceServiceReady |
InferenceService [success-200-isvc-1bf21] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-1bf21 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
replicaset-controller |
switch-graph-1bf21-b5cd598bc |
SuccessfulCreate |
Created pod: switch-graph-1bf21-b5cd598bc-pm5nx | |
kserve-ci-e2e-test |
deployment-controller |
switch-graph-1bf21 |
ScalingReplicaSet |
Scaled up replica set switch-graph-1bf21-b5cd598bc from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
switch-graph-1bf21-b5cd598bc-pm5nx |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "switch-graph-1bf21-serving-cert" not found | |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-1bf21 |
InferenceGraphReady |
InferenceGraph [switch-graph-1bf21] is Ready | |
kserve-ci-e2e-test |
kubelet |
switch-graph-1bf21-b5cd598bc-pm5nx |
Pulling |
Pulling image "quay.io/opendatahub/kserve-router@sha256:6060da2148ba78c06d6de96222351f1e5f7d3ada4027ac02142aa0e1928e4f29" | |
kserve-ci-e2e-test |
multus |
switch-graph-1bf21-b5cd598bc-pm5nx |
AddedInterface |
Add eth0 [10.134.0.31/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
switch-graph-1bf21-b5cd598bc-pm5nx |
Pulled |
Successfully pulled image "quay.io/opendatahub/kserve-router@sha256:6060da2148ba78c06d6de96222351f1e5f7d3ada4027ac02142aa0e1928e4f29" in 2.525s (2.525s including waiting). Image size: 216232023 bytes. | |
kserve-ci-e2e-test |
kubelet |
switch-graph-1bf21-b5cd598bc-pm5nx |
Started |
Started container switch-graph-1bf21 | |
kserve-ci-e2e-test |
kubelet |
switch-graph-1bf21-b5cd598bc-pm5nx |
Created |
Created container: switch-graph-1bf21 | |
| (x9) | kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-d76b874f9-v922p |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.30:8080: connect: connection refused |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-1bf21-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-1bf21-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-1bf21-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-1bf21-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x9) | kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-1 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-1 |
InferenceServiceReady |
InferenceService [isvc-sklearn-graph-1] is Ready | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-3d0d2 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-3d0d2": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-3d0d2": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-3d0d2 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-3d0d2": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-3d0d2-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-3d0d2-predictor-7967c5b545 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-3d0d2-predictor-78c799bd44 |
SuccessfulCreate |
Created pod: error-404-isvc-3d0d2-predictor-78c799bd44-wt5c2 | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-3d0d2-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-3d0d2-predictor-78c799bd44 from 0 to 1 | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-3d0d2 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-3d0d2": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
switch-graph-1bf21-b5cd598bc-pm5nx |
Killing |
Stopping container switch-graph-1bf21 | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-3d0d2-predictor-7967c5b545 |
SuccessfulCreate |
Created pod: success-200-isvc-3d0d2-predictor-7967c5b545-lq669 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-1bf21-predictor-6544f99f87-pskk2 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-1bf21-predictor-6b9945bd54-cggbr |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-3d0d2 |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-3d0d2": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-3d0d2": the object has been modified; please apply your changes to the latest version and try again | |
| (x7) | kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-784cb989b8-x9n2v |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.29:8080: connect: connection refused |
kserve-ci-e2e-test |
multus |
error-404-isvc-3d0d2-predictor-78c799bd44-wt5c2 |
AddedInterface |
Add eth0 [10.132.0.33/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-3d0d2-predictor-7967c5b545-lq669 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-3d0d2-predictor-78c799bd44-wt5c2 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-3d0d2-predictor-7967c5b545-lq669 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-3d0d2-predictor-7967c5b545-lq669 |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1412" already present on machine | |
kserve-ci-e2e-test |
multus |
success-200-isvc-3d0d2-predictor-7967c5b545-lq669 |
AddedInterface |
Add eth0 [10.132.0.32/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-3d0d2-predictor-78c799bd44-wt5c2 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-3d0d2-predictor-78c799bd44-wt5c2 |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1412" already present on machine | |
| (x7) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-1bf21-predictor-6b9945bd54-cggbr |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.31:8080: connect: connection refused |
kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-2 |
InferenceServiceReady |
InferenceService [isvc-sklearn-graph-2] is Ready | |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-1bf21-predictor-6544f99f87-pskk2 |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.29:8080: connect: connection refused |
| (x9) | kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-2 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x9) | kserve-ci-e2e-test |
v1beta1Controllers |
isvc-xgboost-graph |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
isvc-xgboost-graph |
InferenceServiceReady |
InferenceService [isvc-xgboost-graph] is Ready | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-3d0d2-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-3d0d2-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x6) | kserve-ci-e2e-test |
kubelet |
switch-graph-1bf21-b5cd598bc-pm5nx |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
kubelet |
model-chainer-77968cf4b8-6522x |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "model-chainer-serving-cert" not found | |
| (x6) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x6) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
InferenceGraphController |
model-chainer |
InferenceGraphReady |
InferenceGraph [model-chainer] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
model-chainer |
ScalingReplicaSet |
Scaled up replica set model-chainer-77968cf4b8 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
model-chainer-77968cf4b8 |
SuccessfulCreate |
Created pod: model-chainer-77968cf4b8-6522x | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
kubelet |
model-chainer-77968cf4b8-6522x |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:6060da2148ba78c06d6de96222351f1e5f7d3ada4027ac02142aa0e1928e4f29" already present on machine | |
kserve-ci-e2e-test |
multus |
model-chainer-77968cf4b8-6522x |
AddedInterface |
Add eth0 [10.134.0.32/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
model-chainer-77968cf4b8-6522x |
Created |
Created container: model-chainer | |
kserve-ci-e2e-test |
kubelet |
model-chainer-77968cf4b8-6522x |
Started |
Started container model-chainer | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-99283-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-99283-predictor-5b9fd86cdf from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-99283-predictor-75c5d8c576-2d7bl |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-99283 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-99283": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-99283": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-99283 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-99283": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-74d68d6bdc-vzbzj |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-99283-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-99283-predictor-75c5d8c576 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-99283-predictor-5b9fd86cdf-j7k6b |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1412" already present on machine | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-d76b874f9-v922p |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-99283-predictor-5b9fd86cdf-j7k6b |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-784cb989b8-x9n2v |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
multus |
error-404-isvc-99283-predictor-75c5d8c576-2d7bl |
AddedInterface |
Add eth0 [10.132.0.35/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
model-chainer-77968cf4b8-6522x |
Killing |
Stopping container model-chainer | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-99283-predictor-5b9fd86cdf-j7k6b |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-99283-predictor-75c5d8c576-2d7bl |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1412" already present on machine | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-99283-predictor-5b9fd86cdf |
SuccessfulCreate |
Created pod: success-200-isvc-99283-predictor-5b9fd86cdf-j7k6b | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-99283-predictor-75c5d8c576 |
SuccessfulCreate |
Created pod: error-404-isvc-99283-predictor-75c5d8c576-2d7bl | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-99283-predictor-75c5d8c576-2d7bl |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
multus |
success-200-isvc-99283-predictor-5b9fd86cdf-j7k6b |
AddedInterface |
Add eth0 [10.132.0.34/23] from ovn-kubernetes | |
| (x9) | kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-74d68d6bdc-vzbzj |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.30:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-3d0d2-predictor-78c799bd44-wt5c2 |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.33:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-3d0d2-predictor-7967c5b545-lq669 |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.32:8080: connect: connection refused |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-3d0d2-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-3d0d2-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-3d0d2 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-3d0d2 |
InferenceServiceReady |
InferenceService [success-200-isvc-3d0d2] is Ready | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-3d0d2 |
InferenceServiceReady |
InferenceService [error-404-isvc-3d0d2] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-3d0d2 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x6) | kserve-ci-e2e-test |
kubelet |
model-chainer-77968cf4b8-6522x |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-99283-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-99283-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-99283-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-99283-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-3d0d2 |
InferenceGraphReady |
InferenceGraph [switch-graph-3d0d2] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
switch-graph-3d0d2 |
ScalingReplicaSet |
Scaled up replica set switch-graph-3d0d2-5f445cd894 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
switch-graph-3d0d2-5f445cd894 |
SuccessfulCreate |
Created pod: switch-graph-3d0d2-5f445cd894-whsfp | |
kserve-ci-e2e-test |
kubelet |
switch-graph-3d0d2-5f445cd894-whsfp |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:6060da2148ba78c06d6de96222351f1e5f7d3ada4027ac02142aa0e1928e4f29" already present on machine | |
kserve-ci-e2e-test |
kubelet |
switch-graph-3d0d2-5f445cd894-whsfp |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "switch-graph-3d0d2-serving-cert" not found | |
kserve-ci-e2e-test |
multus |
switch-graph-3d0d2-5f445cd894-whsfp |
AddedInterface |
Add eth0 [10.134.0.33/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
switch-graph-3d0d2-5f445cd894-whsfp |
Started |
Started container switch-graph-3d0d2 | |
kserve-ci-e2e-test |
kubelet |
switch-graph-3d0d2-5f445cd894-whsfp |
Created |
Created container: switch-graph-3d0d2 | |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-3d0d2-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-3d0d2-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-99283-predictor-75c5d8c576-2d7bl |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.35:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-99283-predictor-5b9fd86cdf-j7k6b |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.34:8080: connect: connection refused |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-3d0d2 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-3d0d2 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x7) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-99283 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-99283 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-99283 |
InferenceServiceReady |
InferenceService [success-200-isvc-99283] is Ready | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-99283 |
InferenceServiceReady |
InferenceService [error-404-isvc-99283] is Ready | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-99283-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-99283-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-3d0d2 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-3d0d2 |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-3d0d2-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-3d0d2-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
replicaset-controller |
sequence-graph-99283-794d7b9b66 |
SuccessfulCreate |
Created pod: sequence-graph-99283-794d7b9b66-gv4p9 | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-99283-794d7b9b66-gv4p9 |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "sequence-graph-99283-serving-cert" not found | |
kserve-ci-e2e-test |
deployment-controller |
sequence-graph-99283 |
ScalingReplicaSet |
Scaled up replica set sequence-graph-99283-794d7b9b66 from 0 to 1 | |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-99283 |
InferenceGraphReady |
InferenceGraph [sequence-graph-99283] is Ready | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-99283-794d7b9b66-gv4p9 |
Started |
Started container sequence-graph-99283 | |
kserve-ci-e2e-test |
multus |
sequence-graph-99283-794d7b9b66-gv4p9 |
AddedInterface |
Add eth0 [10.134.0.34/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-99283-794d7b9b66-gv4p9 |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:6060da2148ba78c06d6de96222351f1e5f7d3ada4027ac02142aa0e1928e4f29" already present on machine | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-99283-794d7b9b66-gv4p9 |
Created |
Created container: sequence-graph-99283 | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-99283-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-99283-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-99283 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-99283 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
switch-graph-3d0d2-5f445cd894-whsfp |
Killing |
Stopping container switch-graph-3d0d2 | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-de58a |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-de58a": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-3d0d2-predictor-7967c5b545-lq669 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-de58a |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-de58a": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-de58a": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-de58a-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-de58a-predictor-56d6b9bf76 from 0 to 1 | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-de58a |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-de58a": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-de58a": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-de58a |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-de58a": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-de58a-predictor-5959f57c5c |
SuccessfulCreate |
Created pod: success-200-isvc-de58a-predictor-5959f57c5c-pfhmx | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-de58a-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-de58a-predictor-5959f57c5c from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-de58a-predictor-56d6b9bf76 |
SuccessfulCreate |
Created pod: error-404-isvc-de58a-predictor-56d6b9bf76-pws6k | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-3d0d2-predictor-78c799bd44-wt5c2 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-de58a-predictor-5959f57c5c-pfhmx |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1412" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-de58a-predictor-5959f57c5c-pfhmx |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
multus |
success-200-isvc-de58a-predictor-5959f57c5c-pfhmx |
AddedInterface |
Add eth0 [10.132.0.36/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
multus |
error-404-isvc-de58a-predictor-56d6b9bf76-pws6k |
AddedInterface |
Add eth0 [10.132.0.37/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-de58a-predictor-56d6b9bf76-pws6k |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1412" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-de58a-predictor-56d6b9bf76-pws6k |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-de58a-predictor-56d6b9bf76-pws6k |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-de58a-predictor-5959f57c5c-pfhmx |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-de58a-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-de58a-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x6) | kserve-ci-e2e-test |
kubelet |
switch-graph-3d0d2-5f445cd894-whsfp |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-de58a-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-de58a-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
multus |
success-200-isvc-6b9e1-predictor-77fcc484d9-s29lr |
AddedInterface |
Add eth0 [10.132.0.38/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-99283-predictor-75c5d8c576-2d7bl |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-6b9e1-predictor-77fcc484d9-s29lr |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-6b9e1-predictor-d9f68c7f6-rhbb2 |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1412" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-6b9e1-predictor-d9f68c7f6-rhbb2 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-6b9e1-predictor-d9f68c7f6-rhbb2 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-6b9e1-predictor-77fcc484d9 |
SuccessfulCreate |
Created pod: success-200-isvc-6b9e1-predictor-77fcc484d9-s29lr | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-6b9e1-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-6b9e1-predictor-77fcc484d9 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-99283-predictor-5b9fd86cdf-j7k6b |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-6b9e1-predictor-77fcc484d9-s29lr |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-99283-794d7b9b66-gv4p9 |
Killing |
Stopping container sequence-graph-99283 | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-6b9e1 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-6b9e1": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-6b9e1 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-6b9e1": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-6b9e1": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-6b9e1-predictor-77fcc484d9-s29lr |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1412" already present on machine | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-6b9e1-predictor-d9f68c7f6 |
SuccessfulCreate |
Created pod: error-404-isvc-6b9e1-predictor-d9f68c7f6-rhbb2 | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-6b9e1-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-6b9e1-predictor-d9f68c7f6 from 0 to 1 | |
kserve-ci-e2e-test |
multus |
error-404-isvc-6b9e1-predictor-d9f68c7f6-rhbb2 |
AddedInterface |
Add eth0 [10.132.0.39/23] from ovn-kubernetes | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-de58a |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-de58a |
InferenceServiceReady |
InferenceService [success-200-isvc-de58a] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-de58a |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-de58a |
InferenceServiceReady |
InferenceService [error-404-isvc-de58a] is Ready | |
| (x6) | kserve-ci-e2e-test |
kubelet |
sequence-graph-99283-794d7b9b66-gv4p9 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
replicaset-controller |
ensemble-graph-de58a-7d7f775b78 |
SuccessfulCreate |
Created pod: ensemble-graph-de58a-7d7f775b78-25zfk | |
kserve-ci-e2e-test |
deployment-controller |
ensemble-graph-de58a |
ScalingReplicaSet |
Scaled up replica set ensemble-graph-de58a-7d7f775b78 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-de58a-7d7f775b78-25zfk |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "ensemble-graph-de58a-serving-cert" not found | |
kserve-ci-e2e-test |
InferenceGraphController |
ensemble-graph-de58a |
InferenceGraphReady |
InferenceGraph [ensemble-graph-de58a] is Ready | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-de58a-7d7f775b78-25zfk |
Created |
Created container: ensemble-graph-de58a | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-de58a-7d7f775b78-25zfk |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:6060da2148ba78c06d6de96222351f1e5f7d3ada4027ac02142aa0e1928e4f29" already present on machine | |
kserve-ci-e2e-test |
multus |
ensemble-graph-de58a-7d7f775b78-25zfk |
AddedInterface |
Add eth0 [10.134.0.35/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-de58a-7d7f775b78-25zfk |
Started |
Started container ensemble-graph-de58a | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-de58a-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-de58a-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-de58a-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-de58a-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-12b34-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-12b34-predictor-954f5b995 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-12b34-predictor-558d6f8bf8-mzwqn |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-de58a-7d7f775b78-25zfk |
Killing |
Stopping container ensemble-graph-de58a | |
kserve-ci-e2e-test |
multus |
success-200-isvc-12b34-predictor-954f5b995-lqhrg |
AddedInterface |
Add eth0 [10.132.0.40/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-12b34 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-12b34": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-12b34": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-12b34 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-12b34": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-12b34-predictor-954f5b995-lqhrg |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1412" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-12b34-predictor-954f5b995-lqhrg |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-12b34-predictor-954f5b995-lqhrg |
Started |
Started container kserve-container | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-6b9e1-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-6b9e1-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-6b9e1-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-de58a-predictor-5959f57c5c-pfhmx |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-de58a-predictor-56d6b9bf76-pws6k |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
multus |
error-404-isvc-12b34-predictor-558d6f8bf8-mzwqn |
AddedInterface |
Add eth0 [10.132.0.41/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-12b34-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-12b34-predictor-558d6f8bf8 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-12b34-predictor-954f5b995 |
SuccessfulCreate |
Created pod: success-200-isvc-12b34-predictor-954f5b995-lqhrg | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-12b34-predictor-558d6f8bf8-mzwqn |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1412" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-12b34-predictor-558d6f8bf8-mzwqn |
Created |
Created container: kserve-container | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-6b9e1-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-12b34-predictor-558d6f8bf8 |
SuccessfulCreate |
Created pod: error-404-isvc-12b34-predictor-558d6f8bf8-mzwqn | |
| (x7) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-de58a-predictor-56d6b9bf76-pws6k |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.37:8080: connect: connection refused |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-de58a-predictor-5959f57c5c-pfhmx |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.36:8080: connect: connection refused |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-6b9e1 |
InferenceServiceReady |
InferenceService [error-404-isvc-6b9e1] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-6b9e1 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-6b9e1 |
InferenceServiceReady |
InferenceService [success-200-isvc-6b9e1] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-6b9e1 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-12b34-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-12b34-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-12b34-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-12b34-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-6b9e1 |
InternalError |
fails to update InferenceGraph status: Operation cannot be fulfilled on inferencegraphs.serving.kserve.io "sequence-graph-6b9e1": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-6b9e1 |
UpdateFailed |
Failed to update status for InferenceGraph "sequence-graph-6b9e1": Operation cannot be fulfilled on inferencegraphs.serving.kserve.io "sequence-graph-6b9e1": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
replicaset-controller |
sequence-graph-6b9e1-58b69f49c8 |
SuccessfulCreate |
Created pod: sequence-graph-6b9e1-58b69f49c8-6r5th | |
kserve-ci-e2e-test |
deployment-controller |
sequence-graph-6b9e1 |
ScalingReplicaSet |
Scaled up replica set sequence-graph-6b9e1-58b69f49c8 from 0 to 1 | |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-6b9e1 |
InferenceGraphReady |
InferenceGraph [sequence-graph-6b9e1] is Ready | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-6b9e1-58b69f49c8-6r5th |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "sequence-graph-6b9e1-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-6b9e1-58b69f49c8-6r5th |
Started |
Started container sequence-graph-6b9e1 | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-6b9e1-58b69f49c8-6r5th |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:6060da2148ba78c06d6de96222351f1e5f7d3ada4027ac02142aa0e1928e4f29" already present on machine | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-6b9e1-58b69f49c8-6r5th |
Created |
Created container: sequence-graph-6b9e1 | |
kserve-ci-e2e-test |
multus |
sequence-graph-6b9e1-58b69f49c8-6r5th |
AddedInterface |
Add eth0 [10.134.0.36/23] from ovn-kubernetes | |
| (x6) | kserve-ci-e2e-test |
kubelet |
ensemble-graph-de58a-7d7f775b78-25zfk |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-6b9e1-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-6b9e1-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-6b9e1-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-6b9e1-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-1f9ad-predictor-6f68d9c676 |
SuccessfulCreate |
Created pod: error-404-isvc-1f9ad-predictor-6f68d9c676-2l6lt | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-1f9ad-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-1f9ad-predictor-84d585c7c from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-6b9e1-predictor-d9f68c7f6-rhbb2 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-1f9ad |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-1f9ad": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-1f9ad |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-1f9ad": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-1f9ad": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-1f9ad-predictor-84d585c7c |
SuccessfulCreate |
Created pod: success-200-isvc-1f9ad-predictor-84d585c7c-4pvwn | |
kserve-ci-e2e-test |
multus |
success-200-isvc-1f9ad-predictor-84d585c7c-4pvwn |
AddedInterface |
Add eth0 [10.132.0.42/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-6b9e1-58b69f49c8-6r5th |
Killing |
Stopping container sequence-graph-6b9e1 | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-1f9ad |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-1f9ad": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-1f9ad |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-1f9ad": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-1f9ad": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-6b9e1-predictor-77fcc484d9-s29lr |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-1f9ad-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-1f9ad-predictor-6f68d9c676 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-1f9ad-predictor-6f68d9c676-2l6lt |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1412" already present on machine | |
kserve-ci-e2e-test |
multus |
error-404-isvc-1f9ad-predictor-6f68d9c676-2l6lt |
AddedInterface |
Add eth0 [10.132.0.43/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-1f9ad-predictor-6f68d9c676-2l6lt |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-1f9ad-predictor-84d585c7c-4pvwn |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1412" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-1f9ad-predictor-6f68d9c676-2l6lt |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-1f9ad-predictor-84d585c7c-4pvwn |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-1f9ad-predictor-84d585c7c-4pvwn |
Started |
Started container kserve-container | |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-6b9e1-predictor-77fcc484d9-s29lr |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.38:8080: connect: connection refused |
| (x7) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-6b9e1-predictor-d9f68c7f6-rhbb2 |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.39:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-12b34-predictor-558d6f8bf8-mzwqn |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.41:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-12b34-predictor-954f5b995-lqhrg |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.40:8080: connect: connection refused |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-12b34 |
InferenceServiceReady |
InferenceService [error-404-isvc-12b34] is Ready | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-12b34 |
InferenceServiceReady |
InferenceService [success-200-isvc-12b34] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-12b34 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-12b34 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x6) | kserve-ci-e2e-test |
kubelet |
sequence-graph-6b9e1-58b69f49c8-6r5th |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-1f9ad-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-1f9ad-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-1f9ad-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-1f9ad-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
multus |
ensemble-graph-12b34-9c57c45ff-5kq92 |
AddedInterface |
Add eth0 [10.134.0.37/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-12b34-9c57c45ff-5kq92 |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:6060da2148ba78c06d6de96222351f1e5f7d3ada4027ac02142aa0e1928e4f29" already present on machine | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-12b34-9c57c45ff-5kq92 |
Created |
Created container: ensemble-graph-12b34 | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-12b34-9c57c45ff-5kq92 |
Started |
Started container ensemble-graph-12b34 | |
kserve-ci-e2e-test |
replicaset-controller |
ensemble-graph-12b34-9c57c45ff |
SuccessfulCreate |
Created pod: ensemble-graph-12b34-9c57c45ff-5kq92 | |
kserve-ci-e2e-test |
InferenceGraphController |
ensemble-graph-12b34 |
InferenceGraphReady |
InferenceGraph [ensemble-graph-12b34] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
ensemble-graph-12b34 |
ScalingReplicaSet |
Scaled up replica set ensemble-graph-12b34-9c57c45ff from 0 to 1 | |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-1f9ad-predictor-6f68d9c676-2l6lt |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.43:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-1f9ad-predictor-84d585c7c-4pvwn |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.42:8080: connect: connection refused |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-1f9ad |
InferenceServiceReady |
InferenceService [success-200-isvc-1f9ad] is Ready | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-1f9ad |
InferenceServiceReady |
InferenceService [error-404-isvc-1f9ad] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-1f9ad |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-1f9ad |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-12b34-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-12b34-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-12b34-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-12b34-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-1f9ad-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-1f9ad-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
ensemble-graph-12b34 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
ensemble-graph-12b34 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
deployment-controller |
sequence-graph-1f9ad |
ScalingReplicaSet |
Scaled up replica set sequence-graph-1f9ad-5789fb8557 from 0 to 1 | |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-1f9ad |
InferenceGraphReady |
InferenceGraph [sequence-graph-1f9ad] is Ready | |
kserve-ci-e2e-test |
replicaset-controller |
sequence-graph-1f9ad-5789fb8557 |
SuccessfulCreate |
Created pod: sequence-graph-1f9ad-5789fb8557-kcq6v | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-1f9ad-5789fb8557-kcq6v |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "sequence-graph-1f9ad-serving-cert" not found | |
kserve-ci-e2e-test |
multus |
sequence-graph-1f9ad-5789fb8557-kcq6v |
AddedInterface |
Add eth0 [10.134.0.38/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-1f9ad-5789fb8557-kcq6v |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:6060da2148ba78c06d6de96222351f1e5f7d3ada4027ac02142aa0e1928e4f29" already present on machine | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-1f9ad-5789fb8557-kcq6v |
Created |
Created container: sequence-graph-1f9ad | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-1f9ad-5789fb8557-kcq6v |
Started |
Started container sequence-graph-1f9ad | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-1f9ad-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-1f9ad-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-1f9ad |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-1f9ad |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-12b34-9c57c45ff-5kq92 |
Killing |
Stopping container ensemble-graph-12b34 | |
kserve-ci-e2e-test |
multus |
error-404-isvc-e8b6e-predictor-64c44c8fcd-kllhr |
AddedInterface |
Add eth0 [10.132.0.45/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-e8b6e-predictor-64c44c8fcd-kllhr |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-12b34-predictor-954f5b995-lqhrg |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-e8b6e |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-e8b6e": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-e8b6e |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-e8b6e": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-e8b6e": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-e8b6e-predictor-66bb45779f-wmmzb |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-12b34-predictor-558d6f8bf8-mzwqn |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-e8b6e |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-e8b6e": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
multus |
success-200-isvc-e8b6e-predictor-66bb45779f-wmmzb |
AddedInterface |
Add eth0 [10.132.0.44/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-e8b6e-predictor-66bb45779f-wmmzb |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1412" already present on machine | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-e8b6e |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-e8b6e": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-e8b6e": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-e8b6e-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-e8b6e-predictor-64c44c8fcd from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-e8b6e-predictor-64c44c8fcd |
SuccessfulCreate |
Created pod: error-404-isvc-e8b6e-predictor-64c44c8fcd-kllhr | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-e8b6e-predictor-64c44c8fcd-kllhr |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-e8b6e-predictor-66bb45779f-wmmzb |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-e8b6e-predictor-66bb45779f |
SuccessfulCreate |
Created pod: success-200-isvc-e8b6e-predictor-66bb45779f-wmmzb | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-e8b6e-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-e8b6e-predictor-66bb45779f from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-e8b6e-predictor-64c44c8fcd-kllhr |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1412" already present on machine | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-e8b6e-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-e8b6e-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-e8b6e-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-e8b6e-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x6) | kserve-ci-e2e-test |
kubelet |
ensemble-graph-12b34-9c57c45ff-5kq92 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-653df-predictor-7db8685f5 |
SuccessfulCreate |
Created pod: success-200-isvc-653df-predictor-7db8685f5-75qnk | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-653df |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-653df": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-653df": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-653df |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-653df": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-653df-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-653df-predictor-7db8685f5 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-653df-predictor-fd849f8f8 |
SuccessfulCreate |
Created pod: error-404-isvc-653df-predictor-fd849f8f8-w5j6t | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-1f9ad-predictor-84d585c7c-4pvwn |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-1f9ad-5789fb8557-kcq6v |
Killing |
Stopping container sequence-graph-1f9ad | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-1f9ad-predictor-6f68d9c676-2l6lt |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-653df |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-653df": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-653df-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-653df-predictor-fd849f8f8 from 0 to 1 | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-653df |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-653df": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-653df": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-653df-predictor-7db8685f5-75qnk |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1412" already present on machine | |
kserve-ci-e2e-test |
multus |
success-200-isvc-653df-predictor-7db8685f5-75qnk |
AddedInterface |
Add eth0 [10.132.0.46/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
multus |
error-404-isvc-653df-predictor-fd849f8f8-w5j6t |
AddedInterface |
Add eth0 [10.132.0.47/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-653df-predictor-fd849f8f8-w5j6t |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-653df-predictor-7db8685f5-75qnk |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-653df-predictor-7db8685f5-75qnk |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-653df-predictor-fd849f8f8-w5j6t |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1412" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-653df-predictor-fd849f8f8-w5j6t |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-e8b6e |
InferenceServiceReady |
InferenceService [error-404-isvc-e8b6e] is Ready | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-e8b6e |
InferenceServiceReady |
InferenceService [success-200-isvc-e8b6e] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-e8b6e |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-e8b6e |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x6) | kserve-ci-e2e-test |
kubelet |
sequence-graph-1f9ad-5789fb8557-kcq6v |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
InferenceGraphController |
splitter-graph-e8b6e |
UpdateFailed |
Failed to update status for InferenceGraph "splitter-graph-e8b6e": Operation cannot be fulfilled on inferencegraphs.serving.kserve.io "splitter-graph-e8b6e": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
deployment-controller |
splitter-graph-e8b6e |
ScalingReplicaSet |
Scaled up replica set splitter-graph-e8b6e-5f9c98cc85 from 0 to 1 | |
kserve-ci-e2e-test |
InferenceGraphController |
splitter-graph-e8b6e |
InternalError |
fails to update InferenceGraph status: Operation cannot be fulfilled on inferencegraphs.serving.kserve.io "splitter-graph-e8b6e": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-e8b6e-5f9c98cc85-w42z2 |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "splitter-graph-e8b6e-serving-cert" not found | |
kserve-ci-e2e-test |
InferenceGraphController |
splitter-graph-e8b6e |
InferenceGraphReady |
InferenceGraph [splitter-graph-e8b6e] is Ready | |
kserve-ci-e2e-test |
replicaset-controller |
splitter-graph-e8b6e-5f9c98cc85 |
SuccessfulCreate |
Created pod: splitter-graph-e8b6e-5f9c98cc85-w42z2 | |
kserve-ci-e2e-test |
multus |
splitter-graph-e8b6e-5f9c98cc85-w42z2 |
AddedInterface |
Add eth0 [10.134.0.39/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-e8b6e-5f9c98cc85-w42z2 |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:6060da2148ba78c06d6de96222351f1e5f7d3ada4027ac02142aa0e1928e4f29" already present on machine | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-e8b6e-5f9c98cc85-w42z2 |
Created |
Created container: splitter-graph-e8b6e | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-e8b6e-5f9c98cc85-w42z2 |
Started |
Started container splitter-graph-e8b6e | |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-e8b6e-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-e8b6e-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-e8b6e-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-e8b6e-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
multus |
error-404-isvc-9a649-predictor-779bcbc86d-k8kff |
AddedInterface |
Add eth0 [10.132.0.49/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-9a649-predictor-b857f97b5-fnrvk |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1412" already present on machine | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-9a649-predictor-779bcbc86d |
SuccessfulCreate |
Created pod: error-404-isvc-9a649-predictor-779bcbc86d-k8kff | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-653df-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-653df-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-9a649-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-9a649-predictor-b857f97b5 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-e8b6e-predictor-64c44c8fcd-kllhr |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-9a649-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-9a649-predictor-779bcbc86d from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-9a649-predictor-b857f97b5 |
SuccessfulCreate |
Created pod: success-200-isvc-9a649-predictor-b857f97b5-fnrvk | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-9a649-predictor-b857f97b5-fnrvk |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-9a649-predictor-b857f97b5-fnrvk |
Created |
Created container: kserve-container | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-653df-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
splitter-graph-e8b6e-5f9c98cc85-w42z2 |
Killing |
Stopping container splitter-graph-e8b6e | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-9a649 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-9a649": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-9a649 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-9a649": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-9a649": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-9a649-predictor-779bcbc86d-k8kff |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1412" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-9a649-predictor-779bcbc86d-k8kff |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-9a649-predictor-779bcbc86d-k8kff |
Started |
Started container kserve-container | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-653df-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-e8b6e-predictor-66bb45779f-wmmzb |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
multus |
success-200-isvc-9a649-predictor-b857f97b5-fnrvk |
AddedInterface |
Add eth0 [10.132.0.48/23] from ovn-kubernetes | |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-e8b6e-predictor-66bb45779f-wmmzb |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.44:8080: connect: connection refused |
| (x7) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-e8b6e-predictor-64c44c8fcd-kllhr |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.45:8080: connect: connection refused |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-653df |
InferenceServiceReady |
InferenceService [success-200-isvc-653df] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-653df |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-653df |
InferenceServiceReady |
InferenceService [error-404-isvc-653df] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-653df |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-9a649-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-9a649-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-653df |
InferenceGraphReady |
InferenceGraph [switch-graph-653df] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
switch-graph-653df |
ScalingReplicaSet |
Scaled up replica set switch-graph-653df-fd48d9cd8 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
switch-graph-653df-fd48d9cd8 |
SuccessfulCreate |
Created pod: switch-graph-653df-fd48d9cd8-p5dbm | |
kserve-ci-e2e-test |
kubelet |
switch-graph-653df-fd48d9cd8-p5dbm |
Started |
Started container switch-graph-653df | |
kserve-ci-e2e-test |
kubelet |
switch-graph-653df-fd48d9cd8-p5dbm |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "switch-graph-653df-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
switch-graph-653df-fd48d9cd8-p5dbm |
Created |
Created container: switch-graph-653df | |
kserve-ci-e2e-test |
multus |
switch-graph-653df-fd48d9cd8-p5dbm |
AddedInterface |
Add eth0 [10.134.0.40/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
switch-graph-653df-fd48d9cd8-p5dbm |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:6060da2148ba78c06d6de96222351f1e5f7d3ada4027ac02142aa0e1928e4f29" already present on machine | |
| (x6) | kserve-ci-e2e-test |
kubelet |
splitter-graph-e8b6e-5f9c98cc85-w42z2 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-9a649-predictor-779bcbc86d-k8kff |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.49:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-9a649-predictor-b857f97b5-fnrvk |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.48:8080: connect: connection refused |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-9a649-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-9a649-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-653df-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-653df-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-653df-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-653df-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-9a649 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-9a649 |
InferenceServiceReady |
InferenceService [success-200-isvc-9a649] is Ready | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-9a649 |
InferenceServiceReady |
InferenceService [error-404-isvc-9a649] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-9a649 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-653df |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-653df |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
splitter-graph-9a649-6c6f5d7c86-mqbhj |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "splitter-graph-9a649-serving-cert" not found | |
kserve-ci-e2e-test |
InferenceGraphController |
splitter-graph-9a649 |
InferenceGraphReady |
InferenceGraph [splitter-graph-9a649] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
splitter-graph-9a649 |
ScalingReplicaSet |
Scaled up replica set splitter-graph-9a649-6c6f5d7c86 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
splitter-graph-9a649-6c6f5d7c86 |
SuccessfulCreate |
Created pod: splitter-graph-9a649-6c6f5d7c86-mqbhj | |
kserve-ci-e2e-test |
multus |
splitter-graph-9a649-6c6f5d7c86-mqbhj |
AddedInterface |
Add eth0 [10.134.0.41/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-9a649-6c6f5d7c86-mqbhj |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:6060da2148ba78c06d6de96222351f1e5f7d3ada4027ac02142aa0e1928e4f29" already present on machine | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-9a649-6c6f5d7c86-mqbhj |
Created |
Created container: splitter-graph-9a649 | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-9a649-6c6f5d7c86-mqbhj |
Started |
Started container splitter-graph-9a649 | |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-9a649-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-9a649-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-9a649-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-9a649-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
splitter-graph-9a649 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
splitter-graph-9a649 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-9a649-predictor-b857f97b5-fnrvk |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-9a649-predictor-779bcbc86d-k8kff |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-9a649-6c6f5d7c86-mqbhj |
Killing |
Stopping container splitter-graph-9a649 | |
| (x6) | kserve-ci-e2e-test |
kubelet |
splitter-graph-9a649-6c6f5d7c86-mqbhj |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-653df-predictor-fd849f8f8-w5j6t |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
switch-graph-653df-fd48d9cd8-p5dbm |
Killing |
Stopping container switch-graph-653df | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-653df-predictor-7db8685f5-75qnk |
Killing |
Stopping container kserve-container | |
| (x7) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-653df-predictor-fd849f8f8-w5j6t |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.47:8080: connect: connection refused |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-653df-predictor-7db8685f5-75qnk |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.46:8080: connect: connection refused |
| (x4) | kserve-ci-e2e-test |
kubelet |
switch-graph-653df-fd48d9cd8-p5dbm |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |