| Time | Namespace | Component | RelatedObject | Reason | Message |
|---|---|---|---|---|---|
kserve-ci-e2e-test |
success-200-isvc-b65bd-predictor-7b84f8cc4-bgvmc |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-b65bd-predictor-7b84f8cc4-bgvmc to ip-10-0-130-195.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-a940c-predictor-55498679d6-p4w6n |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-a940c-predictor-55498679d6-p4w6n to ip-10-0-130-195.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-009d9-predictor-8d574d484-c7787 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-009d9-predictor-8d574d484-c7787 to ip-10-0-130-195.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-3604c-predictor-67675654b4-qjrd2 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-3604c-predictor-67675654b4-qjrd2 to ip-10-0-130-195.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-3ca33-predictor-b9fdb764c-sr859 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-3ca33-predictor-b9fdb764c-sr859 to ip-10-0-130-195.ec2.internal | ||
kserve-ci-e2e-test |
isvc-xgboost-graph-predictor-784cb989b8-4xk55 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/isvc-xgboost-graph-predictor-784cb989b8-4xk55 to ip-10-0-128-129.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-a940c-predictor-cdc8fbb67-qhs6x |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-a940c-predictor-cdc8fbb67-qhs6x to ip-10-0-130-195.ec2.internal | ||
kserve-ci-e2e-test |
isvc-sklearn-graph-2-predictor-bcbc7cdf4-rp228 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-bcbc7cdf4-rp228 to ip-10-0-128-129.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-a84b0-predictor-6b596fcd54-8mjt4 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-a84b0-predictor-6b596fcd54-8mjt4 to ip-10-0-130-195.ec2.internal | ||
kserve-ci-e2e-test |
splitter-graph-a940c-74c5f5f874-5gw2z |
Scheduled |
Successfully assigned kserve-ci-e2e-test/splitter-graph-a940c-74c5f5f874-5gw2z to ip-10-0-128-129.ec2.internal | ||
kserve-ci-e2e-test |
sequence-graph-009d9-764c944467-bghlk |
Scheduled |
Successfully assigned kserve-ci-e2e-test/sequence-graph-009d9-764c944467-bghlk to ip-10-0-128-129.ec2.internal | ||
kserve-ci-e2e-test |
switch-graph-3ca33-66cd5cfb9d-fmlpr |
Scheduled |
Successfully assigned kserve-ci-e2e-test/switch-graph-3ca33-66cd5cfb9d-fmlpr to ip-10-0-128-129.ec2.internal | ||
kserve-ci-e2e-test |
switch-graph-7cd29-bcdbb89fd-mxb6d |
Scheduled |
Successfully assigned kserve-ci-e2e-test/switch-graph-7cd29-bcdbb89fd-mxb6d to ip-10-0-128-129.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-305b2-predictor-58965b9845-7m8b7 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-305b2-predictor-58965b9845-7m8b7 to ip-10-0-130-195.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-a84b0-predictor-57c69c6bf5-2xkft |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-a84b0-predictor-57c69c6bf5-2xkft to ip-10-0-130-195.ec2.internal | ||
kserve-ci-e2e-test |
sequence-graph-3604c-5c94498546-6xnhc |
Scheduled |
Successfully assigned kserve-ci-e2e-test/sequence-graph-3604c-5c94498546-6xnhc to ip-10-0-128-129.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-0b236-predictor-66b864b-6dsgd |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-0b236-predictor-66b864b-6dsgd to ip-10-0-130-195.ec2.internal | ||
kserve-ci-e2e-test |
splitter-graph-0b236-856d54479f-8q95m |
Scheduled |
Successfully assigned kserve-ci-e2e-test/splitter-graph-0b236-856d54479f-8q95m to ip-10-0-128-129.ec2.internal | ||
kserve-ci-e2e-test |
ensemble-graph-911ed-78995f655-sjdp4 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/ensemble-graph-911ed-78995f655-sjdp4 to ip-10-0-128-129.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-3604c-predictor-6c9f6657bf-j9tfm |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-3604c-predictor-6c9f6657bf-j9tfm to ip-10-0-130-195.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-7cd29-predictor-d9cbb6df9-mssdw |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-7cd29-predictor-d9cbb6df9-mssdw to ip-10-0-130-195.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-305b2-predictor-7466c57bb4-tjdwn |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-305b2-predictor-7466c57bb4-tjdwn to ip-10-0-130-195.ec2.internal | ||
kserve-ci-e2e-test |
switch-graph-b65bd-66566fb599-49wh4 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/switch-graph-b65bd-66566fb599-49wh4 to ip-10-0-128-129.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-0b236-predictor-5d4f9447b7-gs8zd |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-0b236-predictor-5d4f9447b7-gs8zd to ip-10-0-130-195.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-009d9-predictor-5497b97b89-5m5l7 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-009d9-predictor-5497b97b89-5m5l7 to ip-10-0-130-195.ec2.internal | ||
kserve-ci-e2e-test |
isvc-sklearn-graph-1-predictor-6fd8964888-gkf4k |
Scheduled |
Successfully assigned kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6fd8964888-gkf4k to ip-10-0-128-129.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-911ed-predictor-577cc5dbbf-bmwdx |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-911ed-predictor-577cc5dbbf-bmwdx to ip-10-0-130-195.ec2.internal | ||
kserve-ci-e2e-test |
ensemble-graph-305b2-7c6bf4cb48-2gft4 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/ensemble-graph-305b2-7c6bf4cb48-2gft4 to ip-10-0-128-129.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-911ed-predictor-7885d56788-nnsbr |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-911ed-predictor-7885d56788-nnsbr to ip-10-0-130-195.ec2.internal | ||
kserve-ci-e2e-test |
sequence-graph-a84b0-6cc45b7f74-r64lg |
Scheduled |
Successfully assigned kserve-ci-e2e-test/sequence-graph-a84b0-6cc45b7f74-r64lg to ip-10-0-128-129.ec2.internal | ||
kserve-ci-e2e-test |
model-chainer-54c98cd4d8-cnq9q |
Scheduled |
Successfully assigned kserve-ci-e2e-test/model-chainer-54c98cd4d8-cnq9q to ip-10-0-128-129.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-3ca33-predictor-866bdfdb6-gds85 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-3ca33-predictor-866bdfdb6-gds85 to ip-10-0-130-195.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-7cd29-predictor-bc98c47fd-bdwpp |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-7cd29-predictor-bc98c47fd-bdwpp to ip-10-0-130-195.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-b65bd-predictor-75967c8fc9-kkvkc |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-b65bd-predictor-75967c8fc9-kkvkc to ip-10-0-130-195.ec2.internal | ||
kserve-ci-e2e-test |
kubelet |
success-200-isvc-b65bd-predictor-7b84f8cc4-bgvmc |
Pulling |
Pulling image "quay.io/opendatahub/success-200-isvc:odh-pr-1424" | |
kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-1 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "isvc-sklearn-graph-1": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
multus |
error-404-isvc-b65bd-predictor-75967c8fc9-kkvkc |
AddedInterface |
Add eth0 [10.132.0.33/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
replicaset-controller |
isvc-xgboost-graph-predictor-784cb989b8 |
SuccessfulCreate |
Created pod: isvc-xgboost-graph-predictor-784cb989b8-4xk55 | |
kserve-ci-e2e-test |
deployment-controller |
isvc-xgboost-graph-predictor |
ScalingReplicaSet |
Scaled up replica set isvc-xgboost-graph-predictor-784cb989b8 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-b65bd-predictor-75967c8fc9 |
SuccessfulCreate |
Created pod: error-404-isvc-b65bd-predictor-75967c8fc9-kkvkc | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-b65bd-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-b65bd-predictor-75967c8fc9 from 0 to 1 | |
kserve-ci-e2e-test |
multus |
isvc-sklearn-graph-1-predictor-6fd8964888-gkf4k |
AddedInterface |
Add eth0 [10.134.0.22/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-b65bd-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-b65bd-predictor-7b84f8cc4 from 0 to 1 | |
kserve-ci-e2e-test |
multus |
success-200-isvc-b65bd-predictor-7b84f8cc4-bgvmc |
AddedInterface |
Add eth0 [10.132.0.32/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-b65bd-predictor-7b84f8cc4 |
SuccessfulCreate |
Created pod: success-200-isvc-b65bd-predictor-7b84f8cc4-bgvmc | |
kserve-ci-e2e-test |
deployment-controller |
isvc-sklearn-graph-2-predictor |
ScalingReplicaSet |
Scaled up replica set isvc-sklearn-graph-2-predictor-bcbc7cdf4 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
isvc-sklearn-graph-1-predictor-6fd8964888 |
SuccessfulCreate |
Created pod: isvc-sklearn-graph-1-predictor-6fd8964888-gkf4k | |
kserve-ci-e2e-test |
deployment-controller |
isvc-sklearn-graph-1-predictor |
ScalingReplicaSet |
Scaled up replica set isvc-sklearn-graph-1-predictor-6fd8964888 from 0 to 1 | |
kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-1 |
UpdateFailed |
Failed to update status for InferenceService "isvc-sklearn-graph-1": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "isvc-sklearn-graph-1": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
replicaset-controller |
isvc-sklearn-graph-2-predictor-bcbc7cdf4 |
SuccessfulCreate |
Created pod: isvc-sklearn-graph-2-predictor-bcbc7cdf4-rp228 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-b65bd-predictor-75967c8fc9-kkvkc |
Pulling |
Pulling image "quay.io/opendatahub/error-404-isvc:odh-pr-1424" | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-784cb989b8-4xk55 |
Pulling |
Pulling image "quay.io/opendatahub/kserve-storage-initializer@sha256:8eee296dba42148fd03e4b2602ce20b8f3cc18bf537b500919938742ad784fb1" | |
kserve-ci-e2e-test |
multus |
isvc-xgboost-graph-predictor-784cb989b8-4xk55 |
AddedInterface |
Add eth0 [10.134.0.23/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
multus |
isvc-sklearn-graph-2-predictor-bcbc7cdf4-rp228 |
AddedInterface |
Add eth0 [10.134.0.24/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-bcbc7cdf4-rp228 |
Pulling |
Pulling image "quay.io/opendatahub/kserve-storage-initializer@sha256:8eee296dba42148fd03e4b2602ce20b8f3cc18bf537b500919938742ad784fb1" | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-6fd8964888-gkf4k |
Pulling |
Pulling image "quay.io/opendatahub/kserve-storage-initializer@sha256:8eee296dba42148fd03e4b2602ce20b8f3cc18bf537b500919938742ad784fb1" | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-bcbc7cdf4-rp228 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-bcbc7cdf4-rp228 |
Pulled |
Successfully pulled image "quay.io/opendatahub/kserve-storage-initializer@sha256:8eee296dba42148fd03e4b2602ce20b8f3cc18bf537b500919938742ad784fb1" in 4.064s (4.064s including waiting). Image size: 299668405 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-6fd8964888-gkf4k |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-784cb989b8-4xk55 |
Pulled |
Successfully pulled image "quay.io/opendatahub/kserve-storage-initializer@sha256:8eee296dba42148fd03e4b2602ce20b8f3cc18bf537b500919938742ad784fb1" in 4.247s (4.247s including waiting). Image size: 299668405 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-784cb989b8-4xk55 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-784cb989b8-4xk55 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-bcbc7cdf4-rp228 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-6fd8964888-gkf4k |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-6fd8964888-gkf4k |
Pulled |
Successfully pulled image "quay.io/opendatahub/kserve-storage-initializer@sha256:8eee296dba42148fd03e4b2602ce20b8f3cc18bf537b500919938742ad784fb1" in 4.454s (4.454s including waiting). Image size: 299668405 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-bcbc7cdf4-rp228 |
Pulling |
Pulling image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1424" | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-784cb989b8-4xk55 |
Pulling |
Pulling image "kserve/xgbserver:latest" | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-6fd8964888-gkf4k |
Pulling |
Pulling image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1424" | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-b65bd-predictor-7b84f8cc4-bgvmc |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-b65bd-predictor-75967c8fc9-kkvkc |
Pulled |
Successfully pulled image "quay.io/opendatahub/error-404-isvc:odh-pr-1424" in 15.865s (15.865s including waiting). Image size: 1332362859 bytes. | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-b65bd-predictor-75967c8fc9-kkvkc |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-b65bd-predictor-75967c8fc9-kkvkc |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-b65bd-predictor-7b84f8cc4-bgvmc |
Pulled |
Successfully pulled image "quay.io/opendatahub/success-200-isvc:odh-pr-1424" in 15.989s (15.989s including waiting). Image size: 1333970545 bytes. | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-b65bd-predictor-7b84f8cc4-bgvmc |
Started |
Started container kserve-container | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-b65bd-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-b65bd-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-784cb989b8-4xk55 |
Pulled |
Successfully pulled image "kserve/xgbserver:latest" in 26.735s (26.735s including waiting). Image size: 1306229499 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-bcbc7cdf4-rp228 |
Pulled |
Successfully pulled image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1424" in 26.665s (26.665s including waiting). Image size: 1560613808 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-6fd8964888-gkf4k |
Pulled |
Successfully pulled image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1424" in 26.667s (26.667s including waiting). Image size: 1560613808 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-6fd8964888-gkf4k |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-6fd8964888-gkf4k |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-784cb989b8-4xk55 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-784cb989b8-4xk55 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-bcbc7cdf4-rp228 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-bcbc7cdf4-rp228 |
Started |
Started container kserve-container | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-b65bd-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-b65bd-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-b65bd |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-b65bd |
InferenceServiceReady |
InferenceService [success-200-isvc-b65bd] is Ready | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-b65bd |
InferenceServiceReady |
InferenceService [error-404-isvc-b65bd] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-b65bd |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
replicaset-controller |
switch-graph-b65bd-66566fb599 |
SuccessfulCreate |
Created pod: switch-graph-b65bd-66566fb599-49wh4 | |
kserve-ci-e2e-test |
deployment-controller |
switch-graph-b65bd |
ScalingReplicaSet |
Scaled up replica set switch-graph-b65bd-66566fb599 from 0 to 1 | |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-b65bd |
InferenceGraphReady |
InferenceGraph [switch-graph-b65bd] is Ready | |
kserve-ci-e2e-test |
kubelet |
switch-graph-b65bd-66566fb599-49wh4 |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "switch-graph-b65bd-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
switch-graph-b65bd-66566fb599-49wh4 |
Pulling |
Pulling image "quay.io/opendatahub/kserve-router@sha256:24e0d07fc928f25bef5abad5b7d6f0433a913fef03e0557ec5bebf00bc2024ca" | |
kserve-ci-e2e-test |
multus |
switch-graph-b65bd-66566fb599-49wh4 |
AddedInterface |
Add eth0 [10.134.0.25/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
switch-graph-b65bd-66566fb599-49wh4 |
Created |
Created container: switch-graph-b65bd | |
kserve-ci-e2e-test |
kubelet |
switch-graph-b65bd-66566fb599-49wh4 |
Pulled |
Successfully pulled image "quay.io/opendatahub/kserve-router@sha256:24e0d07fc928f25bef5abad5b7d6f0433a913fef03e0557ec5bebf00bc2024ca" in 2.695s (2.695s including waiting). Image size: 216230490 bytes. | |
kserve-ci-e2e-test |
kubelet |
switch-graph-b65bd-66566fb599-49wh4 |
Started |
Started container switch-graph-b65bd | |
| (x7) | kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-bcbc7cdf4-rp228 |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.24:8080: connect: connection refused |
| (x7) | kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-6fd8964888-gkf4k |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.22:8080: connect: connection refused |
| (x7) | kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-784cb989b8-4xk55 |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.23:8080: connect: connection refused |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-b65bd-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-b65bd-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-b65bd-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-b65bd-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-7cd29 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-7cd29": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-b65bd-predictor-7b84f8cc4-bgvmc |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-b65bd-predictor-75967c8fc9-kkvkc |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-7cd29-predictor-d9cbb6df9 |
SuccessfulCreate |
Created pod: error-404-isvc-7cd29-predictor-d9cbb6df9-mssdw | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-7cd29-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-7cd29-predictor-d9cbb6df9 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
switch-graph-b65bd-66566fb599-49wh4 |
Killing |
Stopping container switch-graph-b65bd | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-7cd29 |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-7cd29": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-7cd29": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-7cd29-predictor-bc98c47fd |
SuccessfulCreate |
Created pod: success-200-isvc-7cd29-predictor-bc98c47fd-bdwpp | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-7cd29 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-7cd29": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-7cd29-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-7cd29-predictor-bc98c47fd from 0 to 1 | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-7cd29 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-7cd29": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-7cd29": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-7cd29-predictor-bc98c47fd-bdwpp |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-7cd29-predictor-d9cbb6df9-mssdw |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1424" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-7cd29-predictor-d9cbb6df9-mssdw |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-7cd29-predictor-d9cbb6df9-mssdw |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
multus |
success-200-isvc-7cd29-predictor-bc98c47fd-bdwpp |
AddedInterface |
Add eth0 [10.132.0.34/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-7cd29-predictor-bc98c47fd-bdwpp |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-7cd29-predictor-bc98c47fd-bdwpp |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1424" already present on machine | |
kserve-ci-e2e-test |
multus |
error-404-isvc-7cd29-predictor-d9cbb6df9-mssdw |
AddedInterface |
Add eth0 [10.132.0.35/23] from ovn-kubernetes | |
| (x9) | kserve-ci-e2e-test |
v1beta1Controllers |
isvc-xgboost-graph |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x9) | kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-1 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
isvc-xgboost-graph |
InferenceServiceReady |
InferenceService [isvc-xgboost-graph] is Ready | |
kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-2 |
InferenceServiceReady |
InferenceService [isvc-sklearn-graph-2] is Ready | |
| (x9) | kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-2 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-1 |
InferenceServiceReady |
InferenceService [isvc-sklearn-graph-1] is Ready | |
| (x7) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-b65bd-predictor-75967c8fc9-kkvkc |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.33:8080: connect: connection refused |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-b65bd-predictor-7b84f8cc4-bgvmc |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.32:8080: connect: connection refused |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-7cd29-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-7cd29-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
InferenceGraphController |
model-chainer |
InferenceGraphReady |
InferenceGraph [model-chainer] is Ready | |
kserve-ci-e2e-test |
multus |
model-chainer-54c98cd4d8-cnq9q |
AddedInterface |
Add eth0 [10.134.0.26/23] from ovn-kubernetes | |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
kubelet |
model-chainer-54c98cd4d8-cnq9q |
Created |
Created container: model-chainer | |
kserve-ci-e2e-test |
deployment-controller |
model-chainer |
ScalingReplicaSet |
Scaled up replica set model-chainer-54c98cd4d8 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
model-chainer-54c98cd4d8 |
SuccessfulCreate |
Created pod: model-chainer-54c98cd4d8-cnq9q | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x6) | kserve-ci-e2e-test |
kubelet |
switch-graph-b65bd-66566fb599-49wh4 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
kubelet |
model-chainer-54c98cd4d8-cnq9q |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:24e0d07fc928f25bef5abad5b7d6f0433a913fef03e0557ec5bebf00bc2024ca" already present on machine | |
kserve-ci-e2e-test |
kubelet |
model-chainer-54c98cd4d8-cnq9q |
Started |
Started container model-chainer | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-7cd29-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-7cd29-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-3604c |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-3604c": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-3604c": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-3604c-predictor-6c9f6657bf |
SuccessfulCreate |
Created pod: error-404-isvc-3604c-predictor-6c9f6657bf-j9tfm | |
kserve-ci-e2e-test |
kubelet |
model-chainer-54c98cd4d8-cnq9q |
Killing |
Stopping container model-chainer | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-6fd8964888-gkf4k |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-3604c-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-3604c-predictor-6c9f6657bf from 0 to 1 | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-3604c |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-3604c": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-3604c-predictor-67675654b4 |
SuccessfulCreate |
Created pod: success-200-isvc-3604c-predictor-67675654b4-qjrd2 | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-3604c-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-3604c-predictor-67675654b4 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-bcbc7cdf4-rp228 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-3604c-predictor-67675654b4-qjrd2 |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1424" already present on machine | |
kserve-ci-e2e-test |
multus |
error-404-isvc-3604c-predictor-6c9f6657bf-j9tfm |
AddedInterface |
Add eth0 [10.132.0.37/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-784cb989b8-4xk55 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
multus |
success-200-isvc-3604c-predictor-67675654b4-qjrd2 |
AddedInterface |
Add eth0 [10.132.0.36/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-3604c-predictor-6c9f6657bf-j9tfm |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-3604c-predictor-67675654b4-qjrd2 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-3604c-predictor-67675654b4-qjrd2 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-3604c-predictor-6c9f6657bf-j9tfm |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-3604c-predictor-6c9f6657bf-j9tfm |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1424" already present on machine | |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-7cd29-predictor-d9cbb6df9-mssdw |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.35:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-7cd29-predictor-bc98c47fd-bdwpp |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.34:8080: connect: connection refused |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-7cd29 |
InferenceServiceReady |
InferenceService [success-200-isvc-7cd29] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-7cd29 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-7cd29 |
InferenceServiceReady |
InferenceService [error-404-isvc-7cd29] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-7cd29 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x6) | kserve-ci-e2e-test |
kubelet |
model-chainer-54c98cd4d8-cnq9q |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-3604c-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-3604c-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-3604c-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-3604c-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
deployment-controller |
switch-graph-7cd29 |
ScalingReplicaSet |
Scaled up replica set switch-graph-7cd29-bcdbb89fd from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
switch-graph-7cd29-bcdbb89fd |
SuccessfulCreate |
Created pod: switch-graph-7cd29-bcdbb89fd-mxb6d | |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-7cd29 |
InferenceGraphReady |
InferenceGraph [switch-graph-7cd29] is Ready | |
kserve-ci-e2e-test |
kubelet |
switch-graph-7cd29-bcdbb89fd-mxb6d |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "switch-graph-7cd29-serving-cert" not found | |
kserve-ci-e2e-test |
multus |
switch-graph-7cd29-bcdbb89fd-mxb6d |
AddedInterface |
Add eth0 [10.134.0.27/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-7cd29 |
InternalError |
fails to update InferenceGraph status: Operation cannot be fulfilled on inferencegraphs.serving.kserve.io "switch-graph-7cd29": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-7cd29 |
UpdateFailed |
Failed to update status for InferenceGraph "switch-graph-7cd29": Operation cannot be fulfilled on inferencegraphs.serving.kserve.io "switch-graph-7cd29": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
switch-graph-7cd29-bcdbb89fd-mxb6d |
Started |
Started container switch-graph-7cd29 | |
kserve-ci-e2e-test |
kubelet |
switch-graph-7cd29-bcdbb89fd-mxb6d |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:24e0d07fc928f25bef5abad5b7d6f0433a913fef03e0557ec5bebf00bc2024ca" already present on machine | |
kserve-ci-e2e-test |
kubelet |
switch-graph-7cd29-bcdbb89fd-mxb6d |
Created |
Created container: switch-graph-7cd29 | |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-3604c-predictor-67675654b4-qjrd2 |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.36:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-3604c-predictor-6c9f6657bf-j9tfm |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.37:8080: connect: connection refused |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-3604c |
InferenceServiceReady |
InferenceService [error-404-isvc-3604c] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-3604c |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-3604c |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-3604c |
InferenceServiceReady |
InferenceService [success-200-isvc-3604c] is Ready | |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-7cd29-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-7cd29-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-7cd29-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-7cd29-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
deployment-controller |
sequence-graph-3604c |
ScalingReplicaSet |
Scaled up replica set sequence-graph-3604c-5c94498546 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
sequence-graph-3604c-5c94498546 |
SuccessfulCreate |
Created pod: sequence-graph-3604c-5c94498546-6xnhc | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-3604c-5c94498546-6xnhc |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "sequence-graph-3604c-serving-cert" not found | |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-3604c |
InferenceGraphReady |
InferenceGraph [sequence-graph-3604c] is Ready | |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-3604c |
UpdateFailed |
Failed to update status for InferenceGraph "sequence-graph-3604c": Operation cannot be fulfilled on inferencegraphs.serving.kserve.io "sequence-graph-3604c": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-3604c |
InternalError |
fails to update InferenceGraph status: Operation cannot be fulfilled on inferencegraphs.serving.kserve.io "sequence-graph-3604c": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-3604c-5c94498546-6xnhc |
Started |
Started container sequence-graph-3604c | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-3604c-5c94498546-6xnhc |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:24e0d07fc928f25bef5abad5b7d6f0433a913fef03e0557ec5bebf00bc2024ca" already present on machine | |
kserve-ci-e2e-test |
multus |
sequence-graph-3604c-5c94498546-6xnhc |
AddedInterface |
Add eth0 [10.134.0.28/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-3604c-5c94498546-6xnhc |
Created |
Created container: sequence-graph-3604c | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-3604c-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-3604c-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-3604c-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-3604c-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-7cd29 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-7cd29 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-3604c |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-3604c |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-305b2-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-305b2-predictor-7466c57bb4 from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-305b2-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-305b2-predictor-58965b9845 from 0 to 1 | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-305b2 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-305b2": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-305b2": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
switch-graph-7cd29-bcdbb89fd-mxb6d |
Killing |
Stopping container switch-graph-7cd29 | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-305b2 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-305b2": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-305b2-predictor-7466c57bb4 |
SuccessfulCreate |
Created pod: success-200-isvc-305b2-predictor-7466c57bb4-tjdwn | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-7cd29-predictor-bc98c47fd-bdwpp |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-305b2-predictor-58965b9845 |
SuccessfulCreate |
Created pod: error-404-isvc-305b2-predictor-58965b9845-7m8b7 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-7cd29-predictor-d9cbb6df9-mssdw |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-305b2-predictor-58965b9845-7m8b7 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-305b2-predictor-58965b9845-7m8b7 |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1424" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-305b2-predictor-58965b9845-7m8b7 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-305b2-predictor-7466c57bb4-tjdwn |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-305b2-predictor-7466c57bb4-tjdwn |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-305b2-predictor-7466c57bb4-tjdwn |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1424" already present on machine | |
kserve-ci-e2e-test |
multus |
success-200-isvc-305b2-predictor-7466c57bb4-tjdwn |
AddedInterface |
Add eth0 [10.132.0.38/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
multus |
error-404-isvc-305b2-predictor-58965b9845-7m8b7 |
AddedInterface |
Add eth0 [10.132.0.39/23] from ovn-kubernetes | |
| (x6) | kserve-ci-e2e-test |
kubelet |
switch-graph-7cd29-bcdbb89fd-mxb6d |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-305b2-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-305b2-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-305b2-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-305b2-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-a84b0 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-a84b0": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-a84b0": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-a84b0-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-a84b0-predictor-57c69c6bf5 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-a84b0-predictor-6b596fcd54-8mjt4 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-a84b0-predictor-6b596fcd54 |
SuccessfulCreate |
Created pod: success-200-isvc-a84b0-predictor-6b596fcd54-8mjt4 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-3604c-predictor-6c9f6657bf-j9tfm |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-3604c-predictor-67675654b4-qjrd2 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
multus |
error-404-isvc-a84b0-predictor-57c69c6bf5-2xkft |
AddedInterface |
Add eth0 [10.132.0.41/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-a84b0-predictor-57c69c6bf5-2xkft |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1424" already present on machine | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-a84b0-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-a84b0-predictor-6b596fcd54 from 0 to 1 | |
kserve-ci-e2e-test |
multus |
success-200-isvc-a84b0-predictor-6b596fcd54-8mjt4 |
AddedInterface |
Add eth0 [10.132.0.40/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-a84b0-predictor-6b596fcd54-8mjt4 |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1424" already present on machine | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-a84b0 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-a84b0": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-a84b0-predictor-57c69c6bf5 |
SuccessfulCreate |
Created pod: error-404-isvc-a84b0-predictor-57c69c6bf5-2xkft | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-a84b0 |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-a84b0": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-a84b0": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-a84b0-predictor-6b596fcd54-8mjt4 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-a84b0 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-a84b0": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-3604c-5c94498546-6xnhc |
Killing |
Stopping container sequence-graph-3604c | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-a84b0-predictor-57c69c6bf5-2xkft |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-a84b0-predictor-57c69c6bf5-2xkft |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-a84b0-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-a84b0-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-305b2 |
InferenceServiceReady |
InferenceService [success-200-isvc-305b2] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-305b2 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-305b2 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-305b2 |
InferenceServiceReady |
InferenceService [error-404-isvc-305b2] is Ready | |
| (x6) | kserve-ci-e2e-test |
kubelet |
sequence-graph-3604c-5c94498546-6xnhc |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-a84b0-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-a84b0-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
deployment-controller |
ensemble-graph-305b2 |
ScalingReplicaSet |
Scaled up replica set ensemble-graph-305b2-7c6bf4cb48 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
ensemble-graph-305b2-7c6bf4cb48 |
SuccessfulCreate |
Created pod: ensemble-graph-305b2-7c6bf4cb48-2gft4 | |
kserve-ci-e2e-test |
InferenceGraphController |
ensemble-graph-305b2 |
InferenceGraphReady |
InferenceGraph [ensemble-graph-305b2] is Ready | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-305b2-7c6bf4cb48-2gft4 |
Started |
Started container ensemble-graph-305b2 | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-305b2-7c6bf4cb48-2gft4 |
Created |
Created container: ensemble-graph-305b2 | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-305b2-7c6bf4cb48-2gft4 |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:24e0d07fc928f25bef5abad5b7d6f0433a913fef03e0557ec5bebf00bc2024ca" already present on machine | |
kserve-ci-e2e-test |
multus |
ensemble-graph-305b2-7c6bf4cb48-2gft4 |
AddedInterface |
Add eth0 [10.134.0.29/23] from ovn-kubernetes | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-305b2-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-305b2-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-305b2-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-305b2-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-305b2-predictor-58965b9845-7m8b7 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-911ed |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-911ed": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
multus |
success-200-isvc-911ed-predictor-7885d56788-nnsbr |
AddedInterface |
Add eth0 [10.132.0.42/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-911ed-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-911ed-predictor-577cc5dbbf from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-911ed-predictor-577cc5dbbf-bmwdx |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-911ed-predictor-7885d56788-nnsbr |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1424" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-911ed-predictor-7885d56788-nnsbr |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-911ed-predictor-7885d56788-nnsbr |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-911ed-predictor-7885d56788 |
SuccessfulCreate |
Created pod: success-200-isvc-911ed-predictor-7885d56788-nnsbr | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-911ed-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-911ed-predictor-7885d56788 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-911ed-predictor-577cc5dbbf-bmwdx |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-305b2-predictor-7466c57bb4-tjdwn |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-911ed |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-911ed": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-911ed": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-911ed-predictor-577cc5dbbf |
SuccessfulCreate |
Created pod: error-404-isvc-911ed-predictor-577cc5dbbf-bmwdx | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-305b2-7c6bf4cb48-2gft4 |
Killing |
Stopping container ensemble-graph-305b2 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-911ed-predictor-577cc5dbbf-bmwdx |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1424" already present on machine | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-911ed |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-911ed": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-911ed": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
multus |
error-404-isvc-911ed-predictor-577cc5dbbf-bmwdx |
AddedInterface |
Add eth0 [10.132.0.43/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-911ed |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-911ed": the object has been modified; please apply your changes to the latest version and try again | |
| (x7) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-305b2-predictor-58965b9845-7m8b7 |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.39:8080: connect: connection refused |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-305b2-predictor-7466c57bb4-tjdwn |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.38:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-a84b0 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-a84b0 |
InferenceServiceReady |
InferenceService [error-404-isvc-a84b0] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-a84b0 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-a84b0 |
InferenceServiceReady |
InferenceService [success-200-isvc-a84b0] is Ready | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-911ed-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-911ed-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
deployment-controller |
sequence-graph-a84b0 |
ScalingReplicaSet |
Scaled up replica set sequence-graph-a84b0-6cc45b7f74 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
sequence-graph-a84b0-6cc45b7f74 |
SuccessfulCreate |
Created pod: sequence-graph-a84b0-6cc45b7f74-r64lg | |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-a84b0 |
InferenceGraphReady |
InferenceGraph [sequence-graph-a84b0] is Ready | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-a84b0-6cc45b7f74-r64lg |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:24e0d07fc928f25bef5abad5b7d6f0433a913fef03e0557ec5bebf00bc2024ca" already present on machine | |
kserve-ci-e2e-test |
multus |
sequence-graph-a84b0-6cc45b7f74-r64lg |
AddedInterface |
Add eth0 [10.134.0.30/23] from ovn-kubernetes | |
| (x6) | kserve-ci-e2e-test |
kubelet |
ensemble-graph-305b2-7c6bf4cb48-2gft4 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
kubelet |
sequence-graph-a84b0-6cc45b7f74-r64lg |
Started |
Started container sequence-graph-a84b0 | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-a84b0-6cc45b7f74-r64lg |
Created |
Created container: sequence-graph-a84b0 | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-a84b0-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-a84b0-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-a84b0-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-a84b0-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-009d9 |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-009d9": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-009d9": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-009d9 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-009d9": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-a84b0-predictor-6b596fcd54-8mjt4 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-a84b0-6cc45b7f74-r64lg |
Killing |
Stopping container sequence-graph-a84b0 | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-009d9-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-009d9-predictor-8d574d484 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-009d9-predictor-8d574d484 |
SuccessfulCreate |
Created pod: success-200-isvc-009d9-predictor-8d574d484-c7787 | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-009d9-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-009d9-predictor-5497b97b89 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-009d9-predictor-5497b97b89-5m5l7 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-009d9 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-009d9": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-009d9": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-009d9-predictor-8d574d484-c7787 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-009d9-predictor-8d574d484-c7787 |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1424" already present on machine | |
kserve-ci-e2e-test |
multus |
success-200-isvc-009d9-predictor-8d574d484-c7787 |
AddedInterface |
Add eth0 [10.132.0.44/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-a84b0-predictor-57c69c6bf5-2xkft |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-009d9-predictor-8d574d484-c7787 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
multus |
error-404-isvc-009d9-predictor-5497b97b89-5m5l7 |
AddedInterface |
Add eth0 [10.132.0.45/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-009d9-predictor-5497b97b89 |
SuccessfulCreate |
Created pod: error-404-isvc-009d9-predictor-5497b97b89-5m5l7 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-009d9-predictor-5497b97b89-5m5l7 |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1424" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-009d9-predictor-5497b97b89-5m5l7 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-009d9 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-009d9": the object has been modified; please apply your changes to the latest version and try again | |
| (x7) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-a84b0-predictor-57c69c6bf5-2xkft |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.41:8080: connect: connection refused |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-a84b0-predictor-6b596fcd54-8mjt4 |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.40:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-911ed-predictor-577cc5dbbf-bmwdx |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.43:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-911ed-predictor-7885d56788-nnsbr |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.42:8080: connect: connection refused |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-911ed |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-911ed |
InferenceServiceReady |
InferenceService [success-200-isvc-911ed] is Ready | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-911ed |
InferenceServiceReady |
InferenceService [error-404-isvc-911ed] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-911ed |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-911ed-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-911ed-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x6) | kserve-ci-e2e-test |
kubelet |
sequence-graph-a84b0-6cc45b7f74-r64lg |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-009d9-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-009d9-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-009d9-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-009d9-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-911ed-78995f655-sjdp4 |
Started |
Started container ensemble-graph-911ed | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-911ed-78995f655-sjdp4 |
Created |
Created container: ensemble-graph-911ed | |
kserve-ci-e2e-test |
InferenceGraphController |
ensemble-graph-911ed |
InferenceGraphReady |
InferenceGraph [ensemble-graph-911ed] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
ensemble-graph-911ed |
ScalingReplicaSet |
Scaled up replica set ensemble-graph-911ed-78995f655 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
ensemble-graph-911ed-78995f655 |
SuccessfulCreate |
Created pod: ensemble-graph-911ed-78995f655-sjdp4 | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-911ed-78995f655-sjdp4 |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:24e0d07fc928f25bef5abad5b7d6f0433a913fef03e0557ec5bebf00bc2024ca" already present on machine | |
kserve-ci-e2e-test |
multus |
ensemble-graph-911ed-78995f655-sjdp4 |
AddedInterface |
Add eth0 [10.134.0.31/23] from ovn-kubernetes | |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-911ed-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-911ed-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-009d9-predictor-5497b97b89-5m5l7 |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.45:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-009d9-predictor-8d574d484-c7787 |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.44:8080: connect: connection refused |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
ensemble-graph-911ed |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
ensemble-graph-911ed |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-009d9 |
InferenceServiceReady |
InferenceService [error-404-isvc-009d9] is Ready | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-009d9 |
InferenceServiceReady |
InferenceService [success-200-isvc-009d9] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-009d9 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-009d9 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-911ed-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-911ed-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
ensemble-graph-911ed |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
ensemble-graph-911ed |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-009d9 |
InferenceGraphReady |
InferenceGraph [sequence-graph-009d9] is Ready | |
kserve-ci-e2e-test |
replicaset-controller |
sequence-graph-009d9-764c944467 |
SuccessfulCreate |
Created pod: sequence-graph-009d9-764c944467-bghlk | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-009d9-764c944467-bghlk |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "sequence-graph-009d9-serving-cert" not found | |
kserve-ci-e2e-test |
deployment-controller |
sequence-graph-009d9 |
ScalingReplicaSet |
Scaled up replica set sequence-graph-009d9-764c944467 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-009d9-764c944467-bghlk |
Started |
Started container sequence-graph-009d9 | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-009d9-764c944467-bghlk |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:24e0d07fc928f25bef5abad5b7d6f0433a913fef03e0557ec5bebf00bc2024ca" already present on machine | |
kserve-ci-e2e-test |
multus |
sequence-graph-009d9-764c944467-bghlk |
AddedInterface |
Add eth0 [10.134.0.32/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-009d9-764c944467-bghlk |
Created |
Created container: sequence-graph-009d9 | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-009d9-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-009d9-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-009d9 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-009d9 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-009d9-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-009d9-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-009d9 |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-009d9 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-911ed-78995f655-sjdp4 |
Killing |
Stopping container ensemble-graph-911ed | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-0b236-predictor-5d4f9447b7 |
SuccessfulCreate |
Created pod: error-404-isvc-0b236-predictor-5d4f9447b7-gs8zd | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-0b236-predictor-5d4f9447b7-gs8zd |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-911ed-predictor-7885d56788-nnsbr |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-0b236-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-0b236-predictor-66b864b from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-911ed-predictor-577cc5dbbf-bmwdx |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-0b236-predictor-66b864b-6dsgd |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-0b236 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-0b236": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-0b236": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-0b236 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-0b236": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
multus |
success-200-isvc-0b236-predictor-66b864b-6dsgd |
AddedInterface |
Add eth0 [10.132.0.46/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-0b236-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-0b236-predictor-5d4f9447b7 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-0b236-predictor-66b864b |
SuccessfulCreate |
Created pod: success-200-isvc-0b236-predictor-66b864b-6dsgd | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-0b236-predictor-66b864b-6dsgd |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-0b236-predictor-5d4f9447b7-gs8zd |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-0b236-predictor-5d4f9447b7-gs8zd |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1424" already present on machine | |
kserve-ci-e2e-test |
multus |
error-404-isvc-0b236-predictor-5d4f9447b7-gs8zd |
AddedInterface |
Add eth0 [10.132.0.47/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-0b236 |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-0b236": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-0b236": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-0b236 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-0b236": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-0b236-predictor-66b864b-6dsgd |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1424" already present on machine | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-0b236-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-0b236-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x6) | kserve-ci-e2e-test |
kubelet |
ensemble-graph-911ed-78995f655-sjdp4 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
kubelet |
sequence-graph-009d9-764c944467-bghlk |
Killing |
Stopping container sequence-graph-009d9 | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-3ca33-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-3ca33-predictor-866bdfdb6 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-009d9-predictor-8d574d484-c7787 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-3ca33-predictor-866bdfdb6 |
SuccessfulCreate |
Created pod: success-200-isvc-3ca33-predictor-866bdfdb6-gds85 | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-3ca33 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-3ca33": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-3ca33-predictor-b9fdb764c |
SuccessfulCreate |
Created pod: error-404-isvc-3ca33-predictor-b9fdb764c-sr859 | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-3ca33-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-3ca33-predictor-b9fdb764c from 0 to 1 | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-3ca33 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-3ca33": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-3ca33": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-3ca33-predictor-866bdfdb6-gds85 |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1424" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-3ca33-predictor-b9fdb764c-sr859 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
multus |
error-404-isvc-3ca33-predictor-b9fdb764c-sr859 |
AddedInterface |
Add eth0 [10.132.0.49/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-3ca33-predictor-866bdfdb6-gds85 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-3ca33-predictor-866bdfdb6-gds85 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-3ca33-predictor-b9fdb764c-sr859 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
multus |
success-200-isvc-3ca33-predictor-866bdfdb6-gds85 |
AddedInterface |
Add eth0 [10.132.0.48/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-009d9-predictor-5497b97b89-5m5l7 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-3ca33-predictor-b9fdb764c-sr859 |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1424" already present on machine | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-0b236-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-0b236-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-3ca33-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-3ca33-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-0b236 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-0b236 |
InferenceServiceReady |
InferenceService [error-404-isvc-0b236] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-0b236 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-0b236 |
InferenceServiceReady |
InferenceService [success-200-isvc-0b236] is Ready | |
| (x6) | kserve-ci-e2e-test |
kubelet |
sequence-graph-009d9-764c944467-bghlk |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
kubelet |
splitter-graph-0b236-856d54479f-8q95m |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "splitter-graph-0b236-serving-cert" not found | |
kserve-ci-e2e-test |
InferenceGraphController |
splitter-graph-0b236 |
InferenceGraphReady |
InferenceGraph [splitter-graph-0b236] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
splitter-graph-0b236 |
ScalingReplicaSet |
Scaled up replica set splitter-graph-0b236-856d54479f from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
splitter-graph-0b236-856d54479f |
SuccessfulCreate |
Created pod: splitter-graph-0b236-856d54479f-8q95m | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-0b236-856d54479f-8q95m |
Started |
Started container splitter-graph-0b236 | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-0b236-856d54479f-8q95m |
Created |
Created container: splitter-graph-0b236 | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-0b236-856d54479f-8q95m |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:24e0d07fc928f25bef5abad5b7d6f0433a913fef03e0557ec5bebf00bc2024ca" already present on machine | |
kserve-ci-e2e-test |
multus |
splitter-graph-0b236-856d54479f-8q95m |
AddedInterface |
Add eth0 [10.134.0.33/23] from ovn-kubernetes | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-0b236-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-0b236-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-0b236-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-0b236-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-a940c-predictor-55498679d6-p4w6n |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-a940c-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-a940c-predictor-55498679d6 from 0 to 1 | |
kserve-ci-e2e-test |
multus |
success-200-isvc-a940c-predictor-55498679d6-p4w6n |
AddedInterface |
Add eth0 [10.132.0.50/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-a940c-predictor-55498679d6-p4w6n |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1424" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-a940c-predictor-55498679d6-p4w6n |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-a940c-predictor-cdc8fbb67-qhs6x |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-0b236-predictor-5d4f9447b7-gs8zd |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-a940c-predictor-cdc8fbb67 |
SuccessfulCreate |
Created pod: error-404-isvc-a940c-predictor-cdc8fbb67-qhs6x | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-a940c-predictor-55498679d6 |
SuccessfulCreate |
Created pod: success-200-isvc-a940c-predictor-55498679d6-p4w6n | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-a940c-predictor-cdc8fbb67-qhs6x |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1424" already present on machine | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-a940c-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-a940c-predictor-cdc8fbb67 from 0 to 1 | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-3ca33-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-0b236-predictor-66b864b-6dsgd |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-a940c-predictor-cdc8fbb67-qhs6x |
Created |
Created container: kserve-container | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-3ca33-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
multus |
error-404-isvc-a940c-predictor-cdc8fbb67-qhs6x |
AddedInterface |
Add eth0 [10.132.0.51/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-0b236-856d54479f-8q95m |
Killing |
Stopping container splitter-graph-0b236 | |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-0b236-predictor-66b864b-6dsgd |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.46:8080: connect: connection refused |
| (x7) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-0b236-predictor-5d4f9447b7-gs8zd |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.47:8080: connect: connection refused |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-3ca33 |
InferenceServiceReady |
InferenceService [success-200-isvc-3ca33] is Ready | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-3ca33 |
InferenceServiceReady |
InferenceService [error-404-isvc-3ca33] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-3ca33 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-3ca33 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
replicaset-controller |
switch-graph-3ca33-66cd5cfb9d |
SuccessfulCreate |
Created pod: switch-graph-3ca33-66cd5cfb9d-fmlpr | |
kserve-ci-e2e-test |
deployment-controller |
switch-graph-3ca33 |
ScalingReplicaSet |
Scaled up replica set switch-graph-3ca33-66cd5cfb9d from 0 to 1 | |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-3ca33 |
InferenceGraphReady |
InferenceGraph [switch-graph-3ca33] is Ready | |
kserve-ci-e2e-test |
kubelet |
switch-graph-3ca33-66cd5cfb9d-fmlpr |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:24e0d07fc928f25bef5abad5b7d6f0433a913fef03e0557ec5bebf00bc2024ca" already present on machine | |
kserve-ci-e2e-test |
multus |
switch-graph-3ca33-66cd5cfb9d-fmlpr |
AddedInterface |
Add eth0 [10.134.0.34/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
switch-graph-3ca33-66cd5cfb9d-fmlpr |
Started |
Started container switch-graph-3ca33 | |
kserve-ci-e2e-test |
kubelet |
switch-graph-3ca33-66cd5cfb9d-fmlpr |
Created |
Created container: switch-graph-3ca33 | |
| (x6) | kserve-ci-e2e-test |
kubelet |
splitter-graph-0b236-856d54479f-8q95m |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-3ca33-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-3ca33-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-a940c-predictor-cdc8fbb67-qhs6x |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.51:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-a940c-predictor-55498679d6-p4w6n |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.50:8080: connect: connection refused |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-a940c-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-3ca33-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-3ca33-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-a940c-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-a940c-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-a940c-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-a940c |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-a940c |
InferenceServiceReady |
InferenceService [success-200-isvc-a940c] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-a940c |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-a940c |
InferenceServiceReady |
InferenceService [error-404-isvc-a940c] is Ready | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-a940c-74c5f5f874-5gw2z |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "splitter-graph-a940c-serving-cert" not found | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-3ca33 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-3ca33 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
replicaset-controller |
splitter-graph-a940c-74c5f5f874 |
SuccessfulCreate |
Created pod: splitter-graph-a940c-74c5f5f874-5gw2z | |
kserve-ci-e2e-test |
InferenceGraphController |
splitter-graph-a940c |
InferenceGraphReady |
InferenceGraph [splitter-graph-a940c] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
splitter-graph-a940c |
ScalingReplicaSet |
Scaled up replica set splitter-graph-a940c-74c5f5f874 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-a940c-74c5f5f874-5gw2z |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:24e0d07fc928f25bef5abad5b7d6f0433a913fef03e0557ec5bebf00bc2024ca" already present on machine | |
kserve-ci-e2e-test |
multus |
splitter-graph-a940c-74c5f5f874-5gw2z |
AddedInterface |
Add eth0 [10.134.0.35/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-a940c-74c5f5f874-5gw2z |
Created |
Created container: splitter-graph-a940c | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-a940c-74c5f5f874-5gw2z |
Started |
Started container splitter-graph-a940c | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-a940c-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-a940c-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-a940c-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-a940c-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
splitter-graph-a940c |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
splitter-graph-a940c |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-a940c-predictor-cdc8fbb67-qhs6x |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-a940c-74c5f5f874-5gw2z |
Killing |
Stopping container splitter-graph-a940c | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-a940c-predictor-55498679d6-p4w6n |
Killing |
Stopping container kserve-container | |
| (x6) | kserve-ci-e2e-test |
kubelet |
splitter-graph-a940c-74c5f5f874-5gw2z |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-3ca33-predictor-866bdfdb6-gds85 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-3ca33-predictor-b9fdb764c-sr859 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
switch-graph-3ca33-66cd5cfb9d-fmlpr |
Killing |
Stopping container switch-graph-3ca33 | |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-3ca33-predictor-866bdfdb6-gds85 |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.48:8080: connect: connection refused |
| (x7) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-3ca33-predictor-b9fdb764c-sr859 |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.49:8080: connect: connection refused |
| (x4) | kserve-ci-e2e-test |
kubelet |
switch-graph-3ca33-66cd5cfb9d-fmlpr |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |