| Time | Namespace | Component | RelatedObject | Reason | Message |
|---|---|---|---|---|---|
kserve-ci-e2e-test |
sequence-graph-ed24b-7c6b74f4df-gtjnk |
Scheduled |
Successfully assigned kserve-ci-e2e-test/sequence-graph-ed24b-7c6b74f4df-gtjnk to ip-10-0-128-59.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-78581-predictor-8648c458b4-v2c7w |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-78581-predictor-8648c458b4-v2c7w to ip-10-0-134-133.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-84e06-predictor-579c9cdd97-z77lb |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-84e06-predictor-579c9cdd97-z77lb to ip-10-0-128-59.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-78581-predictor-d6d9bf857-m87d6 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-78581-predictor-d6d9bf857-m87d6 to ip-10-0-128-59.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-516af-predictor-7dc5688b5-z5fmq |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-516af-predictor-7dc5688b5-z5fmq to ip-10-0-128-59.ec2.internal | ||
kserve-ci-e2e-test |
switch-graph-04c3d-b98467bdb-ssm57 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/switch-graph-04c3d-b98467bdb-ssm57 to ip-10-0-128-59.ec2.internal | ||
kserve-ci-e2e-test |
isvc-sklearn-graph-2-predictor-d76b874f9-gp6ts |
Scheduled |
Successfully assigned kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-d76b874f9-gp6ts to ip-10-0-134-133.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-390f9-predictor-666f56949b-vxbx4 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-390f9-predictor-666f56949b-vxbx4 to ip-10-0-134-133.ec2.internal | ||
kserve-ci-e2e-test |
switch-graph-390f9-67fbf8748c-gm76t |
Scheduled |
Successfully assigned kserve-ci-e2e-test/switch-graph-390f9-67fbf8748c-gm76t to ip-10-0-128-59.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-84e06-predictor-59d6c4b5b8-qwgj5 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-84e06-predictor-59d6c4b5b8-qwgj5 to ip-10-0-134-133.ec2.internal | ||
kserve-ci-e2e-test |
ensemble-graph-ccdbb-59bfb89b8-8swsg |
Scheduled |
Successfully assigned kserve-ci-e2e-test/ensemble-graph-ccdbb-59bfb89b8-8swsg to ip-10-0-128-59.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-89f53-predictor-7b489589b4-4c4pr |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-89f53-predictor-7b489589b4-4c4pr to ip-10-0-134-133.ec2.internal | ||
kserve-ci-e2e-test |
isvc-xgboost-graph-predictor-784cb989b8-ll9ps |
Scheduled |
Successfully assigned kserve-ci-e2e-test/isvc-xgboost-graph-predictor-784cb989b8-ll9ps to ip-10-0-134-133.ec2.internal | ||
kserve-ci-e2e-test |
ensemble-graph-df772-7fb98745c-jlqxb |
Scheduled |
Successfully assigned kserve-ci-e2e-test/ensemble-graph-df772-7fb98745c-jlqxb to ip-10-0-128-59.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-ccdbb-predictor-c7cfb5d-jr9f2 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-ccdbb-predictor-c7cfb5d-jr9f2 to ip-10-0-134-133.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-0403e-predictor-65bc898d66-f8rjw |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-0403e-predictor-65bc898d66-f8rjw to ip-10-0-134-133.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-516af-predictor-5f8c67c956-pwv6b |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-516af-predictor-5f8c67c956-pwv6b to ip-10-0-134-133.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-ed24b-predictor-945b44ddd-lpdjg |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-ed24b-predictor-945b44ddd-lpdjg to ip-10-0-134-133.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-04c3d-predictor-7c964cdb94-hzrhl |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-04c3d-predictor-7c964cdb94-hzrhl to ip-10-0-134-133.ec2.internal | ||
kserve-ci-e2e-test |
switch-graph-89f53-d7bd89598-qk2zv |
Scheduled |
Successfully assigned kserve-ci-e2e-test/switch-graph-89f53-d7bd89598-qk2zv to ip-10-0-128-59.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-390f9-predictor-5bdd998c9c-dxsnc |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-390f9-predictor-5bdd998c9c-dxsnc to ip-10-0-128-59.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-04c3d-predictor-6c8787dd55-x9kf9 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-04c3d-predictor-6c8787dd55-x9kf9 to ip-10-0-128-59.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-0403e-predictor-5bfb47d58c-d59t9 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-0403e-predictor-5bfb47d58c-d59t9 to ip-10-0-128-59.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-df772-predictor-875748d7f-jdp2w |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-df772-predictor-875748d7f-jdp2w to ip-10-0-128-59.ec2.internal | ||
kserve-ci-e2e-test |
splitter-graph-84e06-7f457f648b-sqvbh |
Scheduled |
Successfully assigned kserve-ci-e2e-test/splitter-graph-84e06-7f457f648b-sqvbh to ip-10-0-128-59.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-ed24b-predictor-648cf478d9-kpr96 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-ed24b-predictor-648cf478d9-kpr96 to ip-10-0-128-59.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-ccdbb-predictor-697459d95f-7kx24 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-ccdbb-predictor-697459d95f-7kx24 to ip-10-0-128-59.ec2.internal | ||
kserve-ci-e2e-test |
isvc-sklearn-graph-1-predictor-74d68d6bdc-xqs95 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-74d68d6bdc-xqs95 to ip-10-0-134-55.ec2.internal | ||
kserve-ci-e2e-test |
splitter-graph-78581-5cd4b8fdb7-tts6g |
Scheduled |
Successfully assigned kserve-ci-e2e-test/splitter-graph-78581-5cd4b8fdb7-tts6g to ip-10-0-128-59.ec2.internal | ||
kserve-ci-e2e-test |
sequence-graph-516af-7cdf98dc78-cwt5d |
Scheduled |
Successfully assigned kserve-ci-e2e-test/sequence-graph-516af-7cdf98dc78-cwt5d to ip-10-0-128-59.ec2.internal | ||
kserve-ci-e2e-test |
sequence-graph-0403e-6dd9d7fbd6-55qr5 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/sequence-graph-0403e-6dd9d7fbd6-55qr5 to ip-10-0-128-59.ec2.internal | ||
kserve-ci-e2e-test |
model-chainer-77968cf4b8-qdr99 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/model-chainer-77968cf4b8-qdr99 to ip-10-0-128-59.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-89f53-predictor-646dcc4bbf-8hgx4 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-89f53-predictor-646dcc4bbf-8hgx4 to ip-10-0-128-59.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-df772-predictor-5c6cd9cb6b-6bgvz |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-df772-predictor-5c6cd9cb6b-6bgvz to ip-10-0-134-133.ec2.internal | ||
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-390f9-predictor-666f56949b |
SuccessfulCreate |
Created pod: error-404-isvc-390f9-predictor-666f56949b-vxbx4 | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-390f9-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-390f9-predictor-666f56949b from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
isvc-xgboost-graph-predictor |
ScalingReplicaSet |
Scaled up replica set isvc-xgboost-graph-predictor-784cb989b8 from 0 to 1 | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-390f9 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-390f9": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
multus |
success-200-isvc-390f9-predictor-5bdd998c9c-dxsnc |
AddedInterface |
Add eth0 [10.134.0.21/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
multus |
isvc-sklearn-graph-1-predictor-74d68d6bdc-xqs95 |
AddedInterface |
Add eth0 [10.133.0.16/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-390f9-predictor-5bdd998c9c-dxsnc |
Pulling |
Pulling image "quay.io/opendatahub/success-200-isvc:odh-pr-1412" | |
kserve-ci-e2e-test |
deployment-controller |
isvc-sklearn-graph-1-predictor |
ScalingReplicaSet |
Scaled up replica set isvc-sklearn-graph-1-predictor-74d68d6bdc from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
isvc-sklearn-graph-1-predictor-74d68d6bdc |
SuccessfulCreate |
Created pod: isvc-sklearn-graph-1-predictor-74d68d6bdc-xqs95 | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-390f9 |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-390f9": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-390f9": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-390f9-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-390f9-predictor-5bdd998c9c from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-390f9-predictor-5bdd998c9c |
SuccessfulCreate |
Created pod: success-200-isvc-390f9-predictor-5bdd998c9c-dxsnc | |
kserve-ci-e2e-test |
multus |
isvc-xgboost-graph-predictor-784cb989b8-ll9ps |
AddedInterface |
Add eth0 [10.132.0.38/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
replicaset-controller |
isvc-xgboost-graph-predictor-784cb989b8 |
SuccessfulCreate |
Created pod: isvc-xgboost-graph-predictor-784cb989b8-ll9ps | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-d76b874f9-gp6ts |
Pulling |
Pulling image "quay.io/opendatahub/kserve-storage-initializer@sha256:b1408675ea4fdca559a0643f83f1f99c90fa28691ae069983f57f521927df688" | |
kserve-ci-e2e-test |
multus |
error-404-isvc-390f9-predictor-666f56949b-vxbx4 |
AddedInterface |
Add eth0 [10.132.0.37/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
deployment-controller |
isvc-sklearn-graph-2-predictor |
ScalingReplicaSet |
Scaled up replica set isvc-sklearn-graph-2-predictor-d76b874f9 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
isvc-sklearn-graph-2-predictor-d76b874f9 |
SuccessfulCreate |
Created pod: isvc-sklearn-graph-2-predictor-d76b874f9-gp6ts | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-390f9-predictor-666f56949b-vxbx4 |
Pulling |
Pulling image "quay.io/opendatahub/error-404-isvc:odh-pr-1412" | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-74d68d6bdc-xqs95 |
Pulling |
Pulling image "quay.io/opendatahub/kserve-storage-initializer@sha256:b1408675ea4fdca559a0643f83f1f99c90fa28691ae069983f57f521927df688" | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-784cb989b8-ll9ps |
Pulling |
Pulling image "quay.io/opendatahub/kserve-storage-initializer@sha256:b1408675ea4fdca559a0643f83f1f99c90fa28691ae069983f57f521927df688" | |
kserve-ci-e2e-test |
multus |
isvc-sklearn-graph-2-predictor-d76b874f9-gp6ts |
AddedInterface |
Add eth0 [10.132.0.39/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-74d68d6bdc-xqs95 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-74d68d6bdc-xqs95 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-74d68d6bdc-xqs95 |
Pulled |
Successfully pulled image "quay.io/opendatahub/kserve-storage-initializer@sha256:b1408675ea4fdca559a0643f83f1f99c90fa28691ae069983f57f521927df688" in 3.874s (3.874s including waiting). Image size: 299671472 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-74d68d6bdc-xqs95 |
Pulling |
Pulling image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1412" | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-390f9-predictor-5bdd998c9c-dxsnc |
Pulled |
Successfully pulled image "quay.io/opendatahub/success-200-isvc:odh-pr-1412" in 11.622s (11.622s including waiting). Image size: 1332223599 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-d76b874f9-gp6ts |
Pulled |
Successfully pulled image "quay.io/opendatahub/kserve-storage-initializer@sha256:b1408675ea4fdca559a0643f83f1f99c90fa28691ae069983f57f521927df688" in 11.264s (11.264s including waiting). Image size: 299671472 bytes. | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-390f9-predictor-5bdd998c9c-dxsnc |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-390f9-predictor-5bdd998c9c-dxsnc |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-d76b874f9-gp6ts |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-d76b874f9-gp6ts |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-784cb989b8-ll9ps |
Pulled |
Successfully pulled image "quay.io/opendatahub/kserve-storage-initializer@sha256:b1408675ea4fdca559a0643f83f1f99c90fa28691ae069983f57f521927df688" in 12.941s (12.941s including waiting). Image size: 299671472 bytes. | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-390f9-predictor-666f56949b-vxbx4 |
Pulled |
Successfully pulled image "quay.io/opendatahub/error-404-isvc:odh-pr-1412" in 13.499s (13.499s including waiting). Image size: 1332224104 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-784cb989b8-ll9ps |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-784cb989b8-ll9ps |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-390f9-predictor-666f56949b-vxbx4 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-390f9-predictor-666f56949b-vxbx4 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-390f9-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-390f9-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-784cb989b8-ll9ps |
Pulling |
Pulling image "kserve/xgbserver:latest" | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-d76b874f9-gp6ts |
Pulling |
Pulling image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1412" | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-74d68d6bdc-xqs95 |
Pulled |
Successfully pulled image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1412" in 13.13s (13.13s including waiting). Image size: 1560610740 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-74d68d6bdc-xqs95 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-74d68d6bdc-xqs95 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-d76b874f9-gp6ts |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-d76b874f9-gp6ts |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-d76b874f9-gp6ts |
Pulled |
Successfully pulled image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1412" in 6.99s (6.99s including waiting). Image size: 1560610740 bytes. | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-390f9-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-390f9-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-784cb989b8-ll9ps |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-784cb989b8-ll9ps |
Pulled |
Successfully pulled image "kserve/xgbserver:latest" in 18.403s (18.403s including waiting). Image size: 1306229499 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-784cb989b8-ll9ps |
Started |
Started container kserve-container | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-390f9-predictor-5bdd998c9c-dxsnc |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.21:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-390f9-predictor-666f56949b-vxbx4 |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.37:8080: connect: connection refused |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-390f9 |
InferenceServiceReady |
InferenceService [success-200-isvc-390f9] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-390f9 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-390f9 |
InferenceServiceReady |
InferenceService [error-404-isvc-390f9] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-390f9 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-390f9-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-390f9-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-390f9 |
InferenceGraphReady |
InferenceGraph [switch-graph-390f9] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
switch-graph-390f9 |
ScalingReplicaSet |
Scaled up replica set switch-graph-390f9-67fbf8748c from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
switch-graph-390f9-67fbf8748c-gm76t |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "switch-graph-390f9-serving-cert" not found | |
kserve-ci-e2e-test |
replicaset-controller |
switch-graph-390f9-67fbf8748c |
SuccessfulCreate |
Created pod: switch-graph-390f9-67fbf8748c-gm76t | |
kserve-ci-e2e-test |
multus |
switch-graph-390f9-67fbf8748c-gm76t |
AddedInterface |
Add eth0 [10.134.0.22/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
switch-graph-390f9-67fbf8748c-gm76t |
Pulling |
Pulling image "quay.io/opendatahub/kserve-router@sha256:6060da2148ba78c06d6de96222351f1e5f7d3ada4027ac02142aa0e1928e4f29" | |
kserve-ci-e2e-test |
kubelet |
switch-graph-390f9-67fbf8748c-gm76t |
Started |
Started container switch-graph-390f9 | |
kserve-ci-e2e-test |
kubelet |
switch-graph-390f9-67fbf8748c-gm76t |
Pulled |
Successfully pulled image "quay.io/opendatahub/kserve-router@sha256:6060da2148ba78c06d6de96222351f1e5f7d3ada4027ac02142aa0e1928e4f29" in 2.411s (2.411s including waiting). Image size: 216232023 bytes. | |
kserve-ci-e2e-test |
kubelet |
switch-graph-390f9-67fbf8748c-gm76t |
Created |
Created container: switch-graph-390f9 | |
| (x8) | kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-74d68d6bdc-xqs95 |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.16:8080: connect: connection refused |
kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-1 |
InferenceServiceReady |
InferenceService [isvc-sklearn-graph-1] is Ready | |
| (x7) | kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-784cb989b8-ll9ps |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.38:8080: connect: connection refused |
| (x9) | kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-1 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
kubelet |
switch-graph-390f9-67fbf8748c-gm76t |
Killing |
Stopping container switch-graph-390f9 | |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-390f9-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-04c3d-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-04c3d-predictor-6c8787dd55 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-390f9-predictor-666f56949b-vxbx4 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-04c3d |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-04c3d": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-04c3d-predictor-7c964cdb94 |
SuccessfulCreate |
Created pod: error-404-isvc-04c3d-predictor-7c964cdb94-hzrhl | |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-390f9-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-390f9-predictor-5bdd998c9c-dxsnc |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-04c3d |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-04c3d": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-04c3d": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-04c3d-predictor-6c8787dd55 |
SuccessfulCreate |
Created pod: success-200-isvc-04c3d-predictor-6c8787dd55-x9kf9 | |
kserve-ci-e2e-test |
multus |
success-200-isvc-04c3d-predictor-6c8787dd55-x9kf9 |
AddedInterface |
Add eth0 [10.134.0.23/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-04c3d-predictor-6c8787dd55-x9kf9 |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1412" already present on machine | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-04c3d-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-04c3d-predictor-7c964cdb94 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-04c3d-predictor-6c8787dd55-x9kf9 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-04c3d-predictor-6c8787dd55-x9kf9 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-04c3d-predictor-7c964cdb94-hzrhl |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1412" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-04c3d-predictor-7c964cdb94-hzrhl |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-04c3d-predictor-7c964cdb94-hzrhl |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
multus |
error-404-isvc-04c3d-predictor-7c964cdb94-hzrhl |
AddedInterface |
Add eth0 [10.132.0.40/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-390f9-predictor-5bdd998c9c-dxsnc |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.21:8080: i/o timeout | |
| (x10) | kserve-ci-e2e-test |
v1beta1Controllers |
isvc-xgboost-graph |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
isvc-xgboost-graph |
InferenceServiceReady |
InferenceService [isvc-xgboost-graph] is Ready | |
kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-2 |
InferenceServiceReady |
InferenceService [isvc-sklearn-graph-2] is Ready | |
| (x10) | kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-2 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
kubelet |
model-chainer-77968cf4b8-qdr99 |
Started |
Started container model-chainer | |
kserve-ci-e2e-test |
kubelet |
model-chainer-77968cf4b8-qdr99 |
Created |
Created container: model-chainer | |
kserve-ci-e2e-test |
replicaset-controller |
model-chainer-77968cf4b8 |
SuccessfulCreate |
Created pod: model-chainer-77968cf4b8-qdr99 | |
kserve-ci-e2e-test |
deployment-controller |
model-chainer |
ScalingReplicaSet |
Scaled up replica set model-chainer-77968cf4b8 from 0 to 1 | |
kserve-ci-e2e-test |
InferenceGraphController |
model-chainer |
InferenceGraphReady |
InferenceGraph [model-chainer] is Ready | |
kserve-ci-e2e-test |
kubelet |
model-chainer-77968cf4b8-qdr99 |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:6060da2148ba78c06d6de96222351f1e5f7d3ada4027ac02142aa0e1928e4f29" already present on machine | |
kserve-ci-e2e-test |
multus |
model-chainer-77968cf4b8-qdr99 |
AddedInterface |
Add eth0 [10.134.0.24/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-74d68d6bdc-xqs95 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
multus |
error-404-isvc-0403e-predictor-65bc898d66-f8rjw |
AddedInterface |
Add eth0 [10.132.0.41/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-0403e-predictor-65bc898d66-f8rjw |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1412" already present on machine | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-0403e-predictor-65bc898d66 |
SuccessfulCreate |
Created pod: error-404-isvc-0403e-predictor-65bc898d66-f8rjw | |
kserve-ci-e2e-test |
multus |
success-200-isvc-0403e-predictor-5bfb47d58c-d59t9 |
AddedInterface |
Add eth0 [10.134.0.25/23] from ovn-kubernetes | |
| (x6) | kserve-ci-e2e-test |
kubelet |
switch-graph-390f9-67fbf8748c-gm76t |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-0403e-predictor-5bfb47d58c-d59t9 |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1412" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-0403e-predictor-5bfb47d58c-d59t9 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-0403e-predictor-5bfb47d58c-d59t9 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-0403e-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-0403e-predictor-65bc898d66 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-0403e-predictor-5bfb47d58c |
SuccessfulCreate |
Created pod: success-200-isvc-0403e-predictor-5bfb47d58c-d59t9 | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-0403e-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-0403e-predictor-5bfb47d58c from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-784cb989b8-ll9ps |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
model-chainer-77968cf4b8-qdr99 |
Killing |
Stopping container model-chainer | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-d76b874f9-gp6ts |
Killing |
Stopping container kserve-container | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-04c3d-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-04c3d-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-0403e-predictor-65bc898d66-f8rjw |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-0403e-predictor-65bc898d66-f8rjw |
Started |
Started container kserve-container | |
| (x10) | kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-d76b874f9-gp6ts |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.39:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-04c3d-predictor-7c964cdb94-hzrhl |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.40:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-04c3d-predictor-6c8787dd55-x9kf9 |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.23:8080: connect: connection refused |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-04c3d |
InferenceServiceReady |
InferenceService [error-404-isvc-04c3d] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-04c3d |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-04c3d |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-04c3d |
InferenceServiceReady |
InferenceService [success-200-isvc-04c3d] is Ready | |
| (x6) | kserve-ci-e2e-test |
kubelet |
model-chainer-77968cf4b8-qdr99 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-04c3d-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-0403e-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-0403e-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-04c3d-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
replicaset-controller |
switch-graph-04c3d-b98467bdb |
SuccessfulCreate |
Created pod: switch-graph-04c3d-b98467bdb-ssm57 | |
kserve-ci-e2e-test |
deployment-controller |
switch-graph-04c3d |
ScalingReplicaSet |
Scaled up replica set switch-graph-04c3d-b98467bdb from 0 to 1 | |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-04c3d |
InferenceGraphReady |
InferenceGraph [switch-graph-04c3d] is Ready | |
kserve-ci-e2e-test |
kubelet |
switch-graph-04c3d-b98467bdb-ssm57 |
Created |
Created container: switch-graph-04c3d | |
kserve-ci-e2e-test |
multus |
switch-graph-04c3d-b98467bdb-ssm57 |
AddedInterface |
Add eth0 [10.134.0.26/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
switch-graph-04c3d-b98467bdb-ssm57 |
Started |
Started container switch-graph-04c3d | |
kserve-ci-e2e-test |
kubelet |
switch-graph-04c3d-b98467bdb-ssm57 |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:6060da2148ba78c06d6de96222351f1e5f7d3ada4027ac02142aa0e1928e4f29" already present on machine | |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-0403e-predictor-5bfb47d58c-d59t9 |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.25:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-0403e-predictor-65bc898d66-f8rjw |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.41:8080: connect: connection refused |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-04c3d-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-04c3d-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-0403e |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-0403e |
InferenceServiceReady |
InferenceService [error-404-isvc-0403e] is Ready | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-0403e |
InferenceServiceReady |
InferenceService [success-200-isvc-0403e] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-0403e |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-04c3d |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-04c3d |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-0403e-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-0403e-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-0403e |
InferenceGraphReady |
InferenceGraph [sequence-graph-0403e] is Ready | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-04c3d |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
deployment-controller |
sequence-graph-0403e |
ScalingReplicaSet |
Scaled up replica set sequence-graph-0403e-6dd9d7fbd6 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
sequence-graph-0403e-6dd9d7fbd6 |
SuccessfulCreate |
Created pod: sequence-graph-0403e-6dd9d7fbd6-55qr5 | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-04c3d |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
multus |
sequence-graph-0403e-6dd9d7fbd6-55qr5 |
AddedInterface |
Add eth0 [10.134.0.27/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-0403e-6dd9d7fbd6-55qr5 |
Started |
Started container sequence-graph-0403e | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-0403e-6dd9d7fbd6-55qr5 |
Created |
Created container: sequence-graph-0403e | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-0403e-6dd9d7fbd6-55qr5 |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:6060da2148ba78c06d6de96222351f1e5f7d3ada4027ac02142aa0e1928e4f29" already present on machine | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-0403e-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-0403e-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-0403e |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-0403e |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
multus |
error-404-isvc-ccdbb-predictor-c7cfb5d-jr9f2 |
AddedInterface |
Add eth0 [10.132.0.42/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-ccdbb-predictor-c7cfb5d |
SuccessfulCreate |
Created pod: error-404-isvc-ccdbb-predictor-c7cfb5d-jr9f2 | |
kserve-ci-e2e-test |
kubelet |
switch-graph-04c3d-b98467bdb-ssm57 |
Killing |
Stopping container switch-graph-04c3d | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-ccdbb |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-ccdbb": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-ccdbb": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-04c3d-predictor-6c8787dd55-x9kf9 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-04c3d-predictor-7c964cdb94-hzrhl |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
multus |
success-200-isvc-ccdbb-predictor-697459d95f-7kx24 |
AddedInterface |
Add eth0 [10.134.0.28/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-ccdbb |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-ccdbb": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-ccdbb-predictor-c7cfb5d-jr9f2 |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1412" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-ccdbb-predictor-697459d95f-7kx24 |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1412" already present on machine | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-ccdbb-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-ccdbb-predictor-697459d95f from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-ccdbb-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-ccdbb-predictor-c7cfb5d from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-ccdbb-predictor-697459d95f |
SuccessfulCreate |
Created pod: success-200-isvc-ccdbb-predictor-697459d95f-7kx24 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-ccdbb-predictor-c7cfb5d-jr9f2 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-ccdbb-predictor-697459d95f-7kx24 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-ccdbb-predictor-697459d95f-7kx24 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-ccdbb-predictor-c7cfb5d-jr9f2 |
Started |
Started container kserve-container | |
| (x6) | kserve-ci-e2e-test |
kubelet |
switch-graph-04c3d-b98467bdb-ssm57 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-516af |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-516af": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-516af-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-516af-predictor-7dc5688b5 from 0 to 1 | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-ccdbb-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
multus |
error-404-isvc-516af-predictor-5f8c67c956-pwv6b |
AddedInterface |
Add eth0 [10.132.0.43/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-0403e-predictor-5bfb47d58c-d59t9 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-516af-predictor-5f8c67c956-pwv6b |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1412" already present on machine | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-516af |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-516af": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-516af": the object has been modified; please apply your changes to the latest version and try again | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-ccdbb-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-516af |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-516af": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-516af |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-516af": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-516af": the object has been modified; please apply your changes to the latest version and try again | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-ccdbb-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-516af-predictor-5f8c67c956-pwv6b |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-0403e-predictor-65bc898d66-f8rjw |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-516af-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-516af-predictor-5f8c67c956 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-516af-predictor-7dc5688b5 |
SuccessfulCreate |
Created pod: success-200-isvc-516af-predictor-7dc5688b5-z5fmq | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-516af-predictor-7dc5688b5-z5fmq |
Started |
Started container kserve-container | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-ccdbb-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
sequence-graph-0403e-6dd9d7fbd6-55qr5 |
Killing |
Stopping container sequence-graph-0403e | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-516af-predictor-7dc5688b5-z5fmq |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-516af-predictor-7dc5688b5-z5fmq |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1412" already present on machine | |
kserve-ci-e2e-test |
multus |
success-200-isvc-516af-predictor-7dc5688b5-z5fmq |
AddedInterface |
Add eth0 [10.134.0.29/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-516af-predictor-5f8c67c956 |
SuccessfulCreate |
Created pod: error-404-isvc-516af-predictor-5f8c67c956-pwv6b | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-516af-predictor-5f8c67c956-pwv6b |
Started |
Started container kserve-container | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-ccdbb |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-ccdbb |
InferenceServiceReady |
InferenceService [error-404-isvc-ccdbb] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-ccdbb |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-ccdbb |
InferenceServiceReady |
InferenceService [success-200-isvc-ccdbb] is Ready | |
| (x6) | kserve-ci-e2e-test |
kubelet |
sequence-graph-0403e-6dd9d7fbd6-55qr5 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-516af-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-516af-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-516af-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-516af-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
replicaset-controller |
ensemble-graph-ccdbb-59bfb89b8 |
SuccessfulCreate |
Created pod: ensemble-graph-ccdbb-59bfb89b8-8swsg | |
kserve-ci-e2e-test |
deployment-controller |
ensemble-graph-ccdbb |
ScalingReplicaSet |
Scaled up replica set ensemble-graph-ccdbb-59bfb89b8 from 0 to 1 | |
kserve-ci-e2e-test |
InferenceGraphController |
ensemble-graph-ccdbb |
InferenceGraphReady |
InferenceGraph [ensemble-graph-ccdbb] is Ready | |
kserve-ci-e2e-test |
InferenceGraphController |
ensemble-graph-ccdbb |
UpdateFailed |
Failed to update status for InferenceGraph "ensemble-graph-ccdbb": Operation cannot be fulfilled on inferencegraphs.serving.kserve.io "ensemble-graph-ccdbb": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
InferenceGraphController |
ensemble-graph-ccdbb |
InternalError |
fails to update InferenceGraph status: Operation cannot be fulfilled on inferencegraphs.serving.kserve.io "ensemble-graph-ccdbb": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-ccdbb-59bfb89b8-8swsg |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:6060da2148ba78c06d6de96222351f1e5f7d3ada4027ac02142aa0e1928e4f29" already present on machine | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-ccdbb-59bfb89b8-8swsg |
Created |
Created container: ensemble-graph-ccdbb | |
kserve-ci-e2e-test |
multus |
ensemble-graph-ccdbb-59bfb89b8-8swsg |
AddedInterface |
Add eth0 [10.134.0.30/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-ccdbb-59bfb89b8-8swsg |
Started |
Started container ensemble-graph-ccdbb | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-ccdbb-59bfb89b8-8swsg |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "ensemble-graph-ccdbb-serving-cert" not found | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-ccdbb-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-ccdbb-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-ccdbb-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-ccdbb-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-ccdbb-predictor-697459d95f-7kx24 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-df772-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-df772-predictor-875748d7f from 0 to 1 | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-df772 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-df772": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-df772 |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-df772": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-df772": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-ccdbb-59bfb89b8-8swsg |
Killing |
Stopping container ensemble-graph-ccdbb | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-df772-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-df772-predictor-5c6cd9cb6b from 0 to 1 | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-df772 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-df772": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-df772-predictor-5c6cd9cb6b |
SuccessfulCreate |
Created pod: error-404-isvc-df772-predictor-5c6cd9cb6b-6bgvz | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-df772-predictor-5c6cd9cb6b-6bgvz |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1412" already present on machine | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-df772-predictor-875748d7f |
SuccessfulCreate |
Created pod: success-200-isvc-df772-predictor-875748d7f-jdp2w | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-df772-predictor-5c6cd9cb6b-6bgvz |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-df772 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-df772": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-df772": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-ccdbb-predictor-c7cfb5d-jr9f2 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-df772-predictor-5c6cd9cb6b-6bgvz |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
multus |
error-404-isvc-df772-predictor-5c6cd9cb6b-6bgvz |
AddedInterface |
Add eth0 [10.132.0.44/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
multus |
success-200-isvc-df772-predictor-875748d7f-jdp2w |
AddedInterface |
Add eth0 [10.134.0.31/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-516af |
InferenceServiceReady |
InferenceService [success-200-isvc-516af] is Ready | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-df772-predictor-875748d7f-jdp2w |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-df772-predictor-875748d7f-jdp2w |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1412" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-df772-predictor-875748d7f-jdp2w |
Created |
Created container: kserve-container | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-516af |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x7) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-ccdbb-predictor-c7cfb5d-jr9f2 |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.42:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-516af |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-ccdbb-predictor-697459d95f-7kx24 |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.28:8080: connect: connection refused |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-516af |
InferenceServiceReady |
InferenceService [error-404-isvc-516af] is Ready | |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-516af |
InferenceGraphReady |
InferenceGraph [sequence-graph-516af] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
sequence-graph-516af |
ScalingReplicaSet |
Scaled up replica set sequence-graph-516af-7cdf98dc78 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
sequence-graph-516af-7cdf98dc78 |
SuccessfulCreate |
Created pod: sequence-graph-516af-7cdf98dc78-cwt5d | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-516af-7cdf98dc78-cwt5d |
Started |
Started container sequence-graph-516af | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-516af-7cdf98dc78-cwt5d |
Created |
Created container: sequence-graph-516af | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-516af-7cdf98dc78-cwt5d |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:6060da2148ba78c06d6de96222351f1e5f7d3ada4027ac02142aa0e1928e4f29" already present on machine | |
kserve-ci-e2e-test |
multus |
sequence-graph-516af-7cdf98dc78-cwt5d |
AddedInterface |
Add eth0 [10.134.0.32/23] from ovn-kubernetes | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-516af-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-516af-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-516af-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-516af-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x6) | kserve-ci-e2e-test |
kubelet |
ensemble-graph-ccdbb-59bfb89b8-8swsg |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-ed24b |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-ed24b": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-ed24b-predictor-648cf478d9 |
SuccessfulCreate |
Created pod: success-200-isvc-ed24b-predictor-648cf478d9-kpr96 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-516af-predictor-5f8c67c956-pwv6b |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-ed24b |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-ed24b": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-ed24b |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-ed24b": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-ed24b": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-ed24b-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-ed24b-predictor-945b44ddd from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-ed24b-predictor-945b44ddd |
SuccessfulCreate |
Created pod: error-404-isvc-ed24b-predictor-945b44ddd-lpdjg | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-516af-predictor-7dc5688b5-z5fmq |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-516af-7cdf98dc78-cwt5d |
Killing |
Stopping container sequence-graph-516af | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-ed24b |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-ed24b": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-ed24b": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-ed24b-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-ed24b-predictor-648cf478d9 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-ed24b-predictor-648cf478d9-kpr96 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
multus |
success-200-isvc-ed24b-predictor-648cf478d9-kpr96 |
AddedInterface |
Add eth0 [10.134.0.33/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-ed24b-predictor-648cf478d9-kpr96 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-ed24b-predictor-945b44ddd-lpdjg |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1412" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-ed24b-predictor-648cf478d9-kpr96 |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1412" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-ed24b-predictor-945b44ddd-lpdjg |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-ed24b-predictor-945b44ddd-lpdjg |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
multus |
error-404-isvc-ed24b-predictor-945b44ddd-lpdjg |
AddedInterface |
Add eth0 [10.132.0.45/23] from ovn-kubernetes | |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-516af-predictor-7dc5688b5-z5fmq |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.29:8080: connect: connection refused |
| (x7) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-516af-predictor-5f8c67c956-pwv6b |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.43:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-df772-predictor-5c6cd9cb6b-6bgvz |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.44:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-df772-predictor-875748d7f-jdp2w |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.31:8080: connect: connection refused |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-df772-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-df772-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-df772-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-df772-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-df772 |
InferenceServiceReady |
InferenceService [error-404-isvc-df772] is Ready | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-df772 |
InferenceServiceReady |
InferenceService [success-200-isvc-df772] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-df772 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-df772 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x6) | kserve-ci-e2e-test |
kubelet |
sequence-graph-516af-7cdf98dc78-cwt5d |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-ed24b-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-ed24b-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-df772-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-df772-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-df772-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-df772-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
replicaset-controller |
ensemble-graph-df772-7fb98745c |
SuccessfulCreate |
Created pod: ensemble-graph-df772-7fb98745c-jlqxb | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-df772-7fb98745c-jlqxb |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:6060da2148ba78c06d6de96222351f1e5f7d3ada4027ac02142aa0e1928e4f29" already present on machine | |
kserve-ci-e2e-test |
multus |
ensemble-graph-df772-7fb98745c-jlqxb |
AddedInterface |
Add eth0 [10.134.0.34/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-df772-7fb98745c-jlqxb |
Created |
Created container: ensemble-graph-df772 | |
kserve-ci-e2e-test |
deployment-controller |
ensemble-graph-df772 |
ScalingReplicaSet |
Scaled up replica set ensemble-graph-df772-7fb98745c from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-df772-7fb98745c-jlqxb |
Started |
Started container ensemble-graph-df772 | |
kserve-ci-e2e-test |
InferenceGraphController |
ensemble-graph-df772 |
InferenceGraphReady |
InferenceGraph [ensemble-graph-df772] is Ready | |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-ed24b-predictor-945b44ddd-lpdjg |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.45:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-ed24b-predictor-648cf478d9-kpr96 |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.33:8080: connect: connection refused |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-ed24b-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-ed24b-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-ed24b |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-ed24b |
InferenceServiceReady |
InferenceService [success-200-isvc-ed24b] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-ed24b |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-ed24b |
InferenceServiceReady |
InferenceService [error-404-isvc-ed24b] is Ready | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
ensemble-graph-df772 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
ensemble-graph-df772 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
replicaset-controller |
sequence-graph-ed24b-7c6b74f4df |
SuccessfulCreate |
Created pod: sequence-graph-ed24b-7c6b74f4df-gtjnk | |
kserve-ci-e2e-test |
deployment-controller |
sequence-graph-ed24b |
ScalingReplicaSet |
Scaled up replica set sequence-graph-ed24b-7c6b74f4df from 0 to 1 | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
ensemble-graph-df772 |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-ed24b |
InferenceGraphReady |
InferenceGraph [sequence-graph-ed24b] is Ready | |
kserve-ci-e2e-test |
multus |
sequence-graph-ed24b-7c6b74f4df-gtjnk |
AddedInterface |
Add eth0 [10.134.0.35/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
ensemble-graph-df772 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-ed24b-7c6b74f4df-gtjnk |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:6060da2148ba78c06d6de96222351f1e5f7d3ada4027ac02142aa0e1928e4f29" already present on machine | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-ed24b-7c6b74f4df-gtjnk |
Created |
Created container: sequence-graph-ed24b | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-ed24b-7c6b74f4df-gtjnk |
Started |
Started container sequence-graph-ed24b | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-ed24b-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-ed24b-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-ed24b-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-ed24b-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-ed24b |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-ed24b |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-ed24b |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-ed24b |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-78581 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-78581": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-df772-predictor-875748d7f-jdp2w |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-78581-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-78581-predictor-8648c458b4 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-df772-7fb98745c-jlqxb |
Killing |
Stopping container ensemble-graph-df772 | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-78581 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-78581": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-78581-predictor-d6d9bf857 |
SuccessfulCreate |
Created pod: success-200-isvc-78581-predictor-d6d9bf857-m87d6 | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-78581-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-78581-predictor-d6d9bf857 from 0 to 1 | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-78581 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-78581": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-78581": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-df772-predictor-5c6cd9cb6b-6bgvz |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-78581 |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-78581": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-78581": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-78581-predictor-8648c458b4 |
SuccessfulCreate |
Created pod: error-404-isvc-78581-predictor-8648c458b4-v2c7w | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-78581-predictor-d6d9bf857-m87d6 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
multus |
success-200-isvc-78581-predictor-d6d9bf857-m87d6 |
AddedInterface |
Add eth0 [10.134.0.36/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-78581-predictor-8648c458b4-v2c7w |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-78581-predictor-8648c458b4-v2c7w |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-78581-predictor-8648c458b4-v2c7w |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1412" already present on machine | |
kserve-ci-e2e-test |
multus |
error-404-isvc-78581-predictor-8648c458b4-v2c7w |
AddedInterface |
Add eth0 [10.132.0.46/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-78581-predictor-d6d9bf857-m87d6 |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1412" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-78581-predictor-d6d9bf857-m87d6 |
Started |
Started container kserve-container | |
| (x6) | kserve-ci-e2e-test |
kubelet |
ensemble-graph-df772-7fb98745c-jlqxb |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-89f53-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-89f53-predictor-7b489589b4 from 0 to 1 | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-89f53 |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-89f53": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-89f53": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-ed24b-7c6b74f4df-gtjnk |
Killing |
Stopping container sequence-graph-ed24b | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-ed24b-predictor-945b44ddd-lpdjg |
Killing |
Stopping container kserve-container | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-78581-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-78581-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-89f53 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-89f53": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-89f53-predictor-646dcc4bbf |
SuccessfulCreate |
Created pod: success-200-isvc-89f53-predictor-646dcc4bbf-8hgx4 | |
kserve-ci-e2e-test |
multus |
error-404-isvc-89f53-predictor-7b489589b4-4c4pr |
AddedInterface |
Add eth0 [10.132.0.47/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-89f53 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-89f53": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-ed24b-predictor-648cf478d9-kpr96 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-89f53 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-89f53": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-89f53": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-89f53-predictor-7b489589b4 |
SuccessfulCreate |
Created pod: error-404-isvc-89f53-predictor-7b489589b4-4c4pr | |
kserve-ci-e2e-test |
multus |
success-200-isvc-89f53-predictor-646dcc4bbf-8hgx4 |
AddedInterface |
Add eth0 [10.134.0.37/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-89f53-predictor-646dcc4bbf-8hgx4 |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1412" already present on machine | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-89f53-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-89f53-predictor-646dcc4bbf from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-89f53-predictor-646dcc4bbf-8hgx4 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-89f53-predictor-7b489589b4-4c4pr |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1412" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-89f53-predictor-646dcc4bbf-8hgx4 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-89f53-predictor-7b489589b4-4c4pr |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-89f53-predictor-7b489589b4-4c4pr |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-89f53-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-89f53-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-78581-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-78581-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-78581 |
InferenceServiceReady |
InferenceService [error-404-isvc-78581] is Ready | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-78581 |
InferenceServiceReady |
InferenceService [success-200-isvc-78581] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-78581 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-78581 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x6) | kserve-ci-e2e-test |
kubelet |
sequence-graph-ed24b-7c6b74f4df-gtjnk |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-89f53-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-89f53-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
splitter-graph-78581-5cd4b8fdb7-tts6g |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "splitter-graph-78581-serving-cert" not found | |
kserve-ci-e2e-test |
deployment-controller |
splitter-graph-78581 |
ScalingReplicaSet |
Scaled up replica set splitter-graph-78581-5cd4b8fdb7 from 0 to 1 | |
kserve-ci-e2e-test |
InferenceGraphController |
splitter-graph-78581 |
InferenceGraphReady |
InferenceGraph [splitter-graph-78581] is Ready | |
kserve-ci-e2e-test |
replicaset-controller |
splitter-graph-78581-5cd4b8fdb7 |
SuccessfulCreate |
Created pod: splitter-graph-78581-5cd4b8fdb7-tts6g | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-78581-5cd4b8fdb7-tts6g |
Created |
Created container: splitter-graph-78581 | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-78581-5cd4b8fdb7-tts6g |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:6060da2148ba78c06d6de96222351f1e5f7d3ada4027ac02142aa0e1928e4f29" already present on machine | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-78581-5cd4b8fdb7-tts6g |
Started |
Started container splitter-graph-78581 | |
kserve-ci-e2e-test |
multus |
splitter-graph-78581-5cd4b8fdb7-tts6g |
AddedInterface |
Add eth0 [10.134.0.38/23] from ovn-kubernetes | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-78581-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-78581-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-78581-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-78581-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-84e06-predictor-579c9cdd97-z77lb |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1412" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-84e06-predictor-59d6c4b5b8-qwgj5 |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1412" already present on machine | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-84e06 |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-84e06": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-84e06": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-84e06 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-84e06": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-84e06 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-84e06": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-84e06": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-84e06-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-84e06-predictor-59d6c4b5b8 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-84e06-predictor-59d6c4b5b8 |
SuccessfulCreate |
Created pod: error-404-isvc-84e06-predictor-59d6c4b5b8-qwgj5 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-84e06-predictor-59d6c4b5b8-qwgj5 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-84e06-predictor-59d6c4b5b8-qwgj5 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-84e06 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-84e06": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-84e06-predictor-579c9cdd97-z77lb |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-78581-predictor-8648c458b4-v2c7w |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-84e06-predictor-579c9cdd97 |
SuccessfulCreate |
Created pod: success-200-isvc-84e06-predictor-579c9cdd97-z77lb | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-84e06-predictor-579c9cdd97-z77lb |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-78581-5cd4b8fdb7-tts6g |
Killing |
Stopping container splitter-graph-78581 | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-84e06-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-84e06-predictor-579c9cdd97 from 0 to 1 | |
kserve-ci-e2e-test |
multus |
error-404-isvc-84e06-predictor-59d6c4b5b8-qwgj5 |
AddedInterface |
Add eth0 [10.132.0.48/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-78581-predictor-d6d9bf857-m87d6 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
multus |
success-200-isvc-84e06-predictor-579c9cdd97-z77lb |
AddedInterface |
Add eth0 [10.134.0.39/23] from ovn-kubernetes | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-89f53 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-78581-predictor-d6d9bf857-m87d6 |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.36:8080: connect: connection refused |
| (x7) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-78581-predictor-8648c458b4-v2c7w |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.46:8080: connect: connection refused |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-89f53 |
InferenceServiceReady |
InferenceService [success-200-isvc-89f53] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-89f53 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-89f53 |
InferenceServiceReady |
InferenceService [error-404-isvc-89f53] is Ready | |
kserve-ci-e2e-test |
kubelet |
switch-graph-89f53-d7bd89598-qk2zv |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "switch-graph-89f53-serving-cert" not found | |
kserve-ci-e2e-test |
replicaset-controller |
switch-graph-89f53-d7bd89598 |
SuccessfulCreate |
Created pod: switch-graph-89f53-d7bd89598-qk2zv | |
kserve-ci-e2e-test |
deployment-controller |
switch-graph-89f53 |
ScalingReplicaSet |
Scaled up replica set switch-graph-89f53-d7bd89598 from 0 to 1 | |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-89f53 |
InferenceGraphReady |
InferenceGraph [switch-graph-89f53] is Ready | |
kserve-ci-e2e-test |
multus |
switch-graph-89f53-d7bd89598-qk2zv |
AddedInterface |
Add eth0 [10.134.0.40/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
switch-graph-89f53-d7bd89598-qk2zv |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:6060da2148ba78c06d6de96222351f1e5f7d3ada4027ac02142aa0e1928e4f29" already present on machine | |
kserve-ci-e2e-test |
kubelet |
switch-graph-89f53-d7bd89598-qk2zv |
Created |
Created container: switch-graph-89f53 | |
kserve-ci-e2e-test |
kubelet |
switch-graph-89f53-d7bd89598-qk2zv |
Started |
Started container switch-graph-89f53 | |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-89f53-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-89f53-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x6) | kserve-ci-e2e-test |
kubelet |
splitter-graph-78581-5cd4b8fdb7-tts6g |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-84e06-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-84e06-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-84e06-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-84e06-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-89f53 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-89f53 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-89f53-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-89f53-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-84e06-predictor-579c9cdd97-z77lb |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.39:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-84e06-predictor-59d6c4b5b8-qwgj5 |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.48:8080: connect: connection refused |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-89f53 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-89f53 |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-84e06 |
InferenceServiceReady |
InferenceService [success-200-isvc-84e06] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-84e06 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-84e06 |
InferenceServiceReady |
InferenceService [error-404-isvc-84e06] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-84e06 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-84e06-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-84e06-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
InferenceGraphController |
splitter-graph-84e06 |
InferenceGraphReady |
InferenceGraph [splitter-graph-84e06] is Ready | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-84e06-7f457f648b-sqvbh |
Created |
Created container: splitter-graph-84e06 | |
kserve-ci-e2e-test |
deployment-controller |
splitter-graph-84e06 |
ScalingReplicaSet |
Scaled up replica set splitter-graph-84e06-7f457f648b from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
splitter-graph-84e06-7f457f648b |
SuccessfulCreate |
Created pod: splitter-graph-84e06-7f457f648b-sqvbh | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-84e06-7f457f648b-sqvbh |
Started |
Started container splitter-graph-84e06 | |
kserve-ci-e2e-test |
multus |
splitter-graph-84e06-7f457f648b-sqvbh |
AddedInterface |
Add eth0 [10.134.0.41/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-84e06-7f457f648b-sqvbh |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:6060da2148ba78c06d6de96222351f1e5f7d3ada4027ac02142aa0e1928e4f29" already present on machine | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-84e06-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-84e06-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
splitter-graph-84e06 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
splitter-graph-84e06 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
splitter-graph-84e06 |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
splitter-graph-84e06 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-84e06-7f457f648b-sqvbh |
Killing |
Stopping container splitter-graph-84e06 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-84e06-predictor-579c9cdd97-z77lb |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-84e06-predictor-59d6c4b5b8-qwgj5 |
Killing |
Stopping container kserve-container | |
| (x6) | kserve-ci-e2e-test |
kubelet |
splitter-graph-84e06-7f457f648b-sqvbh |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
kubelet |
switch-graph-89f53-d7bd89598-qk2zv |
Killing |
Stopping container switch-graph-89f53 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-89f53-predictor-646dcc4bbf-8hgx4 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-89f53-predictor-7b489589b4-4c4pr |
Killing |
Stopping container kserve-container | |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-89f53-predictor-646dcc4bbf-8hgx4 |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.37:8080: connect: connection refused |
| (x7) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-89f53-predictor-7b489589b4-4c4pr |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.47:8080: connect: connection refused |
| (x5) | kserve-ci-e2e-test |
kubelet |
switch-graph-89f53-d7bd89598-qk2zv |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |