| Time | Namespace | Component | RelatedObject | Reason | Message |
|---|---|---|---|---|---|
kserve-ci-e2e-test |
error-404-isvc-2d44a-predictor-6bd887658-bj6zv |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-2d44a-predictor-6bd887658-bj6zv to ip-10-0-130-140.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-1fc59-predictor-6797966c7-jp9kb |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-1fc59-predictor-6797966c7-jp9kb to ip-10-0-130-229.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-d1f99-predictor-79c6d7db55-qjzfp |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-d1f99-predictor-79c6d7db55-qjzfp to ip-10-0-130-229.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-cee76-predictor-84f4bbdc7-bf595 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-cee76-predictor-84f4bbdc7-bf595 to ip-10-0-130-229.ec2.internal | ||
kserve-ci-e2e-test |
isvc-xgboost-graph-predictor-784cb989b8-5hnph |
Scheduled |
Successfully assigned kserve-ci-e2e-test/isvc-xgboost-graph-predictor-784cb989b8-5hnph to ip-10-0-130-229.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-41c6b-predictor-687c7b4cb4-w7l5r |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-41c6b-predictor-687c7b4cb4-w7l5r to ip-10-0-130-140.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-c9f8b-predictor-b9f4c48f7-z6skf |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-c9f8b-predictor-b9f4c48f7-z6skf to ip-10-0-130-229.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-b8642-predictor-89bc8697-8tq5g |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-b8642-predictor-89bc8697-8tq5g to ip-10-0-130-229.ec2.internal | ||
kserve-ci-e2e-test |
switch-graph-c9f8b-5c958b9899-79ld4 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/switch-graph-c9f8b-5c958b9899-79ld4 to ip-10-0-130-140.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-9c7d6-predictor-6d4df94467-hc4fs |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-9c7d6-predictor-6d4df94467-hc4fs to ip-10-0-130-229.ec2.internal | ||
kserve-ci-e2e-test |
isvc-sklearn-graph-2-predictor-654489c865-9qjkc |
Scheduled |
Successfully assigned kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-654489c865-9qjkc to ip-10-0-130-229.ec2.internal | ||
kserve-ci-e2e-test |
ensemble-graph-b2be2-6df585b7fc-bqfmb |
Scheduled |
Successfully assigned kserve-ci-e2e-test/ensemble-graph-b2be2-6df585b7fc-bqfmb to ip-10-0-130-140.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-41c6b-predictor-86f5c7cb45-9h6d8 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-41c6b-predictor-86f5c7cb45-9h6d8 to ip-10-0-130-229.ec2.internal | ||
kserve-ci-e2e-test |
switch-graph-d1f99-5f9847b898-pp994 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/switch-graph-d1f99-5f9847b898-pp994 to ip-10-0-130-140.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-cee76-predictor-866cc8b64-4mdx8 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-cee76-predictor-866cc8b64-4mdx8 to ip-10-0-130-140.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-36a90-predictor-749c75bdbc-lnz98 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-36a90-predictor-749c75bdbc-lnz98 to ip-10-0-130-229.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-b2be2-predictor-5f8c869854-s6kpj |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-b2be2-predictor-5f8c869854-s6kpj to ip-10-0-130-140.ec2.internal | ||
kserve-ci-e2e-test |
isvc-sklearn-graph-1-predictor-695857997-skcx9 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-695857997-skcx9 to ip-10-0-130-140.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-36a90-predictor-574bcd5574-cmn2x |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-36a90-predictor-574bcd5574-cmn2x to ip-10-0-130-140.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-2d44a-predictor-595d486c67-sz8xh |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-2d44a-predictor-595d486c67-sz8xh to ip-10-0-130-229.ec2.internal | ||
kserve-ci-e2e-test |
model-chainer-78ccc649-29b6r |
Scheduled |
Successfully assigned kserve-ci-e2e-test/model-chainer-78ccc649-29b6r to ip-10-0-130-140.ec2.internal | ||
kserve-ci-e2e-test |
splitter-graph-41c6b-55c4b9fc75-9pkkw |
Scheduled |
Successfully assigned kserve-ci-e2e-test/splitter-graph-41c6b-55c4b9fc75-9pkkw to ip-10-0-130-140.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-d1f99-predictor-6f8c58666-kmthn |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-d1f99-predictor-6f8c58666-kmthn to ip-10-0-130-140.ec2.internal | ||
kserve-ci-e2e-test |
splitter-graph-1fc59-6bbd795f46-rvh7v |
Scheduled |
Successfully assigned kserve-ci-e2e-test/splitter-graph-1fc59-6bbd795f46-rvh7v to ip-10-0-130-140.ec2.internal | ||
kserve-ci-e2e-test |
sequence-graph-cee76-7d9bc88ff6-j7t7v |
Scheduled |
Successfully assigned kserve-ci-e2e-test/sequence-graph-cee76-7d9bc88ff6-j7t7v to ip-10-0-130-140.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-1fc59-predictor-856bfdcfb-97jv7 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-1fc59-predictor-856bfdcfb-97jv7 to ip-10-0-130-140.ec2.internal | ||
kserve-ci-e2e-test |
sequence-graph-b8642-bbb4f56f-n44lf |
Scheduled |
Successfully assigned kserve-ci-e2e-test/sequence-graph-b8642-bbb4f56f-n44lf to ip-10-0-130-140.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-9c7d6-predictor-5fb75bc8f4-f4r9m |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-9c7d6-predictor-5fb75bc8f4-f4r9m to ip-10-0-130-140.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-b2be2-predictor-855dffb447-hvjpx |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-b2be2-predictor-855dffb447-hvjpx to ip-10-0-130-229.ec2.internal | ||
kserve-ci-e2e-test |
switch-graph-9c7d6-58455857bf-xj6x5 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/switch-graph-9c7d6-58455857bf-xj6x5 to ip-10-0-130-140.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-c9f8b-predictor-667b95c6b8-wknl7 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-c9f8b-predictor-667b95c6b8-wknl7 to ip-10-0-130-140.ec2.internal | ||
kserve-ci-e2e-test |
sequence-graph-2d44a-d4fd86597-7j4s5 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/sequence-graph-2d44a-d4fd86597-7j4s5 to ip-10-0-130-140.ec2.internal | ||
kserve-ci-e2e-test |
ensemble-graph-36a90-744c45996f-jphzx |
Scheduled |
Successfully assigned kserve-ci-e2e-test/ensemble-graph-36a90-744c45996f-jphzx to ip-10-0-130-140.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-b8642-predictor-54bb7c4df6-kbbt5 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-b8642-predictor-54bb7c4df6-kbbt5 to ip-10-0-130-140.ec2.internal | ||
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-d1f99-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-d1f99-predictor-79c6d7db55 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-d1f99-predictor-79c6d7db55 |
SuccessfulCreate |
Created pod: success-200-isvc-d1f99-predictor-79c6d7db55-qjzfp | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-d1f99-predictor-6f8c58666 |
SuccessfulCreate |
Created pod: error-404-isvc-d1f99-predictor-6f8c58666-kmthn | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-d1f99-predictor-6f8c58666-kmthn |
Pulling |
Pulling image "quay.io/opendatahub/error-404-isvc:odh-pr-1407" | |
kserve-ci-e2e-test |
replicaset-controller |
isvc-xgboost-graph-predictor-784cb989b8 |
SuccessfulCreate |
Created pod: isvc-xgboost-graph-predictor-784cb989b8-5hnph | |
kserve-ci-e2e-test |
multus |
error-404-isvc-d1f99-predictor-6f8c58666-kmthn |
AddedInterface |
Add eth0 [10.134.0.35/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
replicaset-controller |
isvc-sklearn-graph-1-predictor-695857997 |
SuccessfulCreate |
Created pod: isvc-sklearn-graph-1-predictor-695857997-skcx9 | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-695857997-skcx9 |
Pulling |
Pulling image "quay.io/opendatahub/kserve-storage-initializer@sha256:c49c84e69ddbb36db782821d4aa3d203f458a00c0c04dd506eb662aae339bb8a" | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-d1f99-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-d1f99-predictor-6f8c58666 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-d1f99-predictor-79c6d7db55-qjzfp |
Pulling |
Pulling image "quay.io/opendatahub/success-200-isvc:odh-pr-1407" | |
kserve-ci-e2e-test |
multus |
isvc-sklearn-graph-1-predictor-695857997-skcx9 |
AddedInterface |
Add eth0 [10.134.0.34/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
deployment-controller |
isvc-xgboost-graph-predictor |
ScalingReplicaSet |
Scaled up replica set isvc-xgboost-graph-predictor-784cb989b8 from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
isvc-sklearn-graph-1-predictor |
ScalingReplicaSet |
Scaled up replica set isvc-sklearn-graph-1-predictor-695857997 from 0 to 1 | |
kserve-ci-e2e-test |
multus |
isvc-sklearn-graph-2-predictor-654489c865-9qjkc |
AddedInterface |
Add eth0 [10.132.0.20/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
multus |
success-200-isvc-d1f99-predictor-79c6d7db55-qjzfp |
AddedInterface |
Add eth0 [10.132.0.18/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-784cb989b8-5hnph |
Pulling |
Pulling image "quay.io/opendatahub/kserve-storage-initializer@sha256:c49c84e69ddbb36db782821d4aa3d203f458a00c0c04dd506eb662aae339bb8a" | |
kserve-ci-e2e-test |
replicaset-controller |
isvc-sklearn-graph-2-predictor-654489c865 |
SuccessfulCreate |
Created pod: isvc-sklearn-graph-2-predictor-654489c865-9qjkc | |
kserve-ci-e2e-test |
deployment-controller |
isvc-sklearn-graph-2-predictor |
ScalingReplicaSet |
Scaled up replica set isvc-sklearn-graph-2-predictor-654489c865 from 0 to 1 | |
kserve-ci-e2e-test |
multus |
isvc-xgboost-graph-predictor-784cb989b8-5hnph |
AddedInterface |
Add eth0 [10.132.0.19/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-654489c865-9qjkc |
Pulling |
Pulling image "quay.io/opendatahub/kserve-storage-initializer@sha256:c49c84e69ddbb36db782821d4aa3d203f458a00c0c04dd506eb662aae339bb8a" | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-654489c865-9qjkc |
Pulled |
Successfully pulled image "quay.io/opendatahub/kserve-storage-initializer@sha256:c49c84e69ddbb36db782821d4aa3d203f458a00c0c04dd506eb662aae339bb8a" in 11.949s (11.949s including waiting). Image size: 300960724 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-784cb989b8-5hnph |
Pulled |
Successfully pulled image "quay.io/opendatahub/kserve-storage-initializer@sha256:c49c84e69ddbb36db782821d4aa3d203f458a00c0c04dd506eb662aae339bb8a" in 12.11s (12.11s including waiting). Image size: 300960724 bytes. | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-d1f99-predictor-6f8c58666-kmthn |
Pulled |
Successfully pulled image "quay.io/opendatahub/error-404-isvc:odh-pr-1407" in 13.443s (13.443s including waiting). Image size: 1333455482 bytes. | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-d1f99-predictor-79c6d7db55-qjzfp |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-d1f99-predictor-6f8c58666-kmthn |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-784cb989b8-5hnph |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-784cb989b8-5hnph |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-695857997-skcx9 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-d1f99-predictor-79c6d7db55-qjzfp |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-695857997-skcx9 |
Pulled |
Successfully pulled image "quay.io/opendatahub/kserve-storage-initializer@sha256:c49c84e69ddbb36db782821d4aa3d203f458a00c0c04dd506eb662aae339bb8a" in 13.134s (13.134s including waiting). Image size: 300960724 bytes. | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-d1f99-predictor-79c6d7db55-qjzfp |
Pulled |
Successfully pulled image "quay.io/opendatahub/success-200-isvc:odh-pr-1407" in 12.944s (12.944s including waiting). Image size: 1332287104 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-654489c865-9qjkc |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-654489c865-9qjkc |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-d1f99-predictor-6f8c58666-kmthn |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-695857997-skcx9 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-d1f99-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-d1f99-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-784cb989b8-5hnph |
Pulling |
Pulling image "kserve/xgbserver:latest" | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-654489c865-9qjkc |
Pulling |
Pulling image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1407" | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-695857997-skcx9 |
Pulling |
Pulling image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1407" | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-695857997-skcx9 |
Pulled |
Successfully pulled image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1407" in 6.325s (6.325s including waiting). Image size: 1560613827 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-695857997-skcx9 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-695857997-skcx9 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-654489c865-9qjkc |
Pulled |
Successfully pulled image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1407" in 7.696s (7.696s including waiting). Image size: 1560613827 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-654489c865-9qjkc |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-654489c865-9qjkc |
Started |
Started container kserve-container | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-784cb989b8-5hnph |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-784cb989b8-5hnph |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-784cb989b8-5hnph |
Pulled |
Successfully pulled image "kserve/xgbserver:latest" in 18.115s (18.115s including waiting). Image size: 1306229499 bytes. | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-d1f99-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-d1f99-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-d1f99-predictor-79c6d7db55-qjzfp |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.18:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-d1f99-predictor-6f8c58666-kmthn |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.35:8080: connect: connection refused |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-d1f99 |
InferenceServiceReady |
InferenceService [success-200-isvc-d1f99] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-d1f99 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-d1f99 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-d1f99 |
InferenceServiceReady |
InferenceService [error-404-isvc-d1f99] is Ready | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-d1f99-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-d1f99-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-d1f99-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-d1f99-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
replicaset-controller |
switch-graph-d1f99-5f9847b898 |
SuccessfulCreate |
Created pod: switch-graph-d1f99-5f9847b898-pp994 | |
kserve-ci-e2e-test |
deployment-controller |
switch-graph-d1f99 |
ScalingReplicaSet |
Scaled up replica set switch-graph-d1f99-5f9847b898 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
switch-graph-d1f99-5f9847b898-pp994 |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "switch-graph-d1f99-serving-cert" not found | |
kserve-ci-e2e-test |
multus |
switch-graph-d1f99-5f9847b898-pp994 |
AddedInterface |
Add eth0 [10.134.0.36/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-d1f99 |
InferenceGraphReady |
InferenceGraph [switch-graph-d1f99] is Ready | |
kserve-ci-e2e-test |
kubelet |
switch-graph-d1f99-5f9847b898-pp994 |
Pulling |
Pulling image "quay.io/opendatahub/kserve-router@sha256:daaaf0b7769b899c00520a668e190161eefaa93b6eb75bfb8161ae18d89812c6" | |
kserve-ci-e2e-test |
kubelet |
switch-graph-d1f99-5f9847b898-pp994 |
Started |
Started container switch-graph-d1f99 | |
kserve-ci-e2e-test |
kubelet |
switch-graph-d1f99-5f9847b898-pp994 |
Pulled |
Successfully pulled image "quay.io/opendatahub/kserve-router@sha256:daaaf0b7769b899c00520a668e190161eefaa93b6eb75bfb8161ae18d89812c6" in 1.446s (1.446s including waiting). Image size: 216232057 bytes. | |
kserve-ci-e2e-test |
kubelet |
switch-graph-d1f99-5f9847b898-pp994 |
Created |
Created container: switch-graph-d1f99 | |
| (x8) | kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-654489c865-9qjkc |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.20:8080: connect: connection refused |
| (x8) | kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-695857997-skcx9 |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.34:8080: connect: connection refused |
| (x7) | kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-784cb989b8-5hnph |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.19:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-c9f8b-predictor-b9f4c48f7-z6skf |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
multus |
error-404-isvc-c9f8b-predictor-667b95c6b8-wknl7 |
AddedInterface |
Add eth0 [10.134.0.37/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-d1f99-predictor-6f8c58666-kmthn |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
multus |
success-200-isvc-c9f8b-predictor-b9f4c48f7-z6skf |
AddedInterface |
Add eth0 [10.132.0.21/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-d1f99-predictor-79c6d7db55-qjzfp |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-c9f8b-predictor-b9f4c48f7-z6skf |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1407" already present on machine | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-c9f8b |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-c9f8b": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-c9f8b-predictor-b9f4c48f7-z6skf |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-c9f8b |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-c9f8b": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-c9f8b": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-c9f8b-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-c9f8b-predictor-667b95c6b8 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-c9f8b-predictor-667b95c6b8-wknl7 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-c9f8b-predictor-667b95c6b8-wknl7 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
switch-graph-d1f99-5f9847b898-pp994 |
Killing |
Stopping container switch-graph-d1f99 | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-c9f8b-predictor-b9f4c48f7 |
SuccessfulCreate |
Created pod: success-200-isvc-c9f8b-predictor-b9f4c48f7-z6skf | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-c9f8b-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-c9f8b-predictor-b9f4c48f7 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-c9f8b-predictor-667b95c6b8-wknl7 |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1407" already present on machine | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-c9f8b-predictor-667b95c6b8 |
SuccessfulCreate |
Created pod: error-404-isvc-c9f8b-predictor-667b95c6b8-wknl7 | |
| (x10) | kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-1 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-1 |
InferenceServiceReady |
InferenceService [isvc-sklearn-graph-1] is Ready | |
| (x10) | kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-2 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-2 |
InferenceServiceReady |
InferenceService [isvc-sklearn-graph-2] is Ready | |
| (x10) | kserve-ci-e2e-test |
v1beta1Controllers |
isvc-xgboost-graph |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
isvc-xgboost-graph |
InferenceServiceReady |
InferenceService [isvc-xgboost-graph] is Ready | |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x6) | kserve-ci-e2e-test |
kubelet |
switch-graph-d1f99-5f9847b898-pp994 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
deployment-controller |
model-chainer |
ScalingReplicaSet |
Scaled up replica set model-chainer-78ccc649 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
model-chainer-78ccc649 |
SuccessfulCreate |
Created pod: model-chainer-78ccc649-29b6r | |
kserve-ci-e2e-test |
kubelet |
model-chainer-78ccc649-29b6r |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "model-chainer-serving-cert" not found | |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x6) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
InferenceGraphController |
model-chainer |
InferenceGraphReady |
InferenceGraph [model-chainer] is Ready | |
| (x6) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
kubelet |
model-chainer-78ccc649-29b6r |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:daaaf0b7769b899c00520a668e190161eefaa93b6eb75bfb8161ae18d89812c6" already present on machine | |
kserve-ci-e2e-test |
multus |
model-chainer-78ccc649-29b6r |
AddedInterface |
Add eth0 [10.134.0.38/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
model-chainer-78ccc649-29b6r |
Created |
Created container: model-chainer | |
kserve-ci-e2e-test |
kubelet |
model-chainer-78ccc649-29b6r |
Started |
Started container model-chainer | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-2d44a-predictor-6bd887658-bj6zv |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-654489c865-9qjkc |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-2d44a-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-2d44a-predictor-6bd887658 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-2d44a-predictor-6bd887658 |
SuccessfulCreate |
Created pod: error-404-isvc-2d44a-predictor-6bd887658-bj6zv | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-2d44a-predictor-6bd887658-bj6zv |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-2d44a-predictor-6bd887658-bj6zv |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1407" already present on machine | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-2d44a-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-2d44a-predictor-595d486c67 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-2d44a-predictor-595d486c67 |
SuccessfulCreate |
Created pod: success-200-isvc-2d44a-predictor-595d486c67-sz8xh | |
kserve-ci-e2e-test |
multus |
error-404-isvc-2d44a-predictor-6bd887658-bj6zv |
AddedInterface |
Add eth0 [10.134.0.39/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
model-chainer-78ccc649-29b6r |
Killing |
Stopping container model-chainer | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-784cb989b8-5hnph |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-2d44a-predictor-595d486c67-sz8xh |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-695857997-skcx9 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
multus |
success-200-isvc-2d44a-predictor-595d486c67-sz8xh |
AddedInterface |
Add eth0 [10.132.0.22/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-2d44a-predictor-595d486c67-sz8xh |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1407" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-2d44a-predictor-595d486c67-sz8xh |
Created |
Created container: kserve-container | |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-c9f8b-predictor-b9f4c48f7-z6skf |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.21:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-c9f8b-predictor-667b95c6b8-wknl7 |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.37:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-c9f8b |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-c9f8b |
InferenceServiceReady |
InferenceService [success-200-isvc-c9f8b] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-c9f8b |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-c9f8b |
InferenceServiceReady |
InferenceService [error-404-isvc-c9f8b] is Ready | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-2d44a-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-2d44a-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-c9f8b-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-c9f8b-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x6) | kserve-ci-e2e-test |
kubelet |
model-chainer-78ccc649-29b6r |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
replicaset-controller |
switch-graph-c9f8b-5c958b9899 |
SuccessfulCreate |
Created pod: switch-graph-c9f8b-5c958b9899-79ld4 | |
kserve-ci-e2e-test |
multus |
switch-graph-c9f8b-5c958b9899-79ld4 |
AddedInterface |
Add eth0 [10.134.0.40/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
switch-graph-c9f8b-5c958b9899-79ld4 |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:daaaf0b7769b899c00520a668e190161eefaa93b6eb75bfb8161ae18d89812c6" already present on machine | |
kserve-ci-e2e-test |
kubelet |
switch-graph-c9f8b-5c958b9899-79ld4 |
Created |
Created container: switch-graph-c9f8b | |
kserve-ci-e2e-test |
deployment-controller |
switch-graph-c9f8b |
ScalingReplicaSet |
Scaled up replica set switch-graph-c9f8b-5c958b9899 from 0 to 1 | |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-c9f8b |
InferenceGraphReady |
InferenceGraph [switch-graph-c9f8b] is Ready | |
kserve-ci-e2e-test |
kubelet |
switch-graph-c9f8b-5c958b9899-79ld4 |
Started |
Started container switch-graph-c9f8b | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-c9f8b-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-c9f8b-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-c9f8b-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-c9f8b-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-2d44a-predictor-6bd887658-bj6zv |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.39:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-2d44a-predictor-595d486c67-sz8xh |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.22:8080: connect: connection refused |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-c9f8b |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-c9f8b |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-2d44a-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-2d44a-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-2d44a |
InferenceServiceReady |
InferenceService [error-404-isvc-2d44a] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-2d44a |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-2d44a |
InferenceServiceReady |
InferenceService [success-200-isvc-2d44a] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-2d44a |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
replicaset-controller |
sequence-graph-2d44a-d4fd86597 |
SuccessfulCreate |
Created pod: sequence-graph-2d44a-d4fd86597-7j4s5 | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-2d44a-d4fd86597-7j4s5 |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "sequence-graph-2d44a-serving-cert" not found | |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-2d44a |
InferenceGraphReady |
InferenceGraph [sequence-graph-2d44a] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
sequence-graph-2d44a |
ScalingReplicaSet |
Scaled up replica set sequence-graph-2d44a-d4fd86597 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-2d44a-d4fd86597-7j4s5 |
Started |
Started container sequence-graph-2d44a | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-2d44a-d4fd86597-7j4s5 |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:daaaf0b7769b899c00520a668e190161eefaa93b6eb75bfb8161ae18d89812c6" already present on machine | |
kserve-ci-e2e-test |
multus |
sequence-graph-2d44a-d4fd86597-7j4s5 |
AddedInterface |
Add eth0 [10.134.0.41/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-2d44a-d4fd86597-7j4s5 |
Created |
Created container: sequence-graph-2d44a | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-2d44a-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-2d44a-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-2d44a-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-c9f8b |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-2d44a-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-c9f8b |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-2d44a |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-2d44a |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-2d44a |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-2d44a |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
kubelet |
switch-graph-c9f8b-5c958b9899-79ld4 |
Killing |
Stopping container switch-graph-c9f8b | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-36a90-predictor-574bcd5574 |
SuccessfulCreate |
Created pod: error-404-isvc-36a90-predictor-574bcd5574-cmn2x | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-36a90-predictor-749c75bdbc |
SuccessfulCreate |
Created pod: success-200-isvc-36a90-predictor-749c75bdbc-lnz98 | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-36a90-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-36a90-predictor-749c75bdbc from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-36a90-predictor-749c75bdbc-lnz98 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
multus |
error-404-isvc-36a90-predictor-574bcd5574-cmn2x |
AddedInterface |
Add eth0 [10.134.0.42/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-36a90-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-36a90-predictor-574bcd5574 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-c9f8b-predictor-667b95c6b8-wknl7 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-36a90 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-36a90": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-36a90 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-36a90": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-36a90": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-36a90-predictor-574bcd5574-cmn2x |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1407" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-36a90-predictor-749c75bdbc-lnz98 |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1407" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-c9f8b-predictor-b9f4c48f7-z6skf |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-36a90-predictor-749c75bdbc-lnz98 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
multus |
success-200-isvc-36a90-predictor-749c75bdbc-lnz98 |
AddedInterface |
Add eth0 [10.132.0.23/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-36a90-predictor-574bcd5574-cmn2x |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-36a90-predictor-574bcd5574-cmn2x |
Started |
Started container kserve-container | |
| (x6) | kserve-ci-e2e-test |
kubelet |
switch-graph-c9f8b-5c958b9899-79ld4 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-36a90-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-36a90-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-b8642-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-b8642-predictor-54bb7c4df6 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-b8642-predictor-54bb7c4df6-kbbt5 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-b8642-predictor-89bc8697 |
SuccessfulCreate |
Created pod: success-200-isvc-b8642-predictor-89bc8697-8tq5g | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-b8642-predictor-89bc8697-8tq5g |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-b8642-predictor-89bc8697-8tq5g |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-2d44a-predictor-6bd887658-bj6zv |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-b8642-predictor-89bc8697-8tq5g |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1407" already present on machine | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-b8642 |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-b8642": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-b8642": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-2d44a-predictor-595d486c67-sz8xh |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
multus |
success-200-isvc-b8642-predictor-89bc8697-8tq5g |
AddedInterface |
Add eth0 [10.132.0.24/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
multus |
error-404-isvc-b8642-predictor-54bb7c4df6-kbbt5 |
AddedInterface |
Add eth0 [10.134.0.43/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-b8642-predictor-54bb7c4df6-kbbt5 |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1407" already present on machine | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-2d44a-d4fd86597-7j4s5 |
Killing |
Stopping container sequence-graph-2d44a | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-b8642-predictor-54bb7c4df6-kbbt5 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-b8642-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-b8642-predictor-89bc8697 from 0 to 1 | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-b8642 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-b8642": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-b8642-predictor-54bb7c4df6 |
SuccessfulCreate |
Created pod: error-404-isvc-b8642-predictor-54bb7c4df6-kbbt5 | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-b8642 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-b8642": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-b8642": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-b8642 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-b8642": the object has been modified; please apply your changes to the latest version and try again | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-36a90 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-36a90 |
InferenceServiceReady |
InferenceService [success-200-isvc-36a90] is Ready | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-36a90-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-36a90-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-36a90 |
InferenceServiceReady |
InferenceService [error-404-isvc-36a90] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-36a90 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-b8642-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-b8642-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-36a90-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
InferenceGraphController |
ensemble-graph-36a90 |
InferenceGraphReady |
InferenceGraph [ensemble-graph-36a90] is Ready | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-36a90-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-36a90-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-36a90-744c45996f-jphzx |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "ensemble-graph-36a90-serving-cert" not found | |
kserve-ci-e2e-test |
replicaset-controller |
ensemble-graph-36a90-744c45996f |
SuccessfulCreate |
Created pod: ensemble-graph-36a90-744c45996f-jphzx | |
kserve-ci-e2e-test |
deployment-controller |
ensemble-graph-36a90 |
ScalingReplicaSet |
Scaled up replica set ensemble-graph-36a90-744c45996f from 0 to 1 | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-36a90-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
multus |
ensemble-graph-36a90-744c45996f-jphzx |
AddedInterface |
Add eth0 [10.134.0.44/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-36a90-744c45996f-jphzx |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:daaaf0b7769b899c00520a668e190161eefaa93b6eb75bfb8161ae18d89812c6" already present on machine | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-36a90-744c45996f-jphzx |
Created |
Created container: ensemble-graph-36a90 | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-36a90-744c45996f-jphzx |
Started |
Started container ensemble-graph-36a90 | |
| (x6) | kserve-ci-e2e-test |
kubelet |
sequence-graph-2d44a-d4fd86597-7j4s5 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
multus |
success-200-isvc-b2be2-predictor-855dffb447-hvjpx |
AddedInterface |
Add eth0 [10.132.0.25/23] from ovn-kubernetes | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-b8642-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-b2be2-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-b2be2-predictor-5f8c869854 from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-b2be2-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-b2be2-predictor-855dffb447 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-36a90-predictor-749c75bdbc-lnz98 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-b2be2-predictor-855dffb447 |
SuccessfulCreate |
Created pod: success-200-isvc-b2be2-predictor-855dffb447-hvjpx | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-36a90-744c45996f-jphzx |
Killing |
Stopping container ensemble-graph-36a90 | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-b8642-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-b2be2-predictor-5f8c869854 |
SuccessfulCreate |
Created pod: error-404-isvc-b2be2-predictor-5f8c869854-s6kpj | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-b2be2-predictor-855dffb447-hvjpx |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-b2be2-predictor-855dffb447-hvjpx |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-b2be2-predictor-855dffb447-hvjpx |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1407" already present on machine | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-b2be2 |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-b2be2": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-b2be2": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-b2be2 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-b2be2": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-36a90-predictor-574bcd5574-cmn2x |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
multus |
error-404-isvc-b2be2-predictor-5f8c869854-s6kpj |
AddedInterface |
Add eth0 [10.134.0.45/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-b2be2-predictor-5f8c869854-s6kpj |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1407" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-b2be2-predictor-5f8c869854-s6kpj |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-b2be2 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-b2be2": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-b2be2": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-b2be2 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-b2be2": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-b2be2-predictor-5f8c869854-s6kpj |
Started |
Started container kserve-container | |
| (x7) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-36a90-predictor-574bcd5574-cmn2x |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.42:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-36a90-predictor-749c75bdbc-lnz98 |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.23:8080: connect: connection refused |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-b8642 |
InferenceServiceReady |
InferenceService [error-404-isvc-b8642] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-b8642 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-b8642 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-b8642 |
InferenceServiceReady |
InferenceService [success-200-isvc-b8642] is Ready | |
| (x6) | kserve-ci-e2e-test |
kubelet |
ensemble-graph-36a90-744c45996f-jphzx |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x5) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-b2be2-predictor-855dffb447-hvjpx |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.25:8080: connect: connection refused |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-b8642 |
InternalError |
fails to update InferenceGraph status: Operation cannot be fulfilled on inferencegraphs.serving.kserve.io "sequence-graph-b8642": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-b8642 |
UpdateFailed |
Failed to update status for InferenceGraph "sequence-graph-b8642": Operation cannot be fulfilled on inferencegraphs.serving.kserve.io "sequence-graph-b8642": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-b8642 |
InferenceGraphReady |
InferenceGraph [sequence-graph-b8642] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
sequence-graph-b8642 |
ScalingReplicaSet |
Scaled up replica set sequence-graph-b8642-bbb4f56f from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
sequence-graph-b8642-bbb4f56f |
SuccessfulCreate |
Created pod: sequence-graph-b8642-bbb4f56f-n44lf | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-b8642-bbb4f56f-n44lf |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:daaaf0b7769b899c00520a668e190161eefaa93b6eb75bfb8161ae18d89812c6" already present on machine | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-b8642-bbb4f56f-n44lf |
Started |
Started container sequence-graph-b8642 | |
kserve-ci-e2e-test |
multus |
sequence-graph-b8642-bbb4f56f-n44lf |
AddedInterface |
Add eth0 [10.134.0.46/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-b8642-bbb4f56f-n44lf |
Created |
Created container: sequence-graph-b8642 | |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-b2be2-predictor-5f8c869854-s6kpj |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.45:8080: connect: connection refused |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-b2be2 |
InferenceServiceReady |
InferenceService [success-200-isvc-b2be2] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-b2be2 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-b2be2-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-b2be2-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-b8642-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-b8642-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-b2be2-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-b2be2-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-b8642-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-b8642-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-cee76-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-cee76-predictor-866cc8b64 from 0 to 1 | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-cee76 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-cee76": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-cee76 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-cee76": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-cee76 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-cee76": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-cee76": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-b8642-bbb4f56f-n44lf |
Killing |
Stopping container sequence-graph-b8642 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-b8642-predictor-54bb7c4df6-kbbt5 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-b8642-predictor-89bc8697-8tq5g |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-cee76 |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-cee76": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-cee76": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
multus |
error-404-isvc-cee76-predictor-866cc8b64-4mdx8 |
AddedInterface |
Add eth0 [10.134.0.47/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-cee76-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-cee76-predictor-84f4bbdc7 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-cee76-predictor-866cc8b64-4mdx8 |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1407" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-cee76-predictor-866cc8b64-4mdx8 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-cee76-predictor-866cc8b64-4mdx8 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-cee76-predictor-866cc8b64 |
SuccessfulCreate |
Created pod: error-404-isvc-cee76-predictor-866cc8b64-4mdx8 | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-cee76-predictor-84f4bbdc7 |
SuccessfulCreate |
Created pod: success-200-isvc-cee76-predictor-84f4bbdc7-bf595 | |
kserve-ci-e2e-test |
multus |
success-200-isvc-cee76-predictor-84f4bbdc7-bf595 |
AddedInterface |
Add eth0 [10.132.0.26/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-cee76-predictor-84f4bbdc7-bf595 |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1407" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-cee76-predictor-84f4bbdc7-bf595 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-cee76-predictor-84f4bbdc7-bf595 |
Started |
Started container kserve-container | |
| (x7) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-b8642-predictor-54bb7c4df6-kbbt5 |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.43:8080: connect: connection refused |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-b2be2 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-b8642-predictor-89bc8697-8tq5g |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.24:8080: connect: connection refused |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-b2be2 |
InferenceServiceReady |
InferenceService [error-404-isvc-b2be2] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
ensemble-graph-b2be2 |
ScalingReplicaSet |
Scaled up replica set ensemble-graph-b2be2-6df585b7fc from 0 to 1 | |
kserve-ci-e2e-test |
InferenceGraphController |
ensemble-graph-b2be2 |
InferenceGraphReady |
InferenceGraph [ensemble-graph-b2be2] is Ready | |
kserve-ci-e2e-test |
replicaset-controller |
ensemble-graph-b2be2-6df585b7fc |
SuccessfulCreate |
Created pod: ensemble-graph-b2be2-6df585b7fc-bqfmb | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-b2be2-6df585b7fc-bqfmb |
Created |
Created container: ensemble-graph-b2be2 | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-b2be2-6df585b7fc-bqfmb |
Started |
Started container ensemble-graph-b2be2 | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-b2be2-6df585b7fc-bqfmb |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:daaaf0b7769b899c00520a668e190161eefaa93b6eb75bfb8161ae18d89812c6" already present on machine | |
kserve-ci-e2e-test |
multus |
ensemble-graph-b2be2-6df585b7fc-bqfmb |
AddedInterface |
Add eth0 [10.134.0.48/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-cee76-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-cee76-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-cee76-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-cee76-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-b2be2-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-b2be2-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-b2be2-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
ensemble-graph-b2be2 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
ensemble-graph-b2be2 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-b2be2-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x6) | kserve-ci-e2e-test |
kubelet |
sequence-graph-b8642-bbb4f56f-n44lf |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x5) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-cee76-predictor-84f4bbdc7-bf595 |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.26:8080: connect: connection refused |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
ensemble-graph-b2be2 |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
ensemble-graph-b2be2 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-cee76 |
InferenceServiceReady |
InferenceService [success-200-isvc-cee76] is Ready | |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-cee76-predictor-866cc8b64-4mdx8 |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.47:8080: connect: connection refused |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-cee76 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-cee76 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-cee76 |
InferenceServiceReady |
InferenceService [error-404-isvc-cee76] is Ready | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-cee76-7d9bc88ff6-j7t7v |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "sequence-graph-cee76-serving-cert" not found | |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-cee76 |
InferenceGraphReady |
InferenceGraph [sequence-graph-cee76] is Ready | |
kserve-ci-e2e-test |
replicaset-controller |
sequence-graph-cee76-7d9bc88ff6 |
SuccessfulCreate |
Created pod: sequence-graph-cee76-7d9bc88ff6-j7t7v | |
kserve-ci-e2e-test |
deployment-controller |
sequence-graph-cee76 |
ScalingReplicaSet |
Scaled up replica set sequence-graph-cee76-7d9bc88ff6 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-cee76-7d9bc88ff6-j7t7v |
Started |
Started container sequence-graph-cee76 | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-cee76-7d9bc88ff6-j7t7v |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:daaaf0b7769b899c00520a668e190161eefaa93b6eb75bfb8161ae18d89812c6" already present on machine | |
kserve-ci-e2e-test |
multus |
sequence-graph-cee76-7d9bc88ff6-j7t7v |
AddedInterface |
Add eth0 [10.134.0.49/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-cee76-7d9bc88ff6-j7t7v |
Created |
Created container: sequence-graph-cee76 | |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-cee76-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-cee76-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-cee76 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-cee76 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-cee76-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-cee76-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-cee76 |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-cee76 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-1fc59-predictor-856bfdcfb |
SuccessfulCreate |
Created pod: error-404-isvc-1fc59-predictor-856bfdcfb-97jv7 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-1fc59-predictor-6797966c7-jp9kb |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-1fc59 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-1fc59": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-1fc59": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-1fc59-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-1fc59-predictor-856bfdcfb from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-b2be2-predictor-5f8c869854-s6kpj |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-1fc59 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-1fc59": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-1fc59-predictor-856bfdcfb-97jv7 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-b2be2-6df585b7fc-bqfmb |
Killing |
Stopping container ensemble-graph-b2be2 | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-1fc59 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-1fc59": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-1fc59 |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-1fc59": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-1fc59": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
multus |
success-200-isvc-1fc59-predictor-6797966c7-jp9kb |
AddedInterface |
Add eth0 [10.132.0.27/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-1fc59-predictor-856bfdcfb-97jv7 |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1407" already present on machine | |
kserve-ci-e2e-test |
multus |
error-404-isvc-1fc59-predictor-856bfdcfb-97jv7 |
AddedInterface |
Add eth0 [10.134.0.50/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-1fc59-predictor-6797966c7-jp9kb |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1407" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-b2be2-predictor-855dffb447-hvjpx |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-1fc59-predictor-6797966c7-jp9kb |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-1fc59-predictor-856bfdcfb-97jv7 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-1fc59-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-1fc59-predictor-6797966c7 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-1fc59-predictor-6797966c7 |
SuccessfulCreate |
Created pod: success-200-isvc-1fc59-predictor-6797966c7-jp9kb | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-1fc59-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-1fc59-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x6) | kserve-ci-e2e-test |
kubelet |
ensemble-graph-b2be2-6df585b7fc-bqfmb |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-1fc59-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-1fc59-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-1fc59 |
InferenceServiceReady |
InferenceService [success-200-isvc-1fc59] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-1fc59 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-9c7d6-predictor-6d4df94467-hc4fs |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-9c7d6-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-9c7d6-predictor-5fb75bc8f4 from 0 to 1 | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-9c7d6 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-9c7d6": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-cee76-predictor-84f4bbdc7-bf595 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-9c7d6 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-9c7d6": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-9c7d6": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-9c7d6-predictor-6d4df94467 |
SuccessfulCreate |
Created pod: success-200-isvc-9c7d6-predictor-6d4df94467-hc4fs | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-9c7d6 |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-9c7d6": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-9c7d6": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
multus |
success-200-isvc-9c7d6-predictor-6d4df94467-hc4fs |
AddedInterface |
Add eth0 [10.132.0.28/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-9c7d6-predictor-6d4df94467-hc4fs |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1407" already present on machine | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-9c7d6 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-9c7d6": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-cee76-7d9bc88ff6-j7t7v |
Killing |
Stopping container sequence-graph-cee76 | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-9c7d6-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-9c7d6-predictor-6d4df94467 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-9c7d6-predictor-5fb75bc8f4 |
SuccessfulCreate |
Created pod: error-404-isvc-9c7d6-predictor-5fb75bc8f4-f4r9m | |
kserve-ci-e2e-test |
multus |
error-404-isvc-9c7d6-predictor-5fb75bc8f4-f4r9m |
AddedInterface |
Add eth0 [10.134.0.51/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-9c7d6-predictor-6d4df94467-hc4fs |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-9c7d6-predictor-5fb75bc8f4-f4r9m |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1407" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-9c7d6-predictor-5fb75bc8f4-f4r9m |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-cee76-predictor-866cc8b64-4mdx8 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-9c7d6-predictor-5fb75bc8f4-f4r9m |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-1fc59 |
InferenceServiceReady |
InferenceService [error-404-isvc-1fc59] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-1fc59 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
deployment-controller |
splitter-graph-1fc59 |
ScalingReplicaSet |
Scaled up replica set splitter-graph-1fc59-6bbd795f46 from 0 to 1 | |
kserve-ci-e2e-test |
InferenceGraphController |
splitter-graph-1fc59 |
InferenceGraphReady |
InferenceGraph [splitter-graph-1fc59] is Ready | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-1fc59-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-1fc59-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-1fc59-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-1fc59-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
replicaset-controller |
splitter-graph-1fc59-6bbd795f46 |
SuccessfulCreate |
Created pod: splitter-graph-1fc59-6bbd795f46-rvh7v | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-1fc59-6bbd795f46-rvh7v |
Created |
Created container: splitter-graph-1fc59 | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-1fc59-6bbd795f46-rvh7v |
Started |
Started container splitter-graph-1fc59 | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-1fc59-6bbd795f46-rvh7v |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:daaaf0b7769b899c00520a668e190161eefaa93b6eb75bfb8161ae18d89812c6" already present on machine | |
kserve-ci-e2e-test |
multus |
splitter-graph-1fc59-6bbd795f46-rvh7v |
AddedInterface |
Add eth0 [10.134.0.52/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-9c7d6-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-9c7d6-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-9c7d6-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-9c7d6-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-41c6b |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-41c6b": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-41c6b": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-41c6b-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-41c6b-predictor-86f5c7cb45 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-1fc59-predictor-856bfdcfb-97jv7 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
multus |
error-404-isvc-41c6b-predictor-687c7b4cb4-w7l5r |
AddedInterface |
Add eth0 [10.134.0.53/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-1fc59-predictor-6797966c7-jp9kb |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-41c6b |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-41c6b": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
multus |
success-200-isvc-41c6b-predictor-86f5c7cb45-9h6d8 |
AddedInterface |
Add eth0 [10.132.0.29/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-41c6b |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-41c6b": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-41c6b": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-41c6b-predictor-86f5c7cb45-9h6d8 |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1407" already present on machine | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-41c6b |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-41c6b": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-1fc59-6bbd795f46-rvh7v |
Killing |
Stopping container splitter-graph-1fc59 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-41c6b-predictor-86f5c7cb45-9h6d8 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-41c6b-predictor-86f5c7cb45-9h6d8 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-41c6b-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-41c6b-predictor-687c7b4cb4 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-41c6b-predictor-687c7b4cb4 |
SuccessfulCreate |
Created pod: error-404-isvc-41c6b-predictor-687c7b4cb4-w7l5r | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-41c6b-predictor-86f5c7cb45 |
SuccessfulCreate |
Created pod: success-200-isvc-41c6b-predictor-86f5c7cb45-9h6d8 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-41c6b-predictor-687c7b4cb4-w7l5r |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-41c6b-predictor-687c7b4cb4-w7l5r |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1407" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-41c6b-predictor-687c7b4cb4-w7l5r |
Created |
Created container: kserve-container | |
| (x7) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-1fc59-predictor-856bfdcfb-97jv7 |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.50:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-1fc59-predictor-6797966c7-jp9kb |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.27:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
sequence-graph-cee76-7d9bc88ff6-j7t7v |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-41c6b-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-41c6b-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x6) | kserve-ci-e2e-test |
kubelet |
splitter-graph-1fc59-6bbd795f46-rvh7v |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-41c6b-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-41c6b-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-9c7d6 |
InferenceServiceReady |
InferenceService [error-404-isvc-9c7d6] is Ready | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-9c7d6 |
InferenceServiceReady |
InferenceService [success-200-isvc-9c7d6] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-9c7d6 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-9c7d6 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x5) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-41c6b-predictor-86f5c7cb45-9h6d8 |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.29:8080: connect: connection refused |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-41c6b |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-41c6b-predictor-687c7b4cb4-w7l5r |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.53:8080: connect: connection refused |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-41c6b |
InferenceServiceReady |
InferenceService [success-200-isvc-41c6b] is Ready | |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-9c7d6 |
InternalError |
fails to update InferenceGraph status: Operation cannot be fulfilled on inferencegraphs.serving.kserve.io "switch-graph-9c7d6": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
replicaset-controller |
switch-graph-9c7d6-58455857bf |
SuccessfulCreate |
Created pod: switch-graph-9c7d6-58455857bf-xj6x5 | |
kserve-ci-e2e-test |
kubelet |
switch-graph-9c7d6-58455857bf-xj6x5 |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "switch-graph-9c7d6-serving-cert" not found | |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-9c7d6 |
UpdateFailed |
Failed to update status for InferenceGraph "switch-graph-9c7d6": Operation cannot be fulfilled on inferencegraphs.serving.kserve.io "switch-graph-9c7d6": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-9c7d6 |
InferenceGraphReady |
InferenceGraph [switch-graph-9c7d6] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
switch-graph-9c7d6 |
ScalingReplicaSet |
Scaled up replica set switch-graph-9c7d6-58455857bf from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
switch-graph-9c7d6-58455857bf-xj6x5 |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:daaaf0b7769b899c00520a668e190161eefaa93b6eb75bfb8161ae18d89812c6" already present on machine | |
kserve-ci-e2e-test |
kubelet |
switch-graph-9c7d6-58455857bf-xj6x5 |
Started |
Started container switch-graph-9c7d6 | |
kserve-ci-e2e-test |
kubelet |
switch-graph-9c7d6-58455857bf-xj6x5 |
Created |
Created container: switch-graph-9c7d6 | |
kserve-ci-e2e-test |
multus |
switch-graph-9c7d6-58455857bf-xj6x5 |
AddedInterface |
Add eth0 [10.134.0.54/23] from ovn-kubernetes | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-41c6b |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-41c6b |
InferenceServiceReady |
InferenceService [error-404-isvc-41c6b] is Ready | |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-9c7d6-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-9c7d6-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-9c7d6-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-9c7d6-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-41c6b-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-41c6b-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-41c6b-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-41c6b-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
replicaset-controller |
splitter-graph-41c6b-55c4b9fc75 |
SuccessfulCreate |
Created pod: splitter-graph-41c6b-55c4b9fc75-9pkkw | |
kserve-ci-e2e-test |
deployment-controller |
splitter-graph-41c6b |
ScalingReplicaSet |
Scaled up replica set splitter-graph-41c6b-55c4b9fc75 from 0 to 1 | |
kserve-ci-e2e-test |
InferenceGraphController |
splitter-graph-41c6b |
InferenceGraphReady |
InferenceGraph [splitter-graph-41c6b] is Ready | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-41c6b-55c4b9fc75-9pkkw |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "splitter-graph-41c6b-serving-cert" not found | |
kserve-ci-e2e-test |
multus |
splitter-graph-41c6b-55c4b9fc75-9pkkw |
AddedInterface |
Add eth0 [10.134.0.55/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-41c6b-55c4b9fc75-9pkkw |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:daaaf0b7769b899c00520a668e190161eefaa93b6eb75bfb8161ae18d89812c6" already present on machine | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-41c6b-55c4b9fc75-9pkkw |
Created |
Created container: splitter-graph-41c6b | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-41c6b-55c4b9fc75-9pkkw |
Started |
Started container splitter-graph-41c6b | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-9c7d6 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-9c7d6 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-9c7d6 |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-9c7d6 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
splitter-graph-41c6b |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
splitter-graph-41c6b |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
splitter-graph-41c6b-55c4b9fc75-9pkkw |
Killing |
Stopping container splitter-graph-41c6b | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-41c6b-predictor-687c7b4cb4-w7l5r |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-41c6b-predictor-86f5c7cb45-9h6d8 |
Killing |
Stopping container kserve-container | |
| (x6) | kserve-ci-e2e-test |
kubelet |
splitter-graph-41c6b-55c4b9fc75-9pkkw |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
kubelet |
switch-graph-9c7d6-58455857bf-xj6x5 |
Killing |
Stopping container switch-graph-9c7d6 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-9c7d6-predictor-6d4df94467-hc4fs |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-9c7d6-predictor-5fb75bc8f4-f4r9m |
Killing |
Stopping container kserve-container | |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-9c7d6-predictor-6d4df94467-hc4fs |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.28:8080: connect: connection refused |
| (x7) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-9c7d6-predictor-5fb75bc8f4-f4r9m |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.51:8080: connect: connection refused |
| (x5) | kserve-ci-e2e-test |
kubelet |
switch-graph-9c7d6-58455857bf-xj6x5 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |