| Time | Namespace | Component | RelatedObject | Reason | Message |
|---|---|---|---|---|---|
kserve-ci-e2e-test |
model-chainer-59fd89b477-szskd |
Scheduled |
Successfully assigned kserve-ci-e2e-test/model-chainer-59fd89b477-szskd to ip-10-0-139-184.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-6bad9-predictor-5d7df76d56-h7pdr |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-6bad9-predictor-5d7df76d56-h7pdr to ip-10-0-139-184.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-93cee-predictor-7d9b86d498-48dr9 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-93cee-predictor-7d9b86d498-48dr9 to ip-10-0-139-184.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-e1324-predictor-7798b8b7c8-cktzl |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-e1324-predictor-7798b8b7c8-cktzl to ip-10-0-139-184.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-e1324-predictor-69874b497-dbzwh |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-e1324-predictor-69874b497-dbzwh to ip-10-0-138-34.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-7809f-predictor-b4788b9f6-r48p7 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-7809f-predictor-b4788b9f6-r48p7 to ip-10-0-139-184.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-2a210-predictor-7bb85759bc-hqfwt |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-2a210-predictor-7bb85759bc-hqfwt to ip-10-0-138-34.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-93cee-predictor-787774f689-d62cr |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-93cee-predictor-787774f689-d62cr to ip-10-0-138-34.ec2.internal | ||
kserve-ci-e2e-test |
isvc-xgboost-graph-predictor-669d8d6456-pcrdj |
Scheduled |
Successfully assigned kserve-ci-e2e-test/isvc-xgboost-graph-predictor-669d8d6456-pcrdj to ip-10-0-138-34.ec2.internal | ||
kserve-ci-e2e-test |
isvc-sklearn-graph-2-predictor-67687994d4-tgjwl |
Scheduled |
Successfully assigned kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-67687994d4-tgjwl to ip-10-0-138-34.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-26ebe-predictor-7d49cd9f75-qjrrs |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-26ebe-predictor-7d49cd9f75-qjrrs to ip-10-0-138-34.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-6bad9-predictor-6c4b946b59-klxc7 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-6bad9-predictor-6c4b946b59-klxc7 to ip-10-0-138-34.ec2.internal | ||
kserve-ci-e2e-test |
switch-graph-0600b-587b488647-lbj9j |
Scheduled |
Successfully assigned kserve-ci-e2e-test/switch-graph-0600b-587b488647-lbj9j to ip-10-0-139-184.ec2.internal | ||
kserve-ci-e2e-test |
switch-graph-e1324-b8c5ffc4-w28k7 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/switch-graph-e1324-b8c5ffc4-w28k7 to ip-10-0-139-184.ec2.internal | ||
kserve-ci-e2e-test |
ensemble-graph-2a210-76dff99855-v7s6j |
Scheduled |
Successfully assigned kserve-ci-e2e-test/ensemble-graph-2a210-76dff99855-v7s6j to ip-10-0-139-184.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-0ca59-predictor-b4665bc9b-65wkq |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-0ca59-predictor-b4665bc9b-65wkq to ip-10-0-139-184.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-6c7b3-predictor-7f4499fcf8-f5g4c |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-6c7b3-predictor-7f4499fcf8-f5g4c to ip-10-0-139-184.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-0600b-predictor-655f9fcfd4-98d2n |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-0600b-predictor-655f9fcfd4-98d2n to ip-10-0-139-184.ec2.internal | ||
kserve-ci-e2e-test |
switch-graph-e5e5a-65c9566545-brp96 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/switch-graph-e5e5a-65c9566545-brp96 to ip-10-0-139-184.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-e5e5a-predictor-7bd5747694-zwckw |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-e5e5a-predictor-7bd5747694-zwckw to ip-10-0-139-184.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-26ebe-predictor-585cfc74d-f52v6 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-26ebe-predictor-585cfc74d-f52v6 to ip-10-0-139-184.ec2.internal | ||
kserve-ci-e2e-test |
splitter-graph-93cee-7d756c9f5c-6gn5j |
Scheduled |
Successfully assigned kserve-ci-e2e-test/splitter-graph-93cee-7d756c9f5c-6gn5j to ip-10-0-139-184.ec2.internal | ||
kserve-ci-e2e-test |
sequence-graph-26ebe-8fb564fb5-7z45l |
Scheduled |
Successfully assigned kserve-ci-e2e-test/sequence-graph-26ebe-8fb564fb5-7z45l to ip-10-0-139-184.ec2.internal | ||
kserve-ci-e2e-test |
sequence-graph-6c7b3-86d869f885-wpbqp |
Scheduled |
Successfully assigned kserve-ci-e2e-test/sequence-graph-6c7b3-86d869f885-wpbqp to ip-10-0-139-184.ec2.internal | ||
kserve-ci-e2e-test |
ensemble-graph-0ca59-8bcb68dfb-v4b49 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/ensemble-graph-0ca59-8bcb68dfb-v4b49 to ip-10-0-139-184.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-0600b-predictor-cf96ff6c-ccj24 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-0600b-predictor-cf96ff6c-ccj24 to ip-10-0-138-34.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-7809f-predictor-858cb9b479-84qdj |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-7809f-predictor-858cb9b479-84qdj to ip-10-0-138-34.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-0ca59-predictor-546755f487-skcxd |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-0ca59-predictor-546755f487-skcxd to ip-10-0-138-34.ec2.internal | ||
kserve-ci-e2e-test |
sequence-graph-7809f-56768674bd-l46kl |
Scheduled |
Successfully assigned kserve-ci-e2e-test/sequence-graph-7809f-56768674bd-l46kl to ip-10-0-139-184.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-6c7b3-predictor-5b9464bf9c-l89s7 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-6c7b3-predictor-5b9464bf9c-l89s7 to ip-10-0-138-34.ec2.internal | ||
kserve-ci-e2e-test |
splitter-graph-6bad9-5444bd87c8-6slkv |
Scheduled |
Successfully assigned kserve-ci-e2e-test/splitter-graph-6bad9-5444bd87c8-6slkv to ip-10-0-139-184.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-e5e5a-predictor-55d7d95565-l7vg7 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-e5e5a-predictor-55d7d95565-l7vg7 to ip-10-0-138-34.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-2a210-predictor-846fc69544-c4mwm |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-2a210-predictor-846fc69544-c4mwm to ip-10-0-139-184.ec2.internal | ||
kserve-ci-e2e-test |
isvc-sklearn-graph-1-predictor-7b45b6d56d-gdxfv |
Scheduled |
Successfully assigned kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7b45b6d56d-gdxfv to ip-10-0-139-184.ec2.internal | ||
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-e1324-predictor-7798b8b7c8 |
SuccessfulCreate |
Created pod: success-200-isvc-e1324-predictor-7798b8b7c8-cktzl | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-e1324-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-e1324-predictor-7798b8b7c8 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
isvc-sklearn-graph-1-predictor-7b45b6d56d |
SuccessfulCreate |
Created pod: isvc-sklearn-graph-1-predictor-7b45b6d56d-gdxfv | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-e1324-predictor-69874b497-dbzwh |
Pulling |
Pulling image "quay.io/opendatahub/error-404-isvc:odh-pr-1404" | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-e1324 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-e1324": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-e1324 |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-e1324": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-e1324": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
multus |
error-404-isvc-e1324-predictor-69874b497-dbzwh |
AddedInterface |
Add eth0 [10.132.0.28/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-7b45b6d56d-gdxfv |
Pulling |
Pulling image "quay.io/opendatahub/kserve-storage-initializer@sha256:3460f014e7dc0a9d3daafe0716ca9eadf865f2892e0a5103d0b876da9f34891f" | |
kserve-ci-e2e-test |
multus |
isvc-sklearn-graph-1-predictor-7b45b6d56d-gdxfv |
AddedInterface |
Add eth0 [10.134.0.29/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-e1324-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-e1324-predictor-69874b497 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-e1324-predictor-69874b497 |
SuccessfulCreate |
Created pod: error-404-isvc-e1324-predictor-69874b497-dbzwh | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-e1324-predictor-7798b8b7c8-cktzl |
Pulling |
Pulling image "quay.io/opendatahub/success-200-isvc:odh-pr-1404" | |
kserve-ci-e2e-test |
deployment-controller |
isvc-sklearn-graph-1-predictor |
ScalingReplicaSet |
Scaled up replica set isvc-sklearn-graph-1-predictor-7b45b6d56d from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
isvc-sklearn-graph-2-predictor |
ScalingReplicaSet |
Scaled up replica set isvc-sklearn-graph-2-predictor-67687994d4 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
isvc-xgboost-graph-predictor-669d8d6456 |
SuccessfulCreate |
Created pod: isvc-xgboost-graph-predictor-669d8d6456-pcrdj | |
kserve-ci-e2e-test |
deployment-controller |
isvc-xgboost-graph-predictor |
ScalingReplicaSet |
Scaled up replica set isvc-xgboost-graph-predictor-669d8d6456 from 0 to 1 | |
kserve-ci-e2e-test |
multus |
success-200-isvc-e1324-predictor-7798b8b7c8-cktzl |
AddedInterface |
Add eth0 [10.134.0.28/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
multus |
isvc-xgboost-graph-predictor-669d8d6456-pcrdj |
AddedInterface |
Add eth0 [10.132.0.29/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-669d8d6456-pcrdj |
Pulling |
Pulling image "quay.io/opendatahub/kserve-storage-initializer@sha256:3460f014e7dc0a9d3daafe0716ca9eadf865f2892e0a5103d0b876da9f34891f" | |
kserve-ci-e2e-test |
replicaset-controller |
isvc-sklearn-graph-2-predictor-67687994d4 |
SuccessfulCreate |
Created pod: isvc-sklearn-graph-2-predictor-67687994d4-tgjwl | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-67687994d4-tgjwl |
Pulling |
Pulling image "quay.io/opendatahub/kserve-storage-initializer@sha256:3460f014e7dc0a9d3daafe0716ca9eadf865f2892e0a5103d0b876da9f34891f" | |
kserve-ci-e2e-test |
multus |
isvc-sklearn-graph-2-predictor-67687994d4-tgjwl |
AddedInterface |
Add eth0 [10.132.0.30/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-e1324-predictor-7798b8b7c8-cktzl |
Pulled |
Successfully pulled image "quay.io/opendatahub/success-200-isvc:odh-pr-1404" in 13.405s (13.405s including waiting). Image size: 1335719555 bytes. | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-e1324-predictor-7798b8b7c8-cktzl |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-7b45b6d56d-gdxfv |
Pulled |
Successfully pulled image "quay.io/opendatahub/kserve-storage-initializer@sha256:3460f014e7dc0a9d3daafe0716ca9eadf865f2892e0a5103d0b876da9f34891f" in 12.893s (12.893s including waiting). Image size: 301485528 bytes. | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-e1324-predictor-7798b8b7c8-cktzl |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-e1324-predictor-7798b8b7c8-cktzl |
Pulling |
Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-7b45b6d56d-gdxfv |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-7b45b6d56d-gdxfv |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-67687994d4-tgjwl |
Pulled |
Successfully pulled image "quay.io/opendatahub/kserve-storage-initializer@sha256:3460f014e7dc0a9d3daafe0716ca9eadf865f2892e0a5103d0b876da9f34891f" in 12.906s (12.906s including waiting). Image size: 301485528 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-67687994d4-tgjwl |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-67687994d4-tgjwl |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-669d8d6456-pcrdj |
Pulled |
Successfully pulled image "quay.io/opendatahub/kserve-storage-initializer@sha256:3460f014e7dc0a9d3daafe0716ca9eadf865f2892e0a5103d0b876da9f34891f" in 13.586s (13.586s including waiting). Image size: 301485528 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-669d8d6456-pcrdj |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-669d8d6456-pcrdj |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-e1324-predictor-69874b497-dbzwh |
Pulling |
Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-e1324-predictor-69874b497-dbzwh |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-e1324-predictor-69874b497-dbzwh |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-e1324-predictor-69874b497-dbzwh |
Pulled |
Successfully pulled image "quay.io/opendatahub/error-404-isvc:odh-pr-1404" in 14.464s (14.464s including waiting). Image size: 1334713979 bytes. | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-e1324-predictor-7798b8b7c8-cktzl |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-e1324-predictor-7798b8b7c8-cktzl |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" in 2.573s (2.573s including waiting). Image size: 211946088 bytes. | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-e1324-predictor-7798b8b7c8-cktzl |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-7b45b6d56d-gdxfv |
Pulling |
Pulling image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1404" | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-e1324-predictor-69874b497-dbzwh |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-e1324-predictor-69874b497-dbzwh |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-e1324-predictor-69874b497-dbzwh |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" in 2.514s (2.514s including waiting). Image size: 211946088 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-669d8d6456-pcrdj |
Pulling |
Pulling image "kserve/xgbserver:latest" | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-67687994d4-tgjwl |
Pulling |
Pulling image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1404" | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-7b45b6d56d-gdxfv |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-7b45b6d56d-gdxfv |
Pulled |
Successfully pulled image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1404" in 7.471s (7.471s including waiting). Image size: 1560922562 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-7b45b6d56d-gdxfv |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-67687994d4-tgjwl |
Pulled |
Successfully pulled image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1404" in 6.664s (6.664s including waiting). Image size: 1560922562 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-67687994d4-tgjwl |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-7b45b6d56d-gdxfv |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-7b45b6d56d-gdxfv |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-7b45b6d56d-gdxfv |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-67687994d4-tgjwl |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-67687994d4-tgjwl |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-67687994d4-tgjwl |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-67687994d4-tgjwl |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-669d8d6456-pcrdj |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-669d8d6456-pcrdj |
Pulled |
Successfully pulled image "kserve/xgbserver:latest" in 19.679s (19.679s including waiting). Image size: 1306329851 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-669d8d6456-pcrdj |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-669d8d6456-pcrdj |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-669d8d6456-pcrdj |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-669d8d6456-pcrdj |
Started |
Started container kube-rbac-proxy | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-e1324-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-e1324-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-e1324-predictor-7798b8b7c8-cktzl |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.28:8080: connect: connection refused |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-e1324-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-e1324-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-e1324 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-e1324 |
InferenceServiceReady |
InferenceService [success-200-isvc-e1324] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-e1324 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-e1324 |
InferenceServiceReady |
InferenceService [error-404-isvc-e1324] is Ready | |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-e1324 |
InferenceGraphReady |
InferenceGraph [switch-graph-e1324] is Ready | |
kserve-ci-e2e-test |
replicaset-controller |
switch-graph-e1324-b8c5ffc4 |
SuccessfulCreate |
Created pod: switch-graph-e1324-b8c5ffc4-w28k7 | |
kserve-ci-e2e-test |
deployment-controller |
switch-graph-e1324 |
ScalingReplicaSet |
Scaled up replica set switch-graph-e1324-b8c5ffc4 from 0 to 1 | |
kserve-ci-e2e-test |
multus |
switch-graph-e1324-b8c5ffc4-w28k7 |
AddedInterface |
Add eth0 [10.134.0.30/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
switch-graph-e1324-b8c5ffc4-w28k7 |
Pulling |
Pulling image "quay.io/opendatahub/kserve-router@sha256:6a7f2e0065ff588673ad687410eb1f2b5ccfca9b42b71ed586d2fac5a64a6ca4" | |
kserve-ci-e2e-test |
kubelet |
switch-graph-e1324-b8c5ffc4-w28k7 |
Pulled |
Successfully pulled image "quay.io/opendatahub/kserve-router@sha256:6a7f2e0065ff588673ad687410eb1f2b5ccfca9b42b71ed586d2fac5a64a6ca4" in 2.666s (2.666s including waiting). Image size: 216346748 bytes. | |
kserve-ci-e2e-test |
kubelet |
switch-graph-e1324-b8c5ffc4-w28k7 |
Started |
Started container switch-graph-e1324 | |
kserve-ci-e2e-test |
kubelet |
switch-graph-e1324-b8c5ffc4-w28k7 |
Created |
Created container: switch-graph-e1324 | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-e1324-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-e1324-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-0600b-predictor-655f9fcfd4 |
SuccessfulCreate |
Created pod: success-200-isvc-0600b-predictor-655f9fcfd4-98d2n | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-e1324-predictor-69874b497-dbzwh |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-e1324-predictor-69874b497-dbzwh |
Killing |
Stopping container kube-rbac-proxy | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-e1324-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-e1324-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-e1324-predictor-7798b8b7c8-cktzl |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-e1324-predictor-7798b8b7c8-cktzl |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-0600b-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-0600b-predictor-655f9fcfd4 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
switch-graph-e1324-b8c5ffc4-w28k7 |
Killing |
Stopping container switch-graph-e1324 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-0600b-predictor-655f9fcfd4-98d2n |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "success-200-isvc-0600b-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-0600b |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-0600b": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-0600b |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-0600b": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-0600b": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-0600b |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-0600b": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-0600b |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-0600b": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-0600b": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-0600b-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-0600b-predictor-cf96ff6c from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-0600b-predictor-cf96ff6c |
SuccessfulCreate |
Created pod: error-404-isvc-0600b-predictor-cf96ff6c-ccj24 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-0600b-predictor-655f9fcfd4-98d2n |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-0600b-predictor-655f9fcfd4-98d2n |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-0600b-predictor-655f9fcfd4-98d2n |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1404" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-0600b-predictor-cf96ff6c-ccj24 |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-0600b-predictor-655f9fcfd4-98d2n |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-0600b-predictor-655f9fcfd4-98d2n |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
multus |
success-200-isvc-0600b-predictor-655f9fcfd4-98d2n |
AddedInterface |
Add eth0 [10.134.0.31/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-0600b-predictor-cf96ff6c-ccj24 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-0600b-predictor-cf96ff6c-ccj24 |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
multus |
error-404-isvc-0600b-predictor-cf96ff6c-ccj24 |
AddedInterface |
Add eth0 [10.132.0.31/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-0600b-predictor-cf96ff6c-ccj24 |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1404" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-0600b-predictor-cf96ff6c-ccj24 |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-0600b-predictor-cf96ff6c-ccj24 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-0600b-predictor-655f9fcfd4-98d2n |
Started |
Started container kube-rbac-proxy | |
| (x9) | kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-1 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-1 |
InferenceServiceReady |
InferenceService [isvc-sklearn-graph-1] is Ready | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-e1324-predictor-69874b497-dbzwh |
Unhealthy |
Readiness probe failed: Get "https://10.132.0.28:8643/healthz": dial tcp 10.132.0.28:8643: connect: connection refused | |
| (x8) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-e1324-predictor-69874b497-dbzwh |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.28:8080: connect: connection refused |
| (x8) | kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-669d8d6456-pcrdj |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.29:8080: connect: connection refused |
| (x9) | kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-2 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-2 |
InferenceServiceReady |
InferenceService [isvc-sklearn-graph-2] is Ready | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x7) | kserve-ci-e2e-test |
kubelet |
switch-graph-e1324-b8c5ffc4-w28k7 |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "switch-graph-e1324-serving-cert" not found |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x9) | kserve-ci-e2e-test |
v1beta1Controllers |
isvc-xgboost-graph |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
isvc-xgboost-graph |
InferenceServiceReady |
InferenceService [isvc-xgboost-graph] is Ready | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-0600b-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-0600b-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
InferenceGraphController |
model-chainer |
InferenceGraphReady |
InferenceGraph [model-chainer] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
model-chainer |
ScalingReplicaSet |
Scaled up replica set model-chainer-59fd89b477 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
model-chainer-59fd89b477 |
SuccessfulCreate |
Created pod: model-chainer-59fd89b477-szskd | |
kserve-ci-e2e-test |
kubelet |
model-chainer-59fd89b477-szskd |
Started |
Started container model-chainer | |
kserve-ci-e2e-test |
kubelet |
model-chainer-59fd89b477-szskd |
Created |
Created container: model-chainer | |
kserve-ci-e2e-test |
kubelet |
model-chainer-59fd89b477-szskd |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:6a7f2e0065ff588673ad687410eb1f2b5ccfca9b42b71ed586d2fac5a64a6ca4" already present on machine | |
kserve-ci-e2e-test |
multus |
model-chainer-59fd89b477-szskd |
AddedInterface |
Add eth0 [10.134.0.32/23] from ovn-kubernetes | |
| (x6) | kserve-ci-e2e-test |
kubelet |
switch-graph-e1324-b8c5ffc4-w28k7 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-669d8d6456-pcrdj |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-7b45b6d56d-gdxfv |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-6c7b3-predictor-5b9464bf9c |
SuccessfulCreate |
Created pod: error-404-isvc-6c7b3-predictor-5b9464bf9c-l89s7 | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-67687994d4-tgjwl |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-67687994d4-tgjwl |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
model-chainer-59fd89b477-szskd |
Killing |
Stopping container model-chainer | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-6c7b3-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-6c7b3-predictor-7f4499fcf8 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-6c7b3-predictor-7f4499fcf8 |
SuccessfulCreate |
Created pod: success-200-isvc-6c7b3-predictor-7f4499fcf8-f5g4c | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-6c7b3 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-6c7b3": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-6c7b3": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-6c7b3 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-6c7b3": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-6c7b3-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-6c7b3-predictor-5b9464bf9c from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-669d8d6456-pcrdj |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-6c7b3-predictor-7f4499fcf8-f5g4c |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-6c7b3-predictor-7f4499fcf8-f5g4c |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-6c7b3-predictor-7f4499fcf8-f5g4c |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-6c7b3-predictor-7f4499fcf8-f5g4c |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-6c7b3-predictor-7f4499fcf8-f5g4c |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-6c7b3-predictor-7f4499fcf8-f5g4c |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1404" already present on machine | |
kserve-ci-e2e-test |
multus |
success-200-isvc-6c7b3-predictor-7f4499fcf8-f5g4c |
AddedInterface |
Add eth0 [10.134.0.33/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-7b45b6d56d-gdxfv |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-6c7b3-predictor-5b9464bf9c-l89s7 |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "error-404-isvc-6c7b3-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-7b45b6d56d-gdxfv |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.29:8643/healthz": dial tcp 10.134.0.29:8643: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-6c7b3-predictor-5b9464bf9c-l89s7 |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
multus |
error-404-isvc-6c7b3-predictor-5b9464bf9c-l89s7 |
AddedInterface |
Add eth0 [10.132.0.32/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-6c7b3-predictor-5b9464bf9c-l89s7 |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1404" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-6c7b3-predictor-5b9464bf9c-l89s7 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-6c7b3-predictor-5b9464bf9c-l89s7 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-669d8d6456-pcrdj |
Unhealthy |
Readiness probe failed: Get "https://10.132.0.29:8643/healthz": dial tcp 10.132.0.29:8643: connect: connection refused | |
| (x9) | kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-7b45b6d56d-gdxfv |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.29:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-6c7b3-predictor-5b9464bf9c-l89s7 |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-6c7b3-predictor-5b9464bf9c-l89s7 |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-67687994d4-tgjwl |
Unhealthy |
Readiness probe failed: Get "https://10.132.0.30:8643/healthz": dial tcp 10.132.0.30:8643: connect: connection refused | |
| (x10) | kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-67687994d4-tgjwl |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.30:8080: connect: connection refused |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-0600b |
InferenceServiceReady |
InferenceService [error-404-isvc-0600b] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-0600b |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-0600b |
InferenceServiceReady |
InferenceService [success-200-isvc-0600b] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-0600b |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
multus |
switch-graph-0600b-587b488647-lbj9j |
AddedInterface |
Add eth0 [10.134.0.34/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
replicaset-controller |
switch-graph-0600b-587b488647 |
SuccessfulCreate |
Created pod: switch-graph-0600b-587b488647-lbj9j | |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-0600b |
InferenceGraphReady |
InferenceGraph [switch-graph-0600b] is Ready | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-0600b-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
kubelet |
switch-graph-0600b-587b488647-lbj9j |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:6a7f2e0065ff588673ad687410eb1f2b5ccfca9b42b71ed586d2fac5a64a6ca4" already present on machine | |
kserve-ci-e2e-test |
deployment-controller |
switch-graph-0600b |
ScalingReplicaSet |
Scaled up replica set switch-graph-0600b-587b488647 from 0 to 1 | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-0600b-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
kubelet |
switch-graph-0600b-587b488647-lbj9j |
Started |
Started container switch-graph-0600b | |
kserve-ci-e2e-test |
kubelet |
switch-graph-0600b-587b488647-lbj9j |
Created |
Created container: switch-graph-0600b | |
| (x6) | kserve-ci-e2e-test |
kubelet |
model-chainer-59fd89b477-szskd |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-6c7b3-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-6c7b3-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-6c7b3-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-6c7b3-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-6c7b3-predictor-5b9464bf9c-l89s7 |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.32:8080: connect: connection refused |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-6c7b3 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-6c7b3 |
InferenceServiceReady |
InferenceService [error-404-isvc-6c7b3] is Ready | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-6c7b3 |
InferenceServiceReady |
InferenceService [success-200-isvc-6c7b3] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-6c7b3 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x6) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-0600b-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x6) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-0600b-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
replicaset-controller |
sequence-graph-6c7b3-86d869f885 |
SuccessfulCreate |
Created pod: sequence-graph-6c7b3-86d869f885-wpbqp | |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-6c7b3 |
InferenceGraphReady |
InferenceGraph [sequence-graph-6c7b3] is Ready | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-6c7b3-86d869f885-wpbqp |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "sequence-graph-6c7b3-serving-cert" not found | |
kserve-ci-e2e-test |
deployment-controller |
sequence-graph-6c7b3 |
ScalingReplicaSet |
Scaled up replica set sequence-graph-6c7b3-86d869f885 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-6c7b3-86d869f885-wpbqp |
Created |
Created container: sequence-graph-6c7b3 | |
kserve-ci-e2e-test |
multus |
sequence-graph-6c7b3-86d869f885-wpbqp |
AddedInterface |
Add eth0 [10.134.0.35/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-6c7b3-86d869f885-wpbqp |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:6a7f2e0065ff588673ad687410eb1f2b5ccfca9b42b71ed586d2fac5a64a6ca4" already present on machine | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-6c7b3-86d869f885-wpbqp |
Started |
Started container sequence-graph-6c7b3 | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-0600b |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-0600b |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-6c7b3-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-6c7b3-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-6c7b3-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-6c7b3 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-6c7b3 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-6c7b3-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-6c7b3 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-6c7b3 |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-2a210-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-2a210-predictor-846fc69544 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-2a210-predictor-846fc69544 |
SuccessfulCreate |
Created pod: success-200-isvc-2a210-predictor-846fc69544-c4mwm | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-2a210 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-2a210": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-0600b-predictor-655f9fcfd4-98d2n |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-0600b-predictor-655f9fcfd4-98d2n |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-2a210-predictor-7bb85759bc-hqfwt |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-2a210 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-2a210": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-2a210 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-2a210": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-2a210": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
switch-graph-0600b-587b488647-lbj9j |
Killing |
Stopping container switch-graph-0600b | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-0600b-predictor-cf96ff6c-ccj24 |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-2a210-predictor-7bb85759bc-hqfwt |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-0600b-predictor-cf96ff6c-ccj24 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-2a210 |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-2a210": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-2a210": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-2a210-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-2a210-predictor-7bb85759bc from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-2a210-predictor-7bb85759bc |
SuccessfulCreate |
Created pod: error-404-isvc-2a210-predictor-7bb85759bc-hqfwt | |
kserve-ci-e2e-test |
multus |
error-404-isvc-2a210-predictor-7bb85759bc-hqfwt |
AddedInterface |
Add eth0 [10.132.0.33/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-2a210-predictor-7bb85759bc-hqfwt |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1404" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-2a210-predictor-7bb85759bc-hqfwt |
Created |
Created container: kserve-container | |
| (x2) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-2a210-predictor-846fc69544-c4mwm |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "success-200-isvc-2a210-predictor-serving-cert" not found |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-2a210-predictor-7bb85759bc-hqfwt |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-2a210-predictor-7bb85759bc-hqfwt |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-2a210-predictor-846fc69544-c4mwm |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
multus |
success-200-isvc-2a210-predictor-846fc69544-c4mwm |
AddedInterface |
Add eth0 [10.134.0.36/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-2a210-predictor-846fc69544-c4mwm |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-2a210-predictor-846fc69544-c4mwm |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-2a210-predictor-846fc69544-c4mwm |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-2a210-predictor-846fc69544-c4mwm |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-2a210-predictor-846fc69544-c4mwm |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1404" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-0600b-predictor-655f9fcfd4-98d2n |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.31:8643/healthz": dial tcp 10.134.0.31:8643: connect: connection refused | |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-0600b-predictor-655f9fcfd4-98d2n |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.31:8080: connect: connection refused |
| (x7) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-0600b-predictor-cf96ff6c-ccj24 |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.31:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-0600b-predictor-cf96ff6c-ccj24 |
Unhealthy |
Readiness probe failed: Get "https://10.132.0.31:8643/healthz": dial tcp 10.132.0.31:8643: connect: connection refused | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-2a210-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-2a210-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x6) | kserve-ci-e2e-test |
kubelet |
switch-graph-0600b-587b488647-lbj9j |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-2a210-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-2a210-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-2a210-predictor-7bb85759bc-hqfwt |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.33:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-2a210-predictor-846fc69544-c4mwm |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.36:8080: connect: connection refused |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-26ebe-predictor-7d49cd9f75 |
SuccessfulCreate |
Created pod: error-404-isvc-26ebe-predictor-7d49cd9f75-qjrrs | |
kserve-ci-e2e-test |
multus |
error-404-isvc-26ebe-predictor-7d49cd9f75-qjrrs |
AddedInterface |
Add eth0 [10.132.0.34/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-6c7b3-predictor-5b9464bf9c-l89s7 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-6c7b3-predictor-7f4499fcf8-f5g4c |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-26ebe-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-26ebe-predictor-7d49cd9f75 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-26ebe-predictor-7d49cd9f75-qjrrs |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-26ebe-predictor-7d49cd9f75-qjrrs |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-26ebe-predictor-7d49cd9f75-qjrrs |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-26ebe-predictor-7d49cd9f75-qjrrs |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-26ebe-predictor-7d49cd9f75-qjrrs |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-26ebe-predictor-7d49cd9f75-qjrrs |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1404" already present on machine | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-6c7b3-86d869f885-wpbqp |
Killing |
Stopping container sequence-graph-6c7b3 | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-26ebe |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-26ebe": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-26ebe-predictor-585cfc74d |
SuccessfulCreate |
Created pod: success-200-isvc-26ebe-predictor-585cfc74d-f52v6 | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-26ebe-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-26ebe-predictor-585cfc74d from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-26ebe-predictor-585cfc74d-f52v6 |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "success-200-isvc-26ebe-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-26ebe |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-26ebe": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-26ebe": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-26ebe |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-26ebe": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-26ebe": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-6c7b3-predictor-5b9464bf9c-l89s7 |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-26ebe |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-26ebe": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-6c7b3-predictor-7f4499fcf8-f5g4c |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-26ebe-predictor-585cfc74d-f52v6 |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-26ebe-predictor-585cfc74d-f52v6 |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-26ebe-predictor-585cfc74d-f52v6 |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-26ebe-predictor-585cfc74d-f52v6 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-26ebe-predictor-585cfc74d-f52v6 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-26ebe-predictor-585cfc74d-f52v6 |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1404" already present on machine | |
kserve-ci-e2e-test |
multus |
success-200-isvc-26ebe-predictor-585cfc74d-f52v6 |
AddedInterface |
Add eth0 [10.134.0.37/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-6c7b3-predictor-7f4499fcf8-f5g4c |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.33:8643/healthz": dial tcp 10.134.0.33:8643: connect: connection refused | |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-6c7b3-predictor-7f4499fcf8-f5g4c |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.33:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-6c7b3-predictor-5b9464bf9c-l89s7 |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.32:8080: i/o timeout | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-6c7b3-predictor-5b9464bf9c-l89s7 |
Unhealthy |
Readiness probe failed: Get "https://10.132.0.32:8643/healthz": context deadline exceeded | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-2a210 |
InferenceServiceReady |
InferenceService [error-404-isvc-2a210] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-2a210 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-2a210 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-2a210 |
InferenceServiceReady |
InferenceService [success-200-isvc-2a210] is Ready | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-26ebe-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-26ebe-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
InferenceGraphController |
ensemble-graph-2a210 |
InferenceGraphReady |
InferenceGraph [ensemble-graph-2a210] is Ready | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-2a210-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-2a210-76dff99855-v7s6j |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "ensemble-graph-2a210-serving-cert" not found | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-2a210-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-2a210-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
replicaset-controller |
ensemble-graph-2a210-76dff99855 |
SuccessfulCreate |
Created pod: ensemble-graph-2a210-76dff99855-v7s6j | |
kserve-ci-e2e-test |
deployment-controller |
ensemble-graph-2a210 |
ScalingReplicaSet |
Scaled up replica set ensemble-graph-2a210-76dff99855 from 0 to 1 | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-2a210-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-2a210-76dff99855-v7s6j |
Created |
Created container: ensemble-graph-2a210 | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-2a210-76dff99855-v7s6j |
Started |
Started container ensemble-graph-2a210 | |
kserve-ci-e2e-test |
multus |
ensemble-graph-2a210-76dff99855-v7s6j |
AddedInterface |
Add eth0 [10.134.0.38/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-2a210-76dff99855-v7s6j |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:6a7f2e0065ff588673ad687410eb1f2b5ccfca9b42b71ed586d2fac5a64a6ca4" already present on machine | |
| (x6) | kserve-ci-e2e-test |
kubelet |
sequence-graph-6c7b3-86d869f885-wpbqp |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-26ebe-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-0ca59-predictor-b4665bc9b |
SuccessfulCreate |
Created pod: success-200-isvc-0ca59-predictor-b4665bc9b-65wkq | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-2a210-predictor-846fc69544-c4mwm |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-26ebe-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-2a210-76dff99855-v7s6j |
Killing |
Stopping container ensemble-graph-2a210 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-2a210-predictor-846fc69544-c4mwm |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-0ca59 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-0ca59": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-2a210-predictor-7bb85759bc-hqfwt |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-0ca59 |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-0ca59": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-0ca59": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-0ca59-predictor-546755f487 |
SuccessfulCreate |
Created pod: error-404-isvc-0ca59-predictor-546755f487-skcxd | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-0ca59-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-0ca59-predictor-b4665bc9b from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-0ca59-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-0ca59-predictor-546755f487 from 0 to 1 | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-0ca59 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-0ca59": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-2a210-predictor-7bb85759bc-hqfwt |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-0ca59 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-0ca59": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-0ca59": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-0ca59-predictor-b4665bc9b-65wkq |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-0ca59-predictor-b4665bc9b-65wkq |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-0ca59-predictor-b4665bc9b-65wkq |
Created |
Created container: kube-rbac-proxy | |
| (x2) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-0ca59-predictor-546755f487-skcxd |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "error-404-isvc-0ca59-predictor-serving-cert" not found |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-0ca59-predictor-b4665bc9b-65wkq |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1404" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-0ca59-predictor-b4665bc9b-65wkq |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-0ca59-predictor-b4665bc9b-65wkq |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
multus |
success-200-isvc-0ca59-predictor-b4665bc9b-65wkq |
AddedInterface |
Add eth0 [10.134.0.39/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-0ca59-predictor-546755f487-skcxd |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-0ca59-predictor-546755f487-skcxd |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-0ca59-predictor-546755f487-skcxd |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-0ca59-predictor-546755f487-skcxd |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-0ca59-predictor-546755f487-skcxd |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1404" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-0ca59-predictor-546755f487-skcxd |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
multus |
error-404-isvc-0ca59-predictor-546755f487-skcxd |
AddedInterface |
Add eth0 [10.132.0.35/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-2a210-predictor-7bb85759bc-hqfwt |
Unhealthy |
Readiness probe failed: Get "https://10.132.0.33:8643/healthz": dial tcp 10.132.0.33:8643: connect: connection refused | |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-26ebe-predictor-585cfc74d-f52v6 |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.37:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-26ebe-predictor-7d49cd9f75-qjrrs |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.34:8080: connect: connection refused |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-26ebe |
InferenceServiceReady |
InferenceService [success-200-isvc-26ebe] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-26ebe |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-26ebe |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-26ebe |
InferenceServiceReady |
InferenceService [error-404-isvc-26ebe] is Ready | |
| (x6) | kserve-ci-e2e-test |
kubelet |
ensemble-graph-2a210-76dff99855-v7s6j |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-26ebe |
InternalError |
fails to update InferenceGraph status: Operation cannot be fulfilled on inferencegraphs.serving.kserve.io "sequence-graph-26ebe": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-26ebe-8fb564fb5-7z45l |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:6a7f2e0065ff588673ad687410eb1f2b5ccfca9b42b71ed586d2fac5a64a6ca4" already present on machine | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-26ebe-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-26ebe-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-26ebe-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-26ebe-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-0ca59-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-0ca59-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-0ca59-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
multus |
sequence-graph-26ebe-8fb564fb5-7z45l |
AddedInterface |
Add eth0 [10.134.0.40/23] from ovn-kubernetes | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-0ca59-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
sequence-graph-26ebe-8fb564fb5-7z45l |
Created |
Created container: sequence-graph-26ebe | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-26ebe-8fb564fb5-7z45l |
Started |
Started container sequence-graph-26ebe | |
kserve-ci-e2e-test |
replicaset-controller |
sequence-graph-26ebe-8fb564fb5 |
SuccessfulCreate |
Created pod: sequence-graph-26ebe-8fb564fb5-7z45l | |
kserve-ci-e2e-test |
deployment-controller |
sequence-graph-26ebe |
ScalingReplicaSet |
Scaled up replica set sequence-graph-26ebe-8fb564fb5 from 0 to 1 | |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-26ebe |
UpdateFailed |
Failed to update status for InferenceGraph "sequence-graph-26ebe": Operation cannot be fulfilled on inferencegraphs.serving.kserve.io "sequence-graph-26ebe": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-26ebe |
InferenceGraphReady |
InferenceGraph [sequence-graph-26ebe] is Ready | |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-0ca59-predictor-b4665bc9b-65wkq |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.39:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-7809f-predictor-b4788b9f6-r48p7 |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "success-200-isvc-7809f-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-26ebe-predictor-585cfc74d-f52v6 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-7809f |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-7809f": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-26ebe-predictor-7d49cd9f75-qjrrs |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-26ebe-8fb564fb5-7z45l |
Killing |
Stopping container sequence-graph-26ebe | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-7809f-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-7809f-predictor-858cb9b479 from 0 to 1 | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-7809f |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-7809f": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-7809f": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-7809f-predictor-b4788b9f6 |
SuccessfulCreate |
Created pod: success-200-isvc-7809f-predictor-b4788b9f6-r48p7 | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-7809f |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-7809f": the object has been modified; please apply your changes to the latest version and try again | |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-0ca59-predictor-546755f487-skcxd |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.35:8080: connect: connection refused |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-7809f |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-7809f": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-7809f": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-7809f-predictor-858cb9b479 |
SuccessfulCreate |
Created pod: error-404-isvc-7809f-predictor-858cb9b479-84qdj | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-26ebe-predictor-7d49cd9f75-qjrrs |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-7809f-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-7809f-predictor-b4788b9f6 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-26ebe-predictor-585cfc74d-f52v6 |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
multus |
error-404-isvc-7809f-predictor-858cb9b479-84qdj |
AddedInterface |
Add eth0 [10.132.0.36/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
multus |
success-200-isvc-7809f-predictor-b4788b9f6-r48p7 |
AddedInterface |
Add eth0 [10.134.0.41/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-7809f-predictor-858cb9b479-84qdj |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-7809f-predictor-858cb9b479-84qdj |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-7809f-predictor-858cb9b479-84qdj |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-7809f-predictor-b4788b9f6-r48p7 |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-7809f-predictor-b4788b9f6-r48p7 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-7809f-predictor-b4788b9f6-r48p7 |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-7809f-predictor-858cb9b479-84qdj |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-7809f-predictor-b4788b9f6-r48p7 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-7809f-predictor-b4788b9f6-r48p7 |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1404" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-7809f-predictor-b4788b9f6-r48p7 |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-7809f-predictor-858cb9b479-84qdj |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1404" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-7809f-predictor-858cb9b479-84qdj |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-26ebe-predictor-585cfc74d-f52v6 |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.37:8643/healthz": dial tcp 10.134.0.37:8643: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-26ebe-predictor-7d49cd9f75-qjrrs |
Unhealthy |
Readiness probe failed: Get "https://10.132.0.34:8643/healthz": dial tcp 10.132.0.34:8643: connect: connection refused | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-0ca59 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-0ca59 |
InferenceServiceReady |
InferenceService [success-200-isvc-0ca59] is Ready | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-0ca59 |
InferenceServiceReady |
InferenceService [error-404-isvc-0ca59] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-0ca59 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-7809f-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-7809f-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-0ca59-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
replicaset-controller |
ensemble-graph-0ca59-8bcb68dfb |
SuccessfulCreate |
Created pod: ensemble-graph-0ca59-8bcb68dfb-v4b49 | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-0ca59-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
deployment-controller |
ensemble-graph-0ca59 |
ScalingReplicaSet |
Scaled up replica set ensemble-graph-0ca59-8bcb68dfb from 0 to 1 | |
kserve-ci-e2e-test |
InferenceGraphController |
ensemble-graph-0ca59 |
InferenceGraphReady |
InferenceGraph [ensemble-graph-0ca59] is Ready | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-0ca59-8bcb68dfb-v4b49 |
Started |
Started container ensemble-graph-0ca59 | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-0ca59-8bcb68dfb-v4b49 |
Created |
Created container: ensemble-graph-0ca59 | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-0ca59-8bcb68dfb-v4b49 |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:6a7f2e0065ff588673ad687410eb1f2b5ccfca9b42b71ed586d2fac5a64a6ca4" already present on machine | |
kserve-ci-e2e-test |
multus |
ensemble-graph-0ca59-8bcb68dfb-v4b49 |
AddedInterface |
Add eth0 [10.134.0.42/23] from ovn-kubernetes | |
| (x6) | kserve-ci-e2e-test |
kubelet |
sequence-graph-26ebe-8fb564fb5-7z45l |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
ensemble-graph-0ca59 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-0ca59-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
ensemble-graph-0ca59 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-0ca59-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-7809f-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-7809f-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-7809f |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-7809f |
InferenceServiceReady |
InferenceService [error-404-isvc-7809f] is Ready | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-7809f |
InferenceServiceReady |
InferenceService [success-200-isvc-7809f] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-7809f |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
ensemble-graph-0ca59 |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
ensemble-graph-0ca59 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
replicaset-controller |
sequence-graph-7809f-56768674bd |
SuccessfulCreate |
Created pod: sequence-graph-7809f-56768674bd-l46kl | |
kserve-ci-e2e-test |
deployment-controller |
sequence-graph-7809f |
ScalingReplicaSet |
Scaled up replica set sequence-graph-7809f-56768674bd from 0 to 1 | |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-7809f |
InferenceGraphReady |
InferenceGraph [sequence-graph-7809f] is Ready | |
kserve-ci-e2e-test |
multus |
sequence-graph-7809f-56768674bd-l46kl |
AddedInterface |
Add eth0 [10.134.0.43/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-7809f-56768674bd-l46kl |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:6a7f2e0065ff588673ad687410eb1f2b5ccfca9b42b71ed586d2fac5a64a6ca4" already present on machine | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-7809f-56768674bd-l46kl |
Created |
Created container: sequence-graph-7809f | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-7809f-56768674bd-l46kl |
Started |
Started container sequence-graph-7809f | |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-7809f-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-7809f-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-7809f-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-7809f-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-7809f |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-7809f |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-6bad9-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-6bad9-predictor-6c4b946b59 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-0ca59-predictor-546755f487-skcxd |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-6bad9-predictor-6c4b946b59-klxc7 |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "error-404-isvc-6bad9-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-6bad9 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-6bad9": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-6bad9": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-6bad9 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-6bad9": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-6bad9 |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-6bad9": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-6bad9": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-6bad9 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-6bad9": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-6bad9-predictor-6c4b946b59 |
SuccessfulCreate |
Created pod: error-404-isvc-6bad9-predictor-6c4b946b59-klxc7 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-0ca59-predictor-546755f487-skcxd |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-0ca59-8bcb68dfb-v4b49 |
Killing |
Stopping container ensemble-graph-0ca59 | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-6bad9-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-6bad9-predictor-5d7df76d56 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-6bad9-predictor-5d7df76d56 |
SuccessfulCreate |
Created pod: success-200-isvc-6bad9-predictor-5d7df76d56-h7pdr | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-0ca59-predictor-b4665bc9b-65wkq |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-0ca59-predictor-b4665bc9b-65wkq |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-6bad9-predictor-6c4b946b59-klxc7 |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
multus |
error-404-isvc-6bad9-predictor-6c4b946b59-klxc7 |
AddedInterface |
Add eth0 [10.132.0.37/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-6bad9-predictor-5d7df76d56-h7pdr |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-6bad9-predictor-5d7df76d56-h7pdr |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-6bad9-predictor-5d7df76d56-h7pdr |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-6bad9-predictor-5d7df76d56-h7pdr |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-6bad9-predictor-6c4b946b59-klxc7 |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-6bad9-predictor-6c4b946b59-klxc7 |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-6bad9-predictor-5d7df76d56-h7pdr |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-6bad9-predictor-5d7df76d56-h7pdr |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1404" already present on machine | |
kserve-ci-e2e-test |
multus |
success-200-isvc-6bad9-predictor-5d7df76d56-h7pdr |
AddedInterface |
Add eth0 [10.134.0.44/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-6bad9-predictor-6c4b946b59-klxc7 |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1404" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-6bad9-predictor-6c4b946b59-klxc7 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-6bad9-predictor-6c4b946b59-klxc7 |
Started |
Started container kserve-container | |
| (x6) | kserve-ci-e2e-test |
kubelet |
ensemble-graph-0ca59-8bcb68dfb-v4b49 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-6bad9-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-6bad9-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-6bad9-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-6bad9-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-6bad9-predictor-6c4b946b59-klxc7 |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.37:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-6bad9-predictor-5d7df76d56-h7pdr |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.44:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-7809f-predictor-b4788b9f6-r48p7 |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-7809f-56768674bd-l46kl |
Killing |
Stopping container sequence-graph-7809f | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-e5e5a |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-e5e5a": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-e5e5a |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-e5e5a": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-e5e5a": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-e5e5a |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-e5e5a": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-e5e5a |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-e5e5a": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-e5e5a": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-e5e5a-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-e5e5a-predictor-7bd5747694 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-e5e5a-predictor-7bd5747694 |
SuccessfulCreate |
Created pod: success-200-isvc-e5e5a-predictor-7bd5747694-zwckw | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-e5e5a-predictor-7bd5747694-zwckw |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-e5e5a-predictor-7bd5747694-zwckw |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-e5e5a-predictor-7bd5747694-zwckw |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-e5e5a-predictor-7bd5747694-zwckw |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-e5e5a-predictor-7bd5747694-zwckw |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-e5e5a-predictor-7bd5747694-zwckw |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1404" already present on machine | |
kserve-ci-e2e-test |
multus |
success-200-isvc-e5e5a-predictor-7bd5747694-zwckw |
AddedInterface |
Add eth0 [10.134.0.45/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-e5e5a-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-e5e5a-predictor-55d7d95565 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-e5e5a-predictor-55d7d95565 |
SuccessfulCreate |
Created pod: error-404-isvc-e5e5a-predictor-55d7d95565-l7vg7 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-e5e5a-predictor-55d7d95565-l7vg7 |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1404" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-7809f-predictor-858cb9b479-84qdj |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
multus |
error-404-isvc-e5e5a-predictor-55d7d95565-l7vg7 |
AddedInterface |
Add eth0 [10.132.0.38/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-7809f-predictor-858cb9b479-84qdj |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-7809f-predictor-b4788b9f6-r48p7 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-e5e5a-predictor-55d7d95565-l7vg7 |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-e5e5a-predictor-55d7d95565-l7vg7 |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-e5e5a-predictor-55d7d95565-l7vg7 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-e5e5a-predictor-55d7d95565-l7vg7 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-e5e5a-predictor-55d7d95565-l7vg7 |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-7809f-predictor-b4788b9f6-r48p7 |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.41:8643/healthz": dial tcp 10.134.0.41:8643: connect: connection refused | |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-7809f-predictor-b4788b9f6-r48p7 |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.41:8080: connect: connection refused |
| (x7) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-7809f-predictor-858cb9b479-84qdj |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.36:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-7809f-predictor-858cb9b479-84qdj |
Unhealthy |
Readiness probe failed: Get "https://10.132.0.36:8643/healthz": dial tcp 10.132.0.36:8643: connect: connection refused | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-6bad9 |
InferenceServiceReady |
InferenceService [error-404-isvc-6bad9] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-6bad9 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-6bad9 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-6bad9 |
InferenceServiceReady |
InferenceService [success-200-isvc-6bad9] is Ready | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-e5e5a-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-e5e5a-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-6bad9-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-6bad9-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-6bad9-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-6bad9-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
replicaset-controller |
splitter-graph-6bad9-5444bd87c8 |
SuccessfulCreate |
Created pod: splitter-graph-6bad9-5444bd87c8-6slkv | |
kserve-ci-e2e-test |
deployment-controller |
splitter-graph-6bad9 |
ScalingReplicaSet |
Scaled up replica set splitter-graph-6bad9-5444bd87c8 from 0 to 1 | |
kserve-ci-e2e-test |
InferenceGraphController |
splitter-graph-6bad9 |
InferenceGraphReady |
InferenceGraph [splitter-graph-6bad9] is Ready | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-6bad9-5444bd87c8-6slkv |
Started |
Started container splitter-graph-6bad9 | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-6bad9-5444bd87c8-6slkv |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:6a7f2e0065ff588673ad687410eb1f2b5ccfca9b42b71ed586d2fac5a64a6ca4" already present on machine | |
kserve-ci-e2e-test |
multus |
splitter-graph-6bad9-5444bd87c8-6slkv |
AddedInterface |
Add eth0 [10.134.0.46/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-6bad9-5444bd87c8-6slkv |
Created |
Created container: splitter-graph-6bad9 | |
| (x6) | kserve-ci-e2e-test |
kubelet |
sequence-graph-7809f-56768674bd-l46kl |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
kubelet |
splitter-graph-6bad9-5444bd87c8-6slkv |
Killing |
Stopping container splitter-graph-6bad9 | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-e5e5a-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-e5e5a-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-93cee-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-93cee-predictor-7d9b86d498 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-93cee-predictor-7d9b86d498 |
SuccessfulCreate |
Created pod: success-200-isvc-93cee-predictor-7d9b86d498-48dr9 | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-93cee |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-93cee": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-93cee": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-93cee |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-93cee": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-6bad9-predictor-5d7df76d56-h7pdr |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-6bad9-predictor-5d7df76d56-h7pdr |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-93cee-predictor-7d9b86d498-48dr9 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
multus |
success-200-isvc-93cee-predictor-7d9b86d498-48dr9 |
AddedInterface |
Add eth0 [10.134.0.47/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-93cee-predictor-787774f689-d62cr |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "error-404-isvc-93cee-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-93cee-predictor-787774f689 |
SuccessfulCreate |
Created pod: error-404-isvc-93cee-predictor-787774f689-d62cr | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-93cee-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-93cee-predictor-787774f689 from 0 to 1 | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-93cee |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-93cee": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-93cee": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-93cee |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-93cee": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-6bad9-predictor-6c4b946b59-klxc7 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-93cee-predictor-7d9b86d498-48dr9 |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-93cee-predictor-7d9b86d498-48dr9 |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-93cee-predictor-7d9b86d498-48dr9 |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-6bad9-predictor-6c4b946b59-klxc7 |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-93cee-predictor-7d9b86d498-48dr9 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-93cee-predictor-7d9b86d498-48dr9 |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1404" already present on machine | |
kserve-ci-e2e-test |
multus |
error-404-isvc-93cee-predictor-787774f689-d62cr |
AddedInterface |
Add eth0 [10.132.0.39/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-93cee-predictor-787774f689-d62cr |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-93cee-predictor-787774f689-d62cr |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-93cee-predictor-787774f689-d62cr |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1404" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-93cee-predictor-787774f689-d62cr |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-93cee-predictor-787774f689-d62cr |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-93cee-predictor-787774f689-d62cr |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-6bad9-predictor-6c4b946b59-klxc7 |
Unhealthy |
Readiness probe failed: Get "https://10.132.0.37:8643/healthz": dial tcp 10.132.0.37:8643: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-6bad9-predictor-5d7df76d56-h7pdr |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.44:8643/healthz": dial tcp 10.134.0.44:8643: connect: connection refused | |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-e5e5a-predictor-55d7d95565-l7vg7 |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.38:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-e5e5a-predictor-7bd5747694-zwckw |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.45:8080: connect: connection refused |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-e5e5a |
InferenceServiceReady |
InferenceService [error-404-isvc-e5e5a] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-e5e5a |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-e5e5a |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-e5e5a |
InferenceServiceReady |
InferenceService [success-200-isvc-e5e5a] is Ready | |
| (x6) | kserve-ci-e2e-test |
kubelet |
splitter-graph-6bad9-5444bd87c8-6slkv |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
replicaset-controller |
switch-graph-e5e5a-65c9566545 |
SuccessfulCreate |
Created pod: switch-graph-e5e5a-65c9566545-brp96 | |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-e5e5a |
InferenceGraphReady |
InferenceGraph [switch-graph-e5e5a] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
switch-graph-e5e5a |
ScalingReplicaSet |
Scaled up replica set switch-graph-e5e5a-65c9566545 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
switch-graph-e5e5a-65c9566545-brp96 |
Started |
Started container switch-graph-e5e5a | |
kserve-ci-e2e-test |
multus |
switch-graph-e5e5a-65c9566545-brp96 |
AddedInterface |
Add eth0 [10.134.0.48/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
switch-graph-e5e5a-65c9566545-brp96 |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:6a7f2e0065ff588673ad687410eb1f2b5ccfca9b42b71ed586d2fac5a64a6ca4" already present on machine | |
kserve-ci-e2e-test |
kubelet |
switch-graph-e5e5a-65c9566545-brp96 |
Created |
Created container: switch-graph-e5e5a | |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-93cee-predictor-787774f689-d62cr |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.39:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-93cee-predictor-7d9b86d498-48dr9 |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.47:8080: connect: connection refused |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-93cee-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-e5e5a-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-e5e5a-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-93cee-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-93cee-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-93cee-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-93cee |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-93cee |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-93cee |
InferenceServiceReady |
InferenceService [error-404-isvc-93cee] is Ready | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-93cee |
InferenceServiceReady |
InferenceService [success-200-isvc-93cee] is Ready | |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-e5e5a-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-e5e5a-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
InferenceGraphController |
splitter-graph-93cee |
InferenceGraphReady |
InferenceGraph [splitter-graph-93cee] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
splitter-graph-93cee |
ScalingReplicaSet |
Scaled up replica set splitter-graph-93cee-7d756c9f5c from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
splitter-graph-93cee-7d756c9f5c |
SuccessfulCreate |
Created pod: splitter-graph-93cee-7d756c9f5c-6gn5j | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-93cee-7d756c9f5c-6gn5j |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "splitter-graph-93cee-serving-cert" not found | |
kserve-ci-e2e-test |
multus |
splitter-graph-93cee-7d756c9f5c-6gn5j |
AddedInterface |
Add eth0 [10.134.0.49/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-93cee-7d756c9f5c-6gn5j |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:6a7f2e0065ff588673ad687410eb1f2b5ccfca9b42b71ed586d2fac5a64a6ca4" already present on machine | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-93cee-7d756c9f5c-6gn5j |
Created |
Created container: splitter-graph-93cee | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-93cee-7d756c9f5c-6gn5j |
Started |
Started container splitter-graph-93cee | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-e5e5a |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-e5e5a |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-93cee-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-93cee-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-93cee-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-93cee-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
splitter-graph-93cee |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
splitter-graph-93cee |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-93cee-predictor-787774f689-d62cr |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-93cee-predictor-787774f689-d62cr |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-93cee-predictor-7d9b86d498-48dr9 |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-93cee-predictor-7d9b86d498-48dr9 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-93cee-7d756c9f5c-6gn5j |
Killing |
Stopping container splitter-graph-93cee | |
| (x6) | kserve-ci-e2e-test |
kubelet |
splitter-graph-93cee-7d756c9f5c-6gn5j |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-e5e5a-predictor-55d7d95565-l7vg7 |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
switch-graph-e5e5a-65c9566545-brp96 |
Killing |
Stopping container switch-graph-e5e5a | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-e5e5a-predictor-7bd5747694-zwckw |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-e5e5a-predictor-7bd5747694-zwckw |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-e5e5a-predictor-55d7d95565-l7vg7 |
Killing |
Stopping container kserve-container | |
| (x5) | kserve-ci-e2e-test |
kubelet |
switch-graph-e5e5a-65c9566545-brp96 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |