| Time | Namespace | Component | RelatedObject | Reason | Message |
|---|---|---|---|---|---|
kserve-ci-e2e-test |
error-404-isvc-83116-predictor-849469f6df-2lzrf |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-83116-predictor-849469f6df-2lzrf to ip-10-0-136-75.ec2.internal | ||
kserve-ci-e2e-test |
switch-graph-83116-6fdf4466fc-m5mtv |
Scheduled |
Successfully assigned kserve-ci-e2e-test/switch-graph-83116-6fdf4466fc-m5mtv to ip-10-0-136-75.ec2.internal | ||
kserve-ci-e2e-test |
ensemble-graph-15cdb-68844c9fc9-dsxnm |
Scheduled |
Successfully assigned kserve-ci-e2e-test/ensemble-graph-15cdb-68844c9fc9-dsxnm to ip-10-0-136-75.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-a868a-predictor-848b5648c5-46cjq |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-a868a-predictor-848b5648c5-46cjq to ip-10-0-136-75.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-cdd1d-predictor-66cb4945ff-2r8ml |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-cdd1d-predictor-66cb4945ff-2r8ml to ip-10-0-136-75.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-ecafe-predictor-bf7d7ddc-5k2k4 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-ecafe-predictor-bf7d7ddc-5k2k4 to ip-10-0-136-75.ec2.internal | ||
kserve-ci-e2e-test |
isvc-sklearn-graph-1-predictor-664c5c98bd-8nr4d |
Scheduled |
Successfully assigned kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-664c5c98bd-8nr4d to ip-10-0-137-148.ec2.internal | ||
kserve-ci-e2e-test |
isvc-xgboost-graph-predictor-669d8d6456-xhv8r |
Scheduled |
Successfully assigned kserve-ci-e2e-test/isvc-xgboost-graph-predictor-669d8d6456-xhv8r to ip-10-0-137-148.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-31b2e-predictor-848cf47897-zpj2x |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-31b2e-predictor-848cf47897-zpj2x to ip-10-0-136-75.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-3e303-predictor-7ccc759659-gfmqm |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-3e303-predictor-7ccc759659-gfmqm to ip-10-0-136-75.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-734fc-predictor-5995d7675c-86m5w |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-734fc-predictor-5995d7675c-86m5w to ip-10-0-136-75.ec2.internal | ||
kserve-ci-e2e-test |
ensemble-graph-ecafe-fd8585c74-tmpzq |
Scheduled |
Successfully assigned kserve-ci-e2e-test/ensemble-graph-ecafe-fd8585c74-tmpzq to ip-10-0-136-75.ec2.internal | ||
kserve-ci-e2e-test |
isvc-sklearn-graph-2-predictor-58cc67cb8-c6bdg |
Scheduled |
Successfully assigned kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-58cc67cb8-c6bdg to ip-10-0-137-148.ec2.internal | ||
kserve-ci-e2e-test |
switch-graph-69925-7c7b5bdf4d-g6qn6 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/switch-graph-69925-7c7b5bdf4d-g6qn6 to ip-10-0-136-75.ec2.internal | ||
kserve-ci-e2e-test |
switch-graph-3e303-66c47b978f-nfvht |
Scheduled |
Successfully assigned kserve-ci-e2e-test/switch-graph-3e303-66c47b978f-nfvht to ip-10-0-136-75.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-ecafe-predictor-785fb74b88-nx9dq |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-ecafe-predictor-785fb74b88-nx9dq to ip-10-0-137-148.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-cdd1d-predictor-685c7f8cd8-5jgsv |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-cdd1d-predictor-685c7f8cd8-5jgsv to ip-10-0-137-148.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-a868a-predictor-7675b7748-5r6xk |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-a868a-predictor-7675b7748-5r6xk to ip-10-0-137-148.ec2.internal | ||
kserve-ci-e2e-test |
model-chainer-d669cd755-txm6r |
Scheduled |
Successfully assigned kserve-ci-e2e-test/model-chainer-d669cd755-txm6r to ip-10-0-136-75.ec2.internal | ||
kserve-ci-e2e-test |
sequence-graph-14a90-6db7cfb9f9-9d8xf |
Scheduled |
Successfully assigned kserve-ci-e2e-test/sequence-graph-14a90-6db7cfb9f9-9d8xf to ip-10-0-136-75.ec2.internal | ||
kserve-ci-e2e-test |
sequence-graph-734fc-699db48bbd-8gvbt |
Scheduled |
Successfully assigned kserve-ci-e2e-test/sequence-graph-734fc-699db48bbd-8gvbt to ip-10-0-136-75.ec2.internal | ||
kserve-ci-e2e-test |
sequence-graph-cdd1d-84988c9c55-pflbb |
Scheduled |
Successfully assigned kserve-ci-e2e-test/sequence-graph-cdd1d-84988c9c55-pflbb to ip-10-0-136-75.ec2.internal | ||
kserve-ci-e2e-test |
splitter-graph-31b2e-5cc6cdf9c9-jndff |
Scheduled |
Successfully assigned kserve-ci-e2e-test/splitter-graph-31b2e-5cc6cdf9c9-jndff to ip-10-0-136-75.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-83116-predictor-59d5fb4b86-m27ms |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-83116-predictor-59d5fb4b86-m27ms to ip-10-0-137-148.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-14a90-predictor-547774646f-lrxtg |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-14a90-predictor-547774646f-lrxtg to ip-10-0-136-75.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-734fc-predictor-64d98dd8b6-bknhg |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-734fc-predictor-64d98dd8b6-bknhg to ip-10-0-137-148.ec2.internal | ||
kserve-ci-e2e-test |
splitter-graph-a868a-757c8c8c4d-92495 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/splitter-graph-a868a-757c8c8c4d-92495 to ip-10-0-136-75.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-14a90-predictor-75bc8f9bb-fv57c |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-14a90-predictor-75bc8f9bb-fv57c to ip-10-0-137-148.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-15cdb-predictor-679cfbb586-s4rql |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-15cdb-predictor-679cfbb586-s4rql to ip-10-0-137-148.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-31b2e-predictor-67cf4677b6-p2vdx |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-31b2e-predictor-67cf4677b6-p2vdx to ip-10-0-137-148.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-3e303-predictor-54ff64d9f6-79pgj |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-3e303-predictor-54ff64d9f6-79pgj to ip-10-0-137-148.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-69925-predictor-5d57446965-8zjs4 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-69925-predictor-5d57446965-8zjs4 to ip-10-0-136-75.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-15cdb-predictor-7c646df98f-sjwvp |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-15cdb-predictor-7c646df98f-sjwvp to ip-10-0-136-75.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-69925-predictor-697c88cf8-dk2sh |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-69925-predictor-697c88cf8-dk2sh to ip-10-0-137-148.ec2.internal | ||
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-69925-predictor-5d57446965 |
SuccessfulCreate |
Created pod: error-404-isvc-69925-predictor-5d57446965-8zjs4 | |
kserve-ci-e2e-test |
multus |
error-404-isvc-69925-predictor-5d57446965-8zjs4 |
AddedInterface |
Add eth0 [10.134.0.31/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-664c5c98bd-8nr4d |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "isvc-sklearn-graph-1-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
replicaset-controller |
isvc-xgboost-graph-predictor-669d8d6456 |
SuccessfulCreate |
Created pod: isvc-xgboost-graph-predictor-669d8d6456-xhv8r | |
kserve-ci-e2e-test |
replicaset-controller |
isvc-sklearn-graph-1-predictor-664c5c98bd |
SuccessfulCreate |
Created pod: isvc-sklearn-graph-1-predictor-664c5c98bd-8nr4d | |
kserve-ci-e2e-test |
deployment-controller |
isvc-sklearn-graph-1-predictor |
ScalingReplicaSet |
Scaled up replica set isvc-sklearn-graph-1-predictor-664c5c98bd from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
isvc-xgboost-graph-predictor |
ScalingReplicaSet |
Scaled up replica set isvc-xgboost-graph-predictor-669d8d6456 from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-69925-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-69925-predictor-5d57446965 from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
isvc-sklearn-graph-2-predictor |
ScalingReplicaSet |
Scaled up replica set isvc-sklearn-graph-2-predictor-58cc67cb8 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-69925-predictor-5d57446965-8zjs4 |
Pulling |
Pulling image "quay.io/opendatahub/error-404-isvc:odh-pr-1501" | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-69925-predictor-697c88cf8-dk2sh |
Pulling |
Pulling image "quay.io/opendatahub/success-200-isvc:odh-pr-1501" | |
kserve-ci-e2e-test |
multus |
success-200-isvc-69925-predictor-697c88cf8-dk2sh |
AddedInterface |
Add eth0 [10.133.0.19/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-69925-predictor-697c88cf8 |
SuccessfulCreate |
Created pod: success-200-isvc-69925-predictor-697c88cf8-dk2sh | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-69925-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-69925-predictor-697c88cf8 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-664c5c98bd-8nr4d |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:0459e31fff147b1f9487117ac00a86221572ce2251d3068d36cf76ed2126ea4f" already present on machine | |
kserve-ci-e2e-test |
replicaset-controller |
isvc-sklearn-graph-2-predictor-58cc67cb8 |
SuccessfulCreate |
Created pod: isvc-sklearn-graph-2-predictor-58cc67cb8-c6bdg | |
kserve-ci-e2e-test |
multus |
isvc-xgboost-graph-predictor-669d8d6456-xhv8r |
AddedInterface |
Add eth0 [10.133.0.20/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-669d8d6456-xhv8r |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:0459e31fff147b1f9487117ac00a86221572ce2251d3068d36cf76ed2126ea4f" already present on machine | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-669d8d6456-xhv8r |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-669d8d6456-xhv8r |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
multus |
isvc-sklearn-graph-1-predictor-664c5c98bd-8nr4d |
AddedInterface |
Add eth0 [10.133.0.18/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-664c5c98bd-8nr4d |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-664c5c98bd-8nr4d |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-58cc67cb8-c6bdg |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
multus |
isvc-sklearn-graph-2-predictor-58cc67cb8-c6bdg |
AddedInterface |
Add eth0 [10.133.0.21/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-58cc67cb8-c6bdg |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-58cc67cb8-c6bdg |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:0459e31fff147b1f9487117ac00a86221572ce2251d3068d36cf76ed2126ea4f" already present on machine | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-669d8d6456-xhv8r |
Pulling |
Pulling image "kserve/xgbserver:latest" | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-664c5c98bd-8nr4d |
Pulling |
Pulling image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1501" | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-58cc67cb8-c6bdg |
Pulling |
Pulling image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1501" | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-69925-predictor-5d57446965-8zjs4 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-69925-predictor-5d57446965-8zjs4 |
Pulled |
Successfully pulled image "quay.io/opendatahub/error-404-isvc:odh-pr-1501" in 11.315s (11.315s including waiting). Image size: 1334723672 bytes. | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-69925-predictor-5d57446965-8zjs4 |
Pulling |
Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-69925-predictor-5d57446965-8zjs4 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-69925-predictor-697c88cf8-dk2sh |
Pulling |
Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-69925-predictor-697c88cf8-dk2sh |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-69925-predictor-697c88cf8-dk2sh |
Pulled |
Successfully pulled image "quay.io/opendatahub/success-200-isvc:odh-pr-1501" in 12.301s (12.301s including waiting). Image size: 1335711840 bytes. | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-69925-predictor-697c88cf8-dk2sh |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-69925-predictor-5d57446965-8zjs4 |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-69925-predictor-5d57446965-8zjs4 |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" in 2.179s (2.179s including waiting). Image size: 211946088 bytes. | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-69925-predictor-5d57446965-8zjs4 |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-664c5c98bd-8nr4d |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-58cc67cb8-c6bdg |
Pulling |
Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-664c5c98bd-8nr4d |
Pulled |
Successfully pulled image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1501" in 11.858s (11.858s including waiting). Image size: 1560929697 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-664c5c98bd-8nr4d |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-664c5c98bd-8nr4d |
Pulling |
Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-58cc67cb8-c6bdg |
Pulled |
Successfully pulled image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1501" in 6.84s (6.84s including waiting). Image size: 1560929697 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-58cc67cb8-c6bdg |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-58cc67cb8-c6bdg |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-664c5c98bd-8nr4d |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-664c5c98bd-8nr4d |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" in 2.606s (2.606s including waiting). Image size: 211946088 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-58cc67cb8-c6bdg |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-58cc67cb8-c6bdg |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-69925-predictor-697c88cf8-dk2sh |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-69925-predictor-697c88cf8-dk2sh |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" in 7.337s (7.337s including waiting). Image size: 211946088 bytes. | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-69925-predictor-697c88cf8-dk2sh |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-58cc67cb8-c6bdg |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" in 2.595s (2.595s including waiting). Image size: 211946088 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-664c5c98bd-8nr4d |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-669d8d6456-xhv8r |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-669d8d6456-xhv8r |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-669d8d6456-xhv8r |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-669d8d6456-xhv8r |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-669d8d6456-xhv8r |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-669d8d6456-xhv8r |
Pulled |
Successfully pulled image "kserve/xgbserver:latest" in 27.172s (27.172s including waiting). Image size: 1306436347 bytes. | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-69925-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-69925-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-69925-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-69925-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-69925-predictor-5d57446965-8zjs4 |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.31:8080: connect: connection refused |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-69925 |
InferenceServiceReady |
InferenceService [error-404-isvc-69925] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-69925 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-69925-predictor-697c88cf8-dk2sh |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.19:8080: connect: connection refused |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-69925 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-69925 |
InferenceServiceReady |
InferenceService [success-200-isvc-69925] is Ready | |
| (x10) | kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-58cc67cb8-c6bdg |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.21:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
switch-graph-69925-7c7b5bdf4d-g6qn6 |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "switch-graph-69925-serving-cert" not found | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-69925-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-69925-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-69925 |
InferenceGraphReady |
InferenceGraph [switch-graph-69925] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
switch-graph-69925 |
ScalingReplicaSet |
Scaled up replica set switch-graph-69925-7c7b5bdf4d from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
switch-graph-69925-7c7b5bdf4d |
SuccessfulCreate |
Created pod: switch-graph-69925-7c7b5bdf4d-g6qn6 | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-69925-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-69925-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
kubelet |
switch-graph-69925-7c7b5bdf4d-g6qn6 |
Pulling |
Pulling image "quay.io/opendatahub/kserve-router@sha256:04926a9d7185ff179745ae32ed77ae962904508dbcb7541e9bf600392af6f503" | |
kserve-ci-e2e-test |
multus |
switch-graph-69925-7c7b5bdf4d-g6qn6 |
AddedInterface |
Add eth0 [10.134.0.32/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
switch-graph-69925-7c7b5bdf4d-g6qn6 |
Created |
Created container: switch-graph-69925 | |
kserve-ci-e2e-test |
kubelet |
switch-graph-69925-7c7b5bdf4d-g6qn6 |
Started |
Started container switch-graph-69925 | |
kserve-ci-e2e-test |
kubelet |
switch-graph-69925-7c7b5bdf4d-g6qn6 |
Pulled |
Successfully pulled image "quay.io/opendatahub/kserve-router@sha256:04926a9d7185ff179745ae32ed77ae962904508dbcb7541e9bf600392af6f503" in 2.201s (2.201s including waiting). Image size: 218002168 bytes. | |
kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-1 |
InferenceServiceReady |
InferenceService [isvc-sklearn-graph-1] is Ready | |
| (x8) | kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-1 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-2 |
InferenceServiceReady |
InferenceService [isvc-sklearn-graph-2] is Ready | |
| (x8) | kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-2 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-69925-predictor-5d57446965-8zjs4 |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
switch-graph-69925-7c7b5bdf4d-g6qn6 |
Killing |
Stopping container switch-graph-69925 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-69925-predictor-5d57446965-8zjs4 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-69925-predictor-697c88cf8-dk2sh |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-69925-predictor-5d57446965-8zjs4 |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.31:8643/healthz": dial tcp 10.134.0.31:8643: connect: connection refused | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-83116 |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-83116": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-83116": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-69925-predictor-697c88cf8-dk2sh |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-83116 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-83116": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-83116-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-83116-predictor-59d5fb4b86 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-83116-predictor-59d5fb4b86 |
SuccessfulCreate |
Created pod: success-200-isvc-83116-predictor-59d5fb4b86-m27ms | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-83116 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-83116": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-83116 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-83116": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-83116": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-83116-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-83116-predictor-849469f6df from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-83116-predictor-849469f6df |
SuccessfulCreate |
Created pod: error-404-isvc-83116-predictor-849469f6df-2lzrf | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-83116-predictor-59d5fb4b86-m27ms |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "success-200-isvc-83116-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-83116-predictor-849469f6df-2lzrf |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-83116-predictor-59d5fb4b86-m27ms |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1501" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-83116-predictor-59d5fb4b86-m27ms |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-83116-predictor-59d5fb4b86-m27ms |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-83116-predictor-59d5fb4b86-m27ms |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-83116-predictor-59d5fb4b86-m27ms |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-83116-predictor-59d5fb4b86-m27ms |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
isvc-xgboost-graph |
InferenceServiceReady |
InferenceService [isvc-xgboost-graph] is Ready | |
kserve-ci-e2e-test |
multus |
success-200-isvc-83116-predictor-59d5fb4b86-m27ms |
AddedInterface |
Add eth0 [10.133.0.22/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-83116-predictor-849469f6df-2lzrf |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
multus |
error-404-isvc-83116-predictor-849469f6df-2lzrf |
AddedInterface |
Add eth0 [10.134.0.33/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-83116-predictor-849469f6df-2lzrf |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1501" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-83116-predictor-849469f6df-2lzrf |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-83116-predictor-849469f6df-2lzrf |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-83116-predictor-849469f6df-2lzrf |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
| (x7) | kserve-ci-e2e-test |
v1beta1Controllers |
isvc-xgboost-graph |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-69925-predictor-697c88cf8-dk2sh |
Unhealthy |
Readiness probe failed: Get "https://10.133.0.19:8643/healthz": dial tcp 10.133.0.19:8643: connect: connection refused | |
kserve-ci-e2e-test |
replicaset-controller |
model-chainer-d669cd755 |
SuccessfulCreate |
Created pod: model-chainer-d669cd755-txm6r | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
kubelet |
model-chainer-d669cd755-txm6r |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "model-chainer-serving-cert" not found | |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
InferenceGraphController |
model-chainer |
InferenceGraphReady |
InferenceGraph [model-chainer] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
model-chainer |
ScalingReplicaSet |
Scaled up replica set model-chainer-d669cd755 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
model-chainer-d669cd755-txm6r |
Created |
Created container: model-chainer | |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
kubelet |
model-chainer-d669cd755-txm6r |
Started |
Started container model-chainer | |
kserve-ci-e2e-test |
kubelet |
model-chainer-d669cd755-txm6r |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:04926a9d7185ff179745ae32ed77ae962904508dbcb7541e9bf600392af6f503" already present on machine | |
kserve-ci-e2e-test |
multus |
model-chainer-d669cd755-txm6r |
AddedInterface |
Add eth0 [10.134.0.34/23] from ovn-kubernetes | |
| (x6) | kserve-ci-e2e-test |
kubelet |
switch-graph-69925-7c7b5bdf4d-g6qn6 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-cdd1d |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-cdd1d": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-cdd1d": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-83116-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-58cc67cb8-c6bdg |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-83116-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-669d8d6456-xhv8r |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
model-chainer-d669cd755-txm6r |
Killing |
Stopping container model-chainer | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-664c5c98bd-8nr4d |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-cdd1d-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-cdd1d-predictor-685c7f8cd8 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-cdd1d-predictor-685c7f8cd8 |
SuccessfulCreate |
Created pod: success-200-isvc-cdd1d-predictor-685c7f8cd8-5jgsv | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-669d8d6456-xhv8r |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-83116-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-664c5c98bd-8nr4d |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-cdd1d |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-cdd1d": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-cdd1d |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-cdd1d": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-cdd1d": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-cdd1d-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-cdd1d-predictor-66cb4945ff from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-cdd1d-predictor-66cb4945ff |
SuccessfulCreate |
Created pod: error-404-isvc-cdd1d-predictor-66cb4945ff-2r8ml | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-58cc67cb8-c6bdg |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-cdd1d |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-cdd1d": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-83116-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-cdd1d-predictor-685c7f8cd8-5jgsv |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "success-200-isvc-cdd1d-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-cdd1d-predictor-66cb4945ff-2r8ml |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "error-404-isvc-cdd1d-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-cdd1d-predictor-66cb4945ff-2r8ml |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-cdd1d-predictor-685c7f8cd8-5jgsv |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-669d8d6456-xhv8r |
Unhealthy |
Readiness probe failed: Get "https://10.133.0.20:8643/healthz": dial tcp 10.133.0.20:8643: connect: connection refused | |
kserve-ci-e2e-test |
multus |
error-404-isvc-cdd1d-predictor-66cb4945ff-2r8ml |
AddedInterface |
Add eth0 [10.134.0.35/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-cdd1d-predictor-66cb4945ff-2r8ml |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1501" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-cdd1d-predictor-66cb4945ff-2r8ml |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
multus |
success-200-isvc-cdd1d-predictor-685c7f8cd8-5jgsv |
AddedInterface |
Add eth0 [10.133.0.23/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-cdd1d-predictor-66cb4945ff-2r8ml |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-cdd1d-predictor-66cb4945ff-2r8ml |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-cdd1d-predictor-66cb4945ff-2r8ml |
Started |
Started container kube-rbac-proxy | |
| (x9) | kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-669d8d6456-xhv8r |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.20:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-cdd1d-predictor-685c7f8cd8-5jgsv |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1501" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-cdd1d-predictor-685c7f8cd8-5jgsv |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-cdd1d-predictor-685c7f8cd8-5jgsv |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-cdd1d-predictor-685c7f8cd8-5jgsv |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-cdd1d-predictor-685c7f8cd8-5jgsv |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-58cc67cb8-c6bdg |
Unhealthy |
Readiness probe failed: Get "https://10.133.0.21:8643/healthz": dial tcp 10.133.0.21:8643: connect: connection refused | |
| (x10) | kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-664c5c98bd-8nr4d |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.18:8080: connect: connection refused |
| (x2) | kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-664c5c98bd-8nr4d |
Unhealthy |
Readiness probe failed: Get "https://10.133.0.18:8643/healthz": dial tcp 10.133.0.18:8643: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-83116-predictor-59d5fb4b86-m27ms |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.22:8080: connect: connection refused |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-83116 |
InferenceServiceReady |
InferenceService [error-404-isvc-83116] is Ready | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-83116 |
InferenceServiceReady |
InferenceService [success-200-isvc-83116] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-83116 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-83116 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x6) | kserve-ci-e2e-test |
kubelet |
model-chainer-d669cd755-txm6r |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-cdd1d-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
replicaset-controller |
switch-graph-83116-6fdf4466fc |
SuccessfulCreate |
Created pod: switch-graph-83116-6fdf4466fc-m5mtv | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-cdd1d-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
deployment-controller |
switch-graph-83116 |
ScalingReplicaSet |
Scaled up replica set switch-graph-83116-6fdf4466fc from 0 to 1 | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-cdd1d-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-83116 |
InferenceGraphReady |
InferenceGraph [switch-graph-83116] is Ready | |
kserve-ci-e2e-test |
kubelet |
switch-graph-83116-6fdf4466fc-m5mtv |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "switch-graph-83116-serving-cert" not found | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-cdd1d-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
kubelet |
switch-graph-83116-6fdf4466fc-m5mtv |
Created |
Created container: switch-graph-83116 | |
kserve-ci-e2e-test |
kubelet |
switch-graph-83116-6fdf4466fc-m5mtv |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:04926a9d7185ff179745ae32ed77ae962904508dbcb7541e9bf600392af6f503" already present on machine | |
kserve-ci-e2e-test |
multus |
switch-graph-83116-6fdf4466fc-m5mtv |
AddedInterface |
Add eth0 [10.134.0.36/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
switch-graph-83116-6fdf4466fc-m5mtv |
Started |
Started container switch-graph-83116 | |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-cdd1d-predictor-66cb4945ff-2r8ml |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.35:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-cdd1d-predictor-685c7f8cd8-5jgsv |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.23:8080: connect: connection refused |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-83116-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-83116-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-83116-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-83116-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-cdd1d |
InferenceServiceReady |
InferenceService [success-200-isvc-cdd1d] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-cdd1d |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-cdd1d |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-cdd1d |
InferenceServiceReady |
InferenceService [error-404-isvc-cdd1d] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
sequence-graph-cdd1d |
ScalingReplicaSet |
Scaled up replica set sequence-graph-cdd1d-84988c9c55 from 0 to 1 | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-83116 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-83116 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
replicaset-controller |
sequence-graph-cdd1d-84988c9c55 |
SuccessfulCreate |
Created pod: sequence-graph-cdd1d-84988c9c55-pflbb | |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-cdd1d |
InferenceGraphReady |
InferenceGraph [sequence-graph-cdd1d] is Ready | |
kserve-ci-e2e-test |
multus |
sequence-graph-cdd1d-84988c9c55-pflbb |
AddedInterface |
Add eth0 [10.134.0.37/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-cdd1d-84988c9c55-pflbb |
Started |
Started container sequence-graph-cdd1d | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-cdd1d-84988c9c55-pflbb |
Created |
Created container: sequence-graph-cdd1d | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-cdd1d-84988c9c55-pflbb |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:04926a9d7185ff179745ae32ed77ae962904508dbcb7541e9bf600392af6f503" already present on machine | |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-cdd1d-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-cdd1d |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-cdd1d |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-cdd1d-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-cdd1d-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-cdd1d-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-15cdb |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-15cdb": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-15cdb-predictor-7c646df98f |
SuccessfulCreate |
Created pod: error-404-isvc-15cdb-predictor-7c646df98f-sjwvp | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-83116-predictor-59d5fb4b86-m27ms |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-15cdb |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-15cdb": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-15cdb": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-15cdb-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-15cdb-predictor-679cfbb586 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-83116-predictor-849469f6df-2lzrf |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-83116-predictor-849469f6df-2lzrf |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-15cdb-predictor-679cfbb586 |
SuccessfulCreate |
Created pod: success-200-isvc-15cdb-predictor-679cfbb586-s4rql | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-83116-predictor-59d5fb4b86-m27ms |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-15cdb |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-15cdb": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-15cdb-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-15cdb-predictor-7c646df98f from 0 to 1 | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-15cdb |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-15cdb": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-15cdb": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
switch-graph-83116-6fdf4466fc-m5mtv |
Killing |
Stopping container switch-graph-83116 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-15cdb-predictor-7c646df98f-sjwvp |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-15cdb-predictor-679cfbb586-s4rql |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-15cdb-predictor-7c646df98f-sjwvp |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-15cdb-predictor-679cfbb586-s4rql |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1501" already present on machine | |
kserve-ci-e2e-test |
multus |
success-200-isvc-15cdb-predictor-679cfbb586-s4rql |
AddedInterface |
Add eth0 [10.133.0.24/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-15cdb-predictor-7c646df98f-sjwvp |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
multus |
error-404-isvc-15cdb-predictor-7c646df98f-sjwvp |
AddedInterface |
Add eth0 [10.134.0.38/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-15cdb-predictor-7c646df98f-sjwvp |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1501" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-15cdb-predictor-679cfbb586-s4rql |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-15cdb-predictor-7c646df98f-sjwvp |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-15cdb-predictor-7c646df98f-sjwvp |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-15cdb-predictor-679cfbb586-s4rql |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-15cdb-predictor-679cfbb586-s4rql |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-15cdb-predictor-679cfbb586-s4rql |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-83116-predictor-849469f6df-2lzrf |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.33:8643/healthz": dial tcp 10.134.0.33:8643: connect: connection refused | |
| (x7) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-83116-predictor-849469f6df-2lzrf |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.33:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
switch-graph-83116-6fdf4466fc-m5mtv |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-14a90-predictor-75bc8f9bb |
SuccessfulCreate |
Created pod: success-200-isvc-14a90-predictor-75bc8f9bb-fv57c | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-14a90-predictor-547774646f-lrxtg |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "error-404-isvc-14a90-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-14a90 |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-14a90": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-14a90": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-14a90-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-14a90-predictor-75bc8f9bb from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-14a90-predictor-75bc8f9bb-fv57c |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-14a90-predictor-75bc8f9bb-fv57c |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-14a90-predictor-75bc8f9bb-fv57c |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-14a90 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-14a90": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-14a90 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-14a90": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-14a90": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-14a90-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-14a90-predictor-547774646f from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-14a90-predictor-547774646f |
SuccessfulCreate |
Created pod: error-404-isvc-14a90-predictor-547774646f-lrxtg | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-14a90 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-14a90": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-cdd1d-predictor-66cb4945ff-2r8ml |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-15cdb-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-15cdb-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-cdd1d-predictor-66cb4945ff-2r8ml |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-cdd1d-predictor-685c7f8cd8-5jgsv |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-cdd1d-predictor-685c7f8cd8-5jgsv |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-14a90-predictor-75bc8f9bb-fv57c |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1501" already present on machine | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-cdd1d-84988c9c55-pflbb |
Killing |
Stopping container sequence-graph-cdd1d | |
kserve-ci-e2e-test |
multus |
success-200-isvc-14a90-predictor-75bc8f9bb-fv57c |
AddedInterface |
Add eth0 [10.133.0.25/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-14a90-predictor-75bc8f9bb-fv57c |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-14a90-predictor-547774646f-lrxtg |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-14a90-predictor-547774646f-lrxtg |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-14a90-predictor-547774646f-lrxtg |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
multus |
error-404-isvc-14a90-predictor-547774646f-lrxtg |
AddedInterface |
Add eth0 [10.134.0.39/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-14a90-predictor-547774646f-lrxtg |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1501" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-14a90-predictor-547774646f-lrxtg |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-14a90-predictor-547774646f-lrxtg |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-14a90-predictor-75bc8f9bb-fv57c |
Started |
Started container kube-rbac-proxy | |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-15cdb-predictor-7c646df98f-sjwvp |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.38:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-15cdb-predictor-679cfbb586-s4rql |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.24:8080: connect: connection refused |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-15cdb |
InferenceServiceReady |
InferenceService [success-200-isvc-15cdb] is Ready | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-15cdb |
InferenceServiceReady |
InferenceService [error-404-isvc-15cdb] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-15cdb |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-15cdb |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x6) | kserve-ci-e2e-test |
kubelet |
sequence-graph-cdd1d-84988c9c55-pflbb |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-15cdb-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-15cdb-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
InferenceGraphController |
ensemble-graph-15cdb |
InferenceGraphReady |
InferenceGraph [ensemble-graph-15cdb] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
ensemble-graph-15cdb |
ScalingReplicaSet |
Scaled up replica set ensemble-graph-15cdb-68844c9fc9 from 0 to 1 | |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-15cdb-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
replicaset-controller |
ensemble-graph-15cdb-68844c9fc9 |
SuccessfulCreate |
Created pod: ensemble-graph-15cdb-68844c9fc9-dsxnm | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-14a90-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-15cdb-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-14a90-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-15cdb-68844c9fc9-dsxnm |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "ensemble-graph-15cdb-serving-cert" not found | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-14a90-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-14a90-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-15cdb-68844c9fc9-dsxnm |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:04926a9d7185ff179745ae32ed77ae962904508dbcb7541e9bf600392af6f503" already present on machine | |
kserve-ci-e2e-test |
multus |
ensemble-graph-15cdb-68844c9fc9-dsxnm |
AddedInterface |
Add eth0 [10.134.0.40/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-15cdb-68844c9fc9-dsxnm |
Created |
Created container: ensemble-graph-15cdb | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-15cdb-68844c9fc9-dsxnm |
Started |
Started container ensemble-graph-15cdb | |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-14a90-predictor-75bc8f9bb-fv57c |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.25:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-14a90-predictor-547774646f-lrxtg |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.39:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-15cdb-predictor-679cfbb586-s4rql |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-15cdb-68844c9fc9-dsxnm |
Killing |
Stopping container ensemble-graph-15cdb | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-ecafe-predictor-785fb74b88 |
SuccessfulCreate |
Created pod: success-200-isvc-ecafe-predictor-785fb74b88-nx9dq | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-ecafe-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-ecafe-predictor-785fb74b88 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-15cdb-predictor-679cfbb586-s4rql |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-ecafe |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-ecafe": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-ecafe": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-ecafe |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-ecafe": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-ecafe-predictor-bf7d7ddc-5k2k4 |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1501" already present on machine | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-ecafe |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-ecafe": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-ecafe": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-ecafe-predictor-bf7d7ddc-5k2k4 |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-ecafe-predictor-bf7d7ddc-5k2k4 |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-ecafe-predictor-785fb74b88-nx9dq |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-ecafe-predictor-785fb74b88-nx9dq |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-ecafe-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-ecafe-predictor-bf7d7ddc from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-ecafe-predictor-bf7d7ddc-5k2k4 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-ecafe-predictor-bf7d7ddc-5k2k4 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-ecafe-predictor-bf7d7ddc |
SuccessfulCreate |
Created pod: error-404-isvc-ecafe-predictor-bf7d7ddc-5k2k4 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-ecafe-predictor-785fb74b88-nx9dq |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-15cdb-predictor-7c646df98f-sjwvp |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-ecafe |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-ecafe": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
multus |
error-404-isvc-ecafe-predictor-bf7d7ddc-5k2k4 |
AddedInterface |
Add eth0 [10.134.0.41/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
multus |
success-200-isvc-ecafe-predictor-785fb74b88-nx9dq |
AddedInterface |
Add eth0 [10.133.0.26/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-ecafe-predictor-785fb74b88-nx9dq |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1501" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-ecafe-predictor-785fb74b88-nx9dq |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-15cdb-predictor-7c646df98f-sjwvp |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-ecafe-predictor-bf7d7ddc-5k2k4 |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-ecafe-predictor-785fb74b88-nx9dq |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-15cdb-predictor-7c646df98f-sjwvp |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.38:8643/healthz": dial tcp 10.134.0.38:8643: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-15cdb-predictor-679cfbb586-s4rql |
Unhealthy |
Readiness probe failed: Get "https://10.133.0.24:8643/healthz": dial tcp 10.133.0.24:8643: connect: connection refused | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-14a90 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-14a90 |
InferenceServiceReady |
InferenceService [error-404-isvc-14a90] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-14a90 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-14a90 |
InferenceServiceReady |
InferenceService [success-200-isvc-14a90] is Ready | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-14a90-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-14a90-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-14a90 |
InferenceGraphReady |
InferenceGraph [sequence-graph-14a90] is Ready | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-14a90-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
deployment-controller |
sequence-graph-14a90 |
ScalingReplicaSet |
Scaled up replica set sequence-graph-14a90-6db7cfb9f9 from 0 to 1 | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-14a90-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
replicaset-controller |
sequence-graph-14a90-6db7cfb9f9 |
SuccessfulCreate |
Created pod: sequence-graph-14a90-6db7cfb9f9-9d8xf | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-14a90-6db7cfb9f9-9d8xf |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "sequence-graph-14a90-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-14a90-6db7cfb9f9-9d8xf |
Started |
Started container sequence-graph-14a90 | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-14a90-6db7cfb9f9-9d8xf |
Created |
Created container: sequence-graph-14a90 | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-14a90-6db7cfb9f9-9d8xf |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:04926a9d7185ff179745ae32ed77ae962904508dbcb7541e9bf600392af6f503" already present on machine | |
kserve-ci-e2e-test |
multus |
sequence-graph-14a90-6db7cfb9f9-9d8xf |
AddedInterface |
Add eth0 [10.134.0.42/23] from ovn-kubernetes | |
| (x6) | kserve-ci-e2e-test |
kubelet |
ensemble-graph-15cdb-68844c9fc9-dsxnm |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
kubelet |
sequence-graph-14a90-6db7cfb9f9-9d8xf |
Killing |
Stopping container sequence-graph-14a90 | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-734fc |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-734fc": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-734fc |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-734fc": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-734fc": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-734fc-predictor-5995d7675c-86m5w |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "error-404-isvc-734fc-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-734fc |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-734fc": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-734fc": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-734fc-predictor-5995d7675c |
SuccessfulCreate |
Created pod: error-404-isvc-734fc-predictor-5995d7675c-86m5w | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-734fc-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-734fc-predictor-5995d7675c from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-14a90-predictor-547774646f-lrxtg |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-734fc |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-734fc": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-734fc-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-734fc-predictor-64d98dd8b6 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-14a90-predictor-75bc8f9bb-fv57c |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-14a90-predictor-75bc8f9bb-fv57c |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-734fc-predictor-64d98dd8b6-bknhg |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "success-200-isvc-734fc-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-734fc-predictor-64d98dd8b6 |
SuccessfulCreate |
Created pod: success-200-isvc-734fc-predictor-64d98dd8b6-bknhg | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-14a90-predictor-547774646f-lrxtg |
Killing |
Stopping container kube-rbac-proxy | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-ecafe-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-ecafe-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-734fc-predictor-5995d7675c-86m5w |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-734fc-predictor-5995d7675c-86m5w |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-734fc-predictor-64d98dd8b6-bknhg |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-734fc-predictor-64d98dd8b6-bknhg |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-734fc-predictor-64d98dd8b6-bknhg |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-734fc-predictor-64d98dd8b6-bknhg |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-734fc-predictor-64d98dd8b6-bknhg |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
multus |
error-404-isvc-734fc-predictor-5995d7675c-86m5w |
AddedInterface |
Add eth0 [10.134.0.43/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
multus |
success-200-isvc-734fc-predictor-64d98dd8b6-bknhg |
AddedInterface |
Add eth0 [10.133.0.27/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-734fc-predictor-64d98dd8b6-bknhg |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1501" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-734fc-predictor-5995d7675c-86m5w |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1501" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-734fc-predictor-5995d7675c-86m5w |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-734fc-predictor-5995d7675c-86m5w |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-734fc-predictor-5995d7675c-86m5w |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-14a90-predictor-547774646f-lrxtg |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.39:8643/healthz": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-734fc-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-734fc-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-ecafe-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-ecafe-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-ecafe |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-ecafe |
InferenceServiceReady |
InferenceService [success-200-isvc-ecafe] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-ecafe |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-ecafe |
InferenceServiceReady |
InferenceService [error-404-isvc-ecafe] is Ready | |
| (x6) | kserve-ci-e2e-test |
kubelet |
sequence-graph-14a90-6db7cfb9f9-9d8xf |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
deployment-controller |
ensemble-graph-ecafe |
ScalingReplicaSet |
Scaled up replica set ensemble-graph-ecafe-fd8585c74 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
ensemble-graph-ecafe-fd8585c74 |
SuccessfulCreate |
Created pod: ensemble-graph-ecafe-fd8585c74-tmpzq | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-734fc-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-734fc-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-ecafe-fd8585c74-tmpzq |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "ensemble-graph-ecafe-serving-cert" not found | |
kserve-ci-e2e-test |
InferenceGraphController |
ensemble-graph-ecafe |
InferenceGraphReady |
InferenceGraph [ensemble-graph-ecafe] is Ready | |
kserve-ci-e2e-test |
multus |
ensemble-graph-ecafe-fd8585c74-tmpzq |
AddedInterface |
Add eth0 [10.134.0.44/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-ecafe-fd8585c74-tmpzq |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:04926a9d7185ff179745ae32ed77ae962904508dbcb7541e9bf600392af6f503" already present on machine | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-ecafe-fd8585c74-tmpzq |
Started |
Started container ensemble-graph-ecafe | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-ecafe-fd8585c74-tmpzq |
Created |
Created container: ensemble-graph-ecafe | |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-734fc-predictor-5995d7675c-86m5w |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.43:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-734fc-predictor-64d98dd8b6-bknhg |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.27:8080: connect: connection refused |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-ecafe-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-ecafe-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-ecafe-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-ecafe-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-734fc |
InferenceServiceReady |
InferenceService [error-404-isvc-734fc] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-734fc |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-734fc |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-734fc |
InferenceServiceReady |
InferenceService [success-200-isvc-734fc] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
sequence-graph-734fc |
ScalingReplicaSet |
Scaled up replica set sequence-graph-734fc-699db48bbd from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
sequence-graph-734fc-699db48bbd |
SuccessfulCreate |
Created pod: sequence-graph-734fc-699db48bbd-8gvbt | |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-734fc |
InferenceGraphReady |
InferenceGraph [sequence-graph-734fc] is Ready | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-734fc-699db48bbd-8gvbt |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:04926a9d7185ff179745ae32ed77ae962904508dbcb7541e9bf600392af6f503" already present on machine | |
kserve-ci-e2e-test |
multus |
sequence-graph-734fc-699db48bbd-8gvbt |
AddedInterface |
Add eth0 [10.134.0.45/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-734fc-699db48bbd-8gvbt |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "sequence-graph-734fc-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-734fc-699db48bbd-8gvbt |
Started |
Started container sequence-graph-734fc | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-734fc-699db48bbd-8gvbt |
Created |
Created container: sequence-graph-734fc | |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-734fc-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-734fc |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-734fc |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-734fc-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
ensemble-graph-ecafe |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
ensemble-graph-ecafe |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-734fc-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-734fc |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-734fc-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-734fc |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-a868a |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-a868a": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-a868a-predictor-7675b7748 |
SuccessfulCreate |
Created pod: success-200-isvc-a868a-predictor-7675b7748-5r6xk | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-a868a |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-a868a": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-ecafe-fd8585c74-tmpzq |
Killing |
Stopping container ensemble-graph-ecafe | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-a868a |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-a868a": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-a868a": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-ecafe-predictor-bf7d7ddc-5k2k4 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-ecafe-predictor-bf7d7ddc-5k2k4 |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-a868a-predictor-7675b7748-5r6xk |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "success-200-isvc-a868a-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-a868a-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-a868a-predictor-848b5648c5 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-a868a-predictor-848b5648c5 |
SuccessfulCreate |
Created pod: error-404-isvc-a868a-predictor-848b5648c5-46cjq | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-a868a |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-a868a": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-a868a": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-a868a-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-a868a-predictor-7675b7748 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-ecafe-predictor-785fb74b88-nx9dq |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-ecafe-predictor-785fb74b88-nx9dq |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-a868a-predictor-7675b7748-5r6xk |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-a868a-predictor-7675b7748-5r6xk |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-a868a-predictor-848b5648c5-46cjq |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1501" already present on machine | |
kserve-ci-e2e-test |
multus |
error-404-isvc-a868a-predictor-848b5648c5-46cjq |
AddedInterface |
Add eth0 [10.134.0.46/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
multus |
success-200-isvc-a868a-predictor-7675b7748-5r6xk |
AddedInterface |
Add eth0 [10.133.0.28/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-a868a-predictor-7675b7748-5r6xk |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1501" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-a868a-predictor-848b5648c5-46cjq |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "error-404-isvc-a868a-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-a868a-predictor-7675b7748-5r6xk |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-a868a-predictor-7675b7748-5r6xk |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-a868a-predictor-7675b7748-5r6xk |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-a868a-predictor-848b5648c5-46cjq |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-a868a-predictor-848b5648c5-46cjq |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-a868a-predictor-848b5648c5-46cjq |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-a868a-predictor-848b5648c5-46cjq |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-a868a-predictor-848b5648c5-46cjq |
Started |
Started container kserve-container | |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-ecafe-predictor-785fb74b88-nx9dq |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.26:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-ecafe-predictor-785fb74b88-nx9dq |
Unhealthy |
Readiness probe failed: Get "https://10.133.0.26:8643/healthz": dial tcp 10.133.0.26:8643: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-ecafe-predictor-bf7d7ddc-5k2k4 |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.41:8643/healthz": dial tcp 10.134.0.41:8643: connect: connection refused | |
| (x7) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-ecafe-predictor-bf7d7ddc-5k2k4 |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.41:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
ensemble-graph-ecafe-fd8585c74-tmpzq |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-3e303-predictor-54ff64d9f6 |
SuccessfulCreate |
Created pod: success-200-isvc-3e303-predictor-54ff64d9f6-79pgj | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-3e303 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-3e303": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-734fc-predictor-5995d7675c-86m5w |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-734fc-predictor-5995d7675c-86m5w |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-3e303 |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-3e303": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-3e303": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-734fc-predictor-64d98dd8b6-bknhg |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-734fc-predictor-64d98dd8b6-bknhg |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-3e303-predictor-7ccc759659 |
SuccessfulCreate |
Created pod: error-404-isvc-3e303-predictor-7ccc759659-gfmqm | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-3e303-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-3e303-predictor-54ff64d9f6 from 0 to 1 | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-a868a-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
sequence-graph-734fc-699db48bbd-8gvbt |
Killing |
Stopping container sequence-graph-734fc | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-3e303-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-3e303-predictor-7ccc759659 from 0 to 1 | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-3e303 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-3e303": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-3e303 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-3e303": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-3e303": the object has been modified; please apply your changes to the latest version and try again | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-a868a-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-3e303-predictor-54ff64d9f6-79pgj |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-3e303-predictor-7ccc759659-gfmqm |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "error-404-isvc-3e303-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-3e303-predictor-54ff64d9f6-79pgj |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
multus |
success-200-isvc-3e303-predictor-54ff64d9f6-79pgj |
AddedInterface |
Add eth0 [10.133.0.29/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-3e303-predictor-7ccc759659-gfmqm |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1501" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-3e303-predictor-54ff64d9f6-79pgj |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
multus |
error-404-isvc-3e303-predictor-7ccc759659-gfmqm |
AddedInterface |
Add eth0 [10.134.0.47/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-3e303-predictor-7ccc759659-gfmqm |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-3e303-predictor-54ff64d9f6-79pgj |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-3e303-predictor-7ccc759659-gfmqm |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-3e303-predictor-54ff64d9f6-79pgj |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1501" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-3e303-predictor-7ccc759659-gfmqm |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-3e303-predictor-54ff64d9f6-79pgj |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-3e303-predictor-7ccc759659-gfmqm |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-3e303-predictor-7ccc759659-gfmqm |
Created |
Created container: kube-rbac-proxy | |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-a868a-predictor-7675b7748-5r6xk |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.28:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-a868a-predictor-848b5648c5-46cjq |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.46:8080: connect: connection refused |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-a868a-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-3e303-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-a868a-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-3e303-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-a868a |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-a868a |
InferenceServiceReady |
InferenceService [success-200-isvc-a868a] is Ready | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-a868a |
InferenceServiceReady |
InferenceService [error-404-isvc-a868a] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-a868a |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x6) | kserve-ci-e2e-test |
kubelet |
sequence-graph-734fc-699db48bbd-8gvbt |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-a868a-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-3e303-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
deployment-controller |
splitter-graph-a868a |
ScalingReplicaSet |
Scaled up replica set splitter-graph-a868a-757c8c8c4d from 0 to 1 | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-a868a-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
replicaset-controller |
splitter-graph-a868a-757c8c8c4d |
SuccessfulCreate |
Created pod: splitter-graph-a868a-757c8c8c4d-92495 | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-a868a-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
InferenceGraphController |
splitter-graph-a868a |
InferenceGraphReady |
InferenceGraph [splitter-graph-a868a] is Ready | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-3e303-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-a868a-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
kubelet |
splitter-graph-a868a-757c8c8c4d-92495 |
Created |
Created container: splitter-graph-a868a | |
kserve-ci-e2e-test |
multus |
splitter-graph-a868a-757c8c8c4d-92495 |
AddedInterface |
Add eth0 [10.134.0.48/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-a868a-757c8c8c4d-92495 |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:04926a9d7185ff179745ae32ed77ae962904508dbcb7541e9bf600392af6f503" already present on machine | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-a868a-757c8c8c4d-92495 |
Started |
Started container splitter-graph-a868a | |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-3e303-predictor-54ff64d9f6-79pgj |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.29:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-3e303-predictor-7ccc759659-gfmqm |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.47:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
splitter-graph-a868a-757c8c8c4d-92495 |
Killing |
Stopping container splitter-graph-a868a | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-31b2e-predictor-67cf4677b6-p2vdx |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "success-200-isvc-31b2e-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-31b2e |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-31b2e": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-31b2e": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-a868a-predictor-7675b7748-5r6xk |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-a868a-predictor-7675b7748-5r6xk |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-31b2e-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-31b2e-predictor-848cf47897 from 0 to 1 | |
kserve-ci-e2e-test |
multus |
error-404-isvc-31b2e-predictor-848cf47897-zpj2x |
AddedInterface |
Add eth0 [10.134.0.49/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-31b2e-predictor-848cf47897-zpj2x |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1501" already present on machine | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-31b2e |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-31b2e": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-31b2e": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-31b2e-predictor-848cf47897 |
SuccessfulCreate |
Created pod: error-404-isvc-31b2e-predictor-848cf47897-zpj2x | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-31b2e |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-31b2e": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-31b2e |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-31b2e": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-31b2e-predictor-848cf47897-zpj2x |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-31b2e-predictor-848cf47897-zpj2x |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-31b2e-predictor-848cf47897-zpj2x |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-31b2e-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-31b2e-predictor-67cf4677b6 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-a868a-predictor-848b5648c5-46cjq |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-a868a-predictor-848b5648c5-46cjq |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-31b2e-predictor-67cf4677b6 |
SuccessfulCreate |
Created pod: success-200-isvc-31b2e-predictor-67cf4677b6-p2vdx | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-31b2e-predictor-848cf47897-zpj2x |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-31b2e-predictor-848cf47897-zpj2x |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-31b2e-predictor-67cf4677b6-p2vdx |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1501" already present on machine | |
kserve-ci-e2e-test |
multus |
success-200-isvc-31b2e-predictor-67cf4677b6-p2vdx |
AddedInterface |
Add eth0 [10.133.0.30/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-31b2e-predictor-67cf4677b6-p2vdx |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-31b2e-predictor-67cf4677b6-p2vdx |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-31b2e-predictor-67cf4677b6-p2vdx |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-31b2e-predictor-67cf4677b6-p2vdx |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-31b2e-predictor-67cf4677b6-p2vdx |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-a868a-predictor-7675b7748-5r6xk |
Unhealthy |
Readiness probe failed: Get "https://10.133.0.28:8643/healthz": dial tcp 10.133.0.28:8643: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-a868a-predictor-848b5648c5-46cjq |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.46:8643/healthz": dial tcp 10.134.0.46:8643: connect: connection refused | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-3e303 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-3e303 |
InferenceServiceReady |
InferenceService [success-200-isvc-3e303] is Ready | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-3e303 |
InferenceServiceReady |
InferenceService [error-404-isvc-3e303] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-3e303 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-31b2e-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-31b2e-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-3e303 |
InferenceGraphReady |
InferenceGraph [switch-graph-3e303] is Ready | |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-3e303 |
UpdateFailed |
Failed to update status for InferenceGraph "switch-graph-3e303": Operation cannot be fulfilled on inferencegraphs.serving.kserve.io "switch-graph-3e303": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
switch-graph-3e303-66c47b978f-nfvht |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "switch-graph-3e303-serving-cert" not found | |
kserve-ci-e2e-test |
deployment-controller |
switch-graph-3e303 |
ScalingReplicaSet |
Scaled up replica set switch-graph-3e303-66c47b978f from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
switch-graph-3e303-66c47b978f |
SuccessfulCreate |
Created pod: switch-graph-3e303-66c47b978f-nfvht | |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-3e303 |
InternalError |
fails to update InferenceGraph status: Operation cannot be fulfilled on inferencegraphs.serving.kserve.io "switch-graph-3e303": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
switch-graph-3e303-66c47b978f-nfvht |
Started |
Started container switch-graph-3e303 | |
kserve-ci-e2e-test |
kubelet |
switch-graph-3e303-66c47b978f-nfvht |
Created |
Created container: switch-graph-3e303 | |
kserve-ci-e2e-test |
kubelet |
switch-graph-3e303-66c47b978f-nfvht |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:04926a9d7185ff179745ae32ed77ae962904508dbcb7541e9bf600392af6f503" already present on machine | |
kserve-ci-e2e-test |
multus |
switch-graph-3e303-66c47b978f-nfvht |
AddedInterface |
Add eth0 [10.134.0.50/23] from ovn-kubernetes | |
| (x6) | kserve-ci-e2e-test |
kubelet |
splitter-graph-a868a-757c8c8c4d-92495 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-31b2e-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-31b2e-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-3e303-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-3e303-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-31b2e-predictor-848cf47897-zpj2x |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.49:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-31b2e-predictor-67cf4677b6-p2vdx |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.30:8080: connect: connection refused |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-31b2e |
InferenceServiceReady |
InferenceService [success-200-isvc-31b2e] is Ready | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-31b2e |
InferenceServiceReady |
InferenceService [error-404-isvc-31b2e] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-31b2e |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-3e303-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-3e303 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-3e303 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-31b2e |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-3e303-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
replicaset-controller |
splitter-graph-31b2e-5cc6cdf9c9 |
SuccessfulCreate |
Created pod: splitter-graph-31b2e-5cc6cdf9c9-jndff | |
kserve-ci-e2e-test |
InferenceGraphController |
splitter-graph-31b2e |
InferenceGraphReady |
InferenceGraph [splitter-graph-31b2e] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
splitter-graph-31b2e |
ScalingReplicaSet |
Scaled up replica set splitter-graph-31b2e-5cc6cdf9c9 from 0 to 1 | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-31b2e-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-31b2e-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
kubelet |
splitter-graph-31b2e-5cc6cdf9c9-jndff |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "splitter-graph-31b2e-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-31b2e-5cc6cdf9c9-jndff |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:04926a9d7185ff179745ae32ed77ae962904508dbcb7541e9bf600392af6f503" already present on machine | |
kserve-ci-e2e-test |
multus |
splitter-graph-31b2e-5cc6cdf9c9-jndff |
AddedInterface |
Add eth0 [10.134.0.51/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-31b2e-5cc6cdf9c9-jndff |
Created |
Created container: splitter-graph-31b2e | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-31b2e-5cc6cdf9c9-jndff |
Started |
Started container splitter-graph-31b2e | |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-31b2e-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-31b2e-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
splitter-graph-31b2e |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
splitter-graph-31b2e |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
splitter-graph-31b2e |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
splitter-graph-31b2e |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-31b2e-5cc6cdf9c9-jndff |
Killing |
Stopping container splitter-graph-31b2e | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-31b2e-predictor-67cf4677b6-p2vdx |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-31b2e-predictor-67cf4677b6-p2vdx |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-31b2e-predictor-848cf47897-zpj2x |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-31b2e-predictor-848cf47897-zpj2x |
Killing |
Stopping container kserve-container | |
| (x6) | kserve-ci-e2e-test |
kubelet |
splitter-graph-31b2e-5cc6cdf9c9-jndff |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
kubelet |
switch-graph-3e303-66c47b978f-nfvht |
Killing |
Stopping container switch-graph-3e303 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-3e303-predictor-7ccc759659-gfmqm |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-3e303-predictor-54ff64d9f6-79pgj |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-3e303-predictor-54ff64d9f6-79pgj |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-3e303-predictor-7ccc759659-gfmqm |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-3e303-predictor-54ff64d9f6-79pgj |
Unhealthy |
Readiness probe failed: Get "https://10.133.0.29:8643/healthz": dial tcp 10.133.0.29:8643: connect: connection refused | |
| (x5) | kserve-ci-e2e-test |
kubelet |
switch-graph-3e303-66c47b978f-nfvht |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |