| Time | Namespace | Component | RelatedObject | Reason | Message |
|---|---|---|---|---|---|
kserve-ci-e2e-test |
isvc-sklearn-graph-2-predictor-54c99bfc7d-v6cdj |
Scheduled |
Successfully assigned kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54c99bfc7d-v6cdj to ip-10-0-133-4.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-fd4b4-predictor-59d7bccbf8-pl6qv |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-fd4b4-predictor-59d7bccbf8-pl6qv to ip-10-0-142-53.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-1742e-predictor-5bf4dfd9dd-8j4zf |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-1742e-predictor-5bf4dfd9dd-8j4zf to ip-10-0-142-53.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-40bda-predictor-6664b4979f-g8jxd |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-40bda-predictor-6664b4979f-g8jxd to ip-10-0-142-53.ec2.internal | ||
kserve-ci-e2e-test |
model-chainer-77c65d8d88-vkzr5 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/model-chainer-77c65d8d88-vkzr5 to ip-10-0-143-107.ec2.internal | ||
kserve-ci-e2e-test |
sequence-graph-4d75e-7f95b4f9f7-6b88l |
Scheduled |
Successfully assigned kserve-ci-e2e-test/sequence-graph-4d75e-7f95b4f9f7-6b88l to ip-10-0-143-107.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-acbca-predictor-59cffd4b6b-zwcgm |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-acbca-predictor-59cffd4b6b-zwcgm to ip-10-0-142-53.ec2.internal | ||
kserve-ci-e2e-test |
splitter-graph-fd4b4-74fd795bfc-rvr97 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/splitter-graph-fd4b4-74fd795bfc-rvr97 to ip-10-0-143-107.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-8902c-predictor-b6f848b6b-rmjnr |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-8902c-predictor-b6f848b6b-rmjnr to ip-10-0-142-53.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-acbca-predictor-687469f549-r5cwv |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-acbca-predictor-687469f549-r5cwv to ip-10-0-142-53.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-bcff4-predictor-55cbf45559-tw9hg |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-bcff4-predictor-55cbf45559-tw9hg to ip-10-0-142-53.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-fd4b4-predictor-7694f9fcbf-n88zh |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-fd4b4-predictor-7694f9fcbf-n88zh to ip-10-0-142-53.ec2.internal | ||
kserve-ci-e2e-test |
ensemble-graph-bcff4-76cb6fc4b6-xrpnv |
Scheduled |
Successfully assigned kserve-ci-e2e-test/ensemble-graph-bcff4-76cb6fc4b6-xrpnv to ip-10-0-143-107.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-833d6-predictor-65cfc8fdbb-xw7b6 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-833d6-predictor-65cfc8fdbb-xw7b6 to ip-10-0-142-53.ec2.internal | ||
kserve-ci-e2e-test |
ensemble-graph-155ee-7766bf4486-wp9ff |
Scheduled |
Successfully assigned kserve-ci-e2e-test/ensemble-graph-155ee-7766bf4486-wp9ff to ip-10-0-143-107.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-4d75e-predictor-98c496fb-m8ddw |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-4d75e-predictor-98c496fb-m8ddw to ip-10-0-142-53.ec2.internal | ||
kserve-ci-e2e-test |
isvc-sklearn-graph-1-predictor-678784f46b-b29kb |
Scheduled |
Successfully assigned kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-678784f46b-b29kb to ip-10-0-133-4.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-40bda-predictor-776fc95cd4-dr29n |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-40bda-predictor-776fc95cd4-dr29n to ip-10-0-142-53.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-155ee-predictor-57c99b6f99-mtr6n |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-155ee-predictor-57c99b6f99-mtr6n to ip-10-0-142-53.ec2.internal | ||
kserve-ci-e2e-test |
isvc-xgboost-graph-predictor-669d8d6456-x8tg5 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/isvc-xgboost-graph-predictor-669d8d6456-x8tg5 to ip-10-0-143-107.ec2.internal | ||
kserve-ci-e2e-test |
sequence-graph-833d6-8bd85f5d6-nq6xf |
Scheduled |
Successfully assigned kserve-ci-e2e-test/sequence-graph-833d6-8bd85f5d6-nq6xf to ip-10-0-143-107.ec2.internal | ||
kserve-ci-e2e-test |
sequence-graph-acbca-854dfbbf8-g5nv8 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/sequence-graph-acbca-854dfbbf8-g5nv8 to ip-10-0-143-107.ec2.internal | ||
kserve-ci-e2e-test |
splitter-graph-8902c-6b89df54cb-65tk5 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/splitter-graph-8902c-6b89df54cb-65tk5 to ip-10-0-143-107.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-09598-predictor-7c4d94fb5f-hqnbq |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-09598-predictor-7c4d94fb5f-hqnbq to ip-10-0-142-53.ec2.internal | ||
kserve-ci-e2e-test |
switch-graph-40bda-7ccd57fd7d-9l88z |
Scheduled |
Successfully assigned kserve-ci-e2e-test/switch-graph-40bda-7ccd57fd7d-9l88z to ip-10-0-143-107.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-833d6-predictor-7dfb76b5f7-8rzb8 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-833d6-predictor-7dfb76b5f7-8rzb8 to ip-10-0-142-53.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-1742e-predictor-5764c6c5cf-6wk56 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-1742e-predictor-5764c6c5cf-6wk56 to ip-10-0-142-53.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-bcff4-predictor-66c9fb5576-scwgx |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-bcff4-predictor-66c9fb5576-scwgx to ip-10-0-142-53.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-09598-predictor-587794bf84-zl6dc |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-09598-predictor-587794bf84-zl6dc to ip-10-0-142-53.ec2.internal | ||
kserve-ci-e2e-test |
switch-graph-09598-5987fb5786-6srjk |
Scheduled |
Successfully assigned kserve-ci-e2e-test/switch-graph-09598-5987fb5786-6srjk to ip-10-0-143-107.ec2.internal | ||
kserve-ci-e2e-test |
switch-graph-1742e-68c468964c-d9m58 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/switch-graph-1742e-68c468964c-d9m58 to ip-10-0-143-107.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-155ee-predictor-6b9f6fd99b-qvjql |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-155ee-predictor-6b9f6fd99b-qvjql to ip-10-0-142-53.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-4d75e-predictor-5c8bb955c5-mqnb5 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-4d75e-predictor-5c8bb955c5-mqnb5 to ip-10-0-142-53.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-8902c-predictor-86c999b5df-f6nxh |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-8902c-predictor-86c999b5df-f6nxh to ip-10-0-142-53.ec2.internal | ||
kserve-ci-e2e-test |
deployment-controller |
isvc-sklearn-graph-1-predictor |
ScalingReplicaSet |
Scaled up replica set isvc-sklearn-graph-1-predictor-678784f46b from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-1742e-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-1742e-predictor-5bf4dfd9dd from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
isvc-sklearn-graph-1-predictor-678784f46b |
SuccessfulCreate |
Created pod: isvc-sklearn-graph-1-predictor-678784f46b-b29kb | |
| (x2) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-1742e-predictor-5764c6c5cf-6wk56 |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "error-404-isvc-1742e-predictor-serving-cert" not found |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-1742e-predictor-5bf4dfd9dd |
SuccessfulCreate |
Created pod: success-200-isvc-1742e-predictor-5bf4dfd9dd-8j4zf | |
kserve-ci-e2e-test |
deployment-controller |
isvc-sklearn-graph-2-predictor |
ScalingReplicaSet |
Scaled up replica set isvc-sklearn-graph-2-predictor-54c99bfc7d from 0 to 1 | |
| (x2) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-1742e-predictor-5bf4dfd9dd-8j4zf |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "success-200-isvc-1742e-predictor-serving-cert" not found |
kserve-ci-e2e-test |
replicaset-controller |
isvc-xgboost-graph-predictor-669d8d6456 |
SuccessfulCreate |
Created pod: isvc-xgboost-graph-predictor-669d8d6456-x8tg5 | |
kserve-ci-e2e-test |
replicaset-controller |
isvc-sklearn-graph-2-predictor-54c99bfc7d |
SuccessfulCreate |
Created pod: isvc-sklearn-graph-2-predictor-54c99bfc7d-v6cdj | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-669d8d6456-x8tg5 |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "isvc-xgboost-graph-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
deployment-controller |
isvc-xgboost-graph-predictor |
ScalingReplicaSet |
Scaled up replica set isvc-xgboost-graph-predictor-669d8d6456 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-1742e-predictor-5764c6c5cf |
SuccessfulCreate |
Created pod: error-404-isvc-1742e-predictor-5764c6c5cf-6wk56 | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-1742e-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-1742e-predictor-5764c6c5cf from 0 to 1 | |
| (x2) | kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-678784f46b-b29kb |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "isvc-sklearn-graph-1-predictor-serving-cert" not found |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-678784f46b-b29kb |
Pulling |
Pulling image "quay.io/opendatahub/kserve-storage-initializer@sha256:4e534c6f6e9d80dfdaea245073aaa55f0290d59a851159e578fe713a363df99a" | |
kserve-ci-e2e-test |
multus |
isvc-xgboost-graph-predictor-669d8d6456-x8tg5 |
AddedInterface |
Add eth0 [10.132.0.17/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-669d8d6456-x8tg5 |
Pulling |
Pulling image "quay.io/opendatahub/kserve-storage-initializer@sha256:4e534c6f6e9d80dfdaea245073aaa55f0290d59a851159e578fe713a363df99a" | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-54c99bfc7d-v6cdj |
Pulling |
Pulling image "quay.io/opendatahub/kserve-storage-initializer@sha256:4e534c6f6e9d80dfdaea245073aaa55f0290d59a851159e578fe713a363df99a" | |
kserve-ci-e2e-test |
multus |
isvc-sklearn-graph-2-predictor-54c99bfc7d-v6cdj |
AddedInterface |
Add eth0 [10.133.0.25/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
multus |
isvc-sklearn-graph-1-predictor-678784f46b-b29kb |
AddedInterface |
Add eth0 [10.133.0.24/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-1742e-predictor-5bf4dfd9dd-8j4zf |
Pulling |
Pulling image "quay.io/opendatahub/success-200-isvc:odh-pr-1532" | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-1742e-predictor-5764c6c5cf-6wk56 |
Pulling |
Pulling image "quay.io/opendatahub/error-404-isvc:odh-pr-1532" | |
kserve-ci-e2e-test |
multus |
error-404-isvc-1742e-predictor-5764c6c5cf-6wk56 |
AddedInterface |
Add eth0 [10.134.0.35/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
multus |
success-200-isvc-1742e-predictor-5bf4dfd9dd-8j4zf |
AddedInterface |
Add eth0 [10.134.0.34/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-54c99bfc7d-v6cdj |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-678784f46b-b29kb |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-678784f46b-b29kb |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-678784f46b-b29kb |
Pulled |
Successfully pulled image "quay.io/opendatahub/kserve-storage-initializer@sha256:4e534c6f6e9d80dfdaea245073aaa55f0290d59a851159e578fe713a363df99a" in 3.223s (3.223s including waiting). Image size: 301472374 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-54c99bfc7d-v6cdj |
Pulled |
Successfully pulled image "quay.io/opendatahub/kserve-storage-initializer@sha256:4e534c6f6e9d80dfdaea245073aaa55f0290d59a851159e578fe713a363df99a" in 3.673s (3.673s including waiting). Image size: 301472374 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-669d8d6456-x8tg5 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-669d8d6456-x8tg5 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-669d8d6456-x8tg5 |
Pulled |
Successfully pulled image "quay.io/opendatahub/kserve-storage-initializer@sha256:4e534c6f6e9d80dfdaea245073aaa55f0290d59a851159e578fe713a363df99a" in 3.675s (3.675s including waiting). Image size: 301472374 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-54c99bfc7d-v6cdj |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-54c99bfc7d-v6cdj |
Pulling |
Pulling image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1532" | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-678784f46b-b29kb |
Pulling |
Pulling image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1532" | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-669d8d6456-x8tg5 |
Pulling |
Pulling image "kserve/xgbserver:latest" | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-1742e-predictor-5bf4dfd9dd-8j4zf |
Pulling |
Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-1742e-predictor-5764c6c5cf-6wk56 |
Pulled |
Successfully pulled image "quay.io/opendatahub/error-404-isvc:odh-pr-1532" in 14.23s (14.23s including waiting). Image size: 1334724715 bytes. | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-1742e-predictor-5764c6c5cf-6wk56 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-1742e-predictor-5764c6c5cf-6wk56 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-1742e-predictor-5764c6c5cf-6wk56 |
Pulling |
Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-1742e-predictor-5bf4dfd9dd-8j4zf |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-1742e-predictor-5bf4dfd9dd-8j4zf |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-1742e-predictor-5bf4dfd9dd-8j4zf |
Pulled |
Successfully pulled image "quay.io/opendatahub/success-200-isvc:odh-pr-1532" in 14.283s (14.283s including waiting). Image size: 1335729264 bytes. | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-1742e-predictor-5bf4dfd9dd-8j4zf |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" in 2.559s (2.559s including waiting). Image size: 211946088 bytes. | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-1742e-predictor-5764c6c5cf-6wk56 |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" in 2.548s (2.548s including waiting). Image size: 211946088 bytes. | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-1742e-predictor-5764c6c5cf-6wk56 |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-1742e-predictor-5bf4dfd9dd-8j4zf |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-1742e-predictor-5764c6c5cf-6wk56 |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-1742e-predictor-5bf4dfd9dd-8j4zf |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-678784f46b-b29kb |
Pulled |
Successfully pulled image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1532" in 13.932s (13.932s including waiting). Image size: 1560933302 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-678784f46b-b29kb |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-678784f46b-b29kb |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-678784f46b-b29kb |
Pulling |
Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-54c99bfc7d-v6cdj |
Pulling |
Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-54c99bfc7d-v6cdj |
Pulled |
Successfully pulled image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1532" in 13.935s (13.935s including waiting). Image size: 1560933302 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-54c99bfc7d-v6cdj |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-54c99bfc7d-v6cdj |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-678784f46b-b29kb |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-54c99bfc7d-v6cdj |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-678784f46b-b29kb |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-54c99bfc7d-v6cdj |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" in 2.405s (2.405s including waiting). Image size: 211946088 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-678784f46b-b29kb |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" in 2.403s (2.403s including waiting). Image size: 211946088 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-54c99bfc7d-v6cdj |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-669d8d6456-x8tg5 |
Pulled |
Successfully pulled image "kserve/xgbserver:latest" in 17.283s (17.283s including waiting). Image size: 1306319098 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-669d8d6456-x8tg5 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-669d8d6456-x8tg5 |
Pulling |
Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-669d8d6456-x8tg5 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-669d8d6456-x8tg5 |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" in 2.117s (2.117s including waiting). Image size: 211946088 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-669d8d6456-x8tg5 |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-669d8d6456-x8tg5 |
Started |
Started container kube-rbac-proxy | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-1742e-predictor-5764c6c5cf-6wk56 |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.35:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-1742e-predictor-5bf4dfd9dd-8j4zf |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.34:8080: connect: connection refused |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-1742e-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-1742e-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-1742e-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-1742e-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-1742e |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-1742e |
InferenceServiceReady |
InferenceService [error-404-isvc-1742e] is Ready | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-1742e |
InferenceServiceReady |
InferenceService [success-200-isvc-1742e] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-1742e |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-1742e-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-1742e-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-1742e-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-1742e-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
| (x7) | kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-669d8d6456-x8tg5 |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.17:8080: connect: connection refused |
kserve-ci-e2e-test |
deployment-controller |
switch-graph-1742e |
ScalingReplicaSet |
Scaled up replica set switch-graph-1742e-68c468964c from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
switch-graph-1742e-68c468964c-d9m58 |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "switch-graph-1742e-serving-cert" not found | |
kserve-ci-e2e-test |
replicaset-controller |
switch-graph-1742e-68c468964c |
SuccessfulCreate |
Created pod: switch-graph-1742e-68c468964c-d9m58 | |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-1742e |
InferenceGraphReady |
InferenceGraph [switch-graph-1742e] is Ready | |
kserve-ci-e2e-test |
kubelet |
switch-graph-1742e-68c468964c-d9m58 |
Pulling |
Pulling image "quay.io/opendatahub/kserve-router@sha256:41f0ca4b45114a1d81ffad66a667eba2baa4df82ad74c2ffc611dc9cdef0d94a" | |
kserve-ci-e2e-test |
multus |
switch-graph-1742e-68c468964c-d9m58 |
AddedInterface |
Add eth0 [10.132.0.18/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
switch-graph-1742e-68c468964c-d9m58 |
Started |
Started container switch-graph-1742e | |
kserve-ci-e2e-test |
kubelet |
switch-graph-1742e-68c468964c-d9m58 |
Created |
Created container: switch-graph-1742e | |
kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-1 |
InferenceServiceReady |
InferenceService [isvc-sklearn-graph-1] is Ready | |
| (x9) | kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-1 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
kubelet |
switch-graph-1742e-68c468964c-d9m58 |
Pulled |
Successfully pulled image "quay.io/opendatahub/kserve-router@sha256:41f0ca4b45114a1d81ffad66a667eba2baa4df82ad74c2ffc611dc9cdef0d94a" in 2.61s (2.61s including waiting). Image size: 218005275 bytes. | |
kserve-ci-e2e-test |
v1beta1Controllers |
isvc-xgboost-graph |
InferenceServiceReady |
InferenceService [isvc-xgboost-graph] is Ready | |
| (x9) | kserve-ci-e2e-test |
v1beta1Controllers |
isvc-xgboost-graph |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-1742e-predictor-5764c6c5cf-6wk56 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-40bda-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-40bda-predictor-776fc95cd4 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-1742e-predictor-5bf4dfd9dd-8j4zf |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-1742e-predictor-5bf4dfd9dd-8j4zf |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-1742e-predictor-5764c6c5cf-6wk56 |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
switch-graph-1742e-68c468964c-d9m58 |
Killing |
Stopping container switch-graph-1742e | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-40bda-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-40bda-predictor-6664b4979f from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-40bda-predictor-776fc95cd4-dr29n |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "success-200-isvc-40bda-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-40bda-predictor-776fc95cd4 |
SuccessfulCreate |
Created pod: success-200-isvc-40bda-predictor-776fc95cd4-dr29n | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-1742e-predictor-5764c6c5cf-6wk56 |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.35:8643/healthz": dial tcp 10.134.0.35:8643: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-40bda-predictor-6664b4979f-g8jxd |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "error-404-isvc-40bda-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-40bda |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-40bda": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-40bda": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-40bda |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-40bda": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-40bda-predictor-6664b4979f |
SuccessfulCreate |
Created pod: error-404-isvc-40bda-predictor-6664b4979f-g8jxd | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-40bda-predictor-776fc95cd4-dr29n |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-40bda-predictor-6664b4979f-g8jxd |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-40bda-predictor-6664b4979f-g8jxd |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-40bda-predictor-6664b4979f-g8jxd |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-1742e-predictor-5bf4dfd9dd-8j4zf |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.34:8643/healthz": dial tcp 10.134.0.34:8643: connect: connection refused | |
kserve-ci-e2e-test |
multus |
error-404-isvc-40bda-predictor-6664b4979f-g8jxd |
AddedInterface |
Add eth0 [10.134.0.37/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-40bda-predictor-6664b4979f-g8jxd |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
multus |
success-200-isvc-40bda-predictor-776fc95cd4-dr29n |
AddedInterface |
Add eth0 [10.134.0.36/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-40bda-predictor-6664b4979f-g8jxd |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-40bda-predictor-776fc95cd4-dr29n |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-40bda-predictor-776fc95cd4-dr29n |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1532" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-40bda-predictor-776fc95cd4-dr29n |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-40bda-predictor-776fc95cd4-dr29n |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-40bda-predictor-6664b4979f-g8jxd |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1532" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-40bda-predictor-776fc95cd4-dr29n |
Created |
Created container: kube-rbac-proxy | |
| (x9) | kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-2 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-2 |
InferenceServiceReady |
InferenceService [isvc-sklearn-graph-2] is Ready | |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-40bda-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-40bda-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
replicaset-controller |
model-chainer-77c65d8d88 |
SuccessfulCreate |
Created pod: model-chainer-77c65d8d88-vkzr5 | |
kserve-ci-e2e-test |
InferenceGraphController |
model-chainer |
InternalError |
fails to update InferenceGraph status: Operation cannot be fulfilled on inferencegraphs.serving.kserve.io "model-chainer": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
deployment-controller |
model-chainer |
ScalingReplicaSet |
Scaled up replica set model-chainer-77c65d8d88 from 0 to 1 | |
kserve-ci-e2e-test |
InferenceGraphController |
model-chainer |
InferenceGraphReady |
InferenceGraph [model-chainer] is Ready | |
kserve-ci-e2e-test |
InferenceGraphController |
model-chainer |
UpdateFailed |
Failed to update status for InferenceGraph "model-chainer": Operation cannot be fulfilled on inferencegraphs.serving.kserve.io "model-chainer": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
model-chainer-77c65d8d88-vkzr5 |
Started |
Started container model-chainer | |
kserve-ci-e2e-test |
kubelet |
model-chainer-77c65d8d88-vkzr5 |
Created |
Created container: model-chainer | |
kserve-ci-e2e-test |
kubelet |
model-chainer-77c65d8d88-vkzr5 |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:41f0ca4b45114a1d81ffad66a667eba2baa4df82ad74c2ffc611dc9cdef0d94a" already present on machine | |
kserve-ci-e2e-test |
multus |
model-chainer-77c65d8d88-vkzr5 |
AddedInterface |
Add eth0 [10.132.0.19/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
model-chainer-77c65d8d88-vkzr5 |
Killing |
Stopping container model-chainer | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-669d8d6456-x8tg5 |
Killing |
Stopping container kserve-container | |
| (x6) | kserve-ci-e2e-test |
kubelet |
switch-graph-1742e-68c468964c-d9m58 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-669d8d6456-x8tg5 |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-833d6-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-833d6-predictor-65cfc8fdbb from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-54c99bfc7d-v6cdj |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-833d6 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-833d6": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-833d6": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-833d6 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-833d6": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-833d6-predictor-65cfc8fdbb-xw7b6 |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "success-200-isvc-833d6-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-833d6-predictor-7dfb76b5f7-8rzb8 |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "error-404-isvc-833d6-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-833d6-predictor-65cfc8fdbb |
SuccessfulCreate |
Created pod: success-200-isvc-833d6-predictor-65cfc8fdbb-xw7b6 | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-678784f46b-b29kb |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-833d6-predictor-7dfb76b5f7 |
SuccessfulCreate |
Created pod: error-404-isvc-833d6-predictor-7dfb76b5f7-8rzb8 | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-833d6-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-833d6-predictor-7dfb76b5f7 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-678784f46b-b29kb |
Killing |
Stopping container kube-rbac-proxy | |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-54c99bfc7d-v6cdj |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-54c99bfc7d-v6cdj |
Unhealthy |
Readiness probe failed: Get "https://10.133.0.25:8643/healthz": dial tcp 10.133.0.25:8643: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-833d6-predictor-65cfc8fdbb-xw7b6 |
Started |
Started container kube-rbac-proxy | |
| (x9) | kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-54c99bfc7d-v6cdj |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.25:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-833d6-predictor-7dfb76b5f7-8rzb8 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-833d6-predictor-7dfb76b5f7-8rzb8 |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1532" already present on machine | |
kserve-ci-e2e-test |
multus |
error-404-isvc-833d6-predictor-7dfb76b5f7-8rzb8 |
AddedInterface |
Add eth0 [10.134.0.39/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-833d6-predictor-65cfc8fdbb-xw7b6 |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-833d6-predictor-65cfc8fdbb-xw7b6 |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-833d6-predictor-7dfb76b5f7-8rzb8 |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-833d6-predictor-7dfb76b5f7-8rzb8 |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-833d6-predictor-7dfb76b5f7-8rzb8 |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-669d8d6456-x8tg5 |
Unhealthy |
Readiness probe failed: Get "https://10.132.0.17:8643/healthz": dial tcp 10.132.0.17:8643: connect: connection refused | |
kserve-ci-e2e-test |
multus |
success-200-isvc-833d6-predictor-65cfc8fdbb-xw7b6 |
AddedInterface |
Add eth0 [10.134.0.38/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-833d6-predictor-65cfc8fdbb-xw7b6 |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1532" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-833d6-predictor-65cfc8fdbb-xw7b6 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-833d6-predictor-7dfb76b5f7-8rzb8 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-833d6-predictor-65cfc8fdbb-xw7b6 |
Started |
Started container kserve-container | |
| (x8) | kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-678784f46b-b29kb |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.24:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-678784f46b-b29kb |
Unhealthy |
Readiness probe failed: Get "https://10.133.0.24:8643/healthz": dial tcp 10.133.0.24:8643: connect: connection refused | |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-40bda-predictor-6664b4979f-g8jxd |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.37:8080: connect: connection refused |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-833d6-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-833d6-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-40bda-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-40bda-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-40bda |
InferenceServiceReady |
InferenceService [success-200-isvc-40bda] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-40bda |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-40bda |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-40bda |
InferenceServiceReady |
InferenceService [error-404-isvc-40bda] is Ready | |
| (x6) | kserve-ci-e2e-test |
kubelet |
model-chainer-77c65d8d88-vkzr5 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
kubelet |
switch-graph-40bda-7ccd57fd7d-9l88z |
Created |
Created container: switch-graph-40bda | |
kserve-ci-e2e-test |
kubelet |
switch-graph-40bda-7ccd57fd7d-9l88z |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:41f0ca4b45114a1d81ffad66a667eba2baa4df82ad74c2ffc611dc9cdef0d94a" already present on machine | |
kserve-ci-e2e-test |
kubelet |
switch-graph-40bda-7ccd57fd7d-9l88z |
Started |
Started container switch-graph-40bda | |
kserve-ci-e2e-test |
multus |
switch-graph-40bda-7ccd57fd7d-9l88z |
AddedInterface |
Add eth0 [10.132.0.20/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
replicaset-controller |
switch-graph-40bda-7ccd57fd7d |
SuccessfulCreate |
Created pod: switch-graph-40bda-7ccd57fd7d-9l88z | |
kserve-ci-e2e-test |
deployment-controller |
switch-graph-40bda |
ScalingReplicaSet |
Scaled up replica set switch-graph-40bda-7ccd57fd7d from 0 to 1 | |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-40bda |
InferenceGraphReady |
InferenceGraph [switch-graph-40bda] is Ready | |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-833d6-predictor-7dfb76b5f7-8rzb8 |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.39:8080: connect: connection refused |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-40bda-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-40bda-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-833d6-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-833d6-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-833d6 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-833d6 |
InferenceServiceReady |
InferenceService [success-200-isvc-833d6] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-833d6 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-833d6 |
InferenceServiceReady |
InferenceService [error-404-isvc-833d6] is Ready | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-833d6-8bd85f5d6-nq6xf |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "sequence-graph-833d6-serving-cert" not found | |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-833d6 |
UpdateFailed |
Failed to update status for InferenceGraph "sequence-graph-833d6": Operation cannot be fulfilled on inferencegraphs.serving.kserve.io "sequence-graph-833d6": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-833d6 |
InferenceGraphReady |
InferenceGraph [sequence-graph-833d6] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
sequence-graph-833d6 |
ScalingReplicaSet |
Scaled up replica set sequence-graph-833d6-8bd85f5d6 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
sequence-graph-833d6-8bd85f5d6 |
SuccessfulCreate |
Created pod: sequence-graph-833d6-8bd85f5d6-nq6xf | |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-833d6 |
InternalError |
fails to update InferenceGraph status: Operation cannot be fulfilled on inferencegraphs.serving.kserve.io "sequence-graph-833d6": the object has been modified; please apply your changes to the latest version and try again | |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-40bda-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-40bda-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
kubelet |
sequence-graph-833d6-8bd85f5d6-nq6xf |
Started |
Started container sequence-graph-833d6 | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-833d6-8bd85f5d6-nq6xf |
Created |
Created container: sequence-graph-833d6 | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-833d6-8bd85f5d6-nq6xf |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:41f0ca4b45114a1d81ffad66a667eba2baa4df82ad74c2ffc611dc9cdef0d94a" already present on machine | |
kserve-ci-e2e-test |
multus |
sequence-graph-833d6-8bd85f5d6-nq6xf |
AddedInterface |
Add eth0 [10.132.0.21/23] from ovn-kubernetes | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-833d6-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-833d6-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-833d6-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-40bda |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-40bda |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-833d6-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-833d6 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-833d6 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-bcff4 |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-bcff4": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-bcff4": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-40bda-predictor-776fc95cd4-dr29n |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-bcff4-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-bcff4-predictor-66c9fb5576 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
switch-graph-40bda-7ccd57fd7d-9l88z |
Killing |
Stopping container switch-graph-40bda | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-bcff4 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-bcff4": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-40bda-predictor-6664b4979f-g8jxd |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-40bda-predictor-6664b4979f-g8jxd |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-40bda-predictor-776fc95cd4-dr29n |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-bcff4-predictor-55cbf45559 |
SuccessfulCreate |
Created pod: error-404-isvc-bcff4-predictor-55cbf45559-tw9hg | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-bcff4-predictor-55cbf45559-tw9hg |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "error-404-isvc-bcff4-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-bcff4-predictor-66c9fb5576-scwgx |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-bcff4-predictor-66c9fb5576-scwgx |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-bcff4-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-bcff4-predictor-55cbf45559 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-bcff4-predictor-66c9fb5576-scwgx |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-bcff4-predictor-66c9fb5576 |
SuccessfulCreate |
Created pod: success-200-isvc-bcff4-predictor-66c9fb5576-scwgx | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-bcff4-predictor-66c9fb5576-scwgx |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-bcff4-predictor-66c9fb5576-scwgx |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1532" already present on machine | |
kserve-ci-e2e-test |
multus |
success-200-isvc-bcff4-predictor-66c9fb5576-scwgx |
AddedInterface |
Add eth0 [10.134.0.40/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-bcff4 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-bcff4": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-bcff4": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-bcff4-predictor-66c9fb5576-scwgx |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-bcff4 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-bcff4": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-bcff4-predictor-55cbf45559-tw9hg |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-bcff4-predictor-55cbf45559-tw9hg |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-bcff4-predictor-55cbf45559-tw9hg |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
multus |
error-404-isvc-bcff4-predictor-55cbf45559-tw9hg |
AddedInterface |
Add eth0 [10.134.0.41/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-bcff4-predictor-55cbf45559-tw9hg |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1532" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-bcff4-predictor-55cbf45559-tw9hg |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-bcff4-predictor-55cbf45559-tw9hg |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-40bda-predictor-776fc95cd4-dr29n |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.36:8643/healthz": dial tcp 10.134.0.36:8643: connect: connection refused | |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-40bda-predictor-776fc95cd4-dr29n |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.36:8080: connect: connection refused |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-bcff4-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-bcff4-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x6) | kserve-ci-e2e-test |
kubelet |
switch-graph-40bda-7ccd57fd7d-9l88z |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-acbca |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-acbca": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-833d6-predictor-65cfc8fdbb-xw7b6 |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-acbca |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-acbca": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-acbca": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-833d6-predictor-65cfc8fdbb-xw7b6 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-acbca-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-acbca-predictor-59cffd4b6b from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-833d6-8bd85f5d6-nq6xf |
Killing |
Stopping container sequence-graph-833d6 | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-acbca |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-acbca": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-acbca-predictor-59cffd4b6b-zwcgm |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "success-200-isvc-acbca-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-acbca |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-acbca": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-acbca": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-acbca-predictor-59cffd4b6b |
SuccessfulCreate |
Created pod: success-200-isvc-acbca-predictor-59cffd4b6b-zwcgm | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-833d6-predictor-7dfb76b5f7-8rzb8 |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-acbca-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-acbca-predictor-687469f549 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-acbca-predictor-687469f549 |
SuccessfulCreate |
Created pod: error-404-isvc-acbca-predictor-687469f549-r5cwv | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-acbca-predictor-687469f549-r5cwv |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "error-404-isvc-acbca-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-833d6-predictor-7dfb76b5f7-8rzb8 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-acbca-predictor-687469f549-r5cwv |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-acbca-predictor-59cffd4b6b-zwcgm |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-acbca-predictor-59cffd4b6b-zwcgm |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-acbca-predictor-687469f549-r5cwv |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-acbca-predictor-687469f549-r5cwv |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-acbca-predictor-59cffd4b6b-zwcgm |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
multus |
success-200-isvc-acbca-predictor-59cffd4b6b-zwcgm |
AddedInterface |
Add eth0 [10.134.0.42/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-acbca-predictor-59cffd4b6b-zwcgm |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-acbca-predictor-687469f549-r5cwv |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-acbca-predictor-59cffd4b6b-zwcgm |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1532" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-acbca-predictor-687469f549-r5cwv |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-acbca-predictor-687469f549-r5cwv |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1532" already present on machine | |
kserve-ci-e2e-test |
multus |
error-404-isvc-acbca-predictor-687469f549-r5cwv |
AddedInterface |
Add eth0 [10.134.0.43/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-acbca-predictor-59cffd4b6b-zwcgm |
Started |
Started container kube-rbac-proxy | |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-833d6-predictor-65cfc8fdbb-xw7b6 |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.38:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-833d6-predictor-65cfc8fdbb-xw7b6 |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.38:8643/healthz": dial tcp 10.134.0.38:8643: connect: connection refused | |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-bcff4-predictor-66c9fb5576-scwgx |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.40:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-bcff4-predictor-55cbf45559-tw9hg |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.41:8080: connect: connection refused |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-bcff4-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-bcff4-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-bcff4 |
InferenceServiceReady |
InferenceService [success-200-isvc-bcff4] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-bcff4 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-bcff4 |
InferenceServiceReady |
InferenceService [error-404-isvc-bcff4] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-bcff4 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x6) | kserve-ci-e2e-test |
kubelet |
sequence-graph-833d6-8bd85f5d6-nq6xf |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-bcff4-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-bcff4-76cb6fc4b6-xrpnv |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "ensemble-graph-bcff4-serving-cert" not found | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-bcff4-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
deployment-controller |
ensemble-graph-bcff4 |
ScalingReplicaSet |
Scaled up replica set ensemble-graph-bcff4-76cb6fc4b6 from 0 to 1 | |
kserve-ci-e2e-test |
InferenceGraphController |
ensemble-graph-bcff4 |
InferenceGraphReady |
InferenceGraph [ensemble-graph-bcff4] is Ready | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-bcff4-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-bcff4-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
replicaset-controller |
ensemble-graph-bcff4-76cb6fc4b6 |
SuccessfulCreate |
Created pod: ensemble-graph-bcff4-76cb6fc4b6-xrpnv | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-bcff4-76cb6fc4b6-xrpnv |
Started |
Started container ensemble-graph-bcff4 | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-bcff4-76cb6fc4b6-xrpnv |
Created |
Created container: ensemble-graph-bcff4 | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-bcff4-76cb6fc4b6-xrpnv |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:41f0ca4b45114a1d81ffad66a667eba2baa4df82ad74c2ffc611dc9cdef0d94a" already present on machine | |
kserve-ci-e2e-test |
multus |
ensemble-graph-bcff4-76cb6fc4b6-xrpnv |
AddedInterface |
Add eth0 [10.132.0.22/23] from ovn-kubernetes | |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-acbca-predictor-687469f549-r5cwv |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.43:8080: connect: connection refused |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-155ee-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-155ee-predictor-6b9f6fd99b from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-155ee-predictor-6b9f6fd99b-qvjql |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-155ee-predictor-6b9f6fd99b-qvjql |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-155ee-predictor-6b9f6fd99b-qvjql |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1532" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-bcff4-predictor-66c9fb5576-scwgx |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-bcff4-predictor-55cbf45559-tw9hg |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
multus |
success-200-isvc-155ee-predictor-6b9f6fd99b-qvjql |
AddedInterface |
Add eth0 [10.134.0.44/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-155ee-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-155ee-predictor-57c99b6f99 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-155ee-predictor-57c99b6f99 |
SuccessfulCreate |
Created pod: error-404-isvc-155ee-predictor-57c99b6f99-mtr6n | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-bcff4-predictor-55cbf45559-tw9hg |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-155ee-predictor-6b9f6fd99b |
SuccessfulCreate |
Created pod: success-200-isvc-155ee-predictor-6b9f6fd99b-qvjql | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-155ee |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-155ee": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-155ee": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-155ee-predictor-6b9f6fd99b-qvjql |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-155ee-predictor-6b9f6fd99b-qvjql |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-bcff4-predictor-66c9fb5576-scwgx |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-155ee |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-155ee": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-155ee": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-155ee |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-155ee": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-155ee |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-155ee": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-bcff4-76cb6fc4b6-xrpnv |
Killing |
Stopping container ensemble-graph-bcff4 | |
kserve-ci-e2e-test |
multus |
error-404-isvc-155ee-predictor-57c99b6f99-mtr6n |
AddedInterface |
Add eth0 [10.134.0.45/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-155ee-predictor-6b9f6fd99b-qvjql |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-155ee-predictor-57c99b6f99-mtr6n |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-155ee-predictor-57c99b6f99-mtr6n |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1532" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-155ee-predictor-57c99b6f99-mtr6n |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-155ee-predictor-57c99b6f99-mtr6n |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-155ee-predictor-57c99b6f99-mtr6n |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-155ee-predictor-57c99b6f99-mtr6n |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-bcff4-predictor-66c9fb5576-scwgx |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.40:8643/healthz": dial tcp 10.134.0.40:8643: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-bcff4-predictor-55cbf45559-tw9hg |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.41:8643/healthz": dial tcp 10.134.0.41:8643: connect: connection refused | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-acbca-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-acbca-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-acbca-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-acbca-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-acbca |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-acbca |
InferenceServiceReady |
InferenceService [error-404-isvc-acbca] is Ready | |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-acbca-predictor-59cffd4b6b-zwcgm |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.42:8080: connect: connection refused |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-155ee-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-155ee-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-acbca |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-acbca |
InferenceServiceReady |
InferenceService [success-200-isvc-acbca] is Ready | |
| (x6) | kserve-ci-e2e-test |
kubelet |
ensemble-graph-bcff4-76cb6fc4b6-xrpnv |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
deployment-controller |
sequence-graph-acbca |
ScalingReplicaSet |
Scaled up replica set sequence-graph-acbca-854dfbbf8 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-acbca-854dfbbf8-g5nv8 |
Created |
Created container: sequence-graph-acbca | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-acbca-854dfbbf8-g5nv8 |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:41f0ca4b45114a1d81ffad66a667eba2baa4df82ad74c2ffc611dc9cdef0d94a" already present on machine | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-acbca-854dfbbf8-g5nv8 |
Started |
Started container sequence-graph-acbca | |
kserve-ci-e2e-test |
replicaset-controller |
sequence-graph-acbca-854dfbbf8 |
SuccessfulCreate |
Created pod: sequence-graph-acbca-854dfbbf8-g5nv8 | |
kserve-ci-e2e-test |
multus |
sequence-graph-acbca-854dfbbf8-g5nv8 |
AddedInterface |
Add eth0 [10.132.0.23/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-acbca |
InferenceGraphReady |
InferenceGraph [sequence-graph-acbca] is Ready | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-acbca-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-acbca-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-acbca-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-acbca-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-4d75e-predictor-98c496fb-m8ddw |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "success-200-isvc-4d75e-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-4d75e-predictor-5c8bb955c5-mqnb5 |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1532" already present on machine | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-4d75e |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-4d75e": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-4d75e |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-4d75e": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-4d75e": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-4d75e-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-4d75e-predictor-98c496fb from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-4d75e-predictor-98c496fb |
SuccessfulCreate |
Created pod: success-200-isvc-4d75e-predictor-98c496fb-m8ddw | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-4d75e-predictor-5c8bb955c5-mqnb5 |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-4d75e-predictor-5c8bb955c5 |
SuccessfulCreate |
Created pod: error-404-isvc-4d75e-predictor-5c8bb955c5-mqnb5 | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-4d75e-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-4d75e-predictor-5c8bb955c5 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-4d75e-predictor-5c8bb955c5-mqnb5 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-acbca-854dfbbf8-g5nv8 |
Killing |
Stopping container sequence-graph-acbca | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-4d75e |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-4d75e": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-4d75e": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-4d75e-predictor-5c8bb955c5-mqnb5 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
multus |
error-404-isvc-4d75e-predictor-5c8bb955c5-mqnb5 |
AddedInterface |
Add eth0 [10.134.0.47/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-acbca-predictor-687469f549-r5cwv |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-acbca-predictor-687469f549-r5cwv |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-4d75e |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-4d75e": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-acbca-predictor-59cffd4b6b-zwcgm |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-acbca-predictor-59cffd4b6b-zwcgm |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
multus |
success-200-isvc-4d75e-predictor-98c496fb-m8ddw |
AddedInterface |
Add eth0 [10.134.0.46/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-4d75e-predictor-98c496fb-m8ddw |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1532" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-4d75e-predictor-98c496fb-m8ddw |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-4d75e-predictor-98c496fb-m8ddw |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-4d75e-predictor-98c496fb-m8ddw |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-4d75e-predictor-98c496fb-m8ddw |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-4d75e-predictor-5c8bb955c5-mqnb5 |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-4d75e-predictor-5c8bb955c5-mqnb5 |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-4d75e-predictor-98c496fb-m8ddw |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-acbca-predictor-59cffd4b6b-zwcgm |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.42:8643/healthz": dial tcp 10.134.0.42:8643: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-acbca-predictor-687469f549-r5cwv |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.43:8643/healthz": dial tcp 10.134.0.43:8643: connect: connection refused | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-155ee-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-155ee-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-155ee |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-155ee |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-155ee |
InferenceServiceReady |
InferenceService [success-200-isvc-155ee] is Ready | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-155ee |
InferenceServiceReady |
InferenceService [error-404-isvc-155ee] is Ready | |
| (x6) | kserve-ci-e2e-test |
kubelet |
sequence-graph-acbca-854dfbbf8-g5nv8 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-4d75e-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-4d75e-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-155ee-7766bf4486-wp9ff |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:41f0ca4b45114a1d81ffad66a667eba2baa4df82ad74c2ffc611dc9cdef0d94a" already present on machine | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-4d75e-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-4d75e-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
multus |
ensemble-graph-155ee-7766bf4486-wp9ff |
AddedInterface |
Add eth0 [10.132.0.24/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
replicaset-controller |
ensemble-graph-155ee-7766bf4486 |
SuccessfulCreate |
Created pod: ensemble-graph-155ee-7766bf4486-wp9ff | |
kserve-ci-e2e-test |
deployment-controller |
ensemble-graph-155ee |
ScalingReplicaSet |
Scaled up replica set ensemble-graph-155ee-7766bf4486 from 0 to 1 | |
kserve-ci-e2e-test |
InferenceGraphController |
ensemble-graph-155ee |
InferenceGraphReady |
InferenceGraph [ensemble-graph-155ee] is Ready | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-155ee-7766bf4486-wp9ff |
Created |
Created container: ensemble-graph-155ee | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-155ee-7766bf4486-wp9ff |
Started |
Started container ensemble-graph-155ee | |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-4d75e-predictor-98c496fb-m8ddw |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.46:8080: connect: connection refused |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-4d75e |
InferenceServiceReady |
InferenceService [error-404-isvc-4d75e] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-4d75e |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-4d75e |
InferenceServiceReady |
InferenceService [success-200-isvc-4d75e] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-4d75e |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-155ee-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-155ee-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-155ee-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-155ee-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
replicaset-controller |
sequence-graph-4d75e-7f95b4f9f7 |
SuccessfulCreate |
Created pod: sequence-graph-4d75e-7f95b4f9f7-6b88l | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-4d75e-7f95b4f9f7-6b88l |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "sequence-graph-4d75e-serving-cert" not found | |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-4d75e |
InferenceGraphReady |
InferenceGraph [sequence-graph-4d75e] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
sequence-graph-4d75e |
ScalingReplicaSet |
Scaled up replica set sequence-graph-4d75e-7f95b4f9f7 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-4d75e-7f95b4f9f7-6b88l |
Created |
Created container: sequence-graph-4d75e | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-4d75e-7f95b4f9f7-6b88l |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:41f0ca4b45114a1d81ffad66a667eba2baa4df82ad74c2ffc611dc9cdef0d94a" already present on machine | |
kserve-ci-e2e-test |
multus |
sequence-graph-4d75e-7f95b4f9f7-6b88l |
AddedInterface |
Add eth0 [10.132.0.25/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-4d75e-7f95b4f9f7-6b88l |
Started |
Started container sequence-graph-4d75e | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-4d75e-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-4d75e-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-4d75e-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
ensemble-graph-155ee |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
ensemble-graph-155ee |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-4d75e-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-4d75e |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-4d75e |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-155ee-predictor-6b9f6fd99b-qvjql |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-fd4b4 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-fd4b4": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-fd4b4": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-fd4b4-predictor-59d7bccbf8 |
SuccessfulCreate |
Created pod: success-200-isvc-fd4b4-predictor-59d7bccbf8-pl6qv | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-fd4b4 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-fd4b4": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-fd4b4-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-fd4b4-predictor-7694f9fcbf from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-fd4b4-predictor-7694f9fcbf |
SuccessfulCreate |
Created pod: error-404-isvc-fd4b4-predictor-7694f9fcbf-n88zh | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-fd4b4-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-fd4b4-predictor-59d7bccbf8 from 0 to 1 | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-fd4b4 |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-fd4b4": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-fd4b4": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-fd4b4 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-fd4b4": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
multus |
error-404-isvc-fd4b4-predictor-7694f9fcbf-n88zh |
AddedInterface |
Add eth0 [10.134.0.49/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-fd4b4-predictor-7694f9fcbf-n88zh |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-fd4b4-predictor-7694f9fcbf-n88zh |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-155ee-predictor-6b9f6fd99b-qvjql |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-fd4b4-predictor-7694f9fcbf-n88zh |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-fd4b4-predictor-59d7bccbf8-pl6qv |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "success-200-isvc-fd4b4-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-fd4b4-predictor-7694f9fcbf-n88zh |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-155ee-predictor-57c99b6f99-mtr6n |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-155ee-7766bf4486-wp9ff |
Killing |
Stopping container ensemble-graph-155ee | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-155ee-predictor-57c99b6f99-mtr6n |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-fd4b4-predictor-7694f9fcbf-n88zh |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1532" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-fd4b4-predictor-7694f9fcbf-n88zh |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-fd4b4-predictor-59d7bccbf8-pl6qv |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-fd4b4-predictor-59d7bccbf8-pl6qv |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-fd4b4-predictor-59d7bccbf8-pl6qv |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-fd4b4-predictor-59d7bccbf8-pl6qv |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-fd4b4-predictor-59d7bccbf8-pl6qv |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-fd4b4-predictor-59d7bccbf8-pl6qv |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1532" already present on machine | |
kserve-ci-e2e-test |
multus |
success-200-isvc-fd4b4-predictor-59d7bccbf8-pl6qv |
AddedInterface |
Add eth0 [10.134.0.48/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-155ee-predictor-57c99b6f99-mtr6n |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.45:8643/healthz": dial tcp 10.134.0.45:8643: connect: connection refused | |
| (x8) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-155ee-predictor-6b9f6fd99b-qvjql |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.44:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-155ee-predictor-6b9f6fd99b-qvjql |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.44:8643/healthz": dial tcp 10.134.0.44:8643: connect: connection refused | |
| (x8) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-155ee-predictor-57c99b6f99-mtr6n |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.45:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
ensemble-graph-155ee-7766bf4486-wp9ff |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-09598 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-09598": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-09598": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-09598-predictor-7c4d94fb5f-hqnbq |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1532" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-4d75e-predictor-98c496fb-m8ddw |
Killing |
Stopping container kserve-container | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-fd4b4-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
sequence-graph-4d75e-7f95b4f9f7-6b88l |
Killing |
Stopping container sequence-graph-4d75e | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-4d75e-predictor-98c496fb-m8ddw |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-09598 |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-09598": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-09598": the object has been modified; please apply your changes to the latest version and try again | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-fd4b4-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-fd4b4-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-09598 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-09598": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
multus |
error-404-isvc-09598-predictor-7c4d94fb5f-hqnbq |
AddedInterface |
Add eth0 [10.134.0.51/23] from ovn-kubernetes | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-fd4b4-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-09598-predictor-7c4d94fb5f-hqnbq |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-09598-predictor-587794bf84 |
SuccessfulCreate |
Created pod: success-200-isvc-09598-predictor-587794bf84-zl6dc | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-09598-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-09598-predictor-587794bf84 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-4d75e-predictor-5c8bb955c5-mqnb5 |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-4d75e-predictor-5c8bb955c5-mqnb5 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-09598-predictor-7c4d94fb5f-hqnbq |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-09598-predictor-587794bf84-zl6dc |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "success-200-isvc-09598-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-09598 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-09598": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-09598-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-09598-predictor-7c4d94fb5f from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-09598-predictor-7c4d94fb5f |
SuccessfulCreate |
Created pod: error-404-isvc-09598-predictor-7c4d94fb5f-hqnbq | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-09598-predictor-7c4d94fb5f-hqnbq |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-09598-predictor-7c4d94fb5f-hqnbq |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-09598-predictor-7c4d94fb5f-hqnbq |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-09598-predictor-587794bf84-zl6dc |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-09598-predictor-587794bf84-zl6dc |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-09598-predictor-587794bf84-zl6dc |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1532" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-09598-predictor-587794bf84-zl6dc |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
multus |
success-200-isvc-09598-predictor-587794bf84-zl6dc |
AddedInterface |
Add eth0 [10.134.0.50/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-09598-predictor-587794bf84-zl6dc |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-09598-predictor-587794bf84-zl6dc |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-4d75e-predictor-5c8bb955c5-mqnb5 |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.47:8643/healthz": dial tcp 10.134.0.47:8643: connect: connection refused | |
| (x7) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-4d75e-predictor-5c8bb955c5-mqnb5 |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.47:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-fd4b4-predictor-59d7bccbf8-pl6qv |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.48:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-fd4b4-predictor-7694f9fcbf-n88zh |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.49:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-fd4b4 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-fd4b4 |
InferenceServiceReady |
InferenceService [success-200-isvc-fd4b4] is Ready | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-fd4b4 |
InferenceServiceReady |
InferenceService [error-404-isvc-fd4b4] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-fd4b4 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x6) | kserve-ci-e2e-test |
kubelet |
sequence-graph-4d75e-7f95b4f9f7-6b88l |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
deployment-controller |
splitter-graph-fd4b4 |
ScalingReplicaSet |
Scaled up replica set splitter-graph-fd4b4-74fd795bfc from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-fd4b4-74fd795bfc-rvr97 |
Created |
Created container: splitter-graph-fd4b4 | |
kserve-ci-e2e-test |
replicaset-controller |
splitter-graph-fd4b4-74fd795bfc |
SuccessfulCreate |
Created pod: splitter-graph-fd4b4-74fd795bfc-rvr97 | |
kserve-ci-e2e-test |
InferenceGraphController |
splitter-graph-fd4b4 |
InferenceGraphReady |
InferenceGraph [splitter-graph-fd4b4] is Ready | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-09598-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-09598-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
splitter-graph-fd4b4-74fd795bfc-rvr97 |
Started |
Started container splitter-graph-fd4b4 | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-fd4b4-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-fd4b4-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-fd4b4-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
kubelet |
splitter-graph-fd4b4-74fd795bfc-rvr97 |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:41f0ca4b45114a1d81ffad66a667eba2baa4df82ad74c2ffc611dc9cdef0d94a" already present on machine | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-09598-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
multus |
splitter-graph-fd4b4-74fd795bfc-rvr97 |
AddedInterface |
Add eth0 [10.132.0.26/23] from ovn-kubernetes | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-09598-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-fd4b4-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-09598-predictor-7c4d94fb5f-hqnbq |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.51:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-fd4b4-predictor-7694f9fcbf-n88zh |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-8902c-predictor-b6f848b6b-rmjnr |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "success-200-isvc-8902c-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-fd4b4-predictor-59d7bccbf8-pl6qv |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-8902c-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-8902c-predictor-b6f848b6b from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-fd4b4-predictor-7694f9fcbf-n88zh |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-8902c |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-8902c": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-8902c": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-8902c-predictor-86c999b5df-f6nxh |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "error-404-isvc-8902c-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-fd4b4-74fd795bfc-rvr97 |
Killing |
Stopping container splitter-graph-fd4b4 | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-8902c-predictor-b6f848b6b |
SuccessfulCreate |
Created pod: success-200-isvc-8902c-predictor-b6f848b6b-rmjnr | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-fd4b4-predictor-59d7bccbf8-pl6qv |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-8902c |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-8902c": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-8902c-predictor-86c999b5df |
SuccessfulCreate |
Created pod: error-404-isvc-8902c-predictor-86c999b5df-f6nxh | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-8902c-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-8902c-predictor-86c999b5df from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-8902c-predictor-b6f848b6b-rmjnr |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-8902c-predictor-b6f848b6b-rmjnr |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-8902c-predictor-b6f848b6b-rmjnr |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1532" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-8902c-predictor-b6f848b6b-rmjnr |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-8902c-predictor-86c999b5df-f6nxh |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-8902c-predictor-86c999b5df-f6nxh |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-8902c-predictor-86c999b5df-f6nxh |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
multus |
success-200-isvc-8902c-predictor-b6f848b6b-rmjnr |
AddedInterface |
Add eth0 [10.134.0.52/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-8902c-predictor-b6f848b6b-rmjnr |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-8902c-predictor-86c999b5df-f6nxh |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-8902c-predictor-b6f848b6b-rmjnr |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
multus |
error-404-isvc-8902c-predictor-86c999b5df-f6nxh |
AddedInterface |
Add eth0 [10.134.0.53/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-8902c-predictor-86c999b5df-f6nxh |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1532" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-8902c-predictor-86c999b5df-f6nxh |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-fd4b4-predictor-7694f9fcbf-n88zh |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.49:8643/healthz": dial tcp 10.134.0.49:8643: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-fd4b4-predictor-59d7bccbf8-pl6qv |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.48:8643/healthz": dial tcp 10.134.0.48:8643: connect: connection refused | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-09598 |
InferenceServiceReady |
InferenceService [error-404-isvc-09598] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-09598 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-09598-predictor-587794bf84-zl6dc |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.50:8080: connect: connection refused |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-09598 |
InferenceServiceReady |
InferenceService [success-200-isvc-09598] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-09598 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x6) | kserve-ci-e2e-test |
kubelet |
splitter-graph-fd4b4-74fd795bfc-rvr97 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-8902c-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-8902c-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
replicaset-controller |
switch-graph-09598-5987fb5786 |
SuccessfulCreate |
Created pod: switch-graph-09598-5987fb5786-6srjk | |
kserve-ci-e2e-test |
deployment-controller |
switch-graph-09598 |
ScalingReplicaSet |
Scaled up replica set switch-graph-09598-5987fb5786 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
switch-graph-09598-5987fb5786-6srjk |
Started |
Started container switch-graph-09598 | |
kserve-ci-e2e-test |
kubelet |
switch-graph-09598-5987fb5786-6srjk |
Created |
Created container: switch-graph-09598 | |
kserve-ci-e2e-test |
kubelet |
switch-graph-09598-5987fb5786-6srjk |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:41f0ca4b45114a1d81ffad66a667eba2baa4df82ad74c2ffc611dc9cdef0d94a" already present on machine | |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-09598 |
InferenceGraphReady |
InferenceGraph [switch-graph-09598] is Ready | |
kserve-ci-e2e-test |
multus |
switch-graph-09598-5987fb5786-6srjk |
AddedInterface |
Add eth0 [10.132.0.27/23] from ovn-kubernetes | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-8902c-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-8902c-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-09598-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-09598-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-09598-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-09598-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-8902c-predictor-b6f848b6b-rmjnr |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.52:8080: connect: connection refused |
| (x7) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-8902c-predictor-86c999b5df-f6nxh |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.53:8080: connect: connection refused |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-8902c |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-8902c |
InferenceServiceReady |
InferenceService [success-200-isvc-8902c] is Ready | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-8902c |
InferenceServiceReady |
InferenceService [error-404-isvc-8902c] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-8902c |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-8902c-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
replicaset-controller |
splitter-graph-8902c-6b89df54cb |
SuccessfulCreate |
Created pod: splitter-graph-8902c-6b89df54cb-65tk5 | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-8902c-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
kubelet |
splitter-graph-8902c-6b89df54cb-65tk5 |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "splitter-graph-8902c-serving-cert" not found | |
kserve-ci-e2e-test |
deployment-controller |
splitter-graph-8902c |
ScalingReplicaSet |
Scaled up replica set splitter-graph-8902c-6b89df54cb from 0 to 1 | |
kserve-ci-e2e-test |
InferenceGraphController |
splitter-graph-8902c |
InferenceGraphReady |
InferenceGraph [splitter-graph-8902c] is Ready | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-8902c-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
InferenceGraphController |
splitter-graph-8902c |
InternalError |
fails to update InferenceGraph status: Operation cannot be fulfilled on inferencegraphs.serving.kserve.io "splitter-graph-8902c": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
InferenceGraphController |
splitter-graph-8902c |
UpdateFailed |
Failed to update status for InferenceGraph "splitter-graph-8902c": Operation cannot be fulfilled on inferencegraphs.serving.kserve.io "splitter-graph-8902c": the object has been modified; please apply your changes to the latest version and try again | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-8902c-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
kubelet |
splitter-graph-8902c-6b89df54cb-65tk5 |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:41f0ca4b45114a1d81ffad66a667eba2baa4df82ad74c2ffc611dc9cdef0d94a" already present on machine | |
kserve-ci-e2e-test |
multus |
splitter-graph-8902c-6b89df54cb-65tk5 |
AddedInterface |
Add eth0 [10.132.0.28/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-8902c-6b89df54cb-65tk5 |
Started |
Started container splitter-graph-8902c | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-8902c-6b89df54cb-65tk5 |
Created |
Created container: splitter-graph-8902c | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-09598 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-09598 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
splitter-graph-8902c |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
splitter-graph-8902c |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
splitter-graph-8902c-6b89df54cb-65tk5 |
Killing |
Stopping container splitter-graph-8902c | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-8902c-predictor-b6f848b6b-rmjnr |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-8902c-predictor-b6f848b6b-rmjnr |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-8902c-predictor-86c999b5df-f6nxh |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-8902c-predictor-86c999b5df-f6nxh |
Killing |
Stopping container kube-rbac-proxy | |
| (x6) | kserve-ci-e2e-test |
kubelet |
splitter-graph-8902c-6b89df54cb-65tk5 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-09598-predictor-7c4d94fb5f-hqnbq |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-09598-predictor-7c4d94fb5f-hqnbq |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
switch-graph-09598-5987fb5786-6srjk |
Killing |
Stopping container switch-graph-09598 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-09598-predictor-587794bf84-zl6dc |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-09598-predictor-587794bf84-zl6dc |
Killing |
Stopping container kserve-container | |
| (x5) | kserve-ci-e2e-test |
kubelet |
switch-graph-09598-5987fb5786-6srjk |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |