| Time | Namespace | Component | RelatedObject | Reason | Message |
|---|---|---|---|---|---|
kserve-ci-e2e-test |
model-chainer-7565859b98-gvnv8 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/model-chainer-7565859b98-gvnv8 to ip-10-0-139-178.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-eb211-predictor-6695c85886-hvd2p |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-eb211-predictor-6695c85886-hvd2p to ip-10-0-129-245.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-c059b-predictor-847bfb4858-gvm44 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-c059b-predictor-847bfb4858-gvm44 to ip-10-0-129-245.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-af621-predictor-688d7d5cb9-p4nrw |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-af621-predictor-688d7d5cb9-p4nrw to ip-10-0-129-245.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-f2cdf-predictor-58c9fc6cc8-6spwd |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-f2cdf-predictor-58c9fc6cc8-6spwd to ip-10-0-129-245.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-1bf2c-predictor-6c64b6bb44-scdj5 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-1bf2c-predictor-6c64b6bb44-scdj5 to ip-10-0-129-245.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-c059b-predictor-7c8bc8775f-9qkp5 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-c059b-predictor-7c8bc8775f-9qkp5 to ip-10-0-129-245.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-c3262-predictor-865fd8b765-p828d |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-c3262-predictor-865fd8b765-p828d to ip-10-0-129-245.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-af621-predictor-6c7cdbfc8d-gsrwd |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-af621-predictor-6c7cdbfc8d-gsrwd to ip-10-0-129-245.ec2.internal | ||
kserve-ci-e2e-test |
isvc-sklearn-graph-2-predictor-6c8478f9b5-4v96j |
Scheduled |
Successfully assigned kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-4v96j to ip-10-0-134-114.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-9857d-predictor-74fddbbbc8-ftl8h |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-9857d-predictor-74fddbbbc8-ftl8h to ip-10-0-129-245.ec2.internal | ||
kserve-ci-e2e-test |
switch-graph-f2cdf-545944cd54-5rxqp |
Scheduled |
Successfully assigned kserve-ci-e2e-test/switch-graph-f2cdf-545944cd54-5rxqp to ip-10-0-139-178.ec2.internal | ||
kserve-ci-e2e-test |
ensemble-graph-c059b-b4df54dc8-fppfl |
Scheduled |
Successfully assigned kserve-ci-e2e-test/ensemble-graph-c059b-b4df54dc8-fppfl to ip-10-0-139-178.ec2.internal | ||
kserve-ci-e2e-test |
switch-graph-9857d-698d9d6767-gzxql |
Scheduled |
Successfully assigned kserve-ci-e2e-test/switch-graph-9857d-698d9d6767-gzxql to ip-10-0-139-178.ec2.internal | ||
kserve-ci-e2e-test |
switch-graph-43223-7d58669c44-z74rq |
Scheduled |
Successfully assigned kserve-ci-e2e-test/switch-graph-43223-7d58669c44-z74rq to ip-10-0-139-178.ec2.internal | ||
kserve-ci-e2e-test |
isvc-xgboost-graph-predictor-555fc69d56-6hxpq |
Scheduled |
Successfully assigned kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6hxpq to ip-10-0-134-114.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-550f3-predictor-787558b8bb-22gl7 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-550f3-predictor-787558b8bb-22gl7 to ip-10-0-129-245.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-eb211-predictor-69b49c778c-qn8vg |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-eb211-predictor-69b49c778c-qn8vg to ip-10-0-129-245.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-f2cdf-predictor-64d5b74467-n5sd4 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-f2cdf-predictor-64d5b74467-n5sd4 to ip-10-0-129-245.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-43223-predictor-85967567b9-fkcgw |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-43223-predictor-85967567b9-fkcgw to ip-10-0-129-245.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-43223-predictor-5968f7b98d-s44nj |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-43223-predictor-5968f7b98d-s44nj to ip-10-0-129-245.ec2.internal | ||
kserve-ci-e2e-test |
isvc-sklearn-graph-1-predictor-875bcd459-8wb7k |
Scheduled |
Successfully assigned kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-8wb7k to ip-10-0-134-114.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-c3262-predictor-6676bfcd4d-z54kx |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-c3262-predictor-6676bfcd4d-z54kx to ip-10-0-129-245.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-9857d-predictor-c6ddb6cb7-54ljt |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-9857d-predictor-c6ddb6cb7-54ljt to ip-10-0-129-245.ec2.internal | ||
kserve-ci-e2e-test |
ensemble-graph-af621-7d4fd998f4-sv5l4 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/ensemble-graph-af621-7d4fd998f4-sv5l4 to ip-10-0-139-178.ec2.internal | ||
kserve-ci-e2e-test |
sequence-graph-550f3-686769c68-t5pr2 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/sequence-graph-550f3-686769c68-t5pr2 to ip-10-0-139-178.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-4f643-predictor-7879dc7bcd-279lm |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-4f643-predictor-7879dc7bcd-279lm to ip-10-0-129-245.ec2.internal | ||
kserve-ci-e2e-test |
sequence-graph-c3262-557db7f5b8-g279b |
Scheduled |
Successfully assigned kserve-ci-e2e-test/sequence-graph-c3262-557db7f5b8-g279b to ip-10-0-139-178.ec2.internal | ||
kserve-ci-e2e-test |
sequence-graph-eb211-648cf9b67b-h6dpc |
Scheduled |
Successfully assigned kserve-ci-e2e-test/sequence-graph-eb211-648cf9b67b-h6dpc to ip-10-0-139-178.ec2.internal | ||
kserve-ci-e2e-test |
splitter-graph-1bf2c-997f87564-8nkrj |
Scheduled |
Successfully assigned kserve-ci-e2e-test/splitter-graph-1bf2c-997f87564-8nkrj to ip-10-0-139-178.ec2.internal | ||
kserve-ci-e2e-test |
splitter-graph-4f643-59d4664c7d-tk7t6 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/splitter-graph-4f643-59d4664c7d-tk7t6 to ip-10-0-139-178.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-1bf2c-predictor-56bc8b9cd9-48jqx |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-1bf2c-predictor-56bc8b9cd9-48jqx to ip-10-0-129-245.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-4f643-predictor-785bf555c9-xsk4z |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-4f643-predictor-785bf555c9-xsk4z to ip-10-0-129-245.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-550f3-predictor-6564b49d87-mgttl |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-550f3-predictor-6564b49d87-mgttl to ip-10-0-129-245.ec2.internal | ||
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-f2cdf-predictor-64d5b74467 |
SuccessfulCreate |
Created pod: success-200-isvc-f2cdf-predictor-64d5b74467-n5sd4 | |
kserve-ci-e2e-test |
replicaset-controller |
isvc-sklearn-graph-1-predictor-875bcd459 |
SuccessfulCreate |
Created pod: isvc-sklearn-graph-1-predictor-875bcd459-8wb7k | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-875bcd459-8wb7k |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "isvc-sklearn-graph-1-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
replicaset-controller |
isvc-xgboost-graph-predictor-555fc69d56 |
SuccessfulCreate |
Created pod: isvc-xgboost-graph-predictor-555fc69d56-6hxpq | |
kserve-ci-e2e-test |
deployment-controller |
isvc-xgboost-graph-predictor |
ScalingReplicaSet |
Scaled up replica set isvc-xgboost-graph-predictor-555fc69d56 from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-f2cdf-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-f2cdf-predictor-64d5b74467 from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
isvc-sklearn-graph-1-predictor |
ScalingReplicaSet |
Scaled up replica set isvc-sklearn-graph-1-predictor-875bcd459 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-f2cdf-predictor-58c9fc6cc8 |
SuccessfulCreate |
Created pod: error-404-isvc-f2cdf-predictor-58c9fc6cc8-6spwd | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-875bcd459-8wb7k |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-f2cdf-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-f2cdf-predictor-58c9fc6cc8 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-f2cdf-predictor-58c9fc6cc8-6spwd |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "error-404-isvc-f2cdf-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
multus |
success-200-isvc-f2cdf-predictor-64d5b74467-n5sd4 |
AddedInterface |
Add eth0 [10.134.0.21/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-f2cdf-predictor-64d5b74467-n5sd4 |
Pulling |
Pulling image "quay.io/opendatahub/success-200-isvc:odh-pr-1690" | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-6hxpq |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
replicaset-controller |
isvc-sklearn-graph-2-predictor-6c8478f9b5 |
SuccessfulCreate |
Created pod: isvc-sklearn-graph-2-predictor-6c8478f9b5-4v96j | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-6hxpq |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
deployment-controller |
isvc-sklearn-graph-2-predictor |
ScalingReplicaSet |
Scaled up replica set isvc-sklearn-graph-2-predictor-6c8478f9b5 from 0 to 1 | |
kserve-ci-e2e-test |
multus |
isvc-sklearn-graph-1-predictor-875bcd459-8wb7k |
AddedInterface |
Add eth0 [10.132.0.24/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-875bcd459-8wb7k |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:5df3316e2bbb1c8de0277d9a0c433b6bf041a14baf6838a11e4f2bdc5ed51f25" already present on machine | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-875bcd459-8wb7k |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-6hxpq |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:5df3316e2bbb1c8de0277d9a0c433b6bf041a14baf6838a11e4f2bdc5ed51f25" already present on machine | |
kserve-ci-e2e-test |
multus |
isvc-xgboost-graph-predictor-555fc69d56-6hxpq |
AddedInterface |
Add eth0 [10.132.0.25/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-6c8478f9b5-4v96j |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "isvc-sklearn-graph-2-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-6c8478f9b5-4v96j |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:5df3316e2bbb1c8de0277d9a0c433b6bf041a14baf6838a11e4f2bdc5ed51f25" already present on machine | |
kserve-ci-e2e-test |
multus |
isvc-sklearn-graph-2-predictor-6c8478f9b5-4v96j |
AddedInterface |
Add eth0 [10.132.0.26/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-6c8478f9b5-4v96j |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-f2cdf-predictor-58c9fc6cc8-6spwd |
Pulling |
Pulling image "quay.io/opendatahub/error-404-isvc:odh-pr-1690" | |
kserve-ci-e2e-test |
multus |
error-404-isvc-f2cdf-predictor-58c9fc6cc8-6spwd |
AddedInterface |
Add eth0 [10.134.0.22/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-6c8478f9b5-4v96j |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-875bcd459-8wb7k |
Pulling |
Pulling image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1690" | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-6hxpq |
Pulling |
Pulling image "kserve/xgbserver:latest" | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-6c8478f9b5-4v96j |
Pulling |
Pulling image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1690" | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-f2cdf-predictor-64d5b74467-n5sd4 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-f2cdf-predictor-58c9fc6cc8-6spwd |
Pulling |
Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-f2cdf-predictor-64d5b74467-n5sd4 |
Pulled |
Successfully pulled image "quay.io/opendatahub/success-200-isvc:odh-pr-1690" in 16.651s (16.651s including waiting). Image size: 1335614578 bytes. | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-f2cdf-predictor-64d5b74467-n5sd4 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-f2cdf-predictor-58c9fc6cc8-6spwd |
Pulled |
Successfully pulled image "quay.io/opendatahub/error-404-isvc:odh-pr-1690" in 15.621s (15.621s including waiting). Image size: 1334589547 bytes. | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-f2cdf-predictor-58c9fc6cc8-6spwd |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-f2cdf-predictor-64d5b74467-n5sd4 |
Pulling |
Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-f2cdf-predictor-58c9fc6cc8-6spwd |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-f2cdf-predictor-58c9fc6cc8-6spwd |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-f2cdf-predictor-58c9fc6cc8-6spwd |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-f2cdf-predictor-58c9fc6cc8-6spwd |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" in 2.274s (2.274s including waiting). Image size: 211946088 bytes. | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-f2cdf-predictor-64d5b74467-n5sd4 |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-f2cdf-predictor-64d5b74467-n5sd4 |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" in 2.275s (2.275s including waiting). Image size: 211946088 bytes. | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-f2cdf-predictor-64d5b74467-n5sd4 |
Created |
Created container: kube-rbac-proxy | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-f2cdf-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-f2cdf-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-875bcd459-8wb7k |
Pulled |
Successfully pulled image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1690" in 28.021s (28.021s including waiting). Image size: 1558043571 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-875bcd459-8wb7k |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-875bcd459-8wb7k |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-875bcd459-8wb7k |
Pulling |
Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-6hxpq |
Pulling |
Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-6hxpq |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-6hxpq |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-6hxpq |
Pulled |
Successfully pulled image "kserve/xgbserver:latest" in 28.477s (28.477s including waiting). Image size: 1305293052 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-6c8478f9b5-4v96j |
Pulling |
Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-6c8478f9b5-4v96j |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-6c8478f9b5-4v96j |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-6c8478f9b5-4v96j |
Pulled |
Successfully pulled image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1690" in 27.672s (27.672s including waiting). Image size: 1558043571 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-6hxpq |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-875bcd459-8wb7k |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-6c8478f9b5-4v96j |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" in 2.019s (2.019s including waiting). Image size: 211946088 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-875bcd459-8wb7k |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-875bcd459-8wb7k |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" in 2.666s (2.666s including waiting). Image size: 211946088 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-6c8478f9b5-4v96j |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-6hxpq |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" in 2.224s (2.224s including waiting). Image size: 211946088 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-6hxpq |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-6c8478f9b5-4v96j |
Started |
Started container kube-rbac-proxy | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-f2cdf-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-f2cdf-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-f2cdf |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-f2cdf |
InferenceServiceReady |
InferenceService [success-200-isvc-f2cdf] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-f2cdf |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-f2cdf |
InferenceServiceReady |
InferenceService [error-404-isvc-f2cdf] is Ready | |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
multus |
switch-graph-f2cdf-545944cd54-5rxqp |
AddedInterface |
Add eth0 [10.133.0.30/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-f2cdf |
InferenceGraphReady |
InferenceGraph [switch-graph-f2cdf] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
switch-graph-f2cdf |
ScalingReplicaSet |
Scaled up replica set switch-graph-f2cdf-545944cd54 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
switch-graph-f2cdf-545944cd54 |
SuccessfulCreate |
Created pod: switch-graph-f2cdf-545944cd54-5rxqp | |
kserve-ci-e2e-test |
kubelet |
switch-graph-f2cdf-545944cd54-5rxqp |
Pulling |
Pulling image "quay.io/opendatahub/kserve-router@sha256:a589cb7fd67a31c767ba2472b47f816cadffddbd6c2e2c8ddfd876f9a79d8448" | |
kserve-ci-e2e-test |
kubelet |
switch-graph-f2cdf-545944cd54-5rxqp |
Pulled |
Successfully pulled image "quay.io/opendatahub/kserve-router@sha256:a589cb7fd67a31c767ba2472b47f816cadffddbd6c2e2c8ddfd876f9a79d8448" in 3.079s (3.079s including waiting). Image size: 218070140 bytes. | |
kserve-ci-e2e-test |
kubelet |
switch-graph-f2cdf-545944cd54-5rxqp |
Started |
Started container switch-graph-f2cdf | |
kserve-ci-e2e-test |
kubelet |
switch-graph-f2cdf-545944cd54-5rxqp |
Created |
Created container: switch-graph-f2cdf | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-f2cdf-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-f2cdf-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-f2cdf-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-f2cdf-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-f2cdf-predictor-58c9fc6cc8-6spwd |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
switch-graph-f2cdf-545944cd54-5rxqp |
Killing |
Stopping container switch-graph-f2cdf | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-9857d |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-9857d": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-9857d": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-9857d |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-9857d": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-9857d": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-9857d |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-9857d": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-9857d |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-9857d": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-9857d-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-9857d-predictor-c6ddb6cb7 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-f2cdf-predictor-58c9fc6cc8-6spwd |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-9857d-predictor-c6ddb6cb7 |
SuccessfulCreate |
Created pod: success-200-isvc-9857d-predictor-c6ddb6cb7-54ljt | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-9857d-predictor-c6ddb6cb7-54ljt |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "success-200-isvc-9857d-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-9857d-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-9857d-predictor-74fddbbbc8 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-9857d-predictor-74fddbbbc8 |
SuccessfulCreate |
Created pod: error-404-isvc-9857d-predictor-74fddbbbc8-ftl8h | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-f2cdf-predictor-64d5b74467-n5sd4 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-f2cdf-predictor-64d5b74467-n5sd4 |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-9857d-predictor-c6ddb6cb7-54ljt |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
multus |
success-200-isvc-9857d-predictor-c6ddb6cb7-54ljt |
AddedInterface |
Add eth0 [10.134.0.23/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-9857d-predictor-74fddbbbc8-ftl8h |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
multus |
error-404-isvc-9857d-predictor-74fddbbbc8-ftl8h |
AddedInterface |
Add eth0 [10.134.0.24/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-9857d-predictor-74fddbbbc8-ftl8h |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-9857d-predictor-74fddbbbc8-ftl8h |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-9857d-predictor-74fddbbbc8-ftl8h |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-9857d-predictor-c6ddb6cb7-54ljt |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-9857d-predictor-c6ddb6cb7-54ljt |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1690" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-9857d-predictor-c6ddb6cb7-54ljt |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-9857d-predictor-c6ddb6cb7-54ljt |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-9857d-predictor-74fddbbbc8-ftl8h |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-9857d-predictor-c6ddb6cb7-54ljt |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-9857d-predictor-74fddbbbc8-ftl8h |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1690" already present on machine | |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-f2cdf-predictor-64d5b74467-n5sd4 |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.21:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-f2cdf-predictor-64d5b74467-n5sd4 |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.21:8643/healthz": dial tcp 10.134.0.21:8643: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-f2cdf-predictor-58c9fc6cc8-6spwd |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.22:8643/healthz": dial tcp 10.134.0.22:8643: connect: connection refused | |
| (x7) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-f2cdf-predictor-58c9fc6cc8-6spwd |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.22:8080: connect: connection refused |
kserve-ci-e2e-test |
v1beta1Controllers |
isvc-xgboost-graph |
InferenceServiceReady |
InferenceService [isvc-xgboost-graph] is Ready | |
| (x9) | kserve-ci-e2e-test |
v1beta1Controllers |
isvc-xgboost-graph |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x9) | kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-2 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-2 |
InferenceServiceReady |
InferenceService [isvc-sklearn-graph-2] is Ready | |
| (x9) | kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-1 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-1 |
InferenceServiceReady |
InferenceService [isvc-sklearn-graph-1] is Ready | |
| (x6) | kserve-ci-e2e-test |
kubelet |
switch-graph-f2cdf-545944cd54-5rxqp |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-9857d-predictor-c6ddb6cb7-54ljt |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.23:8080: connect: connection refused |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-9857d-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-9857d-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-9857d-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-9857d-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
replicaset-controller |
model-chainer-7565859b98 |
SuccessfulCreate |
Created pod: model-chainer-7565859b98-gvnv8 | |
kserve-ci-e2e-test |
deployment-controller |
model-chainer |
ScalingReplicaSet |
Scaled up replica set model-chainer-7565859b98 from 0 to 1 | |
kserve-ci-e2e-test |
InferenceGraphController |
model-chainer |
InferenceGraphReady |
InferenceGraph [model-chainer] is Ready | |
kserve-ci-e2e-test |
kubelet |
model-chainer-7565859b98-gvnv8 |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "model-chainer-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
model-chainer-7565859b98-gvnv8 |
Started |
Started container model-chainer | |
kserve-ci-e2e-test |
kubelet |
model-chainer-7565859b98-gvnv8 |
Created |
Created container: model-chainer | |
kserve-ci-e2e-test |
multus |
model-chainer-7565859b98-gvnv8 |
AddedInterface |
Add eth0 [10.133.0.31/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
model-chainer-7565859b98-gvnv8 |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:a589cb7fd67a31c767ba2472b47f816cadffddbd6c2e2c8ddfd876f9a79d8448" already present on machine | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-9857d |
InferenceServiceReady |
InferenceService [error-404-isvc-9857d] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-9857d |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-9857d |
InferenceServiceReady |
InferenceService [success-200-isvc-9857d] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-9857d |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-6c8478f9b5-4v96j |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-eb211-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-eb211-predictor-69b49c778c from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-eb211-predictor-69b49c778c-qn8vg |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "success-200-isvc-eb211-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-eb211-predictor-6695c85886 |
SuccessfulCreate |
Created pod: error-404-isvc-eb211-predictor-6695c85886-hvd2p | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-6c8478f9b5-4v96j |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-6hxpq |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-6hxpq |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-eb211-predictor-69b49c778c |
SuccessfulCreate |
Created pod: success-200-isvc-eb211-predictor-69b49c778c-qn8vg | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-875bcd459-8wb7k |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-875bcd459-8wb7k |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
model-chainer-7565859b98-gvnv8 |
Killing |
Stopping container model-chainer | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-eb211-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-eb211-predictor-6695c85886 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-eb211-predictor-69b49c778c-qn8vg |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
multus |
success-200-isvc-eb211-predictor-69b49c778c-qn8vg |
AddedInterface |
Add eth0 [10.134.0.25/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-eb211-predictor-6695c85886-hvd2p |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-eb211-predictor-69b49c778c-qn8vg |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-eb211-predictor-69b49c778c-qn8vg |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-eb211-predictor-6695c85886-hvd2p |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "error-404-isvc-eb211-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-eb211-predictor-69b49c778c-qn8vg |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1690" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-eb211-predictor-6695c85886-hvd2p |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-eb211-predictor-6695c85886-hvd2p |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-eb211-predictor-69b49c778c-qn8vg |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-eb211-predictor-6695c85886-hvd2p |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1690" already present on machine | |
kserve-ci-e2e-test |
multus |
error-404-isvc-eb211-predictor-6695c85886-hvd2p |
AddedInterface |
Add eth0 [10.134.0.26/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-eb211-predictor-69b49c778c-qn8vg |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-6c8478f9b5-4v96j |
Unhealthy |
Readiness probe failed: Get "https://10.132.0.26:8643/healthz": dial tcp 10.132.0.26:8643: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-eb211-predictor-6695c85886-hvd2p |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-6hxpq |
Unhealthy |
Readiness probe failed: Get "https://10.132.0.25:8643/healthz": dial tcp 10.132.0.25:8643: connect: connection refused | |
| (x10) | kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-6c8478f9b5-4v96j |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.26:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-eb211-predictor-6695c85886-hvd2p |
Started |
Started container kube-rbac-proxy | |
| (x9) | kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-6hxpq |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.25:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-875bcd459-8wb7k |
Unhealthy |
Readiness probe failed: Get "https://10.132.0.24:8643/healthz": dial tcp 10.132.0.24:8643: connect: connection refused | |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-9857d |
InferenceGraphReady |
InferenceGraph [switch-graph-9857d] is Ready | |
| (x11) | kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-875bcd459-8wb7k |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.24:8080: connect: connection refused |
kserve-ci-e2e-test |
deployment-controller |
switch-graph-9857d |
ScalingReplicaSet |
Scaled up replica set switch-graph-9857d-698d9d6767 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
switch-graph-9857d-698d9d6767 |
SuccessfulCreate |
Created pod: switch-graph-9857d-698d9d6767-gzxql | |
kserve-ci-e2e-test |
kubelet |
switch-graph-9857d-698d9d6767-gzxql |
Created |
Created container: switch-graph-9857d | |
kserve-ci-e2e-test |
kubelet |
switch-graph-9857d-698d9d6767-gzxql |
Started |
Started container switch-graph-9857d | |
kserve-ci-e2e-test |
kubelet |
switch-graph-9857d-698d9d6767-gzxql |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:a589cb7fd67a31c767ba2472b47f816cadffddbd6c2e2c8ddfd876f9a79d8448" already present on machine | |
kserve-ci-e2e-test |
multus |
switch-graph-9857d-698d9d6767-gzxql |
AddedInterface |
Add eth0 [10.133.0.32/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-eb211-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-eb211-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-9857d |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-9857d |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-9857d-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-9857d-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x6) | kserve-ci-e2e-test |
kubelet |
model-chainer-7565859b98-gvnv8 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-eb211-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-eb211-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-9857d |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-9857d |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-9857d-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-9857d-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-eb211 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-eb211 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-eb211 |
InferenceServiceReady |
InferenceService [error-404-isvc-eb211] is Ready | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-eb211 |
InferenceServiceReady |
InferenceService [success-200-isvc-eb211] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
sequence-graph-eb211 |
ScalingReplicaSet |
Scaled up replica set sequence-graph-eb211-648cf9b67b from 0 to 1 | |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-eb211 |
InferenceGraphReady |
InferenceGraph [sequence-graph-eb211] is Ready | |
kserve-ci-e2e-test |
replicaset-controller |
sequence-graph-eb211-648cf9b67b |
SuccessfulCreate |
Created pod: sequence-graph-eb211-648cf9b67b-h6dpc | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-eb211-648cf9b67b-h6dpc |
Created |
Created container: sequence-graph-eb211 | |
kserve-ci-e2e-test |
multus |
sequence-graph-eb211-648cf9b67b-h6dpc |
AddedInterface |
Add eth0 [10.133.0.33/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-eb211-648cf9b67b-h6dpc |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:a589cb7fd67a31c767ba2472b47f816cadffddbd6c2e2c8ddfd876f9a79d8448" already present on machine | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-eb211-648cf9b67b-h6dpc |
Started |
Started container sequence-graph-eb211 | |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-eb211-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-eb211-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-eb211-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-eb211-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-eb211 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-eb211 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-c059b |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-c059b": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-c059b": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-c059b-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-c059b-predictor-7c8bc8775f from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-c059b-predictor-847bfb4858 |
SuccessfulCreate |
Created pod: error-404-isvc-c059b-predictor-847bfb4858-gvm44 | |
kserve-ci-e2e-test |
kubelet |
switch-graph-9857d-698d9d6767-gzxql |
Killing |
Stopping container switch-graph-9857d | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-c059b-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-c059b-predictor-847bfb4858 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-c059b-predictor-847bfb4858-gvm44 |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "error-404-isvc-c059b-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-c059b-predictor-7c8bc8775f |
SuccessfulCreate |
Created pod: success-200-isvc-c059b-predictor-7c8bc8775f-9qkp5 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-c059b-predictor-7c8bc8775f-9qkp5 |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "success-200-isvc-c059b-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-c059b |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-c059b": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-9857d-predictor-c6ddb6cb7-54ljt |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-9857d-predictor-c6ddb6cb7-54ljt |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-c059b |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-c059b": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-c059b |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-c059b": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-c059b": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-9857d-predictor-74fddbbbc8-ftl8h |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-9857d-predictor-74fddbbbc8-ftl8h |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-c059b-predictor-847bfb4858-gvm44 |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-c059b-predictor-7c8bc8775f-9qkp5 |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1690" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-c059b-predictor-847bfb4858-gvm44 |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-c059b-predictor-847bfb4858-gvm44 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-c059b-predictor-847bfb4858-gvm44 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-c059b-predictor-7c8bc8775f-9qkp5 |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-c059b-predictor-847bfb4858-gvm44 |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1690" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-c059b-predictor-7c8bc8775f-9qkp5 |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-c059b-predictor-847bfb4858-gvm44 |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
multus |
error-404-isvc-c059b-predictor-847bfb4858-gvm44 |
AddedInterface |
Add eth0 [10.134.0.28/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-c059b-predictor-7c8bc8775f-9qkp5 |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-c059b-predictor-7c8bc8775f-9qkp5 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-c059b-predictor-7c8bc8775f-9qkp5 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
multus |
success-200-isvc-c059b-predictor-7c8bc8775f-9qkp5 |
AddedInterface |
Add eth0 [10.134.0.27/23] from ovn-kubernetes | |
| (x7) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-9857d-predictor-74fddbbbc8-ftl8h |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.24:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-9857d-predictor-74fddbbbc8-ftl8h |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.24:8643/healthz": dial tcp 10.134.0.24:8643: connect: connection refused | |
| (x6) | kserve-ci-e2e-test |
kubelet |
switch-graph-9857d-698d9d6767-gzxql |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-c059b-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-c059b-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-c059b-predictor-7c8bc8775f-9qkp5 |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.27:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-c059b-predictor-847bfb4858-gvm44 |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.28:8080: connect: connection refused |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-c059b-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-c059b-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-c059b |
InferenceServiceReady |
InferenceService [success-200-isvc-c059b] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-c059b |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-c059b |
InferenceServiceReady |
InferenceService [error-404-isvc-c059b] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-c059b |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-550f3 |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-550f3": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-550f3": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-550f3-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-550f3-predictor-6564b49d87 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-550f3-predictor-6564b49d87 |
SuccessfulCreate |
Created pod: success-200-isvc-550f3-predictor-6564b49d87-mgttl | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-550f3 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-550f3": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-550f3-predictor-6564b49d87-mgttl |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1690" already present on machine | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-550f3 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-550f3": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-eb211-predictor-69b49c778c-qn8vg |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-550f3 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-550f3": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-550f3": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
multus |
success-200-isvc-550f3-predictor-6564b49d87-mgttl |
AddedInterface |
Add eth0 [10.134.0.29/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-550f3-predictor-787558b8bb |
SuccessfulCreate |
Created pod: error-404-isvc-550f3-predictor-787558b8bb-22gl7 | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-550f3-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-550f3-predictor-787558b8bb from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-eb211-predictor-69b49c778c-qn8vg |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-eb211-648cf9b67b-h6dpc |
Killing |
Stopping container sequence-graph-eb211 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-eb211-predictor-6695c85886-hvd2p |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-eb211-predictor-6695c85886-hvd2p |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-550f3-predictor-787558b8bb-22gl7 |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-550f3-predictor-787558b8bb-22gl7 |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-550f3-predictor-787558b8bb-22gl7 |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-550f3-predictor-787558b8bb-22gl7 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-550f3-predictor-6564b49d87-mgttl |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-550f3-predictor-787558b8bb-22gl7 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
multus |
error-404-isvc-550f3-predictor-787558b8bb-22gl7 |
AddedInterface |
Add eth0 [10.134.0.30/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-550f3-predictor-6564b49d87-mgttl |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-550f3-predictor-787558b8bb-22gl7 |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1690" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-550f3-predictor-6564b49d87-mgttl |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-550f3-predictor-6564b49d87-mgttl |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-550f3-predictor-6564b49d87-mgttl |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-eb211-predictor-69b49c778c-qn8vg |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.25:8643/healthz": dial tcp 10.134.0.25:8643: connect: connection refused | |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-eb211-predictor-69b49c778c-qn8vg |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.25:8080: connect: connection refused |
| (x7) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-eb211-predictor-6695c85886-hvd2p |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.26:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-eb211-predictor-6695c85886-hvd2p |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.26:8643/healthz": dial tcp 10.134.0.26:8643: connect: connection refused | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-c059b-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-c059b-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-c059b-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
replicaset-controller |
ensemble-graph-c059b-b4df54dc8 |
SuccessfulCreate |
Created pod: ensemble-graph-c059b-b4df54dc8-fppfl | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-c059b-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
InferenceGraphController |
ensemble-graph-c059b |
InferenceGraphReady |
InferenceGraph [ensemble-graph-c059b] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
ensemble-graph-c059b |
ScalingReplicaSet |
Scaled up replica set ensemble-graph-c059b-b4df54dc8 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-c059b-b4df54dc8-fppfl |
Started |
Started container ensemble-graph-c059b | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-c059b-b4df54dc8-fppfl |
Created |
Created container: ensemble-graph-c059b | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-c059b-b4df54dc8-fppfl |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:a589cb7fd67a31c767ba2472b47f816cadffddbd6c2e2c8ddfd876f9a79d8448" already present on machine | |
kserve-ci-e2e-test |
multus |
ensemble-graph-c059b-b4df54dc8-fppfl |
AddedInterface |
Add eth0 [10.133.0.34/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-c059b-predictor-7c8bc8775f-9qkp5 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-af621-predictor-688d7d5cb9 |
SuccessfulCreate |
Created pod: success-200-isvc-af621-predictor-688d7d5cb9-p4nrw | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-af621-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-af621-predictor-6c7cdbfc8d from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-c059b-predictor-7c8bc8775f-9qkp5 |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-af621-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-af621-predictor-688d7d5cb9 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-c059b-predictor-847bfb4858-gvm44 |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-c059b-predictor-847bfb4858-gvm44 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-c059b-b4df54dc8-fppfl |
Killing |
Stopping container ensemble-graph-c059b | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-af621 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-af621": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-af621 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-af621": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-af621": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-af621-predictor-6c7cdbfc8d |
SuccessfulCreate |
Created pod: error-404-isvc-af621-predictor-6c7cdbfc8d-gsrwd | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-af621-predictor-688d7d5cb9-p4nrw |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1690" already present on machine | |
kserve-ci-e2e-test |
multus |
success-200-isvc-af621-predictor-688d7d5cb9-p4nrw |
AddedInterface |
Add eth0 [10.134.0.31/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-af621-predictor-6c7cdbfc8d-gsrwd |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "error-404-isvc-af621-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-af621-predictor-688d7d5cb9-p4nrw |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "success-200-isvc-af621-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-af621-predictor-688d7d5cb9-p4nrw |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-af621-predictor-6c7cdbfc8d-gsrwd |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-af621-predictor-6c7cdbfc8d-gsrwd |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-af621-predictor-6c7cdbfc8d-gsrwd |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-af621-predictor-6c7cdbfc8d-gsrwd |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-af621-predictor-6c7cdbfc8d-gsrwd |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-af621-predictor-6c7cdbfc8d-gsrwd |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1690" already present on machine | |
kserve-ci-e2e-test |
multus |
error-404-isvc-af621-predictor-6c7cdbfc8d-gsrwd |
AddedInterface |
Add eth0 [10.134.0.32/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-af621-predictor-688d7d5cb9-p4nrw |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-af621-predictor-688d7d5cb9-p4nrw |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-af621-predictor-688d7d5cb9-p4nrw |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-af621-predictor-688d7d5cb9-p4nrw |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-c059b-predictor-7c8bc8775f-9qkp5 |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.27:8643/healthz": dial tcp 10.134.0.27:8643: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-c059b-predictor-847bfb4858-gvm44 |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.28:8643/healthz": dial tcp 10.134.0.28:8643: connect: connection refused | |
| (x6) | kserve-ci-e2e-test |
kubelet |
sequence-graph-eb211-648cf9b67b-h6dpc |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-550f3-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-550f3-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-550f3-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-550f3-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-550f3-predictor-787558b8bb-22gl7 |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.30:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
ensemble-graph-c059b-b4df54dc8-fppfl |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-af621-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-af621-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-af621-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-af621-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-550f3 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-550f3 |
InferenceServiceReady |
InferenceService [error-404-isvc-550f3] is Ready | |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-af621-predictor-6c7cdbfc8d-gsrwd |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.32:8080: connect: connection refused |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-550f3 |
InferenceServiceReady |
InferenceService [success-200-isvc-550f3] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-550f3 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-af621 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-af621 |
InferenceServiceReady |
InferenceService [success-200-isvc-af621] is Ready | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-af621 |
InferenceServiceReady |
InferenceService [error-404-isvc-af621] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-af621 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
deployment-controller |
sequence-graph-550f3 |
ScalingReplicaSet |
Scaled up replica set sequence-graph-550f3-686769c68 from 0 to 1 | |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-550f3 |
InferenceGraphReady |
InferenceGraph [sequence-graph-550f3] is Ready | |
kserve-ci-e2e-test |
multus |
sequence-graph-550f3-686769c68-t5pr2 |
AddedInterface |
Add eth0 [10.133.0.35/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
replicaset-controller |
sequence-graph-550f3-686769c68 |
SuccessfulCreate |
Created pod: sequence-graph-550f3-686769c68-t5pr2 | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-550f3-686769c68-t5pr2 |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:a589cb7fd67a31c767ba2472b47f816cadffddbd6c2e2c8ddfd876f9a79d8448" already present on machine | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-550f3-686769c68-t5pr2 |
Created |
Created container: sequence-graph-550f3 | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-550f3-686769c68-t5pr2 |
Started |
Started container sequence-graph-550f3 | |
kserve-ci-e2e-test |
deployment-controller |
ensemble-graph-af621 |
ScalingReplicaSet |
Scaled up replica set ensemble-graph-af621-7d4fd998f4 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
ensemble-graph-af621-7d4fd998f4 |
SuccessfulCreate |
Created pod: ensemble-graph-af621-7d4fd998f4-sv5l4 | |
kserve-ci-e2e-test |
InferenceGraphController |
ensemble-graph-af621 |
InferenceGraphReady |
InferenceGraph [ensemble-graph-af621] is Ready | |
kserve-ci-e2e-test |
multus |
ensemble-graph-af621-7d4fd998f4-sv5l4 |
AddedInterface |
Add eth0 [10.133.0.36/23] from ovn-kubernetes | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-550f3-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-550f3-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-550f3-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-af621-7d4fd998f4-sv5l4 |
Started |
Started container ensemble-graph-af621 | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-550f3-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-af621-7d4fd998f4-sv5l4 |
Created |
Created container: ensemble-graph-af621 | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-af621-7d4fd998f4-sv5l4 |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:a589cb7fd67a31c767ba2472b47f816cadffddbd6c2e2c8ddfd876f9a79d8448" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-550f3-predictor-6564b49d87-mgttl |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-c3262-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-c3262-predictor-6676bfcd4d from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-550f3-predictor-787558b8bb-22gl7 |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-c3262 |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-c3262": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-c3262": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-c3262 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-c3262": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-c3262-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-c3262-predictor-865fd8b765 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-c3262-predictor-865fd8b765 |
SuccessfulCreate |
Created pod: success-200-isvc-c3262-predictor-865fd8b765-p828d | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-550f3-predictor-6564b49d87-mgttl |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-c3262 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-c3262": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-550f3-predictor-787558b8bb-22gl7 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-550f3-686769c68-t5pr2 |
Killing |
Stopping container sequence-graph-550f3 | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-c3262-predictor-6676bfcd4d |
SuccessfulCreate |
Created pod: error-404-isvc-c3262-predictor-6676bfcd4d-z54kx | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-c3262 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-c3262": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-c3262": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-c3262-predictor-865fd8b765-p828d |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-c3262-predictor-865fd8b765-p828d |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-c3262-predictor-865fd8b765-p828d |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "success-200-isvc-c3262-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-c3262-predictor-865fd8b765-p828d |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1690" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-c3262-predictor-6676bfcd4d-z54kx |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-c3262-predictor-865fd8b765-p828d |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-c3262-predictor-6676bfcd4d-z54kx |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-c3262-predictor-865fd8b765-p828d |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-c3262-predictor-865fd8b765-p828d |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
multus |
success-200-isvc-c3262-predictor-865fd8b765-p828d |
AddedInterface |
Add eth0 [10.134.0.33/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-c3262-predictor-6676bfcd4d-z54kx |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-c3262-predictor-6676bfcd4d-z54kx |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1690" already present on machine | |
kserve-ci-e2e-test |
multus |
error-404-isvc-c3262-predictor-6676bfcd4d-z54kx |
AddedInterface |
Add eth0 [10.134.0.34/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-c3262-predictor-6676bfcd4d-z54kx |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-c3262-predictor-6676bfcd4d-z54kx |
Started |
Started container kube-rbac-proxy | |
| (x8) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-550f3-predictor-6564b49d87-mgttl |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.29:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-550f3-predictor-6564b49d87-mgttl |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.29:8643/healthz": dial tcp 10.134.0.29:8643: connect: connection refused | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-af621-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-af621-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-af621-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-af621-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
ensemble-graph-af621 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
ensemble-graph-af621 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x6) | kserve-ci-e2e-test |
kubelet |
sequence-graph-550f3-686769c68-t5pr2 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-c3262-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-c3262-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-c3262-predictor-865fd8b765-p828d |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.33:8080: connect: connection refused |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-c3262 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-c3262 |
InferenceServiceReady |
InferenceService [error-404-isvc-c3262] is Ready | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-c3262 |
InferenceServiceReady |
InferenceService [success-200-isvc-c3262] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-c3262 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
replicaset-controller |
sequence-graph-c3262-557db7f5b8 |
SuccessfulCreate |
Created pod: sequence-graph-c3262-557db7f5b8-g279b | |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-c3262-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
deployment-controller |
sequence-graph-c3262 |
ScalingReplicaSet |
Scaled up replica set sequence-graph-c3262-557db7f5b8 from 0 to 1 | |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-c3262 |
InferenceGraphReady |
InferenceGraph [sequence-graph-c3262] is Ready | |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-c3262-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
kubelet |
sequence-graph-c3262-557db7f5b8-g279b |
Started |
Started container sequence-graph-c3262 | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-c3262-557db7f5b8-g279b |
Created |
Created container: sequence-graph-c3262 | |
kserve-ci-e2e-test |
multus |
sequence-graph-c3262-557db7f5b8-g279b |
AddedInterface |
Add eth0 [10.133.0.38/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-c3262-557db7f5b8-g279b |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:a589cb7fd67a31c767ba2472b47f816cadffddbd6c2e2c8ddfd876f9a79d8448" already present on machine | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-c3262 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-c3262 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-c3262 |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-c3262-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-c3262-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-c3262 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-1bf2c |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-1bf2c": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-1bf2c": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-af621-7d4fd998f4-sv5l4 |
Killing |
Stopping container ensemble-graph-af621 | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-1bf2c-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-1bf2c-predictor-6c64b6bb44 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-1bf2c-predictor-56bc8b9cd9 |
SuccessfulCreate |
Created pod: success-200-isvc-1bf2c-predictor-56bc8b9cd9-48jqx | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-1bf2c-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-1bf2c-predictor-56bc8b9cd9 from 0 to 1 | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-1bf2c |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-1bf2c": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-1bf2c": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-1bf2c |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-1bf2c": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-af621-predictor-688d7d5cb9-p4nrw |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-af621-predictor-688d7d5cb9-p4nrw |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-1bf2c |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-1bf2c": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-1bf2c-predictor-6c64b6bb44 |
SuccessfulCreate |
Created pod: error-404-isvc-1bf2c-predictor-6c64b6bb44-scdj5 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-1bf2c-predictor-56bc8b9cd9-48jqx |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
multus |
success-200-isvc-1bf2c-predictor-56bc8b9cd9-48jqx |
AddedInterface |
Add eth0 [10.134.0.35/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-1bf2c-predictor-56bc8b9cd9-48jqx |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1690" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-af621-predictor-6c7cdbfc8d-gsrwd |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-af621-predictor-6c7cdbfc8d-gsrwd |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-1bf2c-predictor-56bc8b9cd9-48jqx |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-1bf2c-predictor-6c64b6bb44-scdj5 |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "error-404-isvc-1bf2c-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-1bf2c-predictor-56bc8b9cd9-48jqx |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-1bf2c-predictor-56bc8b9cd9-48jqx |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-1bf2c-predictor-56bc8b9cd9-48jqx |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-1bf2c-predictor-6c64b6bb44-scdj5 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-1bf2c-predictor-6c64b6bb44-scdj5 |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1690" already present on machine | |
kserve-ci-e2e-test |
multus |
error-404-isvc-1bf2c-predictor-6c64b6bb44-scdj5 |
AddedInterface |
Add eth0 [10.134.0.36/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-1bf2c-predictor-6c64b6bb44-scdj5 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-1bf2c-predictor-6c64b6bb44-scdj5 |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-1bf2c-predictor-6c64b6bb44-scdj5 |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-1bf2c-predictor-6c64b6bb44-scdj5 |
Started |
Started container kube-rbac-proxy | |
| (x8) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-af621-predictor-688d7d5cb9-p4nrw |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.31:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-af621-predictor-688d7d5cb9-p4nrw |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.31:8643/healthz": dial tcp 10.134.0.31:8643: connect: connection refused | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-1bf2c-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-1bf2c-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x6) | kserve-ci-e2e-test |
kubelet |
ensemble-graph-af621-7d4fd998f4-sv5l4 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-1bf2c-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-1bf2c-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-1bf2c-predictor-6c64b6bb44-scdj5 |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.36:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-1bf2c-predictor-56bc8b9cd9-48jqx |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.35:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-1bf2c |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-1bf2c |
InferenceServiceReady |
InferenceService [error-404-isvc-1bf2c] is Ready | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-1bf2c |
InferenceServiceReady |
InferenceService [success-200-isvc-1bf2c] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-1bf2c |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-1bf2c-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-1bf2c-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
replicaset-controller |
splitter-graph-1bf2c-997f87564 |
SuccessfulCreate |
Created pod: splitter-graph-1bf2c-997f87564-8nkrj | |
kserve-ci-e2e-test |
deployment-controller |
splitter-graph-1bf2c |
ScalingReplicaSet |
Scaled up replica set splitter-graph-1bf2c-997f87564 from 0 to 1 | |
kserve-ci-e2e-test |
InferenceGraphController |
splitter-graph-1bf2c |
InferenceGraphReady |
InferenceGraph [splitter-graph-1bf2c] is Ready | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-1bf2c-997f87564-8nkrj |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:a589cb7fd67a31c767ba2472b47f816cadffddbd6c2e2c8ddfd876f9a79d8448" already present on machine | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-1bf2c-997f87564-8nkrj |
Created |
Created container: splitter-graph-1bf2c | |
kserve-ci-e2e-test |
multus |
splitter-graph-1bf2c-997f87564-8nkrj |
AddedInterface |
Add eth0 [10.133.0.39/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-1bf2c-997f87564-8nkrj |
Started |
Started container splitter-graph-1bf2c | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-1bf2c-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-1bf2c-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-43223 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-43223": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-c3262-predictor-865fd8b765-p828d |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-c3262-predictor-6676bfcd4d-z54kx |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-c3262-predictor-6676bfcd4d-z54kx |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-43223 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-43223": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-43223": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-43223-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-43223-predictor-5968f7b98d from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-43223-predictor-5968f7b98d-s44nj |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "error-404-isvc-43223-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-43223-predictor-85967567b9-fkcgw |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "success-200-isvc-43223-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-c3262-predictor-865fd8b765-p828d |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-c3262-557db7f5b8-g279b |
Killing |
Stopping container sequence-graph-c3262 | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-43223 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-43223": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-43223-predictor-85967567b9 |
SuccessfulCreate |
Created pod: success-200-isvc-43223-predictor-85967567b9-fkcgw | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-43223-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-43223-predictor-85967567b9 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-43223-predictor-5968f7b98d |
SuccessfulCreate |
Created pod: error-404-isvc-43223-predictor-5968f7b98d-s44nj | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-43223 |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-43223": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-43223": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-4f643-predictor-785bf555c9-xsk4z |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "success-200-isvc-4f643-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-43223-predictor-5968f7b98d-s44nj |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-4f643-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-4f643-predictor-7879dc7bcd from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-1bf2c-predictor-6c64b6bb44-scdj5 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-1bf2c-predictor-6c64b6bb44-scdj5 |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-43223-predictor-5968f7b98d-s44nj |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-4f643-predictor-7879dc7bcd-279lm |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "error-404-isvc-4f643-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-4f643-predictor-7879dc7bcd |
SuccessfulCreate |
Created pod: error-404-isvc-4f643-predictor-7879dc7bcd-279lm | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-43223-predictor-85967567b9-fkcgw |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-1bf2c-997f87564-8nkrj |
Killing |
Stopping container splitter-graph-1bf2c | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-43223-predictor-5968f7b98d-s44nj |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1690" already present on machine | |
kserve-ci-e2e-test |
multus |
error-404-isvc-43223-predictor-5968f7b98d-s44nj |
AddedInterface |
Add eth0 [10.134.0.38/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-43223-predictor-5968f7b98d-s44nj |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-4f643-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-4f643-predictor-785bf555c9 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-43223-predictor-85967567b9-fkcgw |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-43223-predictor-85967567b9-fkcgw |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-4f643-predictor-785bf555c9 |
SuccessfulCreate |
Created pod: success-200-isvc-4f643-predictor-785bf555c9-xsk4z | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-1bf2c-predictor-56bc8b9cd9-48jqx |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-1bf2c-predictor-56bc8b9cd9-48jqx |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-43223-predictor-85967567b9-fkcgw |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-43223-predictor-85967567b9-fkcgw |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-43223-predictor-85967567b9-fkcgw |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1690" already present on machine | |
kserve-ci-e2e-test |
multus |
success-200-isvc-43223-predictor-85967567b9-fkcgw |
AddedInterface |
Add eth0 [10.134.0.37/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-43223-predictor-5968f7b98d-s44nj |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-43223-predictor-5968f7b98d-s44nj |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-4f643 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-4f643": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-4f643 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-4f643": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-4f643": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-4f643-predictor-785bf555c9-xsk4z |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1690" already present on machine | |
kserve-ci-e2e-test |
multus |
success-200-isvc-4f643-predictor-785bf555c9-xsk4z |
AddedInterface |
Add eth0 [10.134.0.39/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-c3262-predictor-6676bfcd4d-z54kx |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.34:8643/healthz": dial tcp 10.134.0.34:8643: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-4f643-predictor-7879dc7bcd-279lm |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-4f643-predictor-7879dc7bcd-279lm |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-4f643-predictor-7879dc7bcd-279lm |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-4f643-predictor-785bf555c9-xsk4z |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-4f643-predictor-7879dc7bcd-279lm |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1690" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-4f643-predictor-7879dc7bcd-279lm |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-4f643-predictor-785bf555c9-xsk4z |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-4f643-predictor-785bf555c9-xsk4z |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-4f643-predictor-785bf555c9-xsk4z |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-4f643-predictor-785bf555c9-xsk4z |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-4f643-predictor-7879dc7bcd-279lm |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
multus |
error-404-isvc-4f643-predictor-7879dc7bcd-279lm |
AddedInterface |
Add eth0 [10.134.0.40/23] from ovn-kubernetes | |
| (x7) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-c3262-predictor-6676bfcd4d-z54kx |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.34:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-1bf2c-predictor-56bc8b9cd9-48jqx |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.35:8643/healthz": dial tcp 10.134.0.35:8643: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-1bf2c-predictor-6c64b6bb44-scdj5 |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.36:8643/healthz": dial tcp 10.134.0.36:8643: connect: connection refused | |
| (x6) | kserve-ci-e2e-test |
kubelet |
sequence-graph-c3262-557db7f5b8-g279b |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x6) | kserve-ci-e2e-test |
kubelet |
splitter-graph-1bf2c-997f87564-8nkrj |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-43223-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-43223-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-43223-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-43223-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-4f643-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-4f643-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-4f643-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-4f643-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-43223-predictor-5968f7b98d-s44nj |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.38:8080: connect: connection refused |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-43223-predictor-85967567b9-fkcgw |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.37:8080: connect: connection refused |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-4f643 |
InferenceServiceReady |
InferenceService [error-404-isvc-4f643] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-4f643 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-43223 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-4f643 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-43223 |
InferenceServiceReady |
InferenceService [error-404-isvc-43223] is Ready | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-4f643 |
InferenceServiceReady |
InferenceService [success-200-isvc-4f643] is Ready | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-43223 |
InferenceServiceReady |
InferenceService [success-200-isvc-43223] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-43223 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-43223-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-43223-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
deployment-controller |
splitter-graph-4f643 |
ScalingReplicaSet |
Scaled up replica set splitter-graph-4f643-59d4664c7d from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
splitter-graph-4f643-59d4664c7d |
SuccessfulCreate |
Created pod: splitter-graph-4f643-59d4664c7d-tk7t6 | |
kserve-ci-e2e-test |
InferenceGraphController |
splitter-graph-4f643 |
InferenceGraphReady |
InferenceGraph [splitter-graph-4f643] is Ready | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-4f643-59d4664c7d-tk7t6 |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "splitter-graph-4f643-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-4f643-59d4664c7d-tk7t6 |
Created |
Created container: splitter-graph-4f643 | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-4f643-59d4664c7d-tk7t6 |
Started |
Started container splitter-graph-4f643 | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-4f643-59d4664c7d-tk7t6 |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:a589cb7fd67a31c767ba2472b47f816cadffddbd6c2e2c8ddfd876f9a79d8448" already present on machine | |
kserve-ci-e2e-test |
multus |
splitter-graph-4f643-59d4664c7d-tk7t6 |
AddedInterface |
Add eth0 [10.133.0.40/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
replicaset-controller |
switch-graph-43223-7d58669c44 |
SuccessfulCreate |
Created pod: switch-graph-43223-7d58669c44-z74rq | |
kserve-ci-e2e-test |
kubelet |
switch-graph-43223-7d58669c44-z74rq |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "switch-graph-43223-serving-cert" not found | |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-43223 |
InferenceGraphReady |
InferenceGraph [switch-graph-43223] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
switch-graph-43223 |
ScalingReplicaSet |
Scaled up replica set switch-graph-43223-7d58669c44 from 0 to 1 | |
kserve-ci-e2e-test |
multus |
switch-graph-43223-7d58669c44-z74rq |
AddedInterface |
Add eth0 [10.133.0.41/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
switch-graph-43223-7d58669c44-z74rq |
Started |
Started container switch-graph-43223 | |
kserve-ci-e2e-test |
kubelet |
switch-graph-43223-7d58669c44-z74rq |
Created |
Created container: switch-graph-43223 | |
kserve-ci-e2e-test |
kubelet |
switch-graph-43223-7d58669c44-z74rq |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:a589cb7fd67a31c767ba2472b47f816cadffddbd6c2e2c8ddfd876f9a79d8448" already present on machine | |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-43223-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-43223-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-4f643-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-4f643-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-4f643-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-4f643-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-43223 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-43223 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
splitter-graph-4f643 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
splitter-graph-4f643 |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-43223 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-43223 |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-4f643-59d4664c7d-tk7t6 |
Killing |
Stopping container splitter-graph-4f643 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-4f643-predictor-7879dc7bcd-279lm |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-4f643-predictor-7879dc7bcd-279lm |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-4f643-predictor-785bf555c9-xsk4z |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-4f643-predictor-785bf555c9-xsk4z |
Killing |
Stopping container kserve-container | |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-4f643-predictor-785bf555c9-xsk4z |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.39:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-4f643-predictor-785bf555c9-xsk4z |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.39:8643/healthz": dial tcp 10.134.0.39:8643: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-4f643-predictor-7879dc7bcd-279lm |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.40:8643/healthz": dial tcp 10.134.0.40:8643: connect: connection refused | |
| (x7) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-4f643-predictor-7879dc7bcd-279lm |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.40:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
splitter-graph-4f643-59d4664c7d-tk7t6 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-43223-predictor-85967567b9-fkcgw |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-43223-predictor-85967567b9-fkcgw |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
switch-graph-43223-7d58669c44-z74rq |
Killing |
Stopping container switch-graph-43223 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-43223-predictor-5968f7b98d-s44nj |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-43223-predictor-5968f7b98d-s44nj |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-43223-predictor-85967567b9-fkcgw |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.37:8643/healthz": dial tcp 10.134.0.37:8643: connect: connection refused | |
| (x5) | kserve-ci-e2e-test |
kubelet |
switch-graph-43223-7d58669c44-z74rq |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |