| Time | Namespace | Component | RelatedObject | Reason | Message |
|---|---|---|---|---|---|
kserve-ci-e2e-test |
splitter-graph-61561-79f8d69754-l7866 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/splitter-graph-61561-79f8d69754-l7866 to ip-10-0-128-201.ec2.internal | ||
kserve-ci-e2e-test |
isvc-xgboost-graph-predictor-555fc69d56-km4vt |
Scheduled |
Successfully assigned kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-km4vt to ip-10-0-135-121.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-61561-predictor-545d79d4f6-h8m88 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-61561-predictor-545d79d4f6-h8m88 to ip-10-0-138-50.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-d13b2-predictor-86c6db6b55-mf54z |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-d13b2-predictor-86c6db6b55-mf54z to ip-10-0-135-121.ec2.internal | ||
kserve-ci-e2e-test |
model-chainer-b84f4c8c7-h2txg |
Scheduled |
Successfully assigned kserve-ci-e2e-test/model-chainer-b84f4c8c7-h2txg to ip-10-0-128-201.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-d355e-predictor-c7c6d9d4c-s9x8n |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-d355e-predictor-c7c6d9d4c-s9x8n to ip-10-0-135-121.ec2.internal | ||
kserve-ci-e2e-test |
isvc-sklearn-graph-2-predictor-7d44765f95-bggx2 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-7d44765f95-bggx2 to ip-10-0-135-121.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-cb683-predictor-84d5bf79d6-bz4dc |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-cb683-predictor-84d5bf79d6-bz4dc to ip-10-0-138-50.ec2.internal | ||
kserve-ci-e2e-test |
ensemble-graph-cb683-6bd9cdd588-hncbs |
Scheduled |
Successfully assigned kserve-ci-e2e-test/ensemble-graph-cb683-6bd9cdd588-hncbs to ip-10-0-128-201.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-cb683-predictor-5944ff6487-6sbjs |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-cb683-predictor-5944ff6487-6sbjs to ip-10-0-135-121.ec2.internal | ||
kserve-ci-e2e-test |
ensemble-graph-e26c5-5545679b85-cl99w |
Scheduled |
Successfully assigned kserve-ci-e2e-test/ensemble-graph-e26c5-5545679b85-cl99w to ip-10-0-138-50.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-beb6a-predictor-d9b4c445f-kbknm |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-beb6a-predictor-d9b4c445f-kbknm to ip-10-0-135-121.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-b2e96-predictor-c4576f9f9-9xl48 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-b2e96-predictor-c4576f9f9-9xl48 to ip-10-0-135-121.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-0f5d7-predictor-655fb59d6-xv9mq |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-0f5d7-predictor-655fb59d6-xv9mq to ip-10-0-138-50.ec2.internal | ||
kserve-ci-e2e-test |
sequence-graph-0a095-6b6b78bdf9-crcwm |
Scheduled |
Successfully assigned kserve-ci-e2e-test/sequence-graph-0a095-6b6b78bdf9-crcwm to ip-10-0-128-201.ec2.internal | ||
kserve-ci-e2e-test |
switch-graph-d355e-8455db45bc-6rwmn |
Scheduled |
Successfully assigned kserve-ci-e2e-test/switch-graph-d355e-8455db45bc-6rwmn to ip-10-0-128-201.ec2.internal | ||
kserve-ci-e2e-test |
switch-graph-beb6a-78db6d8859-vxrps |
Scheduled |
Successfully assigned kserve-ci-e2e-test/switch-graph-beb6a-78db6d8859-vxrps to ip-10-0-138-50.ec2.internal | ||
kserve-ci-e2e-test |
sequence-graph-0f5d7-785897b877-f6lpp |
Scheduled |
Successfully assigned kserve-ci-e2e-test/sequence-graph-0f5d7-785897b877-f6lpp to ip-10-0-128-201.ec2.internal | ||
kserve-ci-e2e-test |
sequence-graph-d13b2-8dc58d59b-hjbgw |
Scheduled |
Successfully assigned kserve-ci-e2e-test/sequence-graph-d13b2-8dc58d59b-hjbgw to ip-10-0-128-201.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-d13b2-predictor-557774b68b-xp7n6 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-d13b2-predictor-557774b68b-xp7n6 to ip-10-0-138-50.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-beb6a-predictor-7c99f78746-rr2sm |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-beb6a-predictor-7c99f78746-rr2sm to ip-10-0-138-50.ec2.internal | ||
kserve-ci-e2e-test |
isvc-sklearn-graph-1-predictor-6d55f5d589-gv224 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6d55f5d589-gv224 to ip-10-0-135-121.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-070ff-predictor-59657fff56-glz8v |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-070ff-predictor-59657fff56-glz8v to ip-10-0-138-50.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-e26c5-predictor-7897bcc8dd-zplm7 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-e26c5-predictor-7897bcc8dd-zplm7 to ip-10-0-138-50.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-61561-predictor-6959dd4cf7-jjqv6 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-61561-predictor-6959dd4cf7-jjqv6 to ip-10-0-135-121.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-0f5d7-predictor-69c54f994c-99rb7 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-0f5d7-predictor-69c54f994c-99rb7 to ip-10-0-135-121.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-0a095-predictor-7c5d79bf89-bfbs5 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-0a095-predictor-7c5d79bf89-bfbs5 to ip-10-0-135-121.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-e26c5-predictor-d5cd578f-9wk7v |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-e26c5-predictor-d5cd578f-9wk7v to ip-10-0-135-121.ec2.internal | ||
kserve-ci-e2e-test |
switch-graph-070ff-5949b59c9c-h4596 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/switch-graph-070ff-5949b59c9c-h4596 to ip-10-0-138-50.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-b2e96-predictor-7557b79bc4-bfcbn |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-b2e96-predictor-7557b79bc4-bfcbn to ip-10-0-138-50.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-0a095-predictor-745d9f4d88-hw9ff |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-0a095-predictor-745d9f4d88-hw9ff to ip-10-0-138-50.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-070ff-predictor-6488bc79fc-4ksmq |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-070ff-predictor-6488bc79fc-4ksmq to ip-10-0-135-121.ec2.internal | ||
kserve-ci-e2e-test |
splitter-graph-b2e96-c4cf9c888-47dlv |
Scheduled |
Successfully assigned kserve-ci-e2e-test/splitter-graph-b2e96-c4cf9c888-47dlv to ip-10-0-128-201.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-d355e-predictor-77499898bb-cghz4 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-d355e-predictor-77499898bb-cghz4 to ip-10-0-138-50.ec2.internal | ||
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-6d55f5d589-gv224 |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:6826da04857ec2521ff8d4edc21f858400a7c6db310668e01c2830086507d99d" already present on machine | |
kserve-ci-e2e-test |
replicaset-controller |
isvc-xgboost-graph-predictor-555fc69d56 |
SuccessfulCreate |
Created pod: isvc-xgboost-graph-predictor-555fc69d56-km4vt | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-070ff-predictor-59657fff56 |
SuccessfulCreate |
Created pod: error-404-isvc-070ff-predictor-59657fff56-glz8v | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-070ff-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-070ff-predictor-59657fff56 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-6d55f5d589-gv224 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
multus |
isvc-sklearn-graph-1-predictor-6d55f5d589-gv224 |
AddedInterface |
Add eth0 [10.134.0.24/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-6d55f5d589-gv224 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
replicaset-controller |
isvc-sklearn-graph-1-predictor-6d55f5d589 |
SuccessfulCreate |
Created pod: isvc-sklearn-graph-1-predictor-6d55f5d589-gv224 | |
kserve-ci-e2e-test |
deployment-controller |
isvc-sklearn-graph-1-predictor |
ScalingReplicaSet |
Scaled up replica set isvc-sklearn-graph-1-predictor-6d55f5d589 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-km4vt |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "isvc-xgboost-graph-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
deployment-controller |
isvc-xgboost-graph-predictor |
ScalingReplicaSet |
Scaled up replica set isvc-xgboost-graph-predictor-555fc69d56 from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-070ff-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-070ff-predictor-6488bc79fc from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
isvc-sklearn-graph-2-predictor |
ScalingReplicaSet |
Scaled up replica set isvc-sklearn-graph-2-predictor-7d44765f95 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-070ff-predictor-6488bc79fc |
SuccessfulCreate |
Created pod: success-200-isvc-070ff-predictor-6488bc79fc-4ksmq | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-7d44765f95-bggx2 |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "isvc-sklearn-graph-2-predictor-serving-cert" not found | |
| (x2) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-070ff-predictor-6488bc79fc-4ksmq |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "success-200-isvc-070ff-predictor-serving-cert" not found |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-km4vt |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
replicaset-controller |
isvc-sklearn-graph-2-predictor-7d44765f95 |
SuccessfulCreate |
Created pod: isvc-sklearn-graph-2-predictor-7d44765f95-bggx2 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-070ff-predictor-59657fff56-glz8v |
Pulling |
Pulling image "quay.io/opendatahub/error-404-isvc:odh-pr-1814" | |
kserve-ci-e2e-test |
multus |
isvc-xgboost-graph-predictor-555fc69d56-km4vt |
AddedInterface |
Add eth0 [10.134.0.26/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-km4vt |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:6826da04857ec2521ff8d4edc21f858400a7c6db310668e01c2830086507d99d" already present on machine | |
kserve-ci-e2e-test |
multus |
error-404-isvc-070ff-predictor-59657fff56-glz8v |
AddedInterface |
Add eth0 [10.133.0.16/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-km4vt |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
multus |
success-200-isvc-070ff-predictor-6488bc79fc-4ksmq |
AddedInterface |
Add eth0 [10.134.0.25/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-7d44765f95-bggx2 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-070ff-predictor-6488bc79fc-4ksmq |
Pulling |
Pulling image "quay.io/opendatahub/success-200-isvc:odh-pr-1814" | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-7d44765f95-bggx2 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
multus |
isvc-sklearn-graph-2-predictor-7d44765f95-bggx2 |
AddedInterface |
Add eth0 [10.134.0.27/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-7d44765f95-bggx2 |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:6826da04857ec2521ff8d4edc21f858400a7c6db310668e01c2830086507d99d" already present on machine | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-6d55f5d589-gv224 |
Pulling |
Pulling image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1814" | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-km4vt |
Pulling |
Pulling image "kserve/xgbserver:latest" | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-7d44765f95-bggx2 |
Pulling |
Pulling image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1814" | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-070ff-predictor-59657fff56-glz8v |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-070ff-predictor-59657fff56-glz8v |
Pulled |
Successfully pulled image "quay.io/opendatahub/error-404-isvc:odh-pr-1814" in 11.899s (11.899s including waiting). Image size: 1333940844 bytes. | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-070ff-predictor-59657fff56-glz8v |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-070ff-predictor-59657fff56-glz8v |
Pulling |
Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-070ff-predictor-59657fff56-glz8v |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-070ff-predictor-59657fff56-glz8v |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-070ff-predictor-59657fff56-glz8v |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" in 2.24s (2.24s including waiting). Image size: 211946088 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-7d44765f95-bggx2 |
Pulled |
Successfully pulled image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1814" in 11.886s (11.886s including waiting). Image size: 1555729331 bytes. | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-070ff-predictor-6488bc79fc-4ksmq |
Pulled |
Successfully pulled image "quay.io/opendatahub/success-200-isvc:odh-pr-1814" in 17.08s (17.08s including waiting). Image size: 1334928497 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-6d55f5d589-gv224 |
Pulled |
Successfully pulled image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1814" in 13.905s (13.905s including waiting). Image size: 1555729331 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-7d44765f95-bggx2 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-6d55f5d589-gv224 |
Pulling |
Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-6d55f5d589-gv224 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-070ff-predictor-6488bc79fc-4ksmq |
Pulling |
Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-070ff-predictor-6488bc79fc-4ksmq |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-070ff-predictor-6488bc79fc-4ksmq |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-6d55f5d589-gv224 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-7d44765f95-bggx2 |
Pulling |
Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-7d44765f95-bggx2 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-7d44765f95-bggx2 |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-7d44765f95-bggx2 |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" in 3.326s (3.326s including waiting). Image size: 211946088 bytes. | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-070ff-predictor-6488bc79fc-4ksmq |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-070ff-predictor-6488bc79fc-4ksmq |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" in 3.48s (3.48s including waiting). Image size: 211946088 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-6d55f5d589-gv224 |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" in 3.348s (3.348s including waiting). Image size: 211946088 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-6d55f5d589-gv224 |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-6d55f5d589-gv224 |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-070ff-predictor-6488bc79fc-4ksmq |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-7d44765f95-bggx2 |
Created |
Created container: kube-rbac-proxy | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-km4vt |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-km4vt |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-km4vt |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-km4vt |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-km4vt |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-km4vt |
Pulled |
Successfully pulled image "kserve/xgbserver:latest" in 32.935s (32.935s including waiting). Image size: 1307355896 bytes. | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-070ff-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-070ff-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-070ff-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-070ff-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-070ff |
InferenceServiceReady |
InferenceService [error-404-isvc-070ff] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-070ff |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-070ff |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-070ff |
InferenceServiceReady |
InferenceService [success-200-isvc-070ff] is Ready | |
| (x9) | kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-6d55f5d589-gv224 |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.24:8080: connect: connection refused |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-070ff-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-070ff-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-1 |
InferenceServiceReady |
InferenceService [isvc-sklearn-graph-1] is Ready | |
| (x9) | kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-1 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-070ff |
InferenceGraphReady |
InferenceGraph [switch-graph-070ff] is Ready | |
kserve-ci-e2e-test |
replicaset-controller |
switch-graph-070ff-5949b59c9c |
SuccessfulCreate |
Created pod: switch-graph-070ff-5949b59c9c-h4596 | |
kserve-ci-e2e-test |
kubelet |
switch-graph-070ff-5949b59c9c-h4596 |
Pulling |
Pulling image "quay.io/opendatahub/kserve-router@sha256:3f8b4d8bbc07de8aec3f29b089d69c216cddd2ca68e10f109f830f4b0fdd9ee1" | |
kserve-ci-e2e-test |
deployment-controller |
switch-graph-070ff |
ScalingReplicaSet |
Scaled up replica set switch-graph-070ff-5949b59c9c from 0 to 1 | |
kserve-ci-e2e-test |
multus |
switch-graph-070ff-5949b59c9c-h4596 |
AddedInterface |
Add eth0 [10.133.0.17/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
switch-graph-070ff-5949b59c9c-h4596 |
Pulled |
Successfully pulled image "quay.io/opendatahub/kserve-router@sha256:3f8b4d8bbc07de8aec3f29b089d69c216cddd2ca68e10f109f830f4b0fdd9ee1" in 2.512s (2.512s including waiting). Image size: 218232445 bytes. | |
kserve-ci-e2e-test |
kubelet |
switch-graph-070ff-5949b59c9c-h4596 |
Created |
Created container: switch-graph-070ff | |
kserve-ci-e2e-test |
kubelet |
switch-graph-070ff-5949b59c9c-h4596 |
Started |
Started container switch-graph-070ff | |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-070ff-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-070ff-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x9) | kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-km4vt |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.26:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-d355e-predictor-c7c6d9d4c-s9x8n |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "success-200-isvc-d355e-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-d355e-predictor-77499898bb-cghz4 |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "error-404-isvc-d355e-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
switch-graph-070ff-5949b59c9c-h4596 |
Killing |
Stopping container switch-graph-070ff | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-d355e |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-d355e": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-d355e": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-d355e |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-d355e": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-d355e-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-d355e-predictor-c7c6d9d4c from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-d355e-predictor-c7c6d9d4c |
SuccessfulCreate |
Created pod: success-200-isvc-d355e-predictor-c7c6d9d4c-s9x8n | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-070ff-predictor-59657fff56-glz8v |
Killing |
Stopping container kserve-container | |
| (x10) | kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-2 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-d355e |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-d355e": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-070ff-predictor-6488bc79fc-4ksmq |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-070ff-predictor-6488bc79fc-4ksmq |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.25:8643/healthz": dial tcp 10.134.0.25:8643: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-070ff-predictor-59657fff56-glz8v |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-d355e-predictor-77499898bb |
SuccessfulCreate |
Created pod: error-404-isvc-d355e-predictor-77499898bb-cghz4 | |
kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-2 |
InferenceServiceReady |
InferenceService [isvc-sklearn-graph-2] is Ready | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-070ff-predictor-6488bc79fc-4ksmq |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-d355e-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-d355e-predictor-77499898bb from 0 to 1 | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-d355e |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-d355e": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-d355e": the object has been modified; please apply your changes to the latest version and try again | |
| (x8) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-070ff-predictor-6488bc79fc-4ksmq |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.25:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-d355e-predictor-77499898bb-cghz4 |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-d355e-predictor-c7c6d9d4c-s9x8n |
Started |
Started container kserve-container | |
| (x7) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-070ff-predictor-59657fff56-glz8v |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.16:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-070ff-predictor-59657fff56-glz8v |
Unhealthy |
Readiness probe failed: Get "https://10.133.0.16:8643/healthz": dial tcp 10.133.0.16:8643: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-d355e-predictor-77499898bb-cghz4 |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1814" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-d355e-predictor-c7c6d9d4c-s9x8n |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-d355e-predictor-77499898bb-cghz4 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-d355e-predictor-c7c6d9d4c-s9x8n |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-d355e-predictor-c7c6d9d4c-s9x8n |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
multus |
error-404-isvc-d355e-predictor-77499898bb-cghz4 |
AddedInterface |
Add eth0 [10.133.0.18/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-d355e-predictor-c7c6d9d4c-s9x8n |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-d355e-predictor-c7c6d9d4c-s9x8n |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1814" already present on machine | |
kserve-ci-e2e-test |
multus |
success-200-isvc-d355e-predictor-c7c6d9d4c-s9x8n |
AddedInterface |
Add eth0 [10.134.0.28/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-d355e-predictor-77499898bb-cghz4 |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-d355e-predictor-77499898bb-cghz4 |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-d355e-predictor-77499898bb-cghz4 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
isvc-xgboost-graph |
InferenceServiceReady |
InferenceService [isvc-xgboost-graph] is Ready | |
| (x10) | kserve-ci-e2e-test |
v1beta1Controllers |
isvc-xgboost-graph |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-d355e-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-d355e-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
kubelet |
model-chainer-b84f4c8c7-h2txg |
Pulling |
Pulling image "quay.io/opendatahub/kserve-router@sha256:3f8b4d8bbc07de8aec3f29b089d69c216cddd2ca68e10f109f830f4b0fdd9ee1" | |
kserve-ci-e2e-test |
replicaset-controller |
model-chainer-b84f4c8c7 |
SuccessfulCreate |
Created pod: model-chainer-b84f4c8c7-h2txg | |
kserve-ci-e2e-test |
multus |
model-chainer-b84f4c8c7-h2txg |
AddedInterface |
Add eth0 [10.132.0.35/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
InferenceGraphController |
model-chainer |
InferenceGraphReady |
InferenceGraph [model-chainer] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
model-chainer |
ScalingReplicaSet |
Scaled up replica set model-chainer-b84f4c8c7 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
model-chainer-b84f4c8c7-h2txg |
Started |
Started container model-chainer | |
kserve-ci-e2e-test |
kubelet |
model-chainer-b84f4c8c7-h2txg |
Pulled |
Successfully pulled image "quay.io/opendatahub/kserve-router@sha256:3f8b4d8bbc07de8aec3f29b089d69c216cddd2ca68e10f109f830f4b0fdd9ee1" in 1.916s (1.916s including waiting). Image size: 218232445 bytes. | |
kserve-ci-e2e-test |
kubelet |
model-chainer-b84f4c8c7-h2txg |
Created |
Created container: model-chainer | |
| (x6) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x7) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x7) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x6) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-6d55f5d589-gv224 |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-6d55f5d589-gv224 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-d13b2-predictor-86c6db6b55 |
SuccessfulCreate |
Created pod: success-200-isvc-d13b2-predictor-86c6db6b55-mf54z | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-d13b2-predictor-557774b68b |
SuccessfulCreate |
Created pod: error-404-isvc-d13b2-predictor-557774b68b-xp7n6 | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-d13b2-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-d13b2-predictor-557774b68b from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-d13b2-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-d13b2-predictor-86c6db6b55 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-7d44765f95-bggx2 |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-d13b2-predictor-557774b68b-xp7n6 |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "error-404-isvc-d13b2-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-km4vt |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
multus |
success-200-isvc-d13b2-predictor-86c6db6b55-mf54z |
AddedInterface |
Add eth0 [10.134.0.29/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-7d44765f95-bggx2 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-d13b2-predictor-86c6db6b55-mf54z |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1814" already present on machine | |
| (x6) | kserve-ci-e2e-test |
kubelet |
switch-graph-070ff-5949b59c9c-h4596 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-km4vt |
Killing |
Stopping container kserve-container | |
| (x12) | kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-7d44765f95-bggx2 |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.27:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
model-chainer-b84f4c8c7-h2txg |
Killing |
Stopping container model-chainer | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-d13b2-predictor-557774b68b-xp7n6 |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
multus |
error-404-isvc-d13b2-predictor-557774b68b-xp7n6 |
AddedInterface |
Add eth0 [10.133.0.19/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-d13b2-predictor-86c6db6b55-mf54z |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-d13b2-predictor-86c6db6b55-mf54z |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-d13b2-predictor-557774b68b-xp7n6 |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-d13b2-predictor-86c6db6b55-mf54z |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-d13b2-predictor-86c6db6b55-mf54z |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-km4vt |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.26:8643/healthz": dial tcp 10.134.0.26:8643: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-d13b2-predictor-86c6db6b55-mf54z |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-d13b2-predictor-557774b68b-xp7n6 |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-d13b2-predictor-557774b68b-xp7n6 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-d13b2-predictor-557774b68b-xp7n6 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-d13b2-predictor-557774b68b-xp7n6 |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1814" already present on machine | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-6d55f5d589-gv224 |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.24:8643/healthz": dial tcp 10.134.0.24:8643: connect: connection refused | |
| (x2) | kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-7d44765f95-bggx2 |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.27:8643/healthz": dial tcp 10.134.0.27:8643: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-d355e-predictor-c7c6d9d4c-s9x8n |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.28:8080: connect: connection refused |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-d355e-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-d355e-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-d355e |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-d355e |
InferenceServiceReady |
InferenceService [error-404-isvc-d355e] is Ready | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-d355e |
InferenceServiceReady |
InferenceService [success-200-isvc-d355e] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-d355e |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x6) | kserve-ci-e2e-test |
kubelet |
model-chainer-b84f4c8c7-h2txg |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
deployment-controller |
switch-graph-d355e |
ScalingReplicaSet |
Scaled up replica set switch-graph-d355e-8455db45bc from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
switch-graph-d355e-8455db45bc |
SuccessfulCreate |
Created pod: switch-graph-d355e-8455db45bc-6rwmn | |
kserve-ci-e2e-test |
kubelet |
switch-graph-d355e-8455db45bc-6rwmn |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "switch-graph-d355e-serving-cert" not found | |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-d355e |
InferenceGraphReady |
InferenceGraph [switch-graph-d355e] is Ready | |
kserve-ci-e2e-test |
kubelet |
switch-graph-d355e-8455db45bc-6rwmn |
Created |
Created container: switch-graph-d355e | |
kserve-ci-e2e-test |
kubelet |
switch-graph-d355e-8455db45bc-6rwmn |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:3f8b4d8bbc07de8aec3f29b089d69c216cddd2ca68e10f109f830f4b0fdd9ee1" already present on machine | |
kserve-ci-e2e-test |
kubelet |
switch-graph-d355e-8455db45bc-6rwmn |
Started |
Started container switch-graph-d355e | |
kserve-ci-e2e-test |
multus |
switch-graph-d355e-8455db45bc-6rwmn |
AddedInterface |
Add eth0 [10.132.0.36/23] from ovn-kubernetes | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-d13b2-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-d355e-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-d13b2-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-d355e-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-d355e |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-d355e |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-d13b2 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-d13b2 |
InferenceServiceReady |
InferenceService [success-200-isvc-d13b2] is Ready | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-d13b2 |
InferenceServiceReady |
InferenceService [error-404-isvc-d13b2] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-d13b2 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
deployment-controller |
sequence-graph-d13b2 |
ScalingReplicaSet |
Scaled up replica set sequence-graph-d13b2-8dc58d59b from 0 to 1 | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-d355e |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-d355e |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-d13b2-8dc58d59b-hjbgw |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "sequence-graph-d13b2-serving-cert" not found | |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-d13b2-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-d13b2-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-d355e-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-d355e-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-d13b2 |
InferenceGraphReady |
InferenceGraph [sequence-graph-d13b2] is Ready | |
kserve-ci-e2e-test |
replicaset-controller |
sequence-graph-d13b2-8dc58d59b |
SuccessfulCreate |
Created pod: sequence-graph-d13b2-8dc58d59b-hjbgw | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-d13b2-8dc58d59b-hjbgw |
Created |
Created container: sequence-graph-d13b2 | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-d13b2-8dc58d59b-hjbgw |
Started |
Started container sequence-graph-d13b2 | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-d13b2-8dc58d59b-hjbgw |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:3f8b4d8bbc07de8aec3f29b089d69c216cddd2ca68e10f109f830f4b0fdd9ee1" already present on machine | |
kserve-ci-e2e-test |
multus |
sequence-graph-d13b2-8dc58d59b-hjbgw |
AddedInterface |
Add eth0 [10.132.0.37/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-d13b2-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-d13b2-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-d13b2 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-d13b2 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-d13b2 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-d13b2 |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-d13b2-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-d13b2-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
kubelet |
switch-graph-d355e-8455db45bc-6rwmn |
Killing |
Stopping container switch-graph-d355e | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-cb683-predictor-84d5bf79d6 |
SuccessfulCreate |
Created pod: error-404-isvc-cb683-predictor-84d5bf79d6-bz4dc | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-cb683-predictor-5944ff6487 |
SuccessfulCreate |
Created pod: success-200-isvc-cb683-predictor-5944ff6487-6sbjs | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-d355e-predictor-77499898bb-cghz4 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-d355e-predictor-77499898bb-cghz4 |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-d355e-predictor-c7c6d9d4c-s9x8n |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-d355e-predictor-c7c6d9d4c-s9x8n |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-cb683-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-cb683-predictor-5944ff6487 from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-cb683-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-cb683-predictor-84d5bf79d6 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-cb683-predictor-84d5bf79d6-bz4dc |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-cb683-predictor-84d5bf79d6-bz4dc |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-cb683-predictor-84d5bf79d6-bz4dc |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-cb683-predictor-84d5bf79d6-bz4dc |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-cb683-predictor-5944ff6487-6sbjs |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1814" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-cb683-predictor-5944ff6487-6sbjs |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-cb683-predictor-5944ff6487-6sbjs |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-cb683-predictor-5944ff6487-6sbjs |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-cb683-predictor-5944ff6487-6sbjs |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-cb683-predictor-84d5bf79d6-bz4dc |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-cb683-predictor-84d5bf79d6-bz4dc |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1814" already present on machine | |
kserve-ci-e2e-test |
multus |
error-404-isvc-cb683-predictor-84d5bf79d6-bz4dc |
AddedInterface |
Add eth0 [10.133.0.20/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-cb683-predictor-5944ff6487-6sbjs |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
multus |
success-200-isvc-cb683-predictor-5944ff6487-6sbjs |
AddedInterface |
Add eth0 [10.134.0.30/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-d355e-predictor-77499898bb-cghz4 |
Unhealthy |
Readiness probe failed: Get "https://10.133.0.18:8643/healthz": dial tcp 10.133.0.18:8643: connect: connection refused | |
| (x7) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-d355e-predictor-77499898bb-cghz4 |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.18:8080: connect: connection refused |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-cb683-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-cb683-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x6) | kserve-ci-e2e-test |
kubelet |
switch-graph-d355e-8455db45bc-6rwmn |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-0a095 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-0a095": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-0a095": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-d13b2-predictor-557774b68b-xp7n6 |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-0a095-predictor-7c5d79bf89-bfbs5 |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "success-200-isvc-0a095-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-0a095-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-0a095-predictor-745d9f4d88 from 0 to 1 | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-0a095 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-0a095": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-0a095 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-0a095": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-d13b2-predictor-86c6db6b55-mf54z |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-0a095-predictor-745d9f4d88-hw9ff |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "error-404-isvc-0a095-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-d13b2-predictor-557774b68b-xp7n6 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-0a095-predictor-745d9f4d88 |
SuccessfulCreate |
Created pod: error-404-isvc-0a095-predictor-745d9f4d88-hw9ff | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-d13b2-predictor-86c6db6b55-mf54z |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-d13b2-8dc58d59b-hjbgw |
Killing |
Stopping container sequence-graph-d13b2 | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-0a095-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-0a095-predictor-7c5d79bf89 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-0a095-predictor-7c5d79bf89 |
SuccessfulCreate |
Created pod: success-200-isvc-0a095-predictor-7c5d79bf89-bfbs5 | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-0a095 |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-0a095": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-0a095": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-0a095-predictor-7c5d79bf89-bfbs5 |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1814" already present on machine | |
kserve-ci-e2e-test |
multus |
success-200-isvc-0a095-predictor-7c5d79bf89-bfbs5 |
AddedInterface |
Add eth0 [10.134.0.31/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-0a095-predictor-7c5d79bf89-bfbs5 |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-0a095-predictor-7c5d79bf89-bfbs5 |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-0a095-predictor-7c5d79bf89-bfbs5 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-0a095-predictor-7c5d79bf89-bfbs5 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-0a095-predictor-745d9f4d88-hw9ff |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-0a095-predictor-7c5d79bf89-bfbs5 |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
multus |
error-404-isvc-0a095-predictor-745d9f4d88-hw9ff |
AddedInterface |
Add eth0 [10.133.0.21/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-0a095-predictor-745d9f4d88-hw9ff |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1814" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-0a095-predictor-745d9f4d88-hw9ff |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-0a095-predictor-745d9f4d88-hw9ff |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-0a095-predictor-745d9f4d88-hw9ff |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-0a095-predictor-745d9f4d88-hw9ff |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-d13b2-predictor-86c6db6b55-mf54z |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.29:8643/healthz": dial tcp 10.134.0.29:8643: connect: connection refused | |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-d13b2-predictor-86c6db6b55-mf54z |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.29:8080: connect: connection refused |
| (x7) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-d13b2-predictor-557774b68b-xp7n6 |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.19:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-d13b2-predictor-557774b68b-xp7n6 |
Unhealthy |
Readiness probe failed: Get "https://10.133.0.19:8643/healthz": dial tcp 10.133.0.19:8643: connect: connection refused | |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-cb683-predictor-5944ff6487-6sbjs |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.30:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-cb683-predictor-84d5bf79d6-bz4dc |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.20:8080: connect: connection refused |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-cb683-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-cb683-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-cb683 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-cb683 |
InferenceServiceReady |
InferenceService [success-200-isvc-cb683] is Ready | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-cb683 |
InferenceServiceReady |
InferenceService [error-404-isvc-cb683] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-cb683 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x6) | kserve-ci-e2e-test |
kubelet |
sequence-graph-d13b2-8dc58d59b-hjbgw |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-0a095-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-cb683-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
replicaset-controller |
ensemble-graph-cb683-6bd9cdd588 |
SuccessfulCreate |
Created pod: ensemble-graph-cb683-6bd9cdd588-hncbs | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-0a095-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-cb683-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
deployment-controller |
ensemble-graph-cb683 |
ScalingReplicaSet |
Scaled up replica set ensemble-graph-cb683-6bd9cdd588 from 0 to 1 | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-cb683-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-0a095-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-0a095-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
InferenceGraphController |
ensemble-graph-cb683 |
InferenceGraphReady |
InferenceGraph [ensemble-graph-cb683] is Ready | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-cb683-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-cb683-6bd9cdd588-hncbs |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:3f8b4d8bbc07de8aec3f29b089d69c216cddd2ca68e10f109f830f4b0fdd9ee1" already present on machine | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-cb683-6bd9cdd588-hncbs |
Created |
Created container: ensemble-graph-cb683 | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-cb683-6bd9cdd588-hncbs |
Started |
Started container ensemble-graph-cb683 | |
kserve-ci-e2e-test |
multus |
ensemble-graph-cb683-6bd9cdd588-hncbs |
AddedInterface |
Add eth0 [10.132.0.38/23] from ovn-kubernetes | |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-0a095-predictor-7c5d79bf89-bfbs5 |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.31:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-0a095-predictor-745d9f4d88-hw9ff |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.21:8080: connect: connection refused |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-e26c5-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-e26c5-predictor-d5cd578f from 0 to 1 | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-e26c5 |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-e26c5": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-e26c5": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-cb683-predictor-5944ff6487-6sbjs |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-e26c5 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-e26c5": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-e26c5 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-e26c5": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-e26c5": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-e26c5-predictor-d5cd578f |
SuccessfulCreate |
Created pod: success-200-isvc-e26c5-predictor-d5cd578f-9wk7v | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-e26c5-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-e26c5-predictor-7897bcc8dd from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-cb683-predictor-5944ff6487-6sbjs |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-cb683-predictor-84d5bf79d6-bz4dc |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-e26c5-predictor-7897bcc8dd |
SuccessfulCreate |
Created pod: error-404-isvc-e26c5-predictor-7897bcc8dd-zplm7 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-cb683-predictor-84d5bf79d6-bz4dc |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-cb683-6bd9cdd588-hncbs |
Killing |
Stopping container ensemble-graph-cb683 | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-e26c5 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-e26c5": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-e26c5-predictor-d5cd578f-9wk7v |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1814" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-e26c5-predictor-d5cd578f-9wk7v |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-e26c5-predictor-d5cd578f-9wk7v |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-e26c5-predictor-7897bcc8dd-zplm7 |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "error-404-isvc-e26c5-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-e26c5-predictor-d5cd578f-9wk7v |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-e26c5-predictor-d5cd578f-9wk7v |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-e26c5-predictor-d5cd578f-9wk7v |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
multus |
success-200-isvc-e26c5-predictor-d5cd578f-9wk7v |
AddedInterface |
Add eth0 [10.134.0.32/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-e26c5-predictor-7897bcc8dd-zplm7 |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-e26c5-predictor-7897bcc8dd-zplm7 |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-e26c5-predictor-7897bcc8dd-zplm7 |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-e26c5-predictor-7897bcc8dd-zplm7 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-e26c5-predictor-7897bcc8dd-zplm7 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-e26c5-predictor-7897bcc8dd-zplm7 |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1814" already present on machine | |
kserve-ci-e2e-test |
multus |
error-404-isvc-e26c5-predictor-7897bcc8dd-zplm7 |
AddedInterface |
Add eth0 [10.133.0.22/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-cb683-predictor-5944ff6487-6sbjs |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.30:8643/healthz": dial tcp 10.134.0.30:8643: connect: connection refused | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-0a095 |
InferenceServiceReady |
InferenceService [success-200-isvc-0a095] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-0a095 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-0a095 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-0a095 |
InferenceServiceReady |
InferenceService [error-404-isvc-0a095] is Ready | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-0a095-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
deployment-controller |
sequence-graph-0a095 |
ScalingReplicaSet |
Scaled up replica set sequence-graph-0a095-6b6b78bdf9 from 0 to 1 | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-0a095-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-0a095 |
InferenceGraphReady |
InferenceGraph [sequence-graph-0a095] is Ready | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-0a095-6b6b78bdf9-crcwm |
Created |
Created container: sequence-graph-0a095 | |
kserve-ci-e2e-test |
replicaset-controller |
sequence-graph-0a095-6b6b78bdf9 |
SuccessfulCreate |
Created pod: sequence-graph-0a095-6b6b78bdf9-crcwm | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-0a095-6b6b78bdf9-crcwm |
Started |
Started container sequence-graph-0a095 | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-0a095-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-0a095-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
multus |
sequence-graph-0a095-6b6b78bdf9-crcwm |
AddedInterface |
Add eth0 [10.132.0.39/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-0a095-6b6b78bdf9-crcwm |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:3f8b4d8bbc07de8aec3f29b089d69c216cddd2ca68e10f109f830f4b0fdd9ee1" already present on machine | |
| (x6) | kserve-ci-e2e-test |
kubelet |
ensemble-graph-cb683-6bd9cdd588-hncbs |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-0a095-predictor-7c5d79bf89-bfbs5 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-0a095-predictor-745d9f4d88-hw9ff |
Killing |
Stopping container kserve-container | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-e26c5-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
sequence-graph-0a095-6b6b78bdf9-crcwm |
Killing |
Stopping container sequence-graph-0a095 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-0f5d7-predictor-69c54f994c-99rb7 |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "success-200-isvc-0f5d7-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-0a095-predictor-745d9f4d88-hw9ff |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-0f5d7-predictor-69c54f994c |
SuccessfulCreate |
Created pod: success-200-isvc-0f5d7-predictor-69c54f994c-99rb7 | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-e26c5-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-0f5d7 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-0f5d7": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-0f5d7": the object has been modified; please apply your changes to the latest version and try again | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-e26c5-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-0f5d7-predictor-655fb59d6 |
SuccessfulCreate |
Created pod: error-404-isvc-0f5d7-predictor-655fb59d6-xv9mq | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-0f5d7-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-0f5d7-predictor-655fb59d6 from 0 to 1 | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-e26c5-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-0f5d7-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-0f5d7-predictor-69c54f994c from 0 to 1 | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-0f5d7 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-0f5d7": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-0a095-predictor-7c5d79bf89-bfbs5 |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-0f5d7-predictor-655fb59d6-xv9mq |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-0f5d7-predictor-69c54f994c-99rb7 |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-0f5d7-predictor-655fb59d6-xv9mq |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-0f5d7-predictor-655fb59d6-xv9mq |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
multus |
success-200-isvc-0f5d7-predictor-69c54f994c-99rb7 |
AddedInterface |
Add eth0 [10.134.0.33/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-0f5d7-predictor-69c54f994c-99rb7 |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1814" already present on machine | |
kserve-ci-e2e-test |
multus |
error-404-isvc-0f5d7-predictor-655fb59d6-xv9mq |
AddedInterface |
Add eth0 [10.133.0.23/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-0f5d7-predictor-655fb59d6-xv9mq |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1814" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-0f5d7-predictor-655fb59d6-xv9mq |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-0f5d7-predictor-69c54f994c-99rb7 |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-0f5d7-predictor-69c54f994c-99rb7 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-0f5d7-predictor-655fb59d6-xv9mq |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-0f5d7-predictor-69c54f994c-99rb7 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-0f5d7-predictor-69c54f994c-99rb7 |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-0a095-predictor-7c5d79bf89-bfbs5 |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.31:8643/healthz": dial tcp 10.134.0.31:8643: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-0a095-predictor-745d9f4d88-hw9ff |
Unhealthy |
Readiness probe failed: Get "https://10.133.0.21:8643/healthz": dial tcp 10.133.0.21:8643: connect: connection refused | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-e26c5 |
InferenceServiceReady |
InferenceService [success-200-isvc-e26c5] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-e26c5 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-e26c5 |
InferenceServiceReady |
InferenceService [error-404-isvc-e26c5] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-e26c5 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x6) | kserve-ci-e2e-test |
kubelet |
sequence-graph-0a095-6b6b78bdf9-crcwm |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-0f5d7-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-0f5d7-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
replicaset-controller |
ensemble-graph-e26c5-5545679b85 |
SuccessfulCreate |
Created pod: ensemble-graph-e26c5-5545679b85-cl99w | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-0f5d7-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-0f5d7-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
InferenceGraphController |
ensemble-graph-e26c5 |
InferenceGraphReady |
InferenceGraph [ensemble-graph-e26c5] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
ensemble-graph-e26c5 |
ScalingReplicaSet |
Scaled up replica set ensemble-graph-e26c5-5545679b85 from 0 to 1 | |
kserve-ci-e2e-test |
multus |
ensemble-graph-e26c5-5545679b85-cl99w |
AddedInterface |
Add eth0 [10.133.0.24/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-e26c5-5545679b85-cl99w |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:3f8b4d8bbc07de8aec3f29b089d69c216cddd2ca68e10f109f830f4b0fdd9ee1" already present on machine | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-e26c5-5545679b85-cl99w |
Created |
Created container: ensemble-graph-e26c5 | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-e26c5-5545679b85-cl99w |
Started |
Started container ensemble-graph-e26c5 | |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-0f5d7-predictor-69c54f994c-99rb7 |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.33:8080: connect: connection refused |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-e26c5-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-e26c5-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-0f5d7 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-0f5d7 |
InferenceServiceReady |
InferenceService [success-200-isvc-0f5d7] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-0f5d7 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-0f5d7 |
InferenceServiceReady |
InferenceService [error-404-isvc-0f5d7] is Ready | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-e26c5-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
ensemble-graph-e26c5 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-0f5d7 |
InferenceGraphReady |
InferenceGraph [sequence-graph-0f5d7] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
sequence-graph-0f5d7 |
ScalingReplicaSet |
Scaled up replica set sequence-graph-0f5d7-785897b877 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
sequence-graph-0f5d7-785897b877 |
SuccessfulCreate |
Created pod: sequence-graph-0f5d7-785897b877-f6lpp | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-e26c5-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
ensemble-graph-e26c5 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
sequence-graph-0f5d7-785897b877-f6lpp |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "sequence-graph-0f5d7-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-0f5d7-785897b877-f6lpp |
Started |
Started container sequence-graph-0f5d7 | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-0f5d7-785897b877-f6lpp |
Created |
Created container: sequence-graph-0f5d7 | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-0f5d7-785897b877-f6lpp |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:3f8b4d8bbc07de8aec3f29b089d69c216cddd2ca68e10f109f830f4b0fdd9ee1" already present on machine | |
kserve-ci-e2e-test |
multus |
sequence-graph-0f5d7-785897b877-f6lpp |
AddedInterface |
Add eth0 [10.132.0.40/23] from ovn-kubernetes | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-0f5d7-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-0f5d7-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-0f5d7-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-0f5d7-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-0f5d7 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-0f5d7 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-61561-predictor-545d79d4f6 |
SuccessfulCreate |
Created pod: error-404-isvc-61561-predictor-545d79d4f6-h8m88 | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-61561 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-61561": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-61561-predictor-6959dd4cf7 |
SuccessfulCreate |
Created pod: success-200-isvc-61561-predictor-6959dd4cf7-jjqv6 | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-e26c5-5545679b85-cl99w |
Killing |
Stopping container ensemble-graph-e26c5 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-61561-predictor-6959dd4cf7-jjqv6 |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "success-200-isvc-61561-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-61561-predictor-545d79d4f6-h8m88 |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "error-404-isvc-61561-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-61561 |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-61561": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-61561": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-61561-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-61561-predictor-6959dd4cf7 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-e26c5-predictor-7897bcc8dd-zplm7 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-e26c5-predictor-7897bcc8dd-zplm7 |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-61561-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-61561-predictor-545d79d4f6 from 0 to 1 | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-61561 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-61561": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-61561": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-61561 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-61561": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-e26c5-predictor-d5cd578f-9wk7v |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-e26c5-predictor-d5cd578f-9wk7v |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-61561-predictor-6959dd4cf7-jjqv6 |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1814" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-61561-predictor-6959dd4cf7-jjqv6 |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-61561-predictor-6959dd4cf7-jjqv6 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
multus |
success-200-isvc-61561-predictor-6959dd4cf7-jjqv6 |
AddedInterface |
Add eth0 [10.134.0.34/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-61561-predictor-545d79d4f6-h8m88 |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-61561-predictor-545d79d4f6-h8m88 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-61561-predictor-545d79d4f6-h8m88 |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-61561-predictor-545d79d4f6-h8m88 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-61561-predictor-545d79d4f6-h8m88 |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1814" already present on machine | |
kserve-ci-e2e-test |
multus |
error-404-isvc-61561-predictor-545d79d4f6-h8m88 |
AddedInterface |
Add eth0 [10.133.0.25/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-61561-predictor-6959dd4cf7-jjqv6 |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-61561-predictor-6959dd4cf7-jjqv6 |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-61561-predictor-6959dd4cf7-jjqv6 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-61561-predictor-545d79d4f6-h8m88 |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-e26c5-predictor-d5cd578f-9wk7v |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.32:8643/healthz": dial tcp 10.134.0.32:8643: connect: connection refused | |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-e26c5-predictor-d5cd578f-9wk7v |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.32:8080: connect: connection refused |
| (x7) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-e26c5-predictor-7897bcc8dd-zplm7 |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.22:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-e26c5-predictor-7897bcc8dd-zplm7 |
Unhealthy |
Readiness probe failed: Get "https://10.133.0.22:8643/healthz": dial tcp 10.133.0.22:8643: connect: connection refused | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-61561-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-61561-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x6) | kserve-ci-e2e-test |
kubelet |
ensemble-graph-e26c5-5545679b85-cl99w |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-0f5d7-predictor-69c54f994c-99rb7 |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-0f5d7-predictor-69c54f994c-99rb7 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-beb6a-predictor-7c99f78746 |
SuccessfulCreate |
Created pod: error-404-isvc-beb6a-predictor-7c99f78746-rr2sm | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-beb6a-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-beb6a-predictor-7c99f78746 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-0f5d7-785897b877-f6lpp |
Killing |
Stopping container sequence-graph-0f5d7 | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-beb6a-predictor-d9b4c445f |
SuccessfulCreate |
Created pod: success-200-isvc-beb6a-predictor-d9b4c445f-kbknm | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-beb6a-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-beb6a-predictor-d9b4c445f from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-0f5d7-predictor-655fb59d6-xv9mq |
Killing |
Stopping container kube-rbac-proxy | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-61561-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-61561-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-0f5d7-predictor-655fb59d6-xv9mq |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-beb6a |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-beb6a": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-beb6a": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-beb6a |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-beb6a": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-beb6a": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-beb6a |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-beb6a": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-beb6a |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-beb6a": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-beb6a-predictor-7c99f78746-rr2sm |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-beb6a-predictor-7c99f78746-rr2sm |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-beb6a-predictor-7c99f78746-rr2sm |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1814" already present on machine | |
kserve-ci-e2e-test |
multus |
error-404-isvc-beb6a-predictor-7c99f78746-rr2sm |
AddedInterface |
Add eth0 [10.133.0.26/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-beb6a-predictor-7c99f78746-rr2sm |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-beb6a-predictor-7c99f78746-rr2sm |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-beb6a-predictor-7c99f78746-rr2sm |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
| (x2) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-beb6a-predictor-d9b4c445f-kbknm |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "success-200-isvc-beb6a-predictor-serving-cert" not found |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-beb6a-predictor-d9b4c445f-kbknm |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-beb6a-predictor-d9b4c445f-kbknm |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
multus |
success-200-isvc-beb6a-predictor-d9b4c445f-kbknm |
AddedInterface |
Add eth0 [10.134.0.35/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-beb6a-predictor-d9b4c445f-kbknm |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1814" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-beb6a-predictor-d9b4c445f-kbknm |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-beb6a-predictor-d9b4c445f-kbknm |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-beb6a-predictor-d9b4c445f-kbknm |
Created |
Created container: kserve-container | |
| (x7) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-0f5d7-predictor-655fb59d6-xv9mq |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.23:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-0f5d7-predictor-655fb59d6-xv9mq |
Unhealthy |
Readiness probe failed: Get "https://10.133.0.23:8643/healthz": dial tcp 10.133.0.23:8643: connect: connection refused | |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-61561-predictor-545d79d4f6-h8m88 |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.25:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-61561-predictor-6959dd4cf7-jjqv6 |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.34:8080: connect: connection refused |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-61561 |
InferenceServiceReady |
InferenceService [error-404-isvc-61561] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-61561 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-61561 |
InferenceServiceReady |
InferenceService [success-200-isvc-61561] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-61561 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x6) | kserve-ci-e2e-test |
kubelet |
sequence-graph-0f5d7-785897b877-f6lpp |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-61561-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-beb6a-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-beb6a-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
InferenceGraphController |
splitter-graph-61561 |
InferenceGraphReady |
InferenceGraph [splitter-graph-61561] is Ready | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-61561-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-61561-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
deployment-controller |
splitter-graph-61561 |
ScalingReplicaSet |
Scaled up replica set splitter-graph-61561-79f8d69754 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
splitter-graph-61561-79f8d69754 |
SuccessfulCreate |
Created pod: splitter-graph-61561-79f8d69754-l7866 | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-beb6a-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-61561-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-beb6a-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
multus |
splitter-graph-61561-79f8d69754-l7866 |
AddedInterface |
Add eth0 [10.132.0.41/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-61561-79f8d69754-l7866 |
Created |
Created container: splitter-graph-61561 | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-61561-79f8d69754-l7866 |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:3f8b4d8bbc07de8aec3f29b089d69c216cddd2ca68e10f109f830f4b0fdd9ee1" already present on machine | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-61561-79f8d69754-l7866 |
Started |
Started container splitter-graph-61561 | |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-beb6a-predictor-7c99f78746-rr2sm |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.26:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-beb6a-predictor-d9b4c445f-kbknm |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.35:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-61561-predictor-6959dd4cf7-jjqv6 |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-61561-predictor-6959dd4cf7-jjqv6 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-61561-79f8d69754-l7866 |
Killing |
Stopping container splitter-graph-61561 | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-b2e96-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-b2e96-predictor-c4576f9f9 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-b2e96-predictor-7557b79bc4-bfcbn |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-b2e96-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-b2e96-predictor-7557b79bc4 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-b2e96-predictor-7557b79bc4-bfcbn |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-b2e96-predictor-c4576f9f9-9xl48 |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "success-200-isvc-b2e96-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-b2e96-predictor-7557b79bc4-bfcbn |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-b2e96-predictor-7557b79bc4-bfcbn |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-b2e96-predictor-7557b79bc4-bfcbn |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1814" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-b2e96-predictor-7557b79bc4-bfcbn |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
multus |
error-404-isvc-b2e96-predictor-7557b79bc4-bfcbn |
AddedInterface |
Add eth0 [10.133.0.27/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-b2e96-predictor-7557b79bc4 |
SuccessfulCreate |
Created pod: error-404-isvc-b2e96-predictor-7557b79bc4-bfcbn | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-b2e96 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-b2e96": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-b2e96-predictor-c4576f9f9 |
SuccessfulCreate |
Created pod: success-200-isvc-b2e96-predictor-c4576f9f9-9xl48 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-61561-predictor-545d79d4f6-h8m88 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-61561-predictor-545d79d4f6-h8m88 |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-b2e96 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-b2e96": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-b2e96": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-b2e96-predictor-c4576f9f9-9xl48 |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1814" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-b2e96-predictor-c4576f9f9-9xl48 |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-b2e96-predictor-c4576f9f9-9xl48 |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
multus |
success-200-isvc-b2e96-predictor-c4576f9f9-9xl48 |
AddedInterface |
Add eth0 [10.134.0.36/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-b2e96-predictor-c4576f9f9-9xl48 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-b2e96-predictor-c4576f9f9-9xl48 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-b2e96-predictor-c4576f9f9-9xl48 |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-61561-predictor-545d79d4f6-h8m88 |
Unhealthy |
Readiness probe failed: Get "https://10.133.0.25:8643/healthz": dial tcp 10.133.0.25:8643: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-61561-predictor-6959dd4cf7-jjqv6 |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.34:8643/healthz": context deadline exceeded | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-beb6a |
InferenceServiceReady |
InferenceService [error-404-isvc-beb6a] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-beb6a |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-beb6a |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-beb6a |
InferenceServiceReady |
InferenceService [success-200-isvc-beb6a] is Ready | |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-beb6a |
InferenceGraphReady |
InferenceGraph [switch-graph-beb6a] is Ready | |
kserve-ci-e2e-test |
multus |
switch-graph-beb6a-78db6d8859-vxrps |
AddedInterface |
Add eth0 [10.133.0.28/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
switch-graph-beb6a-78db6d8859-vxrps |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:3f8b4d8bbc07de8aec3f29b089d69c216cddd2ca68e10f109f830f4b0fdd9ee1" already present on machine | |
kserve-ci-e2e-test |
replicaset-controller |
switch-graph-beb6a-78db6d8859 |
SuccessfulCreate |
Created pod: switch-graph-beb6a-78db6d8859-vxrps | |
kserve-ci-e2e-test |
deployment-controller |
switch-graph-beb6a |
ScalingReplicaSet |
Scaled up replica set switch-graph-beb6a-78db6d8859 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
switch-graph-beb6a-78db6d8859-vxrps |
Created |
Created container: switch-graph-beb6a | |
kserve-ci-e2e-test |
kubelet |
switch-graph-beb6a-78db6d8859-vxrps |
Started |
Started container switch-graph-beb6a | |
| (x6) | kserve-ci-e2e-test |
kubelet |
splitter-graph-61561-79f8d69754-l7866 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-b2e96-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-b2e96-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-b2e96-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-b2e96-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-beb6a-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-beb6a-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-beb6a-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-beb6a-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-b2e96-predictor-c4576f9f9-9xl48 |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.36:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-b2e96-predictor-7557b79bc4-bfcbn |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.27:8080: connect: connection refused |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-b2e96 |
InferenceServiceReady |
InferenceService [error-404-isvc-b2e96] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-b2e96 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-b2e96 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-b2e96 |
InferenceServiceReady |
InferenceService [success-200-isvc-b2e96] is Ready | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-beb6a |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-beb6a |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
replicaset-controller |
splitter-graph-b2e96-c4cf9c888 |
SuccessfulCreate |
Created pod: splitter-graph-b2e96-c4cf9c888-47dlv | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-b2e96-c4cf9c888-47dlv |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:3f8b4d8bbc07de8aec3f29b089d69c216cddd2ca68e10f109f830f4b0fdd9ee1" already present on machine | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-b2e96-c4cf9c888-47dlv |
Started |
Started container splitter-graph-b2e96 | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-b2e96-c4cf9c888-47dlv |
Created |
Created container: splitter-graph-b2e96 | |
kserve-ci-e2e-test |
multus |
splitter-graph-b2e96-c4cf9c888-47dlv |
AddedInterface |
Add eth0 [10.132.0.42/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
InferenceGraphController |
splitter-graph-b2e96 |
InferenceGraphReady |
InferenceGraph [splitter-graph-b2e96] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
splitter-graph-b2e96 |
ScalingReplicaSet |
Scaled up replica set splitter-graph-b2e96-c4cf9c888 from 0 to 1 | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-b2e96-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-b2e96-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-b2e96-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
splitter-graph-b2e96 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-b2e96-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
splitter-graph-b2e96 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
splitter-graph-b2e96-c4cf9c888-47dlv |
Killing |
Stopping container splitter-graph-b2e96 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-b2e96-predictor-7557b79bc4-bfcbn |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-b2e96-predictor-7557b79bc4-bfcbn |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-b2e96-predictor-c4576f9f9-9xl48 |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-b2e96-predictor-c4576f9f9-9xl48 |
Killing |
Stopping container kserve-container | |
| (x6) | kserve-ci-e2e-test |
kubelet |
splitter-graph-b2e96-c4cf9c888-47dlv |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-beb6a-predictor-d9b4c445f-kbknm |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-beb6a-predictor-7c99f78746-rr2sm |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
switch-graph-beb6a-78db6d8859-vxrps |
Killing |
Stopping container switch-graph-beb6a | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-beb6a-predictor-7c99f78746-rr2sm |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-beb6a-predictor-d9b4c445f-kbknm |
Killing |
Stopping container kube-rbac-proxy | |
| (x5) | kserve-ci-e2e-test |
kubelet |
switch-graph-beb6a-78db6d8859-vxrps |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |