| Time | Namespace | Component | RelatedObject | Reason | Message |
|---|---|---|---|---|---|
kserve-ci-e2e-test |
sequence-graph-8ecaa-744b549df5-m5nct |
Scheduled |
Successfully assigned kserve-ci-e2e-test/sequence-graph-8ecaa-744b549df5-m5nct to ip-10-0-142-155.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-5f3f4-predictor-595bd58f95-29vch |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-5f3f4-predictor-595bd58f95-29vch to ip-10-0-142-155.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-4baa0-predictor-ff5686f95-v7hhj |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-4baa0-predictor-ff5686f95-v7hhj to ip-10-0-142-155.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-9de39-predictor-6c54447ff5-5mqrh |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-9de39-predictor-6c54447ff5-5mqrh to ip-10-0-142-155.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-8ecaa-predictor-79f5d859c9-j8vtd |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-8ecaa-predictor-79f5d859c9-j8vtd to ip-10-0-142-155.ec2.internal | ||
kserve-ci-e2e-test |
isvc-sklearn-graph-2-predictor-84b568d556-btqhc |
Scheduled |
Successfully assigned kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-84b568d556-btqhc to ip-10-0-132-191.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-1f938-predictor-59ff946b45-j22r5 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-1f938-predictor-59ff946b45-j22r5 to ip-10-0-142-155.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-71ab7-predictor-868947f459-fxsgw |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-71ab7-predictor-868947f459-fxsgw to ip-10-0-142-155.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-104b4-predictor-65665c5848-4gb7r |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-104b4-predictor-65665c5848-4gb7r to ip-10-0-132-191.ec2.internal | ||
kserve-ci-e2e-test |
splitter-graph-9de39-68884c5cfc-t9prr |
Scheduled |
Successfully assigned kserve-ci-e2e-test/splitter-graph-9de39-68884c5cfc-t9prr to ip-10-0-142-155.ec2.internal | ||
kserve-ci-e2e-test |
switch-graph-5f3f4-759d88bf97-qthpt |
Scheduled |
Successfully assigned kserve-ci-e2e-test/switch-graph-5f3f4-759d88bf97-qthpt to ip-10-0-142-155.ec2.internal | ||
kserve-ci-e2e-test |
switch-graph-3274f-78b9ff9b6-mr4hr |
Scheduled |
Successfully assigned kserve-ci-e2e-test/switch-graph-3274f-78b9ff9b6-mr4hr to ip-10-0-142-155.ec2.internal | ||
kserve-ci-e2e-test |
switch-graph-104b4-c874cb76f-zv7n6 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/switch-graph-104b4-c874cb76f-zv7n6 to ip-10-0-142-155.ec2.internal | ||
kserve-ci-e2e-test |
ensemble-graph-4baa0-5fb5d5fbd9-6jf7m |
Scheduled |
Successfully assigned kserve-ci-e2e-test/ensemble-graph-4baa0-5fb5d5fbd9-6jf7m to ip-10-0-142-155.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-9de39-predictor-7575d6d4cd-ppr27 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-9de39-predictor-7575d6d4cd-ppr27 to ip-10-0-132-191.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-8ecaa-predictor-77959c96b6-2sdwt |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-8ecaa-predictor-77959c96b6-2sdwt to ip-10-0-132-191.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-71ab7-predictor-6b54d7bd58-f96g7 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-71ab7-predictor-6b54d7bd58-f96g7 to ip-10-0-132-191.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-3274f-predictor-554cc4d85f-w9hq6 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-3274f-predictor-554cc4d85f-w9hq6 to ip-10-0-142-155.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-1469a-predictor-57f964f944-hm9lx |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-1469a-predictor-57f964f944-hm9lx to ip-10-0-132-191.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-1f938-predictor-59f689c956-lzsxd |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-1f938-predictor-59f689c956-lzsxd to ip-10-0-132-191.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-3274f-predictor-cf66786f4-9m5t7 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-3274f-predictor-cf66786f4-9m5t7 to ip-10-0-132-191.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-3d727-predictor-58657f85cc-bp9xf |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-3d727-predictor-58657f85cc-bp9xf to ip-10-0-142-155.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-3d727-predictor-79f4459548-fkxl5 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-3d727-predictor-79f4459548-fkxl5 to ip-10-0-132-191.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-4baa0-predictor-6dd97867c8-xqs4c |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-4baa0-predictor-6dd97867c8-xqs4c to ip-10-0-132-191.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-104b4-predictor-57dfd5fd5-9d5gx |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-104b4-predictor-57dfd5fd5-9d5gx to ip-10-0-142-155.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-5f3f4-predictor-59799d75f4-nbjg2 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-5f3f4-predictor-59799d75f4-nbjg2 to ip-10-0-132-191.ec2.internal | ||
kserve-ci-e2e-test |
splitter-graph-71ab7-7cd696848d-j79lk |
Scheduled |
Successfully assigned kserve-ci-e2e-test/splitter-graph-71ab7-7cd696848d-j79lk to ip-10-0-142-155.ec2.internal | ||
kserve-ci-e2e-test |
isvc-sklearn-graph-1-predictor-7c964dbd44-bp7fs |
Scheduled |
Successfully assigned kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7c964dbd44-bp7fs to ip-10-0-132-191.ec2.internal | ||
kserve-ci-e2e-test |
isvc-xgboost-graph-predictor-555fc69d56-q44ln |
Scheduled |
Successfully assigned kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-q44ln to ip-10-0-132-191.ec2.internal | ||
kserve-ci-e2e-test |
sequence-graph-3d727-6dd4fd7669-crrj5 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/sequence-graph-3d727-6dd4fd7669-crrj5 to ip-10-0-142-155.ec2.internal | ||
kserve-ci-e2e-test |
sequence-graph-1469a-d7c587ff8-7j2jt |
Scheduled |
Successfully assigned kserve-ci-e2e-test/sequence-graph-1469a-d7c587ff8-7j2jt to ip-10-0-142-155.ec2.internal | ||
kserve-ci-e2e-test |
ensemble-graph-1f938-77484598f8-rppn4 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/ensemble-graph-1f938-77484598f8-rppn4 to ip-10-0-142-155.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-1469a-predictor-5dfdcd7c4f-tntr5 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-1469a-predictor-5dfdcd7c4f-tntr5 to ip-10-0-142-155.ec2.internal | ||
kserve-ci-e2e-test |
model-chainer-57956d54d6-gk2dr |
Scheduled |
Successfully assigned kserve-ci-e2e-test/model-chainer-57956d54d6-gk2dr to ip-10-0-142-155.ec2.internal | ||
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-5f3f4 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-5f3f4": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-5f3f4-predictor-595bd58f95 |
SuccessfulCreate |
Created pod: error-404-isvc-5f3f4-predictor-595bd58f95-29vch | |
kserve-ci-e2e-test |
replicaset-controller |
isvc-xgboost-graph-predictor-555fc69d56 |
SuccessfulCreate |
Created pod: isvc-xgboost-graph-predictor-555fc69d56-q44ln | |
kserve-ci-e2e-test |
deployment-controller |
isvc-sklearn-graph-1-predictor |
ScalingReplicaSet |
Scaled up replica set isvc-sklearn-graph-1-predictor-7c964dbd44 from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
isvc-xgboost-graph-predictor |
ScalingReplicaSet |
Scaled up replica set isvc-xgboost-graph-predictor-555fc69d56 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-7c964dbd44-bp7fs |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "isvc-sklearn-graph-1-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-5f3f4 |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-5f3f4": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-5f3f4": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
replicaset-controller |
isvc-sklearn-graph-2-predictor-84b568d556 |
SuccessfulCreate |
Created pod: isvc-sklearn-graph-2-predictor-84b568d556-btqhc | |
kserve-ci-e2e-test |
deployment-controller |
isvc-sklearn-graph-2-predictor |
ScalingReplicaSet |
Scaled up replica set isvc-sklearn-graph-2-predictor-84b568d556 from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-5f3f4-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-5f3f4-predictor-59799d75f4 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
isvc-sklearn-graph-1-predictor-7c964dbd44 |
SuccessfulCreate |
Created pod: isvc-sklearn-graph-1-predictor-7c964dbd44-bp7fs | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-5f3f4-predictor-59799d75f4-nbjg2 |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "success-200-isvc-5f3f4-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-5f3f4-predictor-59799d75f4 |
SuccessfulCreate |
Created pod: success-200-isvc-5f3f4-predictor-59799d75f4-nbjg2 | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-5f3f4-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-5f3f4-predictor-595bd58f95 from 0 to 1 | |
kserve-ci-e2e-test |
multus |
success-200-isvc-5f3f4-predictor-59799d75f4-nbjg2 |
AddedInterface |
Add eth0 [10.134.0.26/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-7c964dbd44-bp7fs |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:956644def59861b6c4d288d394adc3ba824655b2a247e0388911f52fbf9bf773" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-5f3f4-predictor-59799d75f4-nbjg2 |
Pulling |
Pulling image "quay.io/opendatahub/success-200-isvc:odh-pr-1684" | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-q44ln |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:956644def59861b6c4d288d394adc3ba824655b2a247e0388911f52fbf9bf773" already present on machine | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-q44ln |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-7c964dbd44-bp7fs |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-7c964dbd44-bp7fs |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
multus |
isvc-sklearn-graph-1-predictor-7c964dbd44-bp7fs |
AddedInterface |
Add eth0 [10.134.0.27/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
multus |
error-404-isvc-5f3f4-predictor-595bd58f95-29vch |
AddedInterface |
Add eth0 [10.133.0.17/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
multus |
isvc-xgboost-graph-predictor-555fc69d56-q44ln |
AddedInterface |
Add eth0 [10.134.0.28/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-q44ln |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
multus |
isvc-sklearn-graph-2-predictor-84b568d556-btqhc |
AddedInterface |
Add eth0 [10.134.0.29/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-84b568d556-btqhc |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-84b568d556-btqhc |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-5f3f4-predictor-595bd58f95-29vch |
Pulling |
Pulling image "quay.io/opendatahub/error-404-isvc:odh-pr-1684" | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-84b568d556-btqhc |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:956644def59861b6c4d288d394adc3ba824655b2a247e0388911f52fbf9bf773" already present on machine | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-q44ln |
Pulling |
Pulling image "kserve/xgbserver:latest" | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-7c964dbd44-bp7fs |
Pulling |
Pulling image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1684" | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-84b568d556-btqhc |
Pulling |
Pulling image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1684" | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-5f3f4-predictor-595bd58f95-29vch |
Pulling |
Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-5f3f4-predictor-595bd58f95-29vch |
Pulled |
Successfully pulled image "quay.io/opendatahub/error-404-isvc:odh-pr-1684" in 14.934s (14.934s including waiting). Image size: 1334589534 bytes. | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-5f3f4-predictor-595bd58f95-29vch |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-5f3f4-predictor-595bd58f95-29vch |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-5f3f4-predictor-595bd58f95-29vch |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-5f3f4-predictor-595bd58f95-29vch |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-5f3f4-predictor-595bd58f95-29vch |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" in 2.43s (2.43s including waiting). Image size: 211946088 bytes. | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-5f3f4-predictor-59799d75f4-nbjg2 |
Pulled |
Successfully pulled image "quay.io/opendatahub/success-200-isvc:odh-pr-1684" in 24.295s (24.295s including waiting). Image size: 1335614565 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-84b568d556-btqhc |
Pulled |
Successfully pulled image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1684" in 27.526s (27.526s including waiting). Image size: 1555846056 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-7c964dbd44-bp7fs |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-7c964dbd44-bp7fs |
Pulling |
Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-84b568d556-btqhc |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-5f3f4-predictor-59799d75f4-nbjg2 |
Pulling |
Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-5f3f4-predictor-59799d75f4-nbjg2 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-84b568d556-btqhc |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-7c964dbd44-bp7fs |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-5f3f4-predictor-59799d75f4-nbjg2 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-84b568d556-btqhc |
Pulling |
Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-7c964dbd44-bp7fs |
Pulled |
Successfully pulled image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1684" in 27.527s (27.527s including waiting). Image size: 1555846056 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-q44ln |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-q44ln |
Pulled |
Successfully pulled image "kserve/xgbserver:latest" in 28.325s (28.325s including waiting). Image size: 1305547509 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-q44ln |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-q44ln |
Pulling |
Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-7c964dbd44-bp7fs |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-5f3f4-predictor-59799d75f4-nbjg2 |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" in 3.436s (3.436s including waiting). Image size: 211946088 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-q44ln |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-q44ln |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-84b568d556-btqhc |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-5f3f4-predictor-59799d75f4-nbjg2 |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-7c964dbd44-bp7fs |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" in 3.487s (3.487s including waiting). Image size: 211946088 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-84b568d556-btqhc |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-84b568d556-btqhc |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" in 3.439s (3.439s including waiting). Image size: 211946088 bytes. | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-5f3f4-predictor-59799d75f4-nbjg2 |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-q44ln |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" in 2.724s (2.724s including waiting). Image size: 211946088 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-7c964dbd44-bp7fs |
Started |
Started container kube-rbac-proxy | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-5f3f4-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-5f3f4-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-5f3f4-predictor-595bd58f95-29vch |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.17:8080: connect: connection refused |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-5f3f4-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-5f3f4-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-5f3f4 |
InferenceServiceReady |
InferenceService [error-404-isvc-5f3f4] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-5f3f4 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-5f3f4-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-5f3f4-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-5f3f4 |
InferenceServiceReady |
InferenceService [success-200-isvc-5f3f4] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-5f3f4 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x9) | kserve-ci-e2e-test |
v1beta1Controllers |
isvc-xgboost-graph |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
isvc-xgboost-graph |
InferenceServiceReady |
InferenceService [isvc-xgboost-graph] is Ready | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-5f3f4-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-5f3f4-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
multus |
switch-graph-5f3f4-759d88bf97-qthpt |
AddedInterface |
Add eth0 [10.133.0.18/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
replicaset-controller |
switch-graph-5f3f4-759d88bf97 |
SuccessfulCreate |
Created pod: switch-graph-5f3f4-759d88bf97-qthpt | |
kserve-ci-e2e-test |
deployment-controller |
switch-graph-5f3f4 |
ScalingReplicaSet |
Scaled up replica set switch-graph-5f3f4-759d88bf97 from 0 to 1 | |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-5f3f4 |
InferenceGraphReady |
InferenceGraph [switch-graph-5f3f4] is Ready | |
kserve-ci-e2e-test |
kubelet |
switch-graph-5f3f4-759d88bf97-qthpt |
Pulling |
Pulling image "quay.io/opendatahub/kserve-router@sha256:343c9e455f840436fd086519b55f7daa1173afbafc1b91e08f3c6de9e52e6594" | |
kserve-ci-e2e-test |
kubelet |
switch-graph-5f3f4-759d88bf97-qthpt |
Started |
Started container switch-graph-5f3f4 | |
kserve-ci-e2e-test |
kubelet |
switch-graph-5f3f4-759d88bf97-qthpt |
Created |
Created container: switch-graph-5f3f4 | |
kserve-ci-e2e-test |
kubelet |
switch-graph-5f3f4-759d88bf97-qthpt |
Pulled |
Successfully pulled image "quay.io/opendatahub/kserve-router@sha256:343c9e455f840436fd086519b55f7daa1173afbafc1b91e08f3c6de9e52e6594" in 2.365s (2.365s including waiting). Image size: 218072678 bytes. | |
| (x9) | kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-1 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-1 |
InferenceServiceReady |
InferenceService [isvc-sklearn-graph-1] is Ready | |
| (x9) | kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-2 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-2 |
InferenceServiceReady |
InferenceService [isvc-sklearn-graph-2] is Ready | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-5f3f4-predictor-59799d75f4-nbjg2 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-104b4-predictor-65665c5848 |
SuccessfulCreate |
Created pod: success-200-isvc-104b4-predictor-65665c5848-4gb7r | |
kserve-ci-e2e-test |
kubelet |
switch-graph-5f3f4-759d88bf97-qthpt |
Killing |
Stopping container switch-graph-5f3f4 | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-104b4-predictor-57dfd5fd5 |
SuccessfulCreate |
Created pod: error-404-isvc-104b4-predictor-57dfd5fd5-9d5gx | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-104b4-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-104b4-predictor-57dfd5fd5 from 0 to 1 | |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-5f3f4-predictor-59799d75f4-nbjg2 |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-104b4-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-104b4-predictor-65665c5848 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-104b4-predictor-65665c5848-4gb7r |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1684" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-104b4-predictor-57dfd5fd5-9d5gx |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "error-404-isvc-104b4-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-104b4-predictor-65665c5848-4gb7r |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-104b4-predictor-65665c5848-4gb7r |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-104b4-predictor-65665c5848-4gb7r |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-104b4-predictor-65665c5848-4gb7r |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-104b4-predictor-65665c5848-4gb7r |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-5f3f4-predictor-595bd58f95-29vch |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
multus |
success-200-isvc-104b4-predictor-65665c5848-4gb7r |
AddedInterface |
Add eth0 [10.134.0.30/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-5f3f4-predictor-595bd58f95-29vch |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-104b4-predictor-57dfd5fd5-9d5gx |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
multus |
error-404-isvc-104b4-predictor-57dfd5fd5-9d5gx |
AddedInterface |
Add eth0 [10.133.0.19/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-104b4-predictor-57dfd5fd5-9d5gx |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-104b4-predictor-57dfd5fd5-9d5gx |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1684" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-104b4-predictor-57dfd5fd5-9d5gx |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-104b4-predictor-57dfd5fd5-9d5gx |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-104b4-predictor-57dfd5fd5-9d5gx |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-5f3f4-predictor-59799d75f4-nbjg2 |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.26:8643/healthz": dial tcp 10.134.0.26:8643: connect: connection refused | |
| (x8) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-5f3f4-predictor-59799d75f4-nbjg2 |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.26:8080: connect: connection refused |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
InferenceGraphController |
model-chainer |
UpdateFailed |
Failed to update status for InferenceGraph "model-chainer": Operation cannot be fulfilled on inferencegraphs.serving.kserve.io "model-chainer": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
multus |
model-chainer-57956d54d6-gk2dr |
AddedInterface |
Add eth0 [10.133.0.20/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
InferenceGraphController |
model-chainer |
InternalError |
fails to update InferenceGraph status: Operation cannot be fulfilled on inferencegraphs.serving.kserve.io "model-chainer": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
InferenceGraphController |
model-chainer |
InferenceGraphReady |
InferenceGraph [model-chainer] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
model-chainer |
ScalingReplicaSet |
Scaled up replica set model-chainer-57956d54d6 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
model-chainer-57956d54d6 |
SuccessfulCreate |
Created pod: model-chainer-57956d54d6-gk2dr | |
kserve-ci-e2e-test |
kubelet |
model-chainer-57956d54d6-gk2dr |
Started |
Started container model-chainer | |
kserve-ci-e2e-test |
kubelet |
model-chainer-57956d54d6-gk2dr |
Created |
Created container: model-chainer | |
kserve-ci-e2e-test |
kubelet |
model-chainer-57956d54d6-gk2dr |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:343c9e455f840436fd086519b55f7daa1173afbafc1b91e08f3c6de9e52e6594" already present on machine | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-84b568d556-btqhc |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-1469a-predictor-5dfdcd7c4f |
SuccessfulCreate |
Created pod: error-404-isvc-1469a-predictor-5dfdcd7c4f-tntr5 | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-q44ln |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-84b568d556-btqhc |
Killing |
Stopping container kube-rbac-proxy | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-104b4-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-7c964dbd44-bp7fs |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
model-chainer-57956d54d6-gk2dr |
Killing |
Stopping container model-chainer | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-q44ln |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-1469a-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-1469a-predictor-5dfdcd7c4f from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-1469a-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-1469a-predictor-57f964f944 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-1469a-predictor-57f964f944 |
SuccessfulCreate |
Created pod: success-200-isvc-1469a-predictor-57f964f944-hm9lx | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-104b4-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-104b4-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-7c964dbd44-bp7fs |
Killing |
Stopping container kserve-container | |
| (x6) | kserve-ci-e2e-test |
kubelet |
switch-graph-5f3f4-759d88bf97-qthpt |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-104b4-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-1469a-predictor-5dfdcd7c4f-tntr5 |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-1469a-predictor-5dfdcd7c4f-tntr5 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-1469a-predictor-57f964f944-hm9lx |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1684" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-1469a-predictor-57f964f944-hm9lx |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-1469a-predictor-57f964f944-hm9lx |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-1469a-predictor-57f964f944-hm9lx |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-1469a-predictor-57f964f944-hm9lx |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-1469a-predictor-57f964f944-hm9lx |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-1469a-predictor-5dfdcd7c4f-tntr5 |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "error-404-isvc-1469a-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
multus |
error-404-isvc-1469a-predictor-5dfdcd7c4f-tntr5 |
AddedInterface |
Add eth0 [10.133.0.21/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-1469a-predictor-5dfdcd7c4f-tntr5 |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1684" already present on machine | |
kserve-ci-e2e-test |
multus |
success-200-isvc-1469a-predictor-57f964f944-hm9lx |
AddedInterface |
Add eth0 [10.134.0.31/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-1469a-predictor-5dfdcd7c4f-tntr5 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-1469a-predictor-5dfdcd7c4f-tntr5 |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-1469a-predictor-5dfdcd7c4f-tntr5 |
Started |
Started container kube-rbac-proxy | |
| (x10) | kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-7c964dbd44-bp7fs |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.27:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-q44ln |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.28:8643/healthz": dial tcp 10.134.0.28:8643: connect: connection refused | |
| (x9) | kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-q44ln |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.28:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-84b568d556-btqhc |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.29:8643/healthz": dial tcp 10.134.0.29:8643: connect: connection refused | |
| (x10) | kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-84b568d556-btqhc |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.29:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-7c964dbd44-bp7fs |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.27:8643/healthz": dial tcp 10.134.0.27:8643: connect: connection refused | |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-104b4-predictor-57dfd5fd5-9d5gx |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.19:8080: connect: connection refused |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-104b4 |
InferenceServiceReady |
InferenceService [error-404-isvc-104b4] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-104b4 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x6) | kserve-ci-e2e-test |
kubelet |
model-chainer-57956d54d6-gk2dr |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-104b4 |
InferenceServiceReady |
InferenceService [success-200-isvc-104b4] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-104b4 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-1469a-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-1469a-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-1469a-predictor-5dfdcd7c4f-tntr5 |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.21:8080: connect: connection refused |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-104b4 |
InferenceGraphReady |
InferenceGraph [switch-graph-104b4] is Ready | |
kserve-ci-e2e-test |
replicaset-controller |
switch-graph-104b4-c874cb76f |
SuccessfulCreate |
Created pod: switch-graph-104b4-c874cb76f-zv7n6 | |
kserve-ci-e2e-test |
deployment-controller |
switch-graph-104b4 |
ScalingReplicaSet |
Scaled up replica set switch-graph-104b4-c874cb76f from 0 to 1 | |
kserve-ci-e2e-test |
multus |
switch-graph-104b4-c874cb76f-zv7n6 |
AddedInterface |
Add eth0 [10.133.0.22/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
switch-graph-104b4-c874cb76f-zv7n6 |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "switch-graph-104b4-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
switch-graph-104b4-c874cb76f-zv7n6 |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:343c9e455f840436fd086519b55f7daa1173afbafc1b91e08f3c6de9e52e6594" already present on machine | |
kserve-ci-e2e-test |
kubelet |
switch-graph-104b4-c874cb76f-zv7n6 |
Created |
Created container: switch-graph-104b4 | |
kserve-ci-e2e-test |
kubelet |
switch-graph-104b4-c874cb76f-zv7n6 |
Started |
Started container switch-graph-104b4 | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-1469a-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-104b4-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-104b4-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-1469a-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-104b4-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-104b4-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-1469a-predictor-57f964f944-hm9lx |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.31:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-1469a |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-1469a |
InferenceServiceReady |
InferenceService [error-404-isvc-1469a] is Ready | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-104b4 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-104b4 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-1469a |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-1469a |
InferenceServiceReady |
InferenceService [success-200-isvc-1469a] is Ready | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-1469a-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-1469a-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
deployment-controller |
sequence-graph-1469a |
ScalingReplicaSet |
Scaled up replica set sequence-graph-1469a-d7c587ff8 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-1469a-d7c587ff8-7j2jt |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "sequence-graph-1469a-serving-cert" not found | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-104b4 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-1469a |
InferenceGraphReady |
InferenceGraph [sequence-graph-1469a] is Ready | |
kserve-ci-e2e-test |
replicaset-controller |
sequence-graph-1469a-d7c587ff8 |
SuccessfulCreate |
Created pod: sequence-graph-1469a-d7c587ff8-7j2jt | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-104b4 |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
multus |
sequence-graph-1469a-d7c587ff8-7j2jt |
AddedInterface |
Add eth0 [10.133.0.23/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-1469a-d7c587ff8-7j2jt |
Created |
Created container: sequence-graph-1469a | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-1469a-d7c587ff8-7j2jt |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:343c9e455f840436fd086519b55f7daa1173afbafc1b91e08f3c6de9e52e6594" already present on machine | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-1469a-d7c587ff8-7j2jt |
Started |
Started container sequence-graph-1469a | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-1469a-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-1469a-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-1469a |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-1469a |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-1469a |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-1469a |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-4baa0-predictor-6dd97867c8-xqs4c |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "success-200-isvc-4baa0-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-4baa0 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-4baa0": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-4baa0 |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-4baa0": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-4baa0": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-4baa0 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-4baa0": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
switch-graph-104b4-c874cb76f-zv7n6 |
Killing |
Stopping container switch-graph-104b4 | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-4baa0-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-4baa0-predictor-6dd97867c8 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-4baa0-predictor-6dd97867c8 |
SuccessfulCreate |
Created pod: success-200-isvc-4baa0-predictor-6dd97867c8-xqs4c | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-104b4-predictor-57dfd5fd5-9d5gx |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-104b4-predictor-57dfd5fd5-9d5gx |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-4baa0 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-4baa0": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-4baa0": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-4baa0-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-4baa0-predictor-ff5686f95 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-4baa0-predictor-ff5686f95 |
SuccessfulCreate |
Created pod: error-404-isvc-4baa0-predictor-ff5686f95-v7hhj | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-104b4-predictor-65665c5848-4gb7r |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-104b4-predictor-65665c5848-4gb7r |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-4baa0-predictor-6dd97867c8-xqs4c |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-4baa0-predictor-ff5686f95-v7hhj |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
multus |
success-200-isvc-4baa0-predictor-6dd97867c8-xqs4c |
AddedInterface |
Add eth0 [10.134.0.32/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-4baa0-predictor-6dd97867c8-xqs4c |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-4baa0-predictor-ff5686f95-v7hhj |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
multus |
error-404-isvc-4baa0-predictor-ff5686f95-v7hhj |
AddedInterface |
Add eth0 [10.133.0.24/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-4baa0-predictor-6dd97867c8-xqs4c |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1684" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-4baa0-predictor-ff5686f95-v7hhj |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-4baa0-predictor-ff5686f95-v7hhj |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1684" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-4baa0-predictor-6dd97867c8-xqs4c |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-4baa0-predictor-6dd97867c8-xqs4c |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-4baa0-predictor-6dd97867c8-xqs4c |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-4baa0-predictor-ff5686f95-v7hhj |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-4baa0-predictor-ff5686f95-v7hhj |
Started |
Started container kube-rbac-proxy | |
| (x8) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-104b4-predictor-65665c5848-4gb7r |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.30:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-104b4-predictor-65665c5848-4gb7r |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.30:8643/healthz": dial tcp 10.134.0.30:8643: connect: connection refused | |
| (x6) | kserve-ci-e2e-test |
kubelet |
switch-graph-104b4-c874cb76f-zv7n6 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-8ecaa |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-8ecaa": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-1469a-predictor-5dfdcd7c4f-tntr5 |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-8ecaa-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-8ecaa-predictor-77959c96b6 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-8ecaa-predictor-77959c96b6 |
SuccessfulCreate |
Created pod: success-200-isvc-8ecaa-predictor-77959c96b6-2sdwt | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-1469a-predictor-5dfdcd7c4f-tntr5 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-8ecaa |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-8ecaa": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-8ecaa": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-8ecaa-predictor-79f5d859c9 |
SuccessfulCreate |
Created pod: error-404-isvc-8ecaa-predictor-79f5d859c9-j8vtd | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-8ecaa-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-8ecaa-predictor-79f5d859c9 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-1469a-predictor-57f964f944-hm9lx |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-8ecaa-predictor-79f5d859c9-j8vtd |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "error-404-isvc-8ecaa-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-1469a-d7c587ff8-7j2jt |
Killing |
Stopping container sequence-graph-1469a | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-1469a-predictor-57f964f944-hm9lx |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-8ecaa-predictor-79f5d859c9-j8vtd |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-8ecaa-predictor-79f5d859c9-j8vtd |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1684" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-8ecaa-predictor-79f5d859c9-j8vtd |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
multus |
error-404-isvc-8ecaa-predictor-79f5d859c9-j8vtd |
AddedInterface |
Add eth0 [10.133.0.25/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-8ecaa-predictor-79f5d859c9-j8vtd |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-8ecaa-predictor-79f5d859c9-j8vtd |
Started |
Started container kserve-container | |
| (x2) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-8ecaa-predictor-77959c96b6-2sdwt |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "success-200-isvc-8ecaa-predictor-serving-cert" not found |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-8ecaa-predictor-79f5d859c9-j8vtd |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-8ecaa-predictor-77959c96b6-2sdwt |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-8ecaa-predictor-77959c96b6-2sdwt |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-8ecaa-predictor-77959c96b6-2sdwt |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-8ecaa-predictor-77959c96b6-2sdwt |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-8ecaa-predictor-77959c96b6-2sdwt |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1684" already present on machine | |
kserve-ci-e2e-test |
multus |
success-200-isvc-8ecaa-predictor-77959c96b6-2sdwt |
AddedInterface |
Add eth0 [10.134.0.33/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-8ecaa-predictor-77959c96b6-2sdwt |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-1469a-predictor-57f964f944-hm9lx |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.31:8080: i/o timeout | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-1469a-predictor-57f964f944-hm9lx |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.31:8643/healthz": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) | |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-4baa0-predictor-ff5686f95-v7hhj |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.24:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-4baa0-predictor-6dd97867c8-xqs4c |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.32:8080: connect: connection refused |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-4baa0-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-4baa0-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-4baa0-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-4baa0-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-4baa0 |
InferenceServiceReady |
InferenceService [error-404-isvc-4baa0] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-4baa0 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-4baa0 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-4baa0 |
InferenceServiceReady |
InferenceService [success-200-isvc-4baa0] is Ready | |
| (x6) | kserve-ci-e2e-test |
kubelet |
sequence-graph-1469a-d7c587ff8-7j2jt |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-4baa0-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-4baa0-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
InferenceGraphController |
ensemble-graph-4baa0 |
InferenceGraphReady |
InferenceGraph [ensemble-graph-4baa0] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
ensemble-graph-4baa0 |
ScalingReplicaSet |
Scaled up replica set ensemble-graph-4baa0-5fb5d5fbd9 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
ensemble-graph-4baa0-5fb5d5fbd9 |
SuccessfulCreate |
Created pod: ensemble-graph-4baa0-5fb5d5fbd9-6jf7m | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-4baa0-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-4baa0-5fb5d5fbd9-6jf7m |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "ensemble-graph-4baa0-serving-cert" not found | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-4baa0-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-4baa0-5fb5d5fbd9-6jf7m |
Created |
Created container: ensemble-graph-4baa0 | |
kserve-ci-e2e-test |
multus |
ensemble-graph-4baa0-5fb5d5fbd9-6jf7m |
AddedInterface |
Add eth0 [10.133.0.26/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-4baa0-5fb5d5fbd9-6jf7m |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:343c9e455f840436fd086519b55f7daa1173afbafc1b91e08f3c6de9e52e6594" already present on machine | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-4baa0-5fb5d5fbd9-6jf7m |
Started |
Started container ensemble-graph-4baa0 | |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-8ecaa-predictor-79f5d859c9-j8vtd |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.25:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-4baa0-predictor-6dd97867c8-xqs4c |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-4baa0-5fb5d5fbd9-6jf7m |
Killing |
Stopping container ensemble-graph-4baa0 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-4baa0-predictor-6dd97867c8-xqs4c |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-1f938-predictor-59f689c956 |
SuccessfulCreate |
Created pod: success-200-isvc-1f938-predictor-59f689c956-lzsxd | |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-8ecaa-predictor-77959c96b6-2sdwt |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.33:8080: connect: connection refused |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-1f938-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-1f938-predictor-59f689c956 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-1f938-predictor-59ff946b45-j22r5 |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "error-404-isvc-1f938-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-4baa0-predictor-ff5686f95-v7hhj |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-1f938-predictor-59f689c956-lzsxd |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1684" already present on machine | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-1f938-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-1f938-predictor-59ff946b45 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-1f938-predictor-59ff946b45 |
SuccessfulCreate |
Created pod: error-404-isvc-1f938-predictor-59ff946b45-j22r5 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-1f938-predictor-59f689c956-lzsxd |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
multus |
success-200-isvc-1f938-predictor-59f689c956-lzsxd |
AddedInterface |
Add eth0 [10.134.0.34/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-1f938-predictor-59f689c956-lzsxd |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-1f938-predictor-59f689c956-lzsxd |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-4baa0-predictor-ff5686f95-v7hhj |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-1f938-predictor-59f689c956-lzsxd |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-1f938-predictor-59f689c956-lzsxd |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-1f938-predictor-59ff946b45-j22r5 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-1f938-predictor-59ff946b45-j22r5 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-1f938-predictor-59ff946b45-j22r5 |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-1f938-predictor-59ff946b45-j22r5 |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1684" already present on machine | |
kserve-ci-e2e-test |
multus |
error-404-isvc-1f938-predictor-59ff946b45-j22r5 |
AddedInterface |
Add eth0 [10.133.0.27/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-1f938-predictor-59ff946b45-j22r5 |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-4baa0-predictor-ff5686f95-v7hhj |
Unhealthy |
Readiness probe failed: Get "https://10.133.0.24:8643/healthz": dial tcp 10.133.0.24:8643: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-1f938-predictor-59ff946b45-j22r5 |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-4baa0-predictor-6dd97867c8-xqs4c |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.32:8643/healthz": dial tcp 10.134.0.32:8643: connect: connection refused | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-8ecaa-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-8ecaa-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-8ecaa |
InferenceServiceReady |
InferenceService [error-404-isvc-8ecaa] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-8ecaa |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-8ecaa |
InferenceServiceReady |
InferenceService [success-200-isvc-8ecaa] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-8ecaa |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-1f938-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-1f938-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-8ecaa-744b549df5-m5nct |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "sequence-graph-8ecaa-serving-cert" not found | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-8ecaa-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-8ecaa-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-8ecaa |
InferenceGraphReady |
InferenceGraph [sequence-graph-8ecaa] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
sequence-graph-8ecaa |
ScalingReplicaSet |
Scaled up replica set sequence-graph-8ecaa-744b549df5 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
sequence-graph-8ecaa-744b549df5 |
SuccessfulCreate |
Created pod: sequence-graph-8ecaa-744b549df5-m5nct | |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-8ecaa-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-8ecaa-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
sequence-graph-8ecaa-744b549df5-m5nct |
Started |
Started container sequence-graph-8ecaa | |
kserve-ci-e2e-test |
multus |
sequence-graph-8ecaa-744b549df5-m5nct |
AddedInterface |
Add eth0 [10.133.0.28/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-8ecaa-744b549df5-m5nct |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:343c9e455f840436fd086519b55f7daa1173afbafc1b91e08f3c6de9e52e6594" already present on machine | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-8ecaa-744b549df5-m5nct |
Created |
Created container: sequence-graph-8ecaa | |
| (x6) | kserve-ci-e2e-test |
kubelet |
ensemble-graph-4baa0-5fb5d5fbd9-6jf7m |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-3d727-predictor-79f4459548 |
SuccessfulCreate |
Created pod: success-200-isvc-3d727-predictor-79f4459548-fkxl5 | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-3d727 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-3d727": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-3d727-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-3d727-predictor-58657f85cc from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-8ecaa-predictor-77959c96b6-2sdwt |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-8ecaa-predictor-77959c96b6-2sdwt |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-3d727-predictor-58657f85cc |
SuccessfulCreate |
Created pod: error-404-isvc-3d727-predictor-58657f85cc-bp9xf | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-3d727 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-3d727": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-8ecaa-744b549df5-m5nct |
Killing |
Stopping container sequence-graph-8ecaa | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-3d727 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-3d727": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-3d727": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-3d727 |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-3d727": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-3d727": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-8ecaa-predictor-79f5d859c9-j8vtd |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-8ecaa-predictor-79f5d859c9-j8vtd |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-3d727-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-3d727-predictor-79f4459548 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-3d727-predictor-79f4459548-fkxl5 |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1684" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-3d727-predictor-79f4459548-fkxl5 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-3d727-predictor-79f4459548-fkxl5 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
multus |
success-200-isvc-3d727-predictor-79f4459548-fkxl5 |
AddedInterface |
Add eth0 [10.134.0.35/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-3d727-predictor-79f4459548-fkxl5 |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-3d727-predictor-79f4459548-fkxl5 |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-1f938-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-3d727-predictor-79f4459548-fkxl5 |
Created |
Created container: kube-rbac-proxy | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-1f938-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-3d727-predictor-58657f85cc-bp9xf |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "error-404-isvc-3d727-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-3d727-predictor-58657f85cc-bp9xf |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1684" already present on machine | |
kserve-ci-e2e-test |
multus |
error-404-isvc-3d727-predictor-58657f85cc-bp9xf |
AddedInterface |
Add eth0 [10.133.0.29/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-3d727-predictor-58657f85cc-bp9xf |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-3d727-predictor-58657f85cc-bp9xf |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-3d727-predictor-58657f85cc-bp9xf |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-3d727-predictor-58657f85cc-bp9xf |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-3d727-predictor-58657f85cc-bp9xf |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-8ecaa-predictor-79f5d859c9-j8vtd |
Unhealthy |
Readiness probe failed: Get "https://10.133.0.25:8643/healthz": dial tcp 10.133.0.25:8643: connect: connection refused | |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-1f938-predictor-59f689c956-lzsxd |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.34:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-1f938-predictor-59ff946b45-j22r5 |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.27:8080: connect: connection refused |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-1f938 |
InferenceServiceReady |
InferenceService [success-200-isvc-1f938] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-1f938 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-1f938 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-1f938 |
InferenceServiceReady |
InferenceService [error-404-isvc-1f938] is Ready | |
| (x6) | kserve-ci-e2e-test |
kubelet |
sequence-graph-8ecaa-744b549df5-m5nct |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-3d727-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-3d727-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
deployment-controller |
ensemble-graph-1f938 |
ScalingReplicaSet |
Scaled up replica set ensemble-graph-1f938-77484598f8 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-1f938-77484598f8-rppn4 |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "ensemble-graph-1f938-serving-cert" not found | |
kserve-ci-e2e-test |
replicaset-controller |
ensemble-graph-1f938-77484598f8 |
SuccessfulCreate |
Created pod: ensemble-graph-1f938-77484598f8-rppn4 | |
kserve-ci-e2e-test |
InferenceGraphController |
ensemble-graph-1f938 |
InferenceGraphReady |
InferenceGraph [ensemble-graph-1f938] is Ready | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-1f938-77484598f8-rppn4 |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:343c9e455f840436fd086519b55f7daa1173afbafc1b91e08f3c6de9e52e6594" already present on machine | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-1f938-77484598f8-rppn4 |
Created |
Created container: ensemble-graph-1f938 | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-1f938-77484598f8-rppn4 |
Started |
Started container ensemble-graph-1f938 | |
kserve-ci-e2e-test |
multus |
ensemble-graph-1f938-77484598f8-rppn4 |
AddedInterface |
Add eth0 [10.133.0.30/23] from ovn-kubernetes | |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-3d727-predictor-58657f85cc-bp9xf |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.29:8080: connect: connection refused |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-3d727-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-3d727-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-1f938-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-1f938-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-3d727 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-3d727 |
InferenceServiceReady |
InferenceService [success-200-isvc-3d727] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-3d727 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-3d727 |
InferenceServiceReady |
InferenceService [error-404-isvc-3d727] is Ready | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-3d727-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-3d727-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-3d727 |
InferenceGraphReady |
InferenceGraph [sequence-graph-3d727] is Ready | |
kserve-ci-e2e-test |
replicaset-controller |
sequence-graph-3d727-6dd4fd7669 |
SuccessfulCreate |
Created pod: sequence-graph-3d727-6dd4fd7669-crrj5 | |
kserve-ci-e2e-test |
deployment-controller |
sequence-graph-3d727 |
ScalingReplicaSet |
Scaled up replica set sequence-graph-3d727-6dd4fd7669 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-3d727-6dd4fd7669-crrj5 |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "sequence-graph-3d727-serving-cert" not found | |
kserve-ci-e2e-test |
multus |
sequence-graph-3d727-6dd4fd7669-crrj5 |
AddedInterface |
Add eth0 [10.133.0.31/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-3d727-6dd4fd7669-crrj5 |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:343c9e455f840436fd086519b55f7daa1173afbafc1b91e08f3c6de9e52e6594" already present on machine | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
ensemble-graph-1f938 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
sequence-graph-3d727-6dd4fd7669-crrj5 |
Created |
Created container: sequence-graph-3d727 | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
ensemble-graph-1f938 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-1f938-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-1f938-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
kubelet |
sequence-graph-3d727-6dd4fd7669-crrj5 |
Started |
Started container sequence-graph-3d727 | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-3d727-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-3d727-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-3d727 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-3d727 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-1f938-77484598f8-rppn4 |
Killing |
Stopping container ensemble-graph-1f938 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-1f938-predictor-59f689c956-lzsxd |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-71ab7-predictor-6b54d7bd58-f96g7 |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-71ab7-predictor-6b54d7bd58-f96g7 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-71ab7-predictor-6b54d7bd58-f96g7 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-71ab7-predictor-6b54d7bd58-f96g7 |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1684" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-71ab7-predictor-6b54d7bd58-f96g7 |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
multus |
success-200-isvc-71ab7-predictor-6b54d7bd58-f96g7 |
AddedInterface |
Add eth0 [10.134.0.36/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-1f938-predictor-59ff946b45-j22r5 |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-71ab7-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-71ab7-predictor-868947f459 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-71ab7-predictor-868947f459-fxsgw |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "error-404-isvc-71ab7-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-1f938-predictor-59f689c956-lzsxd |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-71ab7-predictor-6b54d7bd58-f96g7 |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-71ab7-predictor-6b54d7bd58 |
SuccessfulCreate |
Created pod: success-200-isvc-71ab7-predictor-6b54d7bd58-f96g7 | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-71ab7-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-71ab7-predictor-6b54d7bd58 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-1f938-predictor-59ff946b45-j22r5 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-71ab7-predictor-868947f459 |
SuccessfulCreate |
Created pod: error-404-isvc-71ab7-predictor-868947f459-fxsgw | |
kserve-ci-e2e-test |
multus |
error-404-isvc-71ab7-predictor-868947f459-fxsgw |
AddedInterface |
Add eth0 [10.133.0.32/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-71ab7-predictor-868947f459-fxsgw |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1684" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-71ab7-predictor-868947f459-fxsgw |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-71ab7-predictor-868947f459-fxsgw |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-71ab7-predictor-868947f459-fxsgw |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-71ab7-predictor-868947f459-fxsgw |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-71ab7-predictor-868947f459-fxsgw |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-1f938-predictor-59f689c956-lzsxd |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.34:8643/healthz": context deadline exceeded | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-1f938-predictor-59f689c956-lzsxd |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.34:8080: i/o timeout | |
| (x6) | kserve-ci-e2e-test |
kubelet |
ensemble-graph-1f938-77484598f8-rppn4 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-3d727-predictor-58657f85cc-bp9xf |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-3274f-predictor-554cc4d85f |
SuccessfulCreate |
Created pod: error-404-isvc-3274f-predictor-554cc4d85f-w9hq6 | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-3274f |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-3274f": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-3274f-predictor-cf66786f4 |
SuccessfulCreate |
Created pod: success-200-isvc-3274f-predictor-cf66786f4-9m5t7 | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-3274f |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-3274f": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-3274f": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-3274f-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-3274f-predictor-554cc4d85f from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-3274f-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-3274f-predictor-cf66786f4 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-3274f-predictor-554cc4d85f-w9hq6 |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "error-404-isvc-3274f-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-3274f-predictor-cf66786f4-9m5t7 |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1684" already present on machine | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-3274f |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-3274f": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-3274f": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-3d727-predictor-79f4459548-fkxl5 |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-3d727-predictor-79f4459548-fkxl5 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-3274f |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-3274f": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-3d727-6dd4fd7669-crrj5 |
Killing |
Stopping container sequence-graph-3d727 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-3d727-predictor-58657f85cc-bp9xf |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
multus |
success-200-isvc-3274f-predictor-cf66786f4-9m5t7 |
AddedInterface |
Add eth0 [10.134.0.37/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-3274f-predictor-554cc4d85f-w9hq6 |
Started |
Started container kube-rbac-proxy | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-71ab7-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-3274f-predictor-cf66786f4-9m5t7 |
Started |
Started container kube-rbac-proxy | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-71ab7-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
multus |
error-404-isvc-3274f-predictor-554cc4d85f-w9hq6 |
AddedInterface |
Add eth0 [10.133.0.33/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-3274f-predictor-554cc4d85f-w9hq6 |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1684" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-3274f-predictor-554cc4d85f-w9hq6 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-3274f-predictor-cf66786f4-9m5t7 |
Created |
Created container: kserve-container | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-71ab7-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-3274f-predictor-cf66786f4-9m5t7 |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-3274f-predictor-cf66786f4-9m5t7 |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-71ab7-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-3274f-predictor-554cc4d85f-w9hq6 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-3274f-predictor-554cc4d85f-w9hq6 |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-3274f-predictor-554cc4d85f-w9hq6 |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-3274f-predictor-cf66786f4-9m5t7 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-3d727-predictor-79f4459548-fkxl5 |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.35:8643/healthz": dial tcp 10.134.0.35:8643: connect: connection refused | |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-3d727-predictor-79f4459548-fkxl5 |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.35:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-71ab7-predictor-6b54d7bd58-f96g7 |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.36:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-71ab7-predictor-868947f459-fxsgw |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.32:8080: connect: connection refused |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-71ab7 |
InferenceServiceReady |
InferenceService [success-200-isvc-71ab7] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-71ab7 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-71ab7 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-71ab7 |
InferenceServiceReady |
InferenceService [error-404-isvc-71ab7] is Ready | |
| (x6) | kserve-ci-e2e-test |
kubelet |
sequence-graph-3d727-6dd4fd7669-crrj5 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-3274f-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-3274f-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-3274f-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-3274f-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
deployment-controller |
splitter-graph-71ab7 |
ScalingReplicaSet |
Scaled up replica set splitter-graph-71ab7-7cd696848d from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
splitter-graph-71ab7-7cd696848d |
SuccessfulCreate |
Created pod: splitter-graph-71ab7-7cd696848d-j79lk | |
kserve-ci-e2e-test |
multus |
splitter-graph-71ab7-7cd696848d-j79lk |
AddedInterface |
Add eth0 [10.133.0.34/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-71ab7-7cd696848d-j79lk |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:343c9e455f840436fd086519b55f7daa1173afbafc1b91e08f3c6de9e52e6594" already present on machine | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-71ab7-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
kubelet |
splitter-graph-71ab7-7cd696848d-j79lk |
Created |
Created container: splitter-graph-71ab7 | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-71ab7-7cd696848d-j79lk |
Started |
Started container splitter-graph-71ab7 | |
kserve-ci-e2e-test |
InferenceGraphController |
splitter-graph-71ab7 |
UpdateFailed |
Failed to update status for InferenceGraph "splitter-graph-71ab7": Operation cannot be fulfilled on inferencegraphs.serving.kserve.io "splitter-graph-71ab7": the object has been modified; please apply your changes to the latest version and try again | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-71ab7-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
InferenceGraphController |
splitter-graph-71ab7 |
InternalError |
fails to update InferenceGraph status: Operation cannot be fulfilled on inferencegraphs.serving.kserve.io "splitter-graph-71ab7": the object has been modified; please apply your changes to the latest version and try again | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-71ab7-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
InferenceGraphController |
splitter-graph-71ab7 |
InferenceGraphReady |
InferenceGraph [splitter-graph-71ab7] is Ready | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-71ab7-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-3274f-predictor-cf66786f4-9m5t7 |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.37:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-3274f-predictor-554cc4d85f-w9hq6 |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.33:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-9de39-predictor-6c54447ff5-5mqrh |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-9de39-predictor-7575d6d4cd-ppr27 |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1684" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-71ab7-predictor-868947f459-fxsgw |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-9de39-predictor-6c54447ff5-5mqrh |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-9de39-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-9de39-predictor-6c54447ff5 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-9de39-predictor-6c54447ff5 |
SuccessfulCreate |
Created pod: error-404-isvc-9de39-predictor-6c54447ff5-5mqrh | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-9de39-predictor-6c54447ff5-5mqrh |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
multus |
error-404-isvc-9de39-predictor-6c54447ff5-5mqrh |
AddedInterface |
Add eth0 [10.133.0.35/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-9de39-predictor-6c54447ff5-5mqrh |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1684" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-9de39-predictor-6c54447ff5-5mqrh |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-9de39-predictor-6c54447ff5-5mqrh |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-9de39-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-9de39-predictor-7575d6d4cd from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-71ab7-7cd696848d-j79lk |
Killing |
Stopping container splitter-graph-71ab7 | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-9de39-predictor-7575d6d4cd |
SuccessfulCreate |
Created pod: success-200-isvc-9de39-predictor-7575d6d4cd-ppr27 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-71ab7-predictor-6b54d7bd58-f96g7 |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-71ab7-predictor-6b54d7bd58-f96g7 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-71ab7-predictor-868947f459-fxsgw |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-9de39-predictor-7575d6d4cd-ppr27 |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-9de39-predictor-7575d6d4cd-ppr27 |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-9de39-predictor-7575d6d4cd-ppr27 |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-9de39-predictor-7575d6d4cd-ppr27 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-9de39-predictor-7575d6d4cd-ppr27 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
multus |
success-200-isvc-9de39-predictor-7575d6d4cd-ppr27 |
AddedInterface |
Add eth0 [10.134.0.38/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-71ab7-predictor-6b54d7bd58-f96g7 |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.36:8643/healthz": dial tcp 10.134.0.36:8643: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-71ab7-predictor-868947f459-fxsgw |
Unhealthy |
Readiness probe failed: Get "https://10.133.0.32:8643/healthz": context deadline exceeded | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-3274f |
InferenceServiceReady |
InferenceService [success-200-isvc-3274f] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-3274f |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-3274f |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-3274f |
InferenceServiceReady |
InferenceService [error-404-isvc-3274f] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
switch-graph-3274f |
ScalingReplicaSet |
Scaled up replica set switch-graph-3274f-78b9ff9b6 from 0 to 1 | |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-3274f |
InferenceGraphReady |
InferenceGraph [switch-graph-3274f] is Ready | |
kserve-ci-e2e-test |
replicaset-controller |
switch-graph-3274f-78b9ff9b6 |
SuccessfulCreate |
Created pod: switch-graph-3274f-78b9ff9b6-mr4hr | |
kserve-ci-e2e-test |
kubelet |
switch-graph-3274f-78b9ff9b6-mr4hr |
Created |
Created container: switch-graph-3274f | |
kserve-ci-e2e-test |
multus |
switch-graph-3274f-78b9ff9b6-mr4hr |
AddedInterface |
Add eth0 [10.133.0.36/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
switch-graph-3274f-78b9ff9b6-mr4hr |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:343c9e455f840436fd086519b55f7daa1173afbafc1b91e08f3c6de9e52e6594" already present on machine | |
kserve-ci-e2e-test |
kubelet |
switch-graph-3274f-78b9ff9b6-mr4hr |
Started |
Started container switch-graph-3274f | |
| (x6) | kserve-ci-e2e-test |
kubelet |
splitter-graph-71ab7-7cd696848d-j79lk |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-9de39-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-9de39-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-9de39-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-9de39-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-3274f |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-3274f-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-3274f-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-3274f |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-9de39-predictor-6c54447ff5-5mqrh |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.35:8080: connect: connection refused |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-9de39 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-9de39 |
InferenceServiceReady |
InferenceService [success-200-isvc-9de39] is Ready | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-9de39 |
InferenceServiceReady |
InferenceService [error-404-isvc-9de39] is Ready | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-3274f |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-9de39 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-3274f |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-3274f-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-3274f-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
multus |
splitter-graph-9de39-68884c5cfc-t9prr |
AddedInterface |
Add eth0 [10.133.0.37/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-9de39-68884c5cfc-t9prr |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:343c9e455f840436fd086519b55f7daa1173afbafc1b91e08f3c6de9e52e6594" already present on machine | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-9de39-68884c5cfc-t9prr |
Created |
Created container: splitter-graph-9de39 | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-9de39-68884c5cfc-t9prr |
Started |
Started container splitter-graph-9de39 | |
kserve-ci-e2e-test |
replicaset-controller |
splitter-graph-9de39-68884c5cfc |
SuccessfulCreate |
Created pod: splitter-graph-9de39-68884c5cfc-t9prr | |
kserve-ci-e2e-test |
InferenceGraphController |
splitter-graph-9de39 |
InferenceGraphReady |
InferenceGraph [splitter-graph-9de39] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
splitter-graph-9de39 |
ScalingReplicaSet |
Scaled up replica set splitter-graph-9de39-68884c5cfc from 0 to 1 | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-9de39-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-9de39-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-9de39-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-9de39-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
splitter-graph-9de39 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
splitter-graph-9de39 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
splitter-graph-9de39-68884c5cfc-t9prr |
Killing |
Stopping container splitter-graph-9de39 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-9de39-predictor-6c54447ff5-5mqrh |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-9de39-predictor-6c54447ff5-5mqrh |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-9de39-predictor-7575d6d4cd-ppr27 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-9de39-predictor-7575d6d4cd-ppr27 |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-9de39-predictor-7575d6d4cd-ppr27 |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.38:8643/healthz": dial tcp 10.134.0.38:8643: connect: connection refused | |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-9de39-predictor-7575d6d4cd-ppr27 |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.38:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
splitter-graph-9de39-68884c5cfc-t9prr |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
kubelet |
switch-graph-3274f-78b9ff9b6-mr4hr |
Killing |
Stopping container switch-graph-3274f | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-3274f-predictor-cf66786f4-9m5t7 |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-3274f-predictor-554cc4d85f-w9hq6 |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-3274f-predictor-cf66786f4-9m5t7 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-3274f-predictor-554cc4d85f-w9hq6 |
Killing |
Stopping container kserve-container | |
| (x6) | kserve-ci-e2e-test |
kubelet |
switch-graph-3274f-78b9ff9b6-mr4hr |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |